2023-12-07T15:40:05.986 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-07T15:40:05.986 DEBUG:teuthology.run:Teuthology command: teuthology --name gabrioux-2023-12-07_15:07:54-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi --archive /home/teuthworker/archive/gabrioux-2023-12-07_15:07:54-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7482152 --verbose --description orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --owner scheduled_gabrioux@teuthology -- /home/teuthworker/archive/gabrioux-2023-12-07_15:07:54-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7482152/orig.config.yaml 2023-12-07T15:40:06.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T15:40:06.133 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gabrioux-2023-12-07_15:07:54-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7482152 branch: wip-guits-testing-2023-12-05-0857 description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: gabrioux@redhat.com first_in_suite: false job_id: '7482152' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: gabrioux-2023-12-07_15:07:54-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-guits-testing-2023-12-05-0857 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: e6605fb8725c25c4838cef6a39f30df73f1ed149 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: e6605fb8725c25c4838cef6a39f30df73f1ed149 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-guits-testing-2023-12-05-0857 sha1: e6605fb8725c25c4838cef6a39f30df73f1ed149 owner: scheduled_gabrioux@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 6586 sha1: e6605fb8725c25c4838cef6a39f30df73f1ed149 sleep_before_teardown: 0 subset: 1/8 suite: orch:cephadm suite_branch: wip-guits-testing-2023-12-05-0857 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e6605fb8725c25c4838cef6a39f30df73f1ed149/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: e6605fb8725c25c4838cef6a39f30df73f1ed149 targets: smithi063.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMdkX0ifMc5MQBPHmmPkTr/2PPmk54gQ93LPTI2VSnNEEqw52sTbA95fqtHxqxTXjj0yHWt3dI3DP4guGqHJb28= smithi152.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEKgUZN/csJi3+K7rT8Y1M6Cn9VpHCOy/ZwbazjO1Ae+Okm2FeIKHCkw+75HBd5DT2vY5V2QZRguAupLm4yD1ac= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/gabrioux/src/git.ceph.com_ceph-c_wip-guits-testing-2023-12-05-0857/qa/suites/orch/cephadm/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-12-07_15:07:54 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: gabrioux verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2023-12-07T15:40:06.133 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e6605fb8725c25c4838cef6a39f30df73f1ed149/qa; will attempt to use it 2023-12-07T15:40:06.134 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e6605fb8725c25c4838cef6a39f30df73f1ed149/qa/tasks 2023-12-07T15:40:06.134 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-07T15:40:06.136 INFO:teuthology.task.internal:Checking packages... 2023-12-07T15:40:06.160 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e6605fb8725c25c4838cef6a39f30df73f1ed149' 2023-12-07T15:40:06.160 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-07T15:40:06.160 INFO:teuthology.packaging:ref: None 2023-12-07T15:40:06.160 INFO:teuthology.packaging:tag: None 2023-12-07T15:40:06.160 INFO:teuthology.packaging:branch: wip-guits-testing-2023-12-05-0857 2023-12-07T15:40:06.160 INFO:teuthology.packaging:sha1: e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-07T15:40:06.160 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-guits-testing-2023-12-05-0857 2023-12-07T15:40:06.296 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-13.ge6605fb8 2023-12-07T15:40:06.296 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-07T15:40:06.303 INFO:teuthology.task.internal:no buildpackages task found 2023-12-07T15:40:06.303 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-07T15:40:06.352 INFO:teuthology.task.internal:Saving configuration 2023-12-07T15:40:06.372 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-07T15:40:06.378 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-07T15:40:06.404 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-12-07_15:07:54-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7482152', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 15:34:58.274293', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMdkX0ifMc5MQBPHmmPkTr/2PPmk54gQ93LPTI2VSnNEEqw52sTbA95fqtHxqxTXjj0yHWt3dI3DP4guGqHJb28='} 2023-12-07T15:40:06.429 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-12-07_15:07:54-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7482152', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 15:34:58.276243', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEKgUZN/csJi3+K7rT8Y1M6Cn9VpHCOy/ZwbazjO1Ae+Okm2FeIKHCkw+75HBd5DT2vY5V2QZRguAupLm4yD1ac='} 2023-12-07T15:40:06.429 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-07T15:40:06.437 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2023-12-07T15:40:06.437 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2023-12-07T15:40:06.437 INFO:teuthology.run_tasks:Running task console_log... 2023-12-07T15:40:06.510 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8af75dcf70>, signals=[15]) 2023-12-07T15:40:06.511 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-07T15:40:06.518 INFO:teuthology.task.internal:Opening connections... 2023-12-07T15:40:06.518 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi063.front.sepia.ceph.com 2023-12-07T15:40:06.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T15:40:06.589 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2023-12-07T15:40:06.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T15:40:06.659 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-07T15:40:06.665 DEBUG:teuthology.orchestra.run.smithi063:> uname -m 2023-12-07T15:40:06.688 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2023-12-07T15:40:06.689 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2023-12-07T15:40:06.750 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream" 2023-12-07T15:40:06.751 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="8" 2023-12-07T15:40:06.751 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos" 2023-12-07T15:40:06.751 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora" 2023-12-07T15:40:06.751 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="8" 2023-12-07T15:40:06.751 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el8" 2023-12-07T15:40:06.751 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-07T15:40:06.751 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31" 2023-12-07T15:40:06.751 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-07T15:40:06.751 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/" 2023-12-07T15:40:06.751 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-07T15:40:06.751 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-07T15:40:06.751 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-07T15:40:06.752 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2023-12-07T15:40:06.787 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2023-12-07T15:40:06.809 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2023-12-07T15:40:06.809 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-12-07T15:40:06.870 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2023-12-07T15:40:06.871 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8" 2023-12-07T15:40:06.871 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2023-12-07T15:40:06.871 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2023-12-07T15:40:06.871 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8" 2023-12-07T15:40:06.871 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2023-12-07T15:40:06.871 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-07T15:40:06.871 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-12-07T15:40:06.871 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-07T15:40:06.871 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2023-12-07T15:40:06.871 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-07T15:40:06.872 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-07T15:40:06.872 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-07T15:40:06.872 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-12-07T15:40:07.113 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-07T15:40:07.122 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-07T15:40:07.127 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-07T15:40:07.128 DEBUG:teuthology.orchestra.run.smithi063:> test '!' -e /home/ubuntu/cephtest 2023-12-07T15:40:07.130 DEBUG:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2023-12-07T15:40:07.151 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-07T15:40:07.157 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-07T15:40:07.157 DEBUG:teuthology.orchestra.run.smithi063:> test -z $(ls -A /var/lib/ceph) 2023-12-07T15:40:07.192 DEBUG:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2023-12-07T15:40:07.226 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-07T15:40:07.279 INFO:teuthology.run_tasks:Running task kernel... 2023-12-07T15:40:07.294 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-07T15:40:07.294 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-07T15:40:07.294 DEBUG:teuthology.orchestra.run.smithi063:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-07T15:40:07.295 DEBUG:teuthology.orchestra.run.smithi152:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-07T15:40:07.315 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T15:40:07.316 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2023-12-07T15:40:07.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T15:40:07.317 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2023-12-07T15:40:07.379 INFO:teuthology.orchestra.run.smithi063.stdout:4.18.0-489.el8.x86_64 2023-12-07T15:40:07.379 INFO:teuthology.orchestra.run.smithi152.stdout:4.18.0-489.el8.x86_64 2023-12-07T15:40:07.379 INFO:teuthology.task.kernel:Running kernel on smithi063: 4.18.0-489.el8.x86_64 2023-12-07T15:40:07.380 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum install -y kernel 2023-12-07T15:40:07.380 INFO:teuthology.task.kernel:Running kernel on smithi152: 4.18.0-489.el8.x86_64 2023-12-07T15:40:07.380 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum install -y kernel 2023-12-07T15:40:23.278 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 8 - AppStream 2.6 MB/s | 34 MB 00:13 2023-12-07T15:40:31.945 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - AppStream 1.6 MB/s | 34 MB 00:21 2023-12-07T15:40:33.611 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 8 - BaseOS 15 MB/s | 55 MB 00:03 2023-12-07T15:40:40.795 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - BaseOS 21 MB/s | 55 MB 00:02 2023-12-07T15:40:42.277 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 8 - Extras 48 kB/s | 18 kB 00:00 2023-12-07T15:40:42.862 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 6.9 kB 00:00 2023-12-07T15:40:43.204 INFO:teuthology.orchestra.run.smithi063.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2023-12-07T15:40:44.897 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2023-12-07T15:40:49.005 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 222 kB/s | 24 kB 00:00 2023-12-07T15:40:49.045 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - Extras 40 kB/s | 18 kB 00:00 2023-12-07T15:40:49.612 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 6.9 kB 00:00 2023-12-07T15:40:49.922 INFO:teuthology.orchestra.run.smithi152.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-12-07T15:40:51.009 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-12-07T15:40:52.813 INFO:teuthology.orchestra.run.smithi063.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-12-07T15:40:52.813 INFO:teuthology.orchestra.run.smithi063.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-12-07T15:40:53.123 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T15:40:53.124 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T15:40:53.124 INFO:teuthology.orchestra.run.smithi063.stdout: Package Architecture Version Repository Size 2023-12-07T15:40:53.124 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T15:40:53.124 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-07T15:40:53.124 INFO:teuthology.orchestra.run.smithi063.stdout: kernel x86_64 4.18.0-526.el8 baseos 10 M 2023-12-07T15:40:53.124 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2023-12-07T15:40:53.124 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-core x86_64 4.18.0-526.el8 baseos 43 M 2023-12-07T15:40:53.124 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules x86_64 4.18.0-526.el8 baseos 36 M 2023-12-07T15:40:53.124 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T15:40:53.124 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-07T15:40:53.124 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T15:40:53.124 INFO:teuthology.orchestra.run.smithi063.stdout:Install 3 Packages 2023-12-07T15:40:53.125 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T15:40:53.125 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 90 M 2023-12-07T15:40:53.125 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 96 M 2023-12-07T15:40:53.125 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-07T15:40:54.498 INFO:teuthology.orchestra.run.smithi063.stdout:(1/3): kernel-4.18.0-526.el8.x86_64.rpm 8.6 MB/s | 10 MB 00:01 2023-12-07T15:40:54.832 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 397 kB/s | 24 kB 00:00 2023-12-07T15:40:55.515 INFO:teuthology.orchestra.run.smithi063.stdout:(2/3): kernel-modules-4.18.0-526.el8.x86_64.rpm 16 MB/s | 36 MB 00:02 2023-12-07T15:40:56.116 INFO:teuthology.orchestra.run.smithi063.stdout:(3/3): kernel-core-4.18.0-526.el8.x86_64.rpm 15 MB/s | 43 MB 00:02 2023-12-07T15:40:56.117 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-07T15:40:56.117 INFO:teuthology.orchestra.run.smithi063.stdout:Total 30 MB/s | 90 MB 00:02 2023-12-07T15:40:56.830 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-07T15:40:57.270 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-07T15:40:57.270 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-07T15:40:58.506 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-12-07T15:40:58.507 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-12-07T15:40:58.577 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-07T15:40:58.600 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-07T15:40:58.820 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T15:40:58.820 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T15:40:58.820 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2023-12-07T15:40:58.821 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T15:40:58.821 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-07T15:40:58.821 INFO:teuthology.orchestra.run.smithi152.stdout: kernel x86_64 4.18.0-526.el8 baseos 10 M 2023-12-07T15:40:58.821 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-12-07T15:40:58.821 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-core x86_64 4.18.0-526.el8 baseos 43 M 2023-12-07T15:40:58.821 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules x86_64 4.18.0-526.el8 baseos 36 M 2023-12-07T15:40:58.821 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T15:40:58.821 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-07T15:40:58.821 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T15:40:58.821 INFO:teuthology.orchestra.run.smithi152.stdout:Install 3 Packages 2023-12-07T15:40:58.821 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T15:40:58.822 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 90 M 2023-12-07T15:40:58.822 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 96 M 2023-12-07T15:40:58.822 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-07T15:41:00.133 INFO:teuthology.orchestra.run.smithi152.stdout:(1/3): kernel-4.18.0-526.el8.x86_64.rpm 8.0 MB/s | 10 MB 00:01 2023-12-07T15:41:01.133 INFO:teuthology.orchestra.run.smithi152.stdout:(2/3): kernel-modules-4.18.0-526.el8.x86_64.rpm 16 MB/s | 36 MB 00:02 2023-12-07T15:41:01.553 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-07T15:41:01.758 INFO:teuthology.orchestra.run.smithi152.stdout:(3/3): kernel-core-4.18.0-526.el8.x86_64.rpm 15 MB/s | 43 MB 00:02 2023-12-07T15:41:01.759 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-07T15:41:01.759 INFO:teuthology.orchestra.run.smithi152.stdout:Total 30 MB/s | 90 MB 00:02 2023-12-07T15:41:02.040 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-core-4.18.0-526.el8.x86_64 1/3 2023-12-07T15:41:02.435 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-07T15:41:02.863 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-07T15:41:02.863 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-07T15:41:04.120 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-07T15:41:04.141 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-07T15:41:05.855 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-core-4.18.0-526.el8.x86_64 1/3 2023-12-07T15:41:06.232 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-modules-4.18.0-526.el8.x86_64 2/3 2023-12-07T15:41:06.922 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-07T15:41:07.472 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-core-4.18.0-526.el8.x86_64 1/3 2023-12-07T15:41:09.906 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-4.18.0-526.el8.x86_64 2/3 2023-12-07T15:41:10.174 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-4.18.0-526.el8.x86_64 3/3 2023-12-07T15:41:11.094 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-core-4.18.0-526.el8.x86_64 1/3 2023-12-07T15:41:11.530 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-modules-4.18.0-526.el8.x86_64 2/3 2023-12-07T15:41:14.965 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-4.18.0-526.el8.x86_64 2/3 2023-12-07T15:41:15.261 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-4.18.0-526.el8.x86_64 3/3 2023-12-07T15:41:33.503 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-core-4.18.0-526.el8.x86_64 3/3 2023-12-07T15:41:33.528 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-4.18.0-526.el8.x86_64 3/3 2023-12-07T15:41:33.893 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-4.18.0-526.el8.x86_64 3/3 2023-12-07T15:41:33.893 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-4.18.0-526.el8.x86_64 1/3 2023-12-07T15:41:33.893 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-core-4.18.0-526.el8.x86_64 2/3 2023-12-07T15:41:34.714 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-modules-4.18.0-526.el8.x86_64 3/3 2023-12-07T15:41:34.714 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T15:41:34.714 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-07T15:41:34.714 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-4.18.0-526.el8.x86_64 kernel-core-4.18.0-526.el8.x86_64 2023-12-07T15:41:34.714 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules-4.18.0-526.el8.x86_64 2023-12-07T15:41:34.715 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T15:41:34.715 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T15:41:35.684 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q kernel | sort -rV | head -n 1 2023-12-07T15:41:35.916 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-4.18.0-526.el8.x86_64 2023-12-07T15:41:35.917 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-526.el8.x86_64 2023-12-07T15:41:35.917 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-526.el8.x86_64 2023-12-07T15:41:35.917 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-07T15:41:35.917 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-07T15:41:35.917 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2023-12-07T15:41:35.917 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi063.front.sepia.ceph.com, path=None, version=distro) 2023-12-07T15:41:35.917 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q kernel | sort -rV | head -n 1 2023-12-07T15:41:36.135 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-4.18.0-526.el8.x86_64 2023-12-07T15:41:36.136 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-526.el8.x86_64 2023-12-07T15:41:36.136 DEBUG:teuthology.orchestra.run.smithi063:> sudo rpm -qi grub2-tools 2023-12-07T15:41:36.170 INFO:teuthology.orchestra.run.smithi063.stdout:Name : grub2-tools 2023-12-07T15:41:36.170 INFO:teuthology.orchestra.run.smithi063.stdout:Epoch : 1 2023-12-07T15:41:36.170 INFO:teuthology.orchestra.run.smithi063.stdout:Version : 2.02 2023-12-07T15:41:36.171 INFO:teuthology.orchestra.run.smithi063.stdout:Release : 129.el8 2023-12-07T15:41:36.171 INFO:teuthology.orchestra.run.smithi063.stdout:Architecture: x86_64 2023-12-07T15:41:36.171 INFO:teuthology.orchestra.run.smithi063.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-07T15:41:36.171 INFO:teuthology.orchestra.run.smithi063.stdout:Group : System Environment/Base 2023-12-07T15:41:36.171 INFO:teuthology.orchestra.run.smithi063.stdout:Size : 9265586 2023-12-07T15:41:36.171 INFO:teuthology.orchestra.run.smithi063.stdout:License : GPLv3+ 2023-12-07T15:41:36.171 INFO:teuthology.orchestra.run.smithi063.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-07T15:41:36.171 INFO:teuthology.orchestra.run.smithi063.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-07T15:41:36.171 INFO:teuthology.orchestra.run.smithi063.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-07T15:41:36.171 INFO:teuthology.orchestra.run.smithi063.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-07T15:41:36.171 INFO:teuthology.orchestra.run.smithi063.stdout:Relocations : (not relocatable) 2023-12-07T15:41:36.171 INFO:teuthology.orchestra.run.smithi063.stdout:Packager : CentOS BuildSystem 2023-12-07T15:41:36.171 INFO:teuthology.orchestra.run.smithi063.stdout:Vendor : CentOS 2023-12-07T15:41:36.171 INFO:teuthology.orchestra.run.smithi063.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-07T15:41:36.171 INFO:teuthology.orchestra.run.smithi063.stdout:Summary : Support tools for GRUB. 2023-12-07T15:41:36.172 INFO:teuthology.orchestra.run.smithi063.stdout:Description : 2023-12-07T15:41:36.172 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T15:41:36.172 INFO:teuthology.orchestra.run.smithi063.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-07T15:41:36.172 INFO:teuthology.orchestra.run.smithi063.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-07T15:41:36.172 INFO:teuthology.orchestra.run.smithi063.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-07T15:41:36.172 INFO:teuthology.orchestra.run.smithi063.stdout:hardware devices. 2023-12-07T15:41:36.172 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T15:41:36.172 INFO:teuthology.orchestra.run.smithi063.stdout:This subpackage provides tools for support of all platforms. 2023-12-07T15:41:36.173 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-07T15:41:36.173 INFO:teuthology.task.kernel:Updating grub on smithi063 to boot 4.18.0-526.el8.x86_64 2023-12-07T15:41:36.173 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-07T15:41:37.090 INFO:teuthology.orchestra.run.smithi063.stderr:Generating grub configuration file ... 2023-12-07T15:41:37.169 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-core-4.18.0-526.el8.x86_64 3/3 2023-12-07T15:41:37.193 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-4.18.0-526.el8.x86_64 3/3 2023-12-07T15:41:37.560 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-4.18.0-526.el8.x86_64 3/3 2023-12-07T15:41:37.560 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-4.18.0-526.el8.x86_64 1/3 2023-12-07T15:41:37.560 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-core-4.18.0-526.el8.x86_64 2/3 2023-12-07T15:41:38.358 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-modules-4.18.0-526.el8.x86_64 3/3 2023-12-07T15:41:38.358 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T15:41:38.358 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-07T15:41:38.358 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-4.18.0-526.el8.x86_64 kernel-core-4.18.0-526.el8.x86_64 2023-12-07T15:41:38.358 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-4.18.0-526.el8.x86_64 2023-12-07T15:41:38.358 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T15:41:38.358 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T15:41:38.514 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel | sort -rV | head -n 1 2023-12-07T15:41:38.733 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-4.18.0-526.el8.x86_64 2023-12-07T15:41:38.733 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-526.el8.x86_64 2023-12-07T15:41:38.733 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-526.el8.x86_64 2023-12-07T15:41:38.733 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-07T15:41:38.733 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-07T15:41:38.733 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2023-12-07T15:41:38.733 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi152.front.sepia.ceph.com, path=None, version=distro) 2023-12-07T15:41:38.733 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel | sort -rV | head -n 1 2023-12-07T15:41:38.943 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-4.18.0-526.el8.x86_64 2023-12-07T15:41:38.943 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-526.el8.x86_64 2023-12-07T15:41:38.943 DEBUG:teuthology.orchestra.run.smithi152:> sudo rpm -qi grub2-tools 2023-12-07T15:41:38.977 INFO:teuthology.orchestra.run.smithi152.stdout:Name : grub2-tools 2023-12-07T15:41:38.977 INFO:teuthology.orchestra.run.smithi152.stdout:Epoch : 1 2023-12-07T15:41:38.977 INFO:teuthology.orchestra.run.smithi152.stdout:Version : 2.02 2023-12-07T15:41:38.977 INFO:teuthology.orchestra.run.smithi152.stdout:Release : 129.el8 2023-12-07T15:41:38.977 INFO:teuthology.orchestra.run.smithi152.stdout:Architecture: x86_64 2023-12-07T15:41:38.978 INFO:teuthology.orchestra.run.smithi152.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-07T15:41:38.978 INFO:teuthology.orchestra.run.smithi152.stdout:Group : System Environment/Base 2023-12-07T15:41:38.978 INFO:teuthology.orchestra.run.smithi152.stdout:Size : 9265586 2023-12-07T15:41:38.978 INFO:teuthology.orchestra.run.smithi152.stdout:License : GPLv3+ 2023-12-07T15:41:38.978 INFO:teuthology.orchestra.run.smithi152.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-07T15:41:38.978 INFO:teuthology.orchestra.run.smithi152.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-07T15:41:38.978 INFO:teuthology.orchestra.run.smithi152.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-07T15:41:38.978 INFO:teuthology.orchestra.run.smithi152.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-07T15:41:38.978 INFO:teuthology.orchestra.run.smithi152.stdout:Relocations : (not relocatable) 2023-12-07T15:41:38.978 INFO:teuthology.orchestra.run.smithi152.stdout:Packager : CentOS BuildSystem 2023-12-07T15:41:38.978 INFO:teuthology.orchestra.run.smithi152.stdout:Vendor : CentOS 2023-12-07T15:41:38.979 INFO:teuthology.orchestra.run.smithi152.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-07T15:41:38.979 INFO:teuthology.orchestra.run.smithi152.stdout:Summary : Support tools for GRUB. 2023-12-07T15:41:38.979 INFO:teuthology.orchestra.run.smithi152.stdout:Description : 2023-12-07T15:41:38.979 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T15:41:38.979 INFO:teuthology.orchestra.run.smithi152.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-07T15:41:38.979 INFO:teuthology.orchestra.run.smithi152.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-07T15:41:38.979 INFO:teuthology.orchestra.run.smithi152.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-07T15:41:38.979 INFO:teuthology.orchestra.run.smithi152.stdout:hardware devices. 2023-12-07T15:41:38.979 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T15:41:38.979 INFO:teuthology.orchestra.run.smithi152.stdout:This subpackage provides tools for support of all platforms. 2023-12-07T15:41:38.980 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-07T15:41:38.980 INFO:teuthology.task.kernel:Updating grub on smithi152 to boot 4.18.0-526.el8.x86_64 2023-12-07T15:41:38.980 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-07T15:41:39.073 INFO:teuthology.orchestra.run.smithi063.stderr:done 2023-12-07T15:41:39.075 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2023-12-07T15:41:39.107 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.I7v7ikSwLH 2023-12-07T15:41:39.107 DEBUG:teuthology.orchestra.run.smithi063:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.I7v7ikSwLH 2023-12-07T15:41:39.182 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.I7v7ikSwLH 2023-12-07T15:41:39.325 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.I7v7ikSwLH is 6KB 2023-12-07T15:41:39.373 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.I7v7ikSwLH 2023-12-07T15:41:39.391 DEBUG:teuthology.orchestra.run.smithi063:> sudo /bin/ls /boot/loader/entries || true 2023-12-07T15:41:39.464 INFO:teuthology.orchestra.run.smithi063.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-07T15:41:39.464 INFO:teuthology.orchestra.run.smithi063.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-07T15:41:39.464 INFO:teuthology.orchestra.run.smithi063.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-07T15:41:39.464 INFO:teuthology.orchestra.run.smithi063.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-526.el8.x86_64.conf 2023-12-07T15:41:39.465 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-526.el8.x86_64 2023-12-07T15:41:39.607 DEBUG:teuthology.orchestra.run.smithi063:> sudo shutdown -r now 2023-12-07T15:41:40.799 INFO:teuthology.orchestra.run.smithi152.stderr:Generating grub configuration file ... 2023-12-07T15:41:42.932 INFO:teuthology.orchestra.run.smithi152.stderr:done 2023-12-07T15:41:42.934 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2023-12-07T15:41:42.966 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.mOihUQ2XzB 2023-12-07T15:41:42.966 DEBUG:teuthology.orchestra.run.smithi152:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.mOihUQ2XzB 2023-12-07T15:41:43.040 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.mOihUQ2XzB 2023-12-07T15:41:43.180 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.mOihUQ2XzB is 6KB 2023-12-07T15:41:43.229 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.mOihUQ2XzB 2023-12-07T15:41:43.247 DEBUG:teuthology.orchestra.run.smithi152:> sudo /bin/ls /boot/loader/entries || true 2023-12-07T15:41:43.329 INFO:teuthology.orchestra.run.smithi152.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-07T15:41:43.329 INFO:teuthology.orchestra.run.smithi152.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-07T15:41:43.329 INFO:teuthology.orchestra.run.smithi152.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-07T15:41:43.330 INFO:teuthology.orchestra.run.smithi152.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-526.el8.x86_64.conf 2023-12-07T15:41:43.331 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-526.el8.x86_64 2023-12-07T15:41:43.497 DEBUG:teuthology.orchestra.run.smithi152:> sudo shutdown -r now 2023-12-07T15:42:09.634 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2023-12-07T15:42:09.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-07T15:42:09.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T15:42:13.502 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2023-12-07T15:42:13.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-07T15:42:13.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T15:42:28.194 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-12-07T15:42:32.034 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-07T15:42:37.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-07T15:42:37.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T15:42:40.258 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-12-07T15:42:41.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-07T15:42:41.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T15:42:44.102 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-07T15:42:52.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-07T15:42:52.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T15:42:56.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-07T15:42:56.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T15:43:10.694 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-12-07T15:43:25.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-07T15:43:25.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T15:43:26.149 DEBUG:teuthology.orchestra.run.smithi063:> true 2023-12-07T15:43:26.490 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-07T15:43:26.490 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "4.18.0-526.el8.x86_64"... 2023-12-07T15:43:26.490 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2023-12-07T15:43:26.548 INFO:teuthology.orchestra.run.smithi063.stdout:4.18.0-526.el8.x86_64 2023-12-07T15:43:26.548 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-526.el8.x86_64 vs 4.18.0-526.el8.x86_64 2023-12-07T15:43:26.548 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-07T15:43:26.548 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-07T15:43:27.550 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2023-12-07T15:43:27.550 DEBUG:teuthology.orchestra.run.smithi063:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-07T15:43:27.629 INFO:teuthology.orchestra.run.smithi063.stdout:ttyS1 2023-12-07T15:43:27.646 DEBUG:teuthology.parallel:result is None 2023-12-07T15:43:56.110 DEBUG:teuthology.orchestra.remote:timed out 2023-12-07T15:44:11.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-07T15:44:11.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T15:44:11.504 DEBUG:teuthology.orchestra.run.smithi152:> true 2023-12-07T15:44:11.796 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-07T15:44:11.797 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "4.18.0-526.el8.x86_64"... 2023-12-07T15:44:11.797 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2023-12-07T15:44:11.816 INFO:teuthology.orchestra.run.smithi152.stdout:4.18.0-526.el8.x86_64 2023-12-07T15:44:11.816 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-526.el8.x86_64 vs 4.18.0-526.el8.x86_64 2023-12-07T15:44:11.817 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-07T15:44:11.817 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-07T15:44:12.817 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2023-12-07T15:44:12.818 DEBUG:teuthology.orchestra.run.smithi152:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-07T15:44:12.893 INFO:teuthology.orchestra.run.smithi152.stdout:ttyS1 2023-12-07T15:44:12.909 DEBUG:teuthology.parallel:result is None 2023-12-07T15:44:12.910 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-07T15:44:12.918 INFO:teuthology.task.internal:Creating test directory... 2023-12-07T15:44:12.919 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-07T15:44:12.922 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-07T15:44:12.944 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-07T15:44:12.955 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-07T15:44:12.969 INFO:teuthology.task.internal:Creating archive directory... 2023-12-07T15:44:12.970 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-07T15:44:12.986 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-07T15:44:13.025 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-07T15:44:13.032 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-07T15:44:13.033 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-07T15:44:13.062 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-07T15:44:13.101 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-07T15:44:13.104 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-07T15:44:13.113 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-07T15:44:13.115 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-07T15:44:13.116 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-07T15:44:13.125 INFO:teuthology.task.internal:Configuring sudo... 2023-12-07T15:44:13.125 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-07T15:44:13.157 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-07T15:44:13.188 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-07T15:44:13.201 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-07T15:44:13.201 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-07T15:44:13.230 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-07T15:44:13.249 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-07T15:44:13.337 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-07T15:44:13.386 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-07T15:44:13.473 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-07T15:44:13.518 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-07T15:44:13.518 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-07T15:44:13.586 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-07T15:44:13.636 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-07T15:44:13.690 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-07T15:44:13.777 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-07T15:44:13.821 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-07T15:44:13.822 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-07T15:44:13.891 DEBUG:teuthology.orchestra.run.smithi063:> sudo service rsyslog restart 2023-12-07T15:44:13.893 DEBUG:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart 2023-12-07T15:44:13.961 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-07T15:44:13.988 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-07T15:44:14.421 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-07T15:44:14.429 INFO:teuthology.task.internal:Starting timer... 2023-12-07T15:44:14.430 INFO:teuthology.run_tasks:Running task pcp... 2023-12-07T15:44:14.443 INFO:teuthology.run_tasks:Running task selinux... 2023-12-07T15:44:14.457 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-12-07T15:44:14.457 DEBUG:teuthology.orchestra.run.smithi063:> sudo service auditd rotate 2023-12-07T15:44:14.561 INFO:teuthology.orchestra.run.smithi063.stdout:Rotating logs: 2023-12-07T15:44:14.563 DEBUG:teuthology.orchestra.run.smithi152:> sudo service auditd rotate 2023-12-07T15:44:14.641 INFO:teuthology.orchestra.run.smithi152.stdout:Rotating logs: 2023-12-07T15:44:14.643 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-07T15:44:14.643 DEBUG:teuthology.orchestra.run.smithi063:> /usr/sbin/getenforce 2023-12-07T15:44:14.673 INFO:teuthology.orchestra.run.smithi063.stdout:Permissive 2023-12-07T15:44:14.673 DEBUG:teuthology.orchestra.run.smithi152:> /usr/sbin/getenforce 2023-12-07T15:44:14.699 INFO:teuthology.orchestra.run.smithi152.stdout:Permissive 2023-12-07T15:44:14.699 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi063.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi152.front.sepia.ceph.com': 'permissive'} 2023-12-07T15:44:14.699 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-07T15:44:14.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T15:44:14.742 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-07T15:44:14.769 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T15:44:14.769 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-07T15:44:14.769 DEBUG:teuthology.orchestra.run.smithi063:> sudo /usr/sbin/setenforce permissive 2023-12-07T15:44:14.811 DEBUG:teuthology.orchestra.run.smithi152:> sudo /usr/sbin/setenforce permissive 2023-12-07T15:44:14.837 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-07T15:44:14.847 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-07T15:44:14.847 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-07T15:44:14.867 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-07T15:44:14.868 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi063.front.sepia.ceph.com,smithi152.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-07T16:00:07.003 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi063.front.sepia.ceph.com'), Remote(name='ubuntu@smithi152.front.sepia.ceph.com')] 2023-12-07T16:00:07.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-07T16:00:07.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T16:00:07.073 DEBUG:teuthology.orchestra.run.smithi063:> true 2023-12-07T16:00:07.140 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-07T16:00:07.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-07T16:00:07.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T16:00:07.208 DEBUG:teuthology.orchestra.run.smithi152:> true 2023-12-07T16:00:07.275 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-07T16:00:07.276 INFO:teuthology.run_tasks:Running task clock... 2023-12-07T16:00:07.286 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-07T16:00:07.287 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-07T16:00:07.287 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-07T16:00:07.289 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-07T16:00:07.290 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-07T16:00:07.319 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-07T16:00:07.333 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-07T16:00:07.348 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-07T16:00:07.361 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-07T16:00:07.393 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: ntpd: command not found 2023-12-07T16:00:07.404 INFO:teuthology.orchestra.run.smithi063.stdout:506 Cannot talk to daemon 2023-12-07T16:00:07.418 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-07T16:00:07.433 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-07T16:00:07.434 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: ntpd: command not found 2023-12-07T16:00:07.445 INFO:teuthology.orchestra.run.smithi152.stdout:506 Cannot talk to daemon 2023-12-07T16:00:07.459 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-07T16:00:07.472 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-07T16:00:07.497 INFO:teuthology.orchestra.run.smithi063.stderr:bash: ntpq: command not found 2023-12-07T16:00:07.499 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-07T16:00:07.499 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2023-12-07T16:00:07.499 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T16:00:07.500 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T16:00:07.500 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T16:00:07.500 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T16:00:07.539 INFO:teuthology.orchestra.run.smithi152.stderr:bash: ntpq: command not found 2023-12-07T16:00:07.542 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-07T16:00:07.542 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2023-12-07T16:00:07.542 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T16:00:07.543 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T16:00:07.543 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T16:00:07.543 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T16:00:07.544 INFO:teuthology.run_tasks:Running task pexec... 2023-12-07T16:00:07.554 INFO:teuthology.task.pexec:Executing custom commands... 2023-12-07T16:00:07.555 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi063.front.sepia.ceph.com 2023-12-07T16:00:07.555 DEBUG:teuthology.orchestra.run.smithi063:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-07T16:00:07.556 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi152.front.sepia.ceph.com 2023-12-07T16:00:07.556 DEBUG:teuthology.orchestra.run.smithi152:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-07T16:00:08.464 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:53 ago on Thu 07 Dec 2023 03:58:15 PM UTC. 2023-12-07T16:00:08.466 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:41 ago on Thu 07 Dec 2023 03:58:27 PM UTC. 2023-12-07T16:00:10.569 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:00:10.570 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:00:10.570 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2023-12-07T16:00:10.570 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:00:10.570 INFO:teuthology.orchestra.run.smithi152.stdout:Resetting modules: 2023-12-07T16:00:10.570 INFO:teuthology.orchestra.run.smithi152.stdout: container-tools 2023-12-07T16:00:10.571 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:00:10.571 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-07T16:00:10.571 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:00:10.571 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:00:10.786 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:00:10.787 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:00:10.787 INFO:teuthology.orchestra.run.smithi063.stdout: Package Architecture Version Repository Size 2023-12-07T16:00:10.787 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:00:10.787 INFO:teuthology.orchestra.run.smithi063.stdout:Resetting modules: 2023-12-07T16:00:10.787 INFO:teuthology.orchestra.run.smithi063.stdout: container-tools 2023-12-07T16:00:10.787 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:00:10.787 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-07T16:00:10.787 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:00:10.788 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:00:10.837 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:00:11.039 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:00:11.826 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:56 ago on Thu 07 Dec 2023 03:58:15 PM UTC. 2023-12-07T16:00:12.047 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:44 ago on Thu 07 Dec 2023 03:58:27 PM UTC. 2023-12-07T16:00:13.964 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:00:14.148 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:00:14.148 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-12-07T16:00:14.148 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:00:14.148 INFO:teuthology.orchestra.run.smithi152.stdout:Installing group/module packages: 2023-12-07T16:00:14.149 INFO:teuthology.orchestra.run.smithi152.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2023-12-07T16:00:14.149 INFO:teuthology.orchestra.run.smithi152.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2023-12-07T16:00:14.149 INFO:teuthology.orchestra.run.smithi152.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2023-12-07T16:00:14.149 INFO:teuthology.orchestra.run.smithi152.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2023-12-07T16:00:14.149 INFO:teuthology.orchestra.run.smithi152.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2023-12-07T16:00:14.149 INFO:teuthology.orchestra.run.smithi152.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2023-12-07T16:00:14.149 INFO:teuthology.orchestra.run.smithi152.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2023-12-07T16:00:14.149 INFO:teuthology.orchestra.run.smithi152.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2023-12-07T16:00:14.149 INFO:teuthology.orchestra.run.smithi152.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2023-12-07T16:00:14.149 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-12-07T16:00:14.149 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-12-07T16:00:14.150 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-12-07T16:00:14.150 INFO:teuthology.orchestra.run.smithi152.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-12-07T16:00:14.150 INFO:teuthology.orchestra.run.smithi152.stdout:Installing weak dependencies: 2023-12-07T16:00:14.150 INFO:teuthology.orchestra.run.smithi152.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-12-07T16:00:14.150 INFO:teuthology.orchestra.run.smithi152.stdout:Installing module profiles: 2023-12-07T16:00:14.150 INFO:teuthology.orchestra.run.smithi152.stdout: container-tools/common 2023-12-07T16:00:14.150 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:00:14.150 INFO:teuthology.orchestra.run.smithi152.stdout:Enabling module streams: 2023-12-07T16:00:14.150 INFO:teuthology.orchestra.run.smithi152.stdout: container-tools rhel8 2023-12-07T16:00:14.150 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:00:14.151 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-07T16:00:14.151 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:00:14.151 INFO:teuthology.orchestra.run.smithi152.stdout:Install 13 Packages 2023-12-07T16:00:14.151 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:00:14.151 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 27 M 2023-12-07T16:00:14.152 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 89 M 2023-12-07T16:00:14.152 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-07T16:00:14.325 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:00:14.522 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:00:14.523 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2023-12-07T16:00:14.523 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:00:14.523 INFO:teuthology.orchestra.run.smithi063.stdout:Installing group/module packages: 2023-12-07T16:00:14.523 INFO:teuthology.orchestra.run.smithi063.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2023-12-07T16:00:14.523 INFO:teuthology.orchestra.run.smithi063.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2023-12-07T16:00:14.523 INFO:teuthology.orchestra.run.smithi063.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2023-12-07T16:00:14.523 INFO:teuthology.orchestra.run.smithi063.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2023-12-07T16:00:14.523 INFO:teuthology.orchestra.run.smithi063.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2023-12-07T16:00:14.524 INFO:teuthology.orchestra.run.smithi063.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2023-12-07T16:00:14.524 INFO:teuthology.orchestra.run.smithi063.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2023-12-07T16:00:14.524 INFO:teuthology.orchestra.run.smithi063.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2023-12-07T16:00:14.524 INFO:teuthology.orchestra.run.smithi063.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2023-12-07T16:00:14.524 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2023-12-07T16:00:14.524 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-12-07T16:00:14.524 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-12-07T16:00:14.524 INFO:teuthology.orchestra.run.smithi063.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-12-07T16:00:14.524 INFO:teuthology.orchestra.run.smithi063.stdout:Installing weak dependencies: 2023-12-07T16:00:14.524 INFO:teuthology.orchestra.run.smithi063.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-12-07T16:00:14.524 INFO:teuthology.orchestra.run.smithi063.stdout:Installing module profiles: 2023-12-07T16:00:14.525 INFO:teuthology.orchestra.run.smithi063.stdout: container-tools/common 2023-12-07T16:00:14.525 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:00:14.525 INFO:teuthology.orchestra.run.smithi063.stdout:Enabling module streams: 2023-12-07T16:00:14.525 INFO:teuthology.orchestra.run.smithi063.stdout: container-tools rhel8 2023-12-07T16:00:14.525 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:00:14.525 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-07T16:00:14.525 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:00:14.525 INFO:teuthology.orchestra.run.smithi063.stdout:Install 13 Packages 2023-12-07T16:00:14.525 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:00:14.526 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 27 M 2023-12-07T16:00:14.526 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 89 M 2023-12-07T16:00:14.526 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-07T16:00:16.731 INFO:teuthology.orchestra.run.smithi152.stdout:(1/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 2.7 MB/s | 1.0 MB 00:00 2023-12-07T16:00:16.832 INFO:teuthology.orchestra.run.smithi152.stdout:(2/13): cockpit-podman-78-1.module_el8+712+4cd1 1.5 MB/s | 750 kB 00:00 2023-12-07T16:00:16.848 INFO:teuthology.orchestra.run.smithi152.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 324 kB/s | 38 kB 00:00 2023-12-07T16:00:16.957 INFO:teuthology.orchestra.run.smithi152.stdout:(4/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 1.9 MB/s | 241 kB 00:00 2023-12-07T16:00:17.107 INFO:teuthology.orchestra.run.smithi152.stdout:(5/13): python3-podman-4.7.0-1.module_el8+712+4 1.2 MB/s | 178 kB 00:00 2023-12-07T16:00:17.199 INFO:teuthology.orchestra.run.smithi152.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 271 kB/s | 25 kB 00:00 2023-12-07T16:00:17.274 INFO:teuthology.orchestra.run.smithi152.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 1.2 MB/s | 94 kB 00:00 2023-12-07T16:00:17.683 INFO:teuthology.orchestra.run.smithi152.stdout:(8/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 4.7 MB/s | 3.9 MB 00:00 2023-12-07T16:00:18.042 INFO:teuthology.orchestra.run.smithi152.stdout:(9/13): buildah-1.32.0-1.module_el8+712+4cd1bd6 5.7 MB/s | 9.6 MB 00:01 2023-12-07T16:00:18.209 INFO:teuthology.orchestra.run.smithi152.stdout:(10/13): udica-0.2.6-20.module_el8+712+4cd1bd69 316 kB/s | 53 kB 00:00 2023-12-07T16:00:18.267 INFO:teuthology.orchestra.run.smithi152.stdout:(11/13): yajl-2.1.0-12.el8.x86_64.rpm 703 kB/s | 41 kB 00:00 2023-12-07T16:00:18.409 INFO:teuthology.orchestra.run.smithi152.stdout:(12/13): toolbox-0.0.99.4-6.module_el8+712+4cd1 3.5 MB/s | 2.5 MB 00:00 2023-12-07T16:00:19.793 INFO:teuthology.orchestra.run.smithi152.stdout:(13/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 3.2 MB/s | 8.1 MB 00:02 2023-12-07T16:00:19.793 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:00:19.793 INFO:teuthology.orchestra.run.smithi152.stdout:Total 4.7 MB/s | 27 MB 00:05 2023-12-07T16:00:20.063 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-07T16:00:20.084 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-07T16:00:20.084 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-07T16:00:20.356 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-07T16:00:20.359 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-07T16:00:21.068 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-07T16:00:21.277 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-12-07T16:00:21.473 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-07T16:00:21.656 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-12-07T16:00:21.924 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-07T16:00:22.467 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2023-12-07T16:00:23.427 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-07T16:00:23.678 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2023-12-07T16:00:23.883 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2023-12-07T16:00:24.176 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2023-12-07T16:00:24.567 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2023-12-07T16:00:25.441 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-07T16:00:25.776 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2023-12-07T16:00:25.954 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-07T16:00:26.373 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-07T16:00:26.373 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2023-12-07T16:00:26.373 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2023-12-07T16:00:26.373 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2023-12-07T16:00:26.373 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-07T16:00:26.373 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2023-12-07T16:00:26.373 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-07T16:00:26.373 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2023-12-07T16:00:26.373 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-12-07T16:00:26.373 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-12-07T16:00:26.373 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2023-12-07T16:00:26.373 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-07T16:00:26.373 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2023-12-07T16:00:27.195 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-12-07T16:00:27.195 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:00:27.195 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-07T16:00:27.196 INFO:teuthology.orchestra.run.smithi152.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-07T16:00:27.196 INFO:teuthology.orchestra.run.smithi152.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-07T16:00:27.196 INFO:teuthology.orchestra.run.smithi152.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2023-12-07T16:00:27.196 INFO:teuthology.orchestra.run.smithi152.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-12-07T16:00:27.196 INFO:teuthology.orchestra.run.smithi152.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2023-12-07T16:00:27.196 INFO:teuthology.orchestra.run.smithi152.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2023-12-07T16:00:27.196 INFO:teuthology.orchestra.run.smithi152.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2023-12-07T16:00:27.196 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-07T16:00:27.196 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-07T16:00:27.196 INFO:teuthology.orchestra.run.smithi152.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2023-12-07T16:00:27.196 INFO:teuthology.orchestra.run.smithi152.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2023-12-07T16:00:27.196 INFO:teuthology.orchestra.run.smithi152.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2023-12-07T16:00:27.196 INFO:teuthology.orchestra.run.smithi152.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-07T16:00:27.196 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:00:27.196 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:00:27.442 DEBUG:teuthology.parallel:result is None 2023-12-07T16:00:46.925 INFO:teuthology.orchestra.run.smithi063.stdout:(1/13): cockpit-podman-78-1.module_el8+712+4cd1 2.2 MB/s | 750 kB 00:00 2023-12-07T16:00:47.025 INFO:teuthology.orchestra.run.smithi063.stdout:(2/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 380 kB/s | 38 kB 00:00 2023-12-07T16:00:47.134 INFO:teuthology.orchestra.run.smithi063.stdout:(3/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 1.9 MB/s | 1.0 MB 00:00 2023-12-07T16:00:47.159 INFO:teuthology.orchestra.run.smithi063.stdout:(4/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 1.8 MB/s | 241 kB 00:00 2023-12-07T16:00:47.251 INFO:teuthology.orchestra.run.smithi063.stdout:(5/13): python3-podman-4.7.0-1.module_el8+712+4 1.9 MB/s | 178 kB 00:00 2023-12-07T16:00:47.401 INFO:teuthology.orchestra.run.smithi063.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 165 kB/s | 25 kB 00:00 2023-12-07T16:00:47.476 INFO:teuthology.orchestra.run.smithi063.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 1.2 MB/s | 94 kB 00:00 2023-12-07T16:00:48.043 INFO:teuthology.orchestra.run.smithi063.stdout:(8/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 4.3 MB/s | 3.9 MB 00:00 2023-12-07T16:00:48.527 INFO:teuthology.orchestra.run.smithi063.stdout:(9/13): skopeo-1.13.3-1.module_el8+712+4cd1bd69 7.8 MB/s | 8.1 MB 00:01 2023-12-07T16:00:48.702 INFO:teuthology.orchestra.run.smithi063.stdout:(10/13): udica-0.2.6-20.module_el8+712+4cd1bd69 301 kB/s | 53 kB 00:00 2023-12-07T16:00:48.774 INFO:teuthology.orchestra.run.smithi063.stdout:(11/13): yajl-2.1.0-12.el8.x86_64.rpm 569 kB/s | 41 kB 00:00 2023-12-07T16:00:49.020 INFO:teuthology.orchestra.run.smithi063.stdout:(12/13): toolbox-0.0.99.4-6.module_el8+712+4cd1 2.6 MB/s | 2.5 MB 00:00 2023-12-07T16:00:49.494 INFO:teuthology.orchestra.run.smithi063.stdout:(13/13): buildah-1.32.0-1.module_el8+712+4cd1bd 3.3 MB/s | 9.6 MB 00:02 2023-12-07T16:00:49.495 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:00:49.495 INFO:teuthology.orchestra.run.smithi063.stdout:Total 778 kB/s | 27 MB 00:34 2023-12-07T16:00:49.773 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-07T16:00:49.795 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-07T16:00:49.795 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-07T16:00:50.077 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-07T16:00:50.080 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-07T16:00:50.828 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-07T16:00:51.050 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-12-07T16:00:51.210 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-07T16:00:51.425 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-12-07T16:00:51.691 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-07T16:00:52.274 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2023-12-07T16:00:53.434 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-07T16:00:53.708 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2023-12-07T16:00:53.957 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2023-12-07T16:00:54.241 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2023-12-07T16:00:54.676 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2023-12-07T16:00:55.613 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-07T16:00:55.852 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2023-12-07T16:00:56.041 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-07T16:00:56.487 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-07T16:00:56.488 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2023-12-07T16:00:56.488 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2023-12-07T16:00:56.488 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2023-12-07T16:00:56.488 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-07T16:00:56.488 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2023-12-07T16:00:56.488 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-07T16:00:56.488 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2023-12-07T16:00:56.488 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-12-07T16:00:56.488 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-12-07T16:00:56.488 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2023-12-07T16:00:56.488 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-07T16:00:56.488 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2023-12-07T16:00:57.347 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-12-07T16:00:57.347 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:00:57.347 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-07T16:00:57.347 INFO:teuthology.orchestra.run.smithi063.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-07T16:00:57.347 INFO:teuthology.orchestra.run.smithi063.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-07T16:00:57.347 INFO:teuthology.orchestra.run.smithi063.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2023-12-07T16:00:57.347 INFO:teuthology.orchestra.run.smithi063.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-12-07T16:00:57.348 INFO:teuthology.orchestra.run.smithi063.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2023-12-07T16:00:57.348 INFO:teuthology.orchestra.run.smithi063.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2023-12-07T16:00:57.348 INFO:teuthology.orchestra.run.smithi063.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2023-12-07T16:00:57.348 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-07T16:00:57.348 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-07T16:00:57.348 INFO:teuthology.orchestra.run.smithi063.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2023-12-07T16:00:57.348 INFO:teuthology.orchestra.run.smithi063.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2023-12-07T16:00:57.348 INFO:teuthology.orchestra.run.smithi063.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2023-12-07T16:00:57.348 INFO:teuthology.orchestra.run.smithi063.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-07T16:00:57.348 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:00:57.348 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:00:57.685 DEBUG:teuthology.parallel:result is None 2023-12-07T16:00:57.685 INFO:teuthology.run_tasks:Running task install... 2023-12-07T16:00:57.693 DEBUG:teuthology.task.install:project ceph 2023-12-07T16:00:57.693 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e6605fb8725c25c4838cef6a39f30df73f1ed149'}} 2023-12-07T16:00:57.693 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'e6605fb8725c25c4838cef6a39f30df73f1ed149'} 2023-12-07T16:00:57.694 INFO:teuthology.task.install:Using flavor: default 2023-12-07T16:00:57.700 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-07T16:00:57.700 INFO:teuthology.task.install:extra packages: [] 2023-12-07T16:00:57.700 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e6605fb8725c25c4838cef6a39f30df73f1ed149', 'tag': None, 'wait_for_package': False} 2023-12-07T16:00:57.700 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-07T16:00:57.701 INFO:teuthology.packaging:ref: None 2023-12-07T16:00:57.701 INFO:teuthology.packaging:tag: None 2023-12-07T16:00:57.701 INFO:teuthology.packaging:branch: quincy 2023-12-07T16:00:57.701 INFO:teuthology.packaging:sha1: e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-07T16:00:57.701 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-07T16:00:57.703 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e6605fb8725c25c4838cef6a39f30df73f1ed149', 'tag': None, 'wait_for_package': False} 2023-12-07T16:00:57.703 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-07T16:00:57.703 INFO:teuthology.packaging:ref: None 2023-12-07T16:00:57.703 INFO:teuthology.packaging:tag: None 2023-12-07T16:00:57.703 INFO:teuthology.packaging:branch: quincy 2023-12-07T16:00:57.703 INFO:teuthology.packaging:sha1: e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-07T16:00:57.703 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-07T16:00:57.948 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/quincy/4f62d9ad74f167611e0396f21180a147cab03370/centos/8/flavors/default/ 2023-12-07T16:00:57.948 INFO:teuthology.task.install.rpm:Package version is 17.2.7-115.g4f62d9ad 2023-12-07T16:00:58.006 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/quincy/4f62d9ad74f167611e0396f21180a147cab03370/centos/8/flavors/default/ 2023-12-07T16:00:58.006 INFO:teuthology.task.install.rpm:Package version is 17.2.7-115.g4f62d9ad 2023-12-07T16:00:58.124 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/quincy/4f62d9ad74f167611e0396f21180a147cab03370/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/4f62d9ad74f167611e0396f21180a147cab03370/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/4f62d9ad74f167611e0396f21180a147cab03370/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-07T16:00:58.124 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-07T16:00:58.124 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-07T16:00:58.154 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-07T16:00:58.154 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-07T16:00:58.154 INFO:teuthology.packaging:ref: None 2023-12-07T16:00:58.154 INFO:teuthology.packaging:tag: None 2023-12-07T16:00:58.154 INFO:teuthology.packaging:branch: quincy 2023-12-07T16:00:58.154 INFO:teuthology.packaging:sha1: e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-07T16:00:58.154 DEBUG:teuthology.orchestra.run.smithi063:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-07T16:00:58.177 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/quincy/4f62d9ad74f167611e0396f21180a147cab03370/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/4f62d9ad74f167611e0396f21180a147cab03370/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/4f62d9ad74f167611e0396f21180a147cab03370/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-07T16:00:58.177 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-07T16:00:58.177 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-07T16:00:58.213 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-07T16:00:58.213 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-07T16:00:58.213 INFO:teuthology.packaging:ref: None 2023-12-07T16:00:58.213 INFO:teuthology.packaging:tag: None 2023-12-07T16:00:58.213 INFO:teuthology.packaging:branch: quincy 2023-12-07T16:00:58.213 INFO:teuthology.packaging:sha1: e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-07T16:00:58.213 DEBUG:teuthology.orchestra.run.smithi152:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-07T16:00:58.222 DEBUG:teuthology.orchestra.run.smithi063:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-07T16:00:58.284 DEBUG:teuthology.orchestra.run.smithi152:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-07T16:00:58.300 DEBUG:teuthology.orchestra.run.smithi063:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-07T16:00:58.364 DEBUG:teuthology.orchestra.run.smithi152:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-07T16:00:58.366 INFO:teuthology.orchestra.run.smithi063.stdout:check_obsoletes = 1 2023-12-07T16:00:58.368 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum clean all 2023-12-07T16:00:58.433 INFO:teuthology.orchestra.run.smithi152.stdout:check_obsoletes = 1 2023-12-07T16:00:58.435 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum clean all 2023-12-07T16:00:58.649 INFO:teuthology.orchestra.run.smithi063.stdout:76 files removed 2023-12-07T16:00:58.678 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-radosgw 2023-12-07T16:00:58.706 INFO:teuthology.orchestra.run.smithi152.stdout:76 files removed 2023-12-07T16:00:58.735 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-radosgw 2023-12-07T16:00:59.446 INFO:teuthology.orchestra.run.smithi152.stdout:ceph packages for x86_64 262 kB/s | 78 kB 00:00 2023-12-07T16:00:59.476 INFO:teuthology.orchestra.run.smithi063.stdout:ceph packages for x86_64 214 kB/s | 78 kB 00:00 2023-12-07T16:00:59.822 INFO:teuthology.orchestra.run.smithi152.stdout:ceph noarch packages 27 kB/s | 9.1 kB 00:00 2023-12-07T16:00:59.891 INFO:teuthology.orchestra.run.smithi063.stdout:ceph noarch packages 24 kB/s | 9.1 kB 00:00 2023-12-07T16:01:00.131 INFO:teuthology.orchestra.run.smithi152.stdout:ceph source packages 5.2 kB/s | 1.4 kB 00:00 2023-12-07T16:01:00.253 INFO:teuthology.orchestra.run.smithi063.stdout:ceph source packages 4.4 kB/s | 1.4 kB 00:00 2023-12-07T16:01:09.656 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - AppStream 3.6 MB/s | 34 MB 00:09 2023-12-07T16:01:12.052 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 8 - AppStream 2.9 MB/s | 34 MB 00:11 2023-12-07T16:01:18.838 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - BaseOS 19 MB/s | 55 MB 00:02 2023-12-07T16:01:21.420 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 8 - BaseOS 21 MB/s | 55 MB 00:02 2023-12-07T16:01:26.997 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - Extras 48 kB/s | 18 kB 00:00 2023-12-07T16:01:27.722 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 6.9 kB 00:00 2023-12-07T16:01:30.287 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 8 - Extras 42 kB/s | 18 kB 00:00 2023-12-07T16:01:30.879 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.9 kB 00:00 2023-12-07T16:09:45.908 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - PowerTools 14 kB/s | 6.6 MB 08:18 2023-12-07T16:09:47.584 INFO:teuthology.orchestra.run.smithi152.stdout:Copr repo for python3-asyncssh owned by ceph 9.6 kB/s | 3.5 kB 00:00 2023-12-07T16:09:48.634 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2023-12-07T16:09:52.484 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 323 kB/s | 24 kB 00:00 2023-12-07T16:09:57.039 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:09:57.042 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:09:57.042 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-12-07T16:09:57.042 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:09:57.042 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-07T16:09:57.042 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 17 M 2023-12-07T16:09:57.043 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrading: 2023-12-07T16:09:57.043 INFO:teuthology.orchestra.run.smithi152.stdout: librados2 x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 3.5 M 2023-12-07T16:09:57.043 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1 x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 3.6 M 2023-12-07T16:09:57.043 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-12-07T16:09:57.043 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 5.2 M 2023-12-07T16:09:57.043 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 23 M 2023-12-07T16:09:57.043 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 24 k 2023-12-07T16:09:57.043 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-07T16:09:57.043 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2 x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 796 k 2023-12-07T16:09:57.043 INFO:teuthology.orchestra.run.smithi152.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-07T16:09:57.043 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-07T16:09:57.043 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1 x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 507 k 2023-12-07T16:09:57.043 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-12-07T16:09:57.043 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2 x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 5.6 M 2023-12-07T16:09:57.043 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-07T16:09:57.044 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-07T16:09:57.044 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 45 k 2023-12-07T16:09:57.044 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 115 k 2023-12-07T16:09:57.044 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 190 k 2023-12-07T16:09:57.044 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-07T16:09:57.044 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 371 k 2023-12-07T16:09:57.044 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 358 k 2023-12-07T16:09:57.044 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 107 k 2023-12-07T16:09:57.044 INFO:teuthology.orchestra.run.smithi152.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-07T16:09:57.044 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:09:57.044 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-07T16:09:57.044 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:09:57.044 INFO:teuthology.orchestra.run.smithi152.stdout:Install 21 Packages 2023-12-07T16:09:57.044 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrade 2 Packages 2023-12-07T16:09:57.044 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:09:57.045 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 63 M 2023-12-07T16:09:57.045 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-07T16:09:58.302 INFO:teuthology.orchestra.run.smithi152.stdout:(1/23): ceph-base-17.2.7-115.g4f62d9ad.el8.x86_ 6.1 MB/s | 5.2 MB 00:00 2023-12-07T16:09:58.394 INFO:teuthology.orchestra.run.smithi152.stdout:(2/23): ceph-selinux-17.2.7-115.g4f62d9ad.el8.x 265 kB/s | 24 kB 00:00 2023-12-07T16:09:58.536 INFO:teuthology.orchestra.run.smithi152.stdout:(3/23): libcephfs2-17.2.7-115.g4f62d9ad.el8.x86 5.5 MB/s | 796 kB 00:00 2023-12-07T16:09:58.636 INFO:teuthology.orchestra.run.smithi152.stdout:(4/23): libradosstriper1-17.2.7-115.g4f62d9ad.e 5.0 MB/s | 507 kB 00:00 2023-12-07T16:09:59.336 INFO:teuthology.orchestra.run.smithi152.stdout:(5/23): ceph-radosgw-17.2.7-115.g4f62d9ad.el8.x 8.9 MB/s | 17 MB 00:01 2023-12-07T16:09:59.428 INFO:teuthology.orchestra.run.smithi152.stdout:(6/23): librgw2-17.2.7-115.g4f62d9ad.el8.x86_64 7.0 MB/s | 5.6 MB 00:00 2023-12-07T16:09:59.445 INFO:teuthology.orchestra.run.smithi152.stdout:(7/23): python3-ceph-argparse-17.2.7-115.g4f62d 412 kB/s | 45 kB 00:00 2023-12-07T16:09:59.487 INFO:teuthology.orchestra.run.smithi152.stdout:(8/23): python3-ceph-common-17.2.7-115.g4f62d9a 1.9 MB/s | 115 kB 00:00 2023-12-07T16:09:59.512 INFO:teuthology.orchestra.run.smithi152.stdout:(9/23): python3-cephfs-17.2.7-115.g4f62d9ad.el8 2.8 MB/s | 190 kB 00:00 2023-12-07T16:09:59.554 INFO:teuthology.orchestra.run.smithi152.stdout:(10/23): python3-rados-17.2.7-115.g4f62d9ad.el8 5.4 MB/s | 371 kB 00:00 2023-12-07T16:09:59.588 INFO:teuthology.orchestra.run.smithi152.stdout:(11/23): python3-rbd-17.2.7-115.g4f62d9ad.el8.x 4.6 MB/s | 358 kB 00:00 2023-12-07T16:09:59.613 INFO:teuthology.orchestra.run.smithi152.stdout:(12/23): python3-rgw-17.2.7-115.g4f62d9ad.el8.x 1.8 MB/s | 107 kB 00:00 2023-12-07T16:09:59.839 INFO:teuthology.orchestra.run.smithi152.stdout:(13/23): ceph-common-17.2.7-115.g4f62d9ad.el8.x 9.9 MB/s | 23 MB 00:02 2023-12-07T16:09:59.997 INFO:teuthology.orchestra.run.smithi152.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 278 kB/s | 44 kB 00:00 2023-12-07T16:10:00.064 INFO:teuthology.orchestra.run.smithi152.stdout:(15/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 576 kB/s | 259 kB 00:00 2023-12-07T16:10:00.125 INFO:teuthology.orchestra.run.smithi152.stdout:(16/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 370 kB/s | 47 kB 00:00 2023-12-07T16:10:00.290 INFO:teuthology.orchestra.run.smithi152.stdout:(17/23): librdkafka-0.11.4-3.el8.x86_64.rpm 504 kB/s | 354 kB 00:00 2023-12-07T16:10:00.348 INFO:teuthology.orchestra.run.smithi152.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 263 kB/s | 59 kB 00:00 2023-12-07T16:10:00.432 INFO:teuthology.orchestra.run.smithi152.stdout:(19/23): gperftools-libs-2.7-9.el8.x86_64.rpm 833 kB/s | 306 kB 00:00 2023-12-07T16:10:00.507 INFO:teuthology.orchestra.run.smithi152.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 346 kB/s | 75 kB 00:00 2023-12-07T16:10:00.741 INFO:teuthology.orchestra.run.smithi152.stdout:(21/23): librados2-17.2.7-115.g4f62d9ad.el8.x86 11 MB/s | 3.5 MB 00:00 2023-12-07T16:10:00.833 INFO:teuthology.orchestra.run.smithi152.stdout:(22/23): librbd1-17.2.7-115.g4f62d9ad.el8.x86_6 11 MB/s | 3.6 MB 00:00 2023-12-07T16:10:01.292 INFO:teuthology.orchestra.run.smithi152.stdout:(23/23): thrift-0.13.0-2.el8.x86_64.rpm 1.8 MB/s | 1.7 MB 00:00 2023-12-07T16:10:01.297 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:10:01.297 INFO:teuthology.orchestra.run.smithi152.stdout:Total 15 MB/s | 63 MB 00:04 2023-12-07T16:10:01.337 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-07T16:10:01.383 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-07T16:10:01.383 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-07T16:10:01.748 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-07T16:10:01.751 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-07T16:10:02.834 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-07T16:10:03.018 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-07T16:10:03.031 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 8 - PowerTools 13 kB/s | 6.6 MB 08:31 2023-12-07T16:10:03.197 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-07T16:10:03.577 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-07T16:10:03.811 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librados2-2:17.2.7-115.g4f62d9ad.el8.x86_64 3/25 2023-12-07T16:10:03.907 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:17.2.7-115.g4f62d9ad.el8.x86_64 3/25 2023-12-07T16:10:04.177 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rados-2:17.2.7-115.g4f62d9ad.el8.x86_64 4/25 2023-12-07T16:10:04.345 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs2-2:17.2.7-115.g4f62d9ad.el8.x86_64 5/25 2023-12-07T16:10:04.566 INFO:teuthology.orchestra.run.smithi063.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-12-07T16:10:04.751 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs2-2:17.2.7-115.g4f62d9ad.el8.x86_64 5/25 2023-12-07T16:10:04.895 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librbd1-2:17.2.7-115.g4f62d9ad.el8.x86_64 6/25 2023-12-07T16:10:05.168 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:17.2.7-115.g4f62d9ad.el8.x86_64 6/25 2023-12-07T16:10:05.341 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-12-07T16:10:05.534 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-12-07T16:10:05.594 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 19 MB/s | 16 MB 00:00 2023-12-07T16:10:05.670 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-07T16:10:06.203 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-07T16:10:06.361 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librgw2-2:17.2.7-115.g4f62d9ad.el8.x86_64 10/25 2023-12-07T16:10:06.412 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librgw2-2:17.2.7-115.g4f62d9ad.el8.x86_64 10/25 2023-12-07T16:10:06.580 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-argparse-2:17.2.7-115.g4f62d9ad.el8.x 11/25 2023-12-07T16:10:06.789 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cephfs-2:17.2.7-115.g4f62d9ad.el8.x86_64 12/25 2023-12-07T16:10:06.987 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rgw-2:17.2.7-115.g4f62d9ad.el8.x86_64 13/25 2023-12-07T16:10:07.239 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rbd-2:17.2.7-115.g4f62d9ad.el8.x86_64 14/25 2023-12-07T16:10:07.378 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libradosstriper1-2:17.2.7-115.g4f62d9ad.el8.x86_64 15/25 2023-12-07T16:10:07.434 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libradosstriper1-2:17.2.7-115.g4f62d9ad.el8.x86_64 15/25 2023-12-07T16:10:07.678 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-07T16:10:07.868 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-07T16:10:08.094 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-07T16:10:08.261 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-common-2:17.2.7-115.g4f62d9ad.el8.x86 19/25 2023-12-07T16:10:09.633 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 461 kB/s | 24 kB 00:00 2023-12-07T16:10:10.960 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:17.2.7-115.g4f62d9ad.el8.x86_64 20/25 2023-12-07T16:10:11.236 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-common-2:17.2.7-115.g4f62d9ad.el8.x86_64 20/25 2023-12-07T16:10:11.822 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:17.2.7-115.g4f62d9ad.el8.x86_64 20/25 2023-12-07T16:10:12.113 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-base-2:17.2.7-115.g4f62d9ad.el8.x86_64 21/25 2023-12-07T16:10:12.223 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-base-2:17.2.7-115.g4f62d9ad.el8.x86_64 21/25 2023-12-07T16:10:12.439 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-selinux-2:17.2.7-115.g4f62d9ad.el8.x86_64 22/25 2023-12-07T16:10:14.607 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:10:14.610 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:10:14.610 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2023-12-07T16:10:14.610 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:10:14.610 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-07T16:10:14.610 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 17 M 2023-12-07T16:10:14.610 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrading: 2023-12-07T16:10:14.610 INFO:teuthology.orchestra.run.smithi063.stdout: librados2 x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 3.5 M 2023-12-07T16:10:14.610 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1 x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 3.6 M 2023-12-07T16:10:14.610 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2023-12-07T16:10:14.610 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 5.2 M 2023-12-07T16:10:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 23 M 2023-12-07T16:10:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 24 k 2023-12-07T16:10:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-07T16:10:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2 x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 796 k 2023-12-07T16:10:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-07T16:10:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-07T16:10:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1 x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 507 k 2023-12-07T16:10:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-12-07T16:10:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2 x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 5.6 M 2023-12-07T16:10:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-07T16:10:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-07T16:10:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 45 k 2023-12-07T16:10:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 115 k 2023-12-07T16:10:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 190 k 2023-12-07T16:10:14.611 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-07T16:10:14.612 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 371 k 2023-12-07T16:10:14.612 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 358 k 2023-12-07T16:10:14.612 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 107 k 2023-12-07T16:10:14.612 INFO:teuthology.orchestra.run.smithi063.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-07T16:10:14.612 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:10:14.612 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-07T16:10:14.612 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:10:14.612 INFO:teuthology.orchestra.run.smithi063.stdout:Install 21 Packages 2023-12-07T16:10:14.612 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrade 2 Packages 2023-12-07T16:10:14.612 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:10:14.613 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 63 M 2023-12-07T16:10:14.613 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-07T16:10:15.831 INFO:teuthology.orchestra.run.smithi063.stdout:(1/23): ceph-base-17.2.7-115.g4f62d9ad.el8.x86_ 7.7 MB/s | 5.2 MB 00:00 2023-12-07T16:10:15.901 INFO:teuthology.orchestra.run.smithi063.stdout:(2/23): ceph-selinux-17.2.7-115.g4f62d9ad.el8.x 347 kB/s | 24 kB 00:00 2023-12-07T16:10:16.010 INFO:teuthology.orchestra.run.smithi063.stdout:(3/23): libcephfs2-17.2.7-115.g4f62d9ad.el8.x86 7.2 MB/s | 796 kB 00:00 2023-12-07T16:10:16.135 INFO:teuthology.orchestra.run.smithi063.stdout:(4/23): libradosstriper1-17.2.7-115.g4f62d9ad.e 4.0 MB/s | 507 kB 00:00 2023-12-07T16:10:16.869 INFO:teuthology.orchestra.run.smithi063.stdout:(5/23): ceph-common-17.2.7-115.g4f62d9ad.el8.x8 14 MB/s | 23 MB 00:01 2023-12-07T16:10:17.111 INFO:teuthology.orchestra.run.smithi063.stdout:(6/23): librgw2-17.2.7-115.g4f62d9ad.el8.x86_64 5.7 MB/s | 5.6 MB 00:00 2023-12-07T16:10:17.128 INFO:teuthology.orchestra.run.smithi063.stdout:(7/23): python3-ceph-argparse-17.2.7-115.g4f62d 173 kB/s | 45 kB 00:00 2023-12-07T16:10:17.161 INFO:teuthology.orchestra.run.smithi063.stdout:(8/23): python3-ceph-common-17.2.7-115.g4f62d9a 2.2 MB/s | 115 kB 00:00 2023-12-07T16:10:17.220 INFO:teuthology.orchestra.run.smithi063.stdout:(9/23): python3-cephfs-17.2.7-115.g4f62d9ad.el8 2.0 MB/s | 190 kB 00:00 2023-12-07T16:10:17.270 INFO:teuthology.orchestra.run.smithi063.stdout:(10/23): python3-rados-17.2.7-115.g4f62d9ad.el8 3.3 MB/s | 371 kB 00:00 2023-12-07T16:10:17.296 INFO:teuthology.orchestra.run.smithi063.stdout:(11/23): python3-rbd-17.2.7-115.g4f62d9ad.el8.x 4.6 MB/s | 358 kB 00:00 2023-12-07T16:10:17.321 INFO:teuthology.orchestra.run.smithi063.stdout:(12/23): python3-rgw-17.2.7-115.g4f62d9ad.el8.x 2.1 MB/s | 107 kB 00:00 2023-12-07T16:10:17.672 INFO:teuthology.orchestra.run.smithi063.stdout:(13/23): librdkafka-0.11.4-3.el8.x86_64.rpm 943 kB/s | 354 kB 00:00 2023-12-07T16:10:17.696 INFO:teuthology.orchestra.run.smithi063.stdout:(14/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 691 kB/s | 259 kB 00:00 2023-12-07T16:10:17.780 INFO:teuthology.orchestra.run.smithi063.stdout:(15/23): python3-prettytable-0.7.2-14.el8.noarc 405 kB/s | 44 kB 00:00 2023-12-07T16:10:17.805 INFO:teuthology.orchestra.run.smithi063.stdout:(16/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 432 kB/s | 47 kB 00:00 2023-12-07T16:10:18.131 INFO:teuthology.orchestra.run.smithi063.stdout:(17/23): ceph-radosgw-17.2.7-115.g4f62d9ad.el8. 5.7 MB/s | 17 MB 00:02 2023-12-07T16:10:18.489 INFO:teuthology.orchestra.run.smithi063.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 86 kB/s | 59 kB 00:00 2023-12-07T16:10:18.648 INFO:teuthology.orchestra.run.smithi063.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 146 kB/s | 75 kB 00:00 2023-12-07T16:10:18.799 INFO:teuthology.orchestra.run.smithi063.stdout:(20/23): gperftools-libs-2.7-9.el8.x86_64.rpm 301 kB/s | 306 kB 00:01 2023-12-07T16:10:18.957 INFO:teuthology.orchestra.run.smithi063.stdout:(21/23): librados2-17.2.7-115.g4f62d9ad.el8.x86 11 MB/s | 3.5 MB 00:00 2023-12-07T16:10:19.174 INFO:teuthology.orchestra.run.smithi063.stdout:(22/23): librbd1-17.2.7-115.g4f62d9ad.el8.x86_6 9.6 MB/s | 3.6 MB 00:00 2023-12-07T16:10:20.810 INFO:teuthology.orchestra.run.smithi063.stdout:(23/23): thrift-0.13.0-2.el8.x86_64.rpm 766 kB/s | 1.7 MB 00:02 2023-12-07T16:10:20.815 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:10:20.815 INFO:teuthology.orchestra.run.smithi063.stdout:Total 10 MB/s | 63 MB 00:06 2023-12-07T16:10:20.858 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-07T16:10:20.908 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-07T16:10:20.908 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-07T16:10:21.299 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-07T16:10:21.302 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-07T16:10:22.441 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-07T16:10:22.676 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-07T16:10:22.878 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-07T16:10:23.272 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-07T16:10:23.470 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librados2-2:17.2.7-115.g4f62d9ad.el8.x86_64 3/25 2023-12-07T16:10:23.567 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:17.2.7-115.g4f62d9ad.el8.x86_64 3/25 2023-12-07T16:10:23.806 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rados-2:17.2.7-115.g4f62d9ad.el8.x86_64 4/25 2023-12-07T16:10:24.028 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs2-2:17.2.7-115.g4f62d9ad.el8.x86_64 5/25 2023-12-07T16:10:24.440 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephfs2-2:17.2.7-115.g4f62d9ad.el8.x86_64 5/25 2023-12-07T16:10:24.669 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librbd1-2:17.2.7-115.g4f62d9ad.el8.x86_64 6/25 2023-12-07T16:10:24.901 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-2:17.2.7-115.g4f62d9ad.el8.x86_64 6/25 2023-12-07T16:10:25.099 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-12-07T16:10:25.295 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-12-07T16:10:25.436 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-07T16:10:26.050 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-07T16:10:26.203 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librgw2-2:17.2.7-115.g4f62d9ad.el8.x86_64 10/25 2023-12-07T16:10:26.267 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librgw2-2:17.2.7-115.g4f62d9ad.el8.x86_64 10/25 2023-12-07T16:10:26.464 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-argparse-2:17.2.7-115.g4f62d9ad.el8.x 11/25 2023-12-07T16:10:26.673 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cephfs-2:17.2.7-115.g4f62d9ad.el8.x86_64 12/25 2023-12-07T16:10:26.906 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rgw-2:17.2.7-115.g4f62d9ad.el8.x86_64 13/25 2023-12-07T16:10:27.100 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rbd-2:17.2.7-115.g4f62d9ad.el8.x86_64 14/25 2023-12-07T16:10:27.269 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libradosstriper1-2:17.2.7-115.g4f62d9ad.el8.x86_64 15/25 2023-12-07T16:10:27.348 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libradosstriper1-2:17.2.7-115.g4f62d9ad.el8.x86_64 15/25 2023-12-07T16:10:27.572 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-07T16:10:27.795 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-07T16:10:28.034 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-07T16:10:28.261 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-common-2:17.2.7-115.g4f62d9ad.el8.x86 19/25 2023-12-07T16:10:30.951 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-selinux-2:17.2.7-115.g4f62d9ad.el8.x86_64 22/25 2023-12-07T16:10:30.951 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /sys 2023-12-07T16:10:30.951 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /proc 2023-12-07T16:10:30.951 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /dev 2023-12-07T16:10:30.951 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /run 2023-12-07T16:10:30.951 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /mnt 2023-12-07T16:10:30.951 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /var/tmp 2023-12-07T16:10:30.951 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /home 2023-12-07T16:10:30.951 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /tmp 2023-12-07T16:10:30.951 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /dev 2023-12-07T16:10:30.951 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:10:31.143 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:17.2.7-115.g4f62d9ad.el8.x86_64 20/25 2023-12-07T16:10:31.378 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-common-2:17.2.7-115.g4f62d9ad.el8.x86_64 20/25 2023-12-07T16:10:31.995 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:17.2.7-115.g4f62d9ad.el8.x86_64 20/25 2023-12-07T16:10:32.293 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-base-2:17.2.7-115.g4f62d9ad.el8.x86_64 21/25 2023-12-07T16:10:32.427 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-base-2:17.2.7-115.g4f62d9ad.el8.x86_64 21/25 2023-12-07T16:10:32.627 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-selinux-2:17.2.7-115.g4f62d9ad.el8.x86_64 22/25 2023-12-07T16:10:32.643 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-radosgw-2:17.2.7-115.g4f62d9ad.el8.x86_64 23/25 2023-12-07T16:10:32.745 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-115.g4f62d9ad.el8.x86_64 23/25 2023-12-07T16:10:32.745 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-07T16:10:32.959 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-07T16:10:32.959 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-07T16:10:33.675 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-07T16:10:33.675 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-base-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/25 2023-12-07T16:10:33.675 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-common-2:17.2.7-115.g4f62d9ad.el8.x86_64 2/25 2023-12-07T16:10:33.675 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-radosgw-2:17.2.7-115.g4f62d9ad.el8.x86_64 3/25 2023-12-07T16:10:33.675 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-selinux-2:17.2.7-115.g4f62d9ad.el8.x86_64 4/25 2023-12-07T16:10:33.675 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs2-2:17.2.7-115.g4f62d9ad.el8.x86_64 5/25 2023-12-07T16:10:33.675 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libradosstriper1-2:17.2.7-115.g4f62d9ad.el8.x86_64 6/25 2023-12-07T16:10:33.675 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librgw2-2:17.2.7-115.g4f62d9ad.el8.x86_64 7/25 2023-12-07T16:10:33.675 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-argparse-2:17.2.7-115.g4f62d9ad.el8.x 8/25 2023-12-07T16:10:33.675 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-common-2:17.2.7-115.g4f62d9ad.el8.x86 9/25 2023-12-07T16:10:33.675 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cephfs-2:17.2.7-115.g4f62d9ad.el8.x86_64 10/25 2023-12-07T16:10:33.675 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rados-2:17.2.7-115.g4f62d9ad.el8.x86_64 11/25 2023-12-07T16:10:33.676 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rbd-2:17.2.7-115.g4f62d9ad.el8.x86_64 12/25 2023-12-07T16:10:33.676 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rgw-2:17.2.7-115.g4f62d9ad.el8.x86_64 13/25 2023-12-07T16:10:33.676 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-12-07T16:10:33.676 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-07T16:10:33.676 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-07T16:10:33.676 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-07T16:10:33.676 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-07T16:10:33.676 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-12-07T16:10:33.676 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-12-07T16:10:33.676 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-12-07T16:10:33.676 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:17.2.7-115.g4f62d9ad.el8.x86_64 22/25 2023-12-07T16:10:33.676 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-07T16:10:33.676 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:17.2.7-115.g4f62d9ad.el8.x86_64 24/25 2023-12-07T16:10:34.832 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-07T16:10:34.833 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:10:34.833 INFO:teuthology.orchestra.run.smithi152.stdout:Upgraded: 2023-12-07T16:10:34.833 INFO:teuthology.orchestra.run.smithi152.stdout: librados2-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:34.833 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:34.833 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-07T16:10:34.833 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:34.833 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:34.833 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:34.833 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:34.833 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-07T16:10:34.833 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:34.833 INFO:teuthology.orchestra.run.smithi152.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-07T16:10:34.833 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-07T16:10:34.834 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:34.834 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-07T16:10:34.834 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:34.834 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-07T16:10:34.834 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-07T16:10:34.834 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:34.834 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:34.834 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:34.834 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-07T16:10:34.834 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:34.834 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:34.834 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:34.834 INFO:teuthology.orchestra.run.smithi152.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-07T16:10:34.834 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:10:34.834 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:10:35.150 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-test 2023-12-07T16:10:36.011 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:44 ago on Thu 07 Dec 2023 04:09:52 PM UTC. 2023-12-07T16:10:37.699 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:10:37.700 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:10:37.700 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-12-07T16:10:37.700 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:10:37.700 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-07T16:10:37.700 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 52 M 2023-12-07T16:10:37.700 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-12-07T16:10:37.701 INFO:teuthology.orchestra.run.smithi152.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-07T16:10:37.701 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 174 k 2023-12-07T16:10:37.701 INFO:teuthology.orchestra.run.smithi152.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-07T16:10:37.701 INFO:teuthology.orchestra.run.smithi152.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-07T16:10:37.701 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-07T16:10:37.701 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:10:37.701 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-07T16:10:37.701 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:10:37.701 INFO:teuthology.orchestra.run.smithi152.stdout:Install 6 Packages 2023-12-07T16:10:37.701 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:10:37.702 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 53 M 2023-12-07T16:10:37.702 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 234 M 2023-12-07T16:10:37.702 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-07T16:10:37.977 INFO:teuthology.orchestra.run.smithi152.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 872 kB/s | 203 kB 00:00 2023-12-07T16:10:38.036 INFO:teuthology.orchestra.run.smithi152.stdout:(2/6): libcephsqlite-17.2.7-115.g4f62d9ad.el8.x 597 kB/s | 174 kB 00:00 2023-12-07T16:10:38.078 INFO:teuthology.orchestra.run.smithi152.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 1.8 MB/s | 187 kB 00:00 2023-12-07T16:10:38.144 INFO:teuthology.orchestra.run.smithi152.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.0 MB/s | 71 kB 00:00 2023-12-07T16:10:38.311 INFO:teuthology.orchestra.run.smithi152.stdout:(5/6): socat-1.7.4.1-1.el8.x86_64.rpm 1.1 MB/s | 323 kB 00:00 2023-12-07T16:10:40.395 INFO:teuthology.orchestra.run.smithi152.stdout:(6/6): ceph-test-17.2.7-115.g4f62d9ad.el8.x86_6 20 MB/s | 52 MB 00:02 2023-12-07T16:10:40.397 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:10:40.397 INFO:teuthology.orchestra.run.smithi152.stdout:Total 20 MB/s | 53 MB 00:02 2023-12-07T16:10:40.441 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-07T16:10:40.461 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-07T16:10:40.461 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-07T16:10:40.747 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-07T16:10:40.750 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-07T16:10:41.209 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-07T16:10:41.432 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-07T16:10:41.641 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-07T16:10:41.763 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-07T16:10:41.842 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-07T16:10:42.063 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-07T16:10:42.230 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephsqlite-2:17.2.7-115.g4f62d9ad.el8.x86_64 5/6 2023-12-07T16:10:47.225 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephsqlite-2:17.2.7-115.g4f62d9ad.el8.x86_64 5/6 2023-12-07T16:10:47.436 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-test-2:17.2.7-115.g4f62d9ad.el8.x86_64 6/6 2023-12-07T16:10:47.720 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-test-2:17.2.7-115.g4f62d9ad.el8.x86_64 6/6 2023-12-07T16:10:47.720 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-test-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/6 2023-12-07T16:10:47.720 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephsqlite-2:17.2.7-115.g4f62d9ad.el8.x86_64 2/6 2023-12-07T16:10:47.720 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-07T16:10:47.720 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-07T16:10:47.720 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-07T16:10:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-07T16:10:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:10:48.458 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-07T16:10:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: jq-1.6-8.el8.x86_64 2023-12-07T16:10:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-07T16:10:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-07T16:10:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-07T16:10:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:10:48.458 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:10:48.673 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph 2023-12-07T16:10:49.544 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:57 ago on Thu 07 Dec 2023 04:09:52 PM UTC. 2023-12-07T16:10:51.283 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:10:51.287 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:10:51.287 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-12-07T16:10:51.287 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:10:51.287 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-07T16:10:51.287 INFO:teuthology.orchestra.run.smithi152.stdout: ceph x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 6.4 k 2023-12-07T16:10:51.287 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-12-07T16:10:51.287 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 2.3 M 2023-12-07T16:10:51.287 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 1.6 M 2023-12-07T16:10:51.287 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core noarch 2:17.2.7-115.g4f62d9ad.el8 ceph-noarch 238 k 2023-12-07T16:10:51.288 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 3.9 M 2023-12-07T16:10:51.288 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 17 M 2023-12-07T16:10:51.288 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-07T16:10:51.288 INFO:teuthology.orchestra.run.smithi152.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-07T16:10:51.288 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-07T16:10:51.288 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-07T16:10:51.288 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-07T16:10:51.288 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-07T16:10:51.288 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-07T16:10:51.288 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-07T16:10:51.288 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-07T16:10:51.289 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-07T16:10:51.289 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-07T16:10:51.289 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-07T16:10:51.289 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-07T16:10:51.289 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-07T16:10:51.289 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-07T16:10:51.289 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-07T16:10:51.289 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-07T16:10:51.289 INFO:teuthology.orchestra.run.smithi152.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-07T16:10:51.289 INFO:teuthology.orchestra.run.smithi152.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-07T16:10:51.289 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-07T16:10:51.289 INFO:teuthology.orchestra.run.smithi152.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-07T16:10:51.290 INFO:teuthology.orchestra.run.smithi152.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-07T16:10:51.290 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-07T16:10:51.290 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-07T16:10:51.290 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-07T16:10:51.290 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-07T16:10:51.290 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:10:51.290 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-07T16:10:51.290 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:10:51.290 INFO:teuthology.orchestra.run.smithi152.stdout:Install 32 Packages 2023-12-07T16:10:51.290 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:10:51.295 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 28 M 2023-12-07T16:10:51.295 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 110 M 2023-12-07T16:10:51.295 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-07T16:10:51.679 INFO:teuthology.orchestra.run.smithi152.stdout:(1/32): ceph-17.2.7-115.g4f62d9ad.el8.x86_64.rp 49 kB/s | 6.4 kB 00:00 2023-12-07T16:10:51.858 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-selinux-2:17.2.7-115.g4f62d9ad.el8.x86_64 22/25 2023-12-07T16:10:51.858 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /sys 2023-12-07T16:10:51.858 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /proc 2023-12-07T16:10:51.858 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /dev 2023-12-07T16:10:51.858 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /run 2023-12-07T16:10:51.858 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /mnt 2023-12-07T16:10:51.859 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /var/tmp 2023-12-07T16:10:51.859 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /home 2023-12-07T16:10:51.859 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /tmp 2023-12-07T16:10:51.859 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /dev 2023-12-07T16:10:51.859 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:10:51.870 INFO:teuthology.orchestra.run.smithi152.stdout:(2/32): ceph-mds-17.2.7-115.g4f62d9ad.el8.x86_6 7.2 MB/s | 2.3 MB 00:00 2023-12-07T16:10:52.513 INFO:teuthology.orchestra.run.smithi152.stdout:(3/32): ceph-mon-17.2.7-115.g4f62d9ad.el8.x86_6 4.7 MB/s | 3.9 MB 00:00 2023-12-07T16:10:52.596 INFO:teuthology.orchestra.run.smithi152.stdout:(4/32): ceph-mgr-modules-core-17.2.7-115.g4f62d 2.8 MB/s | 238 kB 00:00 2023-12-07T16:10:52.772 INFO:teuthology.orchestra.run.smithi152.stdout:(5/32): ceph-osd-17.2.7-115.g4f62d9ad.el8.x86_6 19 MB/s | 17 MB 00:00 2023-12-07T16:10:52.813 INFO:teuthology.orchestra.run.smithi152.stdout:(6/32): ceph-mgr-17.2.7-115.g4f62d9ad.el8.x86_6 1.2 MB/s | 1.6 MB 00:01 2023-12-07T16:10:52.914 INFO:teuthology.orchestra.run.smithi152.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 274 kB/s | 39 kB 00:00 2023-12-07T16:10:52.964 INFO:teuthology.orchestra.run.smithi152.stdout:(8/32): python3-mako-1.0.6-14.el8.noarch.rpm 427 kB/s | 157 kB 00:00 2023-12-07T16:10:53.006 INFO:teuthology.orchestra.run.smithi152.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 621 kB/s | 57 kB 00:00 2023-12-07T16:10:53.031 INFO:teuthology.orchestra.run.smithi152.stdout:(10/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 476 kB/s | 103 kB 00:00 2023-12-07T16:10:53.131 INFO:teuthology.orchestra.run.smithi152.stdout:(11/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.9 MB/s | 249 kB 00:00 2023-12-07T16:10:53.190 INFO:teuthology.orchestra.run.smithi152.stdout:(12/32): python3-cryptography-3.2.1-6.el8.x86_6 4.0 MB/s | 641 kB 00:00 2023-12-07T16:10:53.215 INFO:teuthology.orchestra.run.smithi152.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 1.3 MB/s | 109 kB 00:00 2023-12-07T16:10:53.382 INFO:teuthology.orchestra.run.smithi152.stdout:(14/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.1 MB/s | 457 kB 00:00 2023-12-07T16:10:53.641 INFO:teuthology.orchestra.run.smithi152.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 97 kB/s | 44 kB 00:00 2023-12-07T16:10:54.063 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-radosgw-2:17.2.7-115.g4f62d9ad.el8.x86_64 23/25 2023-12-07T16:10:54.063 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-115.g4f62d9ad.el8.x86_64 23/25 2023-12-07T16:10:54.063 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-07T16:10:54.064 INFO:teuthology.orchestra.run.smithi152.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 347 kB/s | 185 kB 00:00 2023-12-07T16:10:54.064 INFO:teuthology.orchestra.run.smithi152.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2023-12-07T16:10:54.064 INFO:teuthology.orchestra.run.smithi152.stdout:(18/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 351 kB/s | 173 kB 00:00 2023-12-07T16:10:54.064 INFO:teuthology.orchestra.run.smithi152.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 175 kB/s | 18 kB 00:00 2023-12-07T16:10:54.064 INFO:teuthology.orchestra.run.smithi152.stdout:(20/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.1 MB/s | 384 kB 00:00 2023-12-07T16:10:54.064 INFO:teuthology.orchestra.run.smithi152.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 364 kB/s | 49 kB 00:00 2023-12-07T16:10:54.064 INFO:teuthology.orchestra.run.smithi152.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 585 kB/s | 59 kB 00:00 2023-12-07T16:10:54.093 INFO:teuthology.orchestra.run.smithi152.stdout:(23/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.5 MB/s | 283 kB 00:00 2023-12-07T16:10:54.093 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-07T16:10:54.093 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-07T16:10:54.110 INFO:teuthology.orchestra.run.smithi152.stdout:(24/32): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2023-12-07T16:10:54.143 INFO:teuthology.orchestra.run.smithi152.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 203 kB/s | 19 kB 00:00 2023-12-07T16:10:54.202 INFO:teuthology.orchestra.run.smithi152.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 219 kB/s | 24 kB 00:00 2023-12-07T16:10:54.219 INFO:teuthology.orchestra.run.smithi152.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 268 kB/s | 29 kB 00:00 2023-12-07T16:10:54.236 INFO:teuthology.orchestra.run.smithi152.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 298 kB/s | 27 kB 00:00 2023-12-07T16:10:54.311 INFO:teuthology.orchestra.run.smithi152.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 2.3 MB/s | 255 kB 00:00 2023-12-07T16:10:54.337 INFO:teuthology.orchestra.run.smithi152.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 851 kB/s | 85 kB 00:00 2023-12-07T16:10:54.395 INFO:teuthology.orchestra.run.smithi152.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.4 MB/s | 251 kB 00:00 2023-12-07T16:10:54.420 INFO:teuthology.orchestra.run.smithi152.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 211 kB/s | 23 kB 00:00 2023-12-07T16:10:54.424 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:10:54.424 INFO:teuthology.orchestra.run.smithi152.stdout:Total 9.1 MB/s | 28 MB 00:03 2023-12-07T16:10:54.506 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-07T16:10:54.544 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-07T16:10:54.544 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-07T16:10:54.847 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-07T16:10:54.851 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-07T16:10:54.855 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-07T16:10:54.855 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-base-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/25 2023-12-07T16:10:54.855 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-common-2:17.2.7-115.g4f62d9ad.el8.x86_64 2/25 2023-12-07T16:10:54.855 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-radosgw-2:17.2.7-115.g4f62d9ad.el8.x86_64 3/25 2023-12-07T16:10:54.855 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-selinux-2:17.2.7-115.g4f62d9ad.el8.x86_64 4/25 2023-12-07T16:10:54.855 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs2-2:17.2.7-115.g4f62d9ad.el8.x86_64 5/25 2023-12-07T16:10:54.855 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libradosstriper1-2:17.2.7-115.g4f62d9ad.el8.x86_64 6/25 2023-12-07T16:10:54.855 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librgw2-2:17.2.7-115.g4f62d9ad.el8.x86_64 7/25 2023-12-07T16:10:54.856 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-argparse-2:17.2.7-115.g4f62d9ad.el8.x 8/25 2023-12-07T16:10:54.856 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-common-2:17.2.7-115.g4f62d9ad.el8.x86 9/25 2023-12-07T16:10:54.856 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cephfs-2:17.2.7-115.g4f62d9ad.el8.x86_64 10/25 2023-12-07T16:10:54.856 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rados-2:17.2.7-115.g4f62d9ad.el8.x86_64 11/25 2023-12-07T16:10:54.856 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rbd-2:17.2.7-115.g4f62d9ad.el8.x86_64 12/25 2023-12-07T16:10:54.856 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rgw-2:17.2.7-115.g4f62d9ad.el8.x86_64 13/25 2023-12-07T16:10:54.856 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-12-07T16:10:54.856 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-07T16:10:54.856 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-07T16:10:54.856 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-07T16:10:54.856 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-07T16:10:54.856 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-12-07T16:10:54.856 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-12-07T16:10:54.857 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-12-07T16:10:54.857 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-2:17.2.7-115.g4f62d9ad.el8.x86_64 22/25 2023-12-07T16:10:54.857 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-07T16:10:54.857 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-2:17.2.7-115.g4f62d9ad.el8.x86_64 24/25 2023-12-07T16:10:56.043 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-07T16:10:56.146 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-07T16:10:56.146 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:10:56.147 INFO:teuthology.orchestra.run.smithi063.stdout:Upgraded: 2023-12-07T16:10:56.147 INFO:teuthology.orchestra.run.smithi063.stdout: librados2-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:56.147 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:56.147 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-07T16:10:56.147 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:56.147 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:56.147 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:56.147 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:56.147 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-07T16:10:56.147 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:56.147 INFO:teuthology.orchestra.run.smithi063.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-07T16:10:56.148 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-07T16:10:56.148 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:56.148 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-07T16:10:56.148 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:56.148 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-07T16:10:56.148 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-07T16:10:56.148 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:56.148 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:56.148 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:56.148 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-07T16:10:56.148 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:56.149 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:56.149 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:10:56.149 INFO:teuthology.orchestra.run.smithi063.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-07T16:10:56.149 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:10:56.149 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:10:56.259 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-07T16:10:56.453 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-test 2023-12-07T16:10:56.513 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-07T16:10:56.736 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-07T16:10:57.018 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-07T16:10:57.207 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-07T16:10:57.351 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:00:48 ago on Thu 07 Dec 2023 04:10:09 PM UTC. 2023-12-07T16:10:57.414 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-07T16:10:57.564 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-07T16:10:57.734 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-07T16:10:57.952 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-07T16:10:58.156 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-07T16:10:58.410 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-07T16:10:58.651 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-07T16:10:59.016 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-07T16:10:59.132 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:10:59.133 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:10:59.133 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2023-12-07T16:10:59.133 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:10:59.133 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-07T16:10:59.133 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 52 M 2023-12-07T16:10:59.133 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2023-12-07T16:10:59.134 INFO:teuthology.orchestra.run.smithi063.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-07T16:10:59.134 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 174 k 2023-12-07T16:10:59.134 INFO:teuthology.orchestra.run.smithi063.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-07T16:10:59.134 INFO:teuthology.orchestra.run.smithi063.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-07T16:10:59.134 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-07T16:10:59.134 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:10:59.134 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-07T16:10:59.134 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:10:59.134 INFO:teuthology.orchestra.run.smithi063.stdout:Install 6 Packages 2023-12-07T16:10:59.134 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:10:59.135 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 53 M 2023-12-07T16:10:59.135 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 234 M 2023-12-07T16:10:59.135 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-07T16:10:59.280 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-07T16:10:59.443 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-07T16:10:59.535 INFO:teuthology.orchestra.run.smithi063.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 941 kB/s | 203 kB 00:00 2023-12-07T16:10:59.618 INFO:teuthology.orchestra.run.smithi063.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2023-12-07T16:10:59.644 INFO:teuthology.orchestra.run.smithi063.stdout:(3/6): libcephsqlite-17.2.7-115.g4f62d9ad.el8.x 536 kB/s | 174 kB 00:00 2023-12-07T16:10:59.719 INFO:teuthology.orchestra.run.smithi063.stdout:(4/6): socat-1.7.4.1-1.el8.x86_64.rpm 3.1 MB/s | 323 kB 00:00 2023-12-07T16:10:59.732 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-07T16:10:59.819 INFO:teuthology.orchestra.run.smithi063.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 403 kB/s | 71 kB 00:00 2023-12-07T16:10:59.986 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-07T16:11:00.279 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-07T16:11:00.508 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-07T16:11:00.671 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-07T16:11:00.882 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-07T16:11:01.110 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-07T16:11:01.372 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-07T16:11:01.593 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-07T16:11:01.820 INFO:teuthology.orchestra.run.smithi063.stdout:(6/6): ceph-test-17.2.7-115.g4f62d9ad.el8.x86_6 21 MB/s | 52 MB 00:02 2023-12-07T16:11:01.822 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:11:01.822 INFO:teuthology.orchestra.run.smithi063.stdout:Total 20 MB/s | 53 MB 00:02 2023-12-07T16:11:01.866 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-07T16:11:01.889 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-07T16:11:01.889 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-07T16:11:01.973 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-07T16:11:02.191 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-07T16:11:02.195 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-07T16:11:02.240 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-07T16:11:02.602 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-115.g4f62d9ad.el8.n 27/32 2023-12-07T16:11:02.723 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-07T16:11:02.863 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-2:17.2.7-115.g4f62d9ad.el8.x86_64 28/32 2023-12-07T16:11:03.001 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-07T16:11:03.218 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-07T16:11:03.331 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-07T16:11:03.442 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-07T16:11:03.640 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-07T16:11:03.856 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephsqlite-2:17.2.7-115.g4f62d9ad.el8.x86_64 5/6 2023-12-07T16:11:04.338 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-2:17.2.7-115.g4f62d9ad.el8.x86_64 28/32 2023-12-07T16:11:04.572 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-osd-2:17.2.7-115.g4f62d9ad.el8.x86_64 29/32 2023-12-07T16:11:04.977 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-osd-2:17.2.7-115.g4f62d9ad.el8.x86_64 29/32 2023-12-07T16:11:05.144 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mon-2:17.2.7-115.g4f62d9ad.el8.x86_64 30/32 2023-12-07T16:11:05.376 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mon-2:17.2.7-115.g4f62d9ad.el8.x86_64 30/32 2023-12-07T16:11:05.577 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mds-2:17.2.7-115.g4f62d9ad.el8.x86_64 31/32 2023-12-07T16:11:05.595 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mds-2:17.2.7-115.g4f62d9ad.el8.x86_64 31/32 2023-12-07T16:11:05.751 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-2:17.2.7-115.g4f62d9ad.el8.x86_64 32/32 2023-12-07T16:11:06.153 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-2:17.2.7-115.g4f62d9ad.el8.x86_64 32/32 2023-12-07T16:11:06.153 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/32 2023-12-07T16:11:06.154 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mds-2:17.2.7-115.g4f62d9ad.el8.x86_64 2/32 2023-12-07T16:11:06.154 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-2:17.2.7-115.g4f62d9ad.el8.x86_64 3/32 2023-12-07T16:11:06.154 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mon-2:17.2.7-115.g4f62d9ad.el8.x86_64 4/32 2023-12-07T16:11:06.154 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-osd-2:17.2.7-115.g4f62d9ad.el8.x86_64 5/32 2023-12-07T16:11:06.154 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-115.g4f62d9ad.el8.n 6/32 2023-12-07T16:11:06.154 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-07T16:11:06.154 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-07T16:11:06.154 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-07T16:11:06.154 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-07T16:11:06.155 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-07T16:11:06.155 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-07T16:11:06.155 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-07T16:11:06.155 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-07T16:11:06.155 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-07T16:11:06.155 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-07T16:11:06.155 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-07T16:11:06.155 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-07T16:11:06.155 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-07T16:11:06.155 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-07T16:11:06.156 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-07T16:11:06.156 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-07T16:11:06.156 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-07T16:11:06.156 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-07T16:11:06.156 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-07T16:11:06.156 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-07T16:11:06.156 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-07T16:11:06.156 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-07T16:11:06.156 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-07T16:11:06.156 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-07T16:11:06.156 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-07T16:11:07.715 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-07T16:11:07.716 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:11:07.716 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-07T16:11:07.716 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:11:07.716 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:11:07.716 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:11:07.716 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core-2:17.2.7-115.g4f62d9ad.el8.noarch 2023-12-07T16:11:07.716 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:11:07.716 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:11:07.716 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-07T16:11:07.716 INFO:teuthology.orchestra.run.smithi152.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-07T16:11:07.716 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-07T16:11:07.716 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-07T16:11:07.717 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-07T16:11:07.717 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-07T16:11:07.717 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-07T16:11:07.717 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-07T16:11:07.717 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-07T16:11:07.717 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-07T16:11:07.717 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-07T16:11:07.717 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-07T16:11:07.717 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-07T16:11:07.717 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend-2.6-1.el8.noarch 2023-12-07T16:11:07.717 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-07T16:11:07.717 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-07T16:11:07.717 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-07T16:11:07.718 INFO:teuthology.orchestra.run.smithi152.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-07T16:11:07.718 INFO:teuthology.orchestra.run.smithi152.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-07T16:11:07.718 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-07T16:11:07.718 INFO:teuthology.orchestra.run.smithi152.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-07T16:11:07.718 INFO:teuthology.orchestra.run.smithi152.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-07T16:11:07.718 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-07T16:11:07.718 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-07T16:11:07.718 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-07T16:11:07.718 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-07T16:11:07.718 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:11:07.718 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:11:08.004 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-base 2023-12-07T16:11:08.862 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:16 ago on Thu 07 Dec 2023 04:09:52 PM UTC. 2023-12-07T16:11:09.148 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephsqlite-2:17.2.7-115.g4f62d9ad.el8.x86_64 5/6 2023-12-07T16:11:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-test-2:17.2.7-115.g4f62d9ad.el8.x86_64 6/6 2023-12-07T16:11:09.745 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-test-2:17.2.7-115.g4f62d9ad.el8.x86_64 6/6 2023-12-07T16:11:09.745 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-test-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/6 2023-12-07T16:11:09.745 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephsqlite-2:17.2.7-115.g4f62d9ad.el8.x86_64 2/6 2023-12-07T16:11:09.745 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-07T16:11:09.745 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-07T16:11:09.746 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-07T16:11:10.312 INFO:teuthology.orchestra.run.smithi152.stdout:Package ceph-base-2:17.2.7-115.g4f62d9ad.el8.x86_64 is already installed. 2023-12-07T16:11:10.465 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-07T16:11:10.465 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:11:10.466 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-07T16:11:10.466 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:11:10.466 INFO:teuthology.orchestra.run.smithi063.stdout: jq-1.6-8.el8.x86_64 2023-12-07T16:11:10.466 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:11:10.466 INFO:teuthology.orchestra.run.smithi063.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-07T16:11:10.466 INFO:teuthology.orchestra.run.smithi063.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-07T16:11:10.466 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-07T16:11:10.466 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:11:10.466 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:11:10.538 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:11:10.539 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2023-12-07T16:11:10.539 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:11:10.681 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install cephadm 2023-12-07T16:11:10.742 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph 2023-12-07T16:11:11.529 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:19 ago on Thu 07 Dec 2023 04:09:52 PM UTC. 2023-12-07T16:11:11.629 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:02 ago on Thu 07 Dec 2023 04:10:09 PM UTC. 2023-12-07T16:11:13.227 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:11:13.227 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:11:13.228 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-12-07T16:11:13.228 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:11:13.228 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-07T16:11:13.228 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm noarch 2:17.2.7-115.g4f62d9ad.el8 ceph-noarch 80 k 2023-12-07T16:11:13.228 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:11:13.228 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-07T16:11:13.228 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:11:13.228 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2023-12-07T16:11:13.228 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:11:13.228 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 80 k 2023-12-07T16:11:13.228 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 364 k 2023-12-07T16:11:13.228 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-07T16:11:13.424 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:11:13.428 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:11:13.428 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2023-12-07T16:11:13.428 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:11:13.428 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-07T16:11:13.428 INFO:teuthology.orchestra.run.smithi063.stdout: ceph x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 6.4 k 2023-12-07T16:11:13.428 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2023-12-07T16:11:13.428 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 2.3 M 2023-12-07T16:11:13.428 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 1.6 M 2023-12-07T16:11:13.429 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core noarch 2:17.2.7-115.g4f62d9ad.el8 ceph-noarch 238 k 2023-12-07T16:11:13.429 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 3.9 M 2023-12-07T16:11:13.429 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 17 M 2023-12-07T16:11:13.429 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-07T16:11:13.429 INFO:teuthology.orchestra.run.smithi063.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-07T16:11:13.429 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-07T16:11:13.429 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-07T16:11:13.429 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-07T16:11:13.429 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-07T16:11:13.429 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-07T16:11:13.429 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-07T16:11:13.429 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-07T16:11:13.429 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-07T16:11:13.429 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-07T16:11:13.430 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-07T16:11:13.430 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-07T16:11:13.430 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-07T16:11:13.430 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-07T16:11:13.430 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-07T16:11:13.430 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-07T16:11:13.430 INFO:teuthology.orchestra.run.smithi063.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-07T16:11:13.430 INFO:teuthology.orchestra.run.smithi063.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-07T16:11:13.430 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-07T16:11:13.430 INFO:teuthology.orchestra.run.smithi063.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-07T16:11:13.430 INFO:teuthology.orchestra.run.smithi063.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-07T16:11:13.430 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-07T16:11:13.430 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-07T16:11:13.430 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-07T16:11:13.431 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-07T16:11:13.431 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:11:13.431 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-07T16:11:13.431 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:11:13.431 INFO:teuthology.orchestra.run.smithi063.stdout:Install 32 Packages 2023-12-07T16:11:13.431 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:11:13.432 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 28 M 2023-12-07T16:11:13.432 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 110 M 2023-12-07T16:11:13.432 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-07T16:11:13.484 INFO:teuthology.orchestra.run.smithi152.stdout:cephadm-17.2.7-115.g4f62d9ad.el8.noarch.rpm 314 kB/s | 80 kB 00:00 2023-12-07T16:11:13.485 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:11:13.485 INFO:teuthology.orchestra.run.smithi152.stdout:Total 312 kB/s | 80 kB 00:00 2023-12-07T16:11:13.485 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-07T16:11:13.493 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-07T16:11:13.493 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-07T16:11:13.495 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-07T16:11:13.498 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-07T16:11:13.543 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-07T16:11:13.997 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:17.2.7-115.g4f62d9ad.el8.noarch 1/1 2023-12-07T16:11:14.171 INFO:teuthology.orchestra.run.smithi063.stdout:(1/32): ceph-17.2.7-115.g4f62d9ad.el8.x86_64.rp 35 kB/s | 6.4 kB 00:00 2023-12-07T16:11:14.191 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephadm-2:17.2.7-115.g4f62d9ad.el8.noarch 1/1 2023-12-07T16:11:14.263 INFO:teuthology.orchestra.run.smithi063.stdout:(2/32): ceph-mgr-17.2.7-115.g4f62d9ad.el8.x86_6 5.7 MB/s | 1.6 MB 00:00 2023-12-07T16:11:14.419 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:17.2.7-115.g4f62d9ad.el8.noarch 1/1 2023-12-07T16:11:14.764 INFO:teuthology.orchestra.run.smithi063.stdout:(3/32): ceph-mds-17.2.7-115.g4f62d9ad.el8.x86_6 3.0 MB/s | 2.3 MB 00:00 2023-12-07T16:11:14.864 INFO:teuthology.orchestra.run.smithi063.stdout:(4/32): ceph-mgr-modules-core-17.2.7-115.g4f62d 2.3 MB/s | 238 kB 00:00 2023-12-07T16:11:15.083 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephadm-2:17.2.7-115.g4f62d9ad.el8.noarch 1/1 2023-12-07T16:11:15.083 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:11:15.084 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-07T16:11:15.084 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm-2:17.2.7-115.g4f62d9ad.el8.noarch 2023-12-07T16:11:15.084 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:11:15.084 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:11:15.156 INFO:teuthology.orchestra.run.smithi063.stdout:(5/32): ceph-osd-17.2.7-115.g4f62d9ad.el8.x86_6 19 MB/s | 17 MB 00:00 2023-12-07T16:11:15.181 INFO:teuthology.orchestra.run.smithi063.stdout:(6/32): python3-mako-1.0.6-14.el8.noarch.rpm 495 kB/s | 157 kB 00:00 2023-12-07T16:11:15.282 INFO:teuthology.orchestra.run.smithi063.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 1.0 MB/s | 103 kB 00:00 2023-12-07T16:11:15.295 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-immutable-object-cache 2023-12-07T16:11:15.307 INFO:teuthology.orchestra.run.smithi063.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 258 kB/s | 39 kB 00:00 2023-12-07T16:11:15.366 INFO:teuthology.orchestra.run.smithi063.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 683 kB/s | 57 kB 00:00 2023-12-07T16:11:15.457 INFO:teuthology.orchestra.run.smithi063.stdout:(10/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.7 MB/s | 249 kB 00:00 2023-12-07T16:11:15.566 INFO:teuthology.orchestra.run.smithi063.stdout:(11/32): ceph-mon-17.2.7-115.g4f62d9ad.el8.x86_ 2.8 MB/s | 3.9 MB 00:01 2023-12-07T16:11:15.600 INFO:teuthology.orchestra.run.smithi063.stdout:(12/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.5 MB/s | 457 kB 00:00 2023-12-07T16:11:15.675 INFO:teuthology.orchestra.run.smithi063.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 1.0 MB/s | 109 kB 00:00 2023-12-07T16:11:15.725 INFO:teuthology.orchestra.run.smithi063.stdout:(14/32): python3-cryptography-3.2.1-6.el8.x86_6 2.3 MB/s | 641 kB 00:00 2023-12-07T16:11:15.926 INFO:teuthology.orchestra.run.smithi063.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 134 kB/s | 44 kB 00:00 2023-12-07T16:11:16.093 INFO:teuthology.orchestra.run.smithi063.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 444 kB/s | 185 kB 00:00 2023-12-07T16:11:16.135 INFO:teuthology.orchestra.run.smithi063.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 422 kB/s | 173 kB 00:00 2023-12-07T16:11:16.153 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:24 ago on Thu 07 Dec 2023 04:09:52 PM UTC. 2023-12-07T16:11:16.184 INFO:teuthology.orchestra.run.smithi063.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2023-12-07T16:11:16.227 INFO:teuthology.orchestra.run.smithi063.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 191 kB/s | 18 kB 00:00 2023-12-07T16:11:16.268 INFO:teuthology.orchestra.run.smithi063.stdout:(20/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.1 MB/s | 384 kB 00:00 2023-12-07T16:11:16.285 INFO:teuthology.orchestra.run.smithi063.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 485 kB/s | 49 kB 00:00 2023-12-07T16:11:16.352 INFO:teuthology.orchestra.run.smithi063.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 468 kB/s | 59 kB 00:00 2023-12-07T16:11:16.378 INFO:teuthology.orchestra.run.smithi063.stdout:(23/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.5 MB/s | 283 kB 00:00 2023-12-07T16:11:16.394 INFO:teuthology.orchestra.run.smithi063.stdout:(24/32): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2023-12-07T16:11:16.453 INFO:teuthology.orchestra.run.smithi063.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 186 kB/s | 19 kB 00:00 2023-12-07T16:11:16.478 INFO:teuthology.orchestra.run.smithi063.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 238 kB/s | 24 kB 00:00 2023-12-07T16:11:16.504 INFO:teuthology.orchestra.run.smithi063.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 269 kB/s | 29 kB 00:00 2023-12-07T16:11:16.554 INFO:teuthology.orchestra.run.smithi063.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 273 kB/s | 27 kB 00:00 2023-12-07T16:11:16.610 INFO:teuthology.orchestra.run.smithi063.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 1.9 MB/s | 255 kB 00:00 2023-12-07T16:11:16.654 INFO:teuthology.orchestra.run.smithi063.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 853 kB/s | 85 kB 00:00 2023-12-07T16:11:16.713 INFO:teuthology.orchestra.run.smithi063.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.2 MB/s | 251 kB 00:00 2023-12-07T16:11:16.738 INFO:teuthology.orchestra.run.smithi063.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 180 kB/s | 23 kB 00:00 2023-12-07T16:11:16.740 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:11:16.741 INFO:teuthology.orchestra.run.smithi063.stdout:Total 8.6 MB/s | 28 MB 00:03 2023-12-07T16:11:16.827 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-07T16:11:16.867 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-07T16:11:16.867 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-07T16:11:17.169 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-07T16:11:17.173 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-07T16:11:17.834 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:11:17.834 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:11:17.834 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repo Size 2023-12-07T16:11:17.834 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:11:17.834 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-07T16:11:17.834 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 161 k 2023-12-07T16:11:17.835 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:11:17.835 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-07T16:11:17.835 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:11:17.835 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2023-12-07T16:11:17.835 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:11:17.835 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 161 k 2023-12-07T16:11:17.835 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 490 k 2023-12-07T16:11:17.835 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-07T16:11:18.400 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-07T16:11:18.647 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-07T16:11:18.739 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-immutable-object-cache-17.2.7-115.g4f62d9a 179 kB/s | 161 kB 00:00 2023-12-07T16:11:18.739 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:11:18.740 INFO:teuthology.orchestra.run.smithi152.stdout:Total 178 kB/s | 161 kB 00:00 2023-12-07T16:11:18.740 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-07T16:11:18.752 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-07T16:11:18.752 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-07T16:11:18.805 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-07T16:11:18.808 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-07T16:11:18.924 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-07T16:11:19.195 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-07T16:11:19.305 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-07T16:11:19.469 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-07T16:11:19.483 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-115.g4f62d9ad.e 1/1 2023-12-07T16:11:19.718 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-07T16:11:19.904 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-115.g4f62d9ad.e 1/1 2023-12-07T16:11:19.959 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-07T16:11:20.133 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-07T16:11:20.369 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-07T16:11:20.600 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-115.g4f62d9ad.e 1/1 2023-12-07T16:11:20.600 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:11:20.600 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-07T16:11:20.600 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:11:20.600 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:11:20.600 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:11:20.640 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-07T16:11:20.831 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr 2023-12-07T16:11:20.876 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-07T16:11:21.146 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-07T16:11:21.430 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-07T16:11:21.690 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:29 ago on Thu 07 Dec 2023 04:09:52 PM UTC. 2023-12-07T16:11:21.867 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-07T16:11:22.192 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-07T16:11:22.379 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-07T16:11:22.707 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-07T16:11:22.939 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-07T16:11:23.158 INFO:teuthology.orchestra.run.smithi152.stdout:Package ceph-mgr-2:17.2.7-115.g4f62d9ad.el8.x86_64 is already installed. 2023-12-07T16:11:23.342 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-07T16:11:23.381 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:11:23.382 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2023-12-07T16:11:23.382 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:11:23.498 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-dashboard 2023-12-07T16:11:23.594 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-07T16:11:23.749 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-07T16:11:23.968 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-07T16:11:24.316 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-07T16:11:24.361 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:32 ago on Thu 07 Dec 2023 04:09:52 PM UTC. 2023-12-07T16:11:24.651 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-07T16:11:24.885 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-07T16:11:25.209 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-07T16:11:25.533 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-07T16:11:25.925 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-115.g4f62d9ad.el8.n 27/32 2023-12-07T16:11:26.057 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:11:26.058 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:11:26.058 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-12-07T16:11:26.058 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:11:26.058 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-07T16:11:26.058 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard noarch 2:17.2.7-115.g4f62d9ad.el8 ceph-noarch 1.7 M 2023-12-07T16:11:26.059 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-12-07T16:11:26.059 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards noarch 2:17.2.7-115.g4f62d9ad.el8 ceph-noarch 23 k 2023-12-07T16:11:26.059 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts noarch 2:17.2.7-115.g4f62d9ad.el8 ceph-noarch 14 k 2023-12-07T16:11:26.059 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-07T16:11:26.059 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-07T16:11:26.059 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-07T16:11:26.059 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:11:26.059 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-07T16:11:26.059 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:11:26.059 INFO:teuthology.orchestra.run.smithi152.stdout:Install 6 Packages 2023-12-07T16:11:26.059 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:11:26.060 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 2.0 M 2023-12-07T16:11:26.060 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 8.0 M 2023-12-07T16:11:26.060 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-07T16:11:26.161 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-2:17.2.7-115.g4f62d9ad.el8.x86_64 28/32 2023-12-07T16:11:26.441 INFO:teuthology.orchestra.run.smithi152.stdout:(1/6): ceph-grafana-dashboards-17.2.7-115.g4f62 156 kB/s | 23 kB 00:00 2023-12-07T16:11:26.508 INFO:teuthology.orchestra.run.smithi152.stdout:(2/6): python3-jwt-1.6.1-2.el8.noarch.rpm 640 kB/s | 43 kB 00:00 2023-12-07T16:11:26.534 INFO:teuthology.orchestra.run.smithi152.stdout:(3/6): ceph-prometheus-alerts-17.2.7-115.g4f62d 60 kB/s | 14 kB 00:00 2023-12-07T16:11:26.636 INFO:teuthology.orchestra.run.smithi152.stdout:(4/6): ceph-mgr-dashboard-17.2.7-115.g4f62d9ad. 4.9 MB/s | 1.7 MB 00:00 2023-12-07T16:11:26.851 INFO:teuthology.orchestra.run.smithi152.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 98 kB/s | 34 kB 00:00 2023-12-07T16:11:27.010 INFO:teuthology.orchestra.run.smithi152.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 413 kB/s | 196 kB 00:00 2023-12-07T16:11:27.012 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:11:27.012 INFO:teuthology.orchestra.run.smithi152.stdout:Total 2.1 MB/s | 2.0 MB 00:00 2023-12-07T16:11:27.021 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-07T16:11:27.031 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-07T16:11:27.031 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-07T16:11:27.130 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-07T16:11:27.133 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-07T16:11:27.389 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-07T16:11:27.629 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-07T16:11:27.736 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-2:17.2.7-115.g4f62d9ad.el8.x86_64 28/32 2023-12-07T16:11:27.865 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-07T16:11:27.927 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-osd-2:17.2.7-115.g4f62d9ad.el8.x86_64 29/32 2023-12-07T16:11:28.084 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-07T16:11:28.196 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-115.g4f62d9ad.el8.no 4/6 2023-12-07T16:11:28.353 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-osd-2:17.2.7-115.g4f62d9ad.el8.x86_64 29/32 2023-12-07T16:11:28.550 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-115.g4f62d9ad.el8.n 5/6 2023-12-07T16:11:28.587 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mon-2:17.2.7-115.g4f62d9ad.el8.x86_64 30/32 2023-12-07T16:11:28.775 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-115.g4f62d9ad.el8.noarch 6/6 2023-12-07T16:11:28.835 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mon-2:17.2.7-115.g4f62d9ad.el8.x86_64 30/32 2023-12-07T16:11:29.028 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mds-2:17.2.7-115.g4f62d9ad.el8.x86_64 31/32 2023-12-07T16:11:29.047 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mds-2:17.2.7-115.g4f62d9ad.el8.x86_64 31/32 2023-12-07T16:11:29.084 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-115.g4f62d9ad.el8.noarch 6/6 2023-12-07T16:11:29.084 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-115.g4f62d9ad.el8.n 1/6 2023-12-07T16:11:29.084 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-115.g4f62d9ad.el8.noarch 2/6 2023-12-07T16:11:29.085 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-115.g4f62d9ad.el8.no 3/6 2023-12-07T16:11:29.085 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-07T16:11:29.085 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-07T16:11:29.229 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-2:17.2.7-115.g4f62d9ad.el8.x86_64 32/32 2023-12-07T16:11:29.658 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-2:17.2.7-115.g4f62d9ad.el8.x86_64 32/32 2023-12-07T16:11:29.658 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/32 2023-12-07T16:11:29.658 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mds-2:17.2.7-115.g4f62d9ad.el8.x86_64 2/32 2023-12-07T16:11:29.658 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-2:17.2.7-115.g4f62d9ad.el8.x86_64 3/32 2023-12-07T16:11:29.658 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mon-2:17.2.7-115.g4f62d9ad.el8.x86_64 4/32 2023-12-07T16:11:29.658 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-osd-2:17.2.7-115.g4f62d9ad.el8.x86_64 5/32 2023-12-07T16:11:29.658 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-115.g4f62d9ad.el8.n 6/32 2023-12-07T16:11:29.658 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-07T16:11:29.658 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-07T16:11:29.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-07T16:11:29.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-07T16:11:29.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-07T16:11:29.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-07T16:11:29.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-07T16:11:29.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-07T16:11:29.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-07T16:11:29.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-07T16:11:29.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-07T16:11:29.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-07T16:11:29.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-07T16:11:29.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-07T16:11:29.660 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-07T16:11:29.660 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-07T16:11:29.660 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-07T16:11:29.660 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-07T16:11:29.660 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-07T16:11:29.660 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-07T16:11:29.660 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-07T16:11:29.661 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-07T16:11:29.661 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-07T16:11:29.661 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-07T16:11:29.661 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-07T16:11:29.879 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-07T16:11:29.879 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:11:29.879 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-07T16:11:29.879 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards-2:17.2.7-115.g4f62d9ad.el8.noarch 2023-12-07T16:11:29.879 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard-2:17.2.7-115.g4f62d9ad.el8.noarch 2023-12-07T16:11:29.880 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts-2:17.2.7-115.g4f62d9ad.el8.noarch 2023-12-07T16:11:29.880 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-07T16:11:29.880 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-07T16:11:29.880 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-07T16:11:29.880 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:11:29.880 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:11:30.009 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-07T16:11:30.866 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:38 ago on Thu 07 Dec 2023 04:09:52 PM UTC. 2023-12-07T16:11:30.985 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-07T16:11:30.985 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:11:30.985 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-07T16:11:30.985 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:11:30.985 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:11:30.985 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:11:30.985 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core-2:17.2.7-115.g4f62d9ad.el8.noarch 2023-12-07T16:11:30.985 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:11:30.985 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:11:30.986 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-07T16:11:30.986 INFO:teuthology.orchestra.run.smithi063.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-07T16:11:30.986 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-07T16:11:30.986 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-07T16:11:30.986 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-07T16:11:30.986 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-07T16:11:30.986 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-07T16:11:30.986 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-07T16:11:30.986 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-07T16:11:30.986 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-07T16:11:30.987 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-07T16:11:30.987 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-07T16:11:30.987 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-07T16:11:30.987 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend-2.6-1.el8.noarch 2023-12-07T16:11:30.987 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-07T16:11:30.987 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-07T16:11:30.987 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-07T16:11:30.987 INFO:teuthology.orchestra.run.smithi063.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-07T16:11:30.987 INFO:teuthology.orchestra.run.smithi063.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-07T16:11:30.987 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-07T16:11:30.987 INFO:teuthology.orchestra.run.smithi063.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-07T16:11:30.988 INFO:teuthology.orchestra.run.smithi063.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-07T16:11:30.988 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-07T16:11:30.988 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-07T16:11:30.988 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-07T16:11:30.988 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-07T16:11:30.988 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:11:30.988 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:11:31.258 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-base 2023-12-07T16:11:32.143 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:23 ago on Thu 07 Dec 2023 04:10:09 PM UTC. 2023-12-07T16:11:32.536 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:11:32.538 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================================ 2023-12-07T16:11:32.538 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-12-07T16:11:32.538 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================================ 2023-12-07T16:11:32.538 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-07T16:11:32.538 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-115.g4f62d9ad.el8 ceph-noarch 7.4 M 2023-12-07T16:11:32.538 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-12-07T16:11:32.538 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-07T16:11:32.538 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-07T16:11:32.538 INFO:teuthology.orchestra.run.smithi152.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-07T16:11:32.539 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-07T16:11:32.539 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-07T16:11:32.539 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-07T16:11:32.539 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-12-07T16:11:32.539 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:11:32.539 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-07T16:11:32.539 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================================ 2023-12-07T16:11:32.539 INFO:teuthology.orchestra.run.smithi152.stdout:Install 8 Packages 2023-12-07T16:11:32.539 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:11:32.540 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 35 M 2023-12-07T16:11:32.540 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 210 M 2023-12-07T16:11:32.540 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-07T16:11:33.358 INFO:teuthology.orchestra.run.smithi152.stdout:(1/8): ceph-mgr-diskprediction-local-17.2.7-115 13 MB/s | 7.4 MB 00:00 2023-12-07T16:11:33.616 INFO:teuthology.orchestra.run.smithi152.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 5.7 MB/s | 4.9 MB 00:00 2023-12-07T16:11:33.695 INFO:teuthology.orchestra.run.smithi063.stdout:Package ceph-base-2:17.2.7-115.g4f62d9ad.el8.x86_64 is already installed. 2023-12-07T16:11:33.750 INFO:teuthology.orchestra.run.smithi152.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 1.6 MB/s | 225 kB 00:00 2023-12-07T16:11:33.937 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:11:33.938 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2023-12-07T16:11:33.938 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:11:34.186 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install cephadm 2023-12-07T16:11:34.301 INFO:teuthology.orchestra.run.smithi152.stdout:(4/8): openblas-0.3.15-4.el8.x86_64.rpm 3.1 MB/s | 4.7 MB 00:01 2023-12-07T16:11:34.361 INFO:teuthology.orchestra.run.smithi152.stdout:(5/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 3.7 MB/s | 3.7 MB 00:01 2023-12-07T16:11:34.499 INFO:teuthology.orchestra.run.smithi152.stdout:(6/8): libgfortran-8.5.0-21.el8.x86_64.rpm 3.2 MB/s | 645 kB 00:00 2023-12-07T16:11:34.535 INFO:teuthology.orchestra.run.smithi152.stdout:(7/8): libquadmath-8.5.0-21.el8.x86_64.rpm 985 kB/s | 172 kB 00:00 2023-12-07T16:11:35.075 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:26 ago on Thu 07 Dec 2023 04:10:09 PM UTC. 2023-12-07T16:11:36.881 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:11:36.882 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:11:36.882 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2023-12-07T16:11:36.882 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:11:36.882 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-07T16:11:36.882 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm noarch 2:17.2.7-115.g4f62d9ad.el8 ceph-noarch 80 k 2023-12-07T16:11:36.882 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:11:36.882 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-07T16:11:36.882 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:11:36.882 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2023-12-07T16:11:36.882 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:11:36.883 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 80 k 2023-12-07T16:11:36.883 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 364 k 2023-12-07T16:11:36.883 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-07T16:11:37.161 INFO:teuthology.orchestra.run.smithi063.stdout:cephadm-17.2.7-115.g4f62d9ad.el8.noarch.rpm 290 kB/s | 80 kB 00:00 2023-12-07T16:11:37.161 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:11:37.161 INFO:teuthology.orchestra.run.smithi063.stdout:Total 288 kB/s | 80 kB 00:00 2023-12-07T16:11:37.162 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-07T16:11:37.170 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-07T16:11:37.170 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-07T16:11:37.172 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-07T16:11:37.176 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-07T16:11:37.231 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-07T16:11:37.445 INFO:teuthology.orchestra.run.smithi152.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 3.7 MB/s | 14 MB 00:03 2023-12-07T16:11:37.446 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:11:37.446 INFO:teuthology.orchestra.run.smithi152.stdout:Total 7.2 MB/s | 35 MB 00:04 2023-12-07T16:11:37.683 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-07T16:11:37.701 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-07T16:11:37.701 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-07T16:11:38.076 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-07T16:11:38.079 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-07T16:11:38.632 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-07T16:11:38.754 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-07T16:11:38.883 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-07T16:11:39.063 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-07T16:11:39.643 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-07T16:11:39.854 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-07T16:11:39.986 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cephadm-2:17.2.7-115.g4f62d9ad.el8.noarch 1/1 2023-12-07T16:11:40.247 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephadm-2:17.2.7-115.g4f62d9ad.el8.noarch 1/1 2023-12-07T16:11:40.469 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-07T16:11:40.496 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cephadm-2:17.2.7-115.g4f62d9ad.el8.noarch 1/1 2023-12-07T16:11:40.612 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-07T16:11:41.277 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephadm-2:17.2.7-115.g4f62d9ad.el8.noarch 1/1 2023-12-07T16:11:41.277 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:11:41.277 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-07T16:11:41.278 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm-2:17.2.7-115.g4f62d9ad.el8.noarch 2023-12-07T16:11:41.278 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:11:41.278 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:11:41.323 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-07T16:11:41.495 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-immutable-object-cache 2023-12-07T16:11:41.683 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-07T16:11:41.909 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-07T16:11:42.392 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:33 ago on Thu 07 Dec 2023 04:10:09 PM UTC. 2023-12-07T16:11:43.678 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-07T16:11:44.189 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:11:44.190 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:11:44.190 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repo Size 2023-12-07T16:11:44.190 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:11:44.191 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-07T16:11:44.191 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 161 k 2023-12-07T16:11:44.191 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:11:44.191 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-07T16:11:44.191 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:11:44.191 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2023-12-07T16:11:44.191 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:11:44.191 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 161 k 2023-12-07T16:11:44.191 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 490 k 2023-12-07T16:11:44.191 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-07T16:11:44.626 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-immutable-object-cache-17.2.7-115.g4f62d9a 371 kB/s | 161 kB 00:00 2023-12-07T16:11:44.705 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:11:44.706 INFO:teuthology.orchestra.run.smithi063.stdout:Total 370 kB/s | 161 kB 00:00 2023-12-07T16:11:44.706 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-07T16:11:44.706 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-07T16:11:44.707 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-07T16:11:44.707 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-07T16:11:44.707 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-07T16:11:44.950 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-12-07T16:11:44.983 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-07T16:11:45.187 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-115.g4f62d9ad 8/8 2023-12-07T16:11:45.502 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-115.g4f62d9ad 8/8 2023-12-07T16:11:45.502 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-115.g4f62d9ad 1/8 2023-12-07T16:11:45.503 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-07T16:11:45.503 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-07T16:11:45.503 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-07T16:11:45.503 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-07T16:11:45.503 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-12-07T16:11:45.503 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-07T16:11:45.551 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-115.g4f62d9ad.e 1/1 2023-12-07T16:11:45.970 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-115.g4f62d9ad.e 1/1 2023-12-07T16:11:46.221 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-07T16:11:46.221 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:11:46.221 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-07T16:11:46.221 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local-2:17.2.7-115.g4f62d9ad.el8.noarch 2023-12-07T16:11:46.221 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-07T16:11:46.221 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-07T16:11:46.222 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-07T16:11:46.222 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-07T16:11:46.222 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-07T16:11:46.222 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-07T16:11:46.222 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-12-07T16:11:46.222 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:11:46.222 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:11:46.389 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-rook 2023-12-07T16:11:46.796 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-115.g4f62d9ad.e 1/1 2023-12-07T16:11:46.796 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:11:46.796 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-07T16:11:46.796 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:11:46.796 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:11:46.796 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:11:47.085 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-mgr 2023-12-07T16:11:47.244 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:55 ago on Thu 07 Dec 2023 04:09:52 PM UTC. 2023-12-07T16:11:47.980 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:38 ago on Thu 07 Dec 2023 04:10:09 PM UTC. 2023-12-07T16:11:48.957 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:11:48.958 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:11:48.958 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-12-07T16:11:48.958 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:11:48.959 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-07T16:11:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook noarch 2:17.2.7-115.g4f62d9ad.el8 ceph-noarch 47 k 2023-12-07T16:11:48.959 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-12-07T16:11:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-07T16:11:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-07T16:11:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-07T16:11:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-07T16:11:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-07T16:11:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-07T16:11:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-07T16:11:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-07T16:11:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-07T16:11:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-07T16:11:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-07T16:11:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-07T16:11:48.960 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:11:48.960 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-07T16:11:48.960 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:11:48.960 INFO:teuthology.orchestra.run.smithi152.stdout:Install 13 Packages 2023-12-07T16:11:48.960 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:11:48.960 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 1.9 M 2023-12-07T16:11:48.960 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 25 M 2023-12-07T16:11:48.960 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-07T16:11:49.382 INFO:teuthology.orchestra.run.smithi152.stdout:(1/13): python3-jsonpointer-1.10-11.el8.noarch. 128 kB/s | 20 kB 00:00 2023-12-07T16:11:49.432 INFO:teuthology.orchestra.run.smithi152.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 129 kB/s | 27 kB 00:00 2023-12-07T16:11:49.525 INFO:teuthology.orchestra.run.smithi152.stdout:(3/13): ceph-mgr-rook-17.2.7-115.g4f62d9ad.el8. 158 kB/s | 47 kB 00:00 2023-12-07T16:11:49.540 INFO:teuthology.orchestra.run.smithi063.stdout:Package ceph-mgr-2:17.2.7-115.g4f62d9ad.el8.x86_64 is already installed. 2023-12-07T16:11:49.542 INFO:teuthology.orchestra.run.smithi152.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 796 kB/s | 126 kB 00:00 2023-12-07T16:11:49.575 INFO:teuthology.orchestra.run.smithi152.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 772 kB/s | 110 kB 00:00 2023-12-07T16:11:49.626 INFO:teuthology.orchestra.run.smithi152.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 509 kB/s | 43 kB 00:00 2023-12-07T16:11:49.767 INFO:teuthology.orchestra.run.smithi152.stdout:(7/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 639 kB/s | 155 kB 00:00 2023-12-07T16:11:49.781 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:11:49.782 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2023-12-07T16:11:49.782 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:11:49.906 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-mgr-dashboard 2023-12-07T16:11:49.976 INFO:teuthology.orchestra.run.smithi152.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 46 kB/s | 16 kB 00:00 2023-12-07T16:11:50.001 INFO:teuthology.orchestra.run.smithi152.stdout:(9/13): python3-cachetools-3.1.1-4.el8.noarch.r 77 kB/s | 33 kB 00:00 2023-12-07T16:11:50.168 INFO:teuthology.orchestra.run.smithi152.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 203 kB/s | 81 kB 00:00 2023-12-07T16:11:50.210 INFO:teuthology.orchestra.run.smithi152.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 308 kB/s | 64 kB 00:00 2023-12-07T16:11:50.311 INFO:teuthology.orchestra.run.smithi152.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 432 kB/s | 61 kB 00:00 2023-12-07T16:11:50.758 INFO:teuthology.orchestra.run.smithi152.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 1.5 MB/s | 1.2 MB 00:00 2023-12-07T16:11:50.758 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:11:50.758 INFO:teuthology.orchestra.run.smithi152.stdout:Total 1.1 MB/s | 1.9 MB 00:01 2023-12-07T16:11:50.797 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:41 ago on Thu 07 Dec 2023 04:10:09 PM UTC. 2023-12-07T16:11:50.818 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-07T16:11:50.834 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-07T16:11:50.834 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-07T16:11:50.921 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-07T16:11:50.924 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-07T16:11:51.508 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-07T16:11:51.788 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-07T16:11:51.985 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-07T16:11:52.246 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-07T16:11:52.467 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-07T16:11:52.584 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:11:52.585 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:11:52.586 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2023-12-07T16:11:52.586 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:11:52.586 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-07T16:11:52.586 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard noarch 2:17.2.7-115.g4f62d9ad.el8 ceph-noarch 1.7 M 2023-12-07T16:11:52.586 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2023-12-07T16:11:52.586 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards noarch 2:17.2.7-115.g4f62d9ad.el8 ceph-noarch 23 k 2023-12-07T16:11:52.586 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts noarch 2:17.2.7-115.g4f62d9ad.el8 ceph-noarch 14 k 2023-12-07T16:11:52.586 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-07T16:11:52.586 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-07T16:11:52.586 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-07T16:11:52.586 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:11:52.586 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-07T16:11:52.586 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:11:52.586 INFO:teuthology.orchestra.run.smithi063.stdout:Install 6 Packages 2023-12-07T16:11:52.587 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:11:52.587 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 2.0 M 2023-12-07T16:11:52.587 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 8.0 M 2023-12-07T16:11:52.587 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-07T16:11:52.730 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-07T16:11:52.948 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-07T16:11:53.104 INFO:teuthology.orchestra.run.smithi063.stdout:(1/6): ceph-prometheus-alerts-17.2.7-115.g4f62d 93 kB/s | 14 kB 00:00 2023-12-07T16:11:53.171 INFO:teuthology.orchestra.run.smithi063.stdout:(2/6): python3-jwt-1.6.1-2.el8.noarch.rpm 641 kB/s | 43 kB 00:00 2023-12-07T16:11:53.256 INFO:teuthology.orchestra.run.smithi063.stdout:(3/6): ceph-grafana-dashboards-17.2.7-115.g4f62 75 kB/s | 23 kB 00:00 2023-12-07T16:11:53.265 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-07T16:11:53.313 INFO:teuthology.orchestra.run.smithi063.stdout:(4/6): ceph-mgr-dashboard-17.2.7-115.g4f62d9ad. 4.6 MB/s | 1.7 MB 00:00 2023-12-07T16:11:53.515 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-07T16:11:53.622 INFO:teuthology.orchestra.run.smithi063.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 75 kB/s | 34 kB 00:00 2023-12-07T16:11:53.966 INFO:teuthology.orchestra.run.smithi063.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 280 kB/s | 196 kB 00:00 2023-12-07T16:11:53.967 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:11:53.968 INFO:teuthology.orchestra.run.smithi063.stdout:Total 1.4 MB/s | 2.0 MB 00:01 2023-12-07T16:11:53.981 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-07T16:11:53.991 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-07T16:11:53.991 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-07T16:11:54.096 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-07T16:11:54.100 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-07T16:11:54.380 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-07T16:11:54.513 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-07T16:11:54.616 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-07T16:11:54.825 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-07T16:11:54.930 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-07T16:11:55.032 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-07T16:11:55.136 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-07T16:11:55.244 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-07T16:11:55.308 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-115.g4f62d9ad.el8.no 4/6 2023-12-07T16:11:55.401 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-rook-2:17.2.7-115.g4f62d9ad.el8.noarch 13/13 2023-12-07T16:11:55.688 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-115.g4f62d9ad.el8.noarch 13/13 2023-12-07T16:11:55.688 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-rook-2:17.2.7-115.g4f62d9ad.el8.noarch 1/13 2023-12-07T16:11:55.688 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-07T16:11:55.688 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-07T16:11:55.688 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-07T16:11:55.688 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-07T16:11:55.688 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-07T16:11:55.688 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-07T16:11:55.688 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-07T16:11:55.689 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-07T16:11:55.689 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-07T16:11:55.689 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-07T16:11:55.689 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-07T16:11:55.728 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-115.g4f62d9ad.el8.n 5/6 2023-12-07T16:11:56.482 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-07T16:11:56.483 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:11:56.483 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-07T16:11:56.483 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook-2:17.2.7-115.g4f62d9ad.el8.noarch 2023-12-07T16:11:56.483 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-07T16:11:56.483 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-07T16:11:56.483 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-07T16:11:56.483 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-07T16:11:56.483 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-07T16:11:56.483 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-07T16:11:56.484 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-07T16:11:56.484 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-07T16:11:56.484 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-07T16:11:56.484 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-07T16:11:56.484 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-07T16:11:56.484 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-07T16:11:56.484 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:11:56.484 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:11:56.498 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-115.g4f62d9ad.el8.noarch 6/6 2023-12-07T16:11:56.815 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-115.g4f62d9ad.el8.noarch 6/6 2023-12-07T16:11:56.815 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-115.g4f62d9ad.el8.n 1/6 2023-12-07T16:11:56.815 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-115.g4f62d9ad.el8.noarch 2/6 2023-12-07T16:11:56.815 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-115.g4f62d9ad.el8.no 3/6 2023-12-07T16:11:56.815 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-07T16:11:56.816 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-07T16:11:56.973 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-cephadm 2023-12-07T16:11:57.559 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-07T16:11:57.559 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:11:57.559 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-07T16:11:57.559 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards-2:17.2.7-115.g4f62d9ad.el8.noarch 2023-12-07T16:11:57.559 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard-2:17.2.7-115.g4f62d9ad.el8.noarch 2023-12-07T16:11:57.560 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts-2:17.2.7-115.g4f62d9ad.el8.noarch 2023-12-07T16:11:57.560 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-07T16:11:57.560 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-07T16:11:57.560 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-07T16:11:57.560 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:11:57.560 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:11:57.713 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-07T16:11:57.828 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:05 ago on Thu 07 Dec 2023 04:09:52 PM UTC. 2023-12-07T16:11:58.606 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:49 ago on Thu 07 Dec 2023 04:10:09 PM UTC. 2023-12-07T16:11:59.498 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:11:59.499 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:11:59.499 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-12-07T16:11:59.499 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:11:59.499 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-07T16:11:59.500 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm noarch 2:17.2.7-115.g4f62d9ad.el8 ceph-noarch 121 k 2023-12-07T16:11:59.500 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-12-07T16:11:59.500 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-07T16:11:59.500 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-07T16:11:59.500 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-07T16:11:59.500 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-07T16:11:59.500 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:11:59.500 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-07T16:11:59.500 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:11:59.500 INFO:teuthology.orchestra.run.smithi152.stdout:Install 5 Packages 2023-12-07T16:11:59.500 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:11:59.501 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 6.0 M 2023-12-07T16:11:59.501 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 26 M 2023-12-07T16:11:59.501 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-07T16:11:59.892 INFO:teuthology.orchestra.run.smithi152.stdout:(1/5): ceph-mgr-cephadm-17.2.7-115.g4f62d9ad.el 693 kB/s | 121 kB 00:00 2023-12-07T16:11:59.917 INFO:teuthology.orchestra.run.smithi152.stdout:(2/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 2.6 MB/s | 538 kB 00:00 2023-12-07T16:12:00.135 INFO:teuthology.orchestra.run.smithi152.stdout:(3/5): python3-babel-2.5.1-7.el8.noarch.rpm 11 MB/s | 4.8 MB 00:00 2023-12-07T16:12:00.409 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:12:00.410 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================================ 2023-12-07T16:12:00.410 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2023-12-07T16:12:00.410 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================================ 2023-12-07T16:12:00.410 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-07T16:12:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-115.g4f62d9ad.el8 ceph-noarch 7.4 M 2023-12-07T16:12:00.411 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2023-12-07T16:12:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-07T16:12:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-07T16:12:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-07T16:12:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-07T16:12:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-07T16:12:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-07T16:12:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-12-07T16:12:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:12:00.411 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-07T16:12:00.411 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================================ 2023-12-07T16:12:00.411 INFO:teuthology.orchestra.run.smithi063.stdout:Install 8 Packages 2023-12-07T16:12:00.411 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:12:00.412 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 35 M 2023-12-07T16:12:00.412 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 210 M 2023-12-07T16:12:00.412 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-07T16:12:00.442 INFO:teuthology.orchestra.run.smithi152.stdout:(4/5): python3-natsort-7.1.1-2.el8.noarch.rpm 115 kB/s | 60 kB 00:00 2023-12-07T16:12:00.668 INFO:teuthology.orchestra.run.smithi152.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 613 kB/s | 476 kB 00:00 2023-12-07T16:12:00.670 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:12:00.670 INFO:teuthology.orchestra.run.smithi152.stdout:Total 5.1 MB/s | 6.0 MB 00:01 2023-12-07T16:12:00.723 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-07T16:12:00.735 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-07T16:12:00.735 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-07T16:12:00.835 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-07T16:12:00.838 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-07T16:12:01.133 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-07T16:12:01.474 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-12-07T16:12:01.491 INFO:teuthology.orchestra.run.smithi063.stdout:(1/8): ceph-mgr-diskprediction-local-17.2.7-115 7.4 MB/s | 7.4 MB 00:00 2023-12-07T16:12:01.940 INFO:teuthology.orchestra.run.smithi063.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 3.4 MB/s | 4.9 MB 00:01 2023-12-07T16:12:02.190 INFO:teuthology.orchestra.run.smithi063.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 901 kB/s | 225 kB 00:00 2023-12-07T16:12:02.423 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-12-07T16:12:02.649 INFO:teuthology.orchestra.run.smithi063.stdout:(4/8): openblas-0.3.15-4.el8.x86_64.rpm 2.2 MB/s | 4.7 MB 00:02 2023-12-07T16:12:02.724 INFO:teuthology.orchestra.run.smithi063.stdout:(5/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 3.0 MB/s | 3.7 MB 00:01 2023-12-07T16:12:02.813 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-12-07T16:12:02.816 INFO:teuthology.orchestra.run.smithi063.stdout:(6/8): libgfortran-8.5.0-21.el8.x86_64.rpm 3.8 MB/s | 645 kB 00:00 2023-12-07T16:12:02.899 INFO:teuthology.orchestra.run.smithi063.stdout:(7/8): libquadmath-8.5.0-21.el8.x86_64.rpm 985 kB/s | 172 kB 00:00 2023-12-07T16:12:03.050 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-12-07T16:12:03.258 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-115.g4f62d9ad.el8.noarch 5/5 2023-12-07T16:12:03.540 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-115.g4f62d9ad.el8.noarch 5/5 2023-12-07T16:12:03.541 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-115.g4f62d9ad.el8.noarch 1/5 2023-12-07T16:12:03.541 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-12-07T16:12:03.541 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-12-07T16:12:03.541 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-12-07T16:12:04.214 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-12-07T16:12:04.215 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:04.215 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-07T16:12:04.215 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm-2:17.2.7-115.g4f62d9ad.el8.noarch 2023-12-07T16:12:04.215 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-07T16:12:04.215 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-07T16:12:04.215 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-07T16:12:04.215 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-07T16:12:04.215 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:04.215 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:12:04.338 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-fuse 2023-12-07T16:12:05.195 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:13 ago on Thu 07 Dec 2023 04:09:52 PM UTC. 2023-12-07T16:12:05.683 INFO:teuthology.orchestra.run.smithi063.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 3.9 MB/s | 14 MB 00:03 2023-12-07T16:12:05.684 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:12:05.684 INFO:teuthology.orchestra.run.smithi063.stdout:Total 6.7 MB/s | 35 MB 00:05 2023-12-07T16:12:05.927 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-07T16:12:05.946 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-07T16:12:05.946 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-07T16:12:06.376 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-07T16:12:06.380 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-07T16:12:06.880 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:12:06.881 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:12:06.881 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-12-07T16:12:06.881 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:12:06.881 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-07T16:12:06.881 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 874 k 2023-12-07T16:12:06.881 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-12-07T16:12:06.882 INFO:teuthology.orchestra.run.smithi152.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-07T16:12:06.882 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:06.882 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-07T16:12:06.882 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:12:06.882 INFO:teuthology.orchestra.run.smithi152.stdout:Install 2 Packages 2023-12-07T16:12:06.882 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:06.883 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 957 k 2023-12-07T16:12:06.883 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 3.0 M 2023-12-07T16:12:06.883 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-07T16:12:06.992 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-07T16:12:07.151 INFO:teuthology.orchestra.run.smithi152.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-12-07T16:12:07.182 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-07T16:12:07.321 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-07T16:12:07.476 INFO:teuthology.orchestra.run.smithi152.stdout:(2/2): ceph-fuse-17.2.7-115.g4f62d9ad.el8.x86_6 2.1 MB/s | 874 kB 00:00 2023-12-07T16:12:07.477 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:12:07.477 INFO:teuthology.orchestra.run.smithi152.stdout:Total 1.6 MB/s | 957 kB 00:00 2023-12-07T16:12:07.487 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-07T16:12:07.489 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-07T16:12:07.508 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-07T16:12:07.508 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-07T16:12:07.593 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-07T16:12:07.596 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-07T16:12:07.775 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-07T16:12:08.078 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-07T16:12:08.133 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-07T16:12:08.303 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-fuse-2:17.2.7-115.g4f62d9ad.el8.x86_64 2/2 2023-12-07T16:12:08.314 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-07T16:12:08.700 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-fuse-2:17.2.7-115.g4f62d9ad.el8.x86_64 2/2 2023-12-07T16:12:08.701 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-fuse-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/2 2023-12-07T16:12:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-07T16:12:09.123 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-07T16:12:09.444 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-07T16:12:09.444 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:09.444 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-07T16:12:09.444 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse-2:17.2.7-115.g4f62d9ad.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-07T16:12:09.444 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:09.444 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:12:09.712 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install librados-devel 2023-12-07T16:12:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-07T16:12:10.214 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-07T16:12:10.505 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-07T16:12:10.574 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:18 ago on Thu 07 Dec 2023 04:09:52 PM UTC. 2023-12-07T16:12:12.258 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:12:12.259 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:12:12.259 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repo Size 2023-12-07T16:12:12.259 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:12:12.259 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-07T16:12:12.259 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 130 k 2023-12-07T16:12:12.259 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:12.259 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-07T16:12:12.259 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:12:12.259 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2023-12-07T16:12:12.259 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:12.260 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 130 k 2023-12-07T16:12:12.260 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 464 k 2023-12-07T16:12:12.260 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-07T16:12:12.385 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-07T16:12:12.602 INFO:teuthology.orchestra.run.smithi152.stdout:librados-devel-17.2.7-115.g4f62d9ad.el8.x86_64. 380 kB/s | 130 kB 00:00 2023-12-07T16:12:12.602 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:12:12.603 INFO:teuthology.orchestra.run.smithi152.stdout:Total 378 kB/s | 130 kB 00:00 2023-12-07T16:12:12.603 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-07T16:12:12.609 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-07T16:12:12.609 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-07T16:12:12.661 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-07T16:12:12.664 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-07T16:12:13.365 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-07T16:12:13.729 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-12-07T16:12:13.997 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-115.g4f62d9ad 8/8 2023-12-07T16:12:14.327 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-115.g4f62d9ad 8/8 2023-12-07T16:12:14.328 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-115.g4f62d9ad 1/8 2023-12-07T16:12:14.328 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-07T16:12:14.328 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-07T16:12:14.328 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-07T16:12:14.328 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-07T16:12:14.328 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-12-07T16:12:14.328 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-07T16:12:14.904 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librados-devel-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:12:15.092 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-07T16:12:15.092 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:12:15.092 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-07T16:12:15.093 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local-2:17.2.7-115.g4f62d9ad.el8.noarch 2023-12-07T16:12:15.093 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-07T16:12:15.093 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-07T16:12:15.093 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-07T16:12:15.093 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-07T16:12:15.093 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-07T16:12:15.093 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-07T16:12:15.093 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-12-07T16:12:15.093 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:12:15.093 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:12:15.194 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados-devel-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:12:15.247 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-mgr-rook 2023-12-07T16:12:15.897 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados-devel-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:12:15.897 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:15.897 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-07T16:12:15.897 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:12:15.897 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:15.897 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:12:16.137 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install libcephfs2 2023-12-07T16:12:16.142 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:07 ago on Thu 07 Dec 2023 04:10:09 PM UTC. 2023-12-07T16:12:17.011 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:25 ago on Thu 07 Dec 2023 04:09:52 PM UTC. 2023-12-07T16:12:17.929 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:12:17.930 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:12:17.931 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2023-12-07T16:12:17.931 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:12:17.931 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-07T16:12:17.931 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook noarch 2:17.2.7-115.g4f62d9ad.el8 ceph-noarch 47 k 2023-12-07T16:12:17.931 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2023-12-07T16:12:17.931 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-07T16:12:17.931 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-07T16:12:17.931 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-07T16:12:17.931 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-07T16:12:17.931 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-07T16:12:17.931 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-07T16:12:17.931 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-07T16:12:17.932 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-07T16:12:17.932 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-07T16:12:17.932 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-07T16:12:17.932 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-07T16:12:17.932 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-07T16:12:17.932 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:12:17.932 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-07T16:12:17.932 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:12:17.932 INFO:teuthology.orchestra.run.smithi063.stdout:Install 13 Packages 2023-12-07T16:12:17.932 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:12:17.933 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 1.9 M 2023-12-07T16:12:17.933 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 25 M 2023-12-07T16:12:17.933 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-07T16:12:18.470 INFO:teuthology.orchestra.run.smithi152.stdout:Package libcephfs2-2:17.2.7-115.g4f62d9ad.el8.x86_64 is already installed. 2023-12-07T16:12:18.684 INFO:teuthology.orchestra.run.smithi063.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 214 kB/s | 27 kB 00:00 2023-12-07T16:12:18.694 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:12:18.695 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2023-12-07T16:12:18.695 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:12:18.721 INFO:teuthology.orchestra.run.smithi063.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 124 kB/s | 20 kB 00:00 2023-12-07T16:12:18.763 INFO:teuthology.orchestra.run.smithi063.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.6 MB/s | 126 kB 00:00 2023-12-07T16:12:18.796 INFO:teuthology.orchestra.run.smithi063.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 1.4 MB/s | 110 kB 00:00 2023-12-07T16:12:18.803 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install libcephfs-devel 2023-12-07T16:12:18.855 INFO:teuthology.orchestra.run.smithi063.stdout:(5/13): ceph-mgr-rook-17.2.7-115.g4f62d9ad.el8. 160 kB/s | 47 kB 00:00 2023-12-07T16:12:18.880 INFO:teuthology.orchestra.run.smithi063.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 511 kB/s | 43 kB 00:00 2023-12-07T16:12:18.897 INFO:teuthology.orchestra.run.smithi063.stdout:(7/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 1.1 MB/s | 155 kB 00:00 2023-12-07T16:12:18.997 INFO:teuthology.orchestra.run.smithi063.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 139 kB/s | 16 kB 00:00 2023-12-07T16:12:19.031 INFO:teuthology.orchestra.run.smithi063.stdout:(9/13): python3-cachetools-3.1.1-4.el8.noarch.r 187 kB/s | 33 kB 00:00 2023-12-07T16:12:19.057 INFO:teuthology.orchestra.run.smithi063.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 512 kB/s | 81 kB 00:00 2023-12-07T16:12:19.106 INFO:teuthology.orchestra.run.smithi063.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 856 kB/s | 64 kB 00:00 2023-12-07T16:12:19.132 INFO:teuthology.orchestra.run.smithi063.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 819 kB/s | 61 kB 00:00 2023-12-07T16:12:19.244 INFO:teuthology.orchestra.run.smithi063.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 4.7 MB/s | 1.2 MB 00:00 2023-12-07T16:12:19.244 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:12:19.245 INFO:teuthology.orchestra.run.smithi063.stdout:Total 1.5 MB/s | 1.9 MB 00:01 2023-12-07T16:12:19.307 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-07T16:12:19.323 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-07T16:12:19.323 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-07T16:12:19.419 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-07T16:12:19.423 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-07T16:12:19.660 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:27 ago on Thu 07 Dec 2023 04:09:52 PM UTC. 2023-12-07T16:12:20.080 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-07T16:12:20.301 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-07T16:12:20.539 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-07T16:12:20.817 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-07T16:12:21.062 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-07T16:12:21.344 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-07T16:12:21.345 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:12:21.345 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:12:21.346 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repo Size 2023-12-07T16:12:21.346 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:12:21.346 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-07T16:12:21.346 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 25 k 2023-12-07T16:12:21.346 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:21.346 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-07T16:12:21.346 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:12:21.346 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2023-12-07T16:12:21.346 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:21.347 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 25 k 2023-12-07T16:12:21.347 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 109 k 2023-12-07T16:12:21.347 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-07T16:12:21.493 INFO:teuthology.orchestra.run.smithi152.stdout:libcephfs-devel-17.2.7-115.g4f62d9ad.el8.x86_64 169 kB/s | 25 kB 00:00 2023-12-07T16:12:21.494 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:12:21.494 INFO:teuthology.orchestra.run.smithi152.stdout:Total 168 kB/s | 25 kB 00:00 2023-12-07T16:12:21.494 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-07T16:12:21.498 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-07T16:12:21.498 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-07T16:12:21.500 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-07T16:12:21.503 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-07T16:12:21.551 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-07T16:12:21.631 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-07T16:12:21.785 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs-devel-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:12:21.966 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-07T16:12:22.053 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:12:22.238 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-07T16:12:22.688 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs-devel-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:12:22.688 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:22.688 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-07T16:12:22.688 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:12:22.688 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:22.688 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:12:22.820 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install librados2 2023-12-07T16:12:23.362 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-07T16:12:23.684 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:31 ago on Thu 07 Dec 2023 04:09:52 PM UTC. 2023-12-07T16:12:23.694 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-07T16:12:23.961 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-07T16:12:24.207 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-07T16:12:24.454 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-rook-2:17.2.7-115.g4f62d9ad.el8.noarch 13/13 2023-12-07T16:12:24.789 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-115.g4f62d9ad.el8.noarch 13/13 2023-12-07T16:12:24.789 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-rook-2:17.2.7-115.g4f62d9ad.el8.noarch 1/13 2023-12-07T16:12:24.789 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-07T16:12:24.789 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-07T16:12:24.789 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-07T16:12:24.790 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-07T16:12:24.790 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-07T16:12:24.790 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-07T16:12:24.790 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-07T16:12:24.790 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-07T16:12:24.790 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-07T16:12:24.790 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-07T16:12:24.790 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-07T16:12:25.137 INFO:teuthology.orchestra.run.smithi152.stdout:Package librados2-2:17.2.7-115.g4f62d9ad.el8.x86_64 is already installed. 2023-12-07T16:12:25.361 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:12:25.363 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2023-12-07T16:12:25.363 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:12:25.624 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install librbd1 2023-12-07T16:12:25.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-07T16:12:25.629 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:12:25.629 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-07T16:12:25.629 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook-2:17.2.7-115.g4f62d9ad.el8.noarch 2023-12-07T16:12:25.629 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-07T16:12:25.629 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-07T16:12:25.629 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-07T16:12:25.629 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-07T16:12:25.629 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-07T16:12:25.630 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-07T16:12:25.630 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-07T16:12:25.630 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-07T16:12:25.630 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-07T16:12:25.630 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-07T16:12:25.630 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-07T16:12:25.630 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-07T16:12:25.630 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:12:25.630 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:12:25.822 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-mgr-cephadm 2023-12-07T16:12:26.492 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:34 ago on Thu 07 Dec 2023 04:09:52 PM UTC. 2023-12-07T16:12:26.710 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:17 ago on Thu 07 Dec 2023 04:10:09 PM UTC. 2023-12-07T16:12:27.937 INFO:teuthology.orchestra.run.smithi152.stdout:Package librbd1-2:17.2.7-115.g4f62d9ad.el8.x86_64 is already installed. 2023-12-07T16:12:28.162 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:12:28.163 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2023-12-07T16:12:28.163 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:12:28.265 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-rados 2023-12-07T16:12:28.497 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:12:28.498 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:12:28.498 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2023-12-07T16:12:28.498 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:12:28.498 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-07T16:12:28.498 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm noarch 2:17.2.7-115.g4f62d9ad.el8 ceph-noarch 121 k 2023-12-07T16:12:28.498 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2023-12-07T16:12:28.498 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-07T16:12:28.499 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-07T16:12:28.499 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-07T16:12:28.499 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-07T16:12:28.499 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:12:28.499 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-07T16:12:28.499 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:12:28.499 INFO:teuthology.orchestra.run.smithi063.stdout:Install 5 Packages 2023-12-07T16:12:28.499 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:12:28.499 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 6.0 M 2023-12-07T16:12:28.500 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 26 M 2023-12-07T16:12:28.500 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-07T16:12:28.864 INFO:teuthology.orchestra.run.smithi063.stdout:(1/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 3.4 MB/s | 538 kB 00:00 2023-12-07T16:12:28.881 INFO:teuthology.orchestra.run.smithi063.stdout:(2/5): ceph-mgr-cephadm-17.2.7-115.g4f62d9ad.el 709 kB/s | 121 kB 00:00 2023-12-07T16:12:29.081 INFO:teuthology.orchestra.run.smithi063.stdout:(3/5): python3-babel-2.5.1-7.el8.noarch.rpm 13 MB/s | 4.8 MB 00:00 2023-12-07T16:12:29.122 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:37 ago on Thu 07 Dec 2023 04:09:52 PM UTC. 2023-12-07T16:12:29.165 INFO:teuthology.orchestra.run.smithi063.stdout:(4/5): python3-natsort-7.1.1-2.el8.noarch.rpm 212 kB/s | 60 kB 00:00 2023-12-07T16:12:29.340 INFO:teuthology.orchestra.run.smithi063.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.0 MB/s | 476 kB 00:00 2023-12-07T16:12:29.343 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:12:29.343 INFO:teuthology.orchestra.run.smithi063.stdout:Total 7.1 MB/s | 6.0 MB 00:00 2023-12-07T16:12:29.396 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-07T16:12:29.408 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-07T16:12:29.408 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-07T16:12:29.519 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-07T16:12:29.522 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-07T16:12:29.828 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-07T16:12:30.185 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-12-07T16:12:30.568 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-rados-2:17.2.7-115.g4f62d9ad.el8.x86_64 is already installed. 2023-12-07T16:12:30.790 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:12:30.791 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2023-12-07T16:12:30.791 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:12:30.900 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-rgw 2023-12-07T16:12:31.252 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-12-07T16:12:31.675 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-12-07T16:12:31.763 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:39 ago on Thu 07 Dec 2023 04:09:52 PM UTC. 2023-12-07T16:12:31.956 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-12-07T16:12:32.194 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-115.g4f62d9ad.el8.noarch 5/5 2023-12-07T16:12:32.490 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-115.g4f62d9ad.el8.noarch 5/5 2023-12-07T16:12:32.490 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-115.g4f62d9ad.el8.noarch 1/5 2023-12-07T16:12:32.490 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-12-07T16:12:32.491 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-12-07T16:12:32.491 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-12-07T16:12:33.219 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-12-07T16:12:33.219 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:12:33.219 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-07T16:12:33.219 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm-2:17.2.7-115.g4f62d9ad.el8.noarch 2023-12-07T16:12:33.219 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-07T16:12:33.219 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-07T16:12:33.220 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-07T16:12:33.220 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-07T16:12:33.220 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:12:33.220 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:12:33.220 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-rgw-2:17.2.7-115.g4f62d9ad.el8.x86_64 is already installed. 2023-12-07T16:12:33.373 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-fuse 2023-12-07T16:12:33.445 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:12:33.446 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2023-12-07T16:12:33.446 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:12:33.591 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-cephfs 2023-12-07T16:12:34.275 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:25 ago on Thu 07 Dec 2023 04:10:09 PM UTC. 2023-12-07T16:12:34.450 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:42 ago on Thu 07 Dec 2023 04:09:52 PM UTC. 2023-12-07T16:12:35.919 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-cephfs-2:17.2.7-115.g4f62d9ad.el8.x86_64 is already installed. 2023-12-07T16:12:36.084 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:12:36.084 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:12:36.084 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2023-12-07T16:12:36.084 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:12:36.084 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-07T16:12:36.084 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 874 k 2023-12-07T16:12:36.085 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2023-12-07T16:12:36.085 INFO:teuthology.orchestra.run.smithi063.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-07T16:12:36.085 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:12:36.085 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-07T16:12:36.085 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:12:36.085 INFO:teuthology.orchestra.run.smithi063.stdout:Install 2 Packages 2023-12-07T16:12:36.085 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:12:36.086 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 957 k 2023-12-07T16:12:36.086 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 3.0 M 2023-12-07T16:12:36.086 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-07T16:12:36.141 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:12:36.143 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2023-12-07T16:12:36.143 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:12:36.206 INFO:teuthology.orchestra.run.smithi063.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 1.0 MB/s | 83 kB 00:00 2023-12-07T16:12:36.349 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-rbd 2023-12-07T16:12:36.430 INFO:teuthology.orchestra.run.smithi063.stdout:(2/2): ceph-fuse-17.2.7-115.g4f62d9ad.el8.x86_6 2.8 MB/s | 874 kB 00:00 2023-12-07T16:12:36.430 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:12:36.431 INFO:teuthology.orchestra.run.smithi063.stdout:Total 2.7 MB/s | 957 kB 00:00 2023-12-07T16:12:36.441 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-07T16:12:36.463 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-07T16:12:36.463 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-07T16:12:36.556 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-07T16:12:36.560 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-07T16:12:36.737 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-07T16:12:37.022 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-07T16:12:37.208 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:45 ago on Thu 07 Dec 2023 04:09:52 PM UTC. 2023-12-07T16:12:37.269 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-fuse-2:17.2.7-115.g4f62d9ad.el8.x86_64 2/2 2023-12-07T16:12:37.677 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-fuse-2:17.2.7-115.g4f62d9ad.el8.x86_64 2/2 2023-12-07T16:12:37.677 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-fuse-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/2 2023-12-07T16:12:38.390 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-07T16:12:38.390 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:12:38.390 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-07T16:12:38.391 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse-2:17.2.7-115.g4f62d9ad.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-07T16:12:38.391 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:12:38.391 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:12:38.675 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-rbd-2:17.2.7-115.g4f62d9ad.el8.x86_64 is already installed. 2023-12-07T16:12:38.899 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:12:38.901 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2023-12-07T16:12:38.901 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:12:38.998 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install rbd-fuse 2023-12-07T16:12:39.247 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install librados-devel 2023-12-07T16:12:39.862 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:47 ago on Thu 07 Dec 2023 04:09:52 PM UTC. 2023-12-07T16:12:40.144 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:31 ago on Thu 07 Dec 2023 04:10:09 PM UTC. 2023-12-07T16:12:41.541 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:12:41.541 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:12:41.541 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2023-12-07T16:12:41.542 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:12:41.542 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-07T16:12:41.542 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 90 k 2023-12-07T16:12:41.542 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:41.542 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-07T16:12:41.542 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:12:41.542 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2023-12-07T16:12:41.542 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:41.542 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 90 k 2023-12-07T16:12:41.543 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 264 k 2023-12-07T16:12:41.543 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-07T16:12:41.735 INFO:teuthology.orchestra.run.smithi152.stdout:rbd-fuse-17.2.7-115.g4f62d9ad.el8.x86_64.rpm 469 kB/s | 90 kB 00:00 2023-12-07T16:12:41.736 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:12:41.736 INFO:teuthology.orchestra.run.smithi152.stdout:Total 466 kB/s | 90 kB 00:00 2023-12-07T16:12:41.736 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-07T16:12:41.746 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-07T16:12:41.746 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-07T16:12:41.795 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-07T16:12:41.798 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-07T16:12:41.908 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-07T16:12:41.936 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:12:41.937 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:12:41.937 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repo Size 2023-12-07T16:12:41.937 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:12:41.937 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-07T16:12:41.937 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 130 k 2023-12-07T16:12:41.937 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:12:41.937 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-07T16:12:41.937 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:12:41.937 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2023-12-07T16:12:41.937 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:12:41.938 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 130 k 2023-12-07T16:12:41.938 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 464 k 2023-12-07T16:12:41.938 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-07T16:12:42.126 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-fuse-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:12:42.135 INFO:teuthology.orchestra.run.smithi063.stdout:librados-devel-17.2.7-115.g4f62d9ad.el8.x86_64. 659 kB/s | 130 kB 00:00 2023-12-07T16:12:42.135 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:12:42.136 INFO:teuthology.orchestra.run.smithi063.stdout:Total 655 kB/s | 130 kB 00:00 2023-12-07T16:12:42.136 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-07T16:12:42.142 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-07T16:12:42.142 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-07T16:12:42.195 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-07T16:12:42.199 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-07T16:12:42.317 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-07T16:12:42.449 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-fuse-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:12:42.593 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librados-devel-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:12:42.923 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados-devel-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:12:43.111 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-fuse-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:12:43.111 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:43.111 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-07T16:12:43.111 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:12:43.111 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:43.111 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:12:43.355 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install rbd-mirror 2023-12-07T16:12:43.659 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados-devel-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:12:43.659 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:12:43.659 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-07T16:12:43.659 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:12:43.659 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:12:43.659 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:12:43.927 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install libcephfs2 2023-12-07T16:12:44.214 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:52 ago on Thu 07 Dec 2023 04:09:52 PM UTC. 2023-12-07T16:12:44.827 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:35 ago on Thu 07 Dec 2023 04:10:09 PM UTC. 2023-12-07T16:12:45.892 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:12:45.892 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:12:45.892 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repo Size 2023-12-07T16:12:45.892 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:12:45.892 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-07T16:12:45.893 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 3.5 M 2023-12-07T16:12:45.893 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:45.893 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-07T16:12:45.893 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:12:45.893 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2023-12-07T16:12:45.893 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:45.893 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 3.5 M 2023-12-07T16:12:45.894 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 16 M 2023-12-07T16:12:45.894 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-07T16:12:46.373 INFO:teuthology.orchestra.run.smithi063.stdout:Package libcephfs2-2:17.2.7-115.g4f62d9ad.el8.x86_64 is already installed. 2023-12-07T16:12:46.447 INFO:teuthology.orchestra.run.smithi152.stdout:rbd-mirror-17.2.7-115.g4f62d9ad.el8.x86_64.rpm 6.2 MB/s | 3.5 MB 00:00 2023-12-07T16:12:46.448 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:12:46.449 INFO:teuthology.orchestra.run.smithi152.stdout:Total 6.2 MB/s | 3.5 MB 00:00 2023-12-07T16:12:46.449 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-07T16:12:46.460 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-07T16:12:46.460 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-07T16:12:46.521 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-07T16:12:46.524 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-07T16:12:46.611 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:12:46.613 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2023-12-07T16:12:46.613 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:12:46.736 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install libcephfs-devel 2023-12-07T16:12:47.023 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-07T16:12:47.216 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-mirror-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:12:47.625 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:38 ago on Thu 07 Dec 2023 04:10:09 PM UTC. 2023-12-07T16:12:47.628 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-mirror-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:12:48.330 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-mirror-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:12:48.330 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:48.330 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-07T16:12:48.330 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:12:48.330 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:48.330 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:12:48.536 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install rbd-nbd 2023-12-07T16:12:49.403 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:57 ago on Thu 07 Dec 2023 04:09:52 PM UTC. 2023-12-07T16:12:49.416 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:12:49.417 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:12:49.417 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repo Size 2023-12-07T16:12:49.417 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:12:49.417 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-07T16:12:49.417 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 25 k 2023-12-07T16:12:49.417 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:12:49.418 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-07T16:12:49.418 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:12:49.418 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2023-12-07T16:12:49.418 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:12:49.418 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 25 k 2023-12-07T16:12:49.418 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 109 k 2023-12-07T16:12:49.418 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-07T16:12:49.649 INFO:teuthology.orchestra.run.smithi063.stdout:libcephfs-devel-17.2.7-115.g4f62d9ad.el8.x86_64 107 kB/s | 25 kB 00:00 2023-12-07T16:12:49.650 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:12:49.650 INFO:teuthology.orchestra.run.smithi063.stdout:Total 107 kB/s | 25 kB 00:00 2023-12-07T16:12:49.650 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-07T16:12:49.654 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-07T16:12:49.654 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-07T16:12:49.656 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-07T16:12:49.659 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-07T16:12:49.707 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-07T16:12:49.983 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs-devel-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:12:50.259 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:12:51.076 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-07T16:12:51.077 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:12:51.077 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2023-12-07T16:12:51.077 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:12:51.077 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-07T16:12:51.077 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 173 k 2023-12-07T16:12:51.077 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:51.077 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-07T16:12:51.078 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-07T16:12:51.078 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2023-12-07T16:12:51.078 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:51.078 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 173 k 2023-12-07T16:12:51.078 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 552 k 2023-12-07T16:12:51.078 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-07T16:12:51.119 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs-devel-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:12:51.119 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:12:51.119 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-07T16:12:51.119 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:12:51.119 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:12:51.119 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:12:51.252 INFO:teuthology.orchestra.run.smithi152.stdout:rbd-nbd-17.2.7-115.g4f62d9ad.el8.x86_64.rpm 991 kB/s | 173 kB 00:00 2023-12-07T16:12:51.253 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:12:51.253 INFO:teuthology.orchestra.run.smithi152.stdout:Total 985 kB/s | 173 kB 00:00 2023-12-07T16:12:51.253 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-07T16:12:51.263 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-07T16:12:51.264 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-07T16:12:51.270 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install librados2 2023-12-07T16:12:51.314 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-07T16:12:51.318 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-07T16:12:51.435 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-07T16:12:51.644 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-nbd-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:12:51.930 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-nbd-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:12:52.168 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:43 ago on Thu 07 Dec 2023 04:10:09 PM UTC. 2023-12-07T16:12:52.678 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-nbd-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:12:52.678 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:52.678 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-07T16:12:52.678 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:12:52.678 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:12:52.678 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-07T16:12:52.901 DEBUG:teuthology.parallel:result is None 2023-12-07T16:12:53.718 INFO:teuthology.orchestra.run.smithi063.stdout:Package librados2-2:17.2.7-115.g4f62d9ad.el8.x86_64 is already installed. 2023-12-07T16:12:53.961 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:12:53.962 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2023-12-07T16:12:53.963 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:12:54.215 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install librbd1 2023-12-07T16:12:55.112 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:46 ago on Thu 07 Dec 2023 04:10:09 PM UTC. 2023-12-07T16:12:56.667 INFO:teuthology.orchestra.run.smithi063.stdout:Package librbd1-2:17.2.7-115.g4f62d9ad.el8.x86_64 is already installed. 2023-12-07T16:12:56.904 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:12:56.905 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2023-12-07T16:12:56.905 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:12:57.032 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install python3-rados 2023-12-07T16:12:57.928 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:48 ago on Thu 07 Dec 2023 04:10:09 PM UTC. 2023-12-07T16:12:59.479 INFO:teuthology.orchestra.run.smithi063.stdout:Package python3-rados-2:17.2.7-115.g4f62d9ad.el8.x86_64 is already installed. 2023-12-07T16:12:59.721 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:12:59.722 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2023-12-07T16:12:59.722 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:12:59.847 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install python3-rgw 2023-12-07T16:13:00.735 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:51 ago on Thu 07 Dec 2023 04:10:09 PM UTC. 2023-12-07T16:13:02.283 INFO:teuthology.orchestra.run.smithi063.stdout:Package python3-rgw-2:17.2.7-115.g4f62d9ad.el8.x86_64 is already installed. 2023-12-07T16:13:02.522 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:13:02.524 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2023-12-07T16:13:02.524 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:13:02.635 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install python3-cephfs 2023-12-07T16:13:03.529 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:54 ago on Thu 07 Dec 2023 04:10:09 PM UTC. 2023-12-07T16:13:05.103 INFO:teuthology.orchestra.run.smithi063.stdout:Package python3-cephfs-2:17.2.7-115.g4f62d9ad.el8.x86_64 is already installed. 2023-12-07T16:13:05.341 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:13:05.343 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2023-12-07T16:13:05.343 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:13:05.469 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install python3-rbd 2023-12-07T16:13:06.360 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:02:57 ago on Thu 07 Dec 2023 04:10:09 PM UTC. 2023-12-07T16:13:07.909 INFO:teuthology.orchestra.run.smithi063.stdout:Package python3-rbd-2:17.2.7-115.g4f62d9ad.el8.x86_64 is already installed. 2023-12-07T16:13:08.153 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:13:08.154 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2023-12-07T16:13:08.154 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:13:08.304 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install rbd-fuse 2023-12-07T16:13:09.201 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:03:00 ago on Thu 07 Dec 2023 04:10:09 PM UTC. 2023-12-07T16:13:10.991 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:13:10.992 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:13:10.992 INFO:teuthology.orchestra.run.smithi063.stdout: Package Architecture Version Repository Size 2023-12-07T16:13:10.992 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:13:10.992 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-07T16:13:10.992 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 90 k 2023-12-07T16:13:10.993 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:13:10.993 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-07T16:13:10.993 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:13:10.993 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2023-12-07T16:13:10.993 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:13:10.993 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 90 k 2023-12-07T16:13:10.993 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 264 k 2023-12-07T16:13:10.993 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-07T16:13:11.297 INFO:teuthology.orchestra.run.smithi063.stdout:rbd-fuse-17.2.7-115.g4f62d9ad.el8.x86_64.rpm 296 kB/s | 90 kB 00:00 2023-12-07T16:13:11.298 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:13:11.298 INFO:teuthology.orchestra.run.smithi063.stdout:Total 295 kB/s | 90 kB 00:00 2023-12-07T16:13:11.298 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-07T16:13:11.309 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-07T16:13:11.309 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-07T16:13:11.364 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-07T16:13:11.367 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-07T16:13:11.495 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-07T16:13:11.689 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-fuse-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:13:12.046 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: rbd-fuse-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:13:12.867 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-fuse-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:13:12.867 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:13:12.868 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-07T16:13:12.868 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:13:12.868 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:13:12.868 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:13:13.096 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install rbd-mirror 2023-12-07T16:13:13.995 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:03:04 ago on Thu 07 Dec 2023 04:10:09 PM UTC. 2023-12-07T16:13:15.791 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:13:15.791 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:13:15.791 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repo Size 2023-12-07T16:13:15.791 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:13:15.791 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-07T16:13:15.792 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 3.5 M 2023-12-07T16:13:15.792 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:13:15.792 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-07T16:13:15.792 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:13:15.792 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2023-12-07T16:13:15.792 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:13:15.792 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 3.5 M 2023-12-07T16:13:15.793 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 16 M 2023-12-07T16:13:15.793 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-07T16:13:16.192 INFO:teuthology.orchestra.run.smithi063.stdout:rbd-mirror-17.2.7-115.g4f62d9ad.el8.x86_64.rpm 8.6 MB/s | 3.5 MB 00:00 2023-12-07T16:13:16.193 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:13:16.193 INFO:teuthology.orchestra.run.smithi063.stdout:Total 8.6 MB/s | 3.5 MB 00:00 2023-12-07T16:13:16.193 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-07T16:13:16.206 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-07T16:13:16.206 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-07T16:13:16.272 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-07T16:13:16.275 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-07T16:13:16.751 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-07T16:13:16.914 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-mirror-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:13:17.377 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: rbd-mirror-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:13:18.120 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-mirror-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:13:18.121 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:13:18.121 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-07T16:13:18.121 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:13:18.121 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:13:18.121 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:13:18.358 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install rbd-nbd 2023-12-07T16:13:19.257 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:03:10 ago on Thu 07 Dec 2023 04:10:09 PM UTC. 2023-12-07T16:13:21.068 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-07T16:13:21.069 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:13:21.069 INFO:teuthology.orchestra.run.smithi063.stdout: Package Architecture Version Repository Size 2023-12-07T16:13:21.070 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:13:21.070 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-07T16:13:21.070 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd x86_64 2:17.2.7-115.g4f62d9ad.el8 ceph 173 k 2023-12-07T16:13:21.070 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:13:21.070 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-07T16:13:21.070 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-07T16:13:21.070 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2023-12-07T16:13:21.070 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:13:21.070 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 173 k 2023-12-07T16:13:21.070 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 552 k 2023-12-07T16:13:21.071 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-07T16:13:21.262 INFO:teuthology.orchestra.run.smithi063.stdout:rbd-nbd-17.2.7-115.g4f62d9ad.el8.x86_64.rpm 903 kB/s | 173 kB 00:00 2023-12-07T16:13:21.263 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:13:21.263 INFO:teuthology.orchestra.run.smithi063.stdout:Total 897 kB/s | 173 kB 00:00 2023-12-07T16:13:21.263 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-07T16:13:21.274 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-07T16:13:21.274 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-07T16:13:21.329 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-07T16:13:21.332 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-07T16:13:21.503 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-07T16:13:21.745 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-nbd-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:13:22.033 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: rbd-nbd-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:13:22.987 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-nbd-2:17.2.7-115.g4f62d9ad.el8.x86_64 1/1 2023-12-07T16:13:22.987 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:13:22.988 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-07T16:13:22.988 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd-2:17.2.7-115.g4f62d9ad.el8.x86_64 2023-12-07T16:13:22.988 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:13:22.988 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-07T16:13:23.285 DEBUG:teuthology.parallel:result is None 2023-12-07T16:13:23.286 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-07T16:13:23.286 INFO:teuthology.packaging:ref: None 2023-12-07T16:13:23.286 INFO:teuthology.packaging:tag: None 2023-12-07T16:13:23.286 INFO:teuthology.packaging:branch: quincy 2023-12-07T16:13:23.286 INFO:teuthology.packaging:sha1: e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-07T16:13:23.286 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-07T16:13:23.519 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-07T16:13:23.542 INFO:teuthology.orchestra.run.smithi063.stdout:17.2.7-115.g4f62d9ad.el8 2023-12-07T16:13:23.543 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-115.g4f62d9ad.el8 2023-12-07T16:13:23.543 INFO:teuthology.task.install:The correct ceph version 17.2.7-115.g4f62d9ad is installed. 2023-12-07T16:13:23.543 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-07T16:13:23.543 INFO:teuthology.packaging:ref: None 2023-12-07T16:13:23.543 INFO:teuthology.packaging:tag: None 2023-12-07T16:13:23.543 INFO:teuthology.packaging:branch: quincy 2023-12-07T16:13:23.543 INFO:teuthology.packaging:sha1: e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-07T16:13:23.543 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-07T16:13:23.757 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-07T16:13:23.784 INFO:teuthology.orchestra.run.smithi152.stdout:17.2.7-115.g4f62d9ad.el8 2023-12-07T16:13:23.784 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-115.g4f62d9ad.el8 2023-12-07T16:13:23.784 INFO:teuthology.task.install:The correct ceph version 17.2.7-115.g4f62d9ad is installed. 2023-12-07T16:13:23.785 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-07T16:13:23.785 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-07T16:13:23.785 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-07T16:13:23.814 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-07T16:13:23.814 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-07T16:13:23.857 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-07T16:13:23.857 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-07T16:13:23.857 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/daemon-helper 2023-12-07T16:13:23.885 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-07T16:13:23.953 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-07T16:13:23.953 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/daemon-helper 2023-12-07T16:13:23.983 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-07T16:13:24.054 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-07T16:13:24.054 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-07T16:13:24.054 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-07T16:13:24.082 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-07T16:13:24.149 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-07T16:13:24.149 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-07T16:13:24.179 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-07T16:13:24.248 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-07T16:13:24.248 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-07T16:13:24.248 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/stdin-killer 2023-12-07T16:13:24.275 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-07T16:13:24.342 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-07T16:13:24.342 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/stdin-killer 2023-12-07T16:13:24.371 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-07T16:13:24.439 INFO:teuthology.run_tasks:Running task print... 2023-12-07T16:13:24.448 INFO:teuthology.task.print:**** done install task... 2023-12-07T16:13:24.448 INFO:teuthology.run_tasks:Running task cephadm... 2023-12-07T16:13:24.532 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'e6605fb8725c25c4838cef6a39f30df73f1ed149'} 2023-12-07T16:13:24.532 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2023-12-07T16:13:24.532 INFO:tasks.cephadm:Cluster fsid is 8c493298-951b-11ee-95a2-87774f69a715 2023-12-07T16:13:24.532 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-12-07T16:13:24.533 INFO:tasks.cephadm:No mon roles; fabricating mons 2023-12-07T16:13:24.533 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi063': '172.21.15.63', 'mon.smithi152': '172.21.15.152'} 2023-12-07T16:13:24.533 INFO:tasks.cephadm:Normalizing hostnames... 2023-12-07T16:13:24.533 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname $(hostname -s) 2023-12-07T16:13:24.561 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname $(hostname -s) 2023-12-07T16:13:24.590 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2023-12-07T16:13:24.590 DEBUG:teuthology.orchestra.run.smithi063:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-07T16:13:24.835 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Dec 7 16:13 /home/ubuntu/cephtest/cephadm 2023-12-07T16:13:24.836 DEBUG:teuthology.orchestra.run.smithi152:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-07T16:13:25.055 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Dec 7 16:13 /home/ubuntu/cephtest/cephadm 2023-12-07T16:13:25.056 DEBUG:teuthology.orchestra.run.smithi063:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-07T16:13:25.075 DEBUG:teuthology.orchestra.run.smithi152:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-07T16:13:25.106 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2023-12-07T16:13:25.106 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-07T16:13:25.118 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-07T16:13:26.013 INFO:teuthology.orchestra.run.smithi152.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-07T16:13:26.306 INFO:teuthology.orchestra.run.smithi063.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-07T16:13:55.235 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-07T16:13:55.235 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)", 2023-12-07T16:13:55.235 INFO:teuthology.orchestra.run.smithi152.stdout: "image_id": "fcdfd00f81c7d70eb779fb4803d421b86736bd04dc08a51d0007e848c2218459", 2023-12-07T16:13:55.235 INFO:teuthology.orchestra.run.smithi152.stdout: "repo_digests": [ 2023-12-07T16:13:55.235 INFO:teuthology.orchestra.run.smithi152.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:ba4b97163401e5fa0f1311fe7e4f9933258805ef7c14358f95ebfd54c7a34f57" 2023-12-07T16:13:55.235 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2023-12-07T16:13:55.235 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-07T16:13:55.445 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:13:55.445 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)", 2023-12-07T16:13:55.445 INFO:teuthology.orchestra.run.smithi063.stdout: "image_id": "fcdfd00f81c7d70eb779fb4803d421b86736bd04dc08a51d0007e848c2218459", 2023-12-07T16:13:55.445 INFO:teuthology.orchestra.run.smithi063.stdout: "repo_digests": [ 2023-12-07T16:13:55.445 INFO:teuthology.orchestra.run.smithi063.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:ba4b97163401e5fa0f1311fe7e4f9933258805ef7c14358f95ebfd54c7a34f57" 2023-12-07T16:13:55.445 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2023-12-07T16:13:55.445 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:13:55.464 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph 2023-12-07T16:13:55.494 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph 2023-12-07T16:13:55.525 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 777 /etc/ceph 2023-12-07T16:13:55.562 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 777 /etc/ceph 2023-12-07T16:13:55.592 INFO:tasks.cephadm:Writing seed config... 2023-12-07T16:13:55.593 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2023-12-07T16:13:55.593 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2023-12-07T16:13:55.594 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-12-07T16:13:55.594 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-12-07T16:13:55.594 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-12-07T16:13:55.594 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-12-07T16:13:55.594 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-12-07T16:13:55.594 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-12-07T16:13:55.594 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-12-07T16:13:55.594 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-12-07T16:13:55.594 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-12-07T16:13:55.594 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-12-07T16:13:55.594 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-12-07T16:13:55.595 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-12-07T16:13:55.595 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-12-07T16:13:55.595 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-12-07T16:13:55.595 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-12-07T16:13:55.595 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-12-07T16:13:55.595 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-12-07T16:13:55.595 INFO:tasks.cephadm: override: [client] debug client = 20 2023-12-07T16:13:55.595 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-12-07T16:13:55.595 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-12-07T16:13:55.595 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-12-07T16:13:55.595 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2023-12-07T16:13:55.595 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-12-07T16:13:55.595 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-12-07T16:13:55.595 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-12-07T16:13:55.596 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-12-07T16:13:55.596 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-12-07T16:13:55.596 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-12-07T16:13:55.596 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-12-07T16:13:55.596 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-12-07T16:13:55.596 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-12-07T16:13:55.596 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-12-07T16:13:55.596 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-12-07T16:13:55.596 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-12-07T16:13:55.596 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-12-07T16:13:55.596 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-12-07T16:13:55.596 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-12-07T16:13:55.596 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-12-07T16:13:55.597 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-07T16:13:55.597 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-12-07T16:13:55.619 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 8c493298-951b-11ee-95a2-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-12-07T16:13:55.620 DEBUG:teuthology.orchestra.run.smithi063:mon.smithi063> sudo journalctl -f -n 0 -u ceph-8c493298-951b-11ee-95a2-87774f69a715@mon.smithi063.service 2023-12-07T16:13:55.662 INFO:tasks.cephadm:Bootstrapping... 2023-12-07T16:13:55.662 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 8c493298-951b-11ee-95a2-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.63 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-12-07T16:13:55.689 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:-- Logs begin at Thu 2023-12-07 15:43:10 UTC. -- 2023-12-07T16:13:55.871 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-07T16:13:55.871 INFO:teuthology.orchestra.run.smithi063.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '8c493298-951b-11ee-95a2-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.63', '--skip-admin-label'] 2023-12-07T16:13:55.900 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stdout 4.6.1 2023-12-07T16:13:55.900 INFO:teuthology.orchestra.run.smithi063.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-12-07T16:13:55.901 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying podman|docker is present... 2023-12-07T16:13:55.931 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stdout 4.6.1 2023-12-07T16:13:55.931 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying lvm2 is present... 2023-12-07T16:13:55.931 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying time synchronization is in place... 2023-12-07T16:13:55.939 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-07T16:13:55.939 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-07T16:13:55.945 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-07T16:13:55.945 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout inactive 2023-12-07T16:13:55.951 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout enabled 2023-12-07T16:13:55.957 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout active 2023-12-07T16:13:55.957 INFO:teuthology.orchestra.run.smithi063.stdout:Unit chronyd.service is enabled and running 2023-12-07T16:13:55.957 INFO:teuthology.orchestra.run.smithi063.stdout:Repeating the final host check... 2023-12-07T16:13:55.985 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stdout 4.6.1 2023-12-07T16:13:55.985 INFO:teuthology.orchestra.run.smithi063.stdout:podman (/bin/podman) version 4.6.1 is present 2023-12-07T16:13:55.985 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl is present 2023-12-07T16:13:55.985 INFO:teuthology.orchestra.run.smithi063.stdout:lvcreate is present 2023-12-07T16:13:55.992 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-07T16:13:55.992 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-07T16:13:55.998 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-07T16:13:55.998 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout inactive 2023-12-07T16:13:56.004 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout enabled 2023-12-07T16:13:56.010 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout active 2023-12-07T16:13:56.010 INFO:teuthology.orchestra.run.smithi063.stdout:Unit chronyd.service is enabled and running 2023-12-07T16:13:56.010 INFO:teuthology.orchestra.run.smithi063.stdout:Host looks OK 2023-12-07T16:13:56.010 INFO:teuthology.orchestra.run.smithi063.stdout:Cluster fsid: 8c493298-951b-11ee-95a2-87774f69a715 2023-12-07T16:13:56.010 INFO:teuthology.orchestra.run.smithi063.stdout:Acquiring lock 139649112472040 on /run/cephadm/8c493298-951b-11ee-95a2-87774f69a715.lock 2023-12-07T16:13:56.010 INFO:teuthology.orchestra.run.smithi063.stdout:Lock 139649112472040 acquired on /run/cephadm/8c493298-951b-11ee-95a2-87774f69a715.lock 2023-12-07T16:13:56.011 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying IP 172.21.15.63 port 3300 ... 2023-12-07T16:13:56.011 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying IP 172.21.15.63 port 6789 ... 2023-12-07T16:13:56.011 INFO:teuthology.orchestra.run.smithi063.stdout:Base mon IP(s) is [172.21.15.63:3300, 172.21.15.63:6789], mon addrv is [v2:172.21.15.63:3300,v1:172.21.15.63:6789] 2023-12-07T16:13:56.014 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.63 metric 100 2023-12-07T16:13:56.015 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.63 metric 100 2023-12-07T16:13:56.017 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-12-07T16:13:56.018 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2023-12-07T16:13:56.018 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1793sec hoplimit 64 pref medium 2023-12-07T16:13:56.020 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-12-07T16:13:56.020 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-12-07T16:13:56.020 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-07T16:13:56.021 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2023-12-07T16:13:56.021 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2023-12-07T16:13:56.021 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-07T16:13:56.021 INFO:teuthology.orchestra.run.smithi063.stdout:Mon IP `172.21.15.63` is in CIDR network `172.21.0.0/20` 2023-12-07T16:13:56.022 INFO:teuthology.orchestra.run.smithi063.stdout:Mon IP `172.21.15.63` is in CIDR network `172.21.0.0/20` 2023-12-07T16:13:56.022 INFO:teuthology.orchestra.run.smithi063.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-12-07T16:13:56.022 INFO:teuthology.orchestra.run.smithi063.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-12-07T16:13:56.023 INFO:teuthology.orchestra.run.smithi063.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-07T16:13:56.467 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stdout fcdfd00f81c7d70eb779fb4803d421b86736bd04dc08a51d0007e848c2218459 2023-12-07T16:13:56.467 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-07T16:13:56.467 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stderr Getting image source signatures 2023-12-07T16:13:56.467 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stderr Copying blob sha256:8d9d4d76c86df30606f19002527da1456e3be331f3440334794573d34e918ee2 2023-12-07T16:13:56.467 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stderr Copying blob sha256:d3e436ac93e4b5a6d94c7ac8024df331e66e67275836276615dc044fd3cbf83a 2023-12-07T16:13:56.467 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stderr Copying config sha256:fcdfd00f81c7d70eb779fb4803d421b86736bd04dc08a51d0007e848c2218459 2023-12-07T16:13:56.468 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stderr Writing manifest to image destination 2023-12-07T16:13:57.496 INFO:teuthology.orchestra.run.smithi063.stdout:ceph: stdout ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable) 2023-12-07T16:13:57.496 INFO:teuthology.orchestra.run.smithi063.stdout:Ceph version: ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable) 2023-12-07T16:13:57.496 INFO:teuthology.orchestra.run.smithi063.stdout:Extracting ceph user uid/gid from container image... 2023-12-07T16:13:59.048 INFO:teuthology.orchestra.run.smithi063.stdout:stat: stdout 167 167 2023-12-07T16:13:59.048 INFO:teuthology.orchestra.run.smithi063.stdout:Creating initial keys... 2023-12-07T16:13:59.772 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph-authtool: stdout AQBH73FlFZb3FhAAbSiEwy7EE+SIUVCk9N0gaQ== 2023-12-07T16:14:00.402 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph-authtool: stdout AQBI73FlvJf/AhAAxBMnz5ZyWGwjz7L/m4kJmw== 2023-12-07T16:14:01.109 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph-authtool: stdout AQBI73Flth6IKxAAWWBQ+JZ+b4vTE7H8lZVy0g== 2023-12-07T16:14:01.110 INFO:teuthology.orchestra.run.smithi063.stdout:Creating initial monmap... 2023-12-07T16:14:01.758 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-07T16:14:01.758 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2023-12-07T16:14:01.758 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 8c493298-951b-11ee-95a2-87774f69a715 2023-12-07T16:14:01.758 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-07T16:14:01.758 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool for smithi063 [v2:172.21.15.63:3300,v1:172.21.15.63:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-07T16:14:01.758 INFO:teuthology.orchestra.run.smithi063.stdout:setting min_mon_release = octopus 2023-12-07T16:14:01.758 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/monmaptool: set fsid to 8c493298-951b-11ee-95a2-87774f69a715 2023-12-07T16:14:01.758 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-07T16:14:01.759 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:14:01.759 INFO:teuthology.orchestra.run.smithi063.stdout:Creating mon... 2023-12-07T16:14:02.435 INFO:teuthology.orchestra.run.smithi063.stdout:create mon.smithi063 on 2023-12-07T16:14:02.538 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-12-07T16:14:02.630 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-12-07T16:14:02.727 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-8c493298-951b-11ee-95a2-87774f69a715.target → /etc/systemd/system/ceph-8c493298-951b-11ee-95a2-87774f69a715.target. 2023-12-07T16:14:02.727 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-8c493298-951b-11ee-95a2-87774f69a715.target → /etc/systemd/system/ceph-8c493298-951b-11ee-95a2-87774f69a715.target. 2023-12-07T16:14:02.859 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-8c493298-951b-11ee-95a2-87774f69a715@mon.smithi063 2023-12-07T16:14:02.859 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Failed to reset failed state of unit ceph-8c493298-951b-11ee-95a2-87774f69a715@mon.smithi063.service: Unit ceph-8c493298-951b-11ee-95a2-87774f69a715@mon.smithi063.service not loaded. 2023-12-07T16:14:02.957 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-8c493298-951b-11ee-95a2-87774f69a715.target.wants/ceph-8c493298-951b-11ee-95a2-87774f69a715@mon.smithi063.service → /etc/systemd/system/ceph-8c493298-951b-11ee-95a2-87774f69a715@.service. 2023-12-07T16:14:03.382 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-07T16:14:03.382 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout disabled 2023-12-07T16:14:03.391 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-07T16:14:03.391 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout inactive 2023-12-07T16:14:03.391 INFO:teuthology.orchestra.run.smithi063.stdout:firewalld.service is not enabled 2023-12-07T16:14:03.392 INFO:teuthology.orchestra.run.smithi063.stdout:Not possible to enable service . firewalld.service is not available 2023-12-07T16:14:03.392 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for mon to start... 2023-12-07T16:14:03.392 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for mon... 2023-12-07T16:14:03.645 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:03 smithi063 ceph-mon[111609]: mon.smithi063 is new leader, mons smithi063 in quorum (ranks 0) 2023-12-07T16:14:04.270 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout cluster: 2023-12-07T16:14:04.277 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout id: 8c493298-951b-11ee-95a2-87774f69a715 2023-12-07T16:14:04.277 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-12-07T16:14:04.277 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-07T16:14:04.277 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout services: 2023-12-07T16:14:04.277 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi063 (age 0.519493s) 2023-12-07T16:14:04.277 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-12-07T16:14:04.277 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-12-07T16:14:04.277 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-07T16:14:04.277 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout data: 2023-12-07T16:14:04.277 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-12-07T16:14:04.277 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-12-07T16:14:04.277 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-12-07T16:14:04.278 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout pgs: 2023-12-07T16:14:04.278 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-07T16:14:04.278 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.839+0000 7f5287b28700 1 Processor -- start 2023-12-07T16:14:04.278 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.839+0000 7f5287b28700 1 -- start start 2023-12-07T16:14:04.278 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.839+0000 7f5287b28700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52801038f0 0x7f5280103d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:04.278 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.839+0000 7f5287b28700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5280104240 con 0x7f52801038f0 2023-12-07T16:14:04.278 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.840+0000 7f52858c4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52801038f0 0x7f5280103d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:04.278 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.840+0000 7f52858c4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52801038f0 0x7f5280103d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57094/0 (socket says 172.21.15.63:57094) 2023-12-07T16:14:04.278 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.840+0000 7f52858c4700 1 -- 172.21.15.63:0/34214803 learned_addr learned my addr 172.21.15.63:0/34214803 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:04.278 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.840+0000 7f52858c4700 1 -- 172.21.15.63:0/34214803 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5280104380 con 0x7f52801038f0 2023-12-07T16:14:04.278 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.840+0000 7f52858c4700 1 --2- 172.21.15.63:0/34214803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52801038f0 0x7f5280103d00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f527c0098e0 tx=0x7f527c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe56d5eff49ce2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:04.278 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.840+0000 7f52848c2700 1 -- 172.21.15.63:0/34214803 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f527c00b860 con 0x7f52801038f0 2023-12-07T16:14:04.278 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.840+0000 7f52848c2700 1 -- 172.21.15.63:0/34214803 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527c00b9c0 con 0x7f52801038f0 2023-12-07T16:14:04.278 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.840+0000 7f52848c2700 1 -- 172.21.15.63:0/34214803 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f527c00bc90 con 0x7f52801038f0 2023-12-07T16:14:04.278 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.841+0000 7f5287b28700 1 -- 172.21.15.63:0/34214803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52801038f0 msgr2=0x7f5280103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:04.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.841+0000 7f5287b28700 1 --2- 172.21.15.63:0/34214803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52801038f0 0x7f5280103d00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f527c0098e0 tx=0x7f527c009250 comp rx=0 tx=0).stop 2023-12-07T16:14:04.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.841+0000 7f5287b28700 1 -- 172.21.15.63:0/34214803 shutdown_connections 2023-12-07T16:14:04.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.841+0000 7f5287b28700 1 --2- 172.21.15.63:0/34214803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52801038f0 0x7f5280103d00 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:04.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.841+0000 7f5287b28700 1 -- 172.21.15.63:0/34214803 >> 172.21.15.63:0/34214803 conn(0x7f52800fc0b0 msgr2=0x7f52800fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:04.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.841+0000 7f5287b28700 1 -- 172.21.15.63:0/34214803 shutdown_connections 2023-12-07T16:14:04.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.841+0000 7f5287b28700 1 -- 172.21.15.63:0/34214803 wait complete. 2023-12-07T16:14:04.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.841+0000 7f5287b28700 1 Processor -- start 2023-12-07T16:14:04.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.842+0000 7f5287b28700 1 -- start start 2023-12-07T16:14:04.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.842+0000 7f5287b28700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52801038f0 0x7f5280110960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:04.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.842+0000 7f5287b28700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5280110ea0 con 0x7f52801038f0 2023-12-07T16:14:04.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.842+0000 7f52858c4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52801038f0 0x7f5280110960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:04.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.842+0000 7f52858c4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52801038f0 0x7f5280110960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57110/0 (socket says 172.21.15.63:57110) 2023-12-07T16:14:04.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.842+0000 7f52858c4700 1 -- 172.21.15.63:0/1430610830 learned_addr learned my addr 172.21.15.63:0/1430610830 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:04.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.842+0000 7f52858c4700 1 -- 172.21.15.63:0/1430610830 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527c0094f0 con 0x7f52801038f0 2023-12-07T16:14:04.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.842+0000 7f52858c4700 1 --2- 172.21.15.63:0/1430610830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52801038f0 0x7f5280110960 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f527c003080 tx=0x7f527c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:04.279 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.842+0000 7f52767fc700 1 -- 172.21.15.63:0/1430610830 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f527c01c5c0 con 0x7f52801038f0 2023-12-07T16:14:04.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.842+0000 7f52767fc700 1 -- 172.21.15.63:0/1430610830 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527c01c720 con 0x7f52801038f0 2023-12-07T16:14:04.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.842+0000 7f5287b28700 1 -- 172.21.15.63:0/1430610830 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52801110a0 con 0x7f52801038f0 2023-12-07T16:14:04.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.842+0000 7f52767fc700 1 -- 172.21.15.63:0/1430610830 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f527c01ca30 con 0x7f52801038f0 2023-12-07T16:14:04.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.843+0000 7f5287b28700 1 -- 172.21.15.63:0/1430610830 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52801114b0 con 0x7f52801038f0 2023-12-07T16:14:04.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.843+0000 7f52767fc700 1 -- 172.21.15.63:0/1430610830 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f527c01a450 con 0x7f52801038f0 2023-12-07T16:14:04.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.843+0000 7f52767fc700 1 -- 172.21.15.63:0/1430610830 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f527c02e790 con 0x7f52801038f0 2023-12-07T16:14:04.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.843+0000 7f5287b28700 1 -- 172.21.15.63:0/1430610830 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f528004bb80 con 0x7f52801038f0 2023-12-07T16:14:04.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.846+0000 7f52767fc700 1 -- 172.21.15.63:0/1430610830 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f527c01a890 con 0x7f52801038f0 2023-12-07T16:14:04.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.917+0000 7f5287b28700 1 -- 172.21.15.63:0/1430610830 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f5280109c10 con 0x7f52801038f0 2023-12-07T16:14:04.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.918+0000 7f52767fc700 1 -- 172.21.15.63:0/1430610830 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f527c01aa30 con 0x7f52801038f0 2023-12-07T16:14:04.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.918+0000 7f5287b28700 1 -- 172.21.15.63:0/1430610830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52801038f0 msgr2=0x7f5280110960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:04.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.918+0000 7f5287b28700 1 --2- 172.21.15.63:0/1430610830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52801038f0 0x7f5280110960 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f527c003080 tx=0x7f527c016000 comp rx=0 tx=0).stop 2023-12-07T16:14:04.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.918+0000 7f5287b28700 1 -- 172.21.15.63:0/1430610830 shutdown_connections 2023-12-07T16:14:04.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.918+0000 7f5287b28700 1 --2- 172.21.15.63:0/1430610830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52801038f0 0x7f5280110960 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:04.280 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.918+0000 7f5287b28700 1 -- 172.21.15.63:0/1430610830 >> 172.21.15.63:0/1430610830 conn(0x7f52800fc0b0 msgr2=0x7f5280105150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:04.281 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.918+0000 7f5287b28700 1 -- 172.21.15.63:0/1430610830 shutdown_connections 2023-12-07T16:14:04.281 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:03.918+0000 7f5287b28700 1 -- 172.21.15.63:0/1430610830 wait complete. 2023-12-07T16:14:04.281 INFO:teuthology.orchestra.run.smithi063.stdout:mon is available 2023-12-07T16:14:04.281 INFO:teuthology.orchestra.run.smithi063.stdout:Assimilating anything we can from ceph.conf... 2023-12-07T16:14:04.483 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:04 smithi063 ceph-mon[111609]: mon.smithi063 is new leader, mons smithi063 in quorum (ranks 0) 2023-12-07T16:14:04.483 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:04 smithi063 ceph-mon[111609]: monmap e1: 1 mons at {smithi063=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-07T16:14:04.483 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:04 smithi063 ceph-mon[111609]: fsmap 2023-12-07T16:14:04.483 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:04 smithi063 ceph-mon[111609]: osdmap e1: 0 total, 0 up, 0 in 2023-12-07T16:14:04.483 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:04 smithi063 ceph-mon[111609]: mgrmap e1: no daemons active 2023-12-07T16:14:04.483 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:04 smithi063 ceph-mon[111609]: from='client.? 172.21.15.63:0/1430610830' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-12-07T16:14:05.152 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-07T16:14:05.152 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout [global] 2023-12-07T16:14:05.152 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout fsid = 8c493298-951b-11ee-95a2-87774f69a715 2023-12-07T16:14:05.152 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.63:3300,v1:172.21.15.63:6789] 2023-12-07T16:14:05.152 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-07T16:14:05.152 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-07T16:14:05.152 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-07T16:14:05.152 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-07T16:14:05.152 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-07T16:14:05.152 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-07T16:14:05.152 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-07T16:14:05.152 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-07T16:14:05.152 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout [osd] 2023-12-07T16:14:05.152 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-07T16:14:05.153 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-07T16:14:05.153 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-07T16:14:05.153 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-07T16:14:05.153 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-07T16:14:05.153 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.711+0000 7f1928831700 1 Processor -- start 2023-12-07T16:14:05.153 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.711+0000 7f1928831700 1 -- start start 2023-12-07T16:14:05.153 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.711+0000 7f1928831700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1924070f80 0x7f1924104f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:05.153 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.712+0000 7f1928831700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1924105460 con 0x7f1924070f80 2023-12-07T16:14:05.153 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.712+0000 7f192259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1924070f80 0x7f1924104f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:05.153 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.712+0000 7f192259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1924070f80 0x7f1924104f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57118/0 (socket says 172.21.15.63:57118) 2023-12-07T16:14:05.153 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.712+0000 7f192259c700 1 -- 172.21.15.63:0/2160804295 learned_addr learned my addr 172.21.15.63:0/2160804295 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:05.153 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.712+0000 7f192259c700 1 -- 172.21.15.63:0/2160804295 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19241055a0 con 0x7f1924070f80 2023-12-07T16:14:05.153 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.712+0000 7f192259c700 1 --2- 172.21.15.63:0/2160804295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1924070f80 0x7f1924104f20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f19140098e0 tx=0x7f1914009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0738f2a03ac91ea server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:05.153 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.712+0000 7f192159a700 1 -- 172.21.15.63:0/2160804295 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f191400b860 con 0x7f1924070f80 2023-12-07T16:14:05.153 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.712+0000 7f192159a700 1 -- 172.21.15.63:0/2160804295 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191400b9c0 con 0x7f1924070f80 2023-12-07T16:14:05.153 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.712+0000 7f192159a700 1 -- 172.21.15.63:0/2160804295 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f191400bc90 con 0x7f1924070f80 2023-12-07T16:14:05.154 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.713+0000 7f1928831700 1 -- 172.21.15.63:0/2160804295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1924070f80 msgr2=0x7f1924104f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:05.154 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.713+0000 7f1928831700 1 --2- 172.21.15.63:0/2160804295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1924070f80 0x7f1924104f20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f19140098e0 tx=0x7f1914009250 comp rx=0 tx=0).stop 2023-12-07T16:14:05.154 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.713+0000 7f1928831700 1 -- 172.21.15.63:0/2160804295 shutdown_connections 2023-12-07T16:14:05.154 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.713+0000 7f1928831700 1 --2- 172.21.15.63:0/2160804295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1924070f80 0x7f1924104f20 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:05.154 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.713+0000 7f1928831700 1 -- 172.21.15.63:0/2160804295 >> 172.21.15.63:0/2160804295 conn(0x7f19240fc970 msgr2=0x7f19240fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:05.154 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.713+0000 7f1928831700 1 -- 172.21.15.63:0/2160804295 shutdown_connections 2023-12-07T16:14:05.154 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.713+0000 7f1928831700 1 -- 172.21.15.63:0/2160804295 wait complete. 2023-12-07T16:14:05.154 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.714+0000 7f1928831700 1 Processor -- start 2023-12-07T16:14:05.154 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.714+0000 7f1928831700 1 -- start start 2023-12-07T16:14:05.154 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.714+0000 7f1928831700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1924070f80 0x7f1924110980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:05.154 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.714+0000 7f1928831700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1924110ec0 con 0x7f1924070f80 2023-12-07T16:14:05.154 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.714+0000 7f192259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1924070f80 0x7f1924110980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:05.154 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.714+0000 7f192259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1924070f80 0x7f1924110980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57124/0 (socket says 172.21.15.63:57124) 2023-12-07T16:14:05.154 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.714+0000 7f192259c700 1 -- 172.21.15.63:0/2030257069 learned_addr learned my addr 172.21.15.63:0/2030257069 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:05.154 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.714+0000 7f192259c700 1 -- 172.21.15.63:0/2030257069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19140094f0 con 0x7f1924070f80 2023-12-07T16:14:05.155 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.715+0000 7f192259c700 1 --2- 172.21.15.63:0/2030257069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1924070f80 0x7f1924110980 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f1914009290 tx=0x7f1914016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:05.155 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.715+0000 7f1912ffd700 1 -- 172.21.15.63:0/2030257069 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f191401c5c0 con 0x7f1924070f80 2023-12-07T16:14:05.155 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.715+0000 7f1912ffd700 1 -- 172.21.15.63:0/2030257069 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191401c740 con 0x7f1924070f80 2023-12-07T16:14:05.155 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.715+0000 7f1928831700 1 -- 172.21.15.63:0/2030257069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19241110c0 con 0x7f1924070f80 2023-12-07T16:14:05.155 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.715+0000 7f1912ffd700 1 -- 172.21.15.63:0/2030257069 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f191401ca50 con 0x7f1924070f80 2023-12-07T16:14:05.155 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.715+0000 7f1928831700 1 -- 172.21.15.63:0/2030257069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19241114d0 con 0x7f1924070f80 2023-12-07T16:14:05.155 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.715+0000 7f1912ffd700 1 -- 172.21.15.63:0/2030257069 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f191401a450 con 0x7f1924070f80 2023-12-07T16:14:05.155 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.715+0000 7f1912ffd700 1 -- 172.21.15.63:0/2030257069 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f191402e790 con 0x7f1924070f80 2023-12-07T16:14:05.155 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.716+0000 7f1928831700 1 -- 172.21.15.63:0/2030257069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f192404bb80 con 0x7f1924070f80 2023-12-07T16:14:05.155 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.718+0000 7f1912ffd700 1 -- 172.21.15.63:0/2030257069 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f191401ce30 con 0x7f1924070f80 2023-12-07T16:14:05.155 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.787+0000 7f1928831700 1 -- 172.21.15.63:0/2030257069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f1924105850 con 0x7f1924070f80 2023-12-07T16:14:05.155 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.791+0000 7f1912ffd700 1 -- 172.21.15.63:0/2030257069 <== mon.0 v2:172.21.15.63:3300/0 7 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f191401b3e0 con 0x7f1924070f80 2023-12-07T16:14:05.155 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.791+0000 7f1912ffd700 1 -- 172.21.15.63:0/2030257069 <== mon.0 v2:172.21.15.63:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f191402e950 con 0x7f1924070f80 2023-12-07T16:14:05.155 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.792+0000 7f1928831700 1 -- 172.21.15.63:0/2030257069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1924070f80 msgr2=0x7f1924110980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:05.155 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.792+0000 7f1928831700 1 --2- 172.21.15.63:0/2030257069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1924070f80 0x7f1924110980 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f1914009290 tx=0x7f1914016000 comp rx=0 tx=0).stop 2023-12-07T16:14:05.155 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.792+0000 7f1928831700 1 -- 172.21.15.63:0/2030257069 shutdown_connections 2023-12-07T16:14:05.156 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.792+0000 7f1928831700 1 --2- 172.21.15.63:0/2030257069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1924070f80 0x7f1924110980 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:05.156 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.792+0000 7f1928831700 1 -- 172.21.15.63:0/2030257069 >> 172.21.15.63:0/2030257069 conn(0x7f19240fc970 msgr2=0x7f19240fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:05.156 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.792+0000 7f1928831700 1 -- 172.21.15.63:0/2030257069 shutdown_connections 2023-12-07T16:14:05.156 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:04.792+0000 7f1928831700 1 -- 172.21.15.63:0/2030257069 wait complete. 2023-12-07T16:14:05.156 INFO:teuthology.orchestra.run.smithi063.stdout:Generating new minimal ceph.conf... 2023-12-07T16:14:05.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:05 smithi063 ceph-mon[111609]: from='client.? 172.21.15.63:0/2030257069' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-07T16:14:05.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:05 smithi063 ceph-mon[111609]: from='client.? 172.21.15.63:0/2030257069' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-12-07T16:14:06.044 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.547+0000 7f09541c8700 1 Processor -- start 2023-12-07T16:14:06.044 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.547+0000 7f09541c8700 1 -- start start 2023-12-07T16:14:06.044 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.548+0000 7f09541c8700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f094c103850 0x7f094c103c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:06.044 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.548+0000 7f09541c8700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c1041a0 con 0x7f094c103850 2023-12-07T16:14:06.044 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.548+0000 7f0951f64700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f094c103850 0x7f094c103c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:06.044 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.548+0000 7f0951f64700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f094c103850 0x7f094c103c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57128/0 (socket says 172.21.15.63:57128) 2023-12-07T16:14:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.548+0000 7f0951f64700 1 -- 172.21.15.63:0/1858496827 learned_addr learned my addr 172.21.15.63:0/1858496827 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.548+0000 7f0951f64700 1 -- 172.21.15.63:0/1858496827 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c1042e0 con 0x7f094c103850 2023-12-07T16:14:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.548+0000 7f0951f64700 1 --2- 172.21.15.63:0/1858496827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f094c103850 0x7f094c103c60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f09480098e0 tx=0x7f0948009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67a24d7402bb529 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.548+0000 7f0950f62700 1 -- 172.21.15.63:0/1858496827 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f094800b860 con 0x7f094c103850 2023-12-07T16:14:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.548+0000 7f0950f62700 1 -- 172.21.15.63:0/1858496827 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f094800be30 con 0x7f094c103850 2023-12-07T16:14:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.548+0000 7f0950f62700 1 -- 172.21.15.63:0/1858496827 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0948010380 con 0x7f094c103850 2023-12-07T16:14:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.549+0000 7f09541c8700 1 -- 172.21.15.63:0/1858496827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f094c103850 msgr2=0x7f094c103c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.549+0000 7f09541c8700 1 --2- 172.21.15.63:0/1858496827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f094c103850 0x7f094c103c60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f09480098e0 tx=0x7f0948009250 comp rx=0 tx=0).stop 2023-12-07T16:14:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.549+0000 7f09541c8700 1 -- 172.21.15.63:0/1858496827 shutdown_connections 2023-12-07T16:14:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.549+0000 7f09541c8700 1 --2- 172.21.15.63:0/1858496827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f094c103850 0x7f094c103c60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.549+0000 7f09541c8700 1 -- 172.21.15.63:0/1858496827 >> 172.21.15.63:0/1858496827 conn(0x7f094c0fc010 msgr2=0x7f094c0fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.549+0000 7f09541c8700 1 -- 172.21.15.63:0/1858496827 shutdown_connections 2023-12-07T16:14:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.549+0000 7f09541c8700 1 -- 172.21.15.63:0/1858496827 wait complete. 2023-12-07T16:14:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.550+0000 7f09541c8700 1 Processor -- start 2023-12-07T16:14:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.550+0000 7f09541c8700 1 -- start start 2023-12-07T16:14:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.550+0000 7f09541c8700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f094c103850 0x7f094c110fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.550+0000 7f09541c8700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c111510 con 0x7f094c103850 2023-12-07T16:14:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.550+0000 7f0951f64700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f094c103850 0x7f094c110fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.550+0000 7f0951f64700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f094c103850 0x7f094c110fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57140/0 (socket says 172.21.15.63:57140) 2023-12-07T16:14:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.550+0000 7f0951f64700 1 -- 172.21.15.63:0/2116893426 learned_addr learned my addr 172.21.15.63:0/2116893426 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.550+0000 7f0951f64700 1 -- 172.21.15.63:0/2116893426 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09480094f0 con 0x7f094c103850 2023-12-07T16:14:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.550+0000 7f0951f64700 1 --2- 172.21.15.63:0/2116893426 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f094c103850 0x7f094c110fd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0948006b00 tx=0x7f0948009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.551+0000 7f093e7fc700 1 -- 172.21.15.63:0/2116893426 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09480109b0 con 0x7f094c103850 2023-12-07T16:14:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.551+0000 7f093e7fc700 1 -- 172.21.15.63:0/2116893426 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f094801a430 con 0x7f094c103850 2023-12-07T16:14:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.551+0000 7f093e7fc700 1 -- 172.21.15.63:0/2116893426 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09480245b0 con 0x7f094c103850 2023-12-07T16:14:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.551+0000 7f09541c8700 1 -- 172.21.15.63:0/2116893426 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094c111710 con 0x7f094c103850 2023-12-07T16:14:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.551+0000 7f09541c8700 1 -- 172.21.15.63:0/2116893426 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094c111b20 con 0x7f094c103850 2023-12-07T16:14:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.551+0000 7f093e7fc700 1 -- 172.21.15.63:0/2116893426 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0948010d90 con 0x7f094c103850 2023-12-07T16:14:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.551+0000 7f093e7fc700 1 -- 172.21.15.63:0/2116893426 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f094802e790 con 0x7f094c103850 2023-12-07T16:14:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.552+0000 7f09541c8700 1 -- 172.21.15.63:0/2116893426 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094c04bb80 con 0x7f094c103850 2023-12-07T16:14:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.554+0000 7f093e7fc700 1 -- 172.21.15.63:0/2116893426 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f094801a9c0 con 0x7f094c103850 2023-12-07T16:14:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.623+0000 7f09541c8700 1 -- 172.21.15.63:0/2116893426 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f094c100d30 con 0x7f094c103850 2023-12-07T16:14:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.624+0000 7f093e7fc700 1 -- 172.21.15.63:0/2116893426 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f094801a5a0 con 0x7f094c103850 2023-12-07T16:14:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.624+0000 7f09541c8700 1 -- 172.21.15.63:0/2116893426 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f094c103850 msgr2=0x7f094c110fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.624+0000 7f09541c8700 1 --2- 172.21.15.63:0/2116893426 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f094c103850 0x7f094c110fd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0948006b00 tx=0x7f0948009250 comp rx=0 tx=0).stop 2023-12-07T16:14:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.624+0000 7f09541c8700 1 -- 172.21.15.63:0/2116893426 shutdown_connections 2023-12-07T16:14:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.624+0000 7f09541c8700 1 --2- 172.21.15.63:0/2116893426 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f094c103850 0x7f094c110fd0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.625+0000 7f09541c8700 1 -- 172.21.15.63:0/2116893426 >> 172.21.15.63:0/2116893426 conn(0x7f094c0fc010 msgr2=0x7f094c0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.625+0000 7f09541c8700 1 -- 172.21.15.63:0/2116893426 shutdown_connections 2023-12-07T16:14:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:05.625+0000 7f09541c8700 1 -- 172.21.15.63:0/2116893426 wait complete. 2023-12-07T16:14:06.048 INFO:teuthology.orchestra.run.smithi063.stdout:Restarting the monitor... 2023-12-07T16:14:06.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:06 smithi063 systemd[1]: Stopping Ceph mon.smithi063 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:14:06.477 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:06 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-mon-smithi063[111586]: 2023-12-07T16:14:06.225+0000 7f0d1ef21700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi063 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-07T16:14:06.477 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:06 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-mon-smithi063[111586]: 2023-12-07T16:14:06.225+0000 7f0d1ef21700 -1 mon.smithi063@0(leader) e1 *** Got Signal Terminated *** 2023-12-07T16:14:06.807 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:06 smithi063 bash[111939]: ceph-8c493298-951b-11ee-95a2-87774f69a715-mon-smithi063 2023-12-07T16:14:07.096 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:06 smithi063 systemd[1]: ceph-8c493298-951b-11ee-95a2-87774f69a715@mon.smithi063.service: Succeeded. 2023-12-07T16:14:07.096 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:06 smithi063 systemd[1]: Stopped Ceph mon.smithi063 for 8c493298-951b-11ee-95a2-87774f69a715. 2023-12-07T16:14:07.096 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:06 smithi063 systemd[1]: Starting Ceph mon.smithi063 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:14:07.229 INFO:teuthology.orchestra.run.smithi063.stdout:Setting mon public_network to 172.21.0.0/20 2023-12-07T16:14:07.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: set uid:gid to 167:167 (ceph:ceph) 2023-12-07T16:14:07.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable), process ceph-mon, pid 7 2023-12-07T16:14:07.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: pidfile_write: ignore empty --pid-file 2023-12-07T16:14:07.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: load: jerasure load: lrc 2023-12-07T16:14:07.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: RocksDB version: 6.15.5 2023-12-07T16:14:07.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-12-07T16:14:07.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Compile date Dec 6 2023 2023-12-07T16:14:07.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: DB SUMMARY 2023-12-07T16:14:07.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: DB Session ID: 2BTTNKZ6IMFHTC18YRRB 2023-12-07T16:14:07.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: CURRENT file: CURRENT 2023-12-07T16:14:07.658 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: IDENTITY file: IDENTITY 2023-12-07T16:14:07.658 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2023-12-07T16:14:07.658 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi063/store.db dir, Total Num: 1, files: 000008.sst 2023-12-07T16:14:07.658 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi063/store.db: 000010.log size: 95334 ; 2023-12-07T16:14:07.658 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.error_if_exists: 0 2023-12-07T16:14:07.658 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.create_if_missing: 0 2023-12-07T16:14:07.658 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.paranoid_checks: 1 2023-12-07T16:14:07.658 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-07T16:14:07.658 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.env: 0x5598555aea80 2023-12-07T16:14:07.658 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.fs: Posix File System 2023-12-07T16:14:07.658 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.info_log: 0x559857a12780 2023-12-07T16:14:07.658 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_file_opening_threads: 16 2023-12-07T16:14:07.658 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.statistics: (nil) 2023-12-07T16:14:07.658 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.use_fsync: 0 2023-12-07T16:14:07.658 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_log_file_size: 0 2023-12-07T16:14:07.658 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-07T16:14:07.659 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-07T16:14:07.659 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.keep_log_file_num: 1000 2023-12-07T16:14:07.659 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.recycle_log_file_num: 0 2023-12-07T16:14:07.659 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.allow_fallocate: 1 2023-12-07T16:14:07.659 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.allow_mmap_reads: 0 2023-12-07T16:14:07.659 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.allow_mmap_writes: 0 2023-12-07T16:14:07.659 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.use_direct_reads: 0 2023-12-07T16:14:07.659 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-07T16:14:07.659 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.create_missing_column_families: 0 2023-12-07T16:14:07.659 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.db_log_dir: 2023-12-07T16:14:07.659 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi063/store.db 2023-12-07T16:14:07.659 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-07T16:14:07.659 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-07T16:14:07.659 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-07T16:14:07.659 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-07T16:14:07.659 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-07T16:14:07.660 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-07T16:14:07.660 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.advise_random_on_open: 1 2023-12-07T16:14:07.660 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.db_write_buffer_size: 0 2023-12-07T16:14:07.660 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.write_buffer_manager: 0x5598587829f0 2023-12-07T16:14:07.660 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-07T16:14:07.660 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-12-07T16:14:07.660 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-07T16:14:07.660 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-07T16:14:07.660 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.rate_limiter: (nil) 2023-12-07T16:14:07.660 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-07T16:14:07.660 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.wal_recovery_mode: 2 2023-12-07T16:14:07.660 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.enable_thread_tracking: 0 2023-12-07T16:14:07.660 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.enable_pipelined_write: 0 2023-12-07T16:14:07.660 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.unordered_write: 0 2023-12-07T16:14:07.660 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-07T16:14:07.660 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-07T16:14:07.661 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-07T16:14:07.661 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-07T16:14:07.661 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.row_cache: None 2023-12-07T16:14:07.661 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.wal_filter: None 2023-12-07T16:14:07.661 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-07T16:14:07.661 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.allow_ingest_behind: 0 2023-12-07T16:14:07.661 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.preserve_deletes: 0 2023-12-07T16:14:07.661 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.two_write_queues: 0 2023-12-07T16:14:07.661 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.manual_wal_flush: 0 2023-12-07T16:14:07.661 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.atomic_flush: 0 2023-12-07T16:14:07.661 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-07T16:14:07.661 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-07T16:14:07.661 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-07T16:14:07.661 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.log_readahead_size: 0 2023-12-07T16:14:07.661 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-07T16:14:07.662 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.best_efforts_recovery: 0 2023-12-07T16:14:07.662 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-07T16:14:07.662 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-07T16:14:07.662 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.allow_data_in_errors: 0 2023-12-07T16:14:07.662 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.db_host_id: __hostname__ 2023-12-07T16:14:07.662 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_background_jobs: 2 2023-12-07T16:14:07.662 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_background_compactions: -1 2023-12-07T16:14:07.662 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_subcompactions: 1 2023-12-07T16:14:07.662 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-07T16:14:07.662 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-07T16:14:07.662 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-07T16:14:07.662 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_total_wal_size: 0 2023-12-07T16:14:07.662 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-07T16:14:07.662 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-07T16:14:07.662 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-07T16:14:07.663 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-07T16:14:07.663 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_open_files: -1 2023-12-07T16:14:07.663 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.bytes_per_sync: 0 2023-12-07T16:14:07.663 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-07T16:14:07.663 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-07T16:14:07.663 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.compaction_readahead_size: 0 2023-12-07T16:14:07.663 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_background_flushes: -1 2023-12-07T16:14:07.663 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Compression algorithms supported: 2023-12-07T16:14:07.663 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-07T16:14:07.663 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: kZSTD supported: 0 2023-12-07T16:14:07.663 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: kXpressCompression supported: 0 2023-12-07T16:14:07.663 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: kLZ4HCCompression supported: 1 2023-12-07T16:14:07.663 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: kZlibCompression supported: 1 2023-12-07T16:14:07.663 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: kSnappyCompression supported: 1 2023-12-07T16:14:07.663 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: kLZ4Compression supported: 1 2023-12-07T16:14:07.663 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: kBZip2Compression supported: 0 2023-12-07T16:14:07.663 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-07T16:14:07.664 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi063/store.db/MANIFEST-000009 2023-12-07T16:14:07.664 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-12-07T16:14:07.664 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-07T16:14:07.664 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.merge_operator: 2023-12-07T16:14:07.664 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.compaction_filter: None 2023-12-07T16:14:07.664 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.compaction_filter_factory: None 2023-12-07T16:14:07.664 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.sst_partitioner_factory: None 2023-12-07T16:14:07.664 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-07T16:14:07.664 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-07T16:14:07.664 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559857a62f90) 2023-12-07T16:14:07.664 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: cache_index_and_filter_blocks: 1 2023-12-07T16:14:07.664 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-07T16:14:07.664 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-07T16:14:07.664 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: pin_top_level_index_and_filter: 1 2023-12-07T16:14:07.664 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: index_type: 0 2023-12-07T16:14:07.664 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: data_block_index_type: 0 2023-12-07T16:14:07.665 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: index_shortening: 1 2023-12-07T16:14:07.665 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-07T16:14:07.665 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: hash_index_allow_collision: 1 2023-12-07T16:14:07.665 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: checksum: 1 2023-12-07T16:14:07.665 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: no_block_cache: 0 2023-12-07T16:14:07.665 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_cache: 0x559857a95090 2023-12-07T16:14:07.665 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_cache_name: BinnedLRUCache 2023-12-07T16:14:07.665 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_cache_options: 2023-12-07T16:14:07.665 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: capacity : 536870912 2023-12-07T16:14:07.665 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: num_shard_bits : 4 2023-12-07T16:14:07.665 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: strict_capacity_limit : 0 2023-12-07T16:14:07.665 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: high_pri_pool_ratio: 0.000 2023-12-07T16:14:07.665 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_cache_compressed: (nil) 2023-12-07T16:14:07.665 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: persistent_cache: (nil) 2023-12-07T16:14:07.665 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_size: 4096 2023-12-07T16:14:07.665 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_size_deviation: 10 2023-12-07T16:14:07.666 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_restart_interval: 16 2023-12-07T16:14:07.666 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: index_block_restart_interval: 1 2023-12-07T16:14:07.666 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: metadata_block_size: 4096 2023-12-07T16:14:07.666 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: partition_filters: 0 2023-12-07T16:14:07.666 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: use_delta_encoding: 1 2023-12-07T16:14:07.666 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-12-07T16:14:07.666 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: whole_key_filtering: 1 2023-12-07T16:14:07.666 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: verify_compression: 0 2023-12-07T16:14:07.666 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: read_amp_bytes_per_bit: 0 2023-12-07T16:14:07.666 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: format_version: 4 2023-12-07T16:14:07.666 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: enable_index_compression: 1 2023-12-07T16:14:07.666 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_align: 0 2023-12-07T16:14:07.666 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.write_buffer_size: 33554432 2023-12-07T16:14:07.666 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_write_buffer_number: 2 2023-12-07T16:14:07.666 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.compression: NoCompression 2023-12-07T16:14:07.666 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.bottommost_compression: Disabled 2023-12-07T16:14:07.667 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.prefix_extractor: nullptr 2023-12-07T16:14:07.667 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-07T16:14:07.667 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.num_levels: 7 2023-12-07T16:14:07.667 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-07T16:14:07.667 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-07T16:14:07.667 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-07T16:14:07.667 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-07T16:14:07.667 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-07T16:14:07.667 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-07T16:14:07.667 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-07T16:14:07.667 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-07T16:14:07.667 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-07T16:14:07.667 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-07T16:14:07.667 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-07T16:14:07.667 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.compression_opts.level: 32767 2023-12-07T16:14:07.667 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.compression_opts.strategy: 0 2023-12-07T16:14:07.667 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-07T16:14:07.668 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-07T16:14:07.668 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-07T16:14:07.668 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.compression_opts.enabled: false 2023-12-07T16:14:07.668 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-07T16:14:07.668 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-07T16:14:07.668 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-07T16:14:07.668 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.target_file_size_base: 67108864 2023-12-07T16:14:07.668 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-07T16:14:07.668 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-07T16:14:07.668 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-07T16:14:07.668 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-07T16:14:07.668 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-07T16:14:07.668 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-07T16:14:07.668 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-07T16:14:07.668 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-07T16:14:07.668 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-07T16:14:07.668 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-07T16:14:07.669 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-07T16:14:07.669 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-07T16:14:07.669 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-07T16:14:07.669 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.arena_block_size: 4194304 2023-12-07T16:14:07.669 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-07T16:14:07.669 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-07T16:14:07.669 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-12-07T16:14:07.669 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.disable_auto_compactions: 0 2023-12-07T16:14:07.669 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-07T16:14:07.669 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-07T16:14:07.669 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-07T16:14:07.669 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-07T16:14:07.669 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-07T16:14:07.669 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-07T16:14:07.669 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-07T16:14:07.669 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-07T16:14:07.670 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-07T16:14:07.670 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-07T16:14:07.670 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.table_properties_collectors: 2023-12-07T16:14:07.670 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.inplace_update_support: 0 2023-12-07T16:14:07.670 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-07T16:14:07.670 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-07T16:14:07.670 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-07T16:14:07.670 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-07T16:14:07.670 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.bloom_locality: 0 2023-12-07T16:14:07.670 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.max_successive_merges: 0 2023-12-07T16:14:07.670 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-07T16:14:07.670 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.paranoid_file_checks: 0 2023-12-07T16:14:07.670 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.force_consistency_checks: 1 2023-12-07T16:14:07.670 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.report_bg_io_stats: 0 2023-12-07T16:14:07.670 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.ttl: 2592000 2023-12-07T16:14:07.671 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-07T16:14:07.671 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.enable_blob_files: false 2023-12-07T16:14:07.671 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.min_blob_size: 0 2023-12-07T16:14:07.671 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.blob_file_size: 268435456 2023-12-07T16:14:07.671 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-07T16:14:07.671 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-07T16:14:07.671 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-07T16:14:07.671 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi063/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-07T16:14:07.671 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2023-12-07T16:14:07.671 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2023-12-07T16:14:07.671 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701965647220765, "job": 1, "event": "recovery_started", "wal_files": [10]} 2023-12-07T16:14:07.671 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2023-12-07T16:14:07.671 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-12-07T16:14:07.671 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701965647221550, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 90860, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 88955, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13169, "raw_average_key_size": 49, "raw_value_size": 81733, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 264, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1701965647, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "5786e436-ccb7-44a9-bf38-54fead31b530", "db_session_id": "2BTTNKZ6IMFHTC18YRRB"}} 2023-12-07T16:14:07.671 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2023-12-07T16:14:07.672 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701965647221896, "job": 1, "event": "recovery_finished"} 2023-12-07T16:14:07.672 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi063/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-07T16:14:07.672 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x559857a29180 2023-12-07T16:14:07.672 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: DB pointer 0x559857afe000 2023-12-07T16:14:07.672 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-12-07T16:14:07.672 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-12-07T16:14:07.672 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ** DB Stats ** 2023-12-07T16:14:07.672 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-07T16:14:07.672 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-07T16:14:07.672 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-07T16:14:07.672 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-07T16:14:07.672 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-07T16:14:07.672 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-12-07T16:14:07.672 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-07T16:14:07.672 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-07T16:14:07.672 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ** Compaction Stats [default] ** 2023-12-07T16:14:07.673 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-07T16:14:07.673 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-07T16:14:07.673 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: L0 2/0 90.53 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 173.6 0.00 0.00 1 0.000 0 0 2023-12-07T16:14:07.673 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Sum 2/0 90.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 173.6 0.00 0.00 1 0.000 0 0 2023-12-07T16:14:07.673 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 173.6 0.00 0.00 1 0.000 0 0 2023-12-07T16:14:07.673 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-07T16:14:07.673 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ** Compaction Stats [default] ** 2023-12-07T16:14:07.673 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-07T16:14:07.673 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-07T16:14:07.673 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 173.6 0.00 0.00 1 0.000 0 0 2023-12-07T16:14:07.673 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-07T16:14:07.673 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-07T16:14:07.673 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-07T16:14:07.673 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-07T16:14:07.673 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-07T16:14:07.674 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-07T16:14:07.674 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Cumulative compaction: 0.00 GB write, 28.12 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-07T16:14:07.674 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Interval compaction: 0.00 GB write, 28.12 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-07T16:14:07.674 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-07T16:14:07.674 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-07T16:14:07.674 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-07T16:14:07.674 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-07T16:14:07.674 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ** Compaction Stats [default] ** 2023-12-07T16:14:07.674 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-07T16:14:07.674 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-07T16:14:07.674 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: L0 2/0 90.53 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 173.6 0.00 0.00 1 0.000 0 0 2023-12-07T16:14:07.674 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Sum 2/0 90.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 173.6 0.00 0.00 1 0.000 0 0 2023-12-07T16:14:07.674 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-12-07T16:14:07.674 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-07T16:14:07.675 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ** Compaction Stats [default] ** 2023-12-07T16:14:07.675 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-07T16:14:07.675 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-07T16:14:07.675 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 173.6 0.00 0.00 1 0.000 0 0 2023-12-07T16:14:07.675 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-07T16:14:07.675 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-07T16:14:07.675 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-07T16:14:07.675 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-07T16:14:07.675 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-07T16:14:07.675 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-07T16:14:07.675 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Cumulative compaction: 0.00 GB write, 27.78 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-07T16:14:07.675 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-07T16:14:07.675 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-07T16:14:07.675 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-07T16:14:07.675 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-07T16:14:07.676 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: starting mon.smithi063 rank 0 at public addrs [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] at bind addrs [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi063 fsid 8c493298-951b-11ee-95a2-87774f69a715 2023-12-07T16:14:07.676 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: mon.smithi063@-1(???) e1 preinit fsid 8c493298-951b-11ee-95a2-87774f69a715 2023-12-07T16:14:07.676 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: mon.smithi063@-1(???).mds e1 new map 2023-12-07T16:14:07.676 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: mon.smithi063@-1(???).mds e1 print_map 2023-12-07T16:14:07.676 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: e1 2023-12-07T16:14:07.676 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-07T16:14:07.676 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:14:07.676 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: legacy client fscid: -1 2023-12-07T16:14:07.676 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-07T16:14:07.676 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: No filesystems configured 2023-12-07T16:14:07.676 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: mon.smithi063@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-07T16:14:07.676 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: mon.smithi063@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-07T16:14:07.676 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: mon.smithi063@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-07T16:14:07.676 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: mon.smithi063@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-07T16:14:07.676 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: mon.smithi063@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-12-07T16:14:07.676 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 bash[112058]: 736281f5463cfe147afc6df2a9680efdc97f506fb8da838ac58f948bd4bc3e20 2023-12-07T16:14:07.677 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 systemd[1]: Started Ceph mon.smithi063 for 8c493298-951b-11ee-95a2-87774f69a715. 2023-12-07T16:14:07.677 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: mon.smithi063 is new leader, mons smithi063 in quorum (ranks 0) 2023-12-07T16:14:07.677 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: monmap e1: 1 mons at {smithi063=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-07T16:14:07.677 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: fsmap 2023-12-07T16:14:07.677 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: osdmap e1: 0 total, 0 up, 0 in 2023-12-07T16:14:07.677 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:07 smithi063 ceph-mon[112095]: mgrmap e1: no daemons active 2023-12-07T16:14:08.079 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.583+0000 7f54ca9c5700 1 Processor -- start 2023-12-07T16:14:08.084 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.583+0000 7f54ca9c5700 1 -- start start 2023-12-07T16:14:08.084 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.584+0000 7f54ca9c5700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54c41011d0 0x7f54c41015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:08.084 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.584+0000 7f54ca9c5700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c4101b20 con 0x7f54c41011d0 2023-12-07T16:14:08.084 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.584+0000 7f54c3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54c41011d0 0x7f54c41015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:08.084 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.584+0000 7f54c3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54c41011d0 0x7f54c41015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57144/0 (socket says 172.21.15.63:57144) 2023-12-07T16:14:08.084 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.584+0000 7f54c3fff700 1 -- 172.21.15.63:0/3478850699 learned_addr learned my addr 172.21.15.63:0/3478850699 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:08.084 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.584+0000 7f54c3fff700 1 -- 172.21.15.63:0/3478850699 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c4101c60 con 0x7f54c41011d0 2023-12-07T16:14:08.085 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.584+0000 7f54c3fff700 1 --2- 172.21.15.63:0/3478850699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54c41011d0 0x7f54c41015e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f54b400bb80 tx=0x7f54b400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96229f001d615b8b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:08.085 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.585+0000 7f54c2ffd700 1 -- 172.21.15.63:0/3478850699 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54b400dd00 con 0x7f54c41011d0 2023-12-07T16:14:08.085 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.585+0000 7f54c2ffd700 1 -- 172.21.15.63:0/3478850699 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f54b400de60 con 0x7f54c41011d0 2023-12-07T16:14:08.085 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.585+0000 7f54c2ffd700 1 -- 172.21.15.63:0/3478850699 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54b4018840 con 0x7f54c41011d0 2023-12-07T16:14:08.085 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.585+0000 7f54ca9c5700 1 -- 172.21.15.63:0/3478850699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54c41011d0 msgr2=0x7f54c41015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:08.085 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.585+0000 7f54ca9c5700 1 --2- 172.21.15.63:0/3478850699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54c41011d0 0x7f54c41015e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f54b400bb80 tx=0x7f54b400b4f0 comp rx=0 tx=0).stop 2023-12-07T16:14:08.085 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.585+0000 7f54ca9c5700 1 -- 172.21.15.63:0/3478850699 shutdown_connections 2023-12-07T16:14:08.085 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.585+0000 7f54ca9c5700 1 --2- 172.21.15.63:0/3478850699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54c41011d0 0x7f54c41015e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:08.085 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.585+0000 7f54ca9c5700 1 -- 172.21.15.63:0/3478850699 >> 172.21.15.63:0/3478850699 conn(0x7f54c40fc970 msgr2=0x7f54c40fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:08.085 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.585+0000 7f54ca9c5700 1 -- 172.21.15.63:0/3478850699 shutdown_connections 2023-12-07T16:14:08.085 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.585+0000 7f54ca9c5700 1 -- 172.21.15.63:0/3478850699 wait complete. 2023-12-07T16:14:08.085 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.586+0000 7f54ca9c5700 1 Processor -- start 2023-12-07T16:14:08.085 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.586+0000 7f54ca9c5700 1 -- start start 2023-12-07T16:14:08.085 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.586+0000 7f54ca9c5700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54c41011d0 0x7f54c4113310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:08.085 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.586+0000 7f54ca9c5700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c4113850 con 0x7f54c41011d0 2023-12-07T16:14:08.086 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.586+0000 7f54c3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54c41011d0 0x7f54c4113310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:08.086 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.586+0000 7f54c3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54c41011d0 0x7f54c4113310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57146/0 (socket says 172.21.15.63:57146) 2023-12-07T16:14:08.086 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.586+0000 7f54c3fff700 1 -- 172.21.15.63:0/4288684420 learned_addr learned my addr 172.21.15.63:0/4288684420 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:08.086 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.587+0000 7f54c3fff700 1 -- 172.21.15.63:0/4288684420 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b400b790 con 0x7f54c41011d0 2023-12-07T16:14:08.086 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.587+0000 7f54c3fff700 1 --2- 172.21.15.63:0/4288684420 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54c41011d0 0x7f54c4113310 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f54b4006d20 tx=0x7f54b400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:08.086 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.587+0000 7f54c0ff9700 1 -- 172.21.15.63:0/4288684420 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54b4010920 con 0x7f54c41011d0 2023-12-07T16:14:08.086 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.587+0000 7f54c0ff9700 1 -- 172.21.15.63:0/4288684420 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f54b4010a80 con 0x7f54c41011d0 2023-12-07T16:14:08.086 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.587+0000 7f54ca9c5700 1 -- 172.21.15.63:0/4288684420 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c4113a50 con 0x7f54c41011d0 2023-12-07T16:14:08.086 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.587+0000 7f54c0ff9700 1 -- 172.21.15.63:0/4288684420 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54b4021550 con 0x7f54c41011d0 2023-12-07T16:14:08.086 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.587+0000 7f54ca9c5700 1 -- 172.21.15.63:0/4288684420 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c4113e60 con 0x7f54c41011d0 2023-12-07T16:14:08.086 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.587+0000 7f54c0ff9700 1 -- 172.21.15.63:0/4288684420 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f54b40217c0 con 0x7f54c41011d0 2023-12-07T16:14:08.086 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.587+0000 7f54c0ff9700 1 -- 172.21.15.63:0/4288684420 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f54b4014070 con 0x7f54c41011d0 2023-12-07T16:14:08.086 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.588+0000 7f54ca9c5700 1 -- 172.21.15.63:0/4288684420 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c404bb80 con 0x7f54c41011d0 2023-12-07T16:14:08.086 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.590+0000 7f54c0ff9700 1 -- 172.21.15.63:0/4288684420 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f54b4031060 con 0x7f54c41011d0 2023-12-07T16:14:08.087 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.660+0000 7f54ca9c5700 1 -- 172.21.15.63:0/4288684420 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f54c4102fe0 con 0x7f54c41011d0 2023-12-07T16:14:08.087 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.663+0000 7f54c0ff9700 1 -- 172.21.15.63:0/4288684420 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f54c4102fe0 con 0x7f54c41011d0 2023-12-07T16:14:08.087 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.664+0000 7f54ca9c5700 1 -- 172.21.15.63:0/4288684420 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54c41011d0 msgr2=0x7f54c4113310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:08.087 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.664+0000 7f54ca9c5700 1 --2- 172.21.15.63:0/4288684420 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54c41011d0 0x7f54c4113310 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f54b4006d20 tx=0x7f54b400b4f0 comp rx=0 tx=0).stop 2023-12-07T16:14:08.087 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.664+0000 7f54ca9c5700 1 -- 172.21.15.63:0/4288684420 shutdown_connections 2023-12-07T16:14:08.087 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.664+0000 7f54ca9c5700 1 --2- 172.21.15.63:0/4288684420 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54c41011d0 0x7f54c4113310 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:08.087 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.664+0000 7f54ca9c5700 1 -- 172.21.15.63:0/4288684420 >> 172.21.15.63:0/4288684420 conn(0x7f54c40fc970 msgr2=0x7f54c4105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:08.087 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.664+0000 7f54ca9c5700 1 -- 172.21.15.63:0/4288684420 shutdown_connections 2023-12-07T16:14:08.087 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:07.664+0000 7f54ca9c5700 1 -- 172.21.15.63:0/4288684420 wait complete. 2023-12-07T16:14:08.087 INFO:teuthology.orchestra.run.smithi063.stdout:Wrote config to /etc/ceph/ceph.conf 2023-12-07T16:14:08.087 INFO:teuthology.orchestra.run.smithi063.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-12-07T16:14:08.087 INFO:teuthology.orchestra.run.smithi063.stdout:Creating mgr... 2023-12-07T16:14:08.087 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying port 9283 ... 2023-12-07T16:14:08.223 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-8c493298-951b-11ee-95a2-87774f69a715@mgr.smithi063.yohyyx 2023-12-07T16:14:08.223 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Failed to reset failed state of unit ceph-8c493298-951b-11ee-95a2-87774f69a715@mgr.smithi063.yohyyx.service: Unit ceph-8c493298-951b-11ee-95a2-87774f69a715@mgr.smithi063.yohyyx.service not loaded. 2023-12-07T16:14:08.318 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-8c493298-951b-11ee-95a2-87774f69a715.target.wants/ceph-8c493298-951b-11ee-95a2-87774f69a715@mgr.smithi063.yohyyx.service → /etc/systemd/system/ceph-8c493298-951b-11ee-95a2-87774f69a715@.service. 2023-12-07T16:14:08.749 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-07T16:14:08.749 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout disabled 2023-12-07T16:14:08.757 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-07T16:14:08.757 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout inactive 2023-12-07T16:14:08.757 INFO:teuthology.orchestra.run.smithi063.stdout:firewalld.service is not enabled 2023-12-07T16:14:08.757 INFO:teuthology.orchestra.run.smithi063.stdout:Not possible to enable service . firewalld.service is not available 2023-12-07T16:14:08.766 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-07T16:14:08.766 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout disabled 2023-12-07T16:14:08.774 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-07T16:14:08.775 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout inactive 2023-12-07T16:14:08.775 INFO:teuthology.orchestra.run.smithi063.stdout:firewalld.service is not enabled 2023-12-07T16:14:08.775 INFO:teuthology.orchestra.run.smithi063.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2023-12-07T16:14:08.775 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for mgr to start... 2023-12-07T16:14:08.775 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for mgr... 2023-12-07T16:14:08.919 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:08 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/4288684420' entity='client.admin' 2023-12-07T16:14:09.722 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-07T16:14:09.722 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2023-12-07T16:14:09.722 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsid": "8c493298-951b-11ee-95a2-87774f69a715", 2023-12-07T16:14:09.722 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "health": { 2023-12-07T16:14:09.722 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-07T16:14:09.722 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-07T16:14:09.722 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-07T16:14:09.722 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:09.722 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-07T16:14:09.722 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-07T16:14:09.722 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 0 2023-12-07T16:14:09.722 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2023-12-07T16:14:09.723 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-07T16:14:09.723 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "smithi063" 2023-12-07T16:14:09.723 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2023-12-07T16:14:09.723 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2023-12-07T16:14:09.723 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-07T16:14:09.723 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T16:14:09.723 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-07T16:14:09.723 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-07T16:14:09.723 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:09.723 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-07T16:14:09.723 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T16:14:09.723 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-07T16:14:09.723 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-07T16:14:09.723 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-07T16:14:09.730 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-07T16:14:09.730 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-07T16:14:09.730 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-07T16:14:09.731 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:09.731 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-07T16:14:09.731 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-07T16:14:09.731 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-07T16:14:09.731 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-07T16:14:09.731 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-07T16:14:09.731 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-07T16:14:09.731 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-07T16:14:09.731 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-07T16:14:09.731 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-07T16:14:09.731 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:09.731 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-07T16:14:09.731 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T16:14:09.731 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-07T16:14:09.731 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-07T16:14:09.731 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:09.732 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-07T16:14:09.732 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-07T16:14:09.732 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-07T16:14:09.732 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-07T16:14:09.732 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-07T16:14:09.732 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-07T16:14:09.732 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "restful" 2023-12-07T16:14:09.732 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2023-12-07T16:14:09.732 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-07T16:14:09.732 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:09.732 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-07T16:14:09.732 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T16:14:09.732 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modified": "2023-12-07T16:14:03.401744+0000", 2023-12-07T16:14:09.732 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-07T16:14:09.732 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:09.732 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-07T16:14:09.732 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2023-12-07T16:14:09.733 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.237+0000 7efe8aecd700 1 Processor -- start 2023-12-07T16:14:09.733 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.237+0000 7efe8aecd700 1 -- start start 2023-12-07T16:14:09.733 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.237+0000 7efe8aecd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe841039d0 0x7efe84103de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:09.733 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.237+0000 7efe8aecd700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe84104320 con 0x7efe841039d0 2023-12-07T16:14:09.733 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.237+0000 7efe88c69700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe841039d0 0x7efe84103de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:09.733 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.237+0000 7efe88c69700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe841039d0 0x7efe84103de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57172/0 (socket says 172.21.15.63:57172) 2023-12-07T16:14:09.733 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.237+0000 7efe88c69700 1 -- 172.21.15.63:0/2647753058 learned_addr learned my addr 172.21.15.63:0/2647753058 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:09.733 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.238+0000 7efe88c69700 1 -- 172.21.15.63:0/2647753058 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe84104460 con 0x7efe841039d0 2023-12-07T16:14:09.733 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.238+0000 7efe88c69700 1 --2- 172.21.15.63:0/2647753058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe841039d0 0x7efe84103de0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7efe780098e0 tx=0x7efe78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cfd444e7b2a4994 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:09.733 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.238+0000 7efe837fe700 1 -- 172.21.15.63:0/2647753058 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe7800b860 con 0x7efe841039d0 2023-12-07T16:14:09.733 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.238+0000 7efe837fe700 1 -- 172.21.15.63:0/2647753058 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7efe7800be30 con 0x7efe841039d0 2023-12-07T16:14:09.733 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.238+0000 7efe837fe700 1 -- 172.21.15.63:0/2647753058 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe78010380 con 0x7efe841039d0 2023-12-07T16:14:09.733 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.239+0000 7efe8aecd700 1 -- 172.21.15.63:0/2647753058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe841039d0 msgr2=0x7efe84103de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:09.733 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.239+0000 7efe8aecd700 1 --2- 172.21.15.63:0/2647753058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe841039d0 0x7efe84103de0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7efe780098e0 tx=0x7efe78009250 comp rx=0 tx=0).stop 2023-12-07T16:14:09.733 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.239+0000 7efe8aecd700 1 -- 172.21.15.63:0/2647753058 shutdown_connections 2023-12-07T16:14:09.733 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.239+0000 7efe8aecd700 1 --2- 172.21.15.63:0/2647753058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe841039d0 0x7efe84103de0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:09.734 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.239+0000 7efe8aecd700 1 -- 172.21.15.63:0/2647753058 >> 172.21.15.63:0/2647753058 conn(0x7efe840fc0b0 msgr2=0x7efe840fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:09.734 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.239+0000 7efe8aecd700 1 -- 172.21.15.63:0/2647753058 shutdown_connections 2023-12-07T16:14:09.734 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.239+0000 7efe8aecd700 1 -- 172.21.15.63:0/2647753058 wait complete. 2023-12-07T16:14:09.734 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.239+0000 7efe8aecd700 1 Processor -- start 2023-12-07T16:14:09.734 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.239+0000 7efe8aecd700 1 -- start start 2023-12-07T16:14:09.734 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.240+0000 7efe8aecd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe841039d0 0x7efe84111150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:09.734 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.240+0000 7efe8aecd700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe84111690 con 0x7efe841039d0 2023-12-07T16:14:09.734 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.240+0000 7efe88c69700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe841039d0 0x7efe84111150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:09.734 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.240+0000 7efe88c69700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe841039d0 0x7efe84111150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57182/0 (socket says 172.21.15.63:57182) 2023-12-07T16:14:09.734 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.240+0000 7efe88c69700 1 -- 172.21.15.63:0/2611680565 learned_addr learned my addr 172.21.15.63:0/2611680565 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:09.734 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.240+0000 7efe88c69700 1 -- 172.21.15.63:0/2611680565 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe780094f0 con 0x7efe841039d0 2023-12-07T16:14:09.734 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.240+0000 7efe88c69700 1 --2- 172.21.15.63:0/2611680565 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe841039d0 0x7efe84111150 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efe78006b00 tx=0x7efe78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:09.734 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.240+0000 7efe817fa700 1 -- 172.21.15.63:0/2611680565 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe780109b0 con 0x7efe841039d0 2023-12-07T16:14:09.734 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.240+0000 7efe817fa700 1 -- 172.21.15.63:0/2611680565 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7efe78024440 con 0x7efe841039d0 2023-12-07T16:14:09.734 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.240+0000 7efe8aecd700 1 -- 172.21.15.63:0/2611680565 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe84111890 con 0x7efe841039d0 2023-12-07T16:14:09.735 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.240+0000 7efe817fa700 1 -- 172.21.15.63:0/2611680565 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe7801a5f0 con 0x7efe841039d0 2023-12-07T16:14:09.735 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.240+0000 7efe8aecd700 1 -- 172.21.15.63:0/2611680565 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe84111ca0 con 0x7efe841039d0 2023-12-07T16:14:09.735 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.241+0000 7efe817fa700 1 -- 172.21.15.63:0/2611680565 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7efe7801ab30 con 0x7efe841039d0 2023-12-07T16:14:09.735 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.241+0000 7efe817fa700 1 -- 172.21.15.63:0/2611680565 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7efe7802db90 con 0x7efe841039d0 2023-12-07T16:14:09.735 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.241+0000 7efe8aecd700 1 -- 172.21.15.63:0/2611680565 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe680052e0 con 0x7efe841039d0 2023-12-07T16:14:09.735 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.243+0000 7efe817fa700 1 -- 172.21.15.63:0/2611680565 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7efe78006d70 con 0x7efe841039d0 2023-12-07T16:14:09.735 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.317+0000 7efe8aecd700 1 -- 172.21.15.63:0/2611680565 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7efe68005860 con 0x7efe841039d0 2023-12-07T16:14:09.735 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.317+0000 7efe817fa700 1 -- 172.21.15.63:0/2611680565 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7efe7802ddf0 con 0x7efe841039d0 2023-12-07T16:14:09.735 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.318+0000 7efe8aecd700 1 -- 172.21.15.63:0/2611680565 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe841039d0 msgr2=0x7efe84111150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:09.735 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.318+0000 7efe8aecd700 1 --2- 172.21.15.63:0/2611680565 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe841039d0 0x7efe84111150 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efe78006b00 tx=0x7efe78009250 comp rx=0 tx=0).stop 2023-12-07T16:14:09.735 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.318+0000 7efe8aecd700 1 -- 172.21.15.63:0/2611680565 shutdown_connections 2023-12-07T16:14:09.735 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.318+0000 7efe8aecd700 1 --2- 172.21.15.63:0/2611680565 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe841039d0 0x7efe84111150 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:09.735 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.318+0000 7efe8aecd700 1 -- 172.21.15.63:0/2611680565 >> 172.21.15.63:0/2611680565 conn(0x7efe840fc0b0 msgr2=0x7efe840fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:09.735 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.318+0000 7efe8aecd700 1 -- 172.21.15.63:0/2611680565 shutdown_connections 2023-12-07T16:14:09.735 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:09.318+0000 7efe8aecd700 1 -- 172.21.15.63:0/2611680565 wait complete. 2023-12-07T16:14:09.735 INFO:teuthology.orchestra.run.smithi063.stdout:mgr not available, waiting (1/15)... 2023-12-07T16:14:09.921 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:09 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2611680565' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-07T16:14:12.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:12 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/3067258183' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-07T16:14:12.530 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-07T16:14:12.531 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2023-12-07T16:14:12.531 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsid": "8c493298-951b-11ee-95a2-87774f69a715", 2023-12-07T16:14:12.531 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "health": { 2023-12-07T16:14:12.531 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-07T16:14:12.531 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-07T16:14:12.531 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-07T16:14:12.531 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:12.531 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-07T16:14:12.531 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-07T16:14:12.532 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 0 2023-12-07T16:14:12.532 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2023-12-07T16:14:12.532 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-07T16:14:12.532 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "smithi063" 2023-12-07T16:14:12.532 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2023-12-07T16:14:12.532 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2023-12-07T16:14:12.532 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-07T16:14:12.532 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T16:14:12.532 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-07T16:14:12.532 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-07T16:14:12.532 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:12.532 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-07T16:14:12.532 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T16:14:12.533 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-07T16:14:12.533 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-07T16:14:12.533 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-07T16:14:12.540 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-07T16:14:12.540 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-07T16:14:12.540 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-07T16:14:12.540 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:12.540 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-07T16:14:12.541 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-07T16:14:12.541 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-07T16:14:12.541 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-07T16:14:12.541 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-07T16:14:12.541 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-07T16:14:12.541 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-07T16:14:12.541 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-07T16:14:12.541 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-07T16:14:12.541 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:12.541 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-07T16:14:12.541 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T16:14:12.541 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-07T16:14:12.541 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-07T16:14:12.541 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:12.542 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-07T16:14:12.542 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-07T16:14:12.542 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-07T16:14:12.542 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-07T16:14:12.542 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-07T16:14:12.542 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-07T16:14:12.542 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "restful" 2023-12-07T16:14:12.542 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2023-12-07T16:14:12.542 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-07T16:14:12.542 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:12.542 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-07T16:14:12.542 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T16:14:12.542 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modified": "2023-12-07T16:14:03.401744+0000", 2023-12-07T16:14:12.542 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-07T16:14:12.542 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:12.543 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-07T16:14:12.543 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2023-12-07T16:14:12.543 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.088+0000 7fc12b745700 1 Processor -- start 2023-12-07T16:14:12.543 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.089+0000 7fc12b745700 1 -- start start 2023-12-07T16:14:12.543 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.089+0000 7fc12b745700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1241011d0 0x7fc1241015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:12.543 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.089+0000 7fc12b745700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc124101b20 con 0x7fc1241011d0 2023-12-07T16:14:12.543 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.089+0000 7fc1294e1700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1241011d0 0x7fc1241015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:12.543 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.089+0000 7fc1294e1700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1241011d0 0x7fc1241015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49416/0 (socket says 172.21.15.63:49416) 2023-12-07T16:14:12.543 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.089+0000 7fc1294e1700 1 -- 172.21.15.63:0/1974257518 learned_addr learned my addr 172.21.15.63:0/1974257518 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:12.543 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.089+0000 7fc1294e1700 1 -- 172.21.15.63:0/1974257518 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc124101c60 con 0x7fc1241011d0 2023-12-07T16:14:12.543 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.090+0000 7fc1294e1700 1 --2- 172.21.15.63:0/1974257518 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1241011d0 0x7fc1241015e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc1200098e0 tx=0x7fc120009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8ae95d9594572b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:12.543 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.090+0000 7fc11bfff700 1 -- 172.21.15.63:0/1974257518 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc12000b860 con 0x7fc1241011d0 2023-12-07T16:14:12.543 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.090+0000 7fc11bfff700 1 -- 172.21.15.63:0/1974257518 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fc12000be30 con 0x7fc1241011d0 2023-12-07T16:14:12.543 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.090+0000 7fc11bfff700 1 -- 172.21.15.63:0/1974257518 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc120010380 con 0x7fc1241011d0 2023-12-07T16:14:12.544 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.090+0000 7fc12b745700 1 -- 172.21.15.63:0/1974257518 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1241011d0 msgr2=0x7fc1241015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:12.544 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.090+0000 7fc12b745700 1 --2- 172.21.15.63:0/1974257518 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1241011d0 0x7fc1241015e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc1200098e0 tx=0x7fc120009250 comp rx=0 tx=0).stop 2023-12-07T16:14:12.544 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.091+0000 7fc12b745700 1 -- 172.21.15.63:0/1974257518 shutdown_connections 2023-12-07T16:14:12.544 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.091+0000 7fc12b745700 1 --2- 172.21.15.63:0/1974257518 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1241011d0 0x7fc1241015e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:12.544 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.091+0000 7fc12b745700 1 -- 172.21.15.63:0/1974257518 >> 172.21.15.63:0/1974257518 conn(0x7fc1240fc970 msgr2=0x7fc1240fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:12.544 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.091+0000 7fc12b745700 1 -- 172.21.15.63:0/1974257518 shutdown_connections 2023-12-07T16:14:12.544 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.091+0000 7fc12b745700 1 -- 172.21.15.63:0/1974257518 wait complete. 2023-12-07T16:14:12.544 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.091+0000 7fc12b745700 1 Processor -- start 2023-12-07T16:14:12.544 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.091+0000 7fc12b745700 1 -- start start 2023-12-07T16:14:12.544 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.092+0000 7fc12b745700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1241011d0 0x7fc124113e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:12.544 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.092+0000 7fc12b745700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc124070f90 con 0x7fc1241011d0 2023-12-07T16:14:12.544 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.092+0000 7fc1294e1700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1241011d0 0x7fc124113e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:12.544 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.092+0000 7fc1294e1700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1241011d0 0x7fc124113e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49418/0 (socket says 172.21.15.63:49418) 2023-12-07T16:14:12.544 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.092+0000 7fc1294e1700 1 -- 172.21.15.63:0/3067258183 learned_addr learned my addr 172.21.15.63:0/3067258183 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:12.544 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.092+0000 7fc1294e1700 1 -- 172.21.15.63:0/3067258183 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1200094f0 con 0x7fc1241011d0 2023-12-07T16:14:12.544 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.092+0000 7fc1294e1700 1 --2- 172.21.15.63:0/3067258183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1241011d0 0x7fc124113e50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc120006b00 tx=0x7fc120009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:12.545 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.092+0000 7fc119ffb700 1 -- 172.21.15.63:0/3067258183 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1200109b0 con 0x7fc1241011d0 2023-12-07T16:14:12.545 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.092+0000 7fc119ffb700 1 -- 172.21.15.63:0/3067258183 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fc120024440 con 0x7fc1241011d0 2023-12-07T16:14:12.545 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.092+0000 7fc12b745700 1 -- 172.21.15.63:0/3067258183 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc124071190 con 0x7fc1241011d0 2023-12-07T16:14:12.545 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.092+0000 7fc119ffb700 1 -- 172.21.15.63:0/3067258183 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc12001a5f0 con 0x7fc1241011d0 2023-12-07T16:14:12.545 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.093+0000 7fc12b745700 1 -- 172.21.15.63:0/3067258183 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc124114550 con 0x7fc1241011d0 2023-12-07T16:14:12.545 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.093+0000 7fc119ffb700 1 -- 172.21.15.63:0/3067258183 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc12001aae0 con 0x7fc1241011d0 2023-12-07T16:14:12.545 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.093+0000 7fc119ffb700 1 -- 172.21.15.63:0/3067258183 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc12002db40 con 0x7fc1241011d0 2023-12-07T16:14:12.545 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.094+0000 7fc12b745700 1 -- 172.21.15.63:0/3067258183 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc12410a050 con 0x7fc1241011d0 2023-12-07T16:14:12.545 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.096+0000 7fc119ffb700 1 -- 172.21.15.63:0/3067258183 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc120006d70 con 0x7fc1241011d0 2023-12-07T16:14:12.545 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.169+0000 7fc12b745700 1 -- 172.21.15.63:0/3067258183 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fc12402b0e0 con 0x7fc1241011d0 2023-12-07T16:14:12.545 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.169+0000 7fc119ffb700 1 -- 172.21.15.63:0/3067258183 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fc120032030 con 0x7fc1241011d0 2023-12-07T16:14:12.545 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.170+0000 7fc12b745700 1 -- 172.21.15.63:0/3067258183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1241011d0 msgr2=0x7fc124113e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:12.545 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.170+0000 7fc12b745700 1 --2- 172.21.15.63:0/3067258183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1241011d0 0x7fc124113e50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc120006b00 tx=0x7fc120009250 comp rx=0 tx=0).stop 2023-12-07T16:14:12.545 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.170+0000 7fc12b745700 1 -- 172.21.15.63:0/3067258183 shutdown_connections 2023-12-07T16:14:12.545 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.170+0000 7fc12b745700 1 --2- 172.21.15.63:0/3067258183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1241011d0 0x7fc124113e50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:12.545 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.170+0000 7fc12b745700 1 -- 172.21.15.63:0/3067258183 >> 172.21.15.63:0/3067258183 conn(0x7fc1240fc970 msgr2=0x7fc1240fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:12.546 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.170+0000 7fc12b745700 1 -- 172.21.15.63:0/3067258183 shutdown_connections 2023-12-07T16:14:12.546 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:12.170+0000 7fc12b745700 1 -- 172.21.15.63:0/3067258183 wait complete. 2023-12-07T16:14:12.546 INFO:teuthology.orchestra.run.smithi063.stdout:mgr not available, waiting (2/15)... 2023-12-07T16:14:15.371 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:15 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/3678909520' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-07T16:14:15.426 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-07T16:14:15.426 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2023-12-07T16:14:15.426 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsid": "8c493298-951b-11ee-95a2-87774f69a715", 2023-12-07T16:14:15.426 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "health": { 2023-12-07T16:14:15.426 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-07T16:14:15.427 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-07T16:14:15.427 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-07T16:14:15.427 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:15.427 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-07T16:14:15.427 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-07T16:14:15.427 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 0 2023-12-07T16:14:15.427 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2023-12-07T16:14:15.427 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-07T16:14:15.427 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "smithi063" 2023-12-07T16:14:15.427 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2023-12-07T16:14:15.427 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2023-12-07T16:14:15.427 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-07T16:14:15.427 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T16:14:15.427 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-07T16:14:15.427 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-07T16:14:15.428 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:15.428 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-07T16:14:15.428 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T16:14:15.428 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-07T16:14:15.428 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-07T16:14:15.428 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-07T16:14:15.428 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-07T16:14:15.428 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-07T16:14:15.428 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-07T16:14:15.428 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:15.428 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-07T16:14:15.428 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-07T16:14:15.428 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-07T16:14:15.428 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-07T16:14:15.429 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-07T16:14:15.429 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-07T16:14:15.429 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-07T16:14:15.429 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-07T16:14:15.429 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-07T16:14:15.429 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:15.429 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-07T16:14:15.429 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T16:14:15.429 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-07T16:14:15.429 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-07T16:14:15.429 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:15.429 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-07T16:14:15.429 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-07T16:14:15.429 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-07T16:14:15.430 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-07T16:14:15.430 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-07T16:14:15.430 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-07T16:14:15.430 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "restful" 2023-12-07T16:14:15.430 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2023-12-07T16:14:15.430 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-07T16:14:15.430 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:15.430 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-07T16:14:15.430 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T16:14:15.430 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modified": "2023-12-07T16:14:03.401744+0000", 2023-12-07T16:14:15.430 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-07T16:14:15.430 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:15.431 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-07T16:14:15.431 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2023-12-07T16:14:15.431 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.943+0000 7f4b61ad0700 1 Processor -- start 2023-12-07T16:14:15.431 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.943+0000 7f4b61ad0700 1 -- start start 2023-12-07T16:14:15.431 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.943+0000 7f4b61ad0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b5c071000 0x7f4b5c104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:15.431 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.944+0000 7f4b61ad0700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c1053e0 con 0x7f4b5c071000 2023-12-07T16:14:15.431 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.944+0000 7f4b5b7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b5c071000 0x7f4b5c104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:15.431 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.944+0000 7f4b5b7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b5c071000 0x7f4b5c104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49420/0 (socket says 172.21.15.63:49420) 2023-12-07T16:14:15.431 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.944+0000 7f4b5b7fe700 1 -- 172.21.15.63:0/1054748107 learned_addr learned my addr 172.21.15.63:0/1054748107 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:15.431 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.944+0000 7f4b5b7fe700 1 -- 172.21.15.63:0/1054748107 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c105520 con 0x7f4b5c071000 2023-12-07T16:14:15.431 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.944+0000 7f4b5b7fe700 1 --2- 172.21.15.63:0/1054748107 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b5c071000 0x7f4b5c104ea0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c0098e0 tx=0x7f4b4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b5a4d337dc99f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:15.431 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.944+0000 7f4b5a7fc700 1 -- 172.21.15.63:0/1054748107 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4b4c00b860 con 0x7f4b5c071000 2023-12-07T16:14:15.431 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.944+0000 7f4b5a7fc700 1 -- 172.21.15.63:0/1054748107 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f4b4c00be30 con 0x7f4b5c071000 2023-12-07T16:14:15.432 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.944+0000 7f4b5a7fc700 1 -- 172.21.15.63:0/1054748107 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4b4c010380 con 0x7f4b5c071000 2023-12-07T16:14:15.432 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.945+0000 7f4b61ad0700 1 -- 172.21.15.63:0/1054748107 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b5c071000 msgr2=0x7f4b5c104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:15.432 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.945+0000 7f4b61ad0700 1 --2- 172.21.15.63:0/1054748107 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b5c071000 0x7f4b5c104ea0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c0098e0 tx=0x7f4b4c009250 comp rx=0 tx=0).stop 2023-12-07T16:14:15.432 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.945+0000 7f4b61ad0700 1 -- 172.21.15.63:0/1054748107 shutdown_connections 2023-12-07T16:14:15.432 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.945+0000 7f4b61ad0700 1 --2- 172.21.15.63:0/1054748107 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b5c071000 0x7f4b5c104ea0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:15.432 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.945+0000 7f4b61ad0700 1 -- 172.21.15.63:0/1054748107 >> 172.21.15.63:0/1054748107 conn(0x7f4b5c0fc970 msgr2=0x7f4b5c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:15.432 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.945+0000 7f4b61ad0700 1 -- 172.21.15.63:0/1054748107 shutdown_connections 2023-12-07T16:14:15.432 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.945+0000 7f4b61ad0700 1 -- 172.21.15.63:0/1054748107 wait complete. 2023-12-07T16:14:15.432 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.946+0000 7f4b61ad0700 1 Processor -- start 2023-12-07T16:14:15.432 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.946+0000 7f4b61ad0700 1 -- start start 2023-12-07T16:14:15.432 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.946+0000 7f4b61ad0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b5c071000 0x7f4b5c111160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:15.432 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.946+0000 7f4b61ad0700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c1116a0 con 0x7f4b5c071000 2023-12-07T16:14:15.432 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.946+0000 7f4b5b7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b5c071000 0x7f4b5c111160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:15.433 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.946+0000 7f4b5b7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b5c071000 0x7f4b5c111160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49430/0 (socket says 172.21.15.63:49430) 2023-12-07T16:14:15.433 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.946+0000 7f4b5b7fe700 1 -- 172.21.15.63:0/3678909520 learned_addr learned my addr 172.21.15.63:0/3678909520 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:15.433 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.947+0000 7f4b5b7fe700 1 -- 172.21.15.63:0/3678909520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c0094f0 con 0x7f4b5c071000 2023-12-07T16:14:15.433 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.947+0000 7f4b5b7fe700 1 --2- 172.21.15.63:0/3678909520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b5c071000 0x7f4b5c111160 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c006d40 tx=0x7f4b4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:15.433 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.947+0000 7f4b43fff700 1 -- 172.21.15.63:0/3678909520 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4b4c0109b0 con 0x7f4b5c071000 2023-12-07T16:14:15.433 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.947+0000 7f4b61ad0700 1 -- 172.21.15.63:0/3678909520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5c1118a0 con 0x7f4b5c071000 2023-12-07T16:14:15.433 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.947+0000 7f4b43fff700 1 -- 172.21.15.63:0/3678909520 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f4b4c024440 con 0x7f4b5c071000 2023-12-07T16:14:15.433 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.947+0000 7f4b43fff700 1 -- 172.21.15.63:0/3678909520 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4b4c01a5f0 con 0x7f4b5c071000 2023-12-07T16:14:15.433 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.947+0000 7f4b61ad0700 1 -- 172.21.15.63:0/3678909520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5c111cb0 con 0x7f4b5c071000 2023-12-07T16:14:15.433 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.948+0000 7f4b43fff700 1 -- 172.21.15.63:0/3678909520 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4b4c010d90 con 0x7f4b5c071000 2023-12-07T16:14:15.433 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.948+0000 7f4b43fff700 1 -- 172.21.15.63:0/3678909520 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f4b4c02d740 con 0x7f4b5c071000 2023-12-07T16:14:15.433 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.948+0000 7f4b61ad0700 1 -- 172.21.15.63:0/3678909520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b5c04bb80 con 0x7f4b5c071000 2023-12-07T16:14:15.433 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:14.950+0000 7f4b43fff700 1 -- 172.21.15.63:0/3678909520 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4b4c006d70 con 0x7f4b5c071000 2023-12-07T16:14:15.433 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:15.023+0000 7f4b61ad0700 1 -- 172.21.15.63:0/3678909520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f4b5c10ab60 con 0x7f4b5c071000 2023-12-07T16:14:15.433 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:15.023+0000 7f4b43fff700 1 -- 172.21.15.63:0/3678909520 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f4b4c024a30 con 0x7f4b5c071000 2023-12-07T16:14:15.434 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:15.024+0000 7f4b61ad0700 1 -- 172.21.15.63:0/3678909520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b5c071000 msgr2=0x7f4b5c111160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:15.434 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:15.024+0000 7f4b61ad0700 1 --2- 172.21.15.63:0/3678909520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b5c071000 0x7f4b5c111160 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c006d40 tx=0x7f4b4c009250 comp rx=0 tx=0).stop 2023-12-07T16:14:15.434 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:15.024+0000 7f4b61ad0700 1 -- 172.21.15.63:0/3678909520 shutdown_connections 2023-12-07T16:14:15.434 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:15.024+0000 7f4b61ad0700 1 --2- 172.21.15.63:0/3678909520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b5c071000 0x7f4b5c111160 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:15.434 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:15.024+0000 7f4b61ad0700 1 -- 172.21.15.63:0/3678909520 >> 172.21.15.63:0/3678909520 conn(0x7f4b5c0fc970 msgr2=0x7f4b5c0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:15.434 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:15.024+0000 7f4b61ad0700 1 -- 172.21.15.63:0/3678909520 shutdown_connections 2023-12-07T16:14:15.434 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:15.025+0000 7f4b61ad0700 1 -- 172.21.15.63:0/3678909520 wait complete. 2023-12-07T16:14:15.434 INFO:teuthology.orchestra.run.smithi063.stdout:mgr not available, waiting (3/15)... 2023-12-07T16:14:16.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:16 smithi063 ceph-mon[112095]: Activating manager daemon smithi063.yohyyx 2023-12-07T16:14:16.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:16 smithi063 ceph-mon[112095]: mgrmap e2: smithi063.yohyyx(active, starting, since 0.00278175s) 2023-12-07T16:14:16.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:16 smithi063 ceph-mon[112095]: from='mgr.14100 172.21.15.63:0/1512191965' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-07T16:14:16.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:16 smithi063 ceph-mon[112095]: from='mgr.14100 172.21.15.63:0/1512191965' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-07T16:14:16.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:16 smithi063 ceph-mon[112095]: from='mgr.14100 172.21.15.63:0/1512191965' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-07T16:14:16.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:16 smithi063 ceph-mon[112095]: from='mgr.14100 172.21.15.63:0/1512191965' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-07T16:14:16.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:16 smithi063 ceph-mon[112095]: from='mgr.14100 172.21.15.63:0/1512191965' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr metadata", "who": "smithi063.yohyyx", "id": "smithi063.yohyyx"}]: dispatch 2023-12-07T16:14:16.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:16 smithi063 ceph-mon[112095]: Manager daemon smithi063.yohyyx is now available 2023-12-07T16:14:16.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:16 smithi063 ceph-mon[112095]: from='mgr.14100 172.21.15.63:0/1512191965' entity='mgr.smithi063.yohyyx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.yohyyx/mirror_snapshot_schedule"}]: dispatch 2023-12-07T16:14:16.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:16 smithi063 ceph-mon[112095]: from='mgr.14100 172.21.15.63:0/1512191965' entity='mgr.smithi063.yohyyx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.yohyyx/trash_purge_schedule"}]: dispatch 2023-12-07T16:14:16.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:16 smithi063 ceph-mon[112095]: from='mgr.14100 172.21.15.63:0/1512191965' entity='mgr.smithi063.yohyyx' 2023-12-07T16:14:16.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:16 smithi063 ceph-mon[112095]: from='mgr.14100 172.21.15.63:0/1512191965' entity='mgr.smithi063.yohyyx' 2023-12-07T16:14:16.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:16 smithi063 ceph-mon[112095]: from='mgr.14100 172.21.15.63:0/1512191965' entity='mgr.smithi063.yohyyx' 2023-12-07T16:14:17.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:17 smithi063 ceph-mon[112095]: mgrmap e3: smithi063.yohyyx(active, since 1.00719s) 2023-12-07T16:14:18.502 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-07T16:14:18.505 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2023-12-07T16:14:18.505 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsid": "8c493298-951b-11ee-95a2-87774f69a715", 2023-12-07T16:14:18.505 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "health": { 2023-12-07T16:14:18.505 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-07T16:14:18.505 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-07T16:14:18.505 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-07T16:14:18.505 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:18.505 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-07T16:14:18.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-07T16:14:18.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 0 2023-12-07T16:14:18.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2023-12-07T16:14:18.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-07T16:14:18.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "smithi063" 2023-12-07T16:14:18.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2023-12-07T16:14:18.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2023-12-07T16:14:18.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-07T16:14:18.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T16:14:18.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-07T16:14:18.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-07T16:14:18.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:18.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-07T16:14:18.507 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T16:14:18.507 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-07T16:14:18.507 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-07T16:14:18.507 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-07T16:14:18.515 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-07T16:14:18.515 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-07T16:14:18.515 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-07T16:14:18.515 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:18.515 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-07T16:14:18.515 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-07T16:14:18.516 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-07T16:14:18.516 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-07T16:14:18.516 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-07T16:14:18.516 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-07T16:14:18.516 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-07T16:14:18.516 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-07T16:14:18.516 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-07T16:14:18.516 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:18.516 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-07T16:14:18.516 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T16:14:18.516 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-07T16:14:18.516 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-07T16:14:18.516 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:18.516 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-07T16:14:18.516 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-07T16:14:18.517 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-07T16:14:18.517 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-07T16:14:18.517 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-07T16:14:18.517 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-07T16:14:18.517 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "restful" 2023-12-07T16:14:18.517 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2023-12-07T16:14:18.517 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-07T16:14:18.517 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:18.517 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-07T16:14:18.517 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T16:14:18.517 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modified": "2023-12-07T16:14:03.401744+0000", 2023-12-07T16:14:18.517 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-07T16:14:18.517 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2023-12-07T16:14:18.517 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-07T16:14:18.517 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2023-12-07T16:14:18.518 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.807+0000 7f1e084ad700 1 Processor -- start 2023-12-07T16:14:18.518 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.807+0000 7f1e084ad700 1 -- start start 2023-12-07T16:14:18.518 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.808+0000 7f1e084ad700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e00102900 0x7f1e00102d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:18.518 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.808+0000 7f1e084ad700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e00103250 con 0x7f1e00102900 2023-12-07T16:14:18.518 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.808+0000 7f1e06249700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e00102900 0x7f1e00102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:18.518 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.808+0000 7f1e06249700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e00102900 0x7f1e00102d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49516/0 (socket says 172.21.15.63:49516) 2023-12-07T16:14:18.518 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.808+0000 7f1e06249700 1 -- 172.21.15.63:0/1898525671 learned_addr learned my addr 172.21.15.63:0/1898525671 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:18.518 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.808+0000 7f1e06249700 1 -- 172.21.15.63:0/1898525671 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e00103390 con 0x7f1e00102900 2023-12-07T16:14:18.518 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.808+0000 7f1e06249700 1 --2- 172.21.15.63:0/1898525671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e00102900 0x7f1e00102d10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0098e0 tx=0x7f1dfc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be89abcf86bbf80 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:18.518 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.809+0000 7f1e05247700 1 -- 172.21.15.63:0/1898525671 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1dfc00b860 con 0x7f1e00102900 2023-12-07T16:14:18.518 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.809+0000 7f1e05247700 1 -- 172.21.15.63:0/1898525671 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f1dfc00be30 con 0x7f1e00102900 2023-12-07T16:14:18.518 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.809+0000 7f1e05247700 1 -- 172.21.15.63:0/1898525671 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1dfc010380 con 0x7f1e00102900 2023-12-07T16:14:18.518 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.809+0000 7f1e084ad700 1 -- 172.21.15.63:0/1898525671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e00102900 msgr2=0x7f1e00102d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.809+0000 7f1e084ad700 1 --2- 172.21.15.63:0/1898525671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e00102900 0x7f1e00102d10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0098e0 tx=0x7f1dfc009250 comp rx=0 tx=0).stop 2023-12-07T16:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.809+0000 7f1e084ad700 1 -- 172.21.15.63:0/1898525671 shutdown_connections 2023-12-07T16:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.809+0000 7f1e084ad700 1 --2- 172.21.15.63:0/1898525671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e00102900 0x7f1e00102d10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.809+0000 7f1e084ad700 1 -- 172.21.15.63:0/1898525671 >> 172.21.15.63:0/1898525671 conn(0x7f1e000fc0b0 msgr2=0x7f1e000fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.809+0000 7f1e084ad700 1 -- 172.21.15.63:0/1898525671 shutdown_connections 2023-12-07T16:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.809+0000 7f1e084ad700 1 -- 172.21.15.63:0/1898525671 wait complete. 2023-12-07T16:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.810+0000 7f1e084ad700 1 Processor -- start 2023-12-07T16:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.810+0000 7f1e084ad700 1 -- start start 2023-12-07T16:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.810+0000 7f1e084ad700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e00102900 0x7f1e00113320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.810+0000 7f1e084ad700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e00113860 con 0x7f1e00102900 2023-12-07T16:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.810+0000 7f1e06249700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e00102900 0x7f1e00113320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.810+0000 7f1e06249700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e00102900 0x7f1e00113320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49526/0 (socket says 172.21.15.63:49526) 2023-12-07T16:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.810+0000 7f1e06249700 1 -- 172.21.15.63:0/4289419968 learned_addr learned my addr 172.21.15.63:0/4289419968 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.811+0000 7f1e06249700 1 -- 172.21.15.63:0/4289419968 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc0094f0 con 0x7f1e00102900 2023-12-07T16:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.811+0000 7f1e06249700 1 --2- 172.21.15.63:0/4289419968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e00102900 0x7f1e00113320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc006b00 tx=0x7f1dfc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.811+0000 7f1df6ffd700 1 -- 172.21.15.63:0/4289419968 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1dfc0109b0 con 0x7f1e00102900 2023-12-07T16:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.811+0000 7f1df6ffd700 1 -- 172.21.15.63:0/4289419968 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f1dfc024440 con 0x7f1e00102900 2023-12-07T16:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.811+0000 7f1e084ad700 1 -- 172.21.15.63:0/4289419968 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e00113a60 con 0x7f1e00102900 2023-12-07T16:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.811+0000 7f1df6ffd700 1 -- 172.21.15.63:0/4289419968 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1dfc01a5f0 con 0x7f1e00102900 2023-12-07T16:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.811+0000 7f1e084ad700 1 -- 172.21.15.63:0/4289419968 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e00113e70 con 0x7f1e00102900 2023-12-07T16:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.812+0000 7f1df6ffd700 1 -- 172.21.15.63:0/4289419968 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 3) v1 ==== 43164+0+0 (secure 0 0 0) 0x7f1dfc024990 con 0x7f1e00102900 2023-12-07T16:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.812+0000 7f1df6ffd700 1 --2- 172.21.15.63:0/4289419968 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f1dec036470 0x7f1dec038920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.812+0000 7f1e084ad700 1 -- 172.21.15.63:0/4289419968 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e0004bb80 con 0x7f1e00102900 2023-12-07T16:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.812+0000 7f1df6ffd700 1 -- 172.21.15.63:0/4289419968 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f1dfc04a300 con 0x7f1e00102900 2023-12-07T16:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.812+0000 7f1e05a48700 1 --2- 172.21.15.63:0/4289419968 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f1dec036470 0x7f1dec038920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.812+0000 7f1e05a48700 1 --2- 172.21.15.63:0/4289419968 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f1dec036470 0x7f1dec038920 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1df0009990 tx=0x7f1df0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:17.817+0000 7f1df6ffd700 1 -- 172.21.15.63:0/4289419968 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1dfc006d70 con 0x7f1e00102900 2023-12-07T16:14:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.085+0000 7f1e084ad700 1 -- 172.21.15.63:0/4289419968 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f1e0010d160 con 0x7f1e00102900 2023-12-07T16:14:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.086+0000 7f1df6ffd700 1 -- 172.21.15.63:0/4289419968 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f1dfc0233a0 con 0x7f1e00102900 2023-12-07T16:14:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.087+0000 7f1e084ad700 1 -- 172.21.15.63:0/4289419968 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f1dec036470 msgr2=0x7f1dec038920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.087+0000 7f1e084ad700 1 --2- 172.21.15.63:0/4289419968 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f1dec036470 0x7f1dec038920 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1df0009990 tx=0x7f1df0006e40 comp rx=0 tx=0).stop 2023-12-07T16:14:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.087+0000 7f1e084ad700 1 -- 172.21.15.63:0/4289419968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e00102900 msgr2=0x7f1e00113320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.087+0000 7f1e084ad700 1 --2- 172.21.15.63:0/4289419968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e00102900 0x7f1e00113320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc006b00 tx=0x7f1dfc009250 comp rx=0 tx=0).stop 2023-12-07T16:14:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.088+0000 7f1e084ad700 1 -- 172.21.15.63:0/4289419968 shutdown_connections 2023-12-07T16:14:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.088+0000 7f1e084ad700 1 --2- 172.21.15.63:0/4289419968 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f1dec036470 0x7f1dec038920 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.088+0000 7f1e084ad700 1 --2- 172.21.15.63:0/4289419968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e00102900 0x7f1e00113320 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.088+0000 7f1e084ad700 1 -- 172.21.15.63:0/4289419968 >> 172.21.15.63:0/4289419968 conn(0x7f1e000fc0b0 msgr2=0x7f1e000fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.088+0000 7f1e084ad700 1 -- 172.21.15.63:0/4289419968 shutdown_connections 2023-12-07T16:14:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.088+0000 7f1e084ad700 1 -- 172.21.15.63:0/4289419968 wait complete. 2023-12-07T16:14:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:mgr is available 2023-12-07T16:14:18.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:18 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/4289419968' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-07T16:14:19.450 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-07T16:14:19.450 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout [global] 2023-12-07T16:14:19.451 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout fsid = 8c493298-951b-11ee-95a2-87774f69a715 2023-12-07T16:14:19.451 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-07T16:14:19.451 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-07T16:14:19.451 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-07T16:14:19.451 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-07T16:14:19.451 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-07T16:14:19.451 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-07T16:14:19.451 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-07T16:14:19.451 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2023-12-07T16:14:19.451 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout [osd] 2023-12-07T16:14:19.451 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-07T16:14:19.451 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-07T16:14:19.451 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-07T16:14:19.451 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-07T16:14:19.451 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-07T16:14:19.451 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.879+0000 7f8d2383f700 1 Processor -- start 2023-12-07T16:14:19.452 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.879+0000 7f8d2383f700 1 -- start start 2023-12-07T16:14:19.452 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.879+0000 7f8d2383f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d1c070fc0 0x7f8d1c104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:19.452 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.879+0000 7f8d2383f700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c105420 con 0x7f8d1c070fc0 2023-12-07T16:14:19.452 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.879+0000 7f8d215db700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d1c070fc0 0x7f8d1c104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:19.452 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.879+0000 7f8d215db700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d1c070fc0 0x7f8d1c104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49536/0 (socket says 172.21.15.63:49536) 2023-12-07T16:14:19.452 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.879+0000 7f8d215db700 1 -- 172.21.15.63:0/109669192 learned_addr learned my addr 172.21.15.63:0/109669192 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:19.452 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.879+0000 7f8d215db700 1 -- 172.21.15.63:0/109669192 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1c105560 con 0x7f8d1c070fc0 2023-12-07T16:14:19.452 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.880+0000 7f8d215db700 1 --2- 172.21.15.63:0/109669192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d1c070fc0 0x7f8d1c104ee0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8d180098e0 tx=0x7f8d18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2829a876ed7cc8f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:19.452 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.880+0000 7f8d0ffff700 1 -- 172.21.15.63:0/109669192 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d1800b860 con 0x7f8d1c070fc0 2023-12-07T16:14:19.452 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.880+0000 7f8d0ffff700 1 -- 172.21.15.63:0/109669192 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f8d1800be30 con 0x7f8d1c070fc0 2023-12-07T16:14:19.452 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.880+0000 7f8d0ffff700 1 -- 172.21.15.63:0/109669192 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d18010380 con 0x7f8d1c070fc0 2023-12-07T16:14:19.452 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.880+0000 7f8d2383f700 1 -- 172.21.15.63:0/109669192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d1c070fc0 msgr2=0x7f8d1c104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:19.452 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.880+0000 7f8d2383f700 1 --2- 172.21.15.63:0/109669192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d1c070fc0 0x7f8d1c104ee0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8d180098e0 tx=0x7f8d18009250 comp rx=0 tx=0).stop 2023-12-07T16:14:19.452 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.880+0000 7f8d2383f700 1 -- 172.21.15.63:0/109669192 shutdown_connections 2023-12-07T16:14:19.452 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.880+0000 7f8d2383f700 1 --2- 172.21.15.63:0/109669192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d1c070fc0 0x7f8d1c104ee0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:19.452 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.880+0000 7f8d2383f700 1 -- 172.21.15.63:0/109669192 >> 172.21.15.63:0/109669192 conn(0x7f8d1c0fc970 msgr2=0x7f8d1c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:19.453 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.880+0000 7f8d2383f700 1 -- 172.21.15.63:0/109669192 shutdown_connections 2023-12-07T16:14:19.453 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.880+0000 7f8d2383f700 1 -- 172.21.15.63:0/109669192 wait complete. 2023-12-07T16:14:19.453 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.881+0000 7f8d2383f700 1 Processor -- start 2023-12-07T16:14:19.453 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.881+0000 7f8d2383f700 1 -- start start 2023-12-07T16:14:19.453 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.881+0000 7f8d2383f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d1c070fc0 0x7f8d1c111180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:19.453 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.881+0000 7f8d2383f700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c1116c0 con 0x7f8d1c070fc0 2023-12-07T16:14:19.453 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.881+0000 7f8d215db700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d1c070fc0 0x7f8d1c111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:19.453 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.881+0000 7f8d215db700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d1c070fc0 0x7f8d1c111180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49542/0 (socket says 172.21.15.63:49542) 2023-12-07T16:14:19.453 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.881+0000 7f8d215db700 1 -- 172.21.15.63:0/2412466812 learned_addr learned my addr 172.21.15.63:0/2412466812 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:19.453 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.882+0000 7f8d215db700 1 -- 172.21.15.63:0/2412466812 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d180094f0 con 0x7f8d1c070fc0 2023-12-07T16:14:19.453 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.882+0000 7f8d215db700 1 --2- 172.21.15.63:0/2412466812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d1c070fc0 0x7f8d1c111180 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8d18006d40 tx=0x7f8d18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:19.453 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.882+0000 7f8d0dffb700 1 -- 172.21.15.63:0/2412466812 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d180109b0 con 0x7f8d1c070fc0 2023-12-07T16:14:19.453 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.882+0000 7f8d2383f700 1 -- 172.21.15.63:0/2412466812 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d1c1118c0 con 0x7f8d1c070fc0 2023-12-07T16:14:19.453 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.882+0000 7f8d0dffb700 1 -- 172.21.15.63:0/2412466812 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f8d18024440 con 0x7f8d1c070fc0 2023-12-07T16:14:19.453 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.882+0000 7f8d0dffb700 1 -- 172.21.15.63:0/2412466812 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d1801a5f0 con 0x7f8d1c070fc0 2023-12-07T16:14:19.453 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.882+0000 7f8d2383f700 1 -- 172.21.15.63:0/2412466812 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1c111cd0 con 0x7f8d1c070fc0 2023-12-07T16:14:19.454 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.883+0000 7f8d0dffb700 1 -- 172.21.15.63:0/2412466812 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f8d1801a870 con 0x7f8d1c070fc0 2023-12-07T16:14:19.454 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.883+0000 7f8d0dffb700 1 --2- 172.21.15.63:0/2412466812 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f8d080365a0 0x7f8d08038a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:19.454 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.883+0000 7f8d0dffb700 1 -- 172.21.15.63:0/2412466812 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8d1804a430 con 0x7f8d1c070fc0 2023-12-07T16:14:19.454 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.883+0000 7f8d2383f700 1 -- 172.21.15.63:0/2412466812 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d1c04bb80 con 0x7f8d1c070fc0 2023-12-07T16:14:19.454 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.883+0000 7f8d20dda700 1 --2- 172.21.15.63:0/2412466812 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f8d080365a0 0x7f8d08038a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:19.454 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.884+0000 7f8d20dda700 1 --2- 172.21.15.63:0/2412466812 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f8d080365a0 0x7f8d08038a50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8d10009990 tx=0x7f8d10006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:19.454 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:18.889+0000 7f8d0dffb700 1 -- 172.21.15.63:0/2412466812 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8d1802d3f0 con 0x7f8d1c070fc0 2023-12-07T16:14:19.454 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.079+0000 7f8d2383f700 1 -- 172.21.15.63:0/2412466812 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f8d1c106310 con 0x7f8d1c070fc0 2023-12-07T16:14:19.454 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.080+0000 7f8d0dffb700 1 -- 172.21.15.63:0/2412466812 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f8d18048020 con 0x7f8d1c070fc0 2023-12-07T16:14:19.454 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.082+0000 7f8d2383f700 1 -- 172.21.15.63:0/2412466812 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f8d080365a0 msgr2=0x7f8d08038a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:19.454 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.082+0000 7f8d2383f700 1 --2- 172.21.15.63:0/2412466812 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f8d080365a0 0x7f8d08038a50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8d10009990 tx=0x7f8d10006e40 comp rx=0 tx=0).stop 2023-12-07T16:14:19.454 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.082+0000 7f8d2383f700 1 -- 172.21.15.63:0/2412466812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d1c070fc0 msgr2=0x7f8d1c111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:19.454 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.082+0000 7f8d2383f700 1 --2- 172.21.15.63:0/2412466812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d1c070fc0 0x7f8d1c111180 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8d18006d40 tx=0x7f8d18009250 comp rx=0 tx=0).stop 2023-12-07T16:14:19.454 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.082+0000 7f8d2383f700 1 -- 172.21.15.63:0/2412466812 shutdown_connections 2023-12-07T16:14:19.455 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.082+0000 7f8d2383f700 1 --2- 172.21.15.63:0/2412466812 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f8d080365a0 0x7f8d08038a50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:19.455 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.082+0000 7f8d2383f700 1 --2- 172.21.15.63:0/2412466812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d1c070fc0 0x7f8d1c111180 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:19.455 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.082+0000 7f8d2383f700 1 -- 172.21.15.63:0/2412466812 >> 172.21.15.63:0/2412466812 conn(0x7f8d1c0fc970 msgr2=0x7f8d1c0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:19.455 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.082+0000 7f8d2383f700 1 -- 172.21.15.63:0/2412466812 shutdown_connections 2023-12-07T16:14:19.455 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.082+0000 7f8d2383f700 1 -- 172.21.15.63:0/2412466812 wait complete. 2023-12-07T16:14:19.455 INFO:teuthology.orchestra.run.smithi063.stdout:Enabling cephadm module... 2023-12-07T16:14:19.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:19 smithi063 ceph-mon[112095]: mgrmap e4: smithi063.yohyyx(active, since 3s) 2023-12-07T16:14:19.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:19 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2412466812' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-07T16:14:20.882 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:20 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2282185871' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-12-07T16:14:20.959 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.810+0000 7ff2e5c14700 1 Processor -- start 2023-12-07T16:14:20.959 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.810+0000 7ff2e5c14700 1 -- start start 2023-12-07T16:14:20.959 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.810+0000 7ff2e5c14700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2e0071000 0x7ff2e0104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:20.959 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.810+0000 7ff2e5c14700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e01053e0 con 0x7ff2e0071000 2023-12-07T16:14:20.959 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.810+0000 7ff2df7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2e0071000 0x7ff2e0104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:20.959 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.810+0000 7ff2df7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2e0071000 0x7ff2e0104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40798/0 (socket says 172.21.15.63:40798) 2023-12-07T16:14:20.959 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.810+0000 7ff2df7fe700 1 -- 172.21.15.63:0/489905985 learned_addr learned my addr 172.21.15.63:0/489905985 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:20.959 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.811+0000 7ff2df7fe700 1 -- 172.21.15.63:0/489905985 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e0105520 con 0x7ff2e0071000 2023-12-07T16:14:20.959 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.811+0000 7ff2df7fe700 1 --2- 172.21.15.63:0/489905985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2e0071000 0x7ff2e0104ea0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00098e0 tx=0x7ff2d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa0fca0d3d2362a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:20.959 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.811+0000 7ff2de7fc700 1 -- 172.21.15.63:0/489905985 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2d000b860 con 0x7ff2e0071000 2023-12-07T16:14:20.959 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.811+0000 7ff2de7fc700 1 -- 172.21.15.63:0/489905985 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7ff2d000be30 con 0x7ff2e0071000 2023-12-07T16:14:20.959 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.811+0000 7ff2de7fc700 1 -- 172.21.15.63:0/489905985 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2d0010380 con 0x7ff2e0071000 2023-12-07T16:14:20.959 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.811+0000 7ff2e5c14700 1 -- 172.21.15.63:0/489905985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2e0071000 msgr2=0x7ff2e0104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:20.960 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.811+0000 7ff2e5c14700 1 --2- 172.21.15.63:0/489905985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2e0071000 0x7ff2e0104ea0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00098e0 tx=0x7ff2d0009250 comp rx=0 tx=0).stop 2023-12-07T16:14:20.960 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.812+0000 7ff2e5c14700 1 -- 172.21.15.63:0/489905985 shutdown_connections 2023-12-07T16:14:20.960 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.812+0000 7ff2e5c14700 1 --2- 172.21.15.63:0/489905985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2e0071000 0x7ff2e0104ea0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:20.960 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.812+0000 7ff2e5c14700 1 -- 172.21.15.63:0/489905985 >> 172.21.15.63:0/489905985 conn(0x7ff2e00fc970 msgr2=0x7ff2e00fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:20.960 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.812+0000 7ff2e5c14700 1 -- 172.21.15.63:0/489905985 shutdown_connections 2023-12-07T16:14:20.960 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.812+0000 7ff2e5c14700 1 -- 172.21.15.63:0/489905985 wait complete. 2023-12-07T16:14:20.960 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.812+0000 7ff2e5c14700 1 Processor -- start 2023-12-07T16:14:20.960 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.812+0000 7ff2e5c14700 1 -- start start 2023-12-07T16:14:20.960 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.813+0000 7ff2e5c14700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2e0071000 0x7ff2e0111180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:20.960 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.813+0000 7ff2e5c14700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e01116c0 con 0x7ff2e0071000 2023-12-07T16:14:20.960 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.813+0000 7ff2df7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2e0071000 0x7ff2e0111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:20.961 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.813+0000 7ff2df7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2e0071000 0x7ff2e0111180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40810/0 (socket says 172.21.15.63:40810) 2023-12-07T16:14:20.961 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.813+0000 7ff2df7fe700 1 -- 172.21.15.63:0/2282185871 learned_addr learned my addr 172.21.15.63:0/2282185871 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:20.961 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.813+0000 7ff2df7fe700 1 -- 172.21.15.63:0/2282185871 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d00094f0 con 0x7ff2e0071000 2023-12-07T16:14:20.961 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.813+0000 7ff2df7fe700 1 --2- 172.21.15.63:0/2282185871 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2e0071000 0x7ff2e0111180 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000ba90 tx=0x7ff2d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:20.961 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.813+0000 7ff2c7fff700 1 -- 172.21.15.63:0/2282185871 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2d0010ad0 con 0x7ff2e0071000 2023-12-07T16:14:20.961 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.813+0000 7ff2c7fff700 1 -- 172.21.15.63:0/2282185871 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7ff2d0010c30 con 0x7ff2e0071000 2023-12-07T16:14:20.961 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.813+0000 7ff2c7fff700 1 -- 172.21.15.63:0/2282185871 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2d001a430 con 0x7ff2e0071000 2023-12-07T16:14:20.961 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.813+0000 7ff2e5c14700 1 -- 172.21.15.63:0/2282185871 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e01118c0 con 0x7ff2e0071000 2023-12-07T16:14:20.961 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.813+0000 7ff2e5c14700 1 -- 172.21.15.63:0/2282185871 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e0111cd0 con 0x7ff2e0071000 2023-12-07T16:14:20.961 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.814+0000 7ff2c7fff700 1 -- 172.21.15.63:0/2282185871 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7ff2d0024430 con 0x7ff2e0071000 2023-12-07T16:14:20.962 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.814+0000 7ff2e5c14700 1 -- 172.21.15.63:0/2282185871 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e004bb80 con 0x7ff2e0071000 2023-12-07T16:14:20.962 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.814+0000 7ff2c7fff700 1 --2- 172.21.15.63:0/2282185871 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7ff2c80365f0 0x7ff2c8038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:20.962 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.815+0000 7ff2c7fff700 1 -- 172.21.15.63:0/2282185871 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff2d004a400 con 0x7ff2e0071000 2023-12-07T16:14:20.962 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.815+0000 7ff2deffd700 1 --2- 172.21.15.63:0/2282185871 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7ff2c80365f0 0x7ff2c8038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:20.962 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.815+0000 7ff2deffd700 1 --2- 172.21.15.63:0/2282185871 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7ff2c80365f0 0x7ff2c8038aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4009990 tx=0x7ff2d4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:20.962 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:19.819+0000 7ff2c7fff700 1 -- 172.21.15.63:0/2282185871 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff2d0023570 con 0x7ff2e0071000 2023-12-07T16:14:20.962 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:20.065+0000 7ff2e5c14700 1 -- 172.21.15.63:0/2282185871 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7ff2e010af40 con 0x7ff2e0071000 2023-12-07T16:14:20.962 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:20.536+0000 7ff2c7fff700 1 -- 172.21.15.63:0/2282185871 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7ff2d0019cb0 con 0x7ff2e0071000 2023-12-07T16:14:20.962 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:20.538+0000 7ff2c7fff700 1 -- 172.21.15.63:0/2282185871 <== mon.0 v2:172.21.15.63:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7ff2d000f2e0 con 0x7ff2e0071000 2023-12-07T16:14:20.962 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:20.540+0000 7ff2e5c14700 1 -- 172.21.15.63:0/2282185871 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7ff2c80365f0 msgr2=0x7ff2c8038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:20.962 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:20.540+0000 7ff2e5c14700 1 --2- 172.21.15.63:0/2282185871 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7ff2c80365f0 0x7ff2c8038aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4009990 tx=0x7ff2d4006e40 comp rx=0 tx=0).stop 2023-12-07T16:14:20.962 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:20.540+0000 7ff2e5c14700 1 -- 172.21.15.63:0/2282185871 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2e0071000 msgr2=0x7ff2e0111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:20.962 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:20.540+0000 7ff2e5c14700 1 --2- 172.21.15.63:0/2282185871 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2e0071000 0x7ff2e0111180 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000ba90 tx=0x7ff2d0009250 comp rx=0 tx=0).stop 2023-12-07T16:14:20.963 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:20.540+0000 7ff2e5c14700 1 -- 172.21.15.63:0/2282185871 shutdown_connections 2023-12-07T16:14:20.963 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:20.540+0000 7ff2e5c14700 1 --2- 172.21.15.63:0/2282185871 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7ff2c80365f0 0x7ff2c8038aa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:20.963 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:20.540+0000 7ff2e5c14700 1 --2- 172.21.15.63:0/2282185871 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2e0071000 0x7ff2e0111180 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:20.963 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:20.540+0000 7ff2e5c14700 1 -- 172.21.15.63:0/2282185871 >> 172.21.15.63:0/2282185871 conn(0x7ff2e00fc970 msgr2=0x7ff2e00fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:20.963 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:20.540+0000 7ff2e5c14700 1 -- 172.21.15.63:0/2282185871 shutdown_connections 2023-12-07T16:14:20.963 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:20.540+0000 7ff2e5c14700 1 -- 172.21.15.63:0/2282185871 wait complete. 2023-12-07T16:14:21.784 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:21 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2282185871' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-12-07T16:14:21.784 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:21 smithi063 ceph-mon[112095]: mgrmap e5: smithi063.yohyyx(active, since 5s) 2023-12-07T16:14:22.040 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2023-12-07T16:14:22.040 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-12-07T16:14:22.040 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-07T16:14:22.040 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "active_name": "smithi063.yohyyx", 2023-12-07T16:14:22.040 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-07T16:14:22.040 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2023-12-07T16:14:22.041 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.356+0000 7fc440c48700 1 Processor -- start 2023-12-07T16:14:22.041 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.356+0000 7fc440c48700 1 -- start start 2023-12-07T16:14:22.041 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.356+0000 7fc440c48700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc43c071000 0x7fc43c104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:22.041 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.356+0000 7fc440c48700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c1053e0 con 0x7fc43c071000 2023-12-07T16:14:22.041 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.356+0000 7fc43a59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc43c071000 0x7fc43c104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:22.041 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.356+0000 7fc43a59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc43c071000 0x7fc43c104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40834/0 (socket says 172.21.15.63:40834) 2023-12-07T16:14:22.041 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.356+0000 7fc43a59c700 1 -- 172.21.15.63:0/3813102337 learned_addr learned my addr 172.21.15.63:0/3813102337 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:22.041 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.356+0000 7fc43a59c700 1 -- 172.21.15.63:0/3813102337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c105520 con 0x7fc43c071000 2023-12-07T16:14:22.041 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.357+0000 7fc43a59c700 1 --2- 172.21.15.63:0/3813102337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc43c071000 0x7fc43c104ea0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0098e0 tx=0x7fc42c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248ec659a0c5cb2b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:22.041 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.357+0000 7fc43959a700 1 -- 172.21.15.63:0/3813102337 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc42c00b860 con 0x7fc43c071000 2023-12-07T16:14:22.041 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.357+0000 7fc43959a700 1 -- 172.21.15.63:0/3813102337 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fc42c00be30 con 0x7fc43c071000 2023-12-07T16:14:22.041 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.357+0000 7fc43959a700 1 -- 172.21.15.63:0/3813102337 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc42c010380 con 0x7fc43c071000 2023-12-07T16:14:22.041 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.357+0000 7fc440c48700 1 -- 172.21.15.63:0/3813102337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc43c071000 msgr2=0x7fc43c104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:22.041 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.357+0000 7fc440c48700 1 --2- 172.21.15.63:0/3813102337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc43c071000 0x7fc43c104ea0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0098e0 tx=0x7fc42c009250 comp rx=0 tx=0).stop 2023-12-07T16:14:22.041 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.358+0000 7fc440c48700 1 -- 172.21.15.63:0/3813102337 shutdown_connections 2023-12-07T16:14:22.042 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.358+0000 7fc440c48700 1 --2- 172.21.15.63:0/3813102337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc43c071000 0x7fc43c104ea0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:22.042 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.358+0000 7fc440c48700 1 -- 172.21.15.63:0/3813102337 >> 172.21.15.63:0/3813102337 conn(0x7fc43c0fc970 msgr2=0x7fc43c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:22.042 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.358+0000 7fc440c48700 1 -- 172.21.15.63:0/3813102337 shutdown_connections 2023-12-07T16:14:22.042 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.358+0000 7fc440c48700 1 -- 172.21.15.63:0/3813102337 wait complete. 2023-12-07T16:14:22.042 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.358+0000 7fc440c48700 1 Processor -- start 2023-12-07T16:14:22.042 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.358+0000 7fc440c48700 1 -- start start 2023-12-07T16:14:22.042 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.358+0000 7fc440c48700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc43c071000 0x7fc43c102920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:22.042 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.358+0000 7fc440c48700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c100da0 con 0x7fc43c071000 2023-12-07T16:14:22.042 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.359+0000 7fc43a59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc43c071000 0x7fc43c102920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:22.042 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.359+0000 7fc43a59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc43c071000 0x7fc43c102920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40844/0 (socket says 172.21.15.63:40844) 2023-12-07T16:14:22.042 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.359+0000 7fc43a59c700 1 -- 172.21.15.63:0/3124748863 learned_addr learned my addr 172.21.15.63:0/3124748863 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:22.042 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.359+0000 7fc43a59c700 1 -- 172.21.15.63:0/3124748863 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42c0094f0 con 0x7fc43c071000 2023-12-07T16:14:22.042 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.359+0000 7fc43a59c700 1 --2- 172.21.15.63:0/3124748863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc43c071000 0x7fc43c102920 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc42c006b00 tx=0x7fc42c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:22.042 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.359+0000 7fc42affd700 1 -- 172.21.15.63:0/3124748863 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc42c010a80 con 0x7fc43c071000 2023-12-07T16:14:22.042 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.359+0000 7fc42affd700 1 -- 172.21.15.63:0/3124748863 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fc42c01a430 con 0x7fc43c071000 2023-12-07T16:14:22.043 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.359+0000 7fc42affd700 1 -- 172.21.15.63:0/3124748863 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc42c0245b0 con 0x7fc43c071000 2023-12-07T16:14:22.043 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.359+0000 7fc440c48700 1 -- 172.21.15.63:0/3124748863 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43c100fa0 con 0x7fc43c071000 2023-12-07T16:14:22.043 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.359+0000 7fc440c48700 1 -- 172.21.15.63:0/3124748863 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43c1013b0 con 0x7fc43c071000 2023-12-07T16:14:22.043 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.360+0000 7fc440c48700 1 -- 172.21.15.63:0/3124748863 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43c04bb80 con 0x7fc43c071000 2023-12-07T16:14:22.043 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.360+0000 7fc42affd700 1 -- 172.21.15.63:0/3124748863 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fc42c010be0 con 0x7fc43c071000 2023-12-07T16:14:22.043 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.361+0000 7fc42affd700 1 --2- 172.21.15.63:0/3124748863 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7fc424036640 0x7fc424038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:22.043 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.361+0000 7fc42affd700 1 -- 172.21.15.63:0/3124748863 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc42c04aae0 con 0x7fc43c071000 2023-12-07T16:14:22.043 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.361+0000 7fc439d9b700 1 -- 172.21.15.63:0/3124748863 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7fc424036640 msgr2=0x7fc424038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/2117148141 2023-12-07T16:14:22.043 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.361+0000 7fc439d9b700 1 --2- 172.21.15.63:0/3124748863 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7fc424036640 0x7fc424038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-07T16:14:22.043 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.365+0000 7fc42affd700 1 -- 172.21.15.63:0/3124748863 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc42c01a5a0 con 0x7fc43c071000 2023-12-07T16:14:22.043 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.562+0000 7fc439d9b700 1 -- 172.21.15.63:0/3124748863 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7fc424036640 msgr2=0x7fc424038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/2117148141 2023-12-07T16:14:22.043 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.562+0000 7fc439d9b700 1 --2- 172.21.15.63:0/3124748863 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7fc424036640 0x7fc424038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-07T16:14:22.043 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.631+0000 7fc440c48700 1 -- 172.21.15.63:0/3124748863 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fc43c10ad40 con 0x7fc43c071000 2023-12-07T16:14:22.043 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.632+0000 7fc42affd700 1 -- 172.21.15.63:0/3124748863 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fc42c023b80 con 0x7fc43c071000 2023-12-07T16:14:22.043 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.635+0000 7fc440c48700 1 -- 172.21.15.63:0/3124748863 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7fc424036640 msgr2=0x7fc424038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-07T16:14:22.044 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.635+0000 7fc440c48700 1 --2- 172.21.15.63:0/3124748863 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7fc424036640 0x7fc424038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:22.044 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.635+0000 7fc440c48700 1 -- 172.21.15.63:0/3124748863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc43c071000 msgr2=0x7fc43c102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:22.044 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.635+0000 7fc440c48700 1 --2- 172.21.15.63:0/3124748863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc43c071000 0x7fc43c102920 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc42c006b00 tx=0x7fc42c009250 comp rx=0 tx=0).stop 2023-12-07T16:14:22.044 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.635+0000 7fc440c48700 1 -- 172.21.15.63:0/3124748863 shutdown_connections 2023-12-07T16:14:22.044 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.635+0000 7fc440c48700 1 --2- 172.21.15.63:0/3124748863 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7fc424036640 0x7fc424038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:22.044 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.635+0000 7fc440c48700 1 --2- 172.21.15.63:0/3124748863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc43c071000 0x7fc43c102920 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:22.044 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.635+0000 7fc440c48700 1 -- 172.21.15.63:0/3124748863 >> 172.21.15.63:0/3124748863 conn(0x7fc43c0fc970 msgr2=0x7fc43c0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:22.044 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.635+0000 7fc440c48700 1 -- 172.21.15.63:0/3124748863 shutdown_connections 2023-12-07T16:14:22.044 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:21.635+0000 7fc440c48700 1 -- 172.21.15.63:0/3124748863 wait complete. 2023-12-07T16:14:22.044 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for the mgr to restart... 2023-12-07T16:14:22.044 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for mgr epoch 5... 2023-12-07T16:14:22.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:22 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/3124748863' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-07T16:14:28.649 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:28 smithi063 ceph-mon[112095]: Active manager daemon smithi063.yohyyx restarted 2023-12-07T16:14:28.650 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:28 smithi063 ceph-mon[112095]: Activating manager daemon smithi063.yohyyx 2023-12-07T16:14:28.650 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:28 smithi063 ceph-mon[112095]: osdmap e2: 0 total, 0 up, 0 in 2023-12-07T16:14:28.650 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:28 smithi063 ceph-mon[112095]: mgrmap e6: smithi063.yohyyx(active, starting, since 0.00348592s) 2023-12-07T16:14:28.650 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:28 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-07T16:14:28.650 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:28 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr metadata", "who": "smithi063.yohyyx", "id": "smithi063.yohyyx"}]: dispatch 2023-12-07T16:14:28.650 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:28 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-07T16:14:28.650 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:28 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-07T16:14:28.650 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:28 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-07T16:14:28.650 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:28 smithi063 ceph-mon[112095]: Manager daemon smithi063.yohyyx is now available 2023-12-07T16:14:28.650 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:28 smithi063 ceph-mon[112095]: Found migration_current of "None". Setting to last migration. 2023-12-07T16:14:28.650 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:28 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' 2023-12-07T16:14:28.651 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:28 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' 2023-12-07T16:14:28.651 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:28 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:14:28.651 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:28 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:14:28.651 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:28 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:14:28.651 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:28 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.yohyyx/mirror_snapshot_schedule"}]: dispatch 2023-12-07T16:14:28.651 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:28 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.yohyyx/trash_purge_schedule"}]: dispatch 2023-12-07T16:14:28.846 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2023-12-07T16:14:28.846 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-12-07T16:14:28.846 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-07T16:14:28.846 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2023-12-07T16:14:28.846 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.441+0000 7f7f41d6a700 1 Processor -- start 2023-12-07T16:14:28.846 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.441+0000 7f7f41d6a700 1 -- start start 2023-12-07T16:14:28.846 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.441+0000 7f7f41d6a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f3c076c20 0x7f7f3c1072e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:28.846 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.441+0000 7f7f41d6a700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c102cd0 con 0x7f7f3c076c20 2023-12-07T16:14:28.846 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.441+0000 7f7f3b7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f3c076c20 0x7f7f3c1072e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:28.846 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.441+0000 7f7f3b7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f3c076c20 0x7f7f3c1072e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40852/0 (socket says 172.21.15.63:40852) 2023-12-07T16:14:28.847 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.441+0000 7f7f3b7fe700 1 -- 172.21.15.63:0/2574897047 learned_addr learned my addr 172.21.15.63:0/2574897047 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:28.847 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.442+0000 7f7f3b7fe700 1 -- 172.21.15.63:0/2574897047 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c107820 con 0x7f7f3c076c20 2023-12-07T16:14:28.847 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.442+0000 7f7f3b7fe700 1 --2- 172.21.15.63:0/2574897047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f3c076c20 0x7f7f3c1072e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0098e0 tx=0x7f7f2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f4a5af4181bbd6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:28.847 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.442+0000 7f7f3a7fc700 1 -- 172.21.15.63:0/2574897047 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f2c00b860 con 0x7f7f3c076c20 2023-12-07T16:14:28.847 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.442+0000 7f7f3a7fc700 1 -- 172.21.15.63:0/2574897047 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f7f2c00be30 con 0x7f7f3c076c20 2023-12-07T16:14:28.847 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.442+0000 7f7f3a7fc700 1 -- 172.21.15.63:0/2574897047 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f2c010380 con 0x7f7f3c076c20 2023-12-07T16:14:28.847 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.443+0000 7f7f41d6a700 1 -- 172.21.15.63:0/2574897047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f3c076c20 msgr2=0x7f7f3c1072e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:28.847 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.443+0000 7f7f41d6a700 1 --2- 172.21.15.63:0/2574897047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f3c076c20 0x7f7f3c1072e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0098e0 tx=0x7f7f2c009250 comp rx=0 tx=0).stop 2023-12-07T16:14:28.847 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.443+0000 7f7f41d6a700 1 -- 172.21.15.63:0/2574897047 shutdown_connections 2023-12-07T16:14:28.847 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.443+0000 7f7f41d6a700 1 --2- 172.21.15.63:0/2574897047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f3c076c20 0x7f7f3c1072e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:28.847 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.443+0000 7f7f41d6a700 1 -- 172.21.15.63:0/2574897047 >> 172.21.15.63:0/2574897047 conn(0x7f7f3c0fc950 msgr2=0x7f7f3c0fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:28.847 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.443+0000 7f7f41d6a700 1 -- 172.21.15.63:0/2574897047 shutdown_connections 2023-12-07T16:14:28.847 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.443+0000 7f7f41d6a700 1 -- 172.21.15.63:0/2574897047 wait complete. 2023-12-07T16:14:28.847 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.443+0000 7f7f41d6a700 1 Processor -- start 2023-12-07T16:14:28.847 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.444+0000 7f7f41d6a700 1 -- start start 2023-12-07T16:14:28.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.444+0000 7f7f41d6a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f3c076c20 0x7f7f3c113360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:28.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.444+0000 7f7f41d6a700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c1138a0 con 0x7f7f3c076c20 2023-12-07T16:14:28.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.444+0000 7f7f3b7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f3c076c20 0x7f7f3c113360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:28.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.444+0000 7f7f3b7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f3c076c20 0x7f7f3c113360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40866/0 (socket says 172.21.15.63:40866) 2023-12-07T16:14:28.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.444+0000 7f7f3b7fe700 1 -- 172.21.15.63:0/1053346830 learned_addr learned my addr 172.21.15.63:0/1053346830 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:28.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.444+0000 7f7f3b7fe700 1 -- 172.21.15.63:0/1053346830 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c0094f0 con 0x7f7f3c076c20 2023-12-07T16:14:28.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.444+0000 7f7f3b7fe700 1 --2- 172.21.15.63:0/1053346830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f3c076c20 0x7f7f3c113360 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c006d40 tx=0x7f7f2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:28.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.445+0000 7f7f23fff700 1 -- 172.21.15.63:0/1053346830 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f2c0109b0 con 0x7f7f3c076c20 2023-12-07T16:14:28.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.445+0000 7f7f41d6a700 1 -- 172.21.15.63:0/1053346830 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f3c113aa0 con 0x7f7f3c076c20 2023-12-07T16:14:28.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.445+0000 7f7f23fff700 1 -- 172.21.15.63:0/1053346830 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f7f2c024440 con 0x7f7f3c076c20 2023-12-07T16:14:28.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.445+0000 7f7f23fff700 1 -- 172.21.15.63:0/1053346830 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f2c01a5f0 con 0x7f7f3c076c20 2023-12-07T16:14:28.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.445+0000 7f7f41d6a700 1 -- 172.21.15.63:0/1053346830 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f3c113eb0 con 0x7f7f3c076c20 2023-12-07T16:14:28.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.445+0000 7f7f23fff700 1 -- 172.21.15.63:0/1053346830 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f7f2c01a870 con 0x7f7f3c076c20 2023-12-07T16:14:28.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.446+0000 7f7f23fff700 1 --2- 172.21.15.63:0/1053346830 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f7f240365f0 0x7f7f24038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:28.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.446+0000 7f7f23fff700 1 -- 172.21.15.63:0/1053346830 --> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f240391b0 con 0x7f7f240365f0 2023-12-07T16:14:28.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.446+0000 7f7f23fff700 1 -- 172.21.15.63:0/1053346830 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f7f2c04b3f0 con 0x7f7f3c076c20 2023-12-07T16:14:28.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.446+0000 7f7f3affd700 1 -- 172.21.15.63:0/1053346830 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f7f240365f0 msgr2=0x7f7f24038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/2117148141 2023-12-07T16:14:28.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.446+0000 7f7f3affd700 1 --2- 172.21.15.63:0/1053346830 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f7f240365f0 0x7f7f24038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-07T16:14:28.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.647+0000 7f7f3affd700 1 -- 172.21.15.63:0/1053346830 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f7f240365f0 msgr2=0x7f7f24038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/2117148141 2023-12-07T16:14:28.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:22.647+0000 7f7f3affd700 1 --2- 172.21.15.63:0/1053346830 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f7f240365f0 0x7f7f24038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-07T16:14:28.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:23.048+0000 7f7f3affd700 1 -- 172.21.15.63:0/1053346830 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f7f240365f0 msgr2=0x7f7f24038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/2117148141 2023-12-07T16:14:28.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:23.048+0000 7f7f3affd700 1 --2- 172.21.15.63:0/1053346830 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f7f240365f0 0x7f7f24038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-07T16:14:28.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:23.849+0000 7f7f3affd700 1 -- 172.21.15.63:0/1053346830 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f7f240365f0 msgr2=0x7f7f24038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/2117148141 2023-12-07T16:14:28.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:23.849+0000 7f7f3affd700 1 --2- 172.21.15.63:0/1053346830 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f7f240365f0 0x7f7f24038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-07T16:14:28.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:25.450+0000 7f7f3affd700 1 -- 172.21.15.63:0/1053346830 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f7f240365f0 msgr2=0x7f7f24038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/2117148141 2023-12-07T16:14:28.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:25.450+0000 7f7f3affd700 1 --2- 172.21.15.63:0/1053346830 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f7f240365f0 0x7f7f24038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-07T16:14:28.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:27.412+0000 7f7f23fff700 1 -- 172.21.15.63:0/1053346830 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mgrmap(e 6) v1 ==== 43048+0+0 (secure 0 0 0) 0x7f7f2c024970 con 0x7f7f3c076c20 2023-12-07T16:14:28.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:27.412+0000 7f7f23fff700 1 -- 172.21.15.63:0/1053346830 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f7f240365f0 msgr2=0x7f7f24038aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-07T16:14:28.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:27.412+0000 7f7f23fff700 1 --2- 172.21.15.63:0/1053346830 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f7f240365f0 0x7f7f24038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:28.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:28.415+0000 7f7f23fff700 1 -- 172.21.15.63:0/1053346830 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7f7f2c02d3f0 con 0x7f7f3c076c20 2023-12-07T16:14:28.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:28.415+0000 7f7f23fff700 1 --2- 172.21.15.63:0/1053346830 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f7f24039f60 0x7f7f2403c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:28.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:28.415+0000 7f7f23fff700 1 -- 172.21.15.63:0/1053346830 --> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f240391b0 con 0x7f7f24039f60 2023-12-07T16:14:28.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:28.416+0000 7f7f3affd700 1 --2- 172.21.15.63:0/1053346830 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f7f24039f60 0x7f7f2403c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:28.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:28.416+0000 7f7f3affd700 1 --2- 172.21.15.63:0/1053346830 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f7f24039f60 0x7f7f2403c340 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7f300039d0 tx=0x7f7f30009350 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:28.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:28.417+0000 7f7f23fff700 1 -- 172.21.15.63:0/1053346830 <== mgr.14120 v2:172.21.15.63:6800/1052036735 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f7f240391b0 con 0x7f7f24039f60 2023-12-07T16:14:28.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:28.423+0000 7f7f41d6a700 1 -- 172.21.15.63:0/1053346830 --> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f7f3c04bb80 con 0x7f7f24039f60 2023-12-07T16:14:28.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:28.423+0000 7f7f23fff700 1 -- 172.21.15.63:0/1053346830 <== mgr.14120 v2:172.21.15.63:6800/1052036735 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f7f3c04bb80 con 0x7f7f24039f60 2023-12-07T16:14:28.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:28.423+0000 7f7f41d6a700 1 -- 172.21.15.63:0/1053346830 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f7f24039f60 msgr2=0x7f7f2403c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:28.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:28.423+0000 7f7f41d6a700 1 --2- 172.21.15.63:0/1053346830 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f7f24039f60 0x7f7f2403c340 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7f300039d0 tx=0x7f7f30009350 comp rx=0 tx=0).stop 2023-12-07T16:14:28.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:28.423+0000 7f7f41d6a700 1 -- 172.21.15.63:0/1053346830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f3c076c20 msgr2=0x7f7f3c113360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:28.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:28.423+0000 7f7f41d6a700 1 --2- 172.21.15.63:0/1053346830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f3c076c20 0x7f7f3c113360 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c006d40 tx=0x7f7f2c009250 comp rx=0 tx=0).stop 2023-12-07T16:14:28.851 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:28.424+0000 7f7f41d6a700 1 -- 172.21.15.63:0/1053346830 shutdown_connections 2023-12-07T16:14:28.851 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:28.424+0000 7f7f41d6a700 1 --2- 172.21.15.63:0/1053346830 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f7f24039f60 0x7f7f2403c340 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:28.851 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:28.424+0000 7f7f41d6a700 1 --2- 172.21.15.63:0/1053346830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f3c076c20 0x7f7f3c113360 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:28.851 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:28.424+0000 7f7f41d6a700 1 --2- 172.21.15.63:0/1053346830 >> [v2:172.21.15.63:6800/2117148141,v1:172.21.15.63:6801/2117148141] conn(0x7f7f240365f0 0x7f7f24038aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:28.851 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:28.424+0000 7f7f41d6a700 1 -- 172.21.15.63:0/1053346830 >> 172.21.15.63:0/1053346830 conn(0x7f7f3c0fc950 msgr2=0x7f7f3c0fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:28.851 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:28.424+0000 7f7f41d6a700 1 -- 172.21.15.63:0/1053346830 shutdown_connections 2023-12-07T16:14:28.851 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:28.424+0000 7f7f41d6a700 1 -- 172.21.15.63:0/1053346830 wait complete. 2023-12-07T16:14:28.851 INFO:teuthology.orchestra.run.smithi063.stdout:mgr epoch 5 is available 2023-12-07T16:14:28.851 INFO:teuthology.orchestra.run.smithi063.stdout:Setting orchestrator backend to cephadm... 2023-12-07T16:14:29.679 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:29 smithi063 ceph-mon[112095]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-07T16:14:29.679 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:29 smithi063 ceph-mon[112095]: mgrmap e7: smithi063.yohyyx(active, since 1.00712s) 2023-12-07T16:14:29.679 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:29 smithi063 ceph-mon[112095]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-07T16:14:29.679 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:29 smithi063 ceph-mon[112095]: [07/Dec/2023:16:14:28] ENGINE Bus STARTING 2023-12-07T16:14:29.679 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:29 smithi063 ceph-mon[112095]: [07/Dec/2023:16:14:28] ENGINE Serving on https://172.21.15.63:7150 2023-12-07T16:14:29.679 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:29 smithi063 ceph-mon[112095]: [07/Dec/2023:16:14:28] ENGINE Bus STARTED 2023-12-07T16:14:29.679 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:29 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' 2023-12-07T16:14:29.680 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:29 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:14:29.847 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.256+0000 7f1efa573700 1 Processor -- start 2023-12-07T16:14:29.847 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.256+0000 7f1efa573700 1 -- start start 2023-12-07T16:14:29.847 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.256+0000 7f1efa573700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ef4076bc0 0x7f1ef4107330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:29.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.256+0000 7f1efa573700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef4102d20 con 0x7f1ef4076bc0 2023-12-07T16:14:29.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.257+0000 7f1ef3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ef4076bc0 0x7f1ef4107330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:29.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.257+0000 7f1ef3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ef4076bc0 0x7f1ef4107330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40954/0 (socket says 172.21.15.63:40954) 2023-12-07T16:14:29.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.257+0000 7f1ef3fff700 1 -- 172.21.15.63:0/1697148922 learned_addr learned my addr 172.21.15.63:0/1697148922 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:29.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.257+0000 7f1ef3fff700 1 -- 172.21.15.63:0/1697148922 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef4107870 con 0x7f1ef4076bc0 2023-12-07T16:14:29.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.257+0000 7f1ef3fff700 1 --2- 172.21.15.63:0/1697148922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ef4076bc0 0x7f1ef4107330 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40098e0 tx=0x7f1ee4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5417d2e87fd14d90 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:29.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.257+0000 7f1ef2ffd700 1 -- 172.21.15.63:0/1697148922 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ee400b860 con 0x7f1ef4076bc0 2023-12-07T16:14:29.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.257+0000 7f1ef2ffd700 1 -- 172.21.15.63:0/1697148922 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f1ee400be30 con 0x7f1ef4076bc0 2023-12-07T16:14:29.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.257+0000 7f1ef2ffd700 1 -- 172.21.15.63:0/1697148922 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ee4010380 con 0x7f1ef4076bc0 2023-12-07T16:14:29.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.258+0000 7f1efa573700 1 -- 172.21.15.63:0/1697148922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ef4076bc0 msgr2=0x7f1ef4107330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:29.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.258+0000 7f1efa573700 1 --2- 172.21.15.63:0/1697148922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ef4076bc0 0x7f1ef4107330 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40098e0 tx=0x7f1ee4009250 comp rx=0 tx=0).stop 2023-12-07T16:14:29.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.258+0000 7f1efa573700 1 -- 172.21.15.63:0/1697148922 shutdown_connections 2023-12-07T16:14:29.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.258+0000 7f1efa573700 1 --2- 172.21.15.63:0/1697148922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ef4076bc0 0x7f1ef4107330 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:29.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.258+0000 7f1efa573700 1 -- 172.21.15.63:0/1697148922 >> 172.21.15.63:0/1697148922 conn(0x7f1ef40fc980 msgr2=0x7f1ef40fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:29.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.258+0000 7f1efa573700 1 -- 172.21.15.63:0/1697148922 shutdown_connections 2023-12-07T16:14:29.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.258+0000 7f1efa573700 1 -- 172.21.15.63:0/1697148922 wait complete. 2023-12-07T16:14:29.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.258+0000 7f1efa573700 1 Processor -- start 2023-12-07T16:14:29.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.259+0000 7f1efa573700 1 -- start start 2023-12-07T16:14:29.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.259+0000 7f1efa573700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ef4076bc0 0x7f1ef4113370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:29.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.259+0000 7f1efa573700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef41138b0 con 0x7f1ef4076bc0 2023-12-07T16:14:29.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.259+0000 7f1ef3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ef4076bc0 0x7f1ef4113370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:29.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.259+0000 7f1ef3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ef4076bc0 0x7f1ef4113370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40962/0 (socket says 172.21.15.63:40962) 2023-12-07T16:14:29.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.259+0000 7f1ef3fff700 1 -- 172.21.15.63:0/2668756756 learned_addr learned my addr 172.21.15.63:0/2668756756 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:29.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.259+0000 7f1ef3fff700 1 -- 172.21.15.63:0/2668756756 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee40094f0 con 0x7f1ef4076bc0 2023-12-07T16:14:29.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.259+0000 7f1ef3fff700 1 --2- 172.21.15.63:0/2668756756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ef4076bc0 0x7f1ef4113370 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4006b00 tx=0x7f1ee4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:29.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.260+0000 7f1ef0ff9700 1 -- 172.21.15.63:0/2668756756 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ee4010a80 con 0x7f1ef4076bc0 2023-12-07T16:14:29.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.260+0000 7f1ef0ff9700 1 -- 172.21.15.63:0/2668756756 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f1ee401a430 con 0x7f1ef4076bc0 2023-12-07T16:14:29.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.260+0000 7f1efa573700 1 -- 172.21.15.63:0/2668756756 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef4113ab0 con 0x7f1ef4076bc0 2023-12-07T16:14:29.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.260+0000 7f1ef0ff9700 1 -- 172.21.15.63:0/2668756756 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ee40245b0 con 0x7f1ef4076bc0 2023-12-07T16:14:29.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.260+0000 7f1efa573700 1 -- 172.21.15.63:0/2668756756 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef4113ec0 con 0x7f1ef4076bc0 2023-12-07T16:14:29.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.260+0000 7f1ef0ff9700 1 -- 172.21.15.63:0/2668756756 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7f1ee4024830 con 0x7f1ef4076bc0 2023-12-07T16:14:29.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.261+0000 7f1ef0ff9700 1 --2- 172.21.15.63:0/2668756756 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f1edc0364c0 0x7f1edc038970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:29.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.261+0000 7f1ef0ff9700 1 -- 172.21.15.63:0/2668756756 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f1ee404aad0 con 0x7f1ef4076bc0 2023-12-07T16:14:29.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.261+0000 7f1efa573700 1 -- 172.21.15.63:0/2668756756 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef404bb80 con 0x7f1ef4076bc0 2023-12-07T16:14:29.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.261+0000 7f1ef37fe700 1 --2- 172.21.15.63:0/2668756756 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f1edc0364c0 0x7f1edc038970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:29.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.261+0000 7f1ef37fe700 1 --2- 172.21.15.63:0/2668756756 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f1edc0364c0 0x7f1edc038970 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009990 tx=0x7f1ee8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:29.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.266+0000 7f1ef0ff9700 1 -- 172.21.15.63:0/2668756756 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1ee4018350 con 0x7f1ef4076bc0 2023-12-07T16:14:29.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.475+0000 7f1efa573700 1 -- 172.21.15.63:0/2668756756 --> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ef410cfa0 con 0x7f1edc0364c0 2023-12-07T16:14:29.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.481+0000 7f1ef0ff9700 1 -- 172.21.15.63:0/2668756756 <== mgr.14120 v2:172.21.15.63:6800/1052036735 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1ef410cfa0 con 0x7f1edc0364c0 2023-12-07T16:14:29.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.483+0000 7f1efa573700 1 -- 172.21.15.63:0/2668756756 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f1edc0364c0 msgr2=0x7f1edc038970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:29.851 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.483+0000 7f1efa573700 1 --2- 172.21.15.63:0/2668756756 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f1edc0364c0 0x7f1edc038970 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009990 tx=0x7f1ee8006e40 comp rx=0 tx=0).stop 2023-12-07T16:14:29.851 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.483+0000 7f1efa573700 1 -- 172.21.15.63:0/2668756756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ef4076bc0 msgr2=0x7f1ef4113370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:29.851 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.483+0000 7f1efa573700 1 --2- 172.21.15.63:0/2668756756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ef4076bc0 0x7f1ef4113370 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4006b00 tx=0x7f1ee4009250 comp rx=0 tx=0).stop 2023-12-07T16:14:29.851 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.483+0000 7f1efa573700 1 -- 172.21.15.63:0/2668756756 shutdown_connections 2023-12-07T16:14:29.851 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.483+0000 7f1efa573700 1 --2- 172.21.15.63:0/2668756756 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f1edc0364c0 0x7f1edc038970 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:29.851 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.483+0000 7f1efa573700 1 --2- 172.21.15.63:0/2668756756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ef4076bc0 0x7f1ef4113370 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:29.851 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.483+0000 7f1efa573700 1 -- 172.21.15.63:0/2668756756 >> 172.21.15.63:0/2668756756 conn(0x7f1ef40fc980 msgr2=0x7f1ef40fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:29.851 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.483+0000 7f1efa573700 1 -- 172.21.15.63:0/2668756756 shutdown_connections 2023-12-07T16:14:29.851 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:29.483+0000 7f1efa573700 1 -- 172.21.15.63:0/2668756756 wait complete. 2023-12-07T16:14:30.819 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:30 smithi063 ceph-mon[112095]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:14:30.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:30 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' 2023-12-07T16:14:30.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:30 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:14:30.820 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:30 smithi063 ceph-mon[112095]: mgrmap e8: smithi063.yohyyx(active, since 3s) 2023-12-07T16:14:30.847 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout value unchanged 2023-12-07T16:14:30.847 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.247+0000 7f73057c3700 1 Processor -- start 2023-12-07T16:14:30.847 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.247+0000 7f73057c3700 1 -- start start 2023-12-07T16:14:30.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.247+0000 7f73057c3700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7300076c60 0x7f7300104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:30.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.247+0000 7f73057c3700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73001053e0 con 0x7f7300076c60 2023-12-07T16:14:30.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.248+0000 7f72feffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7300076c60 0x7f7300104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:30.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.248+0000 7f72feffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7300076c60 0x7f7300104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44506/0 (socket says 172.21.15.63:44506) 2023-12-07T16:14:30.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.248+0000 7f72feffd700 1 -- 172.21.15.63:0/2085227940 learned_addr learned my addr 172.21.15.63:0/2085227940 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:30.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.248+0000 7f72feffd700 1 -- 172.21.15.63:0/2085227940 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7300105520 con 0x7f7300076c60 2023-12-07T16:14:30.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.248+0000 7f72feffd700 1 --2- 172.21.15.63:0/2085227940 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7300076c60 0x7f7300104ea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f72f80098e0 tx=0x7f72f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc87cde0fd9f7b35 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:30.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.248+0000 7f72fdffb700 1 -- 172.21.15.63:0/2085227940 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72f800b860 con 0x7f7300076c60 2023-12-07T16:14:30.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.248+0000 7f72fdffb700 1 -- 172.21.15.63:0/2085227940 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f72f800be30 con 0x7f7300076c60 2023-12-07T16:14:30.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.248+0000 7f72fdffb700 1 -- 172.21.15.63:0/2085227940 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72f8010380 con 0x7f7300076c60 2023-12-07T16:14:30.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.249+0000 7f73057c3700 1 -- 172.21.15.63:0/2085227940 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7300076c60 msgr2=0x7f7300104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:30.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.249+0000 7f73057c3700 1 --2- 172.21.15.63:0/2085227940 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7300076c60 0x7f7300104ea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f72f80098e0 tx=0x7f72f8009250 comp rx=0 tx=0).stop 2023-12-07T16:14:30.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.249+0000 7f73057c3700 1 -- 172.21.15.63:0/2085227940 shutdown_connections 2023-12-07T16:14:30.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.249+0000 7f73057c3700 1 --2- 172.21.15.63:0/2085227940 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7300076c60 0x7f7300104ea0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:30.848 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.249+0000 7f73057c3700 1 -- 172.21.15.63:0/2085227940 >> 172.21.15.63:0/2085227940 conn(0x7f73000fc950 msgr2=0x7f73000fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:30.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.249+0000 7f73057c3700 1 -- 172.21.15.63:0/2085227940 shutdown_connections 2023-12-07T16:14:30.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.249+0000 7f73057c3700 1 -- 172.21.15.63:0/2085227940 wait complete. 2023-12-07T16:14:30.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.250+0000 7f73057c3700 1 Processor -- start 2023-12-07T16:14:30.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.250+0000 7f73057c3700 1 -- start start 2023-12-07T16:14:30.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.250+0000 7f73057c3700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7300076c60 0x7f7300111150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:30.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.250+0000 7f73057c3700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7300111690 con 0x7f7300076c60 2023-12-07T16:14:30.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.250+0000 7f72feffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7300076c60 0x7f7300111150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:30.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.250+0000 7f72feffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7300076c60 0x7f7300111150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44512/0 (socket says 172.21.15.63:44512) 2023-12-07T16:14:30.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.250+0000 7f72feffd700 1 -- 172.21.15.63:0/1657567759 learned_addr learned my addr 172.21.15.63:0/1657567759 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:30.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.250+0000 7f72feffd700 1 -- 172.21.15.63:0/1657567759 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f80094f0 con 0x7f7300076c60 2023-12-07T16:14:30.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.250+0000 7f72feffd700 1 --2- 172.21.15.63:0/1657567759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7300076c60 0x7f7300111150 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f72f8006d40 tx=0x7f72f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:30.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.251+0000 7f72e77fe700 1 -- 172.21.15.63:0/1657567759 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72f80109b0 con 0x7f7300076c60 2023-12-07T16:14:30.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.251+0000 7f72e77fe700 1 -- 172.21.15.63:0/1657567759 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f72f8024440 con 0x7f7300076c60 2023-12-07T16:14:30.849 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.251+0000 7f73057c3700 1 -- 172.21.15.63:0/1657567759 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7300111890 con 0x7f7300076c60 2023-12-07T16:14:30.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.251+0000 7f72e77fe700 1 -- 172.21.15.63:0/1657567759 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72f801a5f0 con 0x7f7300076c60 2023-12-07T16:14:30.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.251+0000 7f73057c3700 1 -- 172.21.15.63:0/1657567759 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7300111ca0 con 0x7f7300076c60 2023-12-07T16:14:30.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.251+0000 7f72e77fe700 1 -- 172.21.15.63:0/1657567759 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7f72f8010b10 con 0x7f7300076c60 2023-12-07T16:14:30.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.252+0000 7f72e77fe700 1 --2- 172.21.15.63:0/1657567759 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f72e8036510 0x7f72e80389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:30.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.252+0000 7f72e77fe700 1 -- 172.21.15.63:0/1657567759 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f72f804a240 con 0x7f7300076c60 2023-12-07T16:14:30.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.252+0000 7f72fe7fc700 1 --2- 172.21.15.63:0/1657567759 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f72e8036510 0x7f72e80389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:30.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.252+0000 7f73057c3700 1 -- 172.21.15.63:0/1657567759 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f730004bb80 con 0x7f7300076c60 2023-12-07T16:14:30.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.252+0000 7f72fe7fc700 1 --2- 172.21.15.63:0/1657567759 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f72e8036510 0x7f72e80389c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f72f4009990 tx=0x7f72f4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:30.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.257+0000 7f72e77fe700 1 -- 172.21.15.63:0/1657567759 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f72f802d3f0 con 0x7f7300076c60 2023-12-07T16:14:30.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.417+0000 7f72e77fe700 1 -- 172.21.15.63:0/1657567759 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f72f8010dc0 con 0x7f7300076c60 2023-12-07T16:14:30.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.453+0000 7f73057c3700 1 -- 172.21.15.63:0/1657567759 --> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f730010afa0 con 0x7f72e8036510 2023-12-07T16:14:30.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.454+0000 7f72e77fe700 1 -- 172.21.15.63:0/1657567759 <== mgr.14120 v2:172.21.15.63:6800/1052036735 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f730010afa0 con 0x7f72e8036510 2023-12-07T16:14:30.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.456+0000 7f73057c3700 1 -- 172.21.15.63:0/1657567759 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f72e8036510 msgr2=0x7f72e80389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:30.850 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.456+0000 7f73057c3700 1 --2- 172.21.15.63:0/1657567759 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f72e8036510 0x7f72e80389c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f72f4009990 tx=0x7f72f4006e40 comp rx=0 tx=0).stop 2023-12-07T16:14:30.851 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.456+0000 7f73057c3700 1 -- 172.21.15.63:0/1657567759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7300076c60 msgr2=0x7f7300111150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:30.851 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.456+0000 7f73057c3700 1 --2- 172.21.15.63:0/1657567759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7300076c60 0x7f7300111150 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f72f8006d40 tx=0x7f72f8009250 comp rx=0 tx=0).stop 2023-12-07T16:14:30.851 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.456+0000 7f73057c3700 1 -- 172.21.15.63:0/1657567759 shutdown_connections 2023-12-07T16:14:30.851 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.456+0000 7f73057c3700 1 --2- 172.21.15.63:0/1657567759 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f72e8036510 0x7f72e80389c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:30.851 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.456+0000 7f73057c3700 1 --2- 172.21.15.63:0/1657567759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7300076c60 0x7f7300111150 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:30.851 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.456+0000 7f73057c3700 1 -- 172.21.15.63:0/1657567759 >> 172.21.15.63:0/1657567759 conn(0x7f73000fc950 msgr2=0x7f73000fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:30.851 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.456+0000 7f73057c3700 1 -- 172.21.15.63:0/1657567759 shutdown_connections 2023-12-07T16:14:30.851 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:30.456+0000 7f73057c3700 1 -- 172.21.15.63:0/1657567759 wait complete. 2023-12-07T16:14:30.851 INFO:teuthology.orchestra.run.smithi063.stdout:Generating ssh key... 2023-12-07T16:14:31.881 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:31 smithi063 ceph-mon[112095]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:14:32.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:32 smithi063 ceph-mon[112095]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:14:32.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:32 smithi063 ceph-mon[112095]: Generating ssh key... 2023-12-07T16:14:32.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:32 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' 2023-12-07T16:14:32.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:32 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' 2023-12-07T16:14:34.719 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.191+0000 7f90a7f1d700 1 Processor -- start 2023-12-07T16:14:34.719 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.192+0000 7f90a7f1d700 1 -- start start 2023-12-07T16:14:34.719 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.192+0000 7f90a7f1d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90a01027b0 0x7f90a0102bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:34.719 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.192+0000 7f90a7f1d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a0103100 con 0x7f90a01027b0 2023-12-07T16:14:34.719 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.192+0000 7f90a5cb9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90a01027b0 0x7f90a0102bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:34.719 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.192+0000 7f90a5cb9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90a01027b0 0x7f90a0102bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44514/0 (socket says 172.21.15.63:44514) 2023-12-07T16:14:34.719 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.192+0000 7f90a5cb9700 1 -- 172.21.15.63:0/1932824523 learned_addr learned my addr 172.21.15.63:0/1932824523 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:34.719 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.192+0000 7f90a5cb9700 1 -- 172.21.15.63:0/1932824523 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a0103240 con 0x7f90a01027b0 2023-12-07T16:14:34.719 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.193+0000 7f90a5cb9700 1 --2- 172.21.15.63:0/1932824523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90a01027b0 0x7f90a0102bc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f909c0098e0 tx=0x7f909c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3db388e6b75d06 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:34.719 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.193+0000 7f90a4cb7700 1 -- 172.21.15.63:0/1932824523 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f909c00b860 con 0x7f90a01027b0 2023-12-07T16:14:34.720 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.193+0000 7f90a4cb7700 1 -- 172.21.15.63:0/1932824523 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f909c00be30 con 0x7f90a01027b0 2023-12-07T16:14:34.720 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.193+0000 7f90a4cb7700 1 -- 172.21.15.63:0/1932824523 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f909c010380 con 0x7f90a01027b0 2023-12-07T16:14:34.720 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.193+0000 7f90a7f1d700 1 -- 172.21.15.63:0/1932824523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90a01027b0 msgr2=0x7f90a0102bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:34.720 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.193+0000 7f90a7f1d700 1 --2- 172.21.15.63:0/1932824523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90a01027b0 0x7f90a0102bc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f909c0098e0 tx=0x7f909c009250 comp rx=0 tx=0).stop 2023-12-07T16:14:34.720 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.193+0000 7f90a7f1d700 1 -- 172.21.15.63:0/1932824523 shutdown_connections 2023-12-07T16:14:34.720 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.193+0000 7f90a7f1d700 1 --2- 172.21.15.63:0/1932824523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90a01027b0 0x7f90a0102bc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:34.720 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.193+0000 7f90a7f1d700 1 -- 172.21.15.63:0/1932824523 >> 172.21.15.63:0/1932824523 conn(0x7f90a00fc0b0 msgr2=0x7f90a00fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:34.720 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.193+0000 7f90a7f1d700 1 -- 172.21.15.63:0/1932824523 shutdown_connections 2023-12-07T16:14:34.720 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.193+0000 7f90a7f1d700 1 -- 172.21.15.63:0/1932824523 wait complete. 2023-12-07T16:14:34.720 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.194+0000 7f90a7f1d700 1 Processor -- start 2023-12-07T16:14:34.720 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.194+0000 7f90a7f1d700 1 -- start start 2023-12-07T16:14:34.720 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.194+0000 7f90a7f1d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90a01027b0 0x7f90a0111190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:34.720 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.194+0000 7f90a7f1d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a01116d0 con 0x7f90a01027b0 2023-12-07T16:14:34.720 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.194+0000 7f90a5cb9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90a01027b0 0x7f90a0111190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:34.720 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.194+0000 7f90a5cb9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90a01027b0 0x7f90a0111190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44516/0 (socket says 172.21.15.63:44516) 2023-12-07T16:14:34.721 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.194+0000 7f90a5cb9700 1 -- 172.21.15.63:0/4110808715 learned_addr learned my addr 172.21.15.63:0/4110808715 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:34.721 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.194+0000 7f90a5cb9700 1 -- 172.21.15.63:0/4110808715 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909c0094f0 con 0x7f90a01027b0 2023-12-07T16:14:34.721 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.195+0000 7f90a5cb9700 1 --2- 172.21.15.63:0/4110808715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90a01027b0 0x7f90a0111190 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f909c000c00 tx=0x7f909c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:34.721 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.195+0000 7f90927fc700 1 -- 172.21.15.63:0/4110808715 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f909c010a80 con 0x7f90a01027b0 2023-12-07T16:14:34.721 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.195+0000 7f90927fc700 1 -- 172.21.15.63:0/4110808715 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f909c01a430 con 0x7f90a01027b0 2023-12-07T16:14:34.721 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.195+0000 7f90a7f1d700 1 -- 172.21.15.63:0/4110808715 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a01118d0 con 0x7f90a01027b0 2023-12-07T16:14:34.721 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.195+0000 7f90927fc700 1 -- 172.21.15.63:0/4110808715 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f909c0245b0 con 0x7f90a01027b0 2023-12-07T16:14:34.721 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.195+0000 7f90a7f1d700 1 -- 172.21.15.63:0/4110808715 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a0111ce0 con 0x7f90a01027b0 2023-12-07T16:14:34.721 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.196+0000 7f90927fc700 1 -- 172.21.15.63:0/4110808715 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f909c0247a0 con 0x7f90a01027b0 2023-12-07T16:14:34.721 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.196+0000 7f90a7f1d700 1 -- 172.21.15.63:0/4110808715 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a004bb80 con 0x7f90a01027b0 2023-12-07T16:14:34.721 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.196+0000 7f90927fc700 1 --2- 172.21.15.63:0/4110808715 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f908c036640 0x7f908c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:34.721 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.196+0000 7f90927fc700 1 -- 172.21.15.63:0/4110808715 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f909c04acf0 con 0x7f90a01027b0 2023-12-07T16:14:34.721 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.196+0000 7f90a54b8700 1 --2- 172.21.15.63:0/4110808715 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f908c036640 0x7f908c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:34.721 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.196+0000 7f90a54b8700 1 --2- 172.21.15.63:0/4110808715 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f908c036640 0x7f908c038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9094009990 tx=0x7f9094006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:34.721 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.201+0000 7f90927fc700 1 -- 172.21.15.63:0/4110808715 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f909c010be0 con 0x7f90a01027b0 2023-12-07T16:14:34.722 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.396+0000 7f90a7f1d700 1 -- 172.21.15.63:0/4110808715 --> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f90a00fe3b0 con 0x7f908c036640 2023-12-07T16:14:34.722 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.890+0000 7f90927fc700 1 -- 172.21.15.63:0/4110808715 <== mgr.14120 v2:172.21.15.63:6800/1052036735 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f90a00fe3b0 con 0x7f908c036640 2023-12-07T16:14:34.722 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.892+0000 7f90a7f1d700 1 -- 172.21.15.63:0/4110808715 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f908c036640 msgr2=0x7f908c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:34.722 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.892+0000 7f90a7f1d700 1 --2- 172.21.15.63:0/4110808715 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f908c036640 0x7f908c038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9094009990 tx=0x7f9094006e40 comp rx=0 tx=0).stop 2023-12-07T16:14:34.722 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.892+0000 7f90a7f1d700 1 -- 172.21.15.63:0/4110808715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90a01027b0 msgr2=0x7f90a0111190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:34.722 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.892+0000 7f90a7f1d700 1 --2- 172.21.15.63:0/4110808715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90a01027b0 0x7f90a0111190 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f909c000c00 tx=0x7f909c009250 comp rx=0 tx=0).stop 2023-12-07T16:14:34.722 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.892+0000 7f90a7f1d700 1 -- 172.21.15.63:0/4110808715 shutdown_connections 2023-12-07T16:14:34.722 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.892+0000 7f90a7f1d700 1 --2- 172.21.15.63:0/4110808715 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f908c036640 0x7f908c038af0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:34.722 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.892+0000 7f90a7f1d700 1 --2- 172.21.15.63:0/4110808715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90a01027b0 0x7f90a0111190 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:34.722 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.892+0000 7f90a7f1d700 1 -- 172.21.15.63:0/4110808715 >> 172.21.15.63:0/4110808715 conn(0x7f90a00fc0b0 msgr2=0x7f90a0100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:34.722 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.892+0000 7f90a7f1d700 1 -- 172.21.15.63:0/4110808715 shutdown_connections 2023-12-07T16:14:34.722 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:31.892+0000 7f90a7f1d700 1 -- 172.21.15.63:0/4110808715 wait complete. 2023-12-07T16:14:36.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:36 smithi063 ceph-mon[112095]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:14:38.606 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrOapwP2GGGnp5m5aLe5ahbVKlxAN9Jg2A1LRQ44Q2itIrlffHP9iN3q/E8c1ADP3B1n1VGvGEs/t3kcjxsNBBmg3MQyjECoIdlOmy9ITtvZZGSb/mIyjIjMEFYkp7NgBV9VsUPeSaCsrw+E16C56mcItfKLXCaOyMkVGnCDgCmou0InBsFdq5yDD9SSm504z62af2Djpf7+BM60upvrV8S9SpKjzqFC5UJXF99+08QpXVG3Fo3YbuAEVNbVhc9CfpVas4/qFLND4FN4303WZXIK8QIok742iJct/30+j1Q/81DLkhrDZf+BUiHmGsLRtFjphngQlkTGFGmsV3VtkmwfuuvCSWGtMZl+6HSG9Vh6aV5tWHjY1UDi7AJV80CObG/UV900/thIDqFAXkPAWfH/bsy3xHkdeGmLyPmDbahvbOt4bJ4u/oWSOysWmpDKos5BDg2y+HKb+0SO/xofh5bY2lQCAxtlFNb3BmGPu43IvQ/RzN0CgL4P2DDEpnv10= ceph-8c493298-951b-11ee-95a2-87774f69a715 2023-12-07T16:14:38.606 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.241+0000 7f6e51266700 1 Processor -- start 2023-12-07T16:14:38.606 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.241+0000 7f6e51266700 1 -- start start 2023-12-07T16:14:38.606 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.241+0000 7f6e51266700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e4c070f80 0x7f6e4c107320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:38.606 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.241+0000 7f6e51266700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c102d10 con 0x7f6e4c070f80 2023-12-07T16:14:38.606 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.241+0000 7f6e4affd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e4c070f80 0x7f6e4c107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:38.606 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.241+0000 7f6e4affd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e4c070f80 0x7f6e4c107320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44528/0 (socket says 172.21.15.63:44528) 2023-12-07T16:14:38.606 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.241+0000 7f6e4affd700 1 -- 172.21.15.63:0/1296417694 learned_addr learned my addr 172.21.15.63:0/1296417694 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:38.606 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.242+0000 7f6e4affd700 1 -- 172.21.15.63:0/1296417694 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4c107860 con 0x7f6e4c070f80 2023-12-07T16:14:38.607 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.242+0000 7f6e4affd700 1 --2- 172.21.15.63:0/1296417694 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e4c070f80 0x7f6e4c107320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6e340098e0 tx=0x7f6e34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7b603ad1e95928 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:38.607 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.242+0000 7f6e49ffb700 1 -- 172.21.15.63:0/1296417694 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e3400b860 con 0x7f6e4c070f80 2023-12-07T16:14:38.607 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.242+0000 7f6e49ffb700 1 -- 172.21.15.63:0/1296417694 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f6e3400be30 con 0x7f6e4c070f80 2023-12-07T16:14:38.607 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.242+0000 7f6e49ffb700 1 -- 172.21.15.63:0/1296417694 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e34010380 con 0x7f6e4c070f80 2023-12-07T16:14:38.607 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.243+0000 7f6e51266700 1 -- 172.21.15.63:0/1296417694 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e4c070f80 msgr2=0x7f6e4c107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:38.607 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.243+0000 7f6e51266700 1 --2- 172.21.15.63:0/1296417694 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e4c070f80 0x7f6e4c107320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6e340098e0 tx=0x7f6e34009250 comp rx=0 tx=0).stop 2023-12-07T16:14:38.607 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.243+0000 7f6e51266700 1 -- 172.21.15.63:0/1296417694 shutdown_connections 2023-12-07T16:14:38.607 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.243+0000 7f6e51266700 1 --2- 172.21.15.63:0/1296417694 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e4c070f80 0x7f6e4c107320 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:38.607 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.243+0000 7f6e51266700 1 -- 172.21.15.63:0/1296417694 >> 172.21.15.63:0/1296417694 conn(0x7f6e4c0fc970 msgr2=0x7f6e4c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:38.607 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.243+0000 7f6e51266700 1 -- 172.21.15.63:0/1296417694 shutdown_connections 2023-12-07T16:14:38.607 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.243+0000 7f6e51266700 1 -- 172.21.15.63:0/1296417694 wait complete. 2023-12-07T16:14:38.607 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.243+0000 7f6e51266700 1 Processor -- start 2023-12-07T16:14:38.607 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.243+0000 7f6e51266700 1 -- start start 2023-12-07T16:14:38.607 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.244+0000 7f6e51266700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e4c070f80 0x7f6e4c113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:38.608 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.244+0000 7f6e51266700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c1138c0 con 0x7f6e4c070f80 2023-12-07T16:14:38.608 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.244+0000 7f6e4affd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e4c070f80 0x7f6e4c113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:38.608 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.244+0000 7f6e4affd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e4c070f80 0x7f6e4c113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44532/0 (socket says 172.21.15.63:44532) 2023-12-07T16:14:38.608 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.244+0000 7f6e4affd700 1 -- 172.21.15.63:0/3475931367 learned_addr learned my addr 172.21.15.63:0/3475931367 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:38.608 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.244+0000 7f6e4affd700 1 -- 172.21.15.63:0/3475931367 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e340094f0 con 0x7f6e4c070f80 2023-12-07T16:14:38.608 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.244+0000 7f6e4affd700 1 --2- 172.21.15.63:0/3475931367 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e4c070f80 0x7f6e4c113380 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6e34006b00 tx=0x7f6e34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:38.608 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.244+0000 7f6e437fe700 1 -- 172.21.15.63:0/3475931367 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e34010a80 con 0x7f6e4c070f80 2023-12-07T16:14:38.608 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.244+0000 7f6e437fe700 1 -- 172.21.15.63:0/3475931367 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f6e3401a430 con 0x7f6e4c070f80 2023-12-07T16:14:38.608 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.244+0000 7f6e51266700 1 -- 172.21.15.63:0/3475931367 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4c113ac0 con 0x7f6e4c070f80 2023-12-07T16:14:38.608 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.244+0000 7f6e437fe700 1 -- 172.21.15.63:0/3475931367 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e340245b0 con 0x7f6e4c070f80 2023-12-07T16:14:38.608 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.244+0000 7f6e51266700 1 -- 172.21.15.63:0/3475931367 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4c113ed0 con 0x7f6e4c070f80 2023-12-07T16:14:38.608 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.245+0000 7f6e437fe700 1 -- 172.21.15.63:0/3475931367 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f6e34010be0 con 0x7f6e4c070f80 2023-12-07T16:14:38.608 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.245+0000 7f6e437fe700 1 --2- 172.21.15.63:0/3475931367 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f6e38036640 0x7f6e38038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:38.608 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.245+0000 7f6e51266700 1 -- 172.21.15.63:0/3475931367 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e4c04bb80 con 0x7f6e4c070f80 2023-12-07T16:14:38.609 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.246+0000 7f6e437fe700 1 -- 172.21.15.63:0/3475931367 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6e3404aad0 con 0x7f6e4c070f80 2023-12-07T16:14:38.609 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.246+0000 7f6e4a7fc700 1 --2- 172.21.15.63:0/3475931367 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f6e38036640 0x7f6e38038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:38.609 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.246+0000 7f6e4a7fc700 1 --2- 172.21.15.63:0/3475931367 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f6e38036640 0x7f6e38038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c009990 tx=0x7f6e3c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:38.609 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.251+0000 7f6e437fe700 1 -- 172.21.15.63:0/3475931367 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6e340239e0 con 0x7f6e4c070f80 2023-12-07T16:14:38.609 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.446+0000 7f6e51266700 1 -- 172.21.15.63:0/3475931367 --> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e4c10d1b0 con 0x7f6e38036640 2023-12-07T16:14:38.609 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.447+0000 7f6e437fe700 1 -- 172.21.15.63:0/3475931367 <== mgr.14120 v2:172.21.15.63:6800/1052036735 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f6e4c10d1b0 con 0x7f6e38036640 2023-12-07T16:14:38.609 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.449+0000 7f6e51266700 1 -- 172.21.15.63:0/3475931367 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f6e38036640 msgr2=0x7f6e38038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:38.609 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.449+0000 7f6e51266700 1 --2- 172.21.15.63:0/3475931367 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f6e38036640 0x7f6e38038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c009990 tx=0x7f6e3c006e40 comp rx=0 tx=0).stop 2023-12-07T16:14:38.609 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.449+0000 7f6e51266700 1 -- 172.21.15.63:0/3475931367 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e4c070f80 msgr2=0x7f6e4c113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:38.609 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.449+0000 7f6e51266700 1 --2- 172.21.15.63:0/3475931367 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e4c070f80 0x7f6e4c113380 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6e34006b00 tx=0x7f6e34009250 comp rx=0 tx=0).stop 2023-12-07T16:14:38.609 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.449+0000 7f6e51266700 1 -- 172.21.15.63:0/3475931367 shutdown_connections 2023-12-07T16:14:38.609 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.449+0000 7f6e51266700 1 --2- 172.21.15.63:0/3475931367 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f6e38036640 0x7f6e38038af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:38.609 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.449+0000 7f6e51266700 1 --2- 172.21.15.63:0/3475931367 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e4c070f80 0x7f6e4c113380 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:38.609 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.449+0000 7f6e51266700 1 -- 172.21.15.63:0/3475931367 >> 172.21.15.63:0/3475931367 conn(0x7f6e4c0fc970 msgr2=0x7f6e4c0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:38.610 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.449+0000 7f6e51266700 1 -- 172.21.15.63:0/3475931367 shutdown_connections 2023-12-07T16:14:38.610 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:36.449+0000 7f6e51266700 1 -- 172.21.15.63:0/3475931367 wait complete. 2023-12-07T16:14:38.610 INFO:teuthology.orchestra.run.smithi063.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-12-07T16:14:38.610 INFO:teuthology.orchestra.run.smithi063.stdout:Adding key to root@localhost authorized_keys... 2023-12-07T16:14:38.610 INFO:teuthology.orchestra.run.smithi063.stdout:Adding host smithi063... 2023-12-07T16:14:40.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:40 smithi063 ceph-mon[112095]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi063", "addr": "172.21.15.63", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:14:40.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:40 smithi063 ceph-mon[112095]: Deploying cephadm binary to smithi063 2023-12-07T16:14:41.895 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Added host 'smithi063' with addr '172.21.15.63' 2023-12-07T16:14:41.895 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.557+0000 7f2d28050700 1 Processor -- start 2023-12-07T16:14:41.895 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.557+0000 7f2d28050700 1 -- start start 2023-12-07T16:14:41.895 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.557+0000 7f2d28050700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d20071000 0x7f2d20104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:41.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.557+0000 7f2d28050700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d201053e0 con 0x7f2d20071000 2023-12-07T16:14:41.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.557+0000 7f2d25dec700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d20071000 0x7f2d20104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:41.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.557+0000 7f2d25dec700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d20071000 0x7f2d20104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55220/0 (socket says 172.21.15.63:55220) 2023-12-07T16:14:41.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.557+0000 7f2d25dec700 1 -- 172.21.15.63:0/751458672 learned_addr learned my addr 172.21.15.63:0/751458672 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:41.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.558+0000 7f2d25dec700 1 -- 172.21.15.63:0/751458672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d20105520 con 0x7f2d20071000 2023-12-07T16:14:41.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.558+0000 7f2d25dec700 1 --2- 172.21.15.63:0/751458672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d20071000 0x7f2d20104ea0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0098e0 tx=0x7f2d1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=335290a015e06631 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:41.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.558+0000 7f2d24dea700 1 -- 172.21.15.63:0/751458672 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d1c00b860 con 0x7f2d20071000 2023-12-07T16:14:41.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.558+0000 7f2d24dea700 1 -- 172.21.15.63:0/751458672 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f2d1c00be30 con 0x7f2d20071000 2023-12-07T16:14:41.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.558+0000 7f2d24dea700 1 -- 172.21.15.63:0/751458672 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d1c010380 con 0x7f2d20071000 2023-12-07T16:14:41.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.559+0000 7f2d28050700 1 -- 172.21.15.63:0/751458672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d20071000 msgr2=0x7f2d20104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:41.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.559+0000 7f2d28050700 1 --2- 172.21.15.63:0/751458672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d20071000 0x7f2d20104ea0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0098e0 tx=0x7f2d1c009250 comp rx=0 tx=0).stop 2023-12-07T16:14:41.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.559+0000 7f2d28050700 1 -- 172.21.15.63:0/751458672 shutdown_connections 2023-12-07T16:14:41.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.559+0000 7f2d28050700 1 --2- 172.21.15.63:0/751458672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d20071000 0x7f2d20104ea0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:41.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.559+0000 7f2d28050700 1 -- 172.21.15.63:0/751458672 >> 172.21.15.63:0/751458672 conn(0x7f2d200fc970 msgr2=0x7f2d200fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:41.896 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.559+0000 7f2d28050700 1 -- 172.21.15.63:0/751458672 shutdown_connections 2023-12-07T16:14:41.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.559+0000 7f2d28050700 1 -- 172.21.15.63:0/751458672 wait complete. 2023-12-07T16:14:41.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.559+0000 7f2d28050700 1 Processor -- start 2023-12-07T16:14:41.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.559+0000 7f2d28050700 1 -- start start 2023-12-07T16:14:41.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.559+0000 7f2d28050700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d20071000 0x7f2d20102920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:41.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.559+0000 7f2d28050700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d20100da0 con 0x7f2d20071000 2023-12-07T16:14:41.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.560+0000 7f2d25dec700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d20071000 0x7f2d20102920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:41.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.560+0000 7f2d25dec700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d20071000 0x7f2d20102920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55230/0 (socket says 172.21.15.63:55230) 2023-12-07T16:14:41.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.560+0000 7f2d25dec700 1 -- 172.21.15.63:0/382445712 learned_addr learned my addr 172.21.15.63:0/382445712 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:41.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.560+0000 7f2d25dec700 1 -- 172.21.15.63:0/382445712 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1c0094f0 con 0x7f2d20071000 2023-12-07T16:14:41.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.560+0000 7f2d25dec700 1 --2- 172.21.15.63:0/382445712 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d20071000 0x7f2d20102920 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c006d40 tx=0x7f2d1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:41.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.560+0000 7f2d127fc700 1 -- 172.21.15.63:0/382445712 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d1c0109b0 con 0x7f2d20071000 2023-12-07T16:14:41.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.560+0000 7f2d127fc700 1 -- 172.21.15.63:0/382445712 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f2d1c024440 con 0x7f2d20071000 2023-12-07T16:14:41.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.560+0000 7f2d28050700 1 -- 172.21.15.63:0/382445712 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d20100fa0 con 0x7f2d20071000 2023-12-07T16:14:41.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.560+0000 7f2d127fc700 1 -- 172.21.15.63:0/382445712 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d1c01a5f0 con 0x7f2d20071000 2023-12-07T16:14:41.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.560+0000 7f2d28050700 1 -- 172.21.15.63:0/382445712 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d201013b0 con 0x7f2d20071000 2023-12-07T16:14:41.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.561+0000 7f2d127fc700 1 -- 172.21.15.63:0/382445712 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f2d1c01a820 con 0x7f2d20071000 2023-12-07T16:14:41.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.561+0000 7f2d127fc700 1 --2- 172.21.15.63:0/382445712 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f2d0c036640 0x7f2d0c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:41.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.561+0000 7f2d28050700 1 -- 172.21.15.63:0/382445712 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d2004bb80 con 0x7f2d20071000 2023-12-07T16:14:41.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.561+0000 7f2d127fc700 1 -- 172.21.15.63:0/382445712 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f2d1c04a550 con 0x7f2d20071000 2023-12-07T16:14:41.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.561+0000 7f2d255eb700 1 --2- 172.21.15.63:0/382445712 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f2d0c036640 0x7f2d0c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:41.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.562+0000 7f2d255eb700 1 --2- 172.21.15.63:0/382445712 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f2d0c036640 0x7f2d0c038af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009990 tx=0x7f2d14006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:41.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.566+0000 7f2d127fc700 1 -- 172.21.15.63:0/382445712 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2d1c01aad0 con 0x7f2d20071000 2023-12-07T16:14:41.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:39.762+0000 7f2d28050700 1 -- 172.21.15.63:0/382445712 --> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi063", "addr": "172.21.15.63", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d2010adb0 con 0x7f2d0c036640 2023-12-07T16:14:41.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:41.544+0000 7f2d127fc700 1 -- 172.21.15.63:0/382445712 <== mgr.14120 v2:172.21.15.63:6800/1052036735 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f2d2010adb0 con 0x7f2d0c036640 2023-12-07T16:14:41.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:41.547+0000 7f2d28050700 1 -- 172.21.15.63:0/382445712 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f2d0c036640 msgr2=0x7f2d0c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:41.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:41.547+0000 7f2d28050700 1 --2- 172.21.15.63:0/382445712 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f2d0c036640 0x7f2d0c038af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009990 tx=0x7f2d14006e40 comp rx=0 tx=0).stop 2023-12-07T16:14:41.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:41.547+0000 7f2d28050700 1 -- 172.21.15.63:0/382445712 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d20071000 msgr2=0x7f2d20102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:41.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:41.547+0000 7f2d28050700 1 --2- 172.21.15.63:0/382445712 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d20071000 0x7f2d20102920 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c006d40 tx=0x7f2d1c009250 comp rx=0 tx=0).stop 2023-12-07T16:14:41.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:41.547+0000 7f2d28050700 1 -- 172.21.15.63:0/382445712 shutdown_connections 2023-12-07T16:14:41.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:41.547+0000 7f2d28050700 1 --2- 172.21.15.63:0/382445712 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f2d0c036640 0x7f2d0c038af0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:41.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:41.547+0000 7f2d28050700 1 --2- 172.21.15.63:0/382445712 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d20071000 0x7f2d20102920 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:41.899 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:41.547+0000 7f2d28050700 1 -- 172.21.15.63:0/382445712 >> 172.21.15.63:0/382445712 conn(0x7f2d200fc970 msgr2=0x7f2d200fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:41.899 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:41.547+0000 7f2d28050700 1 -- 172.21.15.63:0/382445712 shutdown_connections 2023-12-07T16:14:41.899 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:41.547+0000 7f2d28050700 1 -- 172.21.15.63:0/382445712 wait complete. 2023-12-07T16:14:41.899 INFO:teuthology.orchestra.run.smithi063.stdout:Deploying mon service with default placement... 2023-12-07T16:14:42.867 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:42 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' 2023-12-07T16:14:42.867 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:42 smithi063 ceph-mon[112095]: Added host smithi063 2023-12-07T16:14:42.867 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:42 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:14:42.867 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:42 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' 2023-12-07T16:14:43.345 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-12-07T16:14:43.345 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.281+0000 7fc95ad74700 1 Processor -- start 2023-12-07T16:14:43.345 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.281+0000 7fc95ad74700 1 -- start start 2023-12-07T16:14:43.345 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.281+0000 7fc95ad74700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9541011d0 0x7fc9541015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:43.345 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.281+0000 7fc95ad74700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc954101b20 con 0x7fc9541011d0 2023-12-07T16:14:43.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.281+0000 7fc958b10700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9541011d0 0x7fc9541015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:43.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.281+0000 7fc958b10700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9541011d0 0x7fc9541015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55242/0 (socket says 172.21.15.63:55242) 2023-12-07T16:14:43.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.282+0000 7fc958b10700 1 -- 172.21.15.63:0/3980000021 learned_addr learned my addr 172.21.15.63:0/3980000021 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:43.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.282+0000 7fc958b10700 1 -- 172.21.15.63:0/3980000021 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc954101c60 con 0x7fc9541011d0 2023-12-07T16:14:43.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.282+0000 7fc958b10700 1 --2- 172.21.15.63:0/3980000021 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9541011d0 0x7fc9541015e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc9480098e0 tx=0x7fc948009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a36c74f9bd3e9ab server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:43.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.282+0000 7fc9537fe700 1 -- 172.21.15.63:0/3980000021 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc94800b860 con 0x7fc9541011d0 2023-12-07T16:14:43.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.282+0000 7fc9537fe700 1 -- 172.21.15.63:0/3980000021 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fc94800be30 con 0x7fc9541011d0 2023-12-07T16:14:43.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.282+0000 7fc9537fe700 1 -- 172.21.15.63:0/3980000021 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc948010380 con 0x7fc9541011d0 2023-12-07T16:14:43.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.283+0000 7fc95ad74700 1 -- 172.21.15.63:0/3980000021 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9541011d0 msgr2=0x7fc9541015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:43.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.283+0000 7fc95ad74700 1 --2- 172.21.15.63:0/3980000021 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9541011d0 0x7fc9541015e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc9480098e0 tx=0x7fc948009250 comp rx=0 tx=0).stop 2023-12-07T16:14:43.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.283+0000 7fc95ad74700 1 -- 172.21.15.63:0/3980000021 shutdown_connections 2023-12-07T16:14:43.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.283+0000 7fc95ad74700 1 --2- 172.21.15.63:0/3980000021 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9541011d0 0x7fc9541015e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:43.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.283+0000 7fc95ad74700 1 -- 172.21.15.63:0/3980000021 >> 172.21.15.63:0/3980000021 conn(0x7fc9540fc970 msgr2=0x7fc9540fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:43.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.283+0000 7fc95ad74700 1 -- 172.21.15.63:0/3980000021 shutdown_connections 2023-12-07T16:14:43.346 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.283+0000 7fc95ad74700 1 -- 172.21.15.63:0/3980000021 wait complete. 2023-12-07T16:14:43.347 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.283+0000 7fc95ad74700 1 Processor -- start 2023-12-07T16:14:43.347 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.283+0000 7fc95ad74700 1 -- start start 2023-12-07T16:14:43.347 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.283+0000 7fc95ad74700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9541011d0 0x7fc954113df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:43.347 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.283+0000 7fc95ad74700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc954070ff0 con 0x7fc9541011d0 2023-12-07T16:14:43.347 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.284+0000 7fc958b10700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9541011d0 0x7fc954113df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:43.347 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.284+0000 7fc958b10700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9541011d0 0x7fc954113df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55248/0 (socket says 172.21.15.63:55248) 2023-12-07T16:14:43.347 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.284+0000 7fc958b10700 1 -- 172.21.15.63:0/4111801449 learned_addr learned my addr 172.21.15.63:0/4111801449 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:43.347 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.284+0000 7fc958b10700 1 -- 172.21.15.63:0/4111801449 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9480094f0 con 0x7fc9541011d0 2023-12-07T16:14:43.347 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.284+0000 7fc958b10700 1 --2- 172.21.15.63:0/4111801449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9541011d0 0x7fc954113df0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc948000c00 tx=0x7fc948009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:43.347 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.284+0000 7fc9517fa700 1 -- 172.21.15.63:0/4111801449 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc948010a80 con 0x7fc9541011d0 2023-12-07T16:14:43.347 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.284+0000 7fc95ad74700 1 -- 172.21.15.63:0/4111801449 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9540711f0 con 0x7fc9541011d0 2023-12-07T16:14:43.347 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.284+0000 7fc9517fa700 1 -- 172.21.15.63:0/4111801449 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fc94801a430 con 0x7fc9541011d0 2023-12-07T16:14:43.347 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.284+0000 7fc9517fa700 1 -- 172.21.15.63:0/4111801449 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc9480245b0 con 0x7fc9541011d0 2023-12-07T16:14:43.347 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.284+0000 7fc95ad74700 1 -- 172.21.15.63:0/4111801449 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9541144f0 con 0x7fc9541011d0 2023-12-07T16:14:43.347 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.285+0000 7fc9517fa700 1 -- 172.21.15.63:0/4111801449 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fc9480247f0 con 0x7fc9541011d0 2023-12-07T16:14:43.347 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.285+0000 7fc95ad74700 1 -- 172.21.15.63:0/4111801449 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc95410a050 con 0x7fc9541011d0 2023-12-07T16:14:43.348 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.285+0000 7fc9517fa700 1 --2- 172.21.15.63:0/4111801449 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fc9440365f0 0x7fc944038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:43.348 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.285+0000 7fc9517fa700 1 -- 172.21.15.63:0/4111801449 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc94804acd0 con 0x7fc9541011d0 2023-12-07T16:14:43.348 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.285+0000 7fc953fff700 1 --2- 172.21.15.63:0/4111801449 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fc9440365f0 0x7fc944038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:43.348 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.286+0000 7fc953fff700 1 --2- 172.21.15.63:0/4111801449 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fc9440365f0 0x7fc944038aa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc940009990 tx=0x7fc940006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:43.348 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.290+0000 7fc9517fa700 1 -- 172.21.15.63:0/4111801449 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc948023570 con 0x7fc9541011d0 2023-12-07T16:14:43.348 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.515+0000 7fc95ad74700 1 -- 172.21.15.63:0/4111801449 --> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7fc95402b290 con 0x7fc9440365f0 2023-12-07T16:14:43.348 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.521+0000 7fc9517fa700 1 -- 172.21.15.63:0/4111801449 <== mgr.14120 v2:172.21.15.63:6800/1052036735 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fc95402b290 con 0x7fc9440365f0 2023-12-07T16:14:43.348 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.523+0000 7fc95ad74700 1 -- 172.21.15.63:0/4111801449 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fc9440365f0 msgr2=0x7fc944038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:43.348 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.523+0000 7fc95ad74700 1 --2- 172.21.15.63:0/4111801449 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fc9440365f0 0x7fc944038aa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc940009990 tx=0x7fc940006e40 comp rx=0 tx=0).stop 2023-12-07T16:14:43.348 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.523+0000 7fc95ad74700 1 -- 172.21.15.63:0/4111801449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9541011d0 msgr2=0x7fc954113df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:43.348 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.523+0000 7fc95ad74700 1 --2- 172.21.15.63:0/4111801449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9541011d0 0x7fc954113df0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc948000c00 tx=0x7fc948009250 comp rx=0 tx=0).stop 2023-12-07T16:14:43.348 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.523+0000 7fc95ad74700 1 -- 172.21.15.63:0/4111801449 shutdown_connections 2023-12-07T16:14:43.348 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.523+0000 7fc95ad74700 1 --2- 172.21.15.63:0/4111801449 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fc9440365f0 0x7fc944038aa0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:43.348 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.523+0000 7fc95ad74700 1 --2- 172.21.15.63:0/4111801449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9541011d0 0x7fc954113df0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:43.348 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.523+0000 7fc95ad74700 1 -- 172.21.15.63:0/4111801449 >> 172.21.15.63:0/4111801449 conn(0x7fc9540fc970 msgr2=0x7fc9540fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:43.348 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.523+0000 7fc95ad74700 1 -- 172.21.15.63:0/4111801449 shutdown_connections 2023-12-07T16:14:43.349 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:42.523+0000 7fc95ad74700 1 -- 172.21.15.63:0/4111801449 wait complete. 2023-12-07T16:14:43.349 INFO:teuthology.orchestra.run.smithi063.stdout:Deploying mgr service with default placement... 2023-12-07T16:14:43.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:43 smithi063 ceph-mon[112095]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:14:43.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:43 smithi063 ceph-mon[112095]: Saving service mon spec with placement count:5 2023-12-07T16:14:43.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:43 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' 2023-12-07T16:14:44.446 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-12-07T16:14:44.446 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.797+0000 7f1694998700 1 Processor -- start 2023-12-07T16:14:44.446 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.797+0000 7f1694998700 1 -- start start 2023-12-07T16:14:44.446 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.797+0000 7f1694998700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16901028e0 0x7f1690102cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:44.446 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.797+0000 7f1694998700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1690103230 con 0x7f16901028e0 2023-12-07T16:14:44.446 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.797+0000 7f168e59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16901028e0 0x7f1690102cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:44.446 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.797+0000 7f168e59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16901028e0 0x7f1690102cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55252/0 (socket says 172.21.15.63:55252) 2023-12-07T16:14:44.447 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.797+0000 7f168e59c700 1 -- 172.21.15.63:0/2289428563 learned_addr learned my addr 172.21.15.63:0/2289428563 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:44.447 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.798+0000 7f168e59c700 1 -- 172.21.15.63:0/2289428563 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1690103370 con 0x7f16901028e0 2023-12-07T16:14:44.447 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.798+0000 7f168e59c700 1 --2- 172.21.15.63:0/2289428563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16901028e0 0x7f1690102cf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f16800098e0 tx=0x7f1680009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c09ca031d480b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:44.447 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.798+0000 7f168d59a700 1 -- 172.21.15.63:0/2289428563 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f168000b8f0 con 0x7f16901028e0 2023-12-07T16:14:44.447 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.798+0000 7f168d59a700 1 -- 172.21.15.63:0/2289428563 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1680011420 con 0x7f16901028e0 2023-12-07T16:14:44.447 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.798+0000 7f168d59a700 1 -- 172.21.15.63:0/2289428563 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1680010540 con 0x7f16901028e0 2023-12-07T16:14:44.447 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.799+0000 7f1694998700 1 -- 172.21.15.63:0/2289428563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16901028e0 msgr2=0x7f1690102cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:44.447 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.799+0000 7f1694998700 1 --2- 172.21.15.63:0/2289428563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16901028e0 0x7f1690102cf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f16800098e0 tx=0x7f1680009250 comp rx=0 tx=0).stop 2023-12-07T16:14:44.447 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.799+0000 7f1694998700 1 -- 172.21.15.63:0/2289428563 shutdown_connections 2023-12-07T16:14:44.447 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.799+0000 7f1694998700 1 --2- 172.21.15.63:0/2289428563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16901028e0 0x7f1690102cf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:44.447 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.799+0000 7f1694998700 1 -- 172.21.15.63:0/2289428563 >> 172.21.15.63:0/2289428563 conn(0x7f16900fc0b0 msgr2=0x7f16900fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:44.447 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.799+0000 7f1694998700 1 -- 172.21.15.63:0/2289428563 shutdown_connections 2023-12-07T16:14:44.447 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.799+0000 7f1694998700 1 -- 172.21.15.63:0/2289428563 wait complete. 2023-12-07T16:14:44.447 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.799+0000 7f1694998700 1 Processor -- start 2023-12-07T16:14:44.447 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.799+0000 7f1694998700 1 -- start start 2023-12-07T16:14:44.447 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.800+0000 7f1694998700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16901028e0 0x7f1690113410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:44.448 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.800+0000 7f1694998700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1690113950 con 0x7f16901028e0 2023-12-07T16:14:44.448 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.800+0000 7f168e59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16901028e0 0x7f1690113410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:44.448 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.800+0000 7f168e59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16901028e0 0x7f1690113410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55264/0 (socket says 172.21.15.63:55264) 2023-12-07T16:14:44.448 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.800+0000 7f168e59c700 1 -- 172.21.15.63:0/3123504220 learned_addr learned my addr 172.21.15.63:0/3123504220 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:44.448 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.800+0000 7f168e59c700 1 -- 172.21.15.63:0/3123504220 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16800094f0 con 0x7f16901028e0 2023-12-07T16:14:44.448 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.800+0000 7f168e59c700 1 --2- 172.21.15.63:0/3123504220 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16901028e0 0x7f1690113410 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1680011d60 tx=0x7f1680009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:44.448 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.800+0000 7f167effd700 1 -- 172.21.15.63:0/3123504220 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f16800107b0 con 0x7f16901028e0 2023-12-07T16:14:44.448 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.800+0000 7f167effd700 1 -- 172.21.15.63:0/3123504220 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1680010dc0 con 0x7f16901028e0 2023-12-07T16:14:44.448 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.800+0000 7f1694998700 1 -- 172.21.15.63:0/3123504220 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1690113b50 con 0x7f16901028e0 2023-12-07T16:14:44.448 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.800+0000 7f167effd700 1 -- 172.21.15.63:0/3123504220 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f168001ad00 con 0x7f16901028e0 2023-12-07T16:14:44.448 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.800+0000 7f1694998700 1 -- 172.21.15.63:0/3123504220 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1690113f60 con 0x7f16901028e0 2023-12-07T16:14:44.448 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.801+0000 7f167effd700 1 -- 172.21.15.63:0/3123504220 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f168002e440 con 0x7f16901028e0 2023-12-07T16:14:44.448 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.802+0000 7f167effd700 1 --2- 172.21.15.63:0/3123504220 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f1678036640 0x7f1678038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:44.448 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.802+0000 7f167effd700 1 -- 172.21.15.63:0/3123504220 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f168004a3f0 con 0x7f16901028e0 2023-12-07T16:14:44.448 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.802+0000 7f1694998700 1 -- 172.21.15.63:0/3123504220 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169004bb80 con 0x7f16901028e0 2023-12-07T16:14:44.448 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.802+0000 7f168dd9b700 1 --2- 172.21.15.63:0/3123504220 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f1678036640 0x7f1678038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:44.449 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.802+0000 7f168dd9b700 1 --2- 172.21.15.63:0/3123504220 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f1678036640 0x7f1678038af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1684009990 tx=0x7f1684006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:44.449 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:43.806+0000 7f167effd700 1 -- 172.21.15.63:0/3123504220 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1680018940 con 0x7f16901028e0 2023-12-07T16:14:44.449 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.013+0000 7f1694998700 1 -- 172.21.15.63:0/3123504220 --> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f169010d020 con 0x7f1678036640 2023-12-07T16:14:44.449 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.018+0000 7f167effd700 1 -- 172.21.15.63:0/3123504220 <== mgr.14120 v2:172.21.15.63:6800/1052036735 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f169010d020 con 0x7f1678036640 2023-12-07T16:14:44.449 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.020+0000 7f1694998700 1 -- 172.21.15.63:0/3123504220 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f1678036640 msgr2=0x7f1678038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:44.449 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.020+0000 7f1694998700 1 --2- 172.21.15.63:0/3123504220 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f1678036640 0x7f1678038af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1684009990 tx=0x7f1684006e40 comp rx=0 tx=0).stop 2023-12-07T16:14:44.449 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.020+0000 7f1694998700 1 -- 172.21.15.63:0/3123504220 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16901028e0 msgr2=0x7f1690113410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:44.449 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.021+0000 7f1694998700 1 --2- 172.21.15.63:0/3123504220 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16901028e0 0x7f1690113410 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1680011d60 tx=0x7f1680009250 comp rx=0 tx=0).stop 2023-12-07T16:14:44.449 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.021+0000 7f1694998700 1 -- 172.21.15.63:0/3123504220 shutdown_connections 2023-12-07T16:14:44.449 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.021+0000 7f1694998700 1 --2- 172.21.15.63:0/3123504220 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f1678036640 0x7f1678038af0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:44.449 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.021+0000 7f1694998700 1 --2- 172.21.15.63:0/3123504220 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16901028e0 0x7f1690113410 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:44.449 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.021+0000 7f1694998700 1 -- 172.21.15.63:0/3123504220 >> 172.21.15.63:0/3123504220 conn(0x7f16900fc0b0 msgr2=0x7f16900fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:44.449 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.021+0000 7f1694998700 1 -- 172.21.15.63:0/3123504220 shutdown_connections 2023-12-07T16:14:44.449 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.021+0000 7f1694998700 1 -- 172.21.15.63:0/3123504220 wait complete. 2023-12-07T16:14:44.449 INFO:teuthology.orchestra.run.smithi063.stdout:Deploying crash service with default placement... 2023-12-07T16:14:45.095 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:44 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' 2023-12-07T16:14:45.095 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:44 smithi063 ceph-mon[112095]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:14:45.095 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:44 smithi063 ceph-mon[112095]: Saving service mgr spec with placement count:2 2023-12-07T16:14:45.096 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:44 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' 2023-12-07T16:14:45.462 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2023-12-07T16:14:45.462 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.844+0000 7f5185752700 1 Processor -- start 2023-12-07T16:14:45.462 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.844+0000 7f5185752700 1 -- start start 2023-12-07T16:14:45.462 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.844+0000 7f5185752700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51801022b0 0x7f51801026c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:45.462 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.844+0000 7f5185752700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5180102c00 con 0x7f51801022b0 2023-12-07T16:14:45.462 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.845+0000 7f517effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51801022b0 0x7f51801026c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:45.462 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.845+0000 7f517effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51801022b0 0x7f51801026c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55274/0 (socket says 172.21.15.63:55274) 2023-12-07T16:14:45.462 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.845+0000 7f517effd700 1 -- 172.21.15.63:0/4104171626 learned_addr learned my addr 172.21.15.63:0/4104171626 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:45.462 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.845+0000 7f517effd700 1 -- 172.21.15.63:0/4104171626 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5180102d40 con 0x7f51801022b0 2023-12-07T16:14:45.462 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.845+0000 7f517effd700 1 --2- 172.21.15.63:0/4104171626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51801022b0 0x7f51801026c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f51700098e0 tx=0x7f5170009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6153792dd95c5fd server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:45.463 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.845+0000 7f517dffb700 1 -- 172.21.15.63:0/4104171626 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f517000b860 con 0x7f51801022b0 2023-12-07T16:14:45.463 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.845+0000 7f517dffb700 1 -- 172.21.15.63:0/4104171626 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f517000be70 con 0x7f51801022b0 2023-12-07T16:14:45.463 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.845+0000 7f517dffb700 1 -- 172.21.15.63:0/4104171626 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5170010380 con 0x7f51801022b0 2023-12-07T16:14:45.463 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.846+0000 7f5185752700 1 -- 172.21.15.63:0/4104171626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51801022b0 msgr2=0x7f51801026c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:45.463 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.846+0000 7f5185752700 1 --2- 172.21.15.63:0/4104171626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51801022b0 0x7f51801026c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f51700098e0 tx=0x7f5170009250 comp rx=0 tx=0).stop 2023-12-07T16:14:45.463 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.846+0000 7f5185752700 1 -- 172.21.15.63:0/4104171626 shutdown_connections 2023-12-07T16:14:45.463 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.846+0000 7f5185752700 1 --2- 172.21.15.63:0/4104171626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51801022b0 0x7f51801026c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:45.463 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.846+0000 7f5185752700 1 -- 172.21.15.63:0/4104171626 >> 172.21.15.63:0/4104171626 conn(0x7f51800fda10 msgr2=0x7f51800ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:45.463 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.846+0000 7f5185752700 1 -- 172.21.15.63:0/4104171626 shutdown_connections 2023-12-07T16:14:45.463 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.846+0000 7f5185752700 1 -- 172.21.15.63:0/4104171626 wait complete. 2023-12-07T16:14:45.463 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.847+0000 7f5185752700 1 Processor -- start 2023-12-07T16:14:45.463 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.847+0000 7f5185752700 1 -- start start 2023-12-07T16:14:45.463 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.847+0000 7f5185752700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51801022b0 0x7f5180111190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:45.463 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.847+0000 7f5185752700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51801116d0 con 0x7f51801022b0 2023-12-07T16:14:45.463 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.847+0000 7f517effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51801022b0 0x7f5180111190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:45.463 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.847+0000 7f517effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51801022b0 0x7f5180111190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55282/0 (socket says 172.21.15.63:55282) 2023-12-07T16:14:45.463 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.847+0000 7f517effd700 1 -- 172.21.15.63:0/636155028 learned_addr learned my addr 172.21.15.63:0/636155028 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:45.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.847+0000 7f517effd700 1 -- 172.21.15.63:0/636155028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51700094f0 con 0x7f51801022b0 2023-12-07T16:14:45.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.848+0000 7f517effd700 1 --2- 172.21.15.63:0/636155028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51801022b0 0x7f5180111190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f517000c010 tx=0x7f5170009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:45.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.848+0000 7f51677fe700 1 -- 172.21.15.63:0/636155028 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5170010960 con 0x7f51801022b0 2023-12-07T16:14:45.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.848+0000 7f51677fe700 1 -- 172.21.15.63:0/636155028 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f517001a430 con 0x7f51801022b0 2023-12-07T16:14:45.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.848+0000 7f51677fe700 1 -- 172.21.15.63:0/636155028 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5170019580 con 0x7f51801022b0 2023-12-07T16:14:45.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.848+0000 7f5185752700 1 -- 172.21.15.63:0/636155028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51801118d0 con 0x7f51801022b0 2023-12-07T16:14:45.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.848+0000 7f5185752700 1 -- 172.21.15.63:0/636155028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5180111ce0 con 0x7f51801022b0 2023-12-07T16:14:45.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.849+0000 7f51677fe700 1 -- 172.21.15.63:0/636155028 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f5170019800 con 0x7f51801022b0 2023-12-07T16:14:45.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.849+0000 7f51677fe700 1 --2- 172.21.15.63:0/636155028 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f51680365f0 0x7f5168038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:45.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.849+0000 7f51677fe700 1 -- 172.21.15.63:0/636155028 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f517004b440 con 0x7f51801022b0 2023-12-07T16:14:45.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.849+0000 7f5185752700 1 -- 172.21.15.63:0/636155028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f518004bb80 con 0x7f51801022b0 2023-12-07T16:14:45.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.849+0000 7f517e7fc700 1 --2- 172.21.15.63:0/636155028 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f51680365f0 0x7f5168038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:45.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.850+0000 7f517e7fc700 1 --2- 172.21.15.63:0/636155028 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f51680365f0 0x7f5168038aa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5174009990 tx=0x7f5174006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:45.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:44.854+0000 7f51677fe700 1 -- 172.21.15.63:0/636155028 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f517002bb50 con 0x7f51801022b0 2023-12-07T16:14:45.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.061+0000 7f5185752700 1 -- 172.21.15.63:0/636155028 --> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f518010ad80 con 0x7f51680365f0 2023-12-07T16:14:45.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.068+0000 7f51677fe700 1 -- 172.21.15.63:0/636155028 <== mgr.14120 v2:172.21.15.63:6800/1052036735 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f518010ad80 con 0x7f51680365f0 2023-12-07T16:14:45.465 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.070+0000 7f5185752700 1 -- 172.21.15.63:0/636155028 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f51680365f0 msgr2=0x7f5168038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:45.465 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.070+0000 7f5185752700 1 --2- 172.21.15.63:0/636155028 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f51680365f0 0x7f5168038aa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5174009990 tx=0x7f5174006e40 comp rx=0 tx=0).stop 2023-12-07T16:14:45.465 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.070+0000 7f5185752700 1 -- 172.21.15.63:0/636155028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51801022b0 msgr2=0x7f5180111190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:45.465 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.070+0000 7f5185752700 1 --2- 172.21.15.63:0/636155028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51801022b0 0x7f5180111190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f517000c010 tx=0x7f5170009250 comp rx=0 tx=0).stop 2023-12-07T16:14:45.465 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.070+0000 7f5185752700 1 -- 172.21.15.63:0/636155028 shutdown_connections 2023-12-07T16:14:45.465 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.070+0000 7f5185752700 1 --2- 172.21.15.63:0/636155028 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f51680365f0 0x7f5168038aa0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:45.465 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.070+0000 7f5185752700 1 --2- 172.21.15.63:0/636155028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51801022b0 0x7f5180111190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:45.465 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.070+0000 7f5185752700 1 -- 172.21.15.63:0/636155028 >> 172.21.15.63:0/636155028 conn(0x7f51800fda10 msgr2=0x7f51800ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:45.465 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.070+0000 7f5185752700 1 -- 172.21.15.63:0/636155028 shutdown_connections 2023-12-07T16:14:45.465 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.070+0000 7f5185752700 1 -- 172.21.15.63:0/636155028 wait complete. 2023-12-07T16:14:45.465 INFO:teuthology.orchestra.run.smithi063.stdout:Deploying prometheus service with default placement... 2023-12-07T16:14:46.351 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:46 smithi063 ceph-mon[112095]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:14:46.351 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:46 smithi063 ceph-mon[112095]: Saving service crash spec with placement * 2023-12-07T16:14:46.351 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:46 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' 2023-12-07T16:14:46.351 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:46 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' 2023-12-07T16:14:46.351 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:46 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' 2023-12-07T16:14:46.351 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:46 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' 2023-12-07T16:14:46.412 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2023-12-07T16:14:46.412 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.830+0000 7fa068965700 1 Processor -- start 2023-12-07T16:14:46.412 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.830+0000 7fa068965700 1 -- start start 2023-12-07T16:14:46.412 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.831+0000 7fa068965700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa064071000 0x7fa064104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:46.412 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.831+0000 7fa068965700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0641053e0 con 0x7fa064071000 2023-12-07T16:14:46.412 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.831+0000 7fa06259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa064071000 0x7fa064104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:46.412 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.831+0000 7fa06259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa064071000 0x7fa064104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55294/0 (socket says 172.21.15.63:55294) 2023-12-07T16:14:46.412 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.831+0000 7fa06259c700 1 -- 172.21.15.63:0/3907472156 learned_addr learned my addr 172.21.15.63:0/3907472156 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:46.412 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.831+0000 7fa06259c700 1 -- 172.21.15.63:0/3907472156 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa064105520 con 0x7fa064071000 2023-12-07T16:14:46.412 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.831+0000 7fa06259c700 1 --2- 172.21.15.63:0/3907472156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa064071000 0x7fa064104ea0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa0540098e0 tx=0x7fa054009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9859b971f3d758c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:46.413 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.832+0000 7fa06159a700 1 -- 172.21.15.63:0/3907472156 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa05400b860 con 0x7fa064071000 2023-12-07T16:14:46.413 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.832+0000 7fa06159a700 1 -- 172.21.15.63:0/3907472156 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa05400be70 con 0x7fa064071000 2023-12-07T16:14:46.413 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.832+0000 7fa06159a700 1 -- 172.21.15.63:0/3907472156 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa054010380 con 0x7fa064071000 2023-12-07T16:14:46.413 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.832+0000 7fa068965700 1 -- 172.21.15.63:0/3907472156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa064071000 msgr2=0x7fa064104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:46.413 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.832+0000 7fa068965700 1 --2- 172.21.15.63:0/3907472156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa064071000 0x7fa064104ea0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa0540098e0 tx=0x7fa054009250 comp rx=0 tx=0).stop 2023-12-07T16:14:46.413 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.832+0000 7fa068965700 1 -- 172.21.15.63:0/3907472156 shutdown_connections 2023-12-07T16:14:46.413 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.832+0000 7fa068965700 1 --2- 172.21.15.63:0/3907472156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa064071000 0x7fa064104ea0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:46.413 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.832+0000 7fa068965700 1 -- 172.21.15.63:0/3907472156 >> 172.21.15.63:0/3907472156 conn(0x7fa0640fc970 msgr2=0x7fa0640fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:46.413 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.832+0000 7fa068965700 1 -- 172.21.15.63:0/3907472156 shutdown_connections 2023-12-07T16:14:46.413 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.832+0000 7fa068965700 1 -- 172.21.15.63:0/3907472156 wait complete. 2023-12-07T16:14:46.413 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.833+0000 7fa068965700 1 Processor -- start 2023-12-07T16:14:46.413 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.833+0000 7fa068965700 1 -- start start 2023-12-07T16:14:46.413 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.833+0000 7fa068965700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa064071000 0x7fa0641111a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:46.413 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.833+0000 7fa068965700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0641116e0 con 0x7fa064071000 2023-12-07T16:14:46.413 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.833+0000 7fa06259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa064071000 0x7fa0641111a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:46.413 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.833+0000 7fa06259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa064071000 0x7fa0641111a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55310/0 (socket says 172.21.15.63:55310) 2023-12-07T16:14:46.414 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.833+0000 7fa06259c700 1 -- 172.21.15.63:0/146933644 learned_addr learned my addr 172.21.15.63:0/146933644 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:46.414 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.834+0000 7fa06259c700 1 -- 172.21.15.63:0/146933644 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0540094f0 con 0x7fa064071000 2023-12-07T16:14:46.414 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.834+0000 7fa06259c700 1 --2- 172.21.15.63:0/146933644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa064071000 0x7fa0641111a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa054006d40 tx=0x7fa054009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:46.414 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.834+0000 7fa052ffd700 1 -- 172.21.15.63:0/146933644 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa054010960 con 0x7fa064071000 2023-12-07T16:14:46.414 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.834+0000 7fa052ffd700 1 -- 172.21.15.63:0/146933644 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa05401a430 con 0x7fa064071000 2023-12-07T16:14:46.414 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.834+0000 7fa068965700 1 -- 172.21.15.63:0/146933644 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0641118e0 con 0x7fa064071000 2023-12-07T16:14:46.414 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.834+0000 7fa052ffd700 1 -- 172.21.15.63:0/146933644 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa0540245b0 con 0x7fa064071000 2023-12-07T16:14:46.414 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.834+0000 7fa068965700 1 -- 172.21.15.63:0/146933644 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa064111cf0 con 0x7fa064071000 2023-12-07T16:14:46.414 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.835+0000 7fa068965700 1 -- 172.21.15.63:0/146933644 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa06404bb80 con 0x7fa064071000 2023-12-07T16:14:46.414 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.835+0000 7fa052ffd700 1 -- 172.21.15.63:0/146933644 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fa05402d3f0 con 0x7fa064071000 2023-12-07T16:14:46.414 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.835+0000 7fa052ffd700 1 --2- 172.21.15.63:0/146933644 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fa04c0365f0 0x7fa04c038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:46.414 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.835+0000 7fa052ffd700 1 -- 172.21.15.63:0/146933644 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa05404a240 con 0x7fa064071000 2023-12-07T16:14:46.414 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.835+0000 7fa061d9b700 1 --2- 172.21.15.63:0/146933644 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fa04c0365f0 0x7fa04c038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:46.414 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.836+0000 7fa061d9b700 1 --2- 172.21.15.63:0/146933644 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fa04c0365f0 0x7fa04c038aa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa058009990 tx=0x7fa058006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:46.415 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:45.840+0000 7fa052ffd700 1 -- 172.21.15.63:0/146933644 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa054010ca0 con 0x7fa064071000 2023-12-07T16:14:46.415 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.046+0000 7fa068965700 1 -- 172.21.15.63:0/146933644 --> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fa06410aff0 con 0x7fa04c0365f0 2023-12-07T16:14:46.415 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.053+0000 7fa052ffd700 1 -- 172.21.15.63:0/146933644 <== mgr.14120 v2:172.21.15.63:6800/1052036735 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7fa06410aff0 con 0x7fa04c0365f0 2023-12-07T16:14:46.415 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.055+0000 7fa068965700 1 -- 172.21.15.63:0/146933644 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fa04c0365f0 msgr2=0x7fa04c038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:46.415 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.055+0000 7fa068965700 1 --2- 172.21.15.63:0/146933644 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fa04c0365f0 0x7fa04c038aa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa058009990 tx=0x7fa058006e40 comp rx=0 tx=0).stop 2023-12-07T16:14:46.415 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.055+0000 7fa068965700 1 -- 172.21.15.63:0/146933644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa064071000 msgr2=0x7fa0641111a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:46.415 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.055+0000 7fa068965700 1 --2- 172.21.15.63:0/146933644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa064071000 0x7fa0641111a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa054006d40 tx=0x7fa054009250 comp rx=0 tx=0).stop 2023-12-07T16:14:46.415 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.055+0000 7fa068965700 1 -- 172.21.15.63:0/146933644 shutdown_connections 2023-12-07T16:14:46.415 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.055+0000 7fa068965700 1 --2- 172.21.15.63:0/146933644 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fa04c0365f0 0x7fa04c038aa0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:46.415 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.055+0000 7fa068965700 1 --2- 172.21.15.63:0/146933644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa064071000 0x7fa0641111a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:46.415 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.055+0000 7fa068965700 1 -- 172.21.15.63:0/146933644 >> 172.21.15.63:0/146933644 conn(0x7fa0640fc970 msgr2=0x7fa0640fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:46.415 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.055+0000 7fa068965700 1 -- 172.21.15.63:0/146933644 shutdown_connections 2023-12-07T16:14:46.415 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.055+0000 7fa068965700 1 -- 172.21.15.63:0/146933644 wait complete. 2023-12-07T16:14:46.415 INFO:teuthology.orchestra.run.smithi063.stdout:Deploying grafana service with default placement... 2023-12-07T16:14:47.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:47 smithi063 ceph-mon[112095]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:14:47.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:47 smithi063 ceph-mon[112095]: Saving service prometheus spec with placement count:1 2023-12-07T16:14:47.603 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2023-12-07T16:14:47.603 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.976+0000 7fd1879ad700 1 Processor -- start 2023-12-07T16:14:47.603 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.977+0000 7fd1879ad700 1 -- start start 2023-12-07T16:14:47.603 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.977+0000 7fd1879ad700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1801028e0 0x7fd180102cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:47.603 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.977+0000 7fd1879ad700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd180103230 con 0x7fd1801028e0 2023-12-07T16:14:47.603 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.977+0000 7fd185749700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1801028e0 0x7fd180102cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:47.603 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.977+0000 7fd185749700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1801028e0 0x7fd180102cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55312/0 (socket says 172.21.15.63:55312) 2023-12-07T16:14:47.603 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.977+0000 7fd185749700 1 -- 172.21.15.63:0/1894806269 learned_addr learned my addr 172.21.15.63:0/1894806269 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:47.603 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.977+0000 7fd185749700 1 -- 172.21.15.63:0/1894806269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd180103370 con 0x7fd1801028e0 2023-12-07T16:14:47.603 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.977+0000 7fd185749700 1 --2- 172.21.15.63:0/1894806269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1801028e0 0x7fd180102cf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd17c0098e0 tx=0x7fd17c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1190562df1220 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:47.603 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.977+0000 7fd173fff700 1 -- 172.21.15.63:0/1894806269 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd17c00b8f0 con 0x7fd1801028e0 2023-12-07T16:14:47.603 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.978+0000 7fd173fff700 1 -- 172.21.15.63:0/1894806269 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd17c011420 con 0x7fd1801028e0 2023-12-07T16:14:47.604 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.978+0000 7fd173fff700 1 -- 172.21.15.63:0/1894806269 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd17c010540 con 0x7fd1801028e0 2023-12-07T16:14:47.604 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.978+0000 7fd1879ad700 1 -- 172.21.15.63:0/1894806269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1801028e0 msgr2=0x7fd180102cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:47.604 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.978+0000 7fd1879ad700 1 --2- 172.21.15.63:0/1894806269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1801028e0 0x7fd180102cf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd17c0098e0 tx=0x7fd17c009250 comp rx=0 tx=0).stop 2023-12-07T16:14:47.604 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.978+0000 7fd1879ad700 1 -- 172.21.15.63:0/1894806269 shutdown_connections 2023-12-07T16:14:47.604 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.978+0000 7fd1879ad700 1 --2- 172.21.15.63:0/1894806269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1801028e0 0x7fd180102cf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:47.604 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.978+0000 7fd1879ad700 1 -- 172.21.15.63:0/1894806269 >> 172.21.15.63:0/1894806269 conn(0x7fd1800fc0b0 msgr2=0x7fd1800fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:47.604 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.978+0000 7fd1879ad700 1 -- 172.21.15.63:0/1894806269 shutdown_connections 2023-12-07T16:14:47.604 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.978+0000 7fd1879ad700 1 -- 172.21.15.63:0/1894806269 wait complete. 2023-12-07T16:14:47.604 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.979+0000 7fd1879ad700 1 Processor -- start 2023-12-07T16:14:47.604 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.979+0000 7fd1879ad700 1 -- start start 2023-12-07T16:14:47.604 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.979+0000 7fd1879ad700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1801028e0 0x7fd180113410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:47.604 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.979+0000 7fd1879ad700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd180113950 con 0x7fd1801028e0 2023-12-07T16:14:47.604 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.979+0000 7fd185749700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1801028e0 0x7fd180113410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:47.604 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.979+0000 7fd185749700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1801028e0 0x7fd180113410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55322/0 (socket says 172.21.15.63:55322) 2023-12-07T16:14:47.604 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.979+0000 7fd185749700 1 -- 172.21.15.63:0/205463816 learned_addr learned my addr 172.21.15.63:0/205463816 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:47.604 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.979+0000 7fd185749700 1 -- 172.21.15.63:0/205463816 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c0094f0 con 0x7fd1801028e0 2023-12-07T16:14:47.605 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.980+0000 7fd185749700 1 --2- 172.21.15.63:0/205463816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1801028e0 0x7fd180113410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd17c011b40 tx=0x7fd17c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:47.605 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.980+0000 7fd171ffb700 1 -- 172.21.15.63:0/205463816 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd17c010800 con 0x7fd1801028e0 2023-12-07T16:14:47.605 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.980+0000 7fd1879ad700 1 -- 172.21.15.63:0/205463816 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd180113b50 con 0x7fd1801028e0 2023-12-07T16:14:47.605 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.980+0000 7fd171ffb700 1 -- 172.21.15.63:0/205463816 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd17c010e10 con 0x7fd1801028e0 2023-12-07T16:14:47.605 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.980+0000 7fd171ffb700 1 -- 172.21.15.63:0/205463816 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd17c01ad10 con 0x7fd1801028e0 2023-12-07T16:14:47.605 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.980+0000 7fd1879ad700 1 -- 172.21.15.63:0/205463816 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd180113f60 con 0x7fd1801028e0 2023-12-07T16:14:47.605 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.981+0000 7fd171ffb700 1 -- 172.21.15.63:0/205463816 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fd17c01a5c0 con 0x7fd1801028e0 2023-12-07T16:14:47.605 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.981+0000 7fd171ffb700 1 --2- 172.21.15.63:0/205463816 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fd16c0365f0 0x7fd16c038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:47.605 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.981+0000 7fd1879ad700 1 -- 172.21.15.63:0/205463816 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd18004bb80 con 0x7fd1801028e0 2023-12-07T16:14:47.605 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.981+0000 7fd171ffb700 1 -- 172.21.15.63:0/205463816 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd17c04a4c0 con 0x7fd1801028e0 2023-12-07T16:14:47.605 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.981+0000 7fd184f48700 1 --2- 172.21.15.63:0/205463816 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fd16c0365f0 0x7fd16c038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:47.605 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.981+0000 7fd184f48700 1 --2- 172.21.15.63:0/205463816 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fd16c0365f0 0x7fd16c038aa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd174009990 tx=0x7fd174006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:47.605 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:46.986+0000 7fd171ffb700 1 -- 172.21.15.63:0/205463816 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd17c02cda0 con 0x7fd1801028e0 2023-12-07T16:14:47.605 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:47.195+0000 7fd1879ad700 1 -- 172.21.15.63:0/205463816 --> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fd18010d220 con 0x7fd16c0365f0 2023-12-07T16:14:47.605 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:47.202+0000 7fd171ffb700 1 -- 172.21.15.63:0/205463816 <== mgr.14120 v2:172.21.15.63:6800/1052036735 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fd18010d220 con 0x7fd16c0365f0 2023-12-07T16:14:47.605 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:47.204+0000 7fd1879ad700 1 -- 172.21.15.63:0/205463816 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fd16c0365f0 msgr2=0x7fd16c038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:47.606 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:47.204+0000 7fd1879ad700 1 --2- 172.21.15.63:0/205463816 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fd16c0365f0 0x7fd16c038aa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd174009990 tx=0x7fd174006e40 comp rx=0 tx=0).stop 2023-12-07T16:14:47.606 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:47.204+0000 7fd1879ad700 1 -- 172.21.15.63:0/205463816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1801028e0 msgr2=0x7fd180113410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:47.606 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:47.204+0000 7fd1879ad700 1 --2- 172.21.15.63:0/205463816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1801028e0 0x7fd180113410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd17c011b40 tx=0x7fd17c009250 comp rx=0 tx=0).stop 2023-12-07T16:14:47.606 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:47.204+0000 7fd1879ad700 1 -- 172.21.15.63:0/205463816 shutdown_connections 2023-12-07T16:14:47.606 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:47.204+0000 7fd1879ad700 1 --2- 172.21.15.63:0/205463816 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fd16c0365f0 0x7fd16c038aa0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:47.606 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:47.204+0000 7fd1879ad700 1 --2- 172.21.15.63:0/205463816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1801028e0 0x7fd180113410 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:47.606 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:47.204+0000 7fd1879ad700 1 -- 172.21.15.63:0/205463816 >> 172.21.15.63:0/205463816 conn(0x7fd1800fc0b0 msgr2=0x7fd1800fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:47.606 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:47.205+0000 7fd1879ad700 1 -- 172.21.15.63:0/205463816 shutdown_connections 2023-12-07T16:14:47.606 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:47.205+0000 7fd1879ad700 1 -- 172.21.15.63:0/205463816 wait complete. 2023-12-07T16:14:47.606 INFO:teuthology.orchestra.run.smithi063.stdout:Deploying node-exporter service with default placement... 2023-12-07T16:14:48.551 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:48 smithi063 ceph-mon[112095]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:14:48.551 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:48 smithi063 ceph-mon[112095]: Saving service grafana spec with placement count:1 2023-12-07T16:14:48.551 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:48 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' 2023-12-07T16:14:48.551 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:48 smithi063 ceph-mon[112095]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:14:48.597 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2023-12-07T16:14:48.597 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.015+0000 7f6b1ae2b700 1 Processor -- start 2023-12-07T16:14:48.597 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.015+0000 7f6b1ae2b700 1 -- start start 2023-12-07T16:14:48.597 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.015+0000 7f6b1ae2b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b14076c60 0x7f6b14104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:48.597 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.015+0000 7f6b1ae2b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b141053d0 con 0x7f6b14076c60 2023-12-07T16:14:48.598 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.015+0000 7f6b18bc7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b14076c60 0x7f6b14104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:48.598 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.015+0000 7f6b18bc7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b14076c60 0x7f6b14104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55330/0 (socket says 172.21.15.63:55330) 2023-12-07T16:14:48.598 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.015+0000 7f6b18bc7700 1 -- 172.21.15.63:0/1906817161 learned_addr learned my addr 172.21.15.63:0/1906817161 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:48.598 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.016+0000 7f6b18bc7700 1 -- 172.21.15.63:0/1906817161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b14105510 con 0x7f6b14076c60 2023-12-07T16:14:48.598 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.016+0000 7f6b18bc7700 1 --2- 172.21.15.63:0/1906817161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b14076c60 0x7f6b14104e90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6b080098e0 tx=0x7f6b08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0fec250e728443 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:48.598 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.016+0000 7f6b137fe700 1 -- 172.21.15.63:0/1906817161 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b0800b860 con 0x7f6b14076c60 2023-12-07T16:14:48.598 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.016+0000 7f6b137fe700 1 -- 172.21.15.63:0/1906817161 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6b0800be70 con 0x7f6b14076c60 2023-12-07T16:14:48.598 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.016+0000 7f6b137fe700 1 -- 172.21.15.63:0/1906817161 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b08010380 con 0x7f6b14076c60 2023-12-07T16:14:48.598 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.016+0000 7f6b1ae2b700 1 -- 172.21.15.63:0/1906817161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b14076c60 msgr2=0x7f6b14104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:48.598 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.017+0000 7f6b1ae2b700 1 --2- 172.21.15.63:0/1906817161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b14076c60 0x7f6b14104e90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6b080098e0 tx=0x7f6b08009250 comp rx=0 tx=0).stop 2023-12-07T16:14:48.599 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.017+0000 7f6b1ae2b700 1 -- 172.21.15.63:0/1906817161 shutdown_connections 2023-12-07T16:14:48.599 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.017+0000 7f6b1ae2b700 1 --2- 172.21.15.63:0/1906817161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b14076c60 0x7f6b14104e90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:48.599 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.017+0000 7f6b1ae2b700 1 -- 172.21.15.63:0/1906817161 >> 172.21.15.63:0/1906817161 conn(0x7f6b140fc980 msgr2=0x7f6b140fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:48.599 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.017+0000 7f6b1ae2b700 1 -- 172.21.15.63:0/1906817161 shutdown_connections 2023-12-07T16:14:48.599 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.017+0000 7f6b1ae2b700 1 -- 172.21.15.63:0/1906817161 wait complete. 2023-12-07T16:14:48.599 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.017+0000 7f6b1ae2b700 1 Processor -- start 2023-12-07T16:14:48.599 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.017+0000 7f6b1ae2b700 1 -- start start 2023-12-07T16:14:48.599 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.018+0000 7f6b1ae2b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b14076c60 0x7f6b14111160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:48.599 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.018+0000 7f6b1ae2b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b141116a0 con 0x7f6b14076c60 2023-12-07T16:14:48.599 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.018+0000 7f6b18bc7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b14076c60 0x7f6b14111160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:48.600 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.018+0000 7f6b18bc7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b14076c60 0x7f6b14111160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55340/0 (socket says 172.21.15.63:55340) 2023-12-07T16:14:48.600 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.018+0000 7f6b18bc7700 1 -- 172.21.15.63:0/1655262391 learned_addr learned my addr 172.21.15.63:0/1655262391 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:48.600 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.018+0000 7f6b18bc7700 1 -- 172.21.15.63:0/1655262391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b080094f0 con 0x7f6b14076c60 2023-12-07T16:14:48.600 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.018+0000 7f6b18bc7700 1 --2- 172.21.15.63:0/1655262391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b14076c60 0x7f6b14111160 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6b080094c0 tx=0x7f6b08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:48.600 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.018+0000 7f6b117fa700 1 -- 172.21.15.63:0/1655262391 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b08010850 con 0x7f6b14076c60 2023-12-07T16:14:48.600 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.018+0000 7f6b117fa700 1 -- 172.21.15.63:0/1655262391 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6b08010e60 con 0x7f6b14076c60 2023-12-07T16:14:48.600 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.018+0000 7f6b1ae2b700 1 -- 172.21.15.63:0/1655262391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b141118a0 con 0x7f6b14076c60 2023-12-07T16:14:48.600 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.018+0000 7f6b117fa700 1 -- 172.21.15.63:0/1655262391 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b0801a430 con 0x7f6b14076c60 2023-12-07T16:14:48.600 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.019+0000 7f6b1ae2b700 1 -- 172.21.15.63:0/1655262391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b14111cb0 con 0x7f6b14076c60 2023-12-07T16:14:48.600 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.019+0000 7f6b117fa700 1 -- 172.21.15.63:0/1655262391 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f6b0801a660 con 0x7f6b14076c60 2023-12-07T16:14:48.600 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.019+0000 7f6b1ae2b700 1 -- 172.21.15.63:0/1655262391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1404bb80 con 0x7f6b14076c60 2023-12-07T16:14:48.600 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.020+0000 7f6b117fa700 1 --2- 172.21.15.63:0/1655262391 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f6b0403aa50 0x7f6b0403cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:48.601 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.020+0000 7f6b117fa700 1 -- 172.21.15.63:0/1655262391 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6b0804a420 con 0x7f6b14076c60 2023-12-07T16:14:48.601 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.020+0000 7f6b13fff700 1 --2- 172.21.15.63:0/1655262391 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f6b0403aa50 0x7f6b0403cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:48.601 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.020+0000 7f6b13fff700 1 --2- 172.21.15.63:0/1655262391 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f6b0403aa50 0x7f6b0403cf00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009990 tx=0x7f6b00006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:48.601 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.024+0000 7f6b117fa700 1 -- 172.21.15.63:0/1655262391 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6b0801a910 con 0x7f6b14076c60 2023-12-07T16:14:48.601 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.225+0000 7f6b1ae2b700 1 -- 172.21.15.63:0/1655262391 --> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b1410afe0 con 0x7f6b0403aa50 2023-12-07T16:14:48.601 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.229+0000 7f6b117fa700 1 -- 172.21.15.63:0/1655262391 <== mgr.14120 v2:172.21.15.63:6800/1052036735 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f6b1410afe0 con 0x7f6b0403aa50 2023-12-07T16:14:48.601 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.231+0000 7f6b1ae2b700 1 -- 172.21.15.63:0/1655262391 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f6b0403aa50 msgr2=0x7f6b0403cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:48.601 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.231+0000 7f6b1ae2b700 1 --2- 172.21.15.63:0/1655262391 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f6b0403aa50 0x7f6b0403cf00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009990 tx=0x7f6b00006e40 comp rx=0 tx=0).stop 2023-12-07T16:14:48.601 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.231+0000 7f6b1ae2b700 1 -- 172.21.15.63:0/1655262391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b14076c60 msgr2=0x7f6b14111160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:48.601 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.231+0000 7f6b1ae2b700 1 --2- 172.21.15.63:0/1655262391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b14076c60 0x7f6b14111160 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6b080094c0 tx=0x7f6b08009250 comp rx=0 tx=0).stop 2023-12-07T16:14:48.601 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.231+0000 7f6b1ae2b700 1 -- 172.21.15.63:0/1655262391 shutdown_connections 2023-12-07T16:14:48.602 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.231+0000 7f6b1ae2b700 1 --2- 172.21.15.63:0/1655262391 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f6b0403aa50 0x7f6b0403cf00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:48.602 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.231+0000 7f6b1ae2b700 1 --2- 172.21.15.63:0/1655262391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b14076c60 0x7f6b14111160 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:48.602 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.231+0000 7f6b1ae2b700 1 -- 172.21.15.63:0/1655262391 >> 172.21.15.63:0/1655262391 conn(0x7f6b140fc980 msgr2=0x7f6b140fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:48.602 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.232+0000 7f6b1ae2b700 1 -- 172.21.15.63:0/1655262391 shutdown_connections 2023-12-07T16:14:48.602 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:48.232+0000 7f6b1ae2b700 1 -- 172.21.15.63:0/1655262391 wait complete. 2023-12-07T16:14:48.602 INFO:teuthology.orchestra.run.smithi063.stdout:Deploying alertmanager service with default placement... 2023-12-07T16:14:49.559 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:49 smithi063 ceph-mon[112095]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:14:49.560 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:49 smithi063 ceph-mon[112095]: Saving service node-exporter spec with placement * 2023-12-07T16:14:49.560 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:49 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' 2023-12-07T16:14:49.611 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2023-12-07T16:14:49.611 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.023+0000 7f8fbe58c700 1 Processor -- start 2023-12-07T16:14:49.611 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.023+0000 7f8fbe58c700 1 -- start start 2023-12-07T16:14:49.611 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.024+0000 7f8fbe58c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fb8076c20 0x7f8fb8104ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:49.611 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.024+0000 7f8fbe58c700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb8105410 con 0x7f8fb8076c20 2023-12-07T16:14:49.611 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.024+0000 7f8fb7fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fb8076c20 0x7f8fb8104ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:49.612 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.024+0000 7f8fb7fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fb8076c20 0x7f8fb8104ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55348/0 (socket says 172.21.15.63:55348) 2023-12-07T16:14:49.612 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.024+0000 7f8fb7fff700 1 -- 172.21.15.63:0/1968236155 learned_addr learned my addr 172.21.15.63:0/1968236155 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:49.612 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.024+0000 7f8fb7fff700 1 -- 172.21.15.63:0/1968236155 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb8105550 con 0x7f8fb8076c20 2023-12-07T16:14:49.612 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.024+0000 7f8fb7fff700 1 --2- 172.21.15.63:0/1968236155 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fb8076c20 0x7f8fb8104ed0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80098e0 tx=0x7f8fa8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c08638a259c7bf server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:49.612 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.024+0000 7f8fb6ffd700 1 -- 172.21.15.63:0/1968236155 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8fa800b860 con 0x7f8fb8076c20 2023-12-07T16:14:49.612 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.025+0000 7f8fb6ffd700 1 -- 172.21.15.63:0/1968236155 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8fa800be70 con 0x7f8fb8076c20 2023-12-07T16:14:49.612 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.025+0000 7f8fb6ffd700 1 -- 172.21.15.63:0/1968236155 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8fa8010380 con 0x7f8fb8076c20 2023-12-07T16:14:49.612 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.025+0000 7f8fbe58c700 1 -- 172.21.15.63:0/1968236155 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fb8076c20 msgr2=0x7f8fb8104ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:49.612 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.025+0000 7f8fbe58c700 1 --2- 172.21.15.63:0/1968236155 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fb8076c20 0x7f8fb8104ed0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80098e0 tx=0x7f8fa8009250 comp rx=0 tx=0).stop 2023-12-07T16:14:49.612 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.025+0000 7f8fbe58c700 1 -- 172.21.15.63:0/1968236155 shutdown_connections 2023-12-07T16:14:49.612 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.025+0000 7f8fbe58c700 1 --2- 172.21.15.63:0/1968236155 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fb8076c20 0x7f8fb8104ed0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:49.612 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.025+0000 7f8fbe58c700 1 -- 172.21.15.63:0/1968236155 >> 172.21.15.63:0/1968236155 conn(0x7f8fb80fc980 msgr2=0x7f8fb80fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:49.612 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.025+0000 7f8fbe58c700 1 -- 172.21.15.63:0/1968236155 shutdown_connections 2023-12-07T16:14:49.612 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.025+0000 7f8fbe58c700 1 -- 172.21.15.63:0/1968236155 wait complete. 2023-12-07T16:14:49.612 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.026+0000 7f8fbe58c700 1 Processor -- start 2023-12-07T16:14:49.612 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.026+0000 7f8fbe58c700 1 -- start start 2023-12-07T16:14:49.613 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.026+0000 7f8fbe58c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fb8076c20 0x7f8fb8111180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:49.613 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.026+0000 7f8fbe58c700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb81116c0 con 0x7f8fb8076c20 2023-12-07T16:14:49.613 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.026+0000 7f8fb7fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fb8076c20 0x7f8fb8111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:49.613 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.026+0000 7f8fb7fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fb8076c20 0x7f8fb8111180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55350/0 (socket says 172.21.15.63:55350) 2023-12-07T16:14:49.613 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.026+0000 7f8fb7fff700 1 -- 172.21.15.63:0/1595644391 learned_addr learned my addr 172.21.15.63:0/1595644391 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:49.613 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.027+0000 7f8fb7fff700 1 -- 172.21.15.63:0/1595644391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa80094f0 con 0x7f8fb8076c20 2023-12-07T16:14:49.613 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.027+0000 7f8fb7fff700 1 --2- 172.21.15.63:0/1595644391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fb8076c20 0x7f8fb8111180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80094c0 tx=0x7f8fa8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:49.613 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.027+0000 7f8fb4ff9700 1 -- 172.21.15.63:0/1595644391 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8fa8010850 con 0x7f8fb8076c20 2023-12-07T16:14:49.613 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.027+0000 7f8fbe58c700 1 -- 172.21.15.63:0/1595644391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb81118c0 con 0x7f8fb8076c20 2023-12-07T16:14:49.613 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.027+0000 7f8fb4ff9700 1 -- 172.21.15.63:0/1595644391 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8fa8010e60 con 0x7f8fb8076c20 2023-12-07T16:14:49.613 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.027+0000 7f8fb4ff9700 1 -- 172.21.15.63:0/1595644391 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8fa801a430 con 0x7f8fb8076c20 2023-12-07T16:14:49.613 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.027+0000 7f8fbe58c700 1 -- 172.21.15.63:0/1595644391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb8111cd0 con 0x7f8fb8076c20 2023-12-07T16:14:49.613 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.028+0000 7f8fb4ff9700 1 -- 172.21.15.63:0/1595644391 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f8fa80109b0 con 0x7f8fb8076c20 2023-12-07T16:14:49.613 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.028+0000 7f8fb4ff9700 1 --2- 172.21.15.63:0/1595644391 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f8fa00365f0 0x7f8fa0038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:49.613 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.028+0000 7f8fb4ff9700 1 -- 172.21.15.63:0/1595644391 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f8fa804a4c0 con 0x7f8fb8076c20 2023-12-07T16:14:49.613 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.028+0000 7f8fbe58c700 1 -- 172.21.15.63:0/1595644391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb804bb80 con 0x7f8fb8076c20 2023-12-07T16:14:49.614 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.028+0000 7f8fb77fe700 1 --2- 172.21.15.63:0/1595644391 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f8fa00365f0 0x7f8fa0038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:49.614 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.029+0000 7f8fb77fe700 1 --2- 172.21.15.63:0/1595644391 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f8fa00365f0 0x7f8fa0038aa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8fac009990 tx=0x7f8fac006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:49.614 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.033+0000 7f8fb4ff9700 1 -- 172.21.15.63:0/1595644391 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8fa8022990 con 0x7f8fb8076c20 2023-12-07T16:14:49.614 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.236+0000 7f8fbe58c700 1 -- 172.21.15.63:0/1595644391 --> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f8fb810ad80 con 0x7f8fa00365f0 2023-12-07T16:14:49.614 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.241+0000 7f8fb4ff9700 1 -- 172.21.15.63:0/1595644391 <== mgr.14120 v2:172.21.15.63:6800/1052036735 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f8fb810ad80 con 0x7f8fa00365f0 2023-12-07T16:14:49.614 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.243+0000 7f8fbe58c700 1 -- 172.21.15.63:0/1595644391 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f8fa00365f0 msgr2=0x7f8fa0038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:49.614 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.243+0000 7f8fbe58c700 1 --2- 172.21.15.63:0/1595644391 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f8fa00365f0 0x7f8fa0038aa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8fac009990 tx=0x7f8fac006e40 comp rx=0 tx=0).stop 2023-12-07T16:14:49.614 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.243+0000 7f8fbe58c700 1 -- 172.21.15.63:0/1595644391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fb8076c20 msgr2=0x7f8fb8111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:49.614 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.243+0000 7f8fbe58c700 1 --2- 172.21.15.63:0/1595644391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fb8076c20 0x7f8fb8111180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80094c0 tx=0x7f8fa8009250 comp rx=0 tx=0).stop 2023-12-07T16:14:49.614 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.243+0000 7f8fbe58c700 1 -- 172.21.15.63:0/1595644391 shutdown_connections 2023-12-07T16:14:49.614 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.243+0000 7f8fbe58c700 1 --2- 172.21.15.63:0/1595644391 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f8fa00365f0 0x7f8fa0038aa0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:49.614 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.243+0000 7f8fbe58c700 1 --2- 172.21.15.63:0/1595644391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fb8076c20 0x7f8fb8111180 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:49.614 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.243+0000 7f8fbe58c700 1 -- 172.21.15.63:0/1595644391 >> 172.21.15.63:0/1595644391 conn(0x7f8fb80fc980 msgr2=0x7f8fb80fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:49.614 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.243+0000 7f8fbe58c700 1 -- 172.21.15.63:0/1595644391 shutdown_connections 2023-12-07T16:14:49.614 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.243+0000 7f8fbe58c700 1 -- 172.21.15.63:0/1595644391 wait complete. 2023-12-07T16:14:50.525 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:50 smithi063 ceph-mon[112095]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:14:50.525 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:50 smithi063 ceph-mon[112095]: Saving service alertmanager spec with placement count:1 2023-12-07T16:14:50.525 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:50 smithi063 ceph-mon[112095]: from='mgr.14120 172.21.15.63:0/3303647032' entity='mgr.smithi063.yohyyx' 2023-12-07T16:14:50.525 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:50 smithi063 ceph-mon[112095]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:14:50.525 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:50 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2020287120' entity='client.admin' 2023-12-07T16:14:50.585 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.968+0000 7fb104571700 1 Processor -- start 2023-12-07T16:14:50.585 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.968+0000 7fb104571700 1 -- start start 2023-12-07T16:14:50.585 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.968+0000 7fb104571700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0fc1028e0 0x7fb0fc102cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:50.585 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.968+0000 7fb104571700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc103230 con 0x7fb0fc1028e0 2023-12-07T16:14:50.585 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.968+0000 7fb10230d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0fc1028e0 0x7fb0fc102cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:50.585 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.968+0000 7fb10230d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0fc1028e0 0x7fb0fc102cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59304/0 (socket says 172.21.15.63:59304) 2023-12-07T16:14:50.586 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.968+0000 7fb10230d700 1 -- 172.21.15.63:0/1990015085 learned_addr learned my addr 172.21.15.63:0/1990015085 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:50.586 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.969+0000 7fb10230d700 1 -- 172.21.15.63:0/1990015085 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc103370 con 0x7fb0fc1028e0 2023-12-07T16:14:50.586 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.969+0000 7fb10230d700 1 --2- 172.21.15.63:0/1990015085 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0fc1028e0 0x7fb0fc102cf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80098e0 tx=0x7fb0f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0e9b14c1975f1c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:50.586 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.969+0000 7fb10130b700 1 -- 172.21.15.63:0/1990015085 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0f800b8f0 con 0x7fb0fc1028e0 2023-12-07T16:14:50.586 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.969+0000 7fb10130b700 1 -- 172.21.15.63:0/1990015085 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb0f8011420 con 0x7fb0fc1028e0 2023-12-07T16:14:50.586 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.969+0000 7fb10130b700 1 -- 172.21.15.63:0/1990015085 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0f8010540 con 0x7fb0fc1028e0 2023-12-07T16:14:50.586 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.970+0000 7fb104571700 1 -- 172.21.15.63:0/1990015085 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0fc1028e0 msgr2=0x7fb0fc102cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:50.586 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.970+0000 7fb104571700 1 --2- 172.21.15.63:0/1990015085 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0fc1028e0 0x7fb0fc102cf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80098e0 tx=0x7fb0f8009250 comp rx=0 tx=0).stop 2023-12-07T16:14:50.586 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.970+0000 7fb104571700 1 -- 172.21.15.63:0/1990015085 shutdown_connections 2023-12-07T16:14:50.586 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.970+0000 7fb104571700 1 --2- 172.21.15.63:0/1990015085 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0fc1028e0 0x7fb0fc102cf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:50.586 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.970+0000 7fb104571700 1 -- 172.21.15.63:0/1990015085 >> 172.21.15.63:0/1990015085 conn(0x7fb0fc0fc0b0 msgr2=0x7fb0fc0fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:50.586 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.970+0000 7fb104571700 1 -- 172.21.15.63:0/1990015085 shutdown_connections 2023-12-07T16:14:50.586 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.970+0000 7fb104571700 1 -- 172.21.15.63:0/1990015085 wait complete. 2023-12-07T16:14:50.586 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.970+0000 7fb104571700 1 Processor -- start 2023-12-07T16:14:50.586 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.970+0000 7fb104571700 1 -- start start 2023-12-07T16:14:50.587 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.970+0000 7fb104571700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0fc1028e0 0x7fb0fc113460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:50.587 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.970+0000 7fb104571700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc1139a0 con 0x7fb0fc1028e0 2023-12-07T16:14:50.587 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.971+0000 7fb10230d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0fc1028e0 0x7fb0fc113460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:50.587 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.971+0000 7fb10230d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0fc1028e0 0x7fb0fc113460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59320/0 (socket says 172.21.15.63:59320) 2023-12-07T16:14:50.587 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.971+0000 7fb10230d700 1 -- 172.21.15.63:0/2020287120 learned_addr learned my addr 172.21.15.63:0/2020287120 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:50.587 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.971+0000 7fb10230d700 1 -- 172.21.15.63:0/2020287120 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f80094f0 con 0x7fb0fc1028e0 2023-12-07T16:14:50.587 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.971+0000 7fb10230d700 1 --2- 172.21.15.63:0/2020287120 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0fc1028e0 0x7fb0fc113460 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8011b40 tx=0x7fb0f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:50.587 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.971+0000 7fb0f2ffd700 1 -- 172.21.15.63:0/2020287120 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0f8010800 con 0x7fb0fc1028e0 2023-12-07T16:14:50.587 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.971+0000 7fb0f2ffd700 1 -- 172.21.15.63:0/2020287120 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb0f8010e10 con 0x7fb0fc1028e0 2023-12-07T16:14:50.587 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.971+0000 7fb104571700 1 -- 172.21.15.63:0/2020287120 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0fc113ba0 con 0x7fb0fc1028e0 2023-12-07T16:14:50.587 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.971+0000 7fb0f2ffd700 1 -- 172.21.15.63:0/2020287120 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0f801ad10 con 0x7fb0fc1028e0 2023-12-07T16:14:50.587 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.971+0000 7fb104571700 1 -- 172.21.15.63:0/2020287120 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0fc113fb0 con 0x7fb0fc1028e0 2023-12-07T16:14:50.587 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.972+0000 7fb0f2ffd700 1 -- 172.21.15.63:0/2020287120 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fb0f802e440 con 0x7fb0fc1028e0 2023-12-07T16:14:50.587 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.972+0000 7fb0f0ff9700 1 -- 172.21.15.63:0/2020287120 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e40052b0 con 0x7fb0fc1028e0 2023-12-07T16:14:50.587 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.972+0000 7fb0f2ffd700 1 --2- 172.21.15.63:0/2020287120 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fb0e80365f0 0x7fb0e8038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:50.587 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.972+0000 7fb0f2ffd700 1 -- 172.21.15.63:0/2020287120 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb0f804a790 con 0x7fb0fc1028e0 2023-12-07T16:14:50.588 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.972+0000 7fb101b0c700 1 --2- 172.21.15.63:0/2020287120 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fb0e80365f0 0x7fb0e8038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:50.588 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.973+0000 7fb101b0c700 1 --2- 172.21.15.63:0/2020287120 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fb0e80365f0 0x7fb0e8038aa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009990 tx=0x7fb0ec006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:50.588 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:49.977+0000 7fb0f2ffd700 1 -- 172.21.15.63:0/2020287120 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb0f8010960 con 0x7fb0fc1028e0 2023-12-07T16:14:50.588 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.170+0000 7fb0f0ff9700 1 -- 172.21.15.63:0/2020287120 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fb0e4005560 con 0x7fb0fc1028e0 2023-12-07T16:14:50.588 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.173+0000 7fb0f2ffd700 1 -- 172.21.15.63:0/2020287120 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fb0f8010960 con 0x7fb0fc1028e0 2023-12-07T16:14:50.588 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.175+0000 7fb0f0ff9700 1 -- 172.21.15.63:0/2020287120 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fb0e80365f0 msgr2=0x7fb0e8038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:50.588 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.175+0000 7fb0f0ff9700 1 --2- 172.21.15.63:0/2020287120 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fb0e80365f0 0x7fb0e8038aa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009990 tx=0x7fb0ec006e40 comp rx=0 tx=0).stop 2023-12-07T16:14:50.588 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.175+0000 7fb0f0ff9700 1 -- 172.21.15.63:0/2020287120 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0fc1028e0 msgr2=0x7fb0fc113460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:50.588 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.175+0000 7fb0f0ff9700 1 --2- 172.21.15.63:0/2020287120 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0fc1028e0 0x7fb0fc113460 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8011b40 tx=0x7fb0f8009250 comp rx=0 tx=0).stop 2023-12-07T16:14:50.588 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.175+0000 7fb0f0ff9700 1 -- 172.21.15.63:0/2020287120 shutdown_connections 2023-12-07T16:14:50.588 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.175+0000 7fb0f0ff9700 1 --2- 172.21.15.63:0/2020287120 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fb0e80365f0 0x7fb0e8038aa0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:50.588 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.175+0000 7fb0f0ff9700 1 --2- 172.21.15.63:0/2020287120 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0fc1028e0 0x7fb0fc113460 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:50.588 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.175+0000 7fb0f0ff9700 1 -- 172.21.15.63:0/2020287120 >> 172.21.15.63:0/2020287120 conn(0x7fb0fc0fc0b0 msgr2=0x7fb0fc0fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:50.588 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.175+0000 7fb0f0ff9700 1 -- 172.21.15.63:0/2020287120 shutdown_connections 2023-12-07T16:14:50.588 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.175+0000 7fb0f0ff9700 1 -- 172.21.15.63:0/2020287120 wait complete. 2023-12-07T16:14:51.528 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.985+0000 7faeb4972700 1 Processor -- start 2023-12-07T16:14:51.529 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.985+0000 7faeb4972700 1 -- start start 2023-12-07T16:14:51.529 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.985+0000 7faeb4972700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faeb0078ca0 0x7faeb00771b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:51.529 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.985+0000 7faeb4972700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb00790b0 con 0x7faeb0078ca0 2023-12-07T16:14:51.529 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.986+0000 7faeae59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faeb0078ca0 0x7faeb00771b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:51.529 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.986+0000 7faeae59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faeb0078ca0 0x7faeb00771b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59328/0 (socket says 172.21.15.63:59328) 2023-12-07T16:14:51.529 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.986+0000 7faeae59c700 1 -- 172.21.15.63:0/1294534472 learned_addr learned my addr 172.21.15.63:0/1294534472 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:51.529 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.986+0000 7faeae59c700 1 -- 172.21.15.63:0/1294534472 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb00776f0 con 0x7faeb0078ca0 2023-12-07T16:14:51.529 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.986+0000 7faeae59c700 1 --2- 172.21.15.63:0/1294534472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faeb0078ca0 0x7faeb00771b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faea40098e0 tx=0x7faea4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4504f0d4faabe9f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:51.529 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.986+0000 7faead59a700 1 -- 172.21.15.63:0/1294534472 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faea400b860 con 0x7faeb0078ca0 2023-12-07T16:14:51.529 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.986+0000 7faead59a700 1 -- 172.21.15.63:0/1294534472 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faea400be70 con 0x7faeb0078ca0 2023-12-07T16:14:51.529 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.986+0000 7faead59a700 1 -- 172.21.15.63:0/1294534472 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faea4010380 con 0x7faeb0078ca0 2023-12-07T16:14:51.529 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.987+0000 7faeb4972700 1 -- 172.21.15.63:0/1294534472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faeb0078ca0 msgr2=0x7faeb00771b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:51.529 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.987+0000 7faeb4972700 1 --2- 172.21.15.63:0/1294534472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faeb0078ca0 0x7faeb00771b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faea40098e0 tx=0x7faea4009250 comp rx=0 tx=0).stop 2023-12-07T16:14:51.529 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.987+0000 7faeb4972700 1 -- 172.21.15.63:0/1294534472 shutdown_connections 2023-12-07T16:14:51.529 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.987+0000 7faeb4972700 1 --2- 172.21.15.63:0/1294534472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faeb0078ca0 0x7faeb00771b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:51.530 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.987+0000 7faeb4972700 1 -- 172.21.15.63:0/1294534472 >> 172.21.15.63:0/1294534472 conn(0x7faeb00fda10 msgr2=0x7faeb00ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:51.530 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.987+0000 7faeb4972700 1 -- 172.21.15.63:0/1294534472 shutdown_connections 2023-12-07T16:14:51.530 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.987+0000 7faeb4972700 1 -- 172.21.15.63:0/1294534472 wait complete. 2023-12-07T16:14:51.530 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.987+0000 7faeb4972700 1 Processor -- start 2023-12-07T16:14:51.530 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.987+0000 7faeb4972700 1 -- start start 2023-12-07T16:14:51.530 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.988+0000 7faeb4972700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faeb0078ca0 0x7faeb0113350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:51.530 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.988+0000 7faeb4972700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb0113890 con 0x7faeb0078ca0 2023-12-07T16:14:51.530 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.988+0000 7faeae59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faeb0078ca0 0x7faeb0113350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:51.530 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.988+0000 7faeae59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faeb0078ca0 0x7faeb0113350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59336/0 (socket says 172.21.15.63:59336) 2023-12-07T16:14:51.530 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.988+0000 7faeae59c700 1 -- 172.21.15.63:0/2736979269 learned_addr learned my addr 172.21.15.63:0/2736979269 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:51.530 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.988+0000 7faeae59c700 1 -- 172.21.15.63:0/2736979269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea40094f0 con 0x7faeb0078ca0 2023-12-07T16:14:51.530 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.988+0000 7faeae59c700 1 --2- 172.21.15.63:0/2736979269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faeb0078ca0 0x7faeb0113350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faea40094c0 tx=0x7faea4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:51.530 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.988+0000 7fae9effd700 1 -- 172.21.15.63:0/2736979269 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faea4010850 con 0x7faeb0078ca0 2023-12-07T16:14:51.530 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.988+0000 7fae9effd700 1 -- 172.21.15.63:0/2736979269 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faea4010e60 con 0x7faeb0078ca0 2023-12-07T16:14:51.530 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.988+0000 7faeb4972700 1 -- 172.21.15.63:0/2736979269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb0113a90 con 0x7faeb0078ca0 2023-12-07T16:14:51.530 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.988+0000 7fae9effd700 1 -- 172.21.15.63:0/2736979269 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faea40243f0 con 0x7faeb0078ca0 2023-12-07T16:14:51.531 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.989+0000 7faeb4972700 1 -- 172.21.15.63:0/2736979269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb0113ea0 con 0x7faeb0078ca0 2023-12-07T16:14:51.531 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.989+0000 7fae9effd700 1 -- 172.21.15.63:0/2736979269 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7faea40246b0 con 0x7faeb0078ca0 2023-12-07T16:14:51.531 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.989+0000 7faeb4972700 1 -- 172.21.15.63:0/2736979269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb004bb80 con 0x7faeb0078ca0 2023-12-07T16:14:51.531 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.990+0000 7fae9effd700 1 --2- 172.21.15.63:0/2736979269 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fae980365f0 0x7fae98038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:51.531 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.990+0000 7fae9effd700 1 -- 172.21.15.63:0/2736979269 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7faea404a610 con 0x7faeb0078ca0 2023-12-07T16:14:51.531 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.990+0000 7faeadd9b700 1 --2- 172.21.15.63:0/2736979269 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fae980365f0 0x7fae98038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:51.531 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.990+0000 7faeadd9b700 1 --2- 172.21.15.63:0/2736979269 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fae980365f0 0x7fae98038aa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faea0009990 tx=0x7faea0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:51.531 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:50.994+0000 7fae9effd700 1 -- 172.21.15.63:0/2736979269 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7faea40187c0 con 0x7faeb0078ca0 2023-12-07T16:14:51.531 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.185+0000 7faeb4972700 1 -- 172.21.15.63:0/2736979269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7faeb0108550 con 0x7faeb0078ca0 2023-12-07T16:14:51.531 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.188+0000 7fae9effd700 1 -- 172.21.15.63:0/2736979269 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7faea40187c0 con 0x7faeb0078ca0 2023-12-07T16:14:51.531 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.190+0000 7faeb4972700 1 -- 172.21.15.63:0/2736979269 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fae980365f0 msgr2=0x7fae98038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:51.531 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.190+0000 7faeb4972700 1 --2- 172.21.15.63:0/2736979269 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fae980365f0 0x7fae98038aa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faea0009990 tx=0x7faea0006e40 comp rx=0 tx=0).stop 2023-12-07T16:14:51.531 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.190+0000 7faeb4972700 1 -- 172.21.15.63:0/2736979269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faeb0078ca0 msgr2=0x7faeb0113350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:51.531 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.190+0000 7faeb4972700 1 --2- 172.21.15.63:0/2736979269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faeb0078ca0 0x7faeb0113350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faea40094c0 tx=0x7faea4009250 comp rx=0 tx=0).stop 2023-12-07T16:14:51.531 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.190+0000 7faeb4972700 1 -- 172.21.15.63:0/2736979269 shutdown_connections 2023-12-07T16:14:51.532 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.190+0000 7faeb4972700 1 --2- 172.21.15.63:0/2736979269 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fae980365f0 0x7fae98038aa0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:51.532 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.190+0000 7faeb4972700 1 --2- 172.21.15.63:0/2736979269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faeb0078ca0 0x7faeb0113350 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:51.532 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.190+0000 7faeb4972700 1 -- 172.21.15.63:0/2736979269 >> 172.21.15.63:0/2736979269 conn(0x7faeb00fda10 msgr2=0x7faeb00ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:51.532 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.191+0000 7faeb4972700 1 -- 172.21.15.63:0/2736979269 shutdown_connections 2023-12-07T16:14:51.532 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.191+0000 7faeb4972700 1 -- 172.21.15.63:0/2736979269 wait complete. 2023-12-07T16:14:51.532 INFO:teuthology.orchestra.run.smithi063.stdout:Enabling the dashboard module... 2023-12-07T16:14:52.464 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:52 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2736979269' entity='client.admin' 2023-12-07T16:14:52.464 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:52 smithi063 ceph-mon[112095]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:14:52.464 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:52 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/373470954' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-12-07T16:14:52.661 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.883+0000 7fbd5e3e9700 1 Processor -- start 2023-12-07T16:14:52.662 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.883+0000 7fbd5e3e9700 1 -- start start 2023-12-07T16:14:52.662 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.883+0000 7fbd5e3e9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd58076c60 0x7fbd58104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:52.662 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.883+0000 7fbd5e3e9700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd581053d0 con 0x7fbd58076c60 2023-12-07T16:14:52.662 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.883+0000 7fbd57fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd58076c60 0x7fbd58104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:52.662 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.883+0000 7fbd57fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd58076c60 0x7fbd58104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59346/0 (socket says 172.21.15.63:59346) 2023-12-07T16:14:52.662 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.883+0000 7fbd57fff700 1 -- 172.21.15.63:0/1098225132 learned_addr learned my addr 172.21.15.63:0/1098225132 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:52.662 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.883+0000 7fbd57fff700 1 -- 172.21.15.63:0/1098225132 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd58105510 con 0x7fbd58076c60 2023-12-07T16:14:52.662 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.884+0000 7fbd57fff700 1 --2- 172.21.15.63:0/1098225132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd58076c60 0x7fbd58104e90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbd480098e0 tx=0x7fbd48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5817944387de2ac server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:52.662 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.884+0000 7fbd56ffd700 1 -- 172.21.15.63:0/1098225132 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd4800b860 con 0x7fbd58076c60 2023-12-07T16:14:52.662 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.884+0000 7fbd56ffd700 1 -- 172.21.15.63:0/1098225132 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbd4800be70 con 0x7fbd58076c60 2023-12-07T16:14:52.662 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.884+0000 7fbd56ffd700 1 -- 172.21.15.63:0/1098225132 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd48010380 con 0x7fbd58076c60 2023-12-07T16:14:52.662 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.884+0000 7fbd5e3e9700 1 -- 172.21.15.63:0/1098225132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd58076c60 msgr2=0x7fbd58104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:52.662 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.884+0000 7fbd5e3e9700 1 --2- 172.21.15.63:0/1098225132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd58076c60 0x7fbd58104e90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbd480098e0 tx=0x7fbd48009250 comp rx=0 tx=0).stop 2023-12-07T16:14:52.662 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.884+0000 7fbd5e3e9700 1 -- 172.21.15.63:0/1098225132 shutdown_connections 2023-12-07T16:14:52.662 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.884+0000 7fbd5e3e9700 1 --2- 172.21.15.63:0/1098225132 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd58076c60 0x7fbd58104e90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:52.663 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.884+0000 7fbd5e3e9700 1 -- 172.21.15.63:0/1098225132 >> 172.21.15.63:0/1098225132 conn(0x7fbd580fc980 msgr2=0x7fbd580fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:52.663 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.884+0000 7fbd5e3e9700 1 -- 172.21.15.63:0/1098225132 shutdown_connections 2023-12-07T16:14:52.663 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.884+0000 7fbd5e3e9700 1 -- 172.21.15.63:0/1098225132 wait complete. 2023-12-07T16:14:52.663 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.885+0000 7fbd5e3e9700 1 Processor -- start 2023-12-07T16:14:52.663 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.885+0000 7fbd5e3e9700 1 -- start start 2023-12-07T16:14:52.663 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.885+0000 7fbd5e3e9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd58076c60 0x7fbd58102910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:52.663 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.885+0000 7fbd5e3e9700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd58100d90 con 0x7fbd58076c60 2023-12-07T16:14:52.663 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.885+0000 7fbd57fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd58076c60 0x7fbd58102910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:52.663 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.885+0000 7fbd57fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd58076c60 0x7fbd58102910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59356/0 (socket says 172.21.15.63:59356) 2023-12-07T16:14:52.663 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.885+0000 7fbd57fff700 1 -- 172.21.15.63:0/373470954 learned_addr learned my addr 172.21.15.63:0/373470954 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:52.663 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.886+0000 7fbd57fff700 1 -- 172.21.15.63:0/373470954 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd480094f0 con 0x7fbd58076c60 2023-12-07T16:14:52.664 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.886+0000 7fbd57fff700 1 --2- 172.21.15.63:0/373470954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd58076c60 0x7fbd58102910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbd48006d40 tx=0x7fbd48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:52.664 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.886+0000 7fbd54ff9700 1 -- 172.21.15.63:0/373470954 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd48010960 con 0x7fbd58076c60 2023-12-07T16:14:52.664 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.886+0000 7fbd54ff9700 1 -- 172.21.15.63:0/373470954 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbd4801a430 con 0x7fbd58076c60 2023-12-07T16:14:52.664 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.886+0000 7fbd5e3e9700 1 -- 172.21.15.63:0/373470954 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd58100f90 con 0x7fbd58076c60 2023-12-07T16:14:52.664 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.886+0000 7fbd54ff9700 1 -- 172.21.15.63:0/373470954 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd480245b0 con 0x7fbd58076c60 2023-12-07T16:14:52.664 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.886+0000 7fbd5e3e9700 1 -- 172.21.15.63:0/373470954 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd581013a0 con 0x7fbd58076c60 2023-12-07T16:14:52.664 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.887+0000 7fbd54ff9700 1 -- 172.21.15.63:0/373470954 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fbd4802d3f0 con 0x7fbd58076c60 2023-12-07T16:14:52.664 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.887+0000 7fbd5e3e9700 1 -- 172.21.15.63:0/373470954 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd5804bb80 con 0x7fbd58076c60 2023-12-07T16:14:52.664 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.887+0000 7fbd54ff9700 1 --2- 172.21.15.63:0/373470954 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fbd40036640 0x7fbd40038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:52.664 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.887+0000 7fbd54ff9700 1 -- 172.21.15.63:0/373470954 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fbd4804a1f0 con 0x7fbd58076c60 2023-12-07T16:14:52.664 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.887+0000 7fbd577fe700 1 --2- 172.21.15.63:0/373470954 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fbd40036640 0x7fbd40038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:52.664 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.888+0000 7fbd577fe700 1 --2- 172.21.15.63:0/373470954 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fbd40036640 0x7fbd40038af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c009990 tx=0x7fbd4c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:52.664 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:51.892+0000 7fbd54ff9700 1 -- 172.21.15.63:0/373470954 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fbd4802b8e0 con 0x7fbd58076c60 2023-12-07T16:14:52.664 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:52.138+0000 7fbd5e3e9700 1 -- 172.21.15.63:0/373470954 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fbd581062f0 con 0x7fbd58076c60 2023-12-07T16:14:52.664 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:52.195+0000 7fbd54ff9700 1 -- 172.21.15.63:0/373470954 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fbd4801a9f0 con 0x7fbd58076c60 2023-12-07T16:14:52.665 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:52.197+0000 7fbd54ff9700 1 -- 172.21.15.63:0/373470954 <== mon.0 v2:172.21.15.63:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fbd48006fd0 con 0x7fbd58076c60 2023-12-07T16:14:52.665 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:52.199+0000 7fbd5e3e9700 1 -- 172.21.15.63:0/373470954 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fbd40036640 msgr2=0x7fbd40038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:52.665 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:52.199+0000 7fbd5e3e9700 1 --2- 172.21.15.63:0/373470954 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fbd40036640 0x7fbd40038af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c009990 tx=0x7fbd4c006e40 comp rx=0 tx=0).stop 2023-12-07T16:14:52.665 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:52.199+0000 7fbd5e3e9700 1 -- 172.21.15.63:0/373470954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd58076c60 msgr2=0x7fbd58102910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:52.665 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:52.199+0000 7fbd5e3e9700 1 --2- 172.21.15.63:0/373470954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd58076c60 0x7fbd58102910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbd48006d40 tx=0x7fbd48009250 comp rx=0 tx=0).stop 2023-12-07T16:14:52.665 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:52.200+0000 7fbd5e3e9700 1 -- 172.21.15.63:0/373470954 shutdown_connections 2023-12-07T16:14:52.665 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:52.200+0000 7fbd5e3e9700 1 --2- 172.21.15.63:0/373470954 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7fbd40036640 0x7fbd40038af0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:52.665 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:52.200+0000 7fbd5e3e9700 1 --2- 172.21.15.63:0/373470954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd58076c60 0x7fbd58102910 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:52.665 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:52.200+0000 7fbd5e3e9700 1 -- 172.21.15.63:0/373470954 >> 172.21.15.63:0/373470954 conn(0x7fbd580fc980 msgr2=0x7fbd580fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:52.665 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:52.200+0000 7fbd5e3e9700 1 -- 172.21.15.63:0/373470954 shutdown_connections 2023-12-07T16:14:52.665 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:52.200+0000 7fbd5e3e9700 1 -- 172.21.15.63:0/373470954 wait complete. 2023-12-07T16:14:53.530 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:53 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/373470954' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-12-07T16:14:53.530 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:53 smithi063 ceph-mon[112095]: mgrmap e9: smithi063.yohyyx(active, since 24s) 2023-12-07T16:14:53.731 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2023-12-07T16:14:53.737 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-12-07T16:14:53.737 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-07T16:14:53.737 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "active_name": "smithi063.yohyyx", 2023-12-07T16:14:53.737 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-07T16:14:53.738 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2023-12-07T16:14:53.738 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.044+0000 7f19f0f21700 1 Processor -- start 2023-12-07T16:14:53.738 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.044+0000 7f19f0f21700 1 -- start start 2023-12-07T16:14:53.738 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.045+0000 7f19f0f21700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19ec102780 0x7f19ec102b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:53.738 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.045+0000 7f19f0f21700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec1030d0 con 0x7f19ec102780 2023-12-07T16:14:53.738 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.045+0000 7f19ea59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19ec102780 0x7f19ec102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:53.738 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.045+0000 7f19ea59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19ec102780 0x7f19ec102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59382/0 (socket says 172.21.15.63:59382) 2023-12-07T16:14:53.738 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.045+0000 7f19ea59c700 1 -- 172.21.15.63:0/1218434447 learned_addr learned my addr 172.21.15.63:0/1218434447 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:53.738 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.045+0000 7f19ea59c700 1 -- 172.21.15.63:0/1218434447 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ec103210 con 0x7f19ec102780 2023-12-07T16:14:53.738 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.045+0000 7f19ea59c700 1 --2- 172.21.15.63:0/1218434447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19ec102780 0x7f19ec102b90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f19dc0098e0 tx=0x7f19dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5326af14d4f976d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:53.738 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.046+0000 7f19e959a700 1 -- 172.21.15.63:0/1218434447 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19dc00b860 con 0x7f19ec102780 2023-12-07T16:14:53.739 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.046+0000 7f19e959a700 1 -- 172.21.15.63:0/1218434447 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f19dc00be70 con 0x7f19ec102780 2023-12-07T16:14:53.739 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.046+0000 7f19e959a700 1 -- 172.21.15.63:0/1218434447 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19dc010380 con 0x7f19ec102780 2023-12-07T16:14:53.739 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.046+0000 7f19f0f21700 1 -- 172.21.15.63:0/1218434447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19ec102780 msgr2=0x7f19ec102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:53.739 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.046+0000 7f19f0f21700 1 --2- 172.21.15.63:0/1218434447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19ec102780 0x7f19ec102b90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f19dc0098e0 tx=0x7f19dc009250 comp rx=0 tx=0).stop 2023-12-07T16:14:53.739 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.046+0000 7f19f0f21700 1 -- 172.21.15.63:0/1218434447 shutdown_connections 2023-12-07T16:14:53.739 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.046+0000 7f19f0f21700 1 --2- 172.21.15.63:0/1218434447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19ec102780 0x7f19ec102b90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:53.739 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.046+0000 7f19f0f21700 1 -- 172.21.15.63:0/1218434447 >> 172.21.15.63:0/1218434447 conn(0x7f19ec0fc0b0 msgr2=0x7f19ec0fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:53.739 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.046+0000 7f19f0f21700 1 -- 172.21.15.63:0/1218434447 shutdown_connections 2023-12-07T16:14:53.739 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.046+0000 7f19f0f21700 1 -- 172.21.15.63:0/1218434447 wait complete. 2023-12-07T16:14:53.739 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.047+0000 7f19f0f21700 1 Processor -- start 2023-12-07T16:14:53.739 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.047+0000 7f19f0f21700 1 -- start start 2023-12-07T16:14:53.740 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.047+0000 7f19f0f21700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19ec102780 0x7f19ec113e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:53.740 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.047+0000 7f19f0f21700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec101070 con 0x7f19ec102780 2023-12-07T16:14:53.740 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.047+0000 7f19ea59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19ec102780 0x7f19ec113e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:14:53.740 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.047+0000 7f19ea59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19ec102780 0x7f19ec113e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59384/0 (socket says 172.21.15.63:59384) 2023-12-07T16:14:53.740 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.047+0000 7f19ea59c700 1 -- 172.21.15.63:0/2932024292 learned_addr learned my addr 172.21.15.63:0/2932024292 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:14:53.740 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.047+0000 7f19ea59c700 1 -- 172.21.15.63:0/2932024292 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc0094f0 con 0x7f19ec102780 2023-12-07T16:14:53.740 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.047+0000 7f19ea59c700 1 --2- 172.21.15.63:0/2932024292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19ec102780 0x7f19ec113e60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f19dc006d40 tx=0x7f19dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:14:53.740 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.048+0000 7f19daffd700 1 -- 172.21.15.63:0/2932024292 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19dc010960 con 0x7f19ec102780 2023-12-07T16:14:53.740 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.048+0000 7f19daffd700 1 -- 172.21.15.63:0/2932024292 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f19dc01a430 con 0x7f19ec102780 2023-12-07T16:14:53.740 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.048+0000 7f19f0f21700 1 -- 172.21.15.63:0/2932024292 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ec101270 con 0x7f19ec102780 2023-12-07T16:14:53.740 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.048+0000 7f19daffd700 1 -- 172.21.15.63:0/2932024292 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19dc0245b0 con 0x7f19ec102780 2023-12-07T16:14:53.740 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.048+0000 7f19f0f21700 1 -- 172.21.15.63:0/2932024292 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ec114560 con 0x7f19ec102780 2023-12-07T16:14:53.741 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.049+0000 7f19daffd700 1 -- 172.21.15.63:0/2932024292 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f19dc02d3f0 con 0x7f19ec102780 2023-12-07T16:14:53.741 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.049+0000 7f19f0f21700 1 -- 172.21.15.63:0/2932024292 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19ec10a0b0 con 0x7f19ec102780 2023-12-07T16:14:53.741 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.049+0000 7f19daffd700 1 --2- 172.21.15.63:0/2932024292 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f19d4036640 0x7f19d4038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:14:53.741 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.049+0000 7f19daffd700 1 -- 172.21.15.63:0/2932024292 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f19dc04a2e0 con 0x7f19ec102780 2023-12-07T16:14:53.741 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.049+0000 7f19e9d9b700 1 -- 172.21.15.63:0/2932024292 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f19d4036640 msgr2=0x7f19d4038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/1052036735 2023-12-07T16:14:53.741 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.049+0000 7f19e9d9b700 1 --2- 172.21.15.63:0/2932024292 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f19d4036640 0x7f19d4038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-07T16:14:53.741 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.054+0000 7f19daffd700 1 -- 172.21.15.63:0/2932024292 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f19dc018e20 con 0x7f19ec102780 2023-12-07T16:14:53.741 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.250+0000 7f19e9d9b700 1 -- 172.21.15.63:0/2932024292 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f19d4036640 msgr2=0x7f19d4038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/1052036735 2023-12-07T16:14:53.741 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.250+0000 7f19e9d9b700 1 --2- 172.21.15.63:0/2932024292 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f19d4036640 0x7f19d4038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-07T16:14:53.741 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.311+0000 7f19f0f21700 1 -- 172.21.15.63:0/2932024292 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f19ec101fd0 con 0x7f19ec102780 2023-12-07T16:14:53.742 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.312+0000 7f19daffd700 1 -- 172.21.15.63:0/2932024292 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f19dc018c40 con 0x7f19ec102780 2023-12-07T16:14:53.742 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.314+0000 7f19f0f21700 1 -- 172.21.15.63:0/2932024292 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f19d4036640 msgr2=0x7f19d4038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-07T16:14:53.742 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.314+0000 7f19f0f21700 1 --2- 172.21.15.63:0/2932024292 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f19d4036640 0x7f19d4038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:53.742 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.314+0000 7f19f0f21700 1 -- 172.21.15.63:0/2932024292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19ec102780 msgr2=0x7f19ec113e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:14:53.742 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.314+0000 7f19f0f21700 1 --2- 172.21.15.63:0/2932024292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19ec102780 0x7f19ec113e60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f19dc006d40 tx=0x7f19dc009250 comp rx=0 tx=0).stop 2023-12-07T16:14:53.742 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.314+0000 7f19f0f21700 1 -- 172.21.15.63:0/2932024292 shutdown_connections 2023-12-07T16:14:53.742 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.314+0000 7f19f0f21700 1 --2- 172.21.15.63:0/2932024292 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f19d4036640 0x7f19d4038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:53.742 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.314+0000 7f19f0f21700 1 --2- 172.21.15.63:0/2932024292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19ec102780 0x7f19ec113e60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:14:53.742 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.314+0000 7f19f0f21700 1 -- 172.21.15.63:0/2932024292 >> 172.21.15.63:0/2932024292 conn(0x7f19ec0fc0b0 msgr2=0x7f19ec0fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:14:53.742 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.314+0000 7f19f0f21700 1 -- 172.21.15.63:0/2932024292 shutdown_connections 2023-12-07T16:14:53.742 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:53.314+0000 7f19f0f21700 1 -- 172.21.15.63:0/2932024292 wait complete. 2023-12-07T16:14:53.743 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for the mgr to restart... 2023-12-07T16:14:53.743 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for mgr epoch 9... 2023-12-07T16:14:54.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:54 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2932024292' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-07T16:14:59.185 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:59 smithi063 ceph-mon[112095]: Active manager daemon smithi063.yohyyx restarted 2023-12-07T16:14:59.185 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:59 smithi063 ceph-mon[112095]: Activating manager daemon smithi063.yohyyx 2023-12-07T16:14:59.185 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:59 smithi063 ceph-mon[112095]: osdmap e3: 0 total, 0 up, 0 in 2023-12-07T16:14:59.185 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:59 smithi063 ceph-mon[112095]: mgrmap e10: smithi063.yohyyx(active, starting, since 0.00334961s) 2023-12-07T16:14:59.185 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:59 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-07T16:14:59.185 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:59 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr metadata", "who": "smithi063.yohyyx", "id": "smithi063.yohyyx"}]: dispatch 2023-12-07T16:14:59.185 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:59 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-07T16:14:59.185 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:59 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-07T16:14:59.186 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:59 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-07T16:14:59.186 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:59 smithi063 ceph-mon[112095]: Manager daemon smithi063.yohyyx is now available 2023-12-07T16:14:59.186 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:59 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:14:59.186 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:14:59 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:15:00.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:00 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.yohyyx/mirror_snapshot_schedule"}]: dispatch 2023-12-07T16:15:00.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:00 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.yohyyx/trash_purge_schedule"}]: dispatch 2023-12-07T16:15:00.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:00 smithi063 ceph-mon[112095]: mgrmap e11: smithi063.yohyyx(active, since 1.0063s) 2023-12-07T16:15:00.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:00 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:00.488 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2023-12-07T16:15:00.488 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-12-07T16:15:00.488 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-07T16:15:00.488 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2023-12-07T16:15:00.488 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.129+0000 7f92ebf95700 1 Processor -- start 2023-12-07T16:15:00.488 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.130+0000 7f92ebf95700 1 -- start start 2023-12-07T16:15:00.488 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.130+0000 7f92ebf95700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e41022d0 0x7f92e41026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:00.488 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.130+0000 7f92ebf95700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e4102c20 con 0x7f92e41022d0 2023-12-07T16:15:00.489 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.130+0000 7f92e9d31700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e41022d0 0x7f92e41026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:00.489 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.130+0000 7f92e9d31700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e41022d0 0x7f92e41026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59388/0 (socket says 172.21.15.63:59388) 2023-12-07T16:15:00.489 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.130+0000 7f92e9d31700 1 -- 172.21.15.63:0/1632852426 learned_addr learned my addr 172.21.15.63:0/1632852426 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:15:00.489 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.130+0000 7f92e9d31700 1 -- 172.21.15.63:0/1632852426 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e4102d60 con 0x7f92e41022d0 2023-12-07T16:15:00.489 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.130+0000 7f92e9d31700 1 --2- 172.21.15.63:0/1632852426 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e41022d0 0x7f92e41026e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f92e00098e0 tx=0x7f92e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a87bc15807bab2b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:00.489 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.131+0000 7f92e8d2f700 1 -- 172.21.15.63:0/1632852426 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92e000b860 con 0x7f92e41022d0 2023-12-07T16:15:00.489 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.131+0000 7f92e8d2f700 1 -- 172.21.15.63:0/1632852426 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f92e000be70 con 0x7f92e41022d0 2023-12-07T16:15:00.489 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.131+0000 7f92e8d2f700 1 -- 172.21.15.63:0/1632852426 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92e0010380 con 0x7f92e41022d0 2023-12-07T16:15:00.489 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.131+0000 7f92ebf95700 1 -- 172.21.15.63:0/1632852426 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e41022d0 msgr2=0x7f92e41026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:00.489 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.131+0000 7f92ebf95700 1 --2- 172.21.15.63:0/1632852426 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e41022d0 0x7f92e41026e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f92e00098e0 tx=0x7f92e0009250 comp rx=0 tx=0).stop 2023-12-07T16:15:00.489 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.131+0000 7f92ebf95700 1 -- 172.21.15.63:0/1632852426 shutdown_connections 2023-12-07T16:15:00.489 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.131+0000 7f92ebf95700 1 --2- 172.21.15.63:0/1632852426 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e41022d0 0x7f92e41026e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:00.489 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.131+0000 7f92ebf95700 1 -- 172.21.15.63:0/1632852426 >> 172.21.15.63:0/1632852426 conn(0x7f92e40fda50 msgr2=0x7f92e40ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:00.489 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.131+0000 7f92ebf95700 1 -- 172.21.15.63:0/1632852426 shutdown_connections 2023-12-07T16:15:00.489 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.131+0000 7f92ebf95700 1 -- 172.21.15.63:0/1632852426 wait complete. 2023-12-07T16:15:00.490 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.132+0000 7f92ebf95700 1 Processor -- start 2023-12-07T16:15:00.490 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.132+0000 7f92ebf95700 1 -- start start 2023-12-07T16:15:00.490 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.132+0000 7f92ebf95700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e41022d0 0x7f92e4111180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:00.490 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.132+0000 7f92ebf95700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e41116c0 con 0x7f92e41022d0 2023-12-07T16:15:00.490 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.132+0000 7f92e9d31700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e41022d0 0x7f92e4111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:00.490 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.132+0000 7f92e9d31700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e41022d0 0x7f92e4111180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59390/0 (socket says 172.21.15.63:59390) 2023-12-07T16:15:00.490 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.132+0000 7f92e9d31700 1 -- 172.21.15.63:0/237494129 learned_addr learned my addr 172.21.15.63:0/237494129 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:15:00.490 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.132+0000 7f92e9d31700 1 -- 172.21.15.63:0/237494129 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e00094f0 con 0x7f92e41022d0 2023-12-07T16:15:00.490 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.133+0000 7f92e9d31700 1 --2- 172.21.15.63:0/237494129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e41022d0 0x7f92e4111180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f92e000c010 tx=0x7f92e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:00.490 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.133+0000 7f92da7fc700 1 -- 172.21.15.63:0/237494129 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92e0010960 con 0x7f92e41022d0 2023-12-07T16:15:00.490 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.133+0000 7f92da7fc700 1 -- 172.21.15.63:0/237494129 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f92e001a430 con 0x7f92e41022d0 2023-12-07T16:15:00.490 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.133+0000 7f92ebf95700 1 -- 172.21.15.63:0/237494129 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e41118c0 con 0x7f92e41022d0 2023-12-07T16:15:00.490 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.133+0000 7f92da7fc700 1 -- 172.21.15.63:0/237494129 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92e0019580 con 0x7f92e41022d0 2023-12-07T16:15:00.490 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.133+0000 7f92ebf95700 1 -- 172.21.15.63:0/237494129 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e4111cd0 con 0x7f92e41022d0 2023-12-07T16:15:00.491 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.134+0000 7f92da7fc700 1 -- 172.21.15.63:0/237494129 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f92e00197b0 con 0x7f92e41022d0 2023-12-07T16:15:00.491 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.134+0000 7f92da7fc700 1 --2- 172.21.15.63:0/237494129 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f92d0036690 0x7f92d0038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:00.491 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.134+0000 7f92da7fc700 1 -- 172.21.15.63:0/237494129 --> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f92d0039250 con 0x7f92d0036690 2023-12-07T16:15:00.491 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.134+0000 7f92da7fc700 1 -- 172.21.15.63:0/237494129 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f92e004a3f0 con 0x7f92e41022d0 2023-12-07T16:15:00.491 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.134+0000 7f92e9530700 1 -- 172.21.15.63:0/237494129 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f92d0036690 msgr2=0x7f92d0038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/1052036735 2023-12-07T16:15:00.491 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.134+0000 7f92e9530700 1 --2- 172.21.15.63:0/237494129 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f92d0036690 0x7f92d0038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-07T16:15:00.491 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.335+0000 7f92e9530700 1 -- 172.21.15.63:0/237494129 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f92d0036690 msgr2=0x7f92d0038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/1052036735 2023-12-07T16:15:00.491 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.335+0000 7f92e9530700 1 --2- 172.21.15.63:0/237494129 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f92d0036690 0x7f92d0038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-07T16:15:00.491 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.736+0000 7f92e9530700 1 -- 172.21.15.63:0/237494129 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f92d0036690 msgr2=0x7f92d0038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/1052036735 2023-12-07T16:15:00.491 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:54.736+0000 7f92e9530700 1 --2- 172.21.15.63:0/237494129 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f92d0036690 0x7f92d0038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-07T16:15:00.491 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:55.537+0000 7f92e9530700 1 -- 172.21.15.63:0/237494129 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f92d0036690 msgr2=0x7f92d0038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/1052036735 2023-12-07T16:15:00.491 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:55.537+0000 7f92e9530700 1 --2- 172.21.15.63:0/237494129 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f92d0036690 0x7f92d0038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-07T16:15:00.491 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:57.138+0000 7f92e9530700 1 -- 172.21.15.63:0/237494129 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f92d0036690 msgr2=0x7f92d0038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/1052036735 2023-12-07T16:15:00.491 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:57.138+0000 7f92e9530700 1 --2- 172.21.15.63:0/237494129 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f92d0036690 0x7f92d0038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-07T16:15:00.491 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:59.067+0000 7f92da7fc700 1 -- 172.21.15.63:0/237494129 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mgrmap(e 10) v1 ==== 43061+0+0 (secure 0 0 0) 0x7f92e001a980 con 0x7f92e41022d0 2023-12-07T16:15:00.491 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:59.067+0000 7f92da7fc700 1 -- 172.21.15.63:0/237494129 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f92d0036690 msgr2=0x7f92d0038b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-07T16:15:00.492 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:14:59.067+0000 7f92da7fc700 1 --2- 172.21.15.63:0/237494129 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f92d0036690 0x7f92d0038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:00.492 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.069+0000 7f92da7fc700 1 -- 172.21.15.63:0/237494129 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7f92e002d3f0 con 0x7f92e41022d0 2023-12-07T16:15:00.492 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.069+0000 7f92da7fc700 1 --2- 172.21.15.63:0/237494129 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f92d0039fb0 0x7f92d003c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:00.492 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.069+0000 7f92da7fc700 1 -- 172.21.15.63:0/237494129 --> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f92d0039250 con 0x7f92d0039fb0 2023-12-07T16:15:00.492 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.070+0000 7f92e9530700 1 --2- 172.21.15.63:0/237494129 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f92d0039fb0 0x7f92d003c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:00.492 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.070+0000 7f92e9530700 1 --2- 172.21.15.63:0/237494129 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f92d0039fb0 0x7f92d003c390 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f92d40039d0 tx=0x7f92d4009350 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:00.492 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.071+0000 7f92da7fc700 1 -- 172.21.15.63:0/237494129 <== mgr.14162 v2:172.21.15.63:6800/4069965417 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f92d0039250 con 0x7f92d0039fb0 2023-12-07T16:15:00.492 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.081+0000 7f92ebf95700 1 -- 172.21.15.63:0/237494129 --> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f92e404bb80 con 0x7f92d0039fb0 2023-12-07T16:15:00.492 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.082+0000 7f92da7fc700 1 -- 172.21.15.63:0/237494129 <== mgr.14162 v2:172.21.15.63:6800/4069965417 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f92e404bb80 con 0x7f92d0039fb0 2023-12-07T16:15:00.492 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.082+0000 7f92ebf95700 1 -- 172.21.15.63:0/237494129 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f92d0039fb0 msgr2=0x7f92d003c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:00.492 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.082+0000 7f92ebf95700 1 --2- 172.21.15.63:0/237494129 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f92d0039fb0 0x7f92d003c390 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f92d40039d0 tx=0x7f92d4009350 comp rx=0 tx=0).stop 2023-12-07T16:15:00.492 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.082+0000 7f92ebf95700 1 -- 172.21.15.63:0/237494129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e41022d0 msgr2=0x7f92e4111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:00.492 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.082+0000 7f92ebf95700 1 --2- 172.21.15.63:0/237494129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e41022d0 0x7f92e4111180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f92e000c010 tx=0x7f92e0009250 comp rx=0 tx=0).stop 2023-12-07T16:15:00.492 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.082+0000 7f92ebf95700 1 -- 172.21.15.63:0/237494129 shutdown_connections 2023-12-07T16:15:00.492 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.082+0000 7f92ebf95700 1 --2- 172.21.15.63:0/237494129 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f92d0039fb0 0x7f92d003c390 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:00.492 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.082+0000 7f92ebf95700 1 --2- 172.21.15.63:0/237494129 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e41022d0 0x7f92e4111180 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:00.492 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.082+0000 7f92ebf95700 1 --2- 172.21.15.63:0/237494129 >> [v2:172.21.15.63:6800/1052036735,v1:172.21.15.63:6801/1052036735] conn(0x7f92d0036690 0x7f92d0038b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:00.493 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.082+0000 7f92ebf95700 1 -- 172.21.15.63:0/237494129 >> 172.21.15.63:0/237494129 conn(0x7f92e40fda50 msgr2=0x7f92e40ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:00.493 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.082+0000 7f92ebf95700 1 -- 172.21.15.63:0/237494129 shutdown_connections 2023-12-07T16:15:00.493 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.082+0000 7f92ebf95700 1 -- 172.21.15.63:0/237494129 wait complete. 2023-12-07T16:15:00.493 INFO:teuthology.orchestra.run.smithi063.stdout:mgr epoch 9 is available 2023-12-07T16:15:00.493 INFO:teuthology.orchestra.run.smithi063.stdout:Generating a dashboard self-signed certificate... 2023-12-07T16:15:01.383 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:01 smithi063 ceph-mon[112095]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-07T16:15:01.383 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:01 smithi063 ceph-mon[112095]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-07T16:15:01.383 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:01 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:01.383 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:01 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:01.835 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-12-07T16:15:01.836 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.959+0000 7f993b25c700 1 Processor -- start 2023-12-07T16:15:01.836 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.959+0000 7f993b25c700 1 -- start start 2023-12-07T16:15:01.836 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.959+0000 7f993b25c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99341022d0 0x7f99341026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:01.836 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.959+0000 7f993b25c700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9934102c20 con 0x7f99341022d0 2023-12-07T16:15:01.836 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.959+0000 7f9938ff8700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99341022d0 0x7f99341026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:01.836 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.959+0000 7f9938ff8700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99341022d0 0x7f99341026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47836/0 (socket says 172.21.15.63:47836) 2023-12-07T16:15:01.836 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.959+0000 7f9938ff8700 1 -- 172.21.15.63:0/3474888002 learned_addr learned my addr 172.21.15.63:0/3474888002 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:15:01.836 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.960+0000 7f9938ff8700 1 -- 172.21.15.63:0/3474888002 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9934102d60 con 0x7f99341022d0 2023-12-07T16:15:01.836 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.960+0000 7f9938ff8700 1 --2- 172.21.15.63:0/3474888002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99341022d0 0x7f99341026e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f99280098e0 tx=0x7f9928009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca301a1d0f71d1a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:01.836 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.960+0000 7f99337fe700 1 -- 172.21.15.63:0/3474888002 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f992800b860 con 0x7f99341022d0 2023-12-07T16:15:01.836 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.960+0000 7f99337fe700 1 -- 172.21.15.63:0/3474888002 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f992800be70 con 0x7f99341022d0 2023-12-07T16:15:01.836 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.960+0000 7f99337fe700 1 -- 172.21.15.63:0/3474888002 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9928010380 con 0x7f99341022d0 2023-12-07T16:15:01.837 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.961+0000 7f993b25c700 1 -- 172.21.15.63:0/3474888002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99341022d0 msgr2=0x7f99341026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:01.837 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.961+0000 7f993b25c700 1 --2- 172.21.15.63:0/3474888002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99341022d0 0x7f99341026e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f99280098e0 tx=0x7f9928009250 comp rx=0 tx=0).stop 2023-12-07T16:15:01.837 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.961+0000 7f993b25c700 1 -- 172.21.15.63:0/3474888002 shutdown_connections 2023-12-07T16:15:01.837 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.961+0000 7f993b25c700 1 --2- 172.21.15.63:0/3474888002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99341022d0 0x7f99341026e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:01.837 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.961+0000 7f993b25c700 1 -- 172.21.15.63:0/3474888002 >> 172.21.15.63:0/3474888002 conn(0x7f99340fda50 msgr2=0x7f99340ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:01.837 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.961+0000 7f993b25c700 1 -- 172.21.15.63:0/3474888002 shutdown_connections 2023-12-07T16:15:01.837 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.961+0000 7f993b25c700 1 -- 172.21.15.63:0/3474888002 wait complete. 2023-12-07T16:15:01.837 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.961+0000 7f993b25c700 1 Processor -- start 2023-12-07T16:15:01.837 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.961+0000 7f993b25c700 1 -- start start 2023-12-07T16:15:01.837 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.962+0000 7f993b25c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99341022d0 0x7f9934111180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:01.837 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.962+0000 7f993b25c700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99341116c0 con 0x7f99341022d0 2023-12-07T16:15:01.837 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.962+0000 7f9938ff8700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99341022d0 0x7f9934111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:01.837 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.962+0000 7f9938ff8700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99341022d0 0x7f9934111180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47844/0 (socket says 172.21.15.63:47844) 2023-12-07T16:15:01.837 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.962+0000 7f9938ff8700 1 -- 172.21.15.63:0/163314630 learned_addr learned my addr 172.21.15.63:0/163314630 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:15:01.838 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.962+0000 7f9938ff8700 1 -- 172.21.15.63:0/163314630 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99280094f0 con 0x7f99341022d0 2023-12-07T16:15:01.838 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.962+0000 7f9938ff8700 1 --2- 172.21.15.63:0/163314630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99341022d0 0x7f9934111180 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f992800c010 tx=0x7f9928009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:01.838 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.963+0000 7f99317fa700 1 -- 172.21.15.63:0/163314630 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9928010960 con 0x7f99341022d0 2023-12-07T16:15:01.838 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.963+0000 7f99317fa700 1 -- 172.21.15.63:0/163314630 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f992801a430 con 0x7f99341022d0 2023-12-07T16:15:01.838 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.963+0000 7f993b25c700 1 -- 172.21.15.63:0/163314630 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99341118c0 con 0x7f99341022d0 2023-12-07T16:15:01.838 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.963+0000 7f99317fa700 1 -- 172.21.15.63:0/163314630 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9928019580 con 0x7f99341022d0 2023-12-07T16:15:01.838 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.963+0000 7f993b25c700 1 -- 172.21.15.63:0/163314630 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9934111cd0 con 0x7f99341022d0 2023-12-07T16:15:01.838 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.963+0000 7f99317fa700 1 -- 172.21.15.63:0/163314630 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7f99280197b0 con 0x7f99341022d0 2023-12-07T16:15:01.838 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.964+0000 7f99317fa700 1 --2- 172.21.15.63:0/163314630 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f9924036570 0x7f9924038a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:01.838 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.964+0000 7f99317fa700 1 -- 172.21.15.63:0/163314630 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f992804a360 con 0x7f99341022d0 2023-12-07T16:15:01.838 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.964+0000 7f9933fff700 1 --2- 172.21.15.63:0/163314630 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f9924036570 0x7f9924038a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:01.838 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.964+0000 7f993b25c700 1 -- 172.21.15.63:0/163314630 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f993404bb80 con 0x7f99341022d0 2023-12-07T16:15:01.838 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.964+0000 7f9933fff700 1 --2- 172.21.15.63:0/163314630 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f9924036570 0x7f9924038a20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9920009990 tx=0x7f9920006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:01.838 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:00.969+0000 7f99317fa700 1 -- 172.21.15.63:0/163314630 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9928019b50 con 0x7f99341022d0 2023-12-07T16:15:01.839 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:01.171+0000 7f993b25c700 1 -- 172.21.15.63:0/163314630 --> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f993410ad20 con 0x7f9924036570 2023-12-07T16:15:01.839 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:01.257+0000 7f99317fa700 1 -- 172.21.15.63:0/163314630 <== mgr.14162 v2:172.21.15.63:6800/4069965417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f993410ad20 con 0x7f9924036570 2023-12-07T16:15:01.839 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:01.260+0000 7f993b25c700 1 -- 172.21.15.63:0/163314630 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f9924036570 msgr2=0x7f9924038a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:01.839 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:01.260+0000 7f993b25c700 1 --2- 172.21.15.63:0/163314630 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f9924036570 0x7f9924038a20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9920009990 tx=0x7f9920006e40 comp rx=0 tx=0).stop 2023-12-07T16:15:01.839 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:01.260+0000 7f993b25c700 1 -- 172.21.15.63:0/163314630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99341022d0 msgr2=0x7f9934111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:01.839 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:01.260+0000 7f993b25c700 1 --2- 172.21.15.63:0/163314630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99341022d0 0x7f9934111180 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f992800c010 tx=0x7f9928009250 comp rx=0 tx=0).stop 2023-12-07T16:15:01.839 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:01.260+0000 7f993b25c700 1 -- 172.21.15.63:0/163314630 shutdown_connections 2023-12-07T16:15:01.839 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:01.260+0000 7f993b25c700 1 --2- 172.21.15.63:0/163314630 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f9924036570 0x7f9924038a20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:01.839 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:01.260+0000 7f993b25c700 1 --2- 172.21.15.63:0/163314630 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99341022d0 0x7f9934111180 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:01.839 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:01.260+0000 7f993b25c700 1 -- 172.21.15.63:0/163314630 >> 172.21.15.63:0/163314630 conn(0x7f99340fda50 msgr2=0x7f99340ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:01.839 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:01.260+0000 7f993b25c700 1 -- 172.21.15.63:0/163314630 shutdown_connections 2023-12-07T16:15:01.839 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:01.260+0000 7f993b25c700 1 -- 172.21.15.63:0/163314630 wait complete. 2023-12-07T16:15:01.839 INFO:teuthology.orchestra.run.smithi063.stdout:Creating initial admin user... 2023-12-07T16:15:02.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:02 smithi063 ceph-mon[112095]: [07/Dec/2023:16:15:00] ENGINE Bus STARTING 2023-12-07T16:15:02.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:02 smithi063 ceph-mon[112095]: [07/Dec/2023:16:15:00] ENGINE Serving on https://172.21.15.63:7150 2023-12-07T16:15:02.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:02 smithi063 ceph-mon[112095]: [07/Dec/2023:16:15:00] ENGINE Bus STARTED 2023-12-07T16:15:02.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:02 smithi063 ceph-mon[112095]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:15:02.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:02 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:02.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:02 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:02.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:02 smithi063 ceph-mon[112095]: mgrmap e12: smithi063.yohyyx(active, since 2s) 2023-12-07T16:15:03.210 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$qtsiW9VLfxMovylGPLDrme37xRnQSdy2G4c7ozsA9CbEK/iBASbo6", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1701965702, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-12-07T16:15:03.210 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.393+0000 7f95223b0700 1 Processor -- start 2023-12-07T16:15:03.210 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.393+0000 7f95223b0700 1 -- start start 2023-12-07T16:15:03.210 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.393+0000 7f95223b0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f951c077bf0 0x7f951c076100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:03.210 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.393+0000 7f95223b0700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c078000 con 0x7f951c077bf0 2023-12-07T16:15:03.210 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.393+0000 7f951bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f951c077bf0 0x7f951c076100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:03.210 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.393+0000 7f951bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f951c077bf0 0x7f951c076100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47850/0 (socket says 172.21.15.63:47850) 2023-12-07T16:15:03.211 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.393+0000 7f951bfff700 1 -- 172.21.15.63:0/628043405 learned_addr learned my addr 172.21.15.63:0/628043405 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:15:03.211 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.394+0000 7f951bfff700 1 -- 172.21.15.63:0/628043405 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c076640 con 0x7f951c077bf0 2023-12-07T16:15:03.211 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.394+0000 7f951bfff700 1 --2- 172.21.15.63:0/628043405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f951c077bf0 0x7f951c076100 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f95040098e0 tx=0x7f9504009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8bda5f852ebe56 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:03.211 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.394+0000 7f951affd700 1 -- 172.21.15.63:0/628043405 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f950400b860 con 0x7f951c077bf0 2023-12-07T16:15:03.211 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.394+0000 7f951affd700 1 -- 172.21.15.63:0/628043405 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f950400be70 con 0x7f951c077bf0 2023-12-07T16:15:03.211 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.394+0000 7f951affd700 1 -- 172.21.15.63:0/628043405 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9504010380 con 0x7f951c077bf0 2023-12-07T16:15:03.211 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.395+0000 7f95223b0700 1 -- 172.21.15.63:0/628043405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f951c077bf0 msgr2=0x7f951c076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:03.211 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.395+0000 7f95223b0700 1 --2- 172.21.15.63:0/628043405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f951c077bf0 0x7f951c076100 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f95040098e0 tx=0x7f9504009250 comp rx=0 tx=0).stop 2023-12-07T16:15:03.211 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.395+0000 7f95223b0700 1 -- 172.21.15.63:0/628043405 shutdown_connections 2023-12-07T16:15:03.211 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.395+0000 7f95223b0700 1 --2- 172.21.15.63:0/628043405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f951c077bf0 0x7f951c076100 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:03.211 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.395+0000 7f95223b0700 1 -- 172.21.15.63:0/628043405 >> 172.21.15.63:0/628043405 conn(0x7f951c0fda50 msgr2=0x7f951c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:03.211 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.395+0000 7f95223b0700 1 -- 172.21.15.63:0/628043405 shutdown_connections 2023-12-07T16:15:03.211 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.395+0000 7f95223b0700 1 -- 172.21.15.63:0/628043405 wait complete. 2023-12-07T16:15:03.211 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.395+0000 7f95223b0700 1 Processor -- start 2023-12-07T16:15:03.211 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.395+0000 7f95223b0700 1 -- start start 2023-12-07T16:15:03.212 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.396+0000 7f95223b0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f951c077bf0 0x7f951c1133e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:03.212 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.396+0000 7f95223b0700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c113920 con 0x7f951c077bf0 2023-12-07T16:15:03.212 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.396+0000 7f951bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f951c077bf0 0x7f951c1133e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:03.212 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.396+0000 7f951bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f951c077bf0 0x7f951c1133e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47862/0 (socket says 172.21.15.63:47862) 2023-12-07T16:15:03.212 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.396+0000 7f951bfff700 1 -- 172.21.15.63:0/3456297908 learned_addr learned my addr 172.21.15.63:0/3456297908 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:15:03.212 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.396+0000 7f951bfff700 1 -- 172.21.15.63:0/3456297908 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95040094f0 con 0x7f951c077bf0 2023-12-07T16:15:03.212 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.396+0000 7f951bfff700 1 --2- 172.21.15.63:0/3456297908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f951c077bf0 0x7f951c1133e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9504006d40 tx=0x7f9504009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:03.212 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.396+0000 7f9518ff9700 1 -- 172.21.15.63:0/3456297908 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9504010960 con 0x7f951c077bf0 2023-12-07T16:15:03.212 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.396+0000 7f9518ff9700 1 -- 172.21.15.63:0/3456297908 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f950401a430 con 0x7f951c077bf0 2023-12-07T16:15:03.212 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.396+0000 7f9518ff9700 1 -- 172.21.15.63:0/3456297908 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f95040245b0 con 0x7f951c077bf0 2023-12-07T16:15:03.212 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.396+0000 7f95223b0700 1 -- 172.21.15.63:0/3456297908 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f951c113b20 con 0x7f951c077bf0 2023-12-07T16:15:03.212 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.396+0000 7f95223b0700 1 -- 172.21.15.63:0/3456297908 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f951c113f30 con 0x7f951c077bf0 2023-12-07T16:15:03.212 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.397+0000 7f9518ff9700 1 -- 172.21.15.63:0/3456297908 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f950402d3f0 con 0x7f951c077bf0 2023-12-07T16:15:03.212 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.397+0000 7f9518ff9700 1 --2- 172.21.15.63:0/3456297908 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f9508036640 0x7f9508038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:03.212 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.397+0000 7f9518ff9700 1 -- 172.21.15.63:0/3456297908 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f950404a590 con 0x7f951c077bf0 2023-12-07T16:15:03.213 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.397+0000 7f95127fc700 1 -- 172.21.15.63:0/3456297908 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95000052b0 con 0x7f951c077bf0 2023-12-07T16:15:03.213 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.398+0000 7f951b7fe700 1 --2- 172.21.15.63:0/3456297908 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f9508036640 0x7f9508038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:03.213 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.398+0000 7f951b7fe700 1 --2- 172.21.15.63:0/3456297908 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f9508036640 0x7f9508038af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f950c009990 tx=0x7f950c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:03.213 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.402+0000 7f9518ff9700 1 -- 172.21.15.63:0/3456297908 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9504010ac0 con 0x7f951c077bf0 2023-12-07T16:15:03.213 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.609+0000 7f95127fc700 1 -- 172.21.15.63:0/3456297908 --> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f9500002400 con 0x7f9508036640 2023-12-07T16:15:03.213 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.855+0000 7f9518ff9700 1 -- 172.21.15.63:0/3456297908 <== mgr.14162 v2:172.21.15.63:6800/4069965417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f9500002400 con 0x7f9508036640 2023-12-07T16:15:03.213 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.857+0000 7f95127fc700 1 -- 172.21.15.63:0/3456297908 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f9508036640 msgr2=0x7f9508038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:03.213 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.857+0000 7f95127fc700 1 --2- 172.21.15.63:0/3456297908 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f9508036640 0x7f9508038af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f950c009990 tx=0x7f950c006e40 comp rx=0 tx=0).stop 2023-12-07T16:15:03.213 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.857+0000 7f95127fc700 1 -- 172.21.15.63:0/3456297908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f951c077bf0 msgr2=0x7f951c1133e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:03.213 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.857+0000 7f95127fc700 1 --2- 172.21.15.63:0/3456297908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f951c077bf0 0x7f951c1133e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9504006d40 tx=0x7f9504009250 comp rx=0 tx=0).stop 2023-12-07T16:15:03.213 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.857+0000 7f95127fc700 1 -- 172.21.15.63:0/3456297908 shutdown_connections 2023-12-07T16:15:03.213 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.857+0000 7f95127fc700 1 --2- 172.21.15.63:0/3456297908 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f9508036640 0x7f9508038af0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:03.213 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.857+0000 7f95127fc700 1 --2- 172.21.15.63:0/3456297908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f951c077bf0 0x7f951c1133e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:03.213 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.857+0000 7f95127fc700 1 -- 172.21.15.63:0/3456297908 >> 172.21.15.63:0/3456297908 conn(0x7f951c0fda50 msgr2=0x7f951c0ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:03.213 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.858+0000 7f95127fc700 1 -- 172.21.15.63:0/3456297908 shutdown_connections 2023-12-07T16:15:03.214 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:02.858+0000 7f95127fc700 1 -- 172.21.15.63:0/3456297908 wait complete. 2023-12-07T16:15:03.214 INFO:teuthology.orchestra.run.smithi063.stdout:Fetching dashboard port number... 2023-12-07T16:15:04.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:03 smithi063 ceph-mon[112095]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:15:04.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:03 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:04.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:03 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/1192563389' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-12-07T16:15:04.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 8443 2023-12-07T16:15:04.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.609+0000 7f49e9038700 1 Processor -- start 2023-12-07T16:15:04.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.610+0000 7f49e9038700 1 -- start start 2023-12-07T16:15:04.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.610+0000 7f49e9038700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49e4101800 0x7f49e4101c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:04.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.610+0000 7f49e9038700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e4102150 con 0x7f49e4101800 2023-12-07T16:15:04.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.610+0000 7f49e2d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49e4101800 0x7f49e4101c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:04.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.610+0000 7f49e2d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49e4101800 0x7f49e4101c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47864/0 (socket says 172.21.15.63:47864) 2023-12-07T16:15:04.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.610+0000 7f49e2d9d700 1 -- 172.21.15.63:0/3955943223 learned_addr learned my addr 172.21.15.63:0/3955943223 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:15:04.226 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.610+0000 7f49e2d9d700 1 -- 172.21.15.63:0/3955943223 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e4102290 con 0x7f49e4101800 2023-12-07T16:15:04.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.610+0000 7f49e2d9d700 1 --2- 172.21.15.63:0/3955943223 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49e4101800 0x7f49e4101c10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f49d40098e0 tx=0x7f49d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6536c5aac8fd12d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:04.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.611+0000 7f49e1d9b700 1 -- 172.21.15.63:0/3955943223 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f49d400b860 con 0x7f49e4101800 2023-12-07T16:15:04.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.611+0000 7f49e1d9b700 1 -- 172.21.15.63:0/3955943223 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f49d400be70 con 0x7f49e4101800 2023-12-07T16:15:04.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.611+0000 7f49e1d9b700 1 -- 172.21.15.63:0/3955943223 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f49d4010380 con 0x7f49e4101800 2023-12-07T16:15:04.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.611+0000 7f49e9038700 1 -- 172.21.15.63:0/3955943223 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49e4101800 msgr2=0x7f49e4101c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:04.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.611+0000 7f49e9038700 1 --2- 172.21.15.63:0/3955943223 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49e4101800 0x7f49e4101c10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f49d40098e0 tx=0x7f49d4009250 comp rx=0 tx=0).stop 2023-12-07T16:15:04.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.611+0000 7f49e9038700 1 -- 172.21.15.63:0/3955943223 shutdown_connections 2023-12-07T16:15:04.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.611+0000 7f49e9038700 1 --2- 172.21.15.63:0/3955943223 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49e4101800 0x7f49e4101c10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:04.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.611+0000 7f49e9038700 1 -- 172.21.15.63:0/3955943223 >> 172.21.15.63:0/3955943223 conn(0x7f49e40fc0b0 msgr2=0x7f49e40fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:04.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.611+0000 7f49e9038700 1 -- 172.21.15.63:0/3955943223 shutdown_connections 2023-12-07T16:15:04.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.611+0000 7f49e9038700 1 -- 172.21.15.63:0/3955943223 wait complete. 2023-12-07T16:15:04.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.612+0000 7f49e9038700 1 Processor -- start 2023-12-07T16:15:04.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.612+0000 7f49e9038700 1 -- start start 2023-12-07T16:15:04.227 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.612+0000 7f49e9038700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49e4101800 0x7f49e41075e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:04.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.612+0000 7f49e9038700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e4105a60 con 0x7f49e4101800 2023-12-07T16:15:04.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.612+0000 7f49e2d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49e4101800 0x7f49e41075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:04.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.612+0000 7f49e2d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49e4101800 0x7f49e41075e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47874/0 (socket says 172.21.15.63:47874) 2023-12-07T16:15:04.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.612+0000 7f49e2d9d700 1 -- 172.21.15.63:0/1192563389 learned_addr learned my addr 172.21.15.63:0/1192563389 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:15:04.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.613+0000 7f49e2d9d700 1 -- 172.21.15.63:0/1192563389 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d40094f0 con 0x7f49e4101800 2023-12-07T16:15:04.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.613+0000 7f49e2d9d700 1 --2- 172.21.15.63:0/1192563389 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49e4101800 0x7f49e41075e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f49d4011b60 tx=0x7f49d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:04.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.613+0000 7f49cb7fe700 1 -- 172.21.15.63:0/1192563389 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f49d4010850 con 0x7f49e4101800 2023-12-07T16:15:04.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.613+0000 7f49cb7fe700 1 -- 172.21.15.63:0/1192563389 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f49d4010e60 con 0x7f49e4101800 2023-12-07T16:15:04.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.613+0000 7f49e9038700 1 -- 172.21.15.63:0/1192563389 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e4105c60 con 0x7f49e4101800 2023-12-07T16:15:04.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.613+0000 7f49cb7fe700 1 -- 172.21.15.63:0/1192563389 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f49d401ae20 con 0x7f49e4101800 2023-12-07T16:15:04.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.613+0000 7f49e9038700 1 -- 172.21.15.63:0/1192563389 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e4106070 con 0x7f49e4101800 2023-12-07T16:15:04.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.614+0000 7f49cb7fe700 1 -- 172.21.15.63:0/1192563389 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f49d402d3f0 con 0x7f49e4101800 2023-12-07T16:15:04.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.614+0000 7f49cb7fe700 1 --2- 172.21.15.63:0/1192563389 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f49cc036690 0x7f49cc038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:04.228 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.614+0000 7f49cb7fe700 1 -- 172.21.15.63:0/1192563389 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f49d404a320 con 0x7f49e4101800 2023-12-07T16:15:04.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.614+0000 7f49e9038700 1 -- 172.21.15.63:0/1192563389 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e404bb80 con 0x7f49e4101800 2023-12-07T16:15:04.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.614+0000 7f49e259c700 1 --2- 172.21.15.63:0/1192563389 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f49cc036690 0x7f49cc038b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:04.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.614+0000 7f49e259c700 1 --2- 172.21.15.63:0/1192563389 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f49cc036690 0x7f49cc038b40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009990 tx=0x7f49d8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:04.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.619+0000 7f49cb7fe700 1 -- 172.21.15.63:0/1192563389 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f49d402b8e0 con 0x7f49e4101800 2023-12-07T16:15:04.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.808+0000 7f49e9038700 1 -- 172.21.15.63:0/1192563389 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f49e4102fb0 con 0x7f49e4101800 2023-12-07T16:15:04.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.809+0000 7f49cb7fe700 1 -- 172.21.15.63:0/1192563389 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f49d402b2f0 con 0x7f49e4101800 2023-12-07T16:15:04.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.811+0000 7f49e9038700 1 -- 172.21.15.63:0/1192563389 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f49cc036690 msgr2=0x7f49cc038b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:04.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.811+0000 7f49e9038700 1 --2- 172.21.15.63:0/1192563389 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f49cc036690 0x7f49cc038b40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009990 tx=0x7f49d8006e40 comp rx=0 tx=0).stop 2023-12-07T16:15:04.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.811+0000 7f49e9038700 1 -- 172.21.15.63:0/1192563389 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49e4101800 msgr2=0x7f49e41075e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:04.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.811+0000 7f49e9038700 1 --2- 172.21.15.63:0/1192563389 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49e4101800 0x7f49e41075e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f49d4011b60 tx=0x7f49d4009250 comp rx=0 tx=0).stop 2023-12-07T16:15:04.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.811+0000 7f49e9038700 1 -- 172.21.15.63:0/1192563389 shutdown_connections 2023-12-07T16:15:04.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.811+0000 7f49e9038700 1 --2- 172.21.15.63:0/1192563389 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f49cc036690 0x7f49cc038b40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:04.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.811+0000 7f49e9038700 1 --2- 172.21.15.63:0/1192563389 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49e4101800 0x7f49e41075e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:04.229 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.811+0000 7f49e9038700 1 -- 172.21.15.63:0/1192563389 >> 172.21.15.63:0/1192563389 conn(0x7f49e40fc0b0 msgr2=0x7f49e40fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:04.230 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.811+0000 7f49e9038700 1 -- 172.21.15.63:0/1192563389 shutdown_connections 2023-12-07T16:15:04.230 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:03.811+0000 7f49e9038700 1 -- 172.21.15.63:0/1192563389 wait complete. 2023-12-07T16:15:04.233 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-07T16:15:04.233 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout disabled 2023-12-07T16:15:04.241 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-07T16:15:04.241 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout inactive 2023-12-07T16:15:04.241 INFO:teuthology.orchestra.run.smithi063.stdout:firewalld.service is not enabled 2023-12-07T16:15:04.241 INFO:teuthology.orchestra.run.smithi063.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-12-07T16:15:04.243 INFO:teuthology.orchestra.run.smithi063.stdout:Ceph Dashboard is now available at: 2023-12-07T16:15:04.244 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:15:04.244 INFO:teuthology.orchestra.run.smithi063.stdout: URL: https://smithi063.front.sepia.ceph.com:8443/ 2023-12-07T16:15:04.244 INFO:teuthology.orchestra.run.smithi063.stdout: User: admin 2023-12-07T16:15:04.244 INFO:teuthology.orchestra.run.smithi063.stdout: Password: atpie26qtq 2023-12-07T16:15:04.244 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:15:04.244 INFO:teuthology.orchestra.run.smithi063.stdout:Saving cluster configuration to /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config directory 2023-12-07T16:15:04.244 INFO:teuthology.orchestra.run.smithi063.stdout:Enabling autotune for osd_memory_target 2023-12-07T16:15:05.176 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.610+0000 7f215754d700 1 Processor -- start 2023-12-07T16:15:05.176 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.610+0000 7f215754d700 1 -- start start 2023-12-07T16:15:05.176 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.610+0000 7f215754d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2150078ce0 0x7f21500771f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:05.176 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.610+0000 7f215754d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21500790f0 con 0x7f2150078ce0 2023-12-07T16:15:05.176 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.610+0000 7f21552e9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2150078ce0 0x7f21500771f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:05.176 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.610+0000 7f21552e9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2150078ce0 0x7f21500771f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47878/0 (socket says 172.21.15.63:47878) 2023-12-07T16:15:05.176 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.610+0000 7f21552e9700 1 -- 172.21.15.63:0/932591572 learned_addr learned my addr 172.21.15.63:0/932591572 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:15:05.176 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.610+0000 7f21552e9700 1 -- 172.21.15.63:0/932591572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2150077730 con 0x7f2150078ce0 2023-12-07T16:15:05.177 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.611+0000 7f21552e9700 1 --2- 172.21.15.63:0/932591572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2150078ce0 0x7f21500771f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f214c0098e0 tx=0x7f214c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d22fa64123e9090 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:05.177 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.611+0000 7f2147fff700 1 -- 172.21.15.63:0/932591572 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f214c00b860 con 0x7f2150078ce0 2023-12-07T16:15:05.177 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.611+0000 7f2147fff700 1 -- 172.21.15.63:0/932591572 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f214c00be70 con 0x7f2150078ce0 2023-12-07T16:15:05.177 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.611+0000 7f2147fff700 1 -- 172.21.15.63:0/932591572 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f214c010380 con 0x7f2150078ce0 2023-12-07T16:15:05.177 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.611+0000 7f215754d700 1 -- 172.21.15.63:0/932591572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2150078ce0 msgr2=0x7f21500771f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:05.177 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.611+0000 7f215754d700 1 --2- 172.21.15.63:0/932591572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2150078ce0 0x7f21500771f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f214c0098e0 tx=0x7f214c009250 comp rx=0 tx=0).stop 2023-12-07T16:15:05.177 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.611+0000 7f215754d700 1 -- 172.21.15.63:0/932591572 shutdown_connections 2023-12-07T16:15:05.177 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.611+0000 7f215754d700 1 --2- 172.21.15.63:0/932591572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2150078ce0 0x7f21500771f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:05.177 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.611+0000 7f215754d700 1 -- 172.21.15.63:0/932591572 >> 172.21.15.63:0/932591572 conn(0x7f21500fda10 msgr2=0x7f21500ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:05.177 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.611+0000 7f215754d700 1 -- 172.21.15.63:0/932591572 shutdown_connections 2023-12-07T16:15:05.177 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.611+0000 7f215754d700 1 -- 172.21.15.63:0/932591572 wait complete. 2023-12-07T16:15:05.177 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.612+0000 7f215754d700 1 Processor -- start 2023-12-07T16:15:05.177 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.612+0000 7f215754d700 1 -- start start 2023-12-07T16:15:05.177 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.612+0000 7f215754d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2150078ce0 0x7f2150113330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:05.177 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.612+0000 7f215754d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2150113870 con 0x7f2150078ce0 2023-12-07T16:15:05.178 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.612+0000 7f21552e9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2150078ce0 0x7f2150113330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:05.178 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.612+0000 7f21552e9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2150078ce0 0x7f2150113330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47884/0 (socket says 172.21.15.63:47884) 2023-12-07T16:15:05.178 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.612+0000 7f21552e9700 1 -- 172.21.15.63:0/963082973 learned_addr learned my addr 172.21.15.63:0/963082973 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:15:05.178 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.612+0000 7f21552e9700 1 -- 172.21.15.63:0/963082973 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c0094f0 con 0x7f2150078ce0 2023-12-07T16:15:05.178 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.613+0000 7f21552e9700 1 --2- 172.21.15.63:0/963082973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2150078ce0 0x7f2150113330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f214c00ba70 tx=0x7f214c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:05.178 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.613+0000 7f2145ffb700 1 -- 172.21.15.63:0/963082973 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f214c010960 con 0x7f2150078ce0 2023-12-07T16:15:05.178 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.613+0000 7f2145ffb700 1 -- 172.21.15.63:0/963082973 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f214c024430 con 0x7f2150078ce0 2023-12-07T16:15:05.178 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.613+0000 7f215754d700 1 -- 172.21.15.63:0/963082973 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2150113a70 con 0x7f2150078ce0 2023-12-07T16:15:05.178 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.613+0000 7f2145ffb700 1 -- 172.21.15.63:0/963082973 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f214c01a5f0 con 0x7f2150078ce0 2023-12-07T16:15:05.178 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.613+0000 7f215754d700 1 -- 172.21.15.63:0/963082973 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2150113e80 con 0x7f2150078ce0 2023-12-07T16:15:05.178 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.614+0000 7f2145ffb700 1 -- 172.21.15.63:0/963082973 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f214c01a860 con 0x7f2150078ce0 2023-12-07T16:15:05.178 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.614+0000 7f2145ffb700 1 --2- 172.21.15.63:0/963082973 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f213c036690 0x7f213c038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:05.178 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.614+0000 7f2145ffb700 1 -- 172.21.15.63:0/963082973 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f214c04a560 con 0x7f2150078ce0 2023-12-07T16:15:05.178 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.614+0000 7f215754d700 1 -- 172.21.15.63:0/963082973 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f215004bb80 con 0x7f2150078ce0 2023-12-07T16:15:05.178 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.614+0000 7f2154ae8700 1 --2- 172.21.15.63:0/963082973 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f213c036690 0x7f213c038b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:05.179 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.614+0000 7f2154ae8700 1 --2- 172.21.15.63:0/963082973 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f213c036690 0x7f213c038b40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2140009990 tx=0x7f2140006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:05.179 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.619+0000 7f2145ffb700 1 -- 172.21.15.63:0/963082973 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f214c0189a0 con 0x7f2150078ce0 2023-12-07T16:15:05.179 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.809+0000 7f215754d700 1 -- 172.21.15.63:0/963082973 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f215010cfd0 con 0x7f2150078ce0 2023-12-07T16:15:05.179 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.809+0000 7f2145ffb700 1 -- 172.21.15.63:0/963082973 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f214c018350 con 0x7f2150078ce0 2023-12-07T16:15:05.179 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.811+0000 7f215754d700 1 -- 172.21.15.63:0/963082973 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f213c036690 msgr2=0x7f213c038b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:05.179 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.811+0000 7f215754d700 1 --2- 172.21.15.63:0/963082973 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f213c036690 0x7f213c038b40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2140009990 tx=0x7f2140006e40 comp rx=0 tx=0).stop 2023-12-07T16:15:05.179 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.811+0000 7f215754d700 1 -- 172.21.15.63:0/963082973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2150078ce0 msgr2=0x7f2150113330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:05.179 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.811+0000 7f215754d700 1 --2- 172.21.15.63:0/963082973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2150078ce0 0x7f2150113330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f214c00ba70 tx=0x7f214c009250 comp rx=0 tx=0).stop 2023-12-07T16:15:05.179 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.811+0000 7f215754d700 1 -- 172.21.15.63:0/963082973 shutdown_connections 2023-12-07T16:15:05.179 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.811+0000 7f215754d700 1 --2- 172.21.15.63:0/963082973 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f213c036690 0x7f213c038b40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:05.179 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.811+0000 7f215754d700 1 --2- 172.21.15.63:0/963082973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2150078ce0 0x7f2150113330 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:05.179 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.811+0000 7f215754d700 1 -- 172.21.15.63:0/963082973 >> 172.21.15.63:0/963082973 conn(0x7f21500fda10 msgr2=0x7f21500ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:05.179 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.811+0000 7f215754d700 1 -- 172.21.15.63:0/963082973 shutdown_connections 2023-12-07T16:15:05.179 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:04.811+0000 7f215754d700 1 -- 172.21.15.63:0/963082973 wait complete. 2023-12-07T16:15:06.190 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:06 smithi063 ceph-mon[112095]: mgrmap e13: smithi063.yohyyx(active, since 6s) 2023-12-07T16:15:06.190 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:06 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/1618760223' entity='client.admin' 2023-12-07T16:15:06.260 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.590+0000 7fa5b07e5700 1 Processor -- start 2023-12-07T16:15:06.260 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.590+0000 7fa5b07e5700 1 -- start start 2023-12-07T16:15:06.260 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.590+0000 7fa5b07e5700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5a81011d0 0x7fa5a81015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:06.260 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.590+0000 7fa5b07e5700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a8101b20 con 0x7fa5a81011d0 2023-12-07T16:15:06.260 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.590+0000 7fa5ae581700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5a81011d0 0x7fa5a81015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:06.260 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.590+0000 7fa5ae581700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5a81011d0 0x7fa5a81015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47896/0 (socket says 172.21.15.63:47896) 2023-12-07T16:15:06.260 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.590+0000 7fa5ae581700 1 -- 172.21.15.63:0/1248119429 learned_addr learned my addr 172.21.15.63:0/1248119429 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:15:06.260 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.591+0000 7fa5ae581700 1 -- 172.21.15.63:0/1248119429 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a8101c60 con 0x7fa5a81011d0 2023-12-07T16:15:06.260 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.591+0000 7fa5ae581700 1 --2- 172.21.15.63:0/1248119429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5a81011d0 0x7fa5a81015e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40098e0 tx=0x7fa5a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eeec7a3212fc7bd server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:06.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.591+0000 7fa5ad57f700 1 -- 172.21.15.63:0/1248119429 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa5a400b860 con 0x7fa5a81011d0 2023-12-07T16:15:06.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.591+0000 7fa5ad57f700 1 -- 172.21.15.63:0/1248119429 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa5a400be70 con 0x7fa5a81011d0 2023-12-07T16:15:06.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.591+0000 7fa5ad57f700 1 -- 172.21.15.63:0/1248119429 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa5a4010380 con 0x7fa5a81011d0 2023-12-07T16:15:06.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.592+0000 7fa5b07e5700 1 -- 172.21.15.63:0/1248119429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5a81011d0 msgr2=0x7fa5a81015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:06.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.592+0000 7fa5b07e5700 1 --2- 172.21.15.63:0/1248119429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5a81011d0 0x7fa5a81015e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40098e0 tx=0x7fa5a4009250 comp rx=0 tx=0).stop 2023-12-07T16:15:06.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.592+0000 7fa5b07e5700 1 -- 172.21.15.63:0/1248119429 shutdown_connections 2023-12-07T16:15:06.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.592+0000 7fa5b07e5700 1 --2- 172.21.15.63:0/1248119429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5a81011d0 0x7fa5a81015e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:06.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.592+0000 7fa5b07e5700 1 -- 172.21.15.63:0/1248119429 >> 172.21.15.63:0/1248119429 conn(0x7fa5a80fc970 msgr2=0x7fa5a80fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:06.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.592+0000 7fa5b07e5700 1 -- 172.21.15.63:0/1248119429 shutdown_connections 2023-12-07T16:15:06.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.592+0000 7fa5b07e5700 1 -- 172.21.15.63:0/1248119429 wait complete. 2023-12-07T16:15:06.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.592+0000 7fa5b07e5700 1 Processor -- start 2023-12-07T16:15:06.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.593+0000 7fa5b07e5700 1 -- start start 2023-12-07T16:15:06.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.593+0000 7fa5b07e5700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5a81011d0 0x7fa5a8113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:06.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.593+0000 7fa5b07e5700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a8070f90 con 0x7fa5a81011d0 2023-12-07T16:15:06.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.593+0000 7fa5ae581700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5a81011d0 0x7fa5a8113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:06.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.593+0000 7fa5ae581700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5a81011d0 0x7fa5a8113eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47898/0 (socket says 172.21.15.63:47898) 2023-12-07T16:15:06.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.593+0000 7fa5ae581700 1 -- 172.21.15.63:0/1618760223 learned_addr learned my addr 172.21.15.63:0/1618760223 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:15:06.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.593+0000 7fa5ae581700 1 -- 172.21.15.63:0/1618760223 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a40094f0 con 0x7fa5a81011d0 2023-12-07T16:15:06.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.593+0000 7fa5ae581700 1 --2- 172.21.15.63:0/1618760223 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5a81011d0 0x7fa5a8113eb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa5a400c010 tx=0x7fa5a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:06.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.593+0000 7fa59effd700 1 -- 172.21.15.63:0/1618760223 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa5a4010960 con 0x7fa5a81011d0 2023-12-07T16:15:06.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.593+0000 7fa59effd700 1 -- 172.21.15.63:0/1618760223 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa5a401a430 con 0x7fa5a81011d0 2023-12-07T16:15:06.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.593+0000 7fa5b07e5700 1 -- 172.21.15.63:0/1618760223 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a8071190 con 0x7fa5a81011d0 2023-12-07T16:15:06.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.594+0000 7fa59effd700 1 -- 172.21.15.63:0/1618760223 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa5a4019580 con 0x7fa5a81011d0 2023-12-07T16:15:06.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.594+0000 7fa5b07e5700 1 -- 172.21.15.63:0/1618760223 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a81145b0 con 0x7fa5a81011d0 2023-12-07T16:15:06.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.594+0000 7fa59effd700 1 -- 172.21.15.63:0/1618760223 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fa5a4010ac0 con 0x7fa5a81011d0 2023-12-07T16:15:06.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.594+0000 7fa5b07e5700 1 -- 172.21.15.63:0/1618760223 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a810a090 con 0x7fa5a81011d0 2023-12-07T16:15:06.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.595+0000 7fa59effd700 1 --2- 172.21.15.63:0/1618760223 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7fa5940366e0 0x7fa594038b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:06.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.595+0000 7fa59effd700 1 -- 172.21.15.63:0/1618760223 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa5a404a6b0 con 0x7fa5a81011d0 2023-12-07T16:15:06.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.595+0000 7fa5add80700 1 --2- 172.21.15.63:0/1618760223 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7fa5940366e0 0x7fa594038b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:06.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.595+0000 7fa5add80700 1 --2- 172.21.15.63:0/1618760223 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7fa5940366e0 0x7fa594038b90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa598009990 tx=0x7fa598006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:06.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.599+0000 7fa59effd700 1 -- 172.21.15.63:0/1618760223 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa5a40222f0 con 0x7fa5a81011d0 2023-12-07T16:15:06.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.897+0000 7fa5b07e5700 1 -- 172.21.15.63:0/1618760223 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fa5a804bb80 con 0x7fa5a81011d0 2023-12-07T16:15:06.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.899+0000 7fa59effd700 1 -- 172.21.15.63:0/1618760223 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7fa5a40222f0 con 0x7fa5a81011d0 2023-12-07T16:15:06.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.901+0000 7fa5b07e5700 1 -- 172.21.15.63:0/1618760223 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7fa5940366e0 msgr2=0x7fa594038b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:06.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.901+0000 7fa5b07e5700 1 --2- 172.21.15.63:0/1618760223 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7fa5940366e0 0x7fa594038b90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa598009990 tx=0x7fa598006e40 comp rx=0 tx=0).stop 2023-12-07T16:15:06.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.901+0000 7fa5b07e5700 1 -- 172.21.15.63:0/1618760223 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5a81011d0 msgr2=0x7fa5a8113eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:06.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.901+0000 7fa5b07e5700 1 --2- 172.21.15.63:0/1618760223 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5a81011d0 0x7fa5a8113eb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa5a400c010 tx=0x7fa5a4009250 comp rx=0 tx=0).stop 2023-12-07T16:15:06.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.901+0000 7fa5b07e5700 1 -- 172.21.15.63:0/1618760223 shutdown_connections 2023-12-07T16:15:06.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.901+0000 7fa5b07e5700 1 --2- 172.21.15.63:0/1618760223 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7fa5940366e0 0x7fa594038b90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:06.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.901+0000 7fa5b07e5700 1 --2- 172.21.15.63:0/1618760223 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5a81011d0 0x7fa5a8113eb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:06.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.901+0000 7fa5b07e5700 1 -- 172.21.15.63:0/1618760223 >> 172.21.15.63:0/1618760223 conn(0x7fa5a80fc970 msgr2=0x7fa5a80fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:06.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.902+0000 7fa5b07e5700 1 -- 172.21.15.63:0/1618760223 shutdown_connections 2023-12-07T16:15:06.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2023-12-07T16:15:05.902+0000 7fa5b07e5700 1 -- 172.21.15.63:0/1618760223 wait complete. 2023-12-07T16:15:06.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-12-07T16:15:06.264 INFO:teuthology.orchestra.run.smithi063.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-12-07T16:15:06.264 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:15:06.264 INFO:teuthology.orchestra.run.smithi063.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 8c493298-951b-11ee-95a2-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-12-07T16:15:06.264 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:15:06.264 INFO:teuthology.orchestra.run.smithi063.stdout:Or, if you are only running a single cluster on this host: 2023-12-07T16:15:06.264 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:15:06.264 INFO:teuthology.orchestra.run.smithi063.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-12-07T16:15:06.264 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:15:06.264 INFO:teuthology.orchestra.run.smithi063.stdout:Please consider enabling telemetry to help improve Ceph: 2023-12-07T16:15:06.264 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:15:06.265 INFO:teuthology.orchestra.run.smithi063.stdout: ceph telemetry on 2023-12-07T16:15:06.265 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:15:06.265 INFO:teuthology.orchestra.run.smithi063.stdout:For more information see: 2023-12-07T16:15:06.265 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:15:06.265 INFO:teuthology.orchestra.run.smithi063.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2023-12-07T16:15:06.265 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:15:06.265 INFO:teuthology.orchestra.run.smithi063.stdout:Bootstrap complete. 2023-12-07T16:15:06.291 INFO:tasks.cephadm:Fetching config... 2023-12-07T16:15:06.291 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-07T16:15:06.291 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-12-07T16:15:06.350 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-12-07T16:15:06.350 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-07T16:15:06.350 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-12-07T16:15:06.409 INFO:tasks.cephadm:Fetching mon keyring... 2023-12-07T16:15:06.409 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-07T16:15:06.409 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/keyring of=/dev/stdout 2023-12-07T16:15:06.480 INFO:tasks.cephadm:Fetching pub ssh key... 2023-12-07T16:15:06.480 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-07T16:15:06.480 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-12-07T16:15:06.539 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-12-07T16:15:06.539 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrOapwP2GGGnp5m5aLe5ahbVKlxAN9Jg2A1LRQ44Q2itIrlffHP9iN3q/E8c1ADP3B1n1VGvGEs/t3kcjxsNBBmg3MQyjECoIdlOmy9ITtvZZGSb/mIyjIjMEFYkp7NgBV9VsUPeSaCsrw+E16C56mcItfKLXCaOyMkVGnCDgCmou0InBsFdq5yDD9SSm504z62af2Djpf7+BM60upvrV8S9SpKjzqFC5UJXF99+08QpXVG3Fo3YbuAEVNbVhc9CfpVas4/qFLND4FN4303WZXIK8QIok742iJct/30+j1Q/81DLkhrDZf+BUiHmGsLRtFjphngQlkTGFGmsV3VtkmwfuuvCSWGtMZl+6HSG9Vh6aV5tWHjY1UDi7AJV80CObG/UV900/thIDqFAXkPAWfH/bsy3xHkdeGmLyPmDbahvbOt4bJ4u/oWSOysWmpDKos5BDg2y+HKb+0SO/xofh5bY2lQCAxtlFNb3BmGPu43IvQ/RzN0CgL4P2DDEpnv10= ceph-8c493298-951b-11ee-95a2-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-07T16:15:06.619 INFO:teuthology.orchestra.run.smithi063.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrOapwP2GGGnp5m5aLe5ahbVKlxAN9Jg2A1LRQ44Q2itIrlffHP9iN3q/E8c1ADP3B1n1VGvGEs/t3kcjxsNBBmg3MQyjECoIdlOmy9ITtvZZGSb/mIyjIjMEFYkp7NgBV9VsUPeSaCsrw+E16C56mcItfKLXCaOyMkVGnCDgCmou0InBsFdq5yDD9SSm504z62af2Djpf7+BM60upvrV8S9SpKjzqFC5UJXF99+08QpXVG3Fo3YbuAEVNbVhc9CfpVas4/qFLND4FN4303WZXIK8QIok742iJct/30+j1Q/81DLkhrDZf+BUiHmGsLRtFjphngQlkTGFGmsV3VtkmwfuuvCSWGtMZl+6HSG9Vh6aV5tWHjY1UDi7AJV80CObG/UV900/thIDqFAXkPAWfH/bsy3xHkdeGmLyPmDbahvbOt4bJ4u/oWSOysWmpDKos5BDg2y+HKb+0SO/xofh5bY2lQCAxtlFNb3BmGPu43IvQ/RzN0CgL4P2DDEpnv10= ceph-8c493298-951b-11ee-95a2-87774f69a715 2023-12-07T16:15:06.630 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrOapwP2GGGnp5m5aLe5ahbVKlxAN9Jg2A1LRQ44Q2itIrlffHP9iN3q/E8c1ADP3B1n1VGvGEs/t3kcjxsNBBmg3MQyjECoIdlOmy9ITtvZZGSb/mIyjIjMEFYkp7NgBV9VsUPeSaCsrw+E16C56mcItfKLXCaOyMkVGnCDgCmou0InBsFdq5yDD9SSm504z62af2Djpf7+BM60upvrV8S9SpKjzqFC5UJXF99+08QpXVG3Fo3YbuAEVNbVhc9CfpVas4/qFLND4FN4303WZXIK8QIok742iJct/30+j1Q/81DLkhrDZf+BUiHmGsLRtFjphngQlkTGFGmsV3VtkmwfuuvCSWGtMZl+6HSG9Vh6aV5tWHjY1UDi7AJV80CObG/UV900/thIDqFAXkPAWfH/bsy3xHkdeGmLyPmDbahvbOt4bJ4u/oWSOysWmpDKos5BDg2y+HKb+0SO/xofh5bY2lQCAxtlFNb3BmGPu43IvQ/RzN0CgL4P2DDEpnv10= ceph-8c493298-951b-11ee-95a2-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-07T16:15:06.675 INFO:teuthology.orchestra.run.smithi152.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrOapwP2GGGnp5m5aLe5ahbVKlxAN9Jg2A1LRQ44Q2itIrlffHP9iN3q/E8c1ADP3B1n1VGvGEs/t3kcjxsNBBmg3MQyjECoIdlOmy9ITtvZZGSb/mIyjIjMEFYkp7NgBV9VsUPeSaCsrw+E16C56mcItfKLXCaOyMkVGnCDgCmou0InBsFdq5yDD9SSm504z62af2Djpf7+BM60upvrV8S9SpKjzqFC5UJXF99+08QpXVG3Fo3YbuAEVNbVhc9CfpVas4/qFLND4FN4303WZXIK8QIok742iJct/30+j1Q/81DLkhrDZf+BUiHmGsLRtFjphngQlkTGFGmsV3VtkmwfuuvCSWGtMZl+6HSG9Vh6aV5tWHjY1UDi7AJV80CObG/UV900/thIDqFAXkPAWfH/bsy3xHkdeGmLyPmDbahvbOt4bJ4u/oWSOysWmpDKos5BDg2y+HKb+0SO/xofh5bY2lQCAxtlFNb3BmGPu43IvQ/RzN0CgL4P2DDEpnv10= ceph-8c493298-951b-11ee-95a2-87774f69a715 2023-12-07T16:15:06.687 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-12-07T16:15:06.966 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:15:08.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.313+0000 7f112d33d700 1 -- 172.21.15.63:0/2595554339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11280fea80 msgr2=0x7f11280fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:08.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.313+0000 7f112d33d700 1 --2- 172.21.15.63:0/2595554339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11280fea80 0x7f11280fee90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f11180048c0 tx=0x7f1118009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:08.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.313+0000 7f112d33d700 1 -- 172.21.15.63:0/2595554339 shutdown_connections 2023-12-07T16:15:08.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.313+0000 7f112d33d700 1 --2- 172.21.15.63:0/2595554339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11280fea80 0x7f11280fee90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:08.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.313+0000 7f112d33d700 1 -- 172.21.15.63:0/2595554339 >> 172.21.15.63:0/2595554339 conn(0x7f11280fa250 msgr2=0x7f11280fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:08.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.313+0000 7f112d33d700 1 -- 172.21.15.63:0/2595554339 shutdown_connections 2023-12-07T16:15:08.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.313+0000 7f112d33d700 1 -- 172.21.15.63:0/2595554339 wait complete. 2023-12-07T16:15:08.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.313+0000 7f112d33d700 1 Processor -- start 2023-12-07T16:15:08.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.313+0000 7f112d33d700 1 -- start start 2023-12-07T16:15:08.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.314+0000 7f112d33d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11280fea80 0x7f112810ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:08.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.314+0000 7f112d33d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112810f280 con 0x7f11280fea80 2023-12-07T16:15:08.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.314+0000 7f1126ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11280fea80 0x7f112810ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:08.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.314+0000 7f1126ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11280fea80 0x7f112810ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47918/0 (socket says 172.21.15.63:47918) 2023-12-07T16:15:08.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.314+0000 7f1126ffd700 1 -- 172.21.15.63:0/2327015118 learned_addr learned my addr 172.21.15.63:0/2327015118 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:15:08.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.314+0000 7f1126ffd700 1 -- 172.21.15.63:0/2327015118 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1118005040 con 0x7f11280fea80 2023-12-07T16:15:08.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.314+0000 7f1126ffd700 1 --2- 172.21.15.63:0/2327015118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11280fea80 0x7f112810ed40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1118009330 tx=0x7f1118009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:08.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.314+0000 7f110f7fe700 1 -- 172.21.15.63:0/2327015118 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11180096b0 con 0x7f11280fea80 2023-12-07T16:15:08.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.314+0000 7f112d33d700 1 -- 172.21.15.63:0/2327015118 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f112810f480 con 0x7f11280fea80 2023-12-07T16:15:08.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.314+0000 7f110f7fe700 1 -- 172.21.15.63:0/2327015118 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1118009810 con 0x7f11280fea80 2023-12-07T16:15:08.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.314+0000 7f112d33d700 1 -- 172.21.15.63:0/2327015118 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f112810ffe0 con 0x7f11280fea80 2023-12-07T16:15:08.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.314+0000 7f110f7fe700 1 -- 172.21.15.63:0/2327015118 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f111801c5b0 con 0x7f11280fea80 2023-12-07T16:15:08.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.315+0000 7f110f7fe700 1 -- 172.21.15.63:0/2327015118 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f111801c870 con 0x7f11280fea80 2023-12-07T16:15:08.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.315+0000 7f110f7fe700 1 --2- 172.21.15.63:0/2327015118 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f11100366d0 0x7f1110038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:08.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.315+0000 7f110f7fe700 1 -- 172.21.15.63:0/2327015118 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f111804a8b0 con 0x7f11280fea80 2023-12-07T16:15:08.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.316+0000 7f112d33d700 1 -- 172.21.15.63:0/2327015118 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11140052e0 con 0x7f11280fea80 2023-12-07T16:15:08.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.316+0000 7f11267fc700 1 --2- 172.21.15.63:0/2327015118 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f11100366d0 0x7f1110038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:08.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.316+0000 7f11267fc700 1 --2- 172.21.15.63:0/2327015118 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f11100366d0 0x7f1110038b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f111c009990 tx=0x7f111c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:08.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.324+0000 7f110f7fe700 1 -- 172.21.15.63:0/2327015118 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1118011dd0 con 0x7f11280fea80 2023-12-07T16:15:08.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.521+0000 7f112d33d700 1 -- 172.21.15.63:0/2327015118 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f1114005b10 con 0x7f11280fea80 2023-12-07T16:15:08.522 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.524+0000 7f110f7fe700 1 -- 172.21.15.63:0/2327015118 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f11180340c0 con 0x7f11280fea80 2023-12-07T16:15:08.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.527+0000 7f112d33d700 1 -- 172.21.15.63:0/2327015118 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f11100366d0 msgr2=0x7f1110038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:08.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.527+0000 7f112d33d700 1 --2- 172.21.15.63:0/2327015118 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f11100366d0 0x7f1110038b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f111c009990 tx=0x7f111c006e40 comp rx=0 tx=0).stop 2023-12-07T16:15:08.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.527+0000 7f112d33d700 1 -- 172.21.15.63:0/2327015118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11280fea80 msgr2=0x7f112810ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:08.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.527+0000 7f112d33d700 1 --2- 172.21.15.63:0/2327015118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11280fea80 0x7f112810ed40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1118009330 tx=0x7f1118009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:08.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.528+0000 7f112d33d700 1 -- 172.21.15.63:0/2327015118 shutdown_connections 2023-12-07T16:15:08.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.528+0000 7f112d33d700 1 --2- 172.21.15.63:0/2327015118 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f11100366d0 0x7f1110038b80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:08.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.528+0000 7f112d33d700 1 --2- 172.21.15.63:0/2327015118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11280fea80 0x7f112810ed40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:08.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.528+0000 7f112d33d700 1 -- 172.21.15.63:0/2327015118 >> 172.21.15.63:0/2327015118 conn(0x7f11280fa250 msgr2=0x7f11280fc050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:08.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.528+0000 7f112d33d700 1 -- 172.21.15.63:0/2327015118 shutdown_connections 2023-12-07T16:15:08.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:08.528+0000 7f112d33d700 1 -- 172.21.15.63:0/2327015118 wait complete. 2023-12-07T16:15:08.919 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-12-07T16:15:08.919 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-12-07T16:15:09.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:08 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:09.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:08 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:09.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:08 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd/host:smithi063", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:15:09.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:08 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:09.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:08 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi063", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-07T16:15:09.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:08 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi063", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-07T16:15:09.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:08 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:15:09.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:08 smithi063 ceph-mon[112095]: Deploying daemon crash.smithi063 on smithi063 2023-12-07T16:15:09.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:08 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2327015118' entity='client.admin' 2023-12-07T16:15:09.263 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:15:11.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.389+0000 7f35eea54700 1 -- 172.21.15.63:0/510138192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f35e8071b60 msgr2=0x7f35e806ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:11.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.389+0000 7f35eea54700 1 --2- 172.21.15.63:0/510138192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f35e8071b60 0x7f35e806ffd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f35d80048c0 tx=0x7f35d8009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:11.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.389+0000 7f35eea54700 1 -- 172.21.15.63:0/510138192 shutdown_connections 2023-12-07T16:15:11.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.389+0000 7f35eea54700 1 --2- 172.21.15.63:0/510138192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f35e8071b60 0x7f35e806ffd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:11.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.389+0000 7f35eea54700 1 -- 172.21.15.63:0/510138192 >> 172.21.15.63:0/510138192 conn(0x7f35e80f7f50 msgr2=0x7f35e80fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:11.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.389+0000 7f35eea54700 1 -- 172.21.15.63:0/510138192 shutdown_connections 2023-12-07T16:15:11.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.389+0000 7f35eea54700 1 -- 172.21.15.63:0/510138192 wait complete. 2023-12-07T16:15:11.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.389+0000 7f35eea54700 1 Processor -- start 2023-12-07T16:15:11.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.390+0000 7f35eea54700 1 -- start start 2023-12-07T16:15:11.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.390+0000 7f35eea54700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f35e8071b60 0x7f35e810ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:11.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.390+0000 7f35eea54700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e810f250 con 0x7f35e8071b60 2023-12-07T16:15:11.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.390+0000 7f35e7fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f35e8071b60 0x7f35e810ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:11.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.390+0000 7f35e7fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f35e8071b60 0x7f35e810ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35314/0 (socket says 172.21.15.63:35314) 2023-12-07T16:15:11.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.390+0000 7f35e7fff700 1 -- 172.21.15.63:0/2950854060 learned_addr learned my addr 172.21.15.63:0/2950854060 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:15:11.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.390+0000 7f35e7fff700 1 -- 172.21.15.63:0/2950854060 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d8005040 con 0x7f35e8071b60 2023-12-07T16:15:11.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.390+0000 7f35e7fff700 1 --2- 172.21.15.63:0/2950854060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f35e8071b60 0x7f35e810ed10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f35d800b690 tx=0x7f35d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:11.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.391+0000 7f35e4ff9700 1 -- 172.21.15.63:0/2950854060 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35d8009650 con 0x7f35e8071b60 2023-12-07T16:15:11.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.391+0000 7f35eea54700 1 -- 172.21.15.63:0/2950854060 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e810f450 con 0x7f35e8071b60 2023-12-07T16:15:11.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.391+0000 7f35e4ff9700 1 -- 172.21.15.63:0/2950854060 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f35d80097b0 con 0x7f35e8071b60 2023-12-07T16:15:11.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.391+0000 7f35e4ff9700 1 -- 172.21.15.63:0/2950854060 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35d801c5b0 con 0x7f35e8071b60 2023-12-07T16:15:11.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.391+0000 7f35eea54700 1 -- 172.21.15.63:0/2950854060 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e810ffb0 con 0x7f35e8071b60 2023-12-07T16:15:11.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.392+0000 7f35e4ff9700 1 -- 172.21.15.63:0/2950854060 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f35d801c870 con 0x7f35e8071b60 2023-12-07T16:15:11.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.392+0000 7f35eea54700 1 -- 172.21.15.63:0/2950854060 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e804bb80 con 0x7f35e8071b60 2023-12-07T16:15:11.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.392+0000 7f35e4ff9700 1 --2- 172.21.15.63:0/2950854060 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f35d00366d0 0x7f35d0038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:11.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.392+0000 7f35e4ff9700 1 -- 172.21.15.63:0/2950854060 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f35d8049aa0 con 0x7f35e8071b60 2023-12-07T16:15:11.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.392+0000 7f35e77fe700 1 --2- 172.21.15.63:0/2950854060 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f35d00366d0 0x7f35d0038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:11.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.392+0000 7f35e77fe700 1 --2- 172.21.15.63:0/2950854060 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f35d00366d0 0x7f35d0038b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009990 tx=0x7f35dc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:11.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.396+0000 7f35e4ff9700 1 -- 172.21.15.63:0/2950854060 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f35d8025400 con 0x7f35e8071b60 2023-12-07T16:15:11.596 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.598+0000 7f35eea54700 1 -- 172.21.15.63:0/2950854060 --> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f35e8110140 con 0x7f35d00366d0 2023-12-07T16:15:11.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.601+0000 7f35e4ff9700 1 -- 172.21.15.63:0/2950854060 <== mgr.14162 v2:172.21.15.63:6800/4069965417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f35e8110140 con 0x7f35d00366d0 2023-12-07T16:15:11.601 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.603+0000 7f35eea54700 1 -- 172.21.15.63:0/2950854060 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f35d00366d0 msgr2=0x7f35d0038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:11.601 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.603+0000 7f35eea54700 1 --2- 172.21.15.63:0/2950854060 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f35d00366d0 0x7f35d0038b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009990 tx=0x7f35dc006e40 comp rx=0 tx=0).stop 2023-12-07T16:15:11.601 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.603+0000 7f35eea54700 1 -- 172.21.15.63:0/2950854060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f35e8071b60 msgr2=0x7f35e810ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:11.601 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.603+0000 7f35eea54700 1 --2- 172.21.15.63:0/2950854060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f35e8071b60 0x7f35e810ed10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f35d800b690 tx=0x7f35d8009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:11.601 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.603+0000 7f35eea54700 1 -- 172.21.15.63:0/2950854060 shutdown_connections 2023-12-07T16:15:11.601 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.603+0000 7f35eea54700 1 --2- 172.21.15.63:0/2950854060 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f35d00366d0 0x7f35d0038b80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:11.601 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.603+0000 7f35eea54700 1 --2- 172.21.15.63:0/2950854060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f35e8071b60 0x7f35e810ed10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:11.601 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.603+0000 7f35eea54700 1 -- 172.21.15.63:0/2950854060 >> 172.21.15.63:0/2950854060 conn(0x7f35e80f7f50 msgr2=0x7f35e80f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:11.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.603+0000 7f35eea54700 1 -- 172.21.15.63:0/2950854060 shutdown_connections 2023-12-07T16:15:11.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:11.603+0000 7f35eea54700 1 -- 172.21.15.63:0/2950854060 wait complete. 2023-12-07T16:15:12.077 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi152 2023-12-07T16:15:12.077 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-07T16:15:12.077 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/etc/ceph/ceph.conf 2023-12-07T16:15:12.099 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-07T16:15:12.099 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-07T16:15:12.160 INFO:tasks.cephadm:Adding host smithi152 to orchestrator... 2023-12-07T16:15:12.160 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph orch host add smithi152 2023-12-07T16:15:12.503 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:15:12.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:12 smithi063 ceph-mon[112095]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:15:12.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:12 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:12.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:12 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:12.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:12 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:12.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:12 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:12.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:12 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:12.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:12 smithi063 ceph-mon[112095]: Deploying daemon node-exporter.smithi063 on smithi063 2023-12-07T16:15:13.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.721+0000 7f4faf0f4700 1 -- 172.21.15.63:0/253411061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fa80fcd70 msgr2=0x7f4fa80fd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:13.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.721+0000 7f4faf0f4700 1 --2- 172.21.15.63:0/253411061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fa80fcd70 0x7f4fa80fd180 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4f980048c0 tx=0x7f4f98009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:13.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.723+0000 7f4faf0f4700 1 -- 172.21.15.63:0/253411061 shutdown_connections 2023-12-07T16:15:13.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.723+0000 7f4faf0f4700 1 --2- 172.21.15.63:0/253411061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fa80fcd70 0x7f4fa80fd180 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:13.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.723+0000 7f4faf0f4700 1 -- 172.21.15.63:0/253411061 >> 172.21.15.63:0/253411061 conn(0x7f4fa80f65d0 msgr2=0x7f4fa80f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:13.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.723+0000 7f4faf0f4700 1 -- 172.21.15.63:0/253411061 shutdown_connections 2023-12-07T16:15:13.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.723+0000 7f4faf0f4700 1 -- 172.21.15.63:0/253411061 wait complete. 2023-12-07T16:15:13.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.724+0000 7f4faf0f4700 1 Processor -- start 2023-12-07T16:15:13.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.724+0000 7f4faf0f4700 1 -- start start 2023-12-07T16:15:13.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.724+0000 7f4faf0f4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fa80fcd70 0x7f4fa810f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:13.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.724+0000 7f4faf0f4700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa80fb5b0 con 0x7f4fa80fcd70 2023-12-07T16:15:13.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.724+0000 7f4face90700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fa80fcd70 0x7f4fa810f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:13.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.724+0000 7f4face90700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fa80fcd70 0x7f4fa810f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35346/0 (socket says 172.21.15.63:35346) 2023-12-07T16:15:13.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.724+0000 7f4face90700 1 -- 172.21.15.63:0/3471758676 learned_addr learned my addr 172.21.15.63:0/3471758676 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:15:13.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.725+0000 7f4face90700 1 -- 172.21.15.63:0/3471758676 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f98005040 con 0x7f4fa80fcd70 2023-12-07T16:15:13.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.725+0000 7f4face90700 1 --2- 172.21.15.63:0/3471758676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fa80fcd70 0x7f4fa810f7e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009330 tx=0x7f4f98009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:13.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.725+0000 7f4fa57fa700 1 -- 172.21.15.63:0/3471758676 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f980096b0 con 0x7f4fa80fcd70 2023-12-07T16:15:13.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.725+0000 7f4fa57fa700 1 -- 172.21.15.63:0/3471758676 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4f98009810 con 0x7f4fa80fcd70 2023-12-07T16:15:13.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.725+0000 7f4faf0f4700 1 -- 172.21.15.63:0/3471758676 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa80fb7b0 con 0x7f4fa80fcd70 2023-12-07T16:15:13.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.725+0000 7f4fa57fa700 1 -- 172.21.15.63:0/3471758676 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f9801c5b0 con 0x7f4fa80fcd70 2023-12-07T16:15:13.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.725+0000 7f4faf0f4700 1 -- 172.21.15.63:0/3471758676 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa810ff60 con 0x7f4fa80fcd70 2023-12-07T16:15:13.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.726+0000 7f4faf0f4700 1 -- 172.21.15.63:0/3471758676 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa8105400 con 0x7f4fa80fcd70 2023-12-07T16:15:13.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.727+0000 7f4fa57fa700 1 -- 172.21.15.63:0/3471758676 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f4f98013420 con 0x7f4fa80fcd70 2023-12-07T16:15:13.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.727+0000 7f4fa57fa700 1 --2- 172.21.15.63:0/3471758676 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f4f90036720 0x7f4f90038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:13.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.727+0000 7f4fa57fa700 1 -- 172.21.15.63:0/3471758676 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4f9804a4c0 con 0x7f4fa80fcd70 2023-12-07T16:15:13.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.727+0000 7f4fa7fff700 1 --2- 172.21.15.63:0/3471758676 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f4f90036720 0x7f4f90038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:13.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.728+0000 7f4fa7fff700 1 --2- 172.21.15.63:0/3471758676 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f4f90036720 0x7f4f90038bd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c009990 tx=0x7f4f9c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:13.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.733+0000 7f4fa57fa700 1 -- 172.21.15.63:0/3471758676 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4f9801b7a0 con 0x7f4fa80fcd70 2023-12-07T16:15:13.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:13.946+0000 7f4faf0f4700 1 -- 172.21.15.63:0/3471758676 --> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi152", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fa802b260 con 0x7f4f90036720 2023-12-07T16:15:15.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:15 smithi063 ceph-mon[112095]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi152", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:15:15.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:15 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:15.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:15 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:15.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:15 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:15.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:15 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:15.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:15 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:15.778 INFO:teuthology.orchestra.run.smithi063.stdout:Added host 'smithi152' with addr '172.21.15.152' 2023-12-07T16:15:15.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:15.780+0000 7f4fa57fa700 1 -- 172.21.15.63:0/3471758676 <== mgr.14162 v2:172.21.15.63:6800/4069965417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f4fa802b260 con 0x7f4f90036720 2023-12-07T16:15:15.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:15.782+0000 7f4faf0f4700 1 -- 172.21.15.63:0/3471758676 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f4f90036720 msgr2=0x7f4f90038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:15.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:15.782+0000 7f4faf0f4700 1 --2- 172.21.15.63:0/3471758676 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f4f90036720 0x7f4f90038bd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c009990 tx=0x7f4f9c006e40 comp rx=0 tx=0).stop 2023-12-07T16:15:15.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:15.783+0000 7f4faf0f4700 1 -- 172.21.15.63:0/3471758676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fa80fcd70 msgr2=0x7f4fa810f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:15.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:15.783+0000 7f4faf0f4700 1 --2- 172.21.15.63:0/3471758676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fa80fcd70 0x7f4fa810f7e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009330 tx=0x7f4f98009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:15.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:15.783+0000 7f4faf0f4700 1 -- 172.21.15.63:0/3471758676 shutdown_connections 2023-12-07T16:15:15.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:15.783+0000 7f4faf0f4700 1 --2- 172.21.15.63:0/3471758676 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f4f90036720 0x7f4f90038bd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:15.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:15.783+0000 7f4faf0f4700 1 --2- 172.21.15.63:0/3471758676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fa80fcd70 0x7f4fa810f7e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:15.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:15.783+0000 7f4faf0f4700 1 -- 172.21.15.63:0/3471758676 >> 172.21.15.63:0/3471758676 conn(0x7f4fa80f65d0 msgr2=0x7f4fa80f7430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:15.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:15.783+0000 7f4faf0f4700 1 -- 172.21.15.63:0/3471758676 shutdown_connections 2023-12-07T16:15:15.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:15.783+0000 7f4faf0f4700 1 -- 172.21.15.63:0/3471758676 wait complete. 2023-12-07T16:15:16.251 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph orch host ls --format=json 2023-12-07T16:15:16.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:16 smithi063 ceph-mon[112095]: Deploying cephadm binary to smithi152 2023-12-07T16:15:16.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:16 smithi063 ceph-mon[112095]: Deploying daemon alertmanager.smithi063 on smithi063 2023-12-07T16:15:16.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:16 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:17.026 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:15:17.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:17 smithi063 ceph-mon[112095]: Added host smithi152 2023-12-07T16:15:19.582 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.583+0000 7f866dbe4700 1 -- 172.21.15.63:0/384422720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86680fb780 msgr2=0x7f86680fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:19.583 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.583+0000 7f866dbe4700 1 --2- 172.21.15.63:0/384422720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86680fb780 0x7f86680fbb90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f86580048c0 tx=0x7f8658009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:19.583 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.583+0000 7f866dbe4700 1 -- 172.21.15.63:0/384422720 shutdown_connections 2023-12-07T16:15:19.583 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.583+0000 7f866dbe4700 1 --2- 172.21.15.63:0/384422720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86680fb780 0x7f86680fbb90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:19.583 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.583+0000 7f866dbe4700 1 -- 172.21.15.63:0/384422720 >> 172.21.15.63:0/384422720 conn(0x7f86680f6e40 msgr2=0x7f86680f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:19.583 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.584+0000 7f866dbe4700 1 -- 172.21.15.63:0/384422720 shutdown_connections 2023-12-07T16:15:19.583 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.584+0000 7f866dbe4700 1 -- 172.21.15.63:0/384422720 wait complete. 2023-12-07T16:15:19.585 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.584+0000 7f866dbe4700 1 Processor -- start 2023-12-07T16:15:19.585 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.584+0000 7f866dbe4700 1 -- start start 2023-12-07T16:15:19.585 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.584+0000 7f866dbe4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86680fb780 0x7f866810f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:19.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.584+0000 7f866dbe4700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8668065a10 con 0x7f86680fb780 2023-12-07T16:15:19.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.584+0000 7f86677fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86680fb780 0x7f866810f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:19.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.584+0000 7f86677fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86680fb780 0x7f866810f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49120/0 (socket says 172.21.15.63:49120) 2023-12-07T16:15:19.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.584+0000 7f86677fe700 1 -- 172.21.15.63:0/3540422772 learned_addr learned my addr 172.21.15.63:0/3540422772 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:15:19.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.585+0000 7f86677fe700 1 -- 172.21.15.63:0/3540422772 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8658005040 con 0x7f86680fb780 2023-12-07T16:15:19.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.585+0000 7f86677fe700 1 --2- 172.21.15.63:0/3540422772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86680fb780 0x7f866810f7c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f865800b690 tx=0x7f8658009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:19.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.585+0000 7f864ffff700 1 -- 172.21.15.63:0/3540422772 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8658009650 con 0x7f86680fb780 2023-12-07T16:15:19.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.585+0000 7f864ffff700 1 -- 172.21.15.63:0/3540422772 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f86580097b0 con 0x7f86680fb780 2023-12-07T16:15:19.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.585+0000 7f866dbe4700 1 -- 172.21.15.63:0/3540422772 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8668065c10 con 0x7f86680fb780 2023-12-07T16:15:19.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.585+0000 7f864ffff700 1 -- 172.21.15.63:0/3540422772 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f865801c5d0 con 0x7f86680fb780 2023-12-07T16:15:19.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.585+0000 7f866dbe4700 1 -- 172.21.15.63:0/3540422772 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866810ff40 con 0x7f86680fb780 2023-12-07T16:15:19.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.586+0000 7f864ffff700 1 -- 172.21.15.63:0/3540422772 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f865801c840 con 0x7f86680fb780 2023-12-07T16:15:19.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.586+0000 7f864ffff700 1 --2- 172.21.15.63:0/3540422772 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f86500366d0 0x7f8650038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:19.587 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.586+0000 7f864ffff700 1 -- 172.21.15.63:0/3540422772 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f86580499d0 con 0x7f86680fb780 2023-12-07T16:15:19.587 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.586+0000 7f8666ffd700 1 --2- 172.21.15.63:0/3540422772 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f86500366d0 0x7f8650038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:19.587 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.586+0000 7f866dbe4700 1 -- 172.21.15.63:0/3540422772 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8668105410 con 0x7f86680fb780 2023-12-07T16:15:19.587 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.587+0000 7f8666ffd700 1 --2- 172.21.15.63:0/3540422772 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f86500366d0 0x7f8650038b80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f865c009990 tx=0x7f865c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:19.590 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.591+0000 7f864ffff700 1 -- 172.21.15.63:0/3540422772 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8658023950 con 0x7f86680fb780 2023-12-07T16:15:19.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.797+0000 7f866dbe4700 1 -- 172.21.15.63:0/3540422772 --> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f866802b150 con 0x7f86500366d0 2023-12-07T16:15:19.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.798+0000 7f864ffff700 1 -- 172.21.15.63:0/3540422772 <== mgr.14162 v2:172.21.15.63:6800/4069965417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f866802b150 con 0x7f86500366d0 2023-12-07T16:15:19.797 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:15:19.797 INFO:teuthology.orchestra.run.smithi063.stdout:[{"addr": "172.21.15.63", "hostname": "smithi063", "labels": [], "status": ""}, {"addr": "172.21.15.152", "hostname": "smithi152", "labels": [], "status": ""}] 2023-12-07T16:15:19.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.800+0000 7f866dbe4700 1 -- 172.21.15.63:0/3540422772 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f86500366d0 msgr2=0x7f8650038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:19.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.800+0000 7f866dbe4700 1 --2- 172.21.15.63:0/3540422772 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f86500366d0 0x7f8650038b80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f865c009990 tx=0x7f865c006e40 comp rx=0 tx=0).stop 2023-12-07T16:15:19.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.800+0000 7f866dbe4700 1 -- 172.21.15.63:0/3540422772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86680fb780 msgr2=0x7f866810f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:19.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.801+0000 7f866dbe4700 1 --2- 172.21.15.63:0/3540422772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86680fb780 0x7f866810f7c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f865800b690 tx=0x7f8658009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:19.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.801+0000 7f866dbe4700 1 -- 172.21.15.63:0/3540422772 shutdown_connections 2023-12-07T16:15:19.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.801+0000 7f866dbe4700 1 --2- 172.21.15.63:0/3540422772 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f86500366d0 0x7f8650038b80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:19.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.801+0000 7f866dbe4700 1 --2- 172.21.15.63:0/3540422772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86680fb780 0x7f866810f7c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:19.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.801+0000 7f866dbe4700 1 -- 172.21.15.63:0/3540422772 >> 172.21.15.63:0/3540422772 conn(0x7f86680f6e40 msgr2=0x7f86680f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:19.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.801+0000 7f866dbe4700 1 -- 172.21.15.63:0/3540422772 shutdown_connections 2023-12-07T16:15:19.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:19.801+0000 7f866dbe4700 1 -- 172.21.15.63:0/3540422772 wait complete. 2023-12-07T16:15:20.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:20 smithi063 ceph-mon[112095]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:15:20.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:20 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:20.440 INFO:tasks.cephadm:Setting crush tunables to default 2023-12-07T16:15:20.440 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph osd crush tunables default 2023-12-07T16:15:20.821 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:15:21.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:21 smithi063 ceph-mon[112095]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T16:15:22.188 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.189+0000 7f8ca9a39700 1 -- 172.21.15.63:0/179878253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ca4066430 msgr2=0x7f8ca41018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:22.188 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.189+0000 7f8ca9a39700 1 --2- 172.21.15.63:0/179878253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ca4066430 0x7f8ca41018b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8c940048c0 tx=0x7f8c94009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:22.188 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.189+0000 7f8ca9a39700 1 -- 172.21.15.63:0/179878253 shutdown_connections 2023-12-07T16:15:22.188 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.189+0000 7f8ca9a39700 1 --2- 172.21.15.63:0/179878253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ca4066430 0x7f8ca41018b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:22.188 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.189+0000 7f8ca9a39700 1 -- 172.21.15.63:0/179878253 >> 172.21.15.63:0/179878253 conn(0x7f8ca40f6ec0 msgr2=0x7f8ca40f92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:22.188 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.189+0000 7f8ca9a39700 1 -- 172.21.15.63:0/179878253 shutdown_connections 2023-12-07T16:15:22.188 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.189+0000 7f8ca9a39700 1 -- 172.21.15.63:0/179878253 wait complete. 2023-12-07T16:15:22.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.190+0000 7f8ca9a39700 1 Processor -- start 2023-12-07T16:15:22.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.190+0000 7f8ca9a39700 1 -- start start 2023-12-07T16:15:22.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.190+0000 7f8ca9a39700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ca4066430 0x7f8ca410ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:22.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.190+0000 7f8ca9a39700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca410f280 con 0x7f8ca4066430 2023-12-07T16:15:22.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.190+0000 7f8ca2ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ca4066430 0x7f8ca410ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:22.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.190+0000 7f8ca2ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ca4066430 0x7f8ca410ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49142/0 (socket says 172.21.15.63:49142) 2023-12-07T16:15:22.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.190+0000 7f8ca2ffd700 1 -- 172.21.15.63:0/1102725988 learned_addr learned my addr 172.21.15.63:0/1102725988 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:15:22.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.190+0000 7f8ca2ffd700 1 -- 172.21.15.63:0/1102725988 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c94005040 con 0x7f8ca4066430 2023-12-07T16:15:22.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.190+0000 7f8ca2ffd700 1 --2- 172.21.15.63:0/1102725988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ca4066430 0x7f8ca410ed40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400b690 tx=0x7f8c94009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:22.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.190+0000 7f8c8b7fe700 1 -- 172.21.15.63:0/1102725988 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c94009650 con 0x7f8ca4066430 2023-12-07T16:15:22.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.191+0000 7f8c8b7fe700 1 -- 172.21.15.63:0/1102725988 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8c940097b0 con 0x7f8ca4066430 2023-12-07T16:15:22.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.191+0000 7f8ca9a39700 1 -- 172.21.15.63:0/1102725988 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca410f480 con 0x7f8ca4066430 2023-12-07T16:15:22.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.191+0000 7f8c8b7fe700 1 -- 172.21.15.63:0/1102725988 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c9401c5d0 con 0x7f8ca4066430 2023-12-07T16:15:22.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.191+0000 7f8ca9a39700 1 -- 172.21.15.63:0/1102725988 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca410ffe0 con 0x7f8ca4066430 2023-12-07T16:15:22.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.191+0000 7f8c8b7fe700 1 -- 172.21.15.63:0/1102725988 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f8c9401c730 con 0x7f8ca4066430 2023-12-07T16:15:22.192 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.192+0000 7f8c8b7fe700 1 --2- 172.21.15.63:0/1102725988 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f8c8c036720 0x7f8c8c038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:22.192 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.192+0000 7f8c8b7fe700 1 -- 172.21.15.63:0/1102725988 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8c9404a7a0 con 0x7f8ca4066430 2023-12-07T16:15:22.192 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.192+0000 7f8ca27fc700 1 --2- 172.21.15.63:0/1102725988 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f8c8c036720 0x7f8c8c038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:22.192 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.192+0000 7f8ca9a39700 1 -- 172.21.15.63:0/1102725988 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca405f270 con 0x7f8ca4066430 2023-12-07T16:15:22.192 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.192+0000 7f8ca27fc700 1 --2- 172.21.15.63:0/1102725988 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f8c8c036720 0x7f8c8c038bd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009990 tx=0x7f8c98006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:22.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.196+0000 7f8c8b7fe700 1 -- 172.21.15.63:0/1102725988 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8c94025400 con 0x7f8ca4066430 2023-12-07T16:15:22.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:22.403+0000 7f8ca9a39700 1 -- 172.21.15.63:0/1102725988 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f8ca404bb80 con 0x7f8ca4066430 2023-12-07T16:15:22.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:22 smithi063 ceph-mon[112095]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:15:22.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:22 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:22.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:22 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:22.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:22 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:22.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:22 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:22.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:22 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:22.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:22 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:22.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:22 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-07T16:15:22.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:22 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:23.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:23.255+0000 7f8c8b7fe700 1 -- 172.21.15.63:0/1102725988 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8c94011b60 con 0x7f8ca4066430 2023-12-07T16:15:23.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:23.257+0000 7f8ca9a39700 1 -- 172.21.15.63:0/1102725988 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f8c8c036720 msgr2=0x7f8c8c038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:23.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:23.257+0000 7f8ca9a39700 1 --2- 172.21.15.63:0/1102725988 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f8c8c036720 0x7f8c8c038bd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009990 tx=0x7f8c98006e40 comp rx=0 tx=0).stop 2023-12-07T16:15:23.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:23.257+0000 7f8ca9a39700 1 -- 172.21.15.63:0/1102725988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ca4066430 msgr2=0x7f8ca410ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:23.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:23.257+0000 7f8ca9a39700 1 --2- 172.21.15.63:0/1102725988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ca4066430 0x7f8ca410ed40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400b690 tx=0x7f8c94009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:23.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:23.257+0000 7f8ca9a39700 1 -- 172.21.15.63:0/1102725988 shutdown_connections 2023-12-07T16:15:23.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:23.257+0000 7f8ca9a39700 1 --2- 172.21.15.63:0/1102725988 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f8c8c036720 0x7f8c8c038bd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:23.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:23.257+0000 7f8ca9a39700 1 --2- 172.21.15.63:0/1102725988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ca4066430 0x7f8ca410ed40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:23.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:23.257+0000 7f8ca9a39700 1 -- 172.21.15.63:0/1102725988 >> 172.21.15.63:0/1102725988 conn(0x7f8ca40f6ec0 msgr2=0x7f8ca40f7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:23.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:23.257+0000 7f8ca9a39700 1 -- 172.21.15.63:0/1102725988 shutdown_connections 2023-12-07T16:15:23.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:15:23.257+0000 7f8ca9a39700 1 -- 172.21.15.63:0/1102725988 wait complete. 2023-12-07T16:15:23.257 INFO:teuthology.orchestra.run.smithi063.stderr:adjusted tunables profile to default 2023-12-07T16:15:23.580 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:23 smithi063 ceph-mon[112095]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-07T16:15:23.580 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:23 smithi063 ceph-mon[112095]: Deploying daemon grafana.smithi063 on smithi063 2023-12-07T16:15:23.580 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:23 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/1102725988' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-07T16:15:23.633 INFO:tasks.cephadm:Adding mon.smithi063 on smithi063 2023-12-07T16:15:23.633 INFO:tasks.cephadm:Adding mon.smithi152 on smithi152 2023-12-07T16:15:23.633 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph orch apply mon '2;smithi063:172.21.15.63=smithi063;smithi152:172.21.15.152=smithi152' 2023-12-07T16:15:23.923 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:15:23.979 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:15:24.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:24 smithi063 ceph-mon[112095]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:15:24.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:24 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/1102725988' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-07T16:15:24.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:24 smithi063 ceph-mon[112095]: osdmap e4: 0 total, 0 up, 0 in 2023-12-07T16:15:24.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:24 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:25.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.265+0000 7f3f8df70700 1 -- 172.21.15.152:0/3539416647 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f880fd3c0 msgr2=0x7f3f880ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:25.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.265+0000 7f3f8df70700 1 --2- 172.21.15.152:0/3539416647 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f880fd3c0 0x7f3f880ff7a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3f780048c0 tx=0x7f3f78009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:25.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.266+0000 7f3f8df70700 1 -- 172.21.15.152:0/3539416647 shutdown_connections 2023-12-07T16:15:25.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.266+0000 7f3f8df70700 1 --2- 172.21.15.152:0/3539416647 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f880fd3c0 0x7f3f880ff7a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:25.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.266+0000 7f3f8df70700 1 -- 172.21.15.152:0/3539416647 >> 172.21.15.152:0/3539416647 conn(0x7f3f880f6e40 msgr2=0x7f3f880f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:25.267 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.266+0000 7f3f8df70700 1 -- 172.21.15.152:0/3539416647 shutdown_connections 2023-12-07T16:15:25.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.266+0000 7f3f8df70700 1 -- 172.21.15.152:0/3539416647 wait complete. 2023-12-07T16:15:25.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.266+0000 7f3f8df70700 1 Processor -- start 2023-12-07T16:15:25.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.266+0000 7f3f8df70700 1 -- start start 2023-12-07T16:15:25.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.266+0000 7f3f8df70700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f880fd3c0 0x7f3f880fce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:25.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.266+0000 7f3f8df70700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f880fb2d0 con 0x7f3f880fd3c0 2023-12-07T16:15:25.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.267+0000 7f3f877fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f880fd3c0 0x7f3f880fce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:25.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.267+0000 7f3f877fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f880fd3c0 0x7f3f880fce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.152:53570/0 (socket says 172.21.15.152:53570) 2023-12-07T16:15:25.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.267+0000 7f3f877fe700 1 -- 172.21.15.152:0/1298839679 learned_addr learned my addr 172.21.15.152:0/1298839679 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-07T16:15:25.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.267+0000 7f3f877fe700 1 -- 172.21.15.152:0/1298839679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f78005040 con 0x7f3f880fd3c0 2023-12-07T16:15:25.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.267+0000 7f3f877fe700 1 --2- 172.21.15.152:0/1298839679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f880fd3c0 0x7f3f880fce50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3f78009040 tx=0x7f3f78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:25.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.267+0000 7f3f6ffff700 1 -- 172.21.15.152:0/1298839679 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f78009620 con 0x7f3f880fd3c0 2023-12-07T16:15:25.268 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.267+0000 7f3f8df70700 1 -- 172.21.15.152:0/1298839679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f880fb4d0 con 0x7f3f880fd3c0 2023-12-07T16:15:25.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.267+0000 7f3f6ffff700 1 -- 172.21.15.152:0/1298839679 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3f78009780 con 0x7f3f880fd3c0 2023-12-07T16:15:25.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.267+0000 7f3f6ffff700 1 -- 172.21.15.152:0/1298839679 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f7801c5b0 con 0x7f3f880fd3c0 2023-12-07T16:15:25.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.267+0000 7f3f8df70700 1 -- 172.21.15.152:0/1298839679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f880fb9c0 con 0x7f3f880fd3c0 2023-12-07T16:15:25.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.268+0000 7f3f6ffff700 1 -- 172.21.15.152:0/1298839679 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f3f7801c870 con 0x7f3f880fd3c0 2023-12-07T16:15:25.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.268+0000 7f3f8df70700 1 -- 172.21.15.152:0/1298839679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f88106510 con 0x7f3f880fd3c0 2023-12-07T16:15:25.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.268+0000 7f3f6ffff700 1 --2- 172.21.15.152:0/1298839679 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f3f700366d0 0x7f3f70038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:25.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.268+0000 7f3f6ffff700 1 -- 172.21.15.152:0/1298839679 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f3f780499a0 con 0x7f3f880fd3c0 2023-12-07T16:15:25.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.269+0000 7f3f86ffd700 1 --2- 172.21.15.152:0/1298839679 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f3f700366d0 0x7f3f70038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:25.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.269+0000 7f3f86ffd700 1 --2- 172.21.15.152:0/1298839679 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f3f700366d0 0x7f3f70038b80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c009990 tx=0x7f3f7c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:25.271 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.273+0000 7f3f6ffff700 1 -- 172.21.15.152:0/1298839679 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3f78023300 con 0x7f3f880fd3c0 2023-12-07T16:15:25.458 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.460+0000 7f3f8df70700 1 -- 172.21.15.152:0/1298839679 --> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi063:172.21.15.63=smithi063;smithi152:172.21.15.152=smithi152", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f8802b250 con 0x7f3f700366d0 2023-12-07T16:15:25.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.468+0000 7f3f6ffff700 1 -- 172.21.15.152:0/1298839679 <== mgr.14162 v2:172.21.15.63:6800/4069965417 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f3f8802b250 con 0x7f3f700366d0 2023-12-07T16:15:25.467 INFO:teuthology.orchestra.run.smithi152.stdout:Scheduled mon update... 2023-12-07T16:15:25.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.470+0000 7f3f8df70700 1 -- 172.21.15.152:0/1298839679 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f3f700366d0 msgr2=0x7f3f70038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:25.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.470+0000 7f3f8df70700 1 --2- 172.21.15.152:0/1298839679 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f3f700366d0 0x7f3f70038b80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c009990 tx=0x7f3f7c006e40 comp rx=0 tx=0).stop 2023-12-07T16:15:25.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.470+0000 7f3f8df70700 1 -- 172.21.15.152:0/1298839679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f880fd3c0 msgr2=0x7f3f880fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:25.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.470+0000 7f3f8df70700 1 --2- 172.21.15.152:0/1298839679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f880fd3c0 0x7f3f880fce50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3f78009040 tx=0x7f3f78009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:25.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.470+0000 7f3f8df70700 1 -- 172.21.15.152:0/1298839679 shutdown_connections 2023-12-07T16:15:25.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.470+0000 7f3f8df70700 1 --2- 172.21.15.152:0/1298839679 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f3f700366d0 0x7f3f70038b80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:25.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.470+0000 7f3f8df70700 1 --2- 172.21.15.152:0/1298839679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f880fd3c0 0x7f3f880fce50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:25.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.470+0000 7f3f8df70700 1 -- 172.21.15.152:0/1298839679 >> 172.21.15.152:0/1298839679 conn(0x7f3f880f6e40 msgr2=0x7f3f880f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:25.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.471+0000 7f3f8df70700 1 -- 172.21.15.152:0/1298839679 shutdown_connections 2023-12-07T16:15:25.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:25.471+0000 7f3f8df70700 1 -- 172.21.15.152:0/1298839679 wait complete. 2023-12-07T16:15:25.874 DEBUG:teuthology.orchestra.run.smithi152:mon.smithi152> sudo journalctl -f -n 0 -u ceph-8c493298-951b-11ee-95a2-87774f69a715@mon.smithi152.service 2023-12-07T16:15:25.876 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-07T16:15:25.876 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-07T16:15:25.906 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:-- Logs begin at Thu 2023-12-07 15:43:14 UTC. -- 2023-12-07T16:15:26.176 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:15:26.237 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:15:26.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:26 smithi063 ceph-mon[112095]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:15:26.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:26 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:27.216 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.216+0000 7ff592bf1700 1 -- 172.21.15.152:0/924550651 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff58c0fb760 msgr2=0x7ff58c0fbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:27.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.216+0000 7ff592bf1700 1 --2- 172.21.15.152:0/924550651 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff58c0fb760 0x7ff58c0fbb70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff5800048c0 tx=0x7ff580009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:27.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.216+0000 7ff592bf1700 1 -- 172.21.15.152:0/924550651 shutdown_connections 2023-12-07T16:15:27.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.216+0000 7ff592bf1700 1 --2- 172.21.15.152:0/924550651 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff58c0fb760 0x7ff58c0fbb70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:27.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.216+0000 7ff592bf1700 1 -- 172.21.15.152:0/924550651 >> 172.21.15.152:0/924550651 conn(0x7ff58c0f6ec0 msgr2=0x7ff58c0f92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:27.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.216+0000 7ff592bf1700 1 -- 172.21.15.152:0/924550651 shutdown_connections 2023-12-07T16:15:27.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.216+0000 7ff592bf1700 1 -- 172.21.15.152:0/924550651 wait complete. 2023-12-07T16:15:27.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.216+0000 7ff592bf1700 1 Processor -- start 2023-12-07T16:15:27.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.216+0000 7ff592bf1700 1 -- start start 2023-12-07T16:15:27.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.217+0000 7ff592bf1700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff58c0fb760 0x7ff58c0f8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:27.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.217+0000 7ff592bf1700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c0f7460 con 0x7ff58c0fb760 2023-12-07T16:15:27.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.217+0000 7ff59098d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff58c0fb760 0x7ff58c0f8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:27.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.217+0000 7ff59098d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff58c0fb760 0x7ff58c0f8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.152:53596/0 (socket says 172.21.15.152:53596) 2023-12-07T16:15:27.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.217+0000 7ff59098d700 1 -- 172.21.15.152:0/2101161355 learned_addr learned my addr 172.21.15.152:0/2101161355 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-07T16:15:27.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.217+0000 7ff59098d700 1 -- 172.21.15.152:0/2101161355 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff580005040 con 0x7ff58c0fb760 2023-12-07T16:15:27.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.217+0000 7ff59098d700 1 --2- 172.21.15.152:0/2101161355 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff58c0fb760 0x7ff58c0f8fe0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff580009040 tx=0x7ff580009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:27.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.217+0000 7ff5897fa700 1 -- 172.21.15.152:0/2101161355 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff580009620 con 0x7ff58c0fb760 2023-12-07T16:15:27.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.217+0000 7ff592bf1700 1 -- 172.21.15.152:0/2101161355 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58c0f7660 con 0x7ff58c0fb760 2023-12-07T16:15:27.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.217+0000 7ff5897fa700 1 -- 172.21.15.152:0/2101161355 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff580009780 con 0x7ff58c0fb760 2023-12-07T16:15:27.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.217+0000 7ff5897fa700 1 -- 172.21.15.152:0/2101161355 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff58001c5b0 con 0x7ff58c0fb760 2023-12-07T16:15:27.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.217+0000 7ff592bf1700 1 -- 172.21.15.152:0/2101161355 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58c0f7b50 con 0x7ff58c0fb760 2023-12-07T16:15:27.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.218+0000 7ff5897fa700 1 -- 172.21.15.152:0/2101161355 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7ff580013a60 con 0x7ff58c0fb760 2023-12-07T16:15:27.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.218+0000 7ff592bf1700 1 -- 172.21.15.152:0/2101161355 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff58c106380 con 0x7ff58c0fb760 2023-12-07T16:15:27.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.218+0000 7ff5897fa700 1 --2- 172.21.15.152:0/2101161355 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7ff57c0366d0 0x7ff57c038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:27.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.218+0000 7ff5897fa700 1 -- 172.21.15.152:0/2101161355 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff580049900 con 0x7ff58c0fb760 2023-12-07T16:15:27.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.219+0000 7ff58bfff700 1 --2- 172.21.15.152:0/2101161355 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7ff57c0366d0 0x7ff57c038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:27.220 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.219+0000 7ff58bfff700 1 --2- 172.21.15.152:0/2101161355 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7ff57c0366d0 0x7ff57c038b80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff578009990 tx=0x7ff578006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:27.224 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.226+0000 7ff5897fa700 1 -- 172.21.15.152:0/2101161355 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff5800119c0 con 0x7ff58c0fb760 2023-12-07T16:15:27.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.475+0000 7ff592bf1700 1 -- 172.21.15.152:0/2101161355 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff58c04bb80 con 0x7ff58c0fb760 2023-12-07T16:15:27.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.475+0000 7ff5897fa700 1 -- 172.21.15.152:0/2101161355 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7ff580011370 con 0x7ff58c0fb760 2023-12-07T16:15:27.474 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:15:27.474 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"8c493298-951b-11ee-95a2-87774f69a715","modified":"2023-12-07T16:14:01.402276Z","created":"2023-12-07T16:14:01.402276Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-07T16:15:27.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.477+0000 7ff592bf1700 1 -- 172.21.15.152:0/2101161355 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7ff57c0366d0 msgr2=0x7ff57c038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:27.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.477+0000 7ff592bf1700 1 --2- 172.21.15.152:0/2101161355 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7ff57c0366d0 0x7ff57c038b80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff578009990 tx=0x7ff578006e40 comp rx=0 tx=0).stop 2023-12-07T16:15:27.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.477+0000 7ff592bf1700 1 -- 172.21.15.152:0/2101161355 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff58c0fb760 msgr2=0x7ff58c0f8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:27.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.477+0000 7ff592bf1700 1 --2- 172.21.15.152:0/2101161355 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff58c0fb760 0x7ff58c0f8fe0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff580009040 tx=0x7ff580009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:27.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.478+0000 7ff592bf1700 1 -- 172.21.15.152:0/2101161355 shutdown_connections 2023-12-07T16:15:27.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.478+0000 7ff592bf1700 1 --2- 172.21.15.152:0/2101161355 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7ff57c0366d0 0x7ff57c038b80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:27.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.478+0000 7ff592bf1700 1 --2- 172.21.15.152:0/2101161355 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff58c0fb760 0x7ff58c0f8fe0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:27.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.478+0000 7ff592bf1700 1 -- 172.21.15.152:0/2101161355 >> 172.21.15.152:0/2101161355 conn(0x7ff58c0f6ec0 msgr2=0x7ff58c066040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:27.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.478+0000 7ff592bf1700 1 -- 172.21.15.152:0/2101161355 shutdown_connections 2023-12-07T16:15:27.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:27.478+0000 7ff592bf1700 1 -- 172.21.15.152:0/2101161355 wait complete. 2023-12-07T16:15:27.477 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2023-12-07T16:15:27.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:27 smithi063 ceph-mon[112095]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi063:172.21.15.63=smithi063;smithi152:172.21.15.152=smithi152", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:15:27.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:27 smithi063 ceph-mon[112095]: Saving service mon spec with placement smithi063:172.21.15.63=smithi063;smithi152:172.21.15.152=smithi152;count:2 2023-12-07T16:15:28.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:28 smithi063 ceph-mon[112095]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:15:28.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:28 smithi063 ceph-mon[112095]: from='client.? 172.21.15.152:0/2101161355' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:15:28.858 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-07T16:15:28.859 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-07T16:15:29.147 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:15:29.207 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:15:29.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:29 smithi063 ceph-mon[112095]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:15:30.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.206+0000 7f69e0a5b700 1 -- 172.21.15.152:0/2064140743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69dc0fb770 msgr2=0x7f69dc0fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:30.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.206+0000 7f69e0a5b700 1 --2- 172.21.15.152:0/2064140743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69dc0fb770 0x7f69dc0fbb80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f69d00048c0 tx=0x7f69d0009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:30.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.207+0000 7f69e0a5b700 1 -- 172.21.15.152:0/2064140743 shutdown_connections 2023-12-07T16:15:30.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.207+0000 7f69e0a5b700 1 --2- 172.21.15.152:0/2064140743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69dc0fb770 0x7f69dc0fbb80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:30.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.207+0000 7f69e0a5b700 1 -- 172.21.15.152:0/2064140743 >> 172.21.15.152:0/2064140743 conn(0x7f69dc0f6e50 msgr2=0x7f69dc0f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:30.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.207+0000 7f69e0a5b700 1 -- 172.21.15.152:0/2064140743 shutdown_connections 2023-12-07T16:15:30.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.207+0000 7f69e0a5b700 1 -- 172.21.15.152:0/2064140743 wait complete. 2023-12-07T16:15:30.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.207+0000 7f69e0a5b700 1 Processor -- start 2023-12-07T16:15:30.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.207+0000 7f69e0a5b700 1 -- start start 2023-12-07T16:15:30.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.207+0000 7f69e0a5b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69dc0fb770 0x7f69dc10f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:30.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.207+0000 7f69e0a5b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc0662a0 con 0x7f69dc0fb770 2023-12-07T16:15:30.206 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.207+0000 7f69da59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69dc0fb770 0x7f69dc10f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:30.207 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.207+0000 7f69da59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69dc0fb770 0x7f69dc10f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.152:53618/0 (socket says 172.21.15.152:53618) 2023-12-07T16:15:30.207 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.207+0000 7f69da59c700 1 -- 172.21.15.152:0/1940454007 learned_addr learned my addr 172.21.15.152:0/1940454007 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-07T16:15:30.207 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.208+0000 7f69da59c700 1 -- 172.21.15.152:0/1940454007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d0005040 con 0x7f69dc0fb770 2023-12-07T16:15:30.207 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.208+0000 7f69da59c700 1 --2- 172.21.15.152:0/1940454007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69dc0fb770 0x7f69dc10f7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f69d000b690 tx=0x7f69d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:30.208 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.208+0000 7f69caffd700 1 -- 172.21.15.152:0/1940454007 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69d0009650 con 0x7f69dc0fb770 2023-12-07T16:15:30.208 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.208+0000 7f69caffd700 1 -- 172.21.15.152:0/1940454007 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f69d00097b0 con 0x7f69dc0fb770 2023-12-07T16:15:30.208 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.208+0000 7f69caffd700 1 -- 172.21.15.152:0/1940454007 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69d001c5d0 con 0x7f69dc0fb770 2023-12-07T16:15:30.208 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.208+0000 7f69e0a5b700 1 -- 172.21.15.152:0/1940454007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69dc0664a0 con 0x7f69dc0fb770 2023-12-07T16:15:30.208 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.208+0000 7f69e0a5b700 1 -- 172.21.15.152:0/1940454007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69dc10ff20 con 0x7f69dc0fb770 2023-12-07T16:15:30.208 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.209+0000 7f69caffd700 1 -- 172.21.15.152:0/1940454007 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f69d0013420 con 0x7f69dc0fb770 2023-12-07T16:15:30.208 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.209+0000 7f69e0a5b700 1 -- 172.21.15.152:0/1940454007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69dc105400 con 0x7f69dc0fb770 2023-12-07T16:15:30.208 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.209+0000 7f69caffd700 1 --2- 172.21.15.152:0/1940454007 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f69c40366d0 0x7f69c4038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:30.208 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.209+0000 7f69caffd700 1 -- 172.21.15.152:0/1940454007 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f69d00499a0 con 0x7f69dc0fb770 2023-12-07T16:15:30.208 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.209+0000 7f69d9d9b700 1 --2- 172.21.15.152:0/1940454007 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f69c40366d0 0x7f69c4038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:30.208 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.210+0000 7f69d9d9b700 1 --2- 172.21.15.152:0/1940454007 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f69c40366d0 0x7f69c4038b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f69cc009990 tx=0x7f69cc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:30.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.215+0000 7f69caffd700 1 -- 172.21.15.152:0/1940454007 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f69d0025400 con 0x7f69dc0fb770 2023-12-07T16:15:30.468 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.470+0000 7f69e0a5b700 1 -- 172.21.15.152:0/1940454007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f69dc1013f0 con 0x7f69dc0fb770 2023-12-07T16:15:30.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.471+0000 7f69caffd700 1 -- 172.21.15.152:0/1940454007 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f69d0011370 con 0x7f69dc0fb770 2023-12-07T16:15:30.469 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:15:30.469 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"8c493298-951b-11ee-95a2-87774f69a715","modified":"2023-12-07T16:14:01.402276Z","created":"2023-12-07T16:14:01.402276Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-07T16:15:30.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.473+0000 7f69e0a5b700 1 -- 172.21.15.152:0/1940454007 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f69c40366d0 msgr2=0x7f69c4038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:30.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.473+0000 7f69e0a5b700 1 --2- 172.21.15.152:0/1940454007 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f69c40366d0 0x7f69c4038b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f69cc009990 tx=0x7f69cc006e40 comp rx=0 tx=0).stop 2023-12-07T16:15:30.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.473+0000 7f69e0a5b700 1 -- 172.21.15.152:0/1940454007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69dc0fb770 msgr2=0x7f69dc10f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:30.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.473+0000 7f69e0a5b700 1 --2- 172.21.15.152:0/1940454007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69dc0fb770 0x7f69dc10f7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f69d000b690 tx=0x7f69d0009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:30.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.473+0000 7f69e0a5b700 1 -- 172.21.15.152:0/1940454007 shutdown_connections 2023-12-07T16:15:30.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.473+0000 7f69e0a5b700 1 --2- 172.21.15.152:0/1940454007 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f69c40366d0 0x7f69c4038b80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:30.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.473+0000 7f69e0a5b700 1 --2- 172.21.15.152:0/1940454007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69dc0fb770 0x7f69dc10f7a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:30.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.473+0000 7f69e0a5b700 1 -- 172.21.15.152:0/1940454007 >> 172.21.15.152:0/1940454007 conn(0x7f69dc0f6e50 msgr2=0x7f69dc0f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:30.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.473+0000 7f69e0a5b700 1 -- 172.21.15.152:0/1940454007 shutdown_connections 2023-12-07T16:15:30.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:30.473+0000 7f69e0a5b700 1 -- 172.21.15.152:0/1940454007 wait complete. 2023-12-07T16:15:30.472 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2023-12-07T16:15:30.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:30 smithi063 ceph-mon[112095]: from='client.? 172.21.15.152:0/1940454007' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:15:31.811 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:31 smithi063 ceph-mon[112095]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:15:31.860 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-07T16:15:31.860 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-07T16:15:32.140 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:15:32.202 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:15:33.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.242+0000 7fabec7a2700 1 -- 172.21.15.152:0/169533806 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabe40fb770 msgr2=0x7fabe40fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:33.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.242+0000 7fabec7a2700 1 --2- 172.21.15.152:0/169533806 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabe40fb770 0x7fabe40fbb80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fabd40048c0 tx=0x7fabd4009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:33.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.243+0000 7fabec7a2700 1 -- 172.21.15.152:0/169533806 shutdown_connections 2023-12-07T16:15:33.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.243+0000 7fabec7a2700 1 --2- 172.21.15.152:0/169533806 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabe40fb770 0x7fabe40fbb80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:33.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.243+0000 7fabec7a2700 1 -- 172.21.15.152:0/169533806 >> 172.21.15.152:0/169533806 conn(0x7fabe40f6e50 msgr2=0x7fabe40f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:33.242 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.243+0000 7fabec7a2700 1 -- 172.21.15.152:0/169533806 shutdown_connections 2023-12-07T16:15:33.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.243+0000 7fabec7a2700 1 -- 172.21.15.152:0/169533806 wait complete. 2023-12-07T16:15:33.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.243+0000 7fabec7a2700 1 Processor -- start 2023-12-07T16:15:33.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.243+0000 7fabec7a2700 1 -- start start 2023-12-07T16:15:33.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.243+0000 7fabec7a2700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabe40fb770 0x7fabe410ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:33.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.243+0000 7fabec7a2700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe410cfd0 con 0x7fabe40fb770 2023-12-07T16:15:33.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.244+0000 7fabea53e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabe40fb770 0x7fabe410ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:33.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.244+0000 7fabea53e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabe40fb770 0x7fabe410ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.152:53648/0 (socket says 172.21.15.152:53648) 2023-12-07T16:15:33.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.244+0000 7fabea53e700 1 -- 172.21.15.152:0/1276399034 learned_addr learned my addr 172.21.15.152:0/1276399034 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-07T16:15:33.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.244+0000 7fabea53e700 1 -- 172.21.15.152:0/1276399034 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd4005040 con 0x7fabe40fb770 2023-12-07T16:15:33.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.244+0000 7fabea53e700 1 --2- 172.21.15.152:0/1276399034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabe40fb770 0x7fabe410ca90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fabd4009330 tx=0x7fabd4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:33.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.246+0000 7fabdaffd700 1 -- 172.21.15.152:0/1276399034 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fabd40096b0 con 0x7fabe40fb770 2023-12-07T16:15:33.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.246+0000 7fabdaffd700 1 -- 172.21.15.152:0/1276399034 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fabd4009810 con 0x7fabe40fb770 2023-12-07T16:15:33.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.246+0000 7fabec7a2700 1 -- 172.21.15.152:0/1276399034 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe410d1d0 con 0x7fabe40fb770 2023-12-07T16:15:33.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.246+0000 7fabdaffd700 1 -- 172.21.15.152:0/1276399034 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fabd401c5b0 con 0x7fabe40fb770 2023-12-07T16:15:33.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.246+0000 7fabec7a2700 1 -- 172.21.15.152:0/1276399034 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe410de70 con 0x7fabe40fb770 2023-12-07T16:15:33.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.247+0000 7fabdaffd700 1 -- 172.21.15.152:0/1276399034 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fabd4013420 con 0x7fabe40fb770 2023-12-07T16:15:33.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.247+0000 7fabec7a2700 1 -- 172.21.15.152:0/1276399034 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe405f270 con 0x7fabe40fb770 2023-12-07T16:15:33.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.247+0000 7fabdaffd700 1 --2- 172.21.15.152:0/1276399034 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7fabd0036720 0x7fabd0038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:33.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.247+0000 7fabdaffd700 1 -- 172.21.15.152:0/1276399034 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fabd4049a70 con 0x7fabe40fb770 2023-12-07T16:15:33.245 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.247+0000 7fabe9d3d700 1 --2- 172.21.15.152:0/1276399034 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7fabd0036720 0x7fabd0038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:33.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.248+0000 7fabe9d3d700 1 --2- 172.21.15.152:0/1276399034 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7fabd0036720 0x7fabd0038bd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009990 tx=0x7fabe0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:33.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.252+0000 7fabdaffd700 1 -- 172.21.15.152:0/1276399034 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fabd40119c0 con 0x7fabe40fb770 2023-12-07T16:15:33.506 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.508+0000 7fabec7a2700 1 -- 172.21.15.152:0/1276399034 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fabe410e9c0 con 0x7fabe40fb770 2023-12-07T16:15:33.506 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.508+0000 7fabdaffd700 1 -- 172.21.15.152:0/1276399034 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fabd4011370 con 0x7fabe40fb770 2023-12-07T16:15:33.507 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:15:33.507 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"8c493298-951b-11ee-95a2-87774f69a715","modified":"2023-12-07T16:14:01.402276Z","created":"2023-12-07T16:14:01.402276Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-07T16:15:33.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.510+0000 7fabec7a2700 1 -- 172.21.15.152:0/1276399034 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7fabd0036720 msgr2=0x7fabd0038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:33.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.510+0000 7fabec7a2700 1 --2- 172.21.15.152:0/1276399034 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7fabd0036720 0x7fabd0038bd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009990 tx=0x7fabe0006e40 comp rx=0 tx=0).stop 2023-12-07T16:15:33.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.510+0000 7fabec7a2700 1 -- 172.21.15.152:0/1276399034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabe40fb770 msgr2=0x7fabe410ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:33.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.510+0000 7fabec7a2700 1 --2- 172.21.15.152:0/1276399034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabe40fb770 0x7fabe410ca90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fabd4009330 tx=0x7fabd4009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:33.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.510+0000 7fabec7a2700 1 -- 172.21.15.152:0/1276399034 shutdown_connections 2023-12-07T16:15:33.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.510+0000 7fabec7a2700 1 --2- 172.21.15.152:0/1276399034 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7fabd0036720 0x7fabd0038bd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:33.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.510+0000 7fabec7a2700 1 --2- 172.21.15.152:0/1276399034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabe40fb770 0x7fabe410ca90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:33.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.510+0000 7fabec7a2700 1 -- 172.21.15.152:0/1276399034 >> 172.21.15.152:0/1276399034 conn(0x7fabe40f6e50 msgr2=0x7fabe4065e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:33.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.510+0000 7fabec7a2700 1 -- 172.21.15.152:0/1276399034 shutdown_connections 2023-12-07T16:15:33.509 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:33.510+0000 7fabec7a2700 1 -- 172.21.15.152:0/1276399034 wait complete. 2023-12-07T16:15:33.510 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2023-12-07T16:15:34.562 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:34 smithi063 ceph-mon[112095]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:15:34.562 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:34 smithi063 ceph-mon[112095]: from='client.? 172.21.15.152:0/1276399034' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:15:34.902 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-07T16:15:34.902 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-07T16:15:35.186 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:15:35.244 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:15:36.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:35 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:36.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:35 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:36.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:35 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:36.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:35 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:36.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:35 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:36.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:35 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:36.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:35 smithi063 ceph-mon[112095]: Deploying daemon prometheus.smithi063 on smithi063 2023-12-07T16:15:36.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:35 smithi063 ceph-mon[112095]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:15:36.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.295+0000 7fb83634e700 1 -- 172.21.15.152:0/1328881899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8300fd3c0 msgr2=0x7fb8300ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:36.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.295+0000 7fb83634e700 1 --2- 172.21.15.152:0/1328881899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8300fd3c0 0x7fb8300ff7a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb8200048c0 tx=0x7fb820009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:36.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.295+0000 7fb83634e700 1 -- 172.21.15.152:0/1328881899 shutdown_connections 2023-12-07T16:15:36.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.295+0000 7fb83634e700 1 --2- 172.21.15.152:0/1328881899 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8300fd3c0 0x7fb8300ff7a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:36.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.295+0000 7fb83634e700 1 -- 172.21.15.152:0/1328881899 >> 172.21.15.152:0/1328881899 conn(0x7fb8300f6e40 msgr2=0x7fb8300f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:36.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.295+0000 7fb83634e700 1 -- 172.21.15.152:0/1328881899 shutdown_connections 2023-12-07T16:15:36.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.295+0000 7fb83634e700 1 -- 172.21.15.152:0/1328881899 wait complete. 2023-12-07T16:15:36.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.295+0000 7fb83634e700 1 Processor -- start 2023-12-07T16:15:36.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.296+0000 7fb83634e700 1 -- start start 2023-12-07T16:15:36.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.296+0000 7fb83634e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8300fd3c0 0x7fb8300fce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:36.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.296+0000 7fb83634e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8300fb2d0 con 0x7fb8300fd3c0 2023-12-07T16:15:36.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.296+0000 7fb82ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8300fd3c0 0x7fb8300fce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:36.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.296+0000 7fb82ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8300fd3c0 0x7fb8300fce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.152:57378/0 (socket says 172.21.15.152:57378) 2023-12-07T16:15:36.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.296+0000 7fb82ffff700 1 -- 172.21.15.152:0/1974419381 learned_addr learned my addr 172.21.15.152:0/1974419381 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-07T16:15:36.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.296+0000 7fb82ffff700 1 -- 172.21.15.152:0/1974419381 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb820005040 con 0x7fb8300fd3c0 2023-12-07T16:15:36.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.296+0000 7fb82ffff700 1 --2- 172.21.15.152:0/1974419381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8300fd3c0 0x7fb8300fce50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb82000b690 tx=0x7fb820009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:36.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.297+0000 7fb82cff9700 1 -- 172.21.15.152:0/1974419381 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb820009650 con 0x7fb8300fd3c0 2023-12-07T16:15:36.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.297+0000 7fb83634e700 1 -- 172.21.15.152:0/1974419381 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8300fb4d0 con 0x7fb8300fd3c0 2023-12-07T16:15:36.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.297+0000 7fb82cff9700 1 -- 172.21.15.152:0/1974419381 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb8200097b0 con 0x7fb8300fd3c0 2023-12-07T16:15:36.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.297+0000 7fb82cff9700 1 -- 172.21.15.152:0/1974419381 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb82001c5b0 con 0x7fb8300fd3c0 2023-12-07T16:15:36.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.297+0000 7fb83634e700 1 -- 172.21.15.152:0/1974419381 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8300fb9c0 con 0x7fb8300fd3c0 2023-12-07T16:15:36.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.297+0000 7fb82cff9700 1 -- 172.21.15.152:0/1974419381 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fb82001c870 con 0x7fb8300fd3c0 2023-12-07T16:15:36.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.297+0000 7fb83634e700 1 -- 172.21.15.152:0/1974419381 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb830106510 con 0x7fb8300fd3c0 2023-12-07T16:15:36.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.298+0000 7fb82cff9700 1 --2- 172.21.15.152:0/1974419381 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7fb8180366d0 0x7fb818038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:36.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.298+0000 7fb82cff9700 1 -- 172.21.15.152:0/1974419381 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb820049a00 con 0x7fb8300fd3c0 2023-12-07T16:15:36.298 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.298+0000 7fb82f7fe700 1 --2- 172.21.15.152:0/1974419381 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7fb8180366d0 0x7fb818038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:36.298 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.298+0000 7fb82f7fe700 1 --2- 172.21.15.152:0/1974419381 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7fb8180366d0 0x7fb818038b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb824009990 tx=0x7fb824006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:36.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.303+0000 7fb82cff9700 1 -- 172.21.15.152:0/1974419381 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb820011550 con 0x7fb8300fd3c0 2023-12-07T16:15:36.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.555+0000 7fb83634e700 1 -- 172.21.15.152:0/1974419381 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb83004bb80 con 0x7fb8300fd3c0 2023-12-07T16:15:36.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.556+0000 7fb82cff9700 1 -- 172.21.15.152:0/1974419381 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fb820011370 con 0x7fb8300fd3c0 2023-12-07T16:15:36.554 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:15:36.554 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"8c493298-951b-11ee-95a2-87774f69a715","modified":"2023-12-07T16:14:01.402276Z","created":"2023-12-07T16:14:01.402276Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-07T16:15:36.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.558+0000 7fb83634e700 1 -- 172.21.15.152:0/1974419381 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7fb8180366d0 msgr2=0x7fb818038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:36.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.558+0000 7fb83634e700 1 --2- 172.21.15.152:0/1974419381 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7fb8180366d0 0x7fb818038b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb824009990 tx=0x7fb824006e40 comp rx=0 tx=0).stop 2023-12-07T16:15:36.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.558+0000 7fb83634e700 1 -- 172.21.15.152:0/1974419381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8300fd3c0 msgr2=0x7fb8300fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:36.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.558+0000 7fb83634e700 1 --2- 172.21.15.152:0/1974419381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8300fd3c0 0x7fb8300fce50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb82000b690 tx=0x7fb820009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:36.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.558+0000 7fb83634e700 1 -- 172.21.15.152:0/1974419381 shutdown_connections 2023-12-07T16:15:36.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.558+0000 7fb83634e700 1 --2- 172.21.15.152:0/1974419381 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7fb8180366d0 0x7fb818038b80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:36.557 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.558+0000 7fb83634e700 1 --2- 172.21.15.152:0/1974419381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8300fd3c0 0x7fb8300fce50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:36.557 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.558+0000 7fb83634e700 1 -- 172.21.15.152:0/1974419381 >> 172.21.15.152:0/1974419381 conn(0x7fb8300f6e40 msgr2=0x7fb8300f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:36.557 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.558+0000 7fb83634e700 1 -- 172.21.15.152:0/1974419381 shutdown_connections 2023-12-07T16:15:36.557 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:36.558+0000 7fb83634e700 1 -- 172.21.15.152:0/1974419381 wait complete. 2023-12-07T16:15:36.557 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2023-12-07T16:15:37.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:36 smithi063 ceph-mon[112095]: from='client.? 172.21.15.152:0/1974419381' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:15:37.944 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-07T16:15:37.945 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-07T16:15:38.231 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:15:38.285 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:15:38.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:38 smithi063 ceph-mon[112095]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:15:39.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.271+0000 7f5038157700 1 -- 172.21.15.152:0/2840977540 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5030065aa0 msgr2=0x7f5030101830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:39.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.271+0000 7f5038157700 1 --2- 172.21.15.152:0/2840977540 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5030065aa0 0x7f5030101830 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f50200048c0 tx=0x7f5020009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:39.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.271+0000 7f5038157700 1 -- 172.21.15.152:0/2840977540 shutdown_connections 2023-12-07T16:15:39.269 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.271+0000 7f5038157700 1 --2- 172.21.15.152:0/2840977540 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5030065aa0 0x7f5030101830 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:39.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.271+0000 7f5038157700 1 -- 172.21.15.152:0/2840977540 >> 172.21.15.152:0/2840977540 conn(0x7f50300f6e40 msgr2=0x7f50300f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:39.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.271+0000 7f5038157700 1 -- 172.21.15.152:0/2840977540 shutdown_connections 2023-12-07T16:15:39.270 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.271+0000 7f5038157700 1 -- 172.21.15.152:0/2840977540 wait complete. 2023-12-07T16:15:39.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.272+0000 7f5038157700 1 Processor -- start 2023-12-07T16:15:39.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.272+0000 7f5038157700 1 -- start start 2023-12-07T16:15:39.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.272+0000 7f5038157700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5030065aa0 0x7f503010ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:39.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.272+0000 7f5038157700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503010f230 con 0x7f5030065aa0 2023-12-07T16:15:39.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.272+0000 7f5035ef3700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5030065aa0 0x7f503010ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:39.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.272+0000 7f5035ef3700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5030065aa0 0x7f503010ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.152:57396/0 (socket says 172.21.15.152:57396) 2023-12-07T16:15:39.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.272+0000 7f5035ef3700 1 -- 172.21.15.152:0/2038696968 learned_addr learned my addr 172.21.15.152:0/2038696968 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-07T16:15:39.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.272+0000 7f5035ef3700 1 -- 172.21.15.152:0/2038696968 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5020005040 con 0x7f5030065aa0 2023-12-07T16:15:39.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.272+0000 7f5035ef3700 1 --2- 172.21.15.152:0/2038696968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5030065aa0 0x7f503010ecf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f502000b690 tx=0x7f5020009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:39.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.273+0000 7f50267fc700 1 -- 172.21.15.152:0/2038696968 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5020009650 con 0x7f5030065aa0 2023-12-07T16:15:39.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.273+0000 7f50267fc700 1 -- 172.21.15.152:0/2038696968 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f50200097b0 con 0x7f5030065aa0 2023-12-07T16:15:39.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.273+0000 7f50267fc700 1 -- 172.21.15.152:0/2038696968 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f502001c5b0 con 0x7f5030065aa0 2023-12-07T16:15:39.272 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.273+0000 7f5038157700 1 -- 172.21.15.152:0/2038696968 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f503010f430 con 0x7f5030065aa0 2023-12-07T16:15:39.273 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.273+0000 7f5038157700 1 -- 172.21.15.152:0/2038696968 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503010ff90 con 0x7f5030065aa0 2023-12-07T16:15:39.273 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.273+0000 7f50267fc700 1 -- 172.21.15.152:0/2038696968 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f502001c820 con 0x7f5030065aa0 2023-12-07T16:15:39.273 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.274+0000 7f50267fc700 1 --2- 172.21.15.152:0/2038696968 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f501c036720 0x7f501c038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:39.273 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.274+0000 7f50267fc700 1 -- 172.21.15.152:0/2038696968 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5020049930 con 0x7f5030065aa0 2023-12-07T16:15:39.273 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.274+0000 7f5038157700 1 -- 172.21.15.152:0/2038696968 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f503004bb80 con 0x7f5030065aa0 2023-12-07T16:15:39.273 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.274+0000 7f50356f2700 1 --2- 172.21.15.152:0/2038696968 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f501c036720 0x7f501c038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:39.273 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.274+0000 7f50356f2700 1 --2- 172.21.15.152:0/2038696968 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f501c036720 0x7f501c038bd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f502c009990 tx=0x7f502c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:39.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.279+0000 7f50267fc700 1 -- 172.21.15.152:0/2038696968 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5020023300 con 0x7f5030065aa0 2023-12-07T16:15:39.532 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.534+0000 7f5038157700 1 -- 172.21.15.152:0/2038696968 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5030110a60 con 0x7f5030065aa0 2023-12-07T16:15:39.533 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.535+0000 7f50267fc700 1 -- 172.21.15.152:0/2038696968 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f5020034090 con 0x7f5030065aa0 2023-12-07T16:15:39.533 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:15:39.533 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"8c493298-951b-11ee-95a2-87774f69a715","modified":"2023-12-07T16:14:01.402276Z","created":"2023-12-07T16:14:01.402276Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-07T16:15:39.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.536+0000 7f5038157700 1 -- 172.21.15.152:0/2038696968 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f501c036720 msgr2=0x7f501c038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:39.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.536+0000 7f5038157700 1 --2- 172.21.15.152:0/2038696968 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f501c036720 0x7f501c038bd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f502c009990 tx=0x7f502c006e40 comp rx=0 tx=0).stop 2023-12-07T16:15:39.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.536+0000 7f5038157700 1 -- 172.21.15.152:0/2038696968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5030065aa0 msgr2=0x7f503010ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:39.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.536+0000 7f5038157700 1 --2- 172.21.15.152:0/2038696968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5030065aa0 0x7f503010ecf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f502000b690 tx=0x7f5020009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:39.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.536+0000 7f5038157700 1 -- 172.21.15.152:0/2038696968 shutdown_connections 2023-12-07T16:15:39.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.536+0000 7f5038157700 1 --2- 172.21.15.152:0/2038696968 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f501c036720 0x7f501c038bd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:39.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.536+0000 7f5038157700 1 --2- 172.21.15.152:0/2038696968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5030065aa0 0x7f503010ecf0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:39.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.536+0000 7f5038157700 1 -- 172.21.15.152:0/2038696968 >> 172.21.15.152:0/2038696968 conn(0x7f50300f6e40 msgr2=0x7f50300f7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:39.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.536+0000 7f5038157700 1 -- 172.21.15.152:0/2038696968 shutdown_connections 2023-12-07T16:15:39.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:39.536+0000 7f5038157700 1 -- 172.21.15.152:0/2038696968 wait complete. 2023-12-07T16:15:39.536 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2023-12-07T16:15:40.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:40 smithi063 ceph-mon[112095]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:15:40.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:40 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:40.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:40 smithi063 ceph-mon[112095]: from='client.? 172.21.15.152:0/2038696968' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:15:40.924 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-07T16:15:40.925 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-07T16:15:41.215 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:15:41.285 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:15:42.322 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:42 smithi063 ceph-mon[112095]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:15:42.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.333+0000 7f056d23d700 1 -- 172.21.15.152:0/3783902033 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05680fb780 msgr2=0x7f05680fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:42.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.333+0000 7f056d23d700 1 --2- 172.21.15.152:0/3783902033 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05680fb780 0x7f05680fbb90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f05580048c0 tx=0x7f0558009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:42.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.333+0000 7f056d23d700 1 -- 172.21.15.152:0/3783902033 shutdown_connections 2023-12-07T16:15:42.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.333+0000 7f056d23d700 1 --2- 172.21.15.152:0/3783902033 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05680fb780 0x7f05680fbb90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:42.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.333+0000 7f056d23d700 1 -- 172.21.15.152:0/3783902033 >> 172.21.15.152:0/3783902033 conn(0x7f05680f6e40 msgr2=0x7f05680f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:42.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.333+0000 7f056d23d700 1 -- 172.21.15.152:0/3783902033 shutdown_connections 2023-12-07T16:15:42.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.333+0000 7f056d23d700 1 -- 172.21.15.152:0/3783902033 wait complete. 2023-12-07T16:15:42.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.334+0000 7f056d23d700 1 Processor -- start 2023-12-07T16:15:42.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.334+0000 7f056d23d700 1 -- start start 2023-12-07T16:15:42.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.334+0000 7f056d23d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05680fb780 0x7f056810ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:42.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.334+0000 7f056d23d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056810f280 con 0x7f05680fb780 2023-12-07T16:15:42.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.334+0000 7f0566d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05680fb780 0x7f056810ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:42.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.334+0000 7f0566d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05680fb780 0x7f056810ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.152:57420/0 (socket says 172.21.15.152:57420) 2023-12-07T16:15:42.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.334+0000 7f0566d9d700 1 -- 172.21.15.152:0/999280879 learned_addr learned my addr 172.21.15.152:0/999280879 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-07T16:15:42.334 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.335+0000 7f0566d9d700 1 -- 172.21.15.152:0/999280879 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0558005040 con 0x7f05680fb780 2023-12-07T16:15:42.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.335+0000 7f0566d9d700 1 --2- 172.21.15.152:0/999280879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05680fb780 0x7f056810ed40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0558009330 tx=0x7f0558009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:42.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.335+0000 7f054f7fe700 1 -- 172.21.15.152:0/999280879 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05580096b0 con 0x7f05680fb780 2023-12-07T16:15:42.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.335+0000 7f056d23d700 1 -- 172.21.15.152:0/999280879 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056810f480 con 0x7f05680fb780 2023-12-07T16:15:42.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.335+0000 7f054f7fe700 1 -- 172.21.15.152:0/999280879 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0558009810 con 0x7f05680fb780 2023-12-07T16:15:42.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.335+0000 7f054f7fe700 1 -- 172.21.15.152:0/999280879 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f055801c5b0 con 0x7f05680fb780 2023-12-07T16:15:42.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.335+0000 7f056d23d700 1 -- 172.21.15.152:0/999280879 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056810ffe0 con 0x7f05680fb780 2023-12-07T16:15:42.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.336+0000 7f054f7fe700 1 -- 172.21.15.152:0/999280879 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f0558013420 con 0x7f05680fb780 2023-12-07T16:15:42.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.336+0000 7f056d23d700 1 -- 172.21.15.152:0/999280879 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056804bb80 con 0x7f05680fb780 2023-12-07T16:15:42.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.336+0000 7f054f7fe700 1 --2- 172.21.15.152:0/999280879 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f05500366d0 0x7f0550038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:42.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.336+0000 7f054f7fe700 1 -- 172.21.15.152:0/999280879 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0558049a10 con 0x7f05680fb780 2023-12-07T16:15:42.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.336+0000 7f056659c700 1 --2- 172.21.15.152:0/999280879 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f05500366d0 0x7f0550038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:42.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.337+0000 7f056659c700 1 --2- 172.21.15.152:0/999280879 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f05500366d0 0x7f0550038b80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f055c009990 tx=0x7f055c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:42.340 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.342+0000 7f054f7fe700 1 -- 172.21.15.152:0/999280879 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f05580119c0 con 0x7f05680fb780 2023-12-07T16:15:42.592 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.594+0000 7f056d23d700 1 -- 172.21.15.152:0/999280879 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0568110e60 con 0x7f05680fb780 2023-12-07T16:15:42.593 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.595+0000 7f054f7fe700 1 -- 172.21.15.152:0/999280879 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f0558011370 con 0x7f05680fb780 2023-12-07T16:15:42.593 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:15:42.593 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"8c493298-951b-11ee-95a2-87774f69a715","modified":"2023-12-07T16:14:01.402276Z","created":"2023-12-07T16:14:01.402276Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-07T16:15:42.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.596+0000 7f056d23d700 1 -- 172.21.15.152:0/999280879 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f05500366d0 msgr2=0x7f0550038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:42.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.596+0000 7f056d23d700 1 --2- 172.21.15.152:0/999280879 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f05500366d0 0x7f0550038b80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f055c009990 tx=0x7f055c006e40 comp rx=0 tx=0).stop 2023-12-07T16:15:42.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.596+0000 7f056d23d700 1 -- 172.21.15.152:0/999280879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05680fb780 msgr2=0x7f056810ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:42.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.596+0000 7f056d23d700 1 --2- 172.21.15.152:0/999280879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05680fb780 0x7f056810ed40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0558009330 tx=0x7f0558009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:42.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.597+0000 7f056d23d700 1 -- 172.21.15.152:0/999280879 shutdown_connections 2023-12-07T16:15:42.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.597+0000 7f056d23d700 1 --2- 172.21.15.152:0/999280879 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f05500366d0 0x7f0550038b80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:42.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.597+0000 7f056d23d700 1 --2- 172.21.15.152:0/999280879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05680fb780 0x7f056810ed40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:42.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.597+0000 7f056d23d700 1 -- 172.21.15.152:0/999280879 >> 172.21.15.152:0/999280879 conn(0x7f05680f6e40 msgr2=0x7f0568065690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:42.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.597+0000 7f056d23d700 1 -- 172.21.15.152:0/999280879 shutdown_connections 2023-12-07T16:15:42.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:42.597+0000 7f056d23d700 1 -- 172.21.15.152:0/999280879 wait complete. 2023-12-07T16:15:42.596 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2023-12-07T16:15:43.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:43 smithi063 ceph-mon[112095]: from='client.? 172.21.15.152:0/999280879' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:15:43.987 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-07T16:15:43.987 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-07T16:15:44.279 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:15:44.337 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:15:44.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:44 smithi063 ceph-mon[112095]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:15:45.329 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.329+0000 7f6ee978c700 1 -- 172.21.15.152:0/1289258721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee40fded0 msgr2=0x7f6ee40fe2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:45.329 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.329+0000 7f6ee978c700 1 --2- 172.21.15.152:0/1289258721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee40fded0 0x7f6ee40fe2e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6ed80048c0 tx=0x7f6ed8009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:45.329 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.329+0000 7f6ee978c700 1 -- 172.21.15.152:0/1289258721 shutdown_connections 2023-12-07T16:15:45.329 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.329+0000 7f6ee978c700 1 --2- 172.21.15.152:0/1289258721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee40fded0 0x7f6ee40fe2e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:45.329 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.329+0000 7f6ee978c700 1 -- 172.21.15.152:0/1289258721 >> 172.21.15.152:0/1289258721 conn(0x7f6ee40f65d0 msgr2=0x7f6ee40f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:45.329 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.329+0000 7f6ee978c700 1 -- 172.21.15.152:0/1289258721 shutdown_connections 2023-12-07T16:15:45.329 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.329+0000 7f6ee978c700 1 -- 172.21.15.152:0/1289258721 wait complete. 2023-12-07T16:15:45.329 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.329+0000 7f6ee978c700 1 Processor -- start 2023-12-07T16:15:45.329 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.329+0000 7f6ee978c700 1 -- start start 2023-12-07T16:15:45.329 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.330+0000 7f6ee978c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee40fded0 0x7f6ee410caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:45.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.330+0000 7f6ee978c700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee410d030 con 0x7f6ee40fded0 2023-12-07T16:15:45.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.330+0000 7f6ee2ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee40fded0 0x7f6ee410caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:45.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.330+0000 7f6ee2ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee40fded0 0x7f6ee410caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.152:52434/0 (socket says 172.21.15.152:52434) 2023-12-07T16:15:45.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.330+0000 7f6ee2ffd700 1 -- 172.21.15.152:0/1637994894 learned_addr learned my addr 172.21.15.152:0/1637994894 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-07T16:15:45.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.330+0000 7f6ee2ffd700 1 -- 172.21.15.152:0/1637994894 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed8005040 con 0x7f6ee40fded0 2023-12-07T16:15:45.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.330+0000 7f6ee2ffd700 1 --2- 172.21.15.152:0/1637994894 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee40fded0 0x7f6ee410caf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8009330 tx=0x7f6ed8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:45.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.330+0000 7f6ecb7fe700 1 -- 172.21.15.152:0/1637994894 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ed80096b0 con 0x7f6ee40fded0 2023-12-07T16:15:45.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.331+0000 7f6ee978c700 1 -- 172.21.15.152:0/1637994894 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee410d230 con 0x7f6ee40fded0 2023-12-07T16:15:45.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.331+0000 7f6ecb7fe700 1 -- 172.21.15.152:0/1637994894 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ed8009810 con 0x7f6ee40fded0 2023-12-07T16:15:45.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.331+0000 7f6ecb7fe700 1 -- 172.21.15.152:0/1637994894 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ed801c5b0 con 0x7f6ee40fded0 2023-12-07T16:15:45.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.331+0000 7f6ee978c700 1 -- 172.21.15.152:0/1637994894 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee410ded0 con 0x7f6ee40fded0 2023-12-07T16:15:45.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.331+0000 7f6ee978c700 1 -- 172.21.15.152:0/1637994894 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee405f270 con 0x7f6ee40fded0 2023-12-07T16:15:45.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.331+0000 7f6ecb7fe700 1 -- 172.21.15.152:0/1637994894 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f6ed8013420 con 0x7f6ee40fded0 2023-12-07T16:15:45.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.332+0000 7f6ecb7fe700 1 --2- 172.21.15.152:0/1637994894 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f6ecc0366d0 0x7f6ecc038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:45.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.332+0000 7f6ecb7fe700 1 -- 172.21.15.152:0/1637994894 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6ed8049ad0 con 0x7f6ee40fded0 2023-12-07T16:15:45.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.332+0000 7f6ee27fc700 1 --2- 172.21.15.152:0/1637994894 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f6ecc0366d0 0x7f6ecc038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:45.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.332+0000 7f6ee27fc700 1 --2- 172.21.15.152:0/1637994894 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f6ecc0366d0 0x7f6ecc038b80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4009990 tx=0x7f6ed4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:45.335 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.337+0000 7f6ecb7fe700 1 -- 172.21.15.152:0/1637994894 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6ed80119c0 con 0x7f6ee40fded0 2023-12-07T16:15:45.586 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.588+0000 7f6ee978c700 1 -- 172.21.15.152:0/1637994894 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6ee410ea20 con 0x7f6ee40fded0 2023-12-07T16:15:45.587 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.589+0000 7f6ecb7fe700 1 -- 172.21.15.152:0/1637994894 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f6ed8011370 con 0x7f6ee40fded0 2023-12-07T16:15:45.587 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:15:45.587 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"8c493298-951b-11ee-95a2-87774f69a715","modified":"2023-12-07T16:14:01.402276Z","created":"2023-12-07T16:14:01.402276Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-07T16:15:45.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.592+0000 7f6ee978c700 1 -- 172.21.15.152:0/1637994894 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f6ecc0366d0 msgr2=0x7f6ecc038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:45.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.592+0000 7f6ee978c700 1 --2- 172.21.15.152:0/1637994894 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f6ecc0366d0 0x7f6ecc038b80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4009990 tx=0x7f6ed4006e40 comp rx=0 tx=0).stop 2023-12-07T16:15:45.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.592+0000 7f6ee978c700 1 -- 172.21.15.152:0/1637994894 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee40fded0 msgr2=0x7f6ee410caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:45.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.592+0000 7f6ee978c700 1 --2- 172.21.15.152:0/1637994894 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee40fded0 0x7f6ee410caf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8009330 tx=0x7f6ed8009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:45.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.592+0000 7f6ee978c700 1 -- 172.21.15.152:0/1637994894 shutdown_connections 2023-12-07T16:15:45.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.592+0000 7f6ee978c700 1 --2- 172.21.15.152:0/1637994894 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f6ecc0366d0 0x7f6ecc038b80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:45.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.592+0000 7f6ee978c700 1 --2- 172.21.15.152:0/1637994894 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee40fded0 0x7f6ee410caf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:45.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.592+0000 7f6ee978c700 1 -- 172.21.15.152:0/1637994894 >> 172.21.15.152:0/1637994894 conn(0x7f6ee40f65d0 msgr2=0x7f6ee40f7370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:45.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.592+0000 7f6ee978c700 1 -- 172.21.15.152:0/1637994894 shutdown_connections 2023-12-07T16:15:45.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:45.592+0000 7f6ee978c700 1 -- 172.21.15.152:0/1637994894 wait complete. 2023-12-07T16:15:45.591 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2023-12-07T16:15:46.455 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:46 smithi063 ceph-mon[112095]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:15:46.456 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:46 smithi063 ceph-mon[112095]: from='client.? 172.21.15.152:0/1637994894' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:15:46.978 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-07T16:15:46.978 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-07T16:15:47.273 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:15:47.333 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:15:48.413 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.413+0000 7f8054f34700 1 -- 172.21.15.152:0/1281755620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80500fb700 msgr2=0x7f80500fbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:48.414 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.413+0000 7f8054f34700 1 --2- 172.21.15.152:0/1281755620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80500fb700 0x7f80500fbb10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f80440048c0 tx=0x7f8044009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:48.414 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.413+0000 7f8054f34700 1 -- 172.21.15.152:0/1281755620 shutdown_connections 2023-12-07T16:15:48.414 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.413+0000 7f8054f34700 1 --2- 172.21.15.152:0/1281755620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80500fb700 0x7f80500fbb10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:48.414 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.413+0000 7f8054f34700 1 -- 172.21.15.152:0/1281755620 >> 172.21.15.152:0/1281755620 conn(0x7f80500f6e80 msgr2=0x7f80500f9290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:48.414 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.413+0000 7f8054f34700 1 -- 172.21.15.152:0/1281755620 shutdown_connections 2023-12-07T16:15:48.414 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.413+0000 7f8054f34700 1 -- 172.21.15.152:0/1281755620 wait complete. 2023-12-07T16:15:48.414 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.414+0000 7f8054f34700 1 Processor -- start 2023-12-07T16:15:48.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.414+0000 7f8054f34700 1 -- start start 2023-12-07T16:15:48.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.414+0000 7f8054f34700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80500fb700 0x7f805010f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:48.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.414+0000 7f8054f34700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8050065a10 con 0x7f80500fb700 2023-12-07T16:15:48.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.414+0000 7f804e59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80500fb700 0x7f805010f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:48.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.414+0000 7f804e59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80500fb700 0x7f805010f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.152:52456/0 (socket says 172.21.15.152:52456) 2023-12-07T16:15:48.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.414+0000 7f804e59c700 1 -- 172.21.15.152:0/1389250273 learned_addr learned my addr 172.21.15.152:0/1389250273 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-07T16:15:48.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.414+0000 7f804e59c700 1 -- 172.21.15.152:0/1389250273 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8044005040 con 0x7f80500fb700 2023-12-07T16:15:48.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.415+0000 7f804e59c700 1 --2- 172.21.15.152:0/1389250273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80500fb700 0x7f805010f740 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8044009040 tx=0x7f8044009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:48.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.415+0000 7f803effd700 1 -- 172.21.15.152:0/1389250273 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8044009620 con 0x7f80500fb700 2023-12-07T16:15:48.415 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.415+0000 7f803effd700 1 -- 172.21.15.152:0/1389250273 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8044009780 con 0x7f80500fb700 2023-12-07T16:15:48.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.415+0000 7f8054f34700 1 -- 172.21.15.152:0/1389250273 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8050065c10 con 0x7f80500fb700 2023-12-07T16:15:48.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.415+0000 7f803effd700 1 -- 172.21.15.152:0/1389250273 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f804401c5b0 con 0x7f80500fb700 2023-12-07T16:15:48.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.415+0000 7f8054f34700 1 -- 172.21.15.152:0/1389250273 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f805010fec0 con 0x7f80500fb700 2023-12-07T16:15:48.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.416+0000 7f803effd700 1 -- 172.21.15.152:0/1389250273 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f8044013a60 con 0x7f80500fb700 2023-12-07T16:15:48.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.416+0000 7f8054f34700 1 -- 172.21.15.152:0/1389250273 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8050105310 con 0x7f80500fb700 2023-12-07T16:15:48.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.416+0000 7f803effd700 1 --2- 172.21.15.152:0/1389250273 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f80380366e0 0x7f8038038b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:48.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.416+0000 7f803effd700 1 -- 172.21.15.152:0/1389250273 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8044049960 con 0x7f80500fb700 2023-12-07T16:15:48.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.416+0000 7f804dd9b700 1 --2- 172.21.15.152:0/1389250273 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f80380366e0 0x7f8038038b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:48.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.417+0000 7f804dd9b700 1 --2- 172.21.15.152:0/1389250273 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f80380366e0 0x7f8038038b90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8040009990 tx=0x7f8040006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:48.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.421+0000 7f803effd700 1 -- 172.21.15.152:0/1389250273 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8044025400 con 0x7f80500fb700 2023-12-07T16:15:48.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.490+0000 7f803effd700 1 -- 172.21.15.152:0/1389250273 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7f8044025780 con 0x7f80500fb700 2023-12-07T16:15:48.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.511+0000 7f804dd9b700 1 -- 172.21.15.152:0/1389250273 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f80380366e0 msgr2=0x7f8038038b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-12-07T16:15:48.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.511+0000 7f804dd9b700 1 -- 172.21.15.152:0/1389250273 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f80380366e0 msgr2=0x7f8038038b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-07T16:15:48.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.511+0000 7f804dd9b700 1 --2- 172.21.15.152:0/1389250273 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f80380366e0 0x7f8038038b90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8040009990 tx=0x7f8040006e40 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-07T16:15:48.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.511+0000 7f804dd9b700 1 --2- 172.21.15.152:0/1389250273 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f80380366e0 0x7f8038038b90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8040009990 tx=0x7f8040006e40 comp rx=0 tx=0).stop 2023-12-07T16:15:48.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.513+0000 7f803effd700 1 -- 172.21.15.152:0/1389250273 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f80380366e0 msgr2=0x7f8038038b90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-12-07T16:15:48.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.513+0000 7f803effd700 1 --2- 172.21.15.152:0/1389250273 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f80380366e0 0x7f8038038b90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:48.512 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:48 smithi063 ceph-mon[112095]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:15:48.512 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:48 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:48.513 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:48 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:48.513 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:48 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:48.513 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:48 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-07T16:15:48.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.694+0000 7f8054f34700 1 -- 172.21.15.152:0/1389250273 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8034005160 con 0x7f80500fb700 2023-12-07T16:15:48.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.694+0000 7f803effd700 1 -- 172.21.15.152:0/1389250273 <== mon.0 v2:172.21.15.63:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f8044012a70 con 0x7f80500fb700 2023-12-07T16:15:48.694 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:15:48.694 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"8c493298-951b-11ee-95a2-87774f69a715","modified":"2023-12-07T16:14:01.402276Z","created":"2023-12-07T16:14:01.402276Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-07T16:15:48.695 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.696+0000 7f8054f34700 1 -- 172.21.15.152:0/1389250273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80500fb700 msgr2=0x7f805010f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:48.695 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.696+0000 7f8054f34700 1 --2- 172.21.15.152:0/1389250273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80500fb700 0x7f805010f740 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8044009040 tx=0x7f8044009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:48.695 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.696+0000 7f8054f34700 1 -- 172.21.15.152:0/1389250273 shutdown_connections 2023-12-07T16:15:48.695 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.696+0000 7f8054f34700 1 --2- 172.21.15.152:0/1389250273 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f80380366e0 0x7f8038038b90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:48.695 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.696+0000 7f8054f34700 1 --2- 172.21.15.152:0/1389250273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80500fb700 0x7f805010f740 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:48.695 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.696+0000 7f8054f34700 1 -- 172.21.15.152:0/1389250273 >> 172.21.15.152:0/1389250273 conn(0x7f80500f6e80 msgr2=0x7f80500f7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:48.696 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.696+0000 7f8054f34700 1 -- 172.21.15.152:0/1389250273 shutdown_connections 2023-12-07T16:15:48.696 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:48.696+0000 7f8054f34700 1 -- 172.21.15.152:0/1389250273 wait complete. 2023-12-07T16:15:48.696 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2023-12-07T16:15:49.850 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:49 smithi063 ceph-mon[112095]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-07T16:15:49.850 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:49 smithi063 ceph-mon[112095]: mgrmap e14: smithi063.yohyyx(active, since 49s) 2023-12-07T16:15:49.850 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:49 smithi063 ceph-mon[112095]: from='client.? 172.21.15.152:0/1389250273' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:15:50.084 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-07T16:15:50.084 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-07T16:15:50.376 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:15:50.436 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:15:51.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.403+0000 7f07f0bd3700 1 -- 172.21.15.152:0/592594372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07ec0faef0 msgr2=0x7f07ec0fb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:51.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.403+0000 7f07f0bd3700 1 --2- 172.21.15.152:0/592594372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07ec0faef0 0x7f07ec0fb300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f07e00048c0 tx=0x7f07e0009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:51.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.403+0000 7f07f0bd3700 1 -- 172.21.15.152:0/592594372 shutdown_connections 2023-12-07T16:15:51.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.403+0000 7f07f0bd3700 1 --2- 172.21.15.152:0/592594372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07ec0faef0 0x7f07ec0fb300 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:51.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.403+0000 7f07f0bd3700 1 -- 172.21.15.152:0/592594372 >> 172.21.15.152:0/592594372 conn(0x7f07ec0f65d0 msgr2=0x7f07ec0f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:51.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.403+0000 7f07f0bd3700 1 -- 172.21.15.152:0/592594372 shutdown_connections 2023-12-07T16:15:51.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.403+0000 7f07f0bd3700 1 -- 172.21.15.152:0/592594372 wait complete. 2023-12-07T16:15:51.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.404+0000 7f07f0bd3700 1 Processor -- start 2023-12-07T16:15:51.406 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.404+0000 7f07f0bd3700 1 -- start start 2023-12-07T16:15:51.406 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.404+0000 7f07f0bd3700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07ec0faef0 0x7f07ec10caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:51.406 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.404+0000 7f07f0bd3700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec10d030 con 0x7f07ec0faef0 2023-12-07T16:15:51.406 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.404+0000 7f07ea59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07ec0faef0 0x7f07ec10caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:51.406 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.404+0000 7f07ea59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07ec0faef0 0x7f07ec10caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.152:52470/0 (socket says 172.21.15.152:52470) 2023-12-07T16:15:51.406 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.404+0000 7f07ea59c700 1 -- 172.21.15.152:0/1734197991 learned_addr learned my addr 172.21.15.152:0/1734197991 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-07T16:15:51.406 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.404+0000 7f07ea59c700 1 -- 172.21.15.152:0/1734197991 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e0005040 con 0x7f07ec0faef0 2023-12-07T16:15:51.406 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.405+0000 7f07ea59c700 1 --2- 172.21.15.152:0/1734197991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07ec0faef0 0x7f07ec10caf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f07e000b690 tx=0x7f07e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:51.406 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.405+0000 7f07daffd700 1 -- 172.21.15.152:0/1734197991 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f07e0009650 con 0x7f07ec0faef0 2023-12-07T16:15:51.406 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.405+0000 7f07f0bd3700 1 -- 172.21.15.152:0/1734197991 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07ec10d230 con 0x7f07ec0faef0 2023-12-07T16:15:51.406 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.405+0000 7f07daffd700 1 -- 172.21.15.152:0/1734197991 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f07e00097b0 con 0x7f07ec0faef0 2023-12-07T16:15:51.407 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.405+0000 7f07daffd700 1 -- 172.21.15.152:0/1734197991 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f07e001c5b0 con 0x7f07ec0faef0 2023-12-07T16:15:51.407 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.405+0000 7f07f0bd3700 1 -- 172.21.15.152:0/1734197991 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07ec10ded0 con 0x7f07ec0faef0 2023-12-07T16:15:51.407 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.406+0000 7f07daffd700 1 -- 172.21.15.152:0/1734197991 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7f07e001c870 con 0x7f07ec0faef0 2023-12-07T16:15:51.407 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.406+0000 7f07f0bd3700 1 -- 172.21.15.152:0/1734197991 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07ec05f270 con 0x7f07ec0faef0 2023-12-07T16:15:51.407 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.406+0000 7f07daffd700 1 --2- 172.21.15.152:0/1734197991 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f07d4036720 0x7f07d4038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:51.407 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.406+0000 7f07daffd700 1 -- 172.21.15.152:0/1734197991 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f07e00499a0 con 0x7f07ec0faef0 2023-12-07T16:15:51.407 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.406+0000 7f07e9d9b700 1 -- 172.21.15.152:0/1734197991 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f07d4036720 msgr2=0x7f07d4038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/4069965417 2023-12-07T16:15:51.407 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.406+0000 7f07e9d9b700 1 --2- 172.21.15.152:0/1734197991 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f07d4036720 0x7f07d4038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-07T16:15:51.409 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.411+0000 7f07daffd700 1 -- 172.21.15.152:0/1734197991 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f07e0011550 con 0x7f07ec0faef0 2023-12-07T16:15:51.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.607+0000 7f07e9d9b700 1 -- 172.21.15.152:0/1734197991 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f07d4036720 msgr2=0x7f07d4038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/4069965417 2023-12-07T16:15:51.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.607+0000 7f07e9d9b700 1 --2- 172.21.15.152:0/1734197991 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f07d4036720 0x7f07d4038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-07T16:15:51.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.664+0000 7f07f0bd3700 1 -- 172.21.15.152:0/1734197991 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f07ec04bb80 con 0x7f07ec0faef0 2023-12-07T16:15:51.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.665+0000 7f07daffd700 1 -- 172.21.15.152:0/1734197991 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f07e0011370 con 0x7f07ec0faef0 2023-12-07T16:15:51.663 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:15:51.663 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"8c493298-951b-11ee-95a2-87774f69a715","modified":"2023-12-07T16:14:01.402276Z","created":"2023-12-07T16:14:01.402276Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-07T16:15:51.665 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.667+0000 7f07f0bd3700 1 -- 172.21.15.152:0/1734197991 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f07d4036720 msgr2=0x7f07d4038bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-07T16:15:51.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.667+0000 7f07f0bd3700 1 --2- 172.21.15.152:0/1734197991 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f07d4036720 0x7f07d4038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:51.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.667+0000 7f07f0bd3700 1 -- 172.21.15.152:0/1734197991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07ec0faef0 msgr2=0x7f07ec10caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:51.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.667+0000 7f07f0bd3700 1 --2- 172.21.15.152:0/1734197991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07ec0faef0 0x7f07ec10caf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f07e000b690 tx=0x7f07e0009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:51.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.667+0000 7f07f0bd3700 1 -- 172.21.15.152:0/1734197991 shutdown_connections 2023-12-07T16:15:51.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.667+0000 7f07f0bd3700 1 --2- 172.21.15.152:0/1734197991 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f07d4036720 0x7f07d4038bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:51.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.667+0000 7f07f0bd3700 1 --2- 172.21.15.152:0/1734197991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07ec0faef0 0x7f07ec10caf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:51.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.667+0000 7f07f0bd3700 1 -- 172.21.15.152:0/1734197991 >> 172.21.15.152:0/1734197991 conn(0x7f07ec0f65d0 msgr2=0x7f07ec103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:51.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.667+0000 7f07f0bd3700 1 -- 172.21.15.152:0/1734197991 shutdown_connections 2023-12-07T16:15:51.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:51.667+0000 7f07f0bd3700 1 -- 172.21.15.152:0/1734197991 wait complete. 2023-12-07T16:15:51.666 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2023-12-07T16:15:52.032 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:51 smithi063 ceph-mon[112095]: from='client.? 172.21.15.152:0/1734197991' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:15:53.051 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-07T16:15:53.052 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-07T16:15:53.345 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:15:53.402 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:15:54.380 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.380+0000 7f67d1335700 1 -- 172.21.15.152:0/2573992886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67cc0fb770 msgr2=0x7f67cc0fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:54.381 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.380+0000 7f67d1335700 1 --2- 172.21.15.152:0/2573992886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67cc0fb770 0x7f67cc0fbb80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f67bc0048c0 tx=0x7f67bc009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:54.381 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.380+0000 7f67d1335700 1 -- 172.21.15.152:0/2573992886 shutdown_connections 2023-12-07T16:15:54.381 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.380+0000 7f67d1335700 1 --2- 172.21.15.152:0/2573992886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67cc0fb770 0x7f67cc0fbb80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:54.381 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.380+0000 7f67d1335700 1 -- 172.21.15.152:0/2573992886 >> 172.21.15.152:0/2573992886 conn(0x7f67cc0f6e50 msgr2=0x7f67cc0f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:54.381 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.380+0000 7f67d1335700 1 -- 172.21.15.152:0/2573992886 shutdown_connections 2023-12-07T16:15:54.381 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.380+0000 7f67d1335700 1 -- 172.21.15.152:0/2573992886 wait complete. 2023-12-07T16:15:54.381 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.381+0000 7f67d1335700 1 Processor -- start 2023-12-07T16:15:54.381 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.381+0000 7f67d1335700 1 -- start start 2023-12-07T16:15:54.381 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.381+0000 7f67d1335700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67cc0fb770 0x7f67cc10f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:54.381 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.381+0000 7f67d1335700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67cc066500 con 0x7f67cc0fb770 2023-12-07T16:15:54.381 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.381+0000 7f67caffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67cc0fb770 0x7f67cc10f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:54.381 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.381+0000 7f67caffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67cc0fb770 0x7f67cc10f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.152:54276/0 (socket says 172.21.15.152:54276) 2023-12-07T16:15:54.381 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.381+0000 7f67caffd700 1 -- 172.21.15.152:0/1146875028 learned_addr learned my addr 172.21.15.152:0/1146875028 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-07T16:15:54.381 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.382+0000 7f67caffd700 1 -- 172.21.15.152:0/1146875028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67bc005040 con 0x7f67cc0fb770 2023-12-07T16:15:54.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.382+0000 7f67caffd700 1 --2- 172.21.15.152:0/1146875028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67cc0fb770 0x7f67cc10f7b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f67bc009330 tx=0x7f67bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:54.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.382+0000 7f67b37fe700 1 -- 172.21.15.152:0/1146875028 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f67bc0096b0 con 0x7f67cc0fb770 2023-12-07T16:15:54.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.382+0000 7f67b37fe700 1 -- 172.21.15.152:0/1146875028 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f67bc009810 con 0x7f67cc0fb770 2023-12-07T16:15:54.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.382+0000 7f67b37fe700 1 -- 172.21.15.152:0/1146875028 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f67bc01c5b0 con 0x7f67cc0fb770 2023-12-07T16:15:54.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.382+0000 7f67d1335700 1 -- 172.21.15.152:0/1146875028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67cc066700 con 0x7f67cc0fb770 2023-12-07T16:15:54.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.382+0000 7f67d1335700 1 -- 172.21.15.152:0/1146875028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67cc10ff30 con 0x7f67cc0fb770 2023-12-07T16:15:54.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.383+0000 7f67b37fe700 1 -- 172.21.15.152:0/1146875028 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7f67bc013420 con 0x7f67cc0fb770 2023-12-07T16:15:54.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.383+0000 7f67d1335700 1 -- 172.21.15.152:0/1146875028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67cc105400 con 0x7f67cc0fb770 2023-12-07T16:15:54.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.383+0000 7f67b37fe700 1 --2- 172.21.15.152:0/1146875028 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f67b4036720 0x7f67b4038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:54.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.383+0000 7f67b37fe700 1 -- 172.21.15.152:0/1146875028 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f67bc049b60 con 0x7f67cc0fb770 2023-12-07T16:15:54.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.383+0000 7f67ca7fc700 1 -- 172.21.15.152:0/1146875028 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f67b4036720 msgr2=0x7f67b4038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/4069965417 2023-12-07T16:15:54.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.383+0000 7f67ca7fc700 1 --2- 172.21.15.152:0/1146875028 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f67b4036720 0x7f67b4038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-07T16:15:54.390 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.392+0000 7f67b37fe700 1 -- 172.21.15.152:0/1146875028 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f67bc0119c0 con 0x7f67cc0fb770 2023-12-07T16:15:54.582 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.584+0000 7f67ca7fc700 1 -- 172.21.15.152:0/1146875028 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f67b4036720 msgr2=0x7f67b4038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/4069965417 2023-12-07T16:15:54.582 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.584+0000 7f67ca7fc700 1 --2- 172.21.15.152:0/1146875028 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f67b4036720 0x7f67b4038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-07T16:15:54.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.645+0000 7f67d1335700 1 -- 172.21.15.152:0/1146875028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f67cc1013f0 con 0x7f67cc0fb770 2023-12-07T16:15:54.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.646+0000 7f67b37fe700 1 -- 172.21.15.152:0/1146875028 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f67bc011370 con 0x7f67cc0fb770 2023-12-07T16:15:54.644 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:15:54.644 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"8c493298-951b-11ee-95a2-87774f69a715","modified":"2023-12-07T16:14:01.402276Z","created":"2023-12-07T16:14:01.402276Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-07T16:15:54.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.648+0000 7f67d1335700 1 -- 172.21.15.152:0/1146875028 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f67b4036720 msgr2=0x7f67b4038bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-07T16:15:54.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.648+0000 7f67d1335700 1 --2- 172.21.15.152:0/1146875028 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f67b4036720 0x7f67b4038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:54.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.648+0000 7f67d1335700 1 -- 172.21.15.152:0/1146875028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67cc0fb770 msgr2=0x7f67cc10f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:54.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.648+0000 7f67d1335700 1 --2- 172.21.15.152:0/1146875028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67cc0fb770 0x7f67cc10f7b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f67bc009330 tx=0x7f67bc009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:54.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.648+0000 7f67d1335700 1 -- 172.21.15.152:0/1146875028 shutdown_connections 2023-12-07T16:15:54.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.648+0000 7f67d1335700 1 --2- 172.21.15.152:0/1146875028 >> [v2:172.21.15.63:6800/4069965417,v1:172.21.15.63:6801/4069965417] conn(0x7f67b4036720 0x7f67b4038bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:54.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.648+0000 7f67d1335700 1 --2- 172.21.15.152:0/1146875028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67cc0fb770 0x7f67cc10f7b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:54.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.648+0000 7f67d1335700 1 -- 172.21.15.152:0/1146875028 >> 172.21.15.152:0/1146875028 conn(0x7f67cc0f6e50 msgr2=0x7f67cc0f7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:54.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.648+0000 7f67d1335700 1 -- 172.21.15.152:0/1146875028 shutdown_connections 2023-12-07T16:15:54.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:54.648+0000 7f67d1335700 1 -- 172.21.15.152:0/1146875028 wait complete. 2023-12-07T16:15:54.647 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2023-12-07T16:15:55.105 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:54 smithi063 ceph-mon[112095]: from='client.? 172.21.15.152:0/1146875028' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:15:56.038 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-07T16:15:56.038 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-07T16:15:56.145 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:55 smithi063 ceph-mon[112095]: Active manager daemon smithi063.yohyyx restarted 2023-12-07T16:15:56.145 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:55 smithi063 ceph-mon[112095]: Activating manager daemon smithi063.yohyyx 2023-12-07T16:15:56.146 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:55 smithi063 ceph-mon[112095]: osdmap e5: 0 total, 0 up, 0 in 2023-12-07T16:15:56.146 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:55 smithi063 ceph-mon[112095]: mgrmap e15: smithi063.yohyyx(active, starting, since 0.00329679s) 2023-12-07T16:15:56.146 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:55 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-07T16:15:56.146 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:55 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr metadata", "who": "smithi063.yohyyx", "id": "smithi063.yohyyx"}]: dispatch 2023-12-07T16:15:56.146 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:55 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-07T16:15:56.146 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:55 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-07T16:15:56.146 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:55 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-07T16:15:56.146 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:55 smithi063 ceph-mon[112095]: Manager daemon smithi063.yohyyx is now available 2023-12-07T16:15:56.146 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:55 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:15:56.146 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:55 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:15:56.146 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:55 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:56.146 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:55 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:15:56.146 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:55 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.yohyyx/mirror_snapshot_schedule"}]: dispatch 2023-12-07T16:15:56.147 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:55 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.yohyyx/trash_purge_schedule"}]: dispatch 2023-12-07T16:15:56.341 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:15:56.405 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:15:56.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:56 smithi063 ceph-mon[112095]: [07/Dec/2023:16:15:55] ENGINE Bus STARTING 2023-12-07T16:15:56.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:56 smithi063 ceph-mon[112095]: [07/Dec/2023:16:15:55] ENGINE Serving on https://172.21.15.63:7150 2023-12-07T16:15:56.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:56 smithi063 ceph-mon[112095]: [07/Dec/2023:16:15:55] ENGINE Bus STARTED 2023-12-07T16:15:56.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:56 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:56.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:56 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:56.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:56 smithi063 ceph-mon[112095]: mgrmap e16: smithi063.yohyyx(active, since 1.00586s) 2023-12-07T16:15:56.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:56 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:57.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.435+0000 7f29d11a5700 1 -- 172.21.15.152:0/4026381575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29cc0fb780 msgr2=0x7f29cc0fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:57.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.435+0000 7f29d11a5700 1 --2- 172.21.15.152:0/4026381575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29cc0fb780 0x7f29cc0fbb90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f29b40048c0 tx=0x7f29b4009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:57.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.435+0000 7f29d11a5700 1 -- 172.21.15.152:0/4026381575 shutdown_connections 2023-12-07T16:15:57.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.435+0000 7f29d11a5700 1 --2- 172.21.15.152:0/4026381575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29cc0fb780 0x7f29cc0fbb90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:57.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.435+0000 7f29d11a5700 1 -- 172.21.15.152:0/4026381575 >> 172.21.15.152:0/4026381575 conn(0x7f29cc0f6e40 msgr2=0x7f29cc0f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:57.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.435+0000 7f29d11a5700 1 -- 172.21.15.152:0/4026381575 shutdown_connections 2023-12-07T16:15:57.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.435+0000 7f29d11a5700 1 -- 172.21.15.152:0/4026381575 wait complete. 2023-12-07T16:15:57.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.436+0000 7f29d11a5700 1 Processor -- start 2023-12-07T16:15:57.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.436+0000 7f29d11a5700 1 -- start start 2023-12-07T16:15:57.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.436+0000 7f29d11a5700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29cc0fb780 0x7f29cc10f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:57.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.436+0000 7f29d11a5700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc065a30 con 0x7f29cc0fb780 2023-12-07T16:15:57.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.437+0000 7f29cad9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29cc0fb780 0x7f29cc10f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:57.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.437+0000 7f29cad9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29cc0fb780 0x7f29cc10f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.152:54290/0 (socket says 172.21.15.152:54290) 2023-12-07T16:15:57.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.437+0000 7f29cad9d700 1 -- 172.21.15.152:0/749342690 learned_addr learned my addr 172.21.15.152:0/749342690 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-07T16:15:57.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.437+0000 7f29cad9d700 1 -- 172.21.15.152:0/749342690 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b4005040 con 0x7f29cc0fb780 2023-12-07T16:15:57.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.437+0000 7f29cad9d700 1 --2- 172.21.15.152:0/749342690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29cc0fb780 0x7f29cc10f7a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009330 tx=0x7f29b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:57.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.437+0000 7f29c37fe700 1 -- 172.21.15.152:0/749342690 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f29b40096b0 con 0x7f29cc0fb780 2023-12-07T16:15:57.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.437+0000 7f29d11a5700 1 -- 172.21.15.152:0/749342690 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29cc065c30 con 0x7f29cc0fb780 2023-12-07T16:15:57.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.437+0000 7f29c37fe700 1 -- 172.21.15.152:0/749342690 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f29b4009810 con 0x7f29cc0fb780 2023-12-07T16:15:57.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.437+0000 7f29c37fe700 1 -- 172.21.15.152:0/749342690 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f29b401c5b0 con 0x7f29cc0fb780 2023-12-07T16:15:57.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.437+0000 7f29d11a5700 1 -- 172.21.15.152:0/749342690 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29cc10ff20 con 0x7f29cc0fb780 2023-12-07T16:15:57.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.438+0000 7f29c37fe700 1 -- 172.21.15.152:0/749342690 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) v1 ==== 43202+0+0 (secure 0 0 0) 0x7f29b401c870 con 0x7f29cc0fb780 2023-12-07T16:15:57.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.438+0000 7f29d11a5700 1 -- 172.21.15.152:0/749342690 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29cc105410 con 0x7f29cc0fb780 2023-12-07T16:15:57.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.438+0000 7f29c37fe700 1 --2- 172.21.15.152:0/749342690 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f29b8036560 0x7f29b8038a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:15:57.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.438+0000 7f29c37fe700 1 -- 172.21.15.152:0/749342690 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f29b40499d0 con 0x7f29cc0fb780 2023-12-07T16:15:57.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.438+0000 7f29ca59c700 1 --2- 172.21.15.152:0/749342690 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f29b8036560 0x7f29b8038a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:15:57.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.439+0000 7f29ca59c700 1 --2- 172.21.15.152:0/749342690 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f29b8036560 0x7f29b8038a10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009990 tx=0x7f29bc006e40 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:15:57.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.443+0000 7f29c37fe700 1 -- 172.21.15.152:0/749342690 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f29b4011550 con 0x7f29cc0fb780 2023-12-07T16:15:57.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.712+0000 7f29d11a5700 1 -- 172.21.15.152:0/749342690 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f29cc04bb80 con 0x7f29cc0fb780 2023-12-07T16:15:57.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.713+0000 7f29c37fe700 1 -- 172.21.15.152:0/749342690 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f29b4011370 con 0x7f29cc0fb780 2023-12-07T16:15:57.711 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:15:57.712 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"8c493298-951b-11ee-95a2-87774f69a715","modified":"2023-12-07T16:14:01.402276Z","created":"2023-12-07T16:14:01.402276Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-07T16:15:57.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.715+0000 7f29d11a5700 1 -- 172.21.15.152:0/749342690 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f29b8036560 msgr2=0x7f29b8038a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:57.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.715+0000 7f29d11a5700 1 --2- 172.21.15.152:0/749342690 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f29b8036560 0x7f29b8038a10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009990 tx=0x7f29bc006e40 comp rx=0 tx=0).stop 2023-12-07T16:15:57.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.715+0000 7f29d11a5700 1 -- 172.21.15.152:0/749342690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29cc0fb780 msgr2=0x7f29cc10f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:15:57.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.715+0000 7f29d11a5700 1 --2- 172.21.15.152:0/749342690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29cc0fb780 0x7f29cc10f7a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009330 tx=0x7f29b4009e30 comp rx=0 tx=0).stop 2023-12-07T16:15:57.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.715+0000 7f29d11a5700 1 -- 172.21.15.152:0/749342690 shutdown_connections 2023-12-07T16:15:57.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.715+0000 7f29d11a5700 1 --2- 172.21.15.152:0/749342690 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f29b8036560 0x7f29b8038a10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:57.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.715+0000 7f29d11a5700 1 --2- 172.21.15.152:0/749342690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29cc0fb780 0x7f29cc10f7a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:15:57.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.715+0000 7f29d11a5700 1 -- 172.21.15.152:0/749342690 >> 172.21.15.152:0/749342690 conn(0x7f29cc0f6e40 msgr2=0x7f29cc0f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:15:57.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.715+0000 7f29d11a5700 1 -- 172.21.15.152:0/749342690 shutdown_connections 2023-12-07T16:15:57.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:15:57.715+0000 7f29d11a5700 1 -- 172.21.15.152:0/749342690 wait complete. 2023-12-07T16:15:57.715 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2023-12-07T16:15:58.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:58 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:58.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:58 smithi063 ceph-mon[112095]: from='client.? 172.21.15.152:0/749342690' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:15:58.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:58 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:58.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:58 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:59.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:59 smithi063 ceph-mon[112095]: mgrmap e17: smithi063.yohyyx(active, since 2s) 2023-12-07T16:15:59.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:59 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:59.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:59 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:15:59.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:15:59 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd/host:smithi063", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:15:59.676 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-07T16:15:59.676 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-07T16:15:59.962 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:16:00.030 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-07T16:16:01.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.010+0000 7fda176e0700 1 -- 172.21.15.152:0/109935099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda101028f0 msgr2=0x7fda10102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:16:01.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.010+0000 7fda176e0700 1 --2- 172.21.15.152:0/109935099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda101028f0 0x7fda10102cc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0048c0 tx=0x7fda0c009e30 comp rx=0 tx=0).stop 2023-12-07T16:16:01.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.010+0000 7fda176e0700 1 -- 172.21.15.152:0/109935099 shutdown_connections 2023-12-07T16:16:01.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.010+0000 7fda176e0700 1 --2- 172.21.15.152:0/109935099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda101028f0 0x7fda10102cc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:01.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.010+0000 7fda176e0700 1 -- 172.21.15.152:0/109935099 >> 172.21.15.152:0/109935099 conn(0x7fda100715e0 msgr2=0x7fda100719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:16:01.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.010+0000 7fda176e0700 1 -- 172.21.15.152:0/109935099 shutdown_connections 2023-12-07T16:16:01.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.010+0000 7fda176e0700 1 -- 172.21.15.152:0/109935099 wait complete. 2023-12-07T16:16:01.010 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.011+0000 7fda176e0700 1 Processor -- start 2023-12-07T16:16:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.011+0000 7fda176e0700 1 -- start start 2023-12-07T16:16:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.011+0000 7fda176e0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda101028f0 0x7fda10112b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:16:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.011+0000 7fda176e0700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda10113090 con 0x7fda101028f0 2023-12-07T16:16:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.012+0000 7fda1547c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda101028f0 0x7fda10112b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:16:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.012+0000 7fda1547c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda101028f0 0x7fda10112b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.152:54320/0 (socket says 172.21.15.152:54320) 2023-12-07T16:16:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.012+0000 7fda1547c700 1 -- 172.21.15.152:0/691411061 learned_addr learned my addr 172.21.15.152:0/691411061 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-07T16:16:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.012+0000 7fda1547c700 1 -- 172.21.15.152:0/691411061 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c005040 con 0x7fda101028f0 2023-12-07T16:16:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.012+0000 7fda1547c700 1 --2- 172.21.15.152:0/691411061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda101028f0 0x7fda10112b50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fda0c009300 tx=0x7fda0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:16:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.012+0000 7fda05ffb700 1 -- 172.21.15.152:0/691411061 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda0c004e60 con 0x7fda101028f0 2023-12-07T16:16:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.012+0000 7fda05ffb700 1 -- 172.21.15.152:0/691411061 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fda0c013420 con 0x7fda101028f0 2023-12-07T16:16:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.012+0000 7fda05ffb700 1 -- 172.21.15.152:0/691411061 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda0c01c5b0 con 0x7fda101028f0 2023-12-07T16:16:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.012+0000 7fda176e0700 1 -- 172.21.15.152:0/691411061 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda10113290 con 0x7fda101028f0 2023-12-07T16:16:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.013+0000 7fda176e0700 1 -- 172.21.15.152:0/691411061 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1010ca10 con 0x7fda101028f0 2023-12-07T16:16:01.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.013+0000 7fda05ffb700 1 -- 172.21.15.152:0/691411061 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7fda0c009600 con 0x7fda101028f0 2023-12-07T16:16:01.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.014+0000 7fda05ffb700 1 --2- 172.21.15.152:0/691411061 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd9fc0367c0 0x7fd9fc038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:16:01.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.014+0000 7fda176e0700 1 -- 172.21.15.152:0/691411061 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1005f270 con 0x7fda101028f0 2023-12-07T16:16:01.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.014+0000 7fda05ffb700 1 -- 172.21.15.152:0/691411061 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fda0c049a30 con 0x7fda101028f0 2023-12-07T16:16:01.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.014+0000 7fda14c7b700 1 --2- 172.21.15.152:0/691411061 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd9fc0367c0 0x7fd9fc038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:16:01.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.014+0000 7fda14c7b700 1 --2- 172.21.15.152:0/691411061 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd9fc0367c0 0x7fd9fc038c70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fda00009990 tx=0x7fda00006e40 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:16:01.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.018+0000 7fda05ffb700 1 -- 172.21.15.152:0/691411061 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fda0c011960 con 0x7fda101028f0 2023-12-07T16:16:01.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:00 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:01.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:00 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:01.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:00 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:01.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:00 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:01.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:00 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd/host:smithi152", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:16:01.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:00 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:01.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:00 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:16:01.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:00 smithi063 ceph-mon[112095]: Updating smithi063:/etc/ceph/ceph.conf 2023-12-07T16:16:01.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:00 smithi063 ceph-mon[112095]: Updating smithi152:/etc/ceph/ceph.conf 2023-12-07T16:16:01.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:00 smithi063 ceph-mon[112095]: Updating smithi152:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-07T16:16:01.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:00 smithi063 ceph-mon[112095]: Updating smithi063:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-07T16:16:01.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:00 smithi063 ceph-mon[112095]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2023-12-07T16:16:01.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:00 smithi063 ceph-mon[112095]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2023-12-07T16:16:01.295 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.298+0000 7fda176e0700 1 -- 172.21.15.152:0/691411061 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fda1010e130 con 0x7fda101028f0 2023-12-07T16:16:01.296 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.298+0000 7fda05ffb700 1 -- 172.21.15.152:0/691411061 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fda0c023560 con 0x7fda101028f0 2023-12-07T16:16:01.296 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:16:01.296 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"8c493298-951b-11ee-95a2-87774f69a715","modified":"2023-12-07T16:14:01.402276Z","created":"2023-12-07T16:14:01.402276Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-07T16:16:01.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.300+0000 7fda176e0700 1 -- 172.21.15.152:0/691411061 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd9fc0367c0 msgr2=0x7fd9fc038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:16:01.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.300+0000 7fda176e0700 1 --2- 172.21.15.152:0/691411061 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd9fc0367c0 0x7fd9fc038c70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fda00009990 tx=0x7fda00006e40 comp rx=0 tx=0).stop 2023-12-07T16:16:01.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.300+0000 7fda176e0700 1 -- 172.21.15.152:0/691411061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda101028f0 msgr2=0x7fda10112b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:16:01.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.300+0000 7fda176e0700 1 --2- 172.21.15.152:0/691411061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda101028f0 0x7fda10112b50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fda0c009300 tx=0x7fda0c009e30 comp rx=0 tx=0).stop 2023-12-07T16:16:01.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.300+0000 7fda176e0700 1 -- 172.21.15.152:0/691411061 shutdown_connections 2023-12-07T16:16:01.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.300+0000 7fda176e0700 1 --2- 172.21.15.152:0/691411061 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd9fc0367c0 0x7fd9fc038c70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:01.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.300+0000 7fda176e0700 1 --2- 172.21.15.152:0/691411061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda101028f0 0x7fda10112b50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:01.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.300+0000 7fda176e0700 1 -- 172.21.15.152:0/691411061 >> 172.21.15.152:0/691411061 conn(0x7fda100715e0 msgr2=0x7fda10103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:16:01.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.301+0000 7fda176e0700 1 -- 172.21.15.152:0/691411061 shutdown_connections 2023-12-07T16:16:01.299 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:01.301+0000 7fda176e0700 1 -- 172.21.15.152:0/691411061 wait complete. 2023-12-07T16:16:01.300 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2023-12-07T16:16:02.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:01 smithi063 ceph-mon[112095]: Updating smithi152:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-07T16:16:02.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:01 smithi063 ceph-mon[112095]: Updating smithi063:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-07T16:16:02.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:01 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:02.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:01 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:02.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:01 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:02.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:01 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:02.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:01 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:02.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:01 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-07T16:16:02.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:01 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-07T16:16:02.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:01 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:02.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:01 smithi063 ceph-mon[112095]: Deploying daemon crash.smithi152 on smithi152 2023-12-07T16:16:02.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:01 smithi063 ceph-mon[112095]: from='client.? 172.21.15.152:0/691411061' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:16:02.764 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-07T16:16:02.764 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-07T16:16:03.037 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-07T16:16:04.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.073+0000 7f734c0a5700 1 -- 172.21.15.152:0/788546011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73441017e0 msgr2=0x7f7344101bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:16:04.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.073+0000 7f734c0a5700 1 --2- 172.21.15.152:0/788546011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73441017e0 0x7f7344101bb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f73380048c0 tx=0x7f7338009e30 comp rx=0 tx=0).stop 2023-12-07T16:16:04.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.074+0000 7f734c0a5700 1 -- 172.21.15.152:0/788546011 shutdown_connections 2023-12-07T16:16:04.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.074+0000 7f734c0a5700 1 --2- 172.21.15.152:0/788546011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73441017e0 0x7f7344101bb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:04.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.074+0000 7f734c0a5700 1 -- 172.21.15.152:0/788546011 >> 172.21.15.152:0/788546011 conn(0x7f73440715e0 msgr2=0x7f73440719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:16:04.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.074+0000 7f734c0a5700 1 -- 172.21.15.152:0/788546011 shutdown_connections 2023-12-07T16:16:04.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.074+0000 7f734c0a5700 1 -- 172.21.15.152:0/788546011 wait complete. 2023-12-07T16:16:04.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.074+0000 7f734c0a5700 1 Processor -- start 2023-12-07T16:16:04.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.074+0000 7f734c0a5700 1 -- start start 2023-12-07T16:16:04.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.074+0000 7f734c0a5700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73441017e0 0x7f73440fd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:16:04.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.074+0000 7f734c0a5700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73440fd8f0 con 0x7f73441017e0 2023-12-07T16:16:04.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.074+0000 7f7349e41700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73441017e0 0x7f73440fd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:16:04.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.074+0000 7f7349e41700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73441017e0 0x7f73440fd3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.152:46528/0 (socket says 172.21.15.152:46528) 2023-12-07T16:16:04.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.075+0000 7f7349e41700 1 -- 172.21.15.152:0/945853277 learned_addr learned my addr 172.21.15.152:0/945853277 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-07T16:16:04.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.075+0000 7f7349e41700 1 -- 172.21.15.152:0/945853277 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7338005040 con 0x7f73441017e0 2023-12-07T16:16:04.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.075+0000 7f7349e41700 1 --2- 172.21.15.152:0/945853277 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73441017e0 0x7f73440fd3b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7338009300 tx=0x7f7338009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:16:04.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.075+0000 7f73367fc700 1 -- 172.21.15.152:0/945853277 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7338004e60 con 0x7f73441017e0 2023-12-07T16:16:04.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.075+0000 7f734c0a5700 1 -- 172.21.15.152:0/945853277 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73440fdaf0 con 0x7f73441017e0 2023-12-07T16:16:04.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.075+0000 7f73367fc700 1 -- 172.21.15.152:0/945853277 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7338013420 con 0x7f73441017e0 2023-12-07T16:16:04.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.075+0000 7f73367fc700 1 -- 172.21.15.152:0/945853277 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f733801c5b0 con 0x7f73441017e0 2023-12-07T16:16:04.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.075+0000 7f734c0a5700 1 -- 172.21.15.152:0/945853277 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73440fdf60 con 0x7f73441017e0 2023-12-07T16:16:04.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.076+0000 7f73367fc700 1 -- 172.21.15.152:0/945853277 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f73380139e0 con 0x7f73441017e0 2023-12-07T16:16:04.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.076+0000 7f734c0a5700 1 -- 172.21.15.152:0/945853277 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734405f270 con 0x7f73441017e0 2023-12-07T16:16:04.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.076+0000 7f73367fc700 1 --2- 172.21.15.152:0/945853277 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f7330036810 0x7f7330038cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:16:04.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.076+0000 7f73367fc700 1 -- 172.21.15.152:0/945853277 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f7338049a20 con 0x7f73441017e0 2023-12-07T16:16:04.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.077+0000 7f7349640700 1 --2- 172.21.15.152:0/945853277 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f7330036810 0x7f7330038cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:16:04.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.077+0000 7f7349640700 1 --2- 172.21.15.152:0/945853277 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f7330036810 0x7f7330038cc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7340009990 tx=0x7f7340006e40 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:16:04.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.081+0000 7f73367fc700 1 -- 172.21.15.152:0/945853277 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7338011960 con 0x7f73441017e0 2023-12-07T16:16:04.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:03 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:04.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:03 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:04.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:03 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:04.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:03 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:04.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:03 smithi063 ceph-mon[112095]: Deploying daemon node-exporter.smithi152 on smithi152 2023-12-07T16:16:04.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.347+0000 7f734c0a5700 1 -- 172.21.15.152:0/945853277 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f73440fe1a0 con 0x7f73441017e0 2023-12-07T16:16:04.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.347+0000 7f73367fc700 1 -- 172.21.15.152:0/945853277 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f7338011370 con 0x7f73441017e0 2023-12-07T16:16:04.346 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:16:04.346 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"8c493298-951b-11ee-95a2-87774f69a715","modified":"2023-12-07T16:14:01.402276Z","created":"2023-12-07T16:14:01.402276Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-07T16:16:04.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.349+0000 7f734c0a5700 1 -- 172.21.15.152:0/945853277 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f7330036810 msgr2=0x7f7330038cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:16:04.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.349+0000 7f734c0a5700 1 --2- 172.21.15.152:0/945853277 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f7330036810 0x7f7330038cc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7340009990 tx=0x7f7340006e40 comp rx=0 tx=0).stop 2023-12-07T16:16:04.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.349+0000 7f734c0a5700 1 -- 172.21.15.152:0/945853277 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73441017e0 msgr2=0x7f73440fd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:16:04.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.349+0000 7f734c0a5700 1 --2- 172.21.15.152:0/945853277 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73441017e0 0x7f73440fd3b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7338009300 tx=0x7f7338009e30 comp rx=0 tx=0).stop 2023-12-07T16:16:04.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.349+0000 7f734c0a5700 1 -- 172.21.15.152:0/945853277 shutdown_connections 2023-12-07T16:16:04.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.349+0000 7f734c0a5700 1 --2- 172.21.15.152:0/945853277 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f7330036810 0x7f7330038cc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:04.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.349+0000 7f734c0a5700 1 --2- 172.21.15.152:0/945853277 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73441017e0 0x7f73440fd3b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:04.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.349+0000 7f734c0a5700 1 -- 172.21.15.152:0/945853277 >> 172.21.15.152:0/945853277 conn(0x7f73440715e0 msgr2=0x7f7344065610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:16:04.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.350+0000 7f734c0a5700 1 -- 172.21.15.152:0/945853277 shutdown_connections 2023-12-07T16:16:04.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:04.350+0000 7f734c0a5700 1 -- 172.21.15.152:0/945853277 wait complete. 2023-12-07T16:16:04.349 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2023-12-07T16:16:05.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:04 smithi063 ceph-mon[112095]: from='client.? 172.21.15.152:0/945853277' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:16:05.799 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-07T16:16:05.800 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-07T16:16:06.337 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-07T16:16:06.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:06 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:07.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.370+0000 7fdbbbdd0700 1 -- 172.21.15.152:0/505998825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbb41028d0 msgr2=0x7fdbb4102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:16:07.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.370+0000 7fdbbbdd0700 1 --2- 172.21.15.152:0/505998825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbb41028d0 0x7fdbb4102ca0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00048c0 tx=0x7fdbb0009e30 comp rx=0 tx=0).stop 2023-12-07T16:16:07.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.370+0000 7fdbbbdd0700 1 -- 172.21.15.152:0/505998825 shutdown_connections 2023-12-07T16:16:07.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.370+0000 7fdbbbdd0700 1 --2- 172.21.15.152:0/505998825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbb41028d0 0x7fdbb4102ca0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:07.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.370+0000 7fdbbbdd0700 1 -- 172.21.15.152:0/505998825 >> 172.21.15.152:0/505998825 conn(0x7fdbb40f8410 msgr2=0x7fdbb40fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:16:07.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.370+0000 7fdbbbdd0700 1 -- 172.21.15.152:0/505998825 shutdown_connections 2023-12-07T16:16:07.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.370+0000 7fdbbbdd0700 1 -- 172.21.15.152:0/505998825 wait complete. 2023-12-07T16:16:07.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.371+0000 7fdbbbdd0700 1 Processor -- start 2023-12-07T16:16:07.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.371+0000 7fdbbbdd0700 1 -- start start 2023-12-07T16:16:07.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.371+0000 7fdbbbdd0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbb41028d0 0x7fdbb4112b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:16:07.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.371+0000 7fdbbbdd0700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb41130a0 con 0x7fdbb41028d0 2023-12-07T16:16:07.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.371+0000 7fdbb9b6c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbb41028d0 0x7fdbb4112b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:16:07.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.371+0000 7fdbb9b6c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbb41028d0 0x7fdbb4112b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.152:46548/0 (socket says 172.21.15.152:46548) 2023-12-07T16:16:07.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.371+0000 7fdbb9b6c700 1 -- 172.21.15.152:0/1370910642 learned_addr learned my addr 172.21.15.152:0/1370910642 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-07T16:16:07.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.372+0000 7fdbb9b6c700 1 -- 172.21.15.152:0/1370910642 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb0005040 con 0x7fdbb41028d0 2023-12-07T16:16:07.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.372+0000 7fdbb9b6c700 1 --2- 172.21.15.152:0/1370910642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbb41028d0 0x7fdbb4112b60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0009300 tx=0x7fdbb0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:16:07.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.372+0000 7fdbaa7fc700 1 -- 172.21.15.152:0/1370910642 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdbb0004e60 con 0x7fdbb41028d0 2023-12-07T16:16:07.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.372+0000 7fdbbbdd0700 1 -- 172.21.15.152:0/1370910642 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb41132a0 con 0x7fdbb41028d0 2023-12-07T16:16:07.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.372+0000 7fdbaa7fc700 1 -- 172.21.15.152:0/1370910642 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdbb0013420 con 0x7fdbb41028d0 2023-12-07T16:16:07.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.372+0000 7fdbaa7fc700 1 -- 172.21.15.152:0/1370910642 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdbb001c5b0 con 0x7fdbb41028d0 2023-12-07T16:16:07.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.372+0000 7fdbbbdd0700 1 -- 172.21.15.152:0/1370910642 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb410ca20 con 0x7fdbb41028d0 2023-12-07T16:16:07.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.373+0000 7fdbaa7fc700 1 -- 172.21.15.152:0/1370910642 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7fdbb00139e0 con 0x7fdbb41028d0 2023-12-07T16:16:07.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.373+0000 7fdbbbdd0700 1 -- 172.21.15.152:0/1370910642 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb405f270 con 0x7fdbb41028d0 2023-12-07T16:16:07.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.373+0000 7fdbaa7fc700 1 --2- 172.21.15.152:0/1370910642 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fdba00367c0 0x7fdba0038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:16:07.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.373+0000 7fdbaa7fc700 1 -- 172.21.15.152:0/1370910642 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fdbb0049ab0 con 0x7fdbb41028d0 2023-12-07T16:16:07.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.373+0000 7fdbb936b700 1 --2- 172.21.15.152:0/1370910642 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fdba00367c0 0x7fdba0038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:16:07.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.374+0000 7fdbb936b700 1 --2- 172.21.15.152:0/1370910642 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fdba00367c0 0x7fdba0038c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009990 tx=0x7fdba4006e40 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:16:07.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.378+0000 7fdbaa7fc700 1 -- 172.21.15.152:0/1370910642 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdbb0011960 con 0x7fdbb41028d0 2023-12-07T16:16:07.641 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.643+0000 7fdbbbdd0700 1 -- 172.21.15.152:0/1370910642 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fdbb410e140 con 0x7fdbb41028d0 2023-12-07T16:16:07.642 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.644+0000 7fdbaa7fc700 1 -- 172.21.15.152:0/1370910642 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fdbb0011370 con 0x7fdbb41028d0 2023-12-07T16:16:07.642 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:16:07.642 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"8c493298-951b-11ee-95a2-87774f69a715","modified":"2023-12-07T16:14:01.402276Z","created":"2023-12-07T16:14:01.402276Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-07T16:16:07.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.646+0000 7fdbbbdd0700 1 -- 172.21.15.152:0/1370910642 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fdba00367c0 msgr2=0x7fdba0038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:16:07.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.646+0000 7fdbbbdd0700 1 --2- 172.21.15.152:0/1370910642 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fdba00367c0 0x7fdba0038c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009990 tx=0x7fdba4006e40 comp rx=0 tx=0).stop 2023-12-07T16:16:07.644 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.646+0000 7fdbbbdd0700 1 -- 172.21.15.152:0/1370910642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbb41028d0 msgr2=0x7fdbb4112b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:16:07.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.646+0000 7fdbbbdd0700 1 --2- 172.21.15.152:0/1370910642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbb41028d0 0x7fdbb4112b60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0009300 tx=0x7fdbb0009e30 comp rx=0 tx=0).stop 2023-12-07T16:16:07.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.646+0000 7fdbbbdd0700 1 -- 172.21.15.152:0/1370910642 shutdown_connections 2023-12-07T16:16:07.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.646+0000 7fdbbbdd0700 1 --2- 172.21.15.152:0/1370910642 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fdba00367c0 0x7fdba0038c70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:07.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.646+0000 7fdbbbdd0700 1 --2- 172.21.15.152:0/1370910642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbb41028d0 0x7fdbb4112b60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:07.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.646+0000 7fdbbbdd0700 1 -- 172.21.15.152:0/1370910642 >> 172.21.15.152:0/1370910642 conn(0x7fdbb40f8410 msgr2=0x7fdbb40fa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:16:07.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.646+0000 7fdbbbdd0700 1 -- 172.21.15.152:0/1370910642 shutdown_connections 2023-12-07T16:16:07.645 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:07.646+0000 7fdbbbdd0700 1 -- 172.21.15.152:0/1370910642 wait complete. 2023-12-07T16:16:07.645 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2023-12-07T16:16:07.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:07 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:07.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:07 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:07.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:07 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:07.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:07 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:07.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:07 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.sxayfb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-07T16:16:07.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:07 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.sxayfb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-07T16:16:07.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:07 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-07T16:16:07.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:07 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:07.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:07 smithi063 ceph-mon[112095]: Deploying daemon mgr.smithi152.sxayfb on smithi152 2023-12-07T16:16:08.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:08 smithi063 ceph-mon[112095]: from='client.? 172.21.15.152:0/1370910642' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:16:09.081 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-07T16:16:09.081 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-07T16:16:09.510 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-07T16:16:09.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:09.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:09.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:09.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:09.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-07T16:16:09.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:10.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:10 smithi063 ceph-mon[112095]: Deploying daemon mon.smithi152 on smithi152 2023-12-07T16:16:10.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:10 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:10.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:10 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:16:10.962 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.962+0000 7f3303c72700 1 -- 172.21.15.152:0/1334430198 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32fc1028f0 msgr2=0x7f32fc102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:16:10.963 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.962+0000 7f3303c72700 1 --2- 172.21.15.152:0/1334430198 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32fc1028f0 0x7f32fc102cc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f32f80048c0 tx=0x7f32f8009e30 comp rx=0 tx=0).stop 2023-12-07T16:16:10.963 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.962+0000 7f3303c72700 1 -- 172.21.15.152:0/1334430198 shutdown_connections 2023-12-07T16:16:10.963 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.962+0000 7f3303c72700 1 --2- 172.21.15.152:0/1334430198 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32fc1028f0 0x7f32fc102cc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:10.963 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.962+0000 7f3303c72700 1 -- 172.21.15.152:0/1334430198 >> 172.21.15.152:0/1334430198 conn(0x7f32fc071d60 msgr2=0x7f32fc072160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:16:10.963 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.962+0000 7f3303c72700 1 -- 172.21.15.152:0/1334430198 shutdown_connections 2023-12-07T16:16:10.963 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.962+0000 7f3303c72700 1 -- 172.21.15.152:0/1334430198 wait complete. 2023-12-07T16:16:10.963 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.963+0000 7f3303c72700 1 Processor -- start 2023-12-07T16:16:10.963 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.963+0000 7f3303c72700 1 -- start start 2023-12-07T16:16:10.963 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.963+0000 7f3303c72700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32fc1028f0 0x7f32fc112bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:16:10.963 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.963+0000 7f3303c72700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc113100 con 0x7f32fc1028f0 2023-12-07T16:16:10.964 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.963+0000 7f3301a0e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32fc1028f0 0x7f32fc112bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:16:10.964 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.963+0000 7f3301a0e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32fc1028f0 0x7f32fc112bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.152:46592/0 (socket says 172.21.15.152:46592) 2023-12-07T16:16:10.964 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.963+0000 7f3301a0e700 1 -- 172.21.15.152:0/2995553809 learned_addr learned my addr 172.21.15.152:0/2995553809 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-07T16:16:10.964 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.964+0000 7f3301a0e700 1 -- 172.21.15.152:0/2995553809 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f8005040 con 0x7f32fc1028f0 2023-12-07T16:16:10.964 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.964+0000 7f3301a0e700 1 --2- 172.21.15.152:0/2995553809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32fc1028f0 0x7f32fc112bc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f32f8009300 tx=0x7f32f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:16:10.964 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.964+0000 7f32f27fc700 1 -- 172.21.15.152:0/2995553809 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32f8004e60 con 0x7f32fc1028f0 2023-12-07T16:16:10.964 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.964+0000 7f3303c72700 1 -- 172.21.15.152:0/2995553809 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32fc113300 con 0x7f32fc1028f0 2023-12-07T16:16:10.964 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.964+0000 7f32f27fc700 1 -- 172.21.15.152:0/2995553809 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f32f8013420 con 0x7f32fc1028f0 2023-12-07T16:16:10.964 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.964+0000 7f32f27fc700 1 -- 172.21.15.152:0/2995553809 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32f801c5b0 con 0x7f32fc1028f0 2023-12-07T16:16:10.964 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.964+0000 7f3303c72700 1 -- 172.21.15.152:0/2995553809 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32fc113770 con 0x7f32fc1028f0 2023-12-07T16:16:10.965 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.965+0000 7f3303c72700 1 -- 172.21.15.152:0/2995553809 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32fc05f270 con 0x7f32fc1028f0 2023-12-07T16:16:10.965 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.965+0000 7f32f27fc700 1 -- 172.21.15.152:0/2995553809 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f32f801c7f0 con 0x7f32fc1028f0 2023-12-07T16:16:10.965 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.966+0000 7f32f27fc700 1 --2- 172.21.15.152:0/2995553809 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f32e80367c0 0x7f32e8038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:16:10.965 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.966+0000 7f32f27fc700 1 -- 172.21.15.152:0/2995553809 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f32f8049a10 con 0x7f32fc1028f0 2023-12-07T16:16:10.965 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.966+0000 7f330120d700 1 --2- 172.21.15.152:0/2995553809 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f32e80367c0 0x7f32e8038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:16:10.966 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.966+0000 7f330120d700 1 --2- 172.21.15.152:0/2995553809 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f32e80367c0 0x7f32e8038c70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f32ec009990 tx=0x7f32ec006e40 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:16:10.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:10.971+0000 7f32f27fc700 1 -- 172.21.15.152:0/2995553809 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f32f8011550 con 0x7f32fc1028f0 2023-12-07T16:16:10.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:10 smithi152 systemd[1]: Starting Ceph mon.smithi152 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:16:11.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:11.228+0000 7f32f27fc700 1 -- 172.21.15.152:0/2995553809 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32f804e020 con 0x7f32fc1028f0 2023-12-07T16:16:11.257 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:11.259+0000 7f3303c72700 1 -- 172.21.15.152:0/2995553809 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f32fc04bc10 con 0x7f32fc1028f0 2023-12-07T16:16:11.495 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 bash[121057]: ecfe3add39d6a90345efdde545366e56fc760bf3fb30a5cb0b05ef6222663b09 2023-12-07T16:16:11.495 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 systemd[1]: Started Ceph mon.smithi152 for 8c493298-951b-11ee-95a2-87774f69a715. 2023-12-07T16:16:11.495 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: set uid:gid to 167:167 (ceph:ceph) 2023-12-07T16:16:11.495 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable), process ceph-mon, pid 7 2023-12-07T16:16:11.495 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: pidfile_write: ignore empty --pid-file 2023-12-07T16:16:11.496 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: load: jerasure load: lrc 2023-12-07T16:16:11.496 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: RocksDB version: 6.15.5 2023-12-07T16:16:11.496 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-12-07T16:16:11.496 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Compile date Dec 6 2023 2023-12-07T16:16:11.496 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: DB SUMMARY 2023-12-07T16:16:11.496 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: DB Session ID: A6UZOA5EKDEZ1QHDULH3 2023-12-07T16:16:11.496 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: CURRENT file: CURRENT 2023-12-07T16:16:11.496 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: IDENTITY file: IDENTITY 2023-12-07T16:16:11.496 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2023-12-07T16:16:11.496 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi152/store.db dir, Total Num: 0, files: 2023-12-07T16:16:11.496 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi152/store.db: 000004.log size: 511 ; 2023-12-07T16:16:11.497 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.error_if_exists: 0 2023-12-07T16:16:11.497 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.create_if_missing: 0 2023-12-07T16:16:11.497 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.paranoid_checks: 1 2023-12-07T16:16:11.497 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-07T16:16:11.497 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.env: 0x55a91f700a80 2023-12-07T16:16:11.497 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.fs: Posix File System 2023-12-07T16:16:11.497 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.info_log: 0x55a9216f4780 2023-12-07T16:16:11.497 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_file_opening_threads: 16 2023-12-07T16:16:11.497 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.statistics: (nil) 2023-12-07T16:16:11.497 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.use_fsync: 0 2023-12-07T16:16:11.497 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_log_file_size: 0 2023-12-07T16:16:11.498 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-07T16:16:11.498 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-07T16:16:11.498 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.keep_log_file_num: 1000 2023-12-07T16:16:11.498 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.recycle_log_file_num: 0 2023-12-07T16:16:11.498 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.allow_fallocate: 1 2023-12-07T16:16:11.498 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.allow_mmap_reads: 0 2023-12-07T16:16:11.498 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.allow_mmap_writes: 0 2023-12-07T16:16:11.498 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.use_direct_reads: 0 2023-12-07T16:16:11.498 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-07T16:16:11.499 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.create_missing_column_families: 0 2023-12-07T16:16:11.499 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.db_log_dir: 2023-12-07T16:16:11.499 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi152/store.db 2023-12-07T16:16:11.499 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-07T16:16:11.499 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-07T16:16:11.499 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-07T16:16:11.499 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-07T16:16:11.499 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-07T16:16:11.499 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-07T16:16:11.499 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.advise_random_on_open: 1 2023-12-07T16:16:11.500 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.db_write_buffer_size: 0 2023-12-07T16:16:11.500 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.write_buffer_manager: 0x55a9224649f0 2023-12-07T16:16:11.500 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-07T16:16:11.500 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-12-07T16:16:11.500 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-07T16:16:11.500 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-07T16:16:11.500 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.rate_limiter: (nil) 2023-12-07T16:16:11.500 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-07T16:16:11.500 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.wal_recovery_mode: 2 2023-12-07T16:16:11.500 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.enable_thread_tracking: 0 2023-12-07T16:16:11.501 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.enable_pipelined_write: 0 2023-12-07T16:16:11.501 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.unordered_write: 0 2023-12-07T16:16:11.501 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-07T16:16:11.501 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-07T16:16:11.501 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-07T16:16:11.501 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-07T16:16:11.501 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.row_cache: None 2023-12-07T16:16:11.501 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.wal_filter: None 2023-12-07T16:16:11.501 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-07T16:16:11.501 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.allow_ingest_behind: 0 2023-12-07T16:16:11.501 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.preserve_deletes: 0 2023-12-07T16:16:11.502 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.two_write_queues: 0 2023-12-07T16:16:11.502 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.manual_wal_flush: 0 2023-12-07T16:16:11.502 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.atomic_flush: 0 2023-12-07T16:16:11.502 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-07T16:16:11.502 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-07T16:16:11.502 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-07T16:16:11.502 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.log_readahead_size: 0 2023-12-07T16:16:11.502 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-07T16:16:11.502 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.best_efforts_recovery: 0 2023-12-07T16:16:11.502 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-07T16:16:11.502 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-07T16:16:11.503 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.allow_data_in_errors: 0 2023-12-07T16:16:11.503 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.db_host_id: __hostname__ 2023-12-07T16:16:11.503 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_background_jobs: 2 2023-12-07T16:16:11.503 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_background_compactions: -1 2023-12-07T16:16:11.503 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_subcompactions: 1 2023-12-07T16:16:11.503 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-07T16:16:11.503 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-07T16:16:11.503 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-07T16:16:11.503 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_total_wal_size: 0 2023-12-07T16:16:11.503 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-07T16:16:11.503 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-07T16:16:11.504 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-07T16:16:11.504 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-07T16:16:11.504 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_open_files: -1 2023-12-07T16:16:11.504 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.bytes_per_sync: 0 2023-12-07T16:16:11.504 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-07T16:16:11.504 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-07T16:16:11.504 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.compaction_readahead_size: 0 2023-12-07T16:16:11.504 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_background_flushes: -1 2023-12-07T16:16:11.504 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Compression algorithms supported: 2023-12-07T16:16:11.504 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-07T16:16:11.505 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: kZSTD supported: 0 2023-12-07T16:16:11.505 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: kXpressCompression supported: 0 2023-12-07T16:16:11.505 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: kLZ4HCCompression supported: 1 2023-12-07T16:16:11.505 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: kZlibCompression supported: 1 2023-12-07T16:16:11.505 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: kSnappyCompression supported: 1 2023-12-07T16:16:11.505 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: kLZ4Compression supported: 1 2023-12-07T16:16:11.505 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: kBZip2Compression supported: 0 2023-12-07T16:16:11.505 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-07T16:16:11.505 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi152/store.db/MANIFEST-000003 2023-12-07T16:16:11.505 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-12-07T16:16:11.506 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-07T16:16:11.506 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.merge_operator: 2023-12-07T16:16:11.506 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.compaction_filter: None 2023-12-07T16:16:11.506 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.compaction_filter_factory: None 2023-12-07T16:16:11.506 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.sst_partitioner_factory: None 2023-12-07T16:16:11.506 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-07T16:16:11.506 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-07T16:16:11.506 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a921744f90) 2023-12-07T16:16:11.506 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: cache_index_and_filter_blocks: 1 2023-12-07T16:16:11.506 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-07T16:16:11.506 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-07T16:16:11.507 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: pin_top_level_index_and_filter: 1 2023-12-07T16:16:11.507 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: index_type: 0 2023-12-07T16:16:11.507 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: data_block_index_type: 0 2023-12-07T16:16:11.507 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: index_shortening: 1 2023-12-07T16:16:11.507 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-07T16:16:11.507 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: hash_index_allow_collision: 1 2023-12-07T16:16:11.507 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: checksum: 1 2023-12-07T16:16:11.507 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: no_block_cache: 0 2023-12-07T16:16:11.507 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache: 0x55a921777090 2023-12-07T16:16:11.507 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache_name: BinnedLRUCache 2023-12-07T16:16:11.507 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache_options: 2023-12-07T16:16:11.507 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: capacity : 536870912 2023-12-07T16:16:11.508 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: num_shard_bits : 4 2023-12-07T16:16:11.508 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: strict_capacity_limit : 0 2023-12-07T16:16:11.508 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: high_pri_pool_ratio: 0.000 2023-12-07T16:16:11.508 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache_compressed: (nil) 2023-12-07T16:16:11.508 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: persistent_cache: (nil) 2023-12-07T16:16:11.508 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_size: 4096 2023-12-07T16:16:11.508 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_size_deviation: 10 2023-12-07T16:16:11.508 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_restart_interval: 16 2023-12-07T16:16:11.508 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: index_block_restart_interval: 1 2023-12-07T16:16:11.508 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: metadata_block_size: 4096 2023-12-07T16:16:11.508 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: partition_filters: 0 2023-12-07T16:16:11.509 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: use_delta_encoding: 1 2023-12-07T16:16:11.509 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-12-07T16:16:11.509 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: whole_key_filtering: 1 2023-12-07T16:16:11.509 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: verify_compression: 0 2023-12-07T16:16:11.509 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: read_amp_bytes_per_bit: 0 2023-12-07T16:16:11.509 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: format_version: 4 2023-12-07T16:16:11.509 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: enable_index_compression: 1 2023-12-07T16:16:11.509 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_align: 0 2023-12-07T16:16:11.509 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.write_buffer_size: 33554432 2023-12-07T16:16:11.509 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_write_buffer_number: 2 2023-12-07T16:16:11.509 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.compression: NoCompression 2023-12-07T16:16:11.509 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.bottommost_compression: Disabled 2023-12-07T16:16:11.510 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.prefix_extractor: nullptr 2023-12-07T16:16:11.510 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-07T16:16:11.510 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.num_levels: 7 2023-12-07T16:16:11.510 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-07T16:16:11.510 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-07T16:16:11.510 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-07T16:16:11.510 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-07T16:16:11.510 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-07T16:16:11.510 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-07T16:16:11.510 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-07T16:16:11.511 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-07T16:16:11.511 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-07T16:16:11.511 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-07T16:16:11.511 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-07T16:16:11.511 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.compression_opts.level: 32767 2023-12-07T16:16:11.511 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.compression_opts.strategy: 0 2023-12-07T16:16:11.511 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-07T16:16:11.511 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-07T16:16:11.511 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-07T16:16:11.511 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.compression_opts.enabled: false 2023-12-07T16:16:11.511 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-07T16:16:11.512 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-07T16:16:11.512 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-07T16:16:11.512 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.target_file_size_base: 67108864 2023-12-07T16:16:11.512 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-07T16:16:11.512 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-07T16:16:11.512 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-07T16:16:11.512 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-07T16:16:11.512 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-07T16:16:11.512 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-07T16:16:11.512 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-07T16:16:11.512 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-07T16:16:11.513 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-07T16:16:11.513 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-07T16:16:11.513 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-07T16:16:11.513 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-07T16:16:11.513 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-07T16:16:11.513 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.arena_block_size: 4194304 2023-12-07T16:16:11.513 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-07T16:16:11.513 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-07T16:16:11.513 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-12-07T16:16:11.513 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.disable_auto_compactions: 0 2023-12-07T16:16:11.513 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-07T16:16:11.513 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-07T16:16:11.514 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-07T16:16:11.514 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-07T16:16:11.514 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-07T16:16:11.514 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-07T16:16:11.514 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-07T16:16:11.514 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-07T16:16:11.514 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-07T16:16:11.514 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-07T16:16:11.514 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.table_properties_collectors: 2023-12-07T16:16:11.514 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.inplace_update_support: 0 2023-12-07T16:16:11.514 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-07T16:16:11.515 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-07T16:16:11.515 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-07T16:16:11.515 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-07T16:16:11.515 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.bloom_locality: 0 2023-12-07T16:16:11.515 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.max_successive_merges: 0 2023-12-07T16:16:11.515 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-07T16:16:11.515 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.paranoid_file_checks: 0 2023-12-07T16:16:11.515 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.force_consistency_checks: 1 2023-12-07T16:16:11.515 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.report_bg_io_stats: 0 2023-12-07T16:16:11.515 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.ttl: 2592000 2023-12-07T16:16:11.515 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-07T16:16:11.515 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.enable_blob_files: false 2023-12-07T16:16:11.516 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.min_blob_size: 0 2023-12-07T16:16:11.516 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.blob_file_size: 268435456 2023-12-07T16:16:11.516 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-07T16:16:11.516 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-07T16:16:11.516 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-07T16:16:11.516 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi152/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-07T16:16:11.516 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2023-12-07T16:16:11.516 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2023-12-07T16:16:11.516 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701965771191301, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-12-07T16:16:11.516 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2023-12-07T16:16:11.516 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-12-07T16:16:11.516 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701965771191656, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1701965771, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "56f1f507-e1ff-4ebe-bba7-c98e4d0f369d", "db_session_id": "A6UZOA5EKDEZ1QHDULH3"}} 2023-12-07T16:16:11.517 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2023-12-07T16:16:11.517 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701965771192049, "job": 1, "event": "recovery_finished"} 2023-12-07T16:16:11.517 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi152/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-07T16:16:11.517 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55a92170b180 2023-12-07T16:16:11.517 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: DB pointer 0x55a9217e0000 2023-12-07T16:16:11.517 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-12-07T16:16:11.517 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-12-07T16:16:11.517 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** DB Stats ** 2023-12-07T16:16:11.517 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-07T16:16:11.517 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-07T16:16:11.517 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-07T16:16:11.518 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-07T16:16:11.518 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-07T16:16:11.518 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-12-07T16:16:11.518 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-07T16:16:11.518 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-07T16:16:11.518 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** Compaction Stats [default] ** 2023-12-07T16:16:11.518 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-07T16:16:11.518 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-07T16:16:11.518 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 2023-12-07T16:16:11.518 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 2023-12-07T16:16:11.518 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 2023-12-07T16:16:11.518 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-07T16:16:11.519 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** Compaction Stats [default] ** 2023-12-07T16:16:11.519 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-07T16:16:11.519 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-07T16:16:11.519 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.000 0 0 2023-12-07T16:16:11.519 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-07T16:16:11.519 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-07T16:16:11.519 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-07T16:16:11.519 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-07T16:16:11.519 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-07T16:16:11.519 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-07T16:16:11.519 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative compaction: 0.00 GB write, 0.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-07T16:16:11.519 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval compaction: 0.00 GB write, 0.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-07T16:16:11.520 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-07T16:16:11.520 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-07T16:16:11.520 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-07T16:16:11.520 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-07T16:16:11.520 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** Compaction Stats [default] ** 2023-12-07T16:16:11.520 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-07T16:16:11.520 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-07T16:16:11.520 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 2023-12-07T16:16:11.520 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 2023-12-07T16:16:11.520 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-12-07T16:16:11.520 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-07T16:16:11.521 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** Compaction Stats [default] ** 2023-12-07T16:16:11.521 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-07T16:16:11.521 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-07T16:16:11.521 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.000 0 0 2023-12-07T16:16:11.521 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-07T16:16:11.521 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-07T16:16:11.521 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-07T16:16:11.521 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-07T16:16:11.521 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-07T16:16:11.521 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-07T16:16:11.521 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative compaction: 0.00 GB write, 0.39 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-07T16:16:11.521 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-07T16:16:11.522 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-07T16:16:11.522 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-07T16:16:11.522 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-07T16:16:11.522 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: mon.smithi152 does not exist in monmap, will attempt to join an existing cluster 2023-12-07T16:16:11.522 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: using public_addr v2:172.21.15.152:0/0 -> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2023-12-07T16:16:11.522 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: starting mon.smithi152 rank -1 at public addrs [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] at bind addrs [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi152 fsid 8c493298-951b-11ee-95a2-87774f69a715 2023-12-07T16:16:11.522 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: mon.smithi152@-1(???) e0 preinit fsid 8c493298-951b-11ee-95a2-87774f69a715 2023-12-07T16:16:11.522 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: mon.smithi152@-1(synchronizing).mds e1 new map 2023-12-07T16:16:11.522 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: mon.smithi152@-1(synchronizing).mds e1 print_map 2023-12-07T16:16:11.522 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: e1 2023-12-07T16:16:11.522 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-07T16:16:11.523 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:16:11.523 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: legacy client fscid: -1 2023-12-07T16:16:11.523 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-07T16:16:11.523 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: No filesystems configured 2023-12-07T16:16:11.523 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: mon.smithi152@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-12-07T16:16:11.523 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: mon.smithi152@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-12-07T16:16:11.523 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: mon.smithi152@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-12-07T16:16:11.523 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: mon.smithi152@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-12-07T16:16:11.523 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: mon.smithi152@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-12-07T16:16:11.523 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: mon.smithi152@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-12-07T16:16:11.523 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: mon.smithi152@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2023-12-07T16:16:11.523 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: mon.smithi152@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-07T16:16:11.524 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: mon.smithi152@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-07T16:16:11.524 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: mon.smithi152@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-07T16:16:11.524 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: mon.smithi152@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-07T16:16:11.524 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi063:172.21.15.63=smithi063;smithi152:172.21.15.152=smithi152", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:16:11.524 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: Saving service mon spec with placement smithi063:172.21.15.63=smithi063;smithi152:172.21.15.152=smithi152;count:2 2023-12-07T16:16:11.524 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:11.524 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='client.? 172.21.15.152:0/2101161355' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:16:11.524 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:11.524 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='client.? 172.21.15.152:0/1940454007' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:16:11.524 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:11.524 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:11.524 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='client.? 172.21.15.152:0/1276399034' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:16:11.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: Deploying daemon prometheus.smithi063 on smithi063 2023-12-07T16:16:11.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:11.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='client.? 172.21.15.152:0/1974419381' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:16:11.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:11.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:11.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='client.? 172.21.15.152:0/2038696968' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:16:11.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:11.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='client.? 172.21.15.152:0/999280879' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:16:11.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:11.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:11.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='client.? 172.21.15.152:0/1637994894' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:16:11.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:11.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-07T16:16:11.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14162 172.21.15.63:0/4175189475' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-07T16:16:11.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: mgrmap e14: smithi063.yohyyx(active, since 49s) 2023-12-07T16:16:11.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='client.? 172.21.15.152:0/1389250273' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:16:11.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='client.? 172.21.15.152:0/1734197991' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:16:11.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='client.? 172.21.15.152:0/1146875028' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:16:11.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: Active manager daemon smithi063.yohyyx restarted 2023-12-07T16:16:11.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: Activating manager daemon smithi063.yohyyx 2023-12-07T16:16:11.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: osdmap e5: 0 total, 0 up, 0 in 2023-12-07T16:16:11.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: mgrmap e15: smithi063.yohyyx(active, starting, since 0.00329679s) 2023-12-07T16:16:11.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-07T16:16:11.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr metadata", "who": "smithi063.yohyyx", "id": "smithi063.yohyyx"}]: dispatch 2023-12-07T16:16:11.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-07T16:16:11.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-07T16:16:11.527 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-07T16:16:11.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: Manager daemon smithi063.yohyyx is now available 2023-12-07T16:16:11.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:16:11.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:16:11.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:16:11.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.yohyyx/mirror_snapshot_schedule"}]: dispatch 2023-12-07T16:16:11.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.yohyyx/trash_purge_schedule"}]: dispatch 2023-12-07T16:16:11.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: [07/Dec/2023:16:15:55] ENGINE Bus STARTING 2023-12-07T16:16:11.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: [07/Dec/2023:16:15:55] ENGINE Serving on https://172.21.15.63:7150 2023-12-07T16:16:11.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: [07/Dec/2023:16:15:55] ENGINE Bus STARTED 2023-12-07T16:16:11.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: mgrmap e16: smithi063.yohyyx(active, since 1.00586s) 2023-12-07T16:16:11.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='client.? 172.21.15.152:0/749342690' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:16:11.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: mgrmap e17: smithi063.yohyyx(active, since 2s) 2023-12-07T16:16:11.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd/host:smithi063", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:16:11.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd/host:smithi152", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:16:11.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:11.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:16:11.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: Updating smithi063:/etc/ceph/ceph.conf 2023-12-07T16:16:11.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: Updating smithi152:/etc/ceph/ceph.conf 2023-12-07T16:16:11.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: Updating smithi152:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-07T16:16:11.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: Updating smithi063:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-07T16:16:11.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2023-12-07T16:16:11.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2023-12-07T16:16:11.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: Updating smithi152:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-07T16:16:11.530 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: Updating smithi063:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-07T16:16:11.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-07T16:16:11.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-07T16:16:11.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:11.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: Deploying daemon crash.smithi152 on smithi152 2023-12-07T16:16:11.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='client.? 172.21.15.152:0/691411061' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:16:11.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.531 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: Deploying daemon node-exporter.smithi152 on smithi152 2023-12-07T16:16:11.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='client.? 172.21.15.152:0/945853277' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:16:11.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.sxayfb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-07T16:16:11.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.sxayfb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-07T16:16:11.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-07T16:16:11.532 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:11.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: Deploying daemon mgr.smithi152.sxayfb on smithi152 2023-12-07T16:16:11.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='client.? 172.21.15.152:0/1370910642' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:16:11.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-07T16:16:11.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:11.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: Deploying daemon mon.smithi152 on smithi152 2023-12-07T16:16:11.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:11.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:16:11.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: mon.smithi152@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2023-12-07T16:16:11.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:11 smithi152 ceph-mon[121113]: mon.smithi152@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-12-07T16:16:16.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:16.280+0000 7f32f27fc700 1 -- 172.21.15.152:0/2995553809 <== mon.0 v2:172.21.15.63:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1017 (secure 0 0 0) 0x7f32f8049220 con 0x7f32fc1028f0 2023-12-07T16:16:16.279 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-07T16:16:16.279 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":2,"fsid":"8c493298-951b-11ee-95a2-87774f69a715","modified":"2023-12-07T16:16:11.228664Z","created":"2023-12-07T16:14:01.402276Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi063","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-12-07T16:16:16.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:16.283+0000 7f3303c72700 1 -- 172.21.15.152:0/2995553809 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f32e80367c0 msgr2=0x7f32e8038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:16:16.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:16.283+0000 7f3303c72700 1 --2- 172.21.15.152:0/2995553809 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f32e80367c0 0x7f32e8038c70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f32ec009990 tx=0x7f32ec006e40 comp rx=0 tx=0).stop 2023-12-07T16:16:16.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:16.283+0000 7f3303c72700 1 -- 172.21.15.152:0/2995553809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32fc1028f0 msgr2=0x7f32fc112bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:16:16.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:16.283+0000 7f3303c72700 1 --2- 172.21.15.152:0/2995553809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32fc1028f0 0x7f32fc112bc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f32f8009300 tx=0x7f32f8009e30 comp rx=0 tx=0).stop 2023-12-07T16:16:16.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:16.283+0000 7f3303c72700 1 -- 172.21.15.152:0/2995553809 shutdown_connections 2023-12-07T16:16:16.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:16.283+0000 7f3303c72700 1 --2- 172.21.15.152:0/2995553809 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f32e80367c0 0x7f32e8038c70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:16.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:16.283+0000 7f3303c72700 1 --2- 172.21.15.152:0/2995553809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32fc1028f0 0x7f32fc112bc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:16.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:16.283+0000 7f3303c72700 1 -- 172.21.15.152:0/2995553809 >> 172.21.15.152:0/2995553809 conn(0x7f32fc071d60 msgr2=0x7f32fc103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:16:16.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:16.283+0000 7f3303c72700 1 -- 172.21.15.152:0/2995553809 shutdown_connections 2023-12-07T16:16:16.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:16:16.283+0000 7f3303c72700 1 -- 172.21.15.152:0/2995553809 wait complete. 2023-12-07T16:16:16.282 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 2 2023-12-07T16:16:16.643 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:16 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-07T16:16:16.643 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:16 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:16:16.643 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:16 smithi152 ceph-mon[121113]: mon.smithi063 calling monitor election 2023-12-07T16:16:16.643 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:16 smithi152 ceph-mon[121113]: from='client.? 172.21.15.152:0/2995553809' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:16:16.643 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:16 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:16:16.643 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:16 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:16:16.643 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:16 smithi152 ceph-mon[121113]: mon.smithi152 calling monitor election 2023-12-07T16:16:16.644 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:16 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:16:16.644 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:16 smithi152 ceph-mon[121113]: from='mgr.? 172.21.15.152:0/1014835728' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.sxayfb/crt"}]: dispatch 2023-12-07T16:16:16.644 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:16 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:16:16.644 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:16 smithi152 ceph-mon[121113]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:16.644 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:16 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:16:16.644 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:16 smithi152 ceph-mon[121113]: mon.smithi063 is new leader, mons smithi063,smithi152 in quorum (ranks 0,1) 2023-12-07T16:16:16.644 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:16 smithi152 ceph-mon[121113]: monmap e2: 2 mons at {smithi063=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0],smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-07T16:16:16.644 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:16 smithi152 ceph-mon[121113]: fsmap 2023-12-07T16:16:16.644 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:16 smithi152 ceph-mon[121113]: osdmap e5: 0 total, 0 up, 0 in 2023-12-07T16:16:16.644 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:16 smithi152 ceph-mon[121113]: mgrmap e17: smithi063.yohyyx(active, since 21s) 2023-12-07T16:16:16.645 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:16 smithi152 ceph-mon[121113]: Standby manager daemon smithi152.sxayfb started 2023-12-07T16:16:16.645 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:16 smithi152 ceph-mon[121113]: from='mgr.? 172.21.15.152:0/1014835728' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-07T16:16:16.645 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:16 smithi152 ceph-mon[121113]: overall HEALTH_OK 2023-12-07T16:16:16.645 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:16 smithi152 ceph-mon[121113]: from='mgr.? 172.21.15.152:0/1014835728' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.sxayfb/key"}]: dispatch 2023-12-07T16:16:16.645 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:16 smithi152 ceph-mon[121113]: from='mgr.? 172.21.15.152:0/1014835728' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-07T16:16:16.645 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:16 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:16.645 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:16 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:16.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:16 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-07T16:16:16.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:16 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:16:16.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:16 smithi063 ceph-mon[112095]: mon.smithi063 calling monitor election 2023-12-07T16:16:16.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:16 smithi063 ceph-mon[112095]: from='client.? 172.21.15.152:0/2995553809' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T16:16:16.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:16 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:16:16.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:16 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:16:16.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:16 smithi063 ceph-mon[112095]: mon.smithi152 calling monitor election 2023-12-07T16:16:16.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:16 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:16:16.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:16 smithi063 ceph-mon[112095]: from='mgr.? 172.21.15.152:0/1014835728' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.sxayfb/crt"}]: dispatch 2023-12-07T16:16:16.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:16 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:16:16.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:16 smithi063 ceph-mon[112095]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:16.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:16 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:16:16.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:16 smithi063 ceph-mon[112095]: mon.smithi063 is new leader, mons smithi063,smithi152 in quorum (ranks 0,1) 2023-12-07T16:16:16.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:16 smithi063 ceph-mon[112095]: monmap e2: 2 mons at {smithi063=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0],smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-07T16:16:16.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:16 smithi063 ceph-mon[112095]: fsmap 2023-12-07T16:16:16.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:16 smithi063 ceph-mon[112095]: osdmap e5: 0 total, 0 up, 0 in 2023-12-07T16:16:16.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:16 smithi063 ceph-mon[112095]: mgrmap e17: smithi063.yohyyx(active, since 21s) 2023-12-07T16:16:16.658 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:16 smithi063 ceph-mon[112095]: Standby manager daemon smithi152.sxayfb started 2023-12-07T16:16:16.658 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:16 smithi063 ceph-mon[112095]: from='mgr.? 172.21.15.152:0/1014835728' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-07T16:16:16.658 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:16 smithi063 ceph-mon[112095]: overall HEALTH_OK 2023-12-07T16:16:16.658 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:16 smithi063 ceph-mon[112095]: from='mgr.? 172.21.15.152:0/1014835728' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.sxayfb/key"}]: dispatch 2023-12-07T16:16:16.658 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:16 smithi063 ceph-mon[112095]: from='mgr.? 172.21.15.152:0/1014835728' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-07T16:16:16.658 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:16 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:16.658 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:16 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:16.665 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-12-07T16:16:16.665 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph config generate-minimal-conf 2023-12-07T16:16:16.948 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:16:17.404 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:17 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:17.405 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:17 smithi152 ceph-mon[121113]: mgrmap e18: smithi063.yohyyx(active, since 21s), standbys: smithi152.sxayfb 2023-12-07T16:16:17.405 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:17 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr metadata", "who": "smithi152.sxayfb", "id": "smithi152.sxayfb"}]: dispatch 2023-12-07T16:16:17.405 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:17 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:17.405 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:17 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:17.405 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:17 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:16:17.405 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:17 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:16:17.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:17 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:17.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:17 smithi063 ceph-mon[112095]: mgrmap e18: smithi063.yohyyx(active, since 21s), standbys: smithi152.sxayfb 2023-12-07T16:16:17.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:17 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr metadata", "who": "smithi152.sxayfb", "id": "smithi152.sxayfb"}]: dispatch 2023-12-07T16:16:17.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:17 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:17.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:17 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:17.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:17 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:16:17.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:17 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:16:18.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.028+0000 7f14f5a3c700 1 -- 172.21.15.63:0/1214584383 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f0102830 msgr2=0x7f14f0102c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:16:18.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.028+0000 7f14f5a3c700 1 --2- 172.21.15.63:0/1214584383 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f0102830 0x7f14f0102c00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f14e00048c0 tx=0x7f14e0009e30 comp rx=0 tx=0).stop 2023-12-07T16:16:18.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.028+0000 7f14f5a3c700 1 -- 172.21.15.63:0/1214584383 shutdown_connections 2023-12-07T16:16:18.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.028+0000 7f14f5a3c700 1 --2- 172.21.15.63:0/1214584383 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f0102830 0x7f14f0102c00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:18.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.028+0000 7f14f5a3c700 1 -- 172.21.15.63:0/1214584383 >> 172.21.15.63:0/1214584383 conn(0x7f14f0071cb0 msgr2=0x7f14f00720b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:16:18.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.028+0000 7f14f5a3c700 1 -- 172.21.15.63:0/1214584383 shutdown_connections 2023-12-07T16:16:18.027 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.028+0000 7f14f5a3c700 1 -- 172.21.15.63:0/1214584383 wait complete. 2023-12-07T16:16:18.028 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.029+0000 7f14f5a3c700 1 Processor -- start 2023-12-07T16:16:18.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.029+0000 7f14f5a3c700 1 -- start start 2023-12-07T16:16:18.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.029+0000 7f14f5a3c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f0102830 0x7f14f0112c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:16:18.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.029+0000 7f14f5a3c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14f01131c0 0x7f14f010cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:16:18.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.029+0000 7f14f5a3c700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f0113780 con 0x7f14f0102830 2023-12-07T16:16:18.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.029+0000 7f14f5a3c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f010d080 con 0x7f14f01131c0 2023-12-07T16:16:18.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.029+0000 7f14eeffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f0102830 0x7f14f0112c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:16:18.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.029+0000 7f14eeffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f0102830 0x7f14f0112c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36580/0 (socket says 172.21.15.63:36580) 2023-12-07T16:16:18.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.029+0000 7f14eeffd700 1 -- 172.21.15.63:0/1012100728 learned_addr learned my addr 172.21.15.63:0/1012100728 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:16:18.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.029+0000 7f14ee7fc700 1 --2- 172.21.15.63:0/1012100728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14f01131c0 0x7f14f010cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:16:18.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.030+0000 7f14ee7fc700 1 -- 172.21.15.63:0/1012100728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14f01131c0 msgr2=0x7f14f010cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-12-07T16:16:18.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.030+0000 7f14ee7fc700 1 -- 172.21.15.63:0/1012100728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14f01131c0 msgr2=0x7f14f010cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-07T16:16:18.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.030+0000 7f14ee7fc700 1 --2- 172.21.15.63:0/1012100728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14f01131c0 0x7f14f010cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-07T16:16:18.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.030+0000 7f14ee7fc700 1 --2- 172.21.15.63:0/1012100728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14f01131c0 0x7f14f010cb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-07T16:16:18.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.030+0000 7f14eeffd700 1 -- 172.21.15.63:0/1012100728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14f01131c0 msgr2=0x7f14f010cb40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-07T16:16:18.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.030+0000 7f14eeffd700 1 --2- 172.21.15.63:0/1012100728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14f01131c0 0x7f14f010cb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:18.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.030+0000 7f14eeffd700 1 -- 172.21.15.63:0/1012100728 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e0005040 con 0x7f14f0102830 2023-12-07T16:16:18.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.030+0000 7f14eeffd700 1 --2- 172.21.15.63:0/1012100728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f0102830 0x7f14f0112c80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f14e000bfe0 tx=0x7f14e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:16:18.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.030+0000 7f14d77fe700 1 -- 172.21.15.63:0/1012100728 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14e000e040 con 0x7f14f0102830 2023-12-07T16:16:18.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.030+0000 7f14d77fe700 1 -- 172.21.15.63:0/1012100728 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f14e0013420 con 0x7f14f0102830 2023-12-07T16:16:18.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.030+0000 7f14f5a3c700 1 -- 172.21.15.63:0/1012100728 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f010d300 con 0x7f14f0102830 2023-12-07T16:16:18.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.030+0000 7f14d77fe700 1 -- 172.21.15.63:0/1012100728 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14e001c630 con 0x7f14f0102830 2023-12-07T16:16:18.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.030+0000 7f14f5a3c700 1 -- 172.21.15.63:0/1012100728 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f010d840 con 0x7f14f0102830 2023-12-07T16:16:18.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.031+0000 7f14f5a3c700 1 -- 172.21.15.63:0/1012100728 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14f005f270 con 0x7f14f0102830 2023-12-07T16:16:18.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.032+0000 7f14d77fe700 1 -- 172.21.15.63:0/1012100728 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f14e00139e0 con 0x7f14f0102830 2023-12-07T16:16:18.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.032+0000 7f14d77fe700 1 --2- 172.21.15.63:0/1012100728 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f14d8069030 0x7f14d806b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:16:18.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.032+0000 7f14d77fe700 1 -- 172.21.15.63:0/1012100728 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f14e0086f20 con 0x7f14f0102830 2023-12-07T16:16:18.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.032+0000 7f14ee7fc700 1 --2- 172.21.15.63:0/1012100728 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f14d8069030 0x7f14d806b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:16:18.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.033+0000 7f14ee7fc700 1 --2- 172.21.15.63:0/1012100728 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f14d8069030 0x7f14d806b4e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f14e4006f30 tx=0x7f14e4008040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:16:18.035 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.037+0000 7f14d77fe700 1 -- 172.21.15.63:0/1012100728 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f14e0058000 con 0x7f14f0102830 2023-12-07T16:16:18.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.259+0000 7f14f5a3c700 1 -- 172.21.15.63:0/1012100728 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f14f010e1f0 con 0x7f14f0102830 2023-12-07T16:16:18.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.260+0000 7f14d77fe700 1 -- 172.21.15.63:0/1012100728 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f14e0057b90 con 0x7f14f0102830 2023-12-07T16:16:18.258 INFO:teuthology.orchestra.run.smithi063.stdout:# minimal ceph.conf for 8c493298-951b-11ee-95a2-87774f69a715 2023-12-07T16:16:18.258 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2023-12-07T16:16:18.258 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 8c493298-951b-11ee-95a2-87774f69a715 2023-12-07T16:16:18.258 INFO:teuthology.orchestra.run.smithi063.stdout: mon_host = [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2023-12-07T16:16:18.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.262+0000 7f14f5a3c700 1 -- 172.21.15.63:0/1012100728 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f14d8069030 msgr2=0x7f14d806b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:16:18.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.262+0000 7f14f5a3c700 1 --2- 172.21.15.63:0/1012100728 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f14d8069030 0x7f14d806b4e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f14e4006f30 tx=0x7f14e4008040 comp rx=0 tx=0).stop 2023-12-07T16:16:18.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.262+0000 7f14f5a3c700 1 -- 172.21.15.63:0/1012100728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f0102830 msgr2=0x7f14f0112c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:16:18.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.262+0000 7f14f5a3c700 1 --2- 172.21.15.63:0/1012100728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f0102830 0x7f14f0112c80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f14e000bfe0 tx=0x7f14e0009e30 comp rx=0 tx=0).stop 2023-12-07T16:16:18.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.262+0000 7f14f5a3c700 1 -- 172.21.15.63:0/1012100728 shutdown_connections 2023-12-07T16:16:18.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.262+0000 7f14f5a3c700 1 --2- 172.21.15.63:0/1012100728 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f14d8069030 0x7f14d806b4e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:18.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.262+0000 7f14f5a3c700 1 --2- 172.21.15.63:0/1012100728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14f0102830 0x7f14f0112c80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:18.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.262+0000 7f14f5a3c700 1 --2- 172.21.15.63:0/1012100728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14f01131c0 0x7f14f010cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:18.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.262+0000 7f14f5a3c700 1 -- 172.21.15.63:0/1012100728 >> 172.21.15.63:0/1012100728 conn(0x7f14f0071cb0 msgr2=0x7f14f0103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:16:18.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.262+0000 7f14f5a3c700 1 -- 172.21.15.63:0/1012100728 shutdown_connections 2023-12-07T16:16:18.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:18.262+0000 7f14f5a3c700 1 -- 172.21.15.63:0/1012100728 wait complete. 2023-12-07T16:16:18.556 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:18 smithi063 ceph-mon[112095]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:18.556 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:18 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:18.557 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:18 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:18.557 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:18 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:18.557 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:18 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:16:18.557 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:18 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:18.557 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:18 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:18.557 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:18 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:18.557 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:18 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:18.557 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:18 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:18.557 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:18 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/1012100728' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:18.557 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:18 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-07T16:16:18.557 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:18 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-07T16:16:18.558 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:18 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:18.643 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-12-07T16:16:18.643 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-07T16:16:18.643 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.conf 2023-12-07T16:16:18.675 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-07T16:16:18.675 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-07T16:16:18.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:18 smithi152 ceph-mon[121113]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:18.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:18 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:18.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:18 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:18.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:18 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:18.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:18 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:16:18.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:18 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:18.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:18 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:18.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:18 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:18.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:18 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:18.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:18 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:18.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:18 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/1012100728' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:18.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:18 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-07T16:16:18.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:18 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-07T16:16:18.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:18 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:18.746 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-07T16:16:18.746 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.conf 2023-12-07T16:16:18.779 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-07T16:16:18.779 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-07T16:16:18.847 INFO:tasks.cephadm:Deploying OSDs... 2023-12-07T16:16:18.847 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-07T16:16:18.848 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/scratch_devs of=/dev/stdout 2023-12-07T16:16:18.867 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-07T16:16:18.867 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_1 2023-12-07T16:16:18.925 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-07T16:16:18.925 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T16:16:18.925 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 391828 Links: 1 2023-12-07T16:16:18.925 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T16:16:18.925 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2023-12-07T16:16:18.925 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2023-12-07 16:15:45.180710921 +0000 2023-12-07T16:16:18.925 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2023-12-07 15:59:26.255052585 +0000 2023-12-07T16:16:18.925 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2023-12-07 15:59:26.255052585 +0000 2023-12-07T16:16:18.926 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: - 2023-12-07T16:16:18.926 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-07T16:16:18.993 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2023-12-07T16:16:18.993 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2023-12-07T16:16:18.993 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000238065 s, 2.2 MB/s 2023-12-07T16:16:18.994 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-07T16:16:19.055 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_2 2023-12-07T16:16:19.113 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-07T16:16:19.113 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T16:16:19.113 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 386836 Links: 1 2023-12-07T16:16:19.113 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T16:16:19.113 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2023-12-07T16:16:19.113 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2023-12-07 16:15:45.180710921 +0000 2023-12-07T16:16:19.113 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2023-12-07 15:59:26.767047460 +0000 2023-12-07T16:16:19.114 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2023-12-07 15:59:26.767047460 +0000 2023-12-07T16:16:19.114 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: - 2023-12-07T16:16:19.114 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-07T16:16:19.185 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2023-12-07T16:16:19.185 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2023-12-07T16:16:19.186 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000319546 s, 1.6 MB/s 2023-12-07T16:16:19.187 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-07T16:16:19.247 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_3 2023-12-07T16:16:19.307 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-07T16:16:19.307 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T16:16:19.307 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 396862 Links: 1 2023-12-07T16:16:19.308 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T16:16:19.308 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2023-12-07T16:16:19.308 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2023-12-07 16:15:45.180710921 +0000 2023-12-07T16:16:19.308 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2023-12-07 15:59:27.259042536 +0000 2023-12-07T16:16:19.308 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2023-12-07 15:59:27.259042536 +0000 2023-12-07T16:16:19.308 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: - 2023-12-07T16:16:19.308 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-07T16:16:19.376 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2023-12-07T16:16:19.376 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2023-12-07T16:16:19.376 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000215534 s, 2.4 MB/s 2023-12-07T16:16:19.377 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-07T16:16:19.437 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_4 2023-12-07T16:16:19.497 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-07T16:16:19.497 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T16:16:19.497 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 394133 Links: 1 2023-12-07T16:16:19.497 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T16:16:19.497 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2023-12-07T16:16:19.498 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2023-12-07 16:15:45.180710921 +0000 2023-12-07T16:16:19.498 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2023-12-07 15:59:27.751037611 +0000 2023-12-07T16:16:19.498 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2023-12-07 15:59:27.751037611 +0000 2023-12-07T16:16:19.498 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: - 2023-12-07T16:16:19.498 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-07T16:16:19.564 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:19 smithi063 ceph-mon[112095]: Updating smithi063:/etc/ceph/ceph.conf 2023-12-07T16:16:19.564 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:19 smithi063 ceph-mon[112095]: Updating smithi152:/etc/ceph/ceph.conf 2023-12-07T16:16:19.564 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:19 smithi063 ceph-mon[112095]: Updating smithi152:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-07T16:16:19.564 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:19 smithi063 ceph-mon[112095]: Updating smithi063:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-07T16:16:19.565 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:19 smithi063 ceph-mon[112095]: Reconfiguring mon.smithi063 (unknown last config time)... 2023-12-07T16:16:19.565 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:19 smithi063 ceph-mon[112095]: Reconfiguring daemon mon.smithi063 on smithi063 2023-12-07T16:16:19.565 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:19 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:19.565 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:19 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:19.565 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:19 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi063.yohyyx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-07T16:16:19.565 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:19 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-07T16:16:19.565 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:19 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:19.566 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2023-12-07T16:16:19.566 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2023-12-07T16:16:19.566 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000218142 s, 2.3 MB/s 2023-12-07T16:16:19.568 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-07T16:16:19.627 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-07T16:16:19.627 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout 2023-12-07T16:16:19.649 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-07T16:16:19.650 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_1 2023-12-07T16:16:19.711 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-07T16:16:19.711 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T16:16:19.711 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 397373 Links: 1 2023-12-07T16:16:19.711 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T16:16:19.712 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2023-12-07T16:16:19.712 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-12-07 16:16:10.691708213 +0000 2023-12-07T16:16:19.712 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-12-07 15:59:10.610356306 +0000 2023-12-07T16:16:19.712 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-12-07 15:59:10.610356306 +0000 2023-12-07T16:16:19.712 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2023-12-07T16:16:19.712 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-07T16:16:19.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:19 smithi152 ceph-mon[121113]: Updating smithi063:/etc/ceph/ceph.conf 2023-12-07T16:16:19.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:19 smithi152 ceph-mon[121113]: Updating smithi152:/etc/ceph/ceph.conf 2023-12-07T16:16:19.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:19 smithi152 ceph-mon[121113]: Updating smithi152:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-07T16:16:19.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:19 smithi152 ceph-mon[121113]: Updating smithi063:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-07T16:16:19.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:19 smithi152 ceph-mon[121113]: Reconfiguring mon.smithi063 (unknown last config time)... 2023-12-07T16:16:19.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:19 smithi152 ceph-mon[121113]: Reconfiguring daemon mon.smithi063 on smithi063 2023-12-07T16:16:19.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:19 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:19.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:19 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:19.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:19 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi063.yohyyx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-07T16:16:19.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:19 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-07T16:16:19.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:19 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:19.773 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-12-07T16:16:19.773 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-12-07T16:16:19.773 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000210551 s, 2.4 MB/s 2023-12-07T16:16:19.774 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-07T16:16:19.836 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_2 2023-12-07T16:16:19.896 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-07T16:16:19.896 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T16:16:19.896 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 392041 Links: 1 2023-12-07T16:16:19.896 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T16:16:19.896 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2023-12-07T16:16:19.896 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-12-07 16:16:10.691708213 +0000 2023-12-07T16:16:19.896 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-12-07 15:59:11.086350624 +0000 2023-12-07T16:16:19.896 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-12-07 15:59:11.086350624 +0000 2023-12-07T16:16:19.896 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2023-12-07T16:16:19.897 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-07T16:16:19.964 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-12-07T16:16:19.964 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-12-07T16:16:19.964 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000199749 s, 2.6 MB/s 2023-12-07T16:16:19.965 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-07T16:16:20.026 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_3 2023-12-07T16:16:20.086 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-07T16:16:20.086 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T16:16:20.087 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 392139 Links: 1 2023-12-07T16:16:20.087 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T16:16:20.087 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2023-12-07T16:16:20.087 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-12-07 16:16:10.691708213 +0000 2023-12-07T16:16:20.087 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-12-07 15:59:11.567344882 +0000 2023-12-07T16:16:20.087 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-12-07 15:59:11.567344882 +0000 2023-12-07T16:16:20.087 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2023-12-07T16:16:20.087 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-07T16:16:20.154 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-12-07T16:16:20.154 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-12-07T16:16:20.155 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000212356 s, 2.4 MB/s 2023-12-07T16:16:20.156 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-07T16:16:20.215 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_4 2023-12-07T16:16:20.274 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-07T16:16:20.274 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T16:16:20.275 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 398619 Links: 1 2023-12-07T16:16:20.275 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T16:16:20.275 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2023-12-07T16:16:20.275 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-12-07 16:16:10.691708213 +0000 2023-12-07T16:16:20.275 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-12-07 15:59:12.058339021 +0000 2023-12-07T16:16:20.275 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-12-07 15:59:12.058339021 +0000 2023-12-07T16:16:20.275 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2023-12-07T16:16:20.275 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-07T16:16:20.341 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-12-07T16:16:20.341 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-12-07T16:16:20.341 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000234428 s, 2.2 MB/s 2023-12-07T16:16:20.342 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-07T16:16:20.402 INFO:tasks.cephadm:Deploying osd.0 on smithi063 with /dev/vg_nvme/lv_4... 2023-12-07T16:16:20.402 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-07T16:16:20.427 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:20 smithi063 ceph-mon[112095]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:20.427 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:20 smithi063 ceph-mon[112095]: Reconfiguring mgr.smithi063.yohyyx (unknown last config time)... 2023-12-07T16:16:20.427 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:20 smithi063 ceph-mon[112095]: Reconfiguring daemon mgr.smithi063.yohyyx on smithi063 2023-12-07T16:16:20.428 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:20 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:20.428 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:20 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:20.428 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:20 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:20.428 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:20 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi063", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-07T16:16:20.428 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:20 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:20.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:20 smithi152 ceph-mon[121113]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:20.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:20 smithi152 ceph-mon[121113]: Reconfiguring mgr.smithi063.yohyyx (unknown last config time)... 2023-12-07T16:16:20.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:20 smithi152 ceph-mon[121113]: Reconfiguring daemon mgr.smithi063.yohyyx on smithi063 2023-12-07T16:16:20.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:20 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:20.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:20 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:20.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:20 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:20.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:20 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi063", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-07T16:16:20.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:20 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:21.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:21 smithi063 ceph-mon[112095]: Reconfiguring crash.smithi063 (monmap changed)... 2023-12-07T16:16:21.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:21 smithi063 ceph-mon[112095]: Reconfiguring daemon crash.smithi063 on smithi063 2023-12-07T16:16:21.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:21 smithi152 ceph-mon[121113]: Reconfiguring crash.smithi063 (monmap changed)... 2023-12-07T16:16:21.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:21 smithi152 ceph-mon[121113]: Reconfiguring daemon crash.smithi063 on smithi063 2023-12-07T16:16:21.835 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:16:22.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:22 smithi063 ceph-mon[112095]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:22.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:22 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:22.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:22 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:22.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:22 smithi152 ceph-mon[121113]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:22.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:22 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:22.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:22 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:23.267 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-07T16:16:23.267 INFO:teuthology.orchestra.run.smithi063.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-07T16:16:23.267 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 10+0 records in 2023-12-07T16:16:23.268 INFO:teuthology.orchestra.run.smithi063.stderr:10+0 records out 2023-12-07T16:16:23.268 INFO:teuthology.orchestra.run.smithi063.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110478 s, 949 MB/s 2023-12-07T16:16:23.268 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping successful for: 2023-12-07T16:16:23.461 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:23 smithi063 ceph-mon[112095]: Reconfiguring alertmanager.smithi063 (dependencies changed)... 2023-12-07T16:16:23.461 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:23 smithi063 ceph-mon[112095]: Reconfiguring daemon alertmanager.smithi063 on smithi063 2023-12-07T16:16:23.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:23 smithi152 ceph-mon[121113]: Reconfiguring alertmanager.smithi063 (dependencies changed)... 2023-12-07T16:16:23.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:23 smithi152 ceph-mon[121113]: Reconfiguring daemon alertmanager.smithi063 on smithi063 2023-12-07T16:16:23.851 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi063:vg_nvme/lv_4 2023-12-07T16:16:24.170 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:16:24.577 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:24 smithi063 ceph-mon[112095]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:24.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:24 smithi152 ceph-mon[121113]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:25.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.473+0000 7fd7fa8c6700 1 -- 172.21.15.63:0/2538146717 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7f40fbaf0 msgr2=0x7fd7f40fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:16:25.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.473+0000 7fd7fa8c6700 1 --2- 172.21.15.63:0/2538146717 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7f40fbaf0 0x7fd7f40fbf00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4004940 tx=0x7fd7e4009e30 comp rx=0 tx=0).stop 2023-12-07T16:16:25.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.473+0000 7fd7fa8c6700 1 -- 172.21.15.63:0/2538146717 shutdown_connections 2023-12-07T16:16:25.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.473+0000 7fd7fa8c6700 1 --2- 172.21.15.63:0/2538146717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7f40fcd00 0x7fd7f40fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:25.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.473+0000 7fd7fa8c6700 1 --2- 172.21.15.63:0/2538146717 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7f40fbaf0 0x7fd7f40fbf00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:25.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.473+0000 7fd7fa8c6700 1 -- 172.21.15.63:0/2538146717 >> 172.21.15.63:0/2538146717 conn(0x7fd7f40f71b0 msgr2=0x7fd7f40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:16:25.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.473+0000 7fd7fa8c6700 1 -- 172.21.15.63:0/2538146717 shutdown_connections 2023-12-07T16:16:25.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.473+0000 7fd7fa8c6700 1 -- 172.21.15.63:0/2538146717 wait complete. 2023-12-07T16:16:25.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.474+0000 7fd7fa8c6700 1 Processor -- start 2023-12-07T16:16:25.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.474+0000 7fd7fa8c6700 1 -- start start 2023-12-07T16:16:25.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.474+0000 7fd7fa8c6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7f40fbaf0 0x7fd7f4100450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:16:25.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.474+0000 7fd7fa8c6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7f40fcd00 0x7fd7f40fe8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:16:25.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.474+0000 7fd7fa8c6700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f40feed0 con 0x7fd7f40fbaf0 2023-12-07T16:16:25.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.474+0000 7fd7fa8c6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f40ff040 con 0x7fd7f40fcd00 2023-12-07T16:16:25.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.474+0000 7fd7f3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7f40fbaf0 0x7fd7f4100450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:16:25.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.474+0000 7fd7f3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7f40fbaf0 0x7fd7f4100450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43660/0 (socket says 172.21.15.63:43660) 2023-12-07T16:16:25.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.474+0000 7fd7f3fff700 1 -- 172.21.15.63:0/689337092 learned_addr learned my addr 172.21.15.63:0/689337092 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:16:25.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.474+0000 7fd7f37fe700 1 --2- 172.21.15.63:0/689337092 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7f40fcd00 0x7fd7f40fe8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:16:25.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.474+0000 7fd7f3fff700 1 -- 172.21.15.63:0/689337092 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7f40fcd00 msgr2=0x7fd7f40fe8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:16:25.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.474+0000 7fd7f3fff700 1 --2- 172.21.15.63:0/689337092 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7f40fcd00 0x7fd7f40fe8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:25.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.474+0000 7fd7f3fff700 1 -- 172.21.15.63:0/689337092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e4005040 con 0x7fd7f40fbaf0 2023-12-07T16:16:25.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.475+0000 7fd7f3fff700 1 --2- 172.21.15.63:0/689337092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7f40fbaf0 0x7fd7f4100450 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009360 tx=0x7fd7e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:16:25.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.475+0000 7fd7f0ff9700 1 -- 172.21.15.63:0/689337092 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7e400e040 con 0x7fd7f40fbaf0 2023-12-07T16:16:25.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.475+0000 7fd7f0ff9700 1 -- 172.21.15.63:0/689337092 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd7e4004290 con 0x7fd7f40fbaf0 2023-12-07T16:16:25.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.475+0000 7fd7fa8c6700 1 -- 172.21.15.63:0/689337092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f40ff2c0 con 0x7fd7f40fbaf0 2023-12-07T16:16:25.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.475+0000 7fd7f0ff9700 1 -- 172.21.15.63:0/689337092 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7e401c630 con 0x7fd7f40fbaf0 2023-12-07T16:16:25.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.475+0000 7fd7fa8c6700 1 -- 172.21.15.63:0/689337092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f4115580 con 0x7fd7f40fbaf0 2023-12-07T16:16:25.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.476+0000 7fd7fa8c6700 1 -- 172.21.15.63:0/689337092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f404bb80 con 0x7fd7f40fbaf0 2023-12-07T16:16:25.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.476+0000 7fd7f0ff9700 1 -- 172.21.15.63:0/689337092 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7fd7e4013960 con 0x7fd7f40fbaf0 2023-12-07T16:16:25.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.477+0000 7fd7f0ff9700 1 --2- 172.21.15.63:0/689337092 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd7dc068ed0 0x7fd7dc06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:16:25.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.477+0000 7fd7f0ff9700 1 -- 172.21.15.63:0/689337092 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fd7e4086f20 con 0x7fd7f40fbaf0 2023-12-07T16:16:25.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.477+0000 7fd7f37fe700 1 --2- 172.21.15.63:0/689337092 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd7dc068ed0 0x7fd7dc06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:16:25.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.478+0000 7fd7f37fe700 1 --2- 172.21.15.63:0/689337092 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd7dc068ed0 0x7fd7dc06b380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8007fd0 tx=0x7fd7e8009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:16:25.479 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.482+0000 7fd7f0ff9700 1 -- 172.21.15.63:0/689337092 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd7e4058000 con 0x7fd7f40fbaf0 2023-12-07T16:16:25.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:25 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:16:25.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:25.694+0000 7fd7fa8c6700 1 -- 172.21.15.63:0/689337092 --> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7f41009c0 con 0x7fd7dc068ed0 2023-12-07T16:16:25.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:25 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:16:26.424 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:26 smithi063 ceph-mon[112095]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:26.424 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:26 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-07T16:16:26.424 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:26 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-07T16:16:26.424 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:26 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:26.424 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:26 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:26.425 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:26 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:26.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:26 smithi152 ceph-mon[121113]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:26.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:26 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-07T16:16:26.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:26 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-07T16:16:26.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:26 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:26.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:26 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:26.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:26 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:27.555 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:27 smithi063 ceph-mon[112095]: from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:16:27.555 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:27 smithi063 ceph-mon[112095]: Reconfiguring grafana.smithi063 (dependencies changed)... 2023-12-07T16:16:27.555 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:27 smithi063 ceph-mon[112095]: Reconfiguring daemon grafana.smithi063 on smithi063 2023-12-07T16:16:27.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:27 smithi152 ceph-mon[121113]: from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:16:27.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:27 smithi152 ceph-mon[121113]: Reconfiguring grafana.smithi063 (dependencies changed)... 2023-12-07T16:16:27.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:27 smithi152 ceph-mon[121113]: Reconfiguring daemon grafana.smithi063 on smithi063 2023-12-07T16:16:28.535 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:28 smithi063 ceph-mon[112095]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:28.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:28 smithi152 ceph-mon[121113]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:29.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:29 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:29.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:29 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:29.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:29 smithi152 ceph-mon[121113]: Reconfiguring prometheus.smithi063 (dependencies changed)... 2023-12-07T16:16:29.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:29 smithi152 ceph-mon[121113]: Reconfiguring daemon prometheus.smithi063 on smithi063 2023-12-07T16:16:29.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:29 smithi152 ceph-mon[121113]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:29.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:29 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/1792683752' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8cce319-d8dc-49e7-8596-ba27cc0f8836"}]: dispatch 2023-12-07T16:16:29.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:29 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/1792683752' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d8cce319-d8dc-49e7-8596-ba27cc0f8836"}]': finished 2023-12-07T16:16:29.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:29 smithi152 ceph-mon[121113]: osdmap e6: 1 total, 0 up, 1 in 2023-12-07T16:16:29.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:29 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-07T16:16:30.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:29 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:30.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:29 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:30.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:29 smithi063 ceph-mon[112095]: Reconfiguring prometheus.smithi063 (dependencies changed)... 2023-12-07T16:16:30.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:29 smithi063 ceph-mon[112095]: Reconfiguring daemon prometheus.smithi063 on smithi063 2023-12-07T16:16:30.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:29 smithi063 ceph-mon[112095]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:30.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:29 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/1792683752' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8cce319-d8dc-49e7-8596-ba27cc0f8836"}]: dispatch 2023-12-07T16:16:30.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:29 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/1792683752' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d8cce319-d8dc-49e7-8596-ba27cc0f8836"}]': finished 2023-12-07T16:16:30.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:29 smithi063 ceph-mon[112095]: osdmap e6: 1 total, 0 up, 1 in 2023-12-07T16:16:30.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:29 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-07T16:16:30.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:30 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/2372253743' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-07T16:16:31.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:30 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2372253743' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-07T16:16:31.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:31 smithi152 ceph-mon[121113]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:32.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:31 smithi063 ceph-mon[112095]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:34.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:34 smithi063 ceph-mon[112095]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:34.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:34 smithi152 ceph-mon[121113]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:36.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:36 smithi063 ceph-mon[112095]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:36.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:36 smithi152 ceph-mon[121113]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:38.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:38 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:38.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:38 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:38.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:38 smithi152 ceph-mon[121113]: Reconfiguring crash.smithi152 (monmap changed)... 2023-12-07T16:16:38.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:38 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-07T16:16:38.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:38 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:38.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:38 smithi152 ceph-mon[121113]: Reconfiguring daemon crash.smithi152 on smithi152 2023-12-07T16:16:38.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:38 smithi152 ceph-mon[121113]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:38.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:38 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-07T16:16:38.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:38 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:38.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:38 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:38.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:38 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:38.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:38 smithi063 ceph-mon[112095]: Reconfiguring crash.smithi152 (monmap changed)... 2023-12-07T16:16:38.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:38 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-07T16:16:38.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:38 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:38.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:38 smithi063 ceph-mon[112095]: Reconfiguring daemon crash.smithi152 on smithi152 2023-12-07T16:16:38.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:38 smithi063 ceph-mon[112095]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:38.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:38 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-07T16:16:38.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:38 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:39.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:39 smithi063 ceph-mon[112095]: Deploying daemon osd.0 on smithi063 2023-12-07T16:16:39.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:39 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:39.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:39 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:39.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:39 smithi063 ceph-mon[112095]: Reconfiguring mgr.smithi152.sxayfb (monmap changed)... 2023-12-07T16:16:39.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:39 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.sxayfb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-07T16:16:39.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:39 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-07T16:16:39.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:39 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:39.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:39 smithi063 ceph-mon[112095]: Reconfiguring daemon mgr.smithi152.sxayfb on smithi152 2023-12-07T16:16:39.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:39 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:39.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:39 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:39.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:39 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-07T16:16:39.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:39 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-07T16:16:39.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:39 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:39.461 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:39 smithi152 ceph-mon[121113]: Deploying daemon osd.0 on smithi063 2023-12-07T16:16:39.461 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:39 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:39.461 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:39 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:39.461 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:39 smithi152 ceph-mon[121113]: Reconfiguring mgr.smithi152.sxayfb (monmap changed)... 2023-12-07T16:16:39.461 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:39 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.sxayfb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-07T16:16:39.461 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:39 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-07T16:16:39.461 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:39 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:39.461 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:39 smithi152 ceph-mon[121113]: Reconfiguring daemon mgr.smithi152.sxayfb on smithi152 2023-12-07T16:16:39.461 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:39 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:39.461 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:39 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:39.461 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:39 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-07T16:16:39.461 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:39 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-07T16:16:39.462 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:39 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:40.358 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:40 smithi063 ceph-mon[112095]: Reconfiguring mon.smithi152 (monmap changed)... 2023-12-07T16:16:40.358 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:40 smithi063 ceph-mon[112095]: Reconfiguring daemon mon.smithi152 on smithi152 2023-12-07T16:16:40.358 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:40 smithi063 ceph-mon[112095]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:40.359 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:40 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:40.359 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:40 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:40.359 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:40 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-07T16:16:40.359 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:40 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi063.front.sepia.ceph.com:9093"}]: dispatch 2023-12-07T16:16:40.359 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:40 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:40.359 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:40 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-07T16:16:40.359 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:40 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi063.front.sepia.ceph.com:3000"}]: dispatch 2023-12-07T16:16:40.359 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:40 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:40.359 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:40 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-07T16:16:40.359 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:40 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi063.front.sepia.ceph.com:9095"}]: dispatch 2023-12-07T16:16:40.360 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:40 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:40.360 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:40 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:16:40.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:40 smithi152 ceph-mon[121113]: Reconfiguring mon.smithi152 (monmap changed)... 2023-12-07T16:16:40.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:40 smithi152 ceph-mon[121113]: Reconfiguring daemon mon.smithi152 on smithi152 2023-12-07T16:16:40.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:40 smithi152 ceph-mon[121113]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:40.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:40 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:40.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:40 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:40.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:40 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-07T16:16:40.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:40 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi063.front.sepia.ceph.com:9093"}]: dispatch 2023-12-07T16:16:40.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:40 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:40.494 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:40 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-07T16:16:40.494 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:40 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi063.front.sepia.ceph.com:3000"}]: dispatch 2023-12-07T16:16:40.494 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:40 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:40.494 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:40 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-07T16:16:40.494 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:40 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi063.front.sepia.ceph.com:9095"}]: dispatch 2023-12-07T16:16:40.494 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:40 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:40.494 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:40 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:16:41.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:41 smithi152 ceph-mon[121113]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-07T16:16:41.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:41 smithi152 ceph-mon[121113]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi063.front.sepia.ceph.com:9093"}]: dispatch 2023-12-07T16:16:41.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:41 smithi152 ceph-mon[121113]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-07T16:16:41.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:41 smithi152 ceph-mon[121113]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi063.front.sepia.ceph.com:3000"}]: dispatch 2023-12-07T16:16:41.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:41 smithi152 ceph-mon[121113]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-07T16:16:41.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:41 smithi152 ceph-mon[121113]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi063.front.sepia.ceph.com:9095"}]: dispatch 2023-12-07T16:16:41.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:41 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:16:41.369 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:41 smithi063 ceph-mon[112095]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-07T16:16:41.369 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:41 smithi063 ceph-mon[112095]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi063.front.sepia.ceph.com:9093"}]: dispatch 2023-12-07T16:16:41.369 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:41 smithi063 ceph-mon[112095]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-07T16:16:41.369 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:41 smithi063 ceph-mon[112095]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi063.front.sepia.ceph.com:3000"}]: dispatch 2023-12-07T16:16:41.369 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:41 smithi063 ceph-mon[112095]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-07T16:16:41.369 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:41 smithi063 ceph-mon[112095]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi063.front.sepia.ceph.com:9095"}]: dispatch 2023-12-07T16:16:41.369 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:41 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:16:42.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:42 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:42.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:42 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:42.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:42 smithi152 ceph-mon[121113]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:42.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:42 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:42.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:42 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:42.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:42 smithi063 ceph-mon[112095]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:43.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:43 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:43.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:43 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:43.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:43 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:43.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:43 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:44.587 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:44 smithi063 ceph-mon[112095]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:44.587 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:44 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:44.587 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:44 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:44.588 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:44 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:44.588 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:44 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:16:44.588 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:44 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:44.588 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:44 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:16:44.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:44.654+0000 7fd7f0ff9700 1 -- 172.21.15.63:0/689337092 <== mgr.14212 v2:172.21.15.63:6800/184283085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd7f41009c0 con 0x7fd7dc068ed0 2023-12-07T16:16:44.652 INFO:teuthology.orchestra.run.smithi063.stdout:Created osd(s) 0 on host 'smithi063' 2023-12-07T16:16:44.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:44.657+0000 7fd7fa8c6700 1 -- 172.21.15.63:0/689337092 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd7dc068ed0 msgr2=0x7fd7dc06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:16:44.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:44.657+0000 7fd7fa8c6700 1 --2- 172.21.15.63:0/689337092 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd7dc068ed0 0x7fd7dc06b380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8007fd0 tx=0x7fd7e8009040 comp rx=0 tx=0).stop 2023-12-07T16:16:44.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:44.657+0000 7fd7fa8c6700 1 -- 172.21.15.63:0/689337092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7f40fbaf0 msgr2=0x7fd7f4100450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:16:44.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:44.657+0000 7fd7fa8c6700 1 --2- 172.21.15.63:0/689337092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7f40fbaf0 0x7fd7f4100450 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009360 tx=0x7fd7e4009e30 comp rx=0 tx=0).stop 2023-12-07T16:16:44.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:44.657+0000 7fd7fa8c6700 1 -- 172.21.15.63:0/689337092 shutdown_connections 2023-12-07T16:16:44.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:44.657+0000 7fd7fa8c6700 1 --2- 172.21.15.63:0/689337092 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd7dc068ed0 0x7fd7dc06b380 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:44.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:44.657+0000 7fd7fa8c6700 1 --2- 172.21.15.63:0/689337092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7f40fbaf0 0x7fd7f4100450 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:44.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:44.657+0000 7fd7fa8c6700 1 --2- 172.21.15.63:0/689337092 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7f40fcd00 0x7fd7f40fe8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:44.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:44.657+0000 7fd7fa8c6700 1 -- 172.21.15.63:0/689337092 >> 172.21.15.63:0/689337092 conn(0x7fd7f40f71b0 msgr2=0x7fd7f40f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:16:44.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:44.657+0000 7fd7fa8c6700 1 -- 172.21.15.63:0/689337092 shutdown_connections 2023-12-07T16:16:44.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:44.657+0000 7fd7fa8c6700 1 -- 172.21.15.63:0/689337092 wait complete. 2023-12-07T16:16:44.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:44 smithi152 ceph-mon[121113]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:44.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:44 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:44.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:44 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:44.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:44 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:44.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:44 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:16:44.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:44 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:44.696 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:44 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:16:45.075 DEBUG:teuthology.orchestra.run.smithi063:osd.0> sudo journalctl -f -n 0 -u ceph-8c493298-951b-11ee-95a2-87774f69a715@osd.0.service 2023-12-07T16:16:45.078 INFO:tasks.cephadm:Deploying osd.1 on smithi063 with /dev/vg_nvme/lv_3... 2023-12-07T16:16:45.078 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-07T16:16:45.114 INFO:journalctl@ceph.osd.0.smithi063.stdout:-- Logs begin at Thu 2023-12-07 15:43:10 UTC. -- 2023-12-07T16:16:45.501 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:16:45.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:45 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:45.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:45 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:45.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:45 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:45.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:45 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:45.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:45 smithi063 ceph-mon[112095]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:45.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:45 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:45.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:45 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:45.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:45 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:45.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:45 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:45.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:45 smithi152 ceph-mon[121113]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:46.592 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:16:46 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-0[134949]: 2023-12-07T16:16:46.319+0000 7f5d36e1f540 -1 osd.0 0 log_to_monitors true 2023-12-07T16:16:47.119 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-07T16:16:47.119 INFO:teuthology.orchestra.run.smithi063.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-07T16:16:47.120 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 10+0 records in 2023-12-07T16:16:47.120 INFO:teuthology.orchestra.run.smithi063.stderr:10+0 records out 2023-12-07T16:16:47.120 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0109856 s, 954 MB/s 2023-12-07T16:16:47.120 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping successful for: 2023-12-07T16:16:47.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:47 smithi063 ceph-mon[112095]: from='osd.0 [v2:172.21.15.63:6802/2340994154,v1:172.21.15.63:6803/2340994154]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-07T16:16:47.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:47 smithi152 ceph-mon[121113]: from='osd.0 [v2:172.21.15.63:6802/2340994154,v1:172.21.15.63:6803/2340994154]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-07T16:16:47.632 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi063:vg_nvme/lv_3 2023-12-07T16:16:47.911 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:16:48.357 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:16:48 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-0[134949]: 2023-12-07T16:16:48.061+0000 7f5d2d604700 -1 osd.0 0 waiting for initial osdmap 2023-12-07T16:16:48.357 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:16:48 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-0[134949]: 2023-12-07T16:16:48.066+0000 7f5d263fb700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T16:16:48.358 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:48 smithi063 ceph-mon[112095]: from='osd.0 [v2:172.21.15.63:6802/2340994154,v1:172.21.15.63:6803/2340994154]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-07T16:16:48.358 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:48 smithi063 ceph-mon[112095]: osdmap e7: 1 total, 0 up, 1 in 2023-12-07T16:16:48.358 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:48 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-07T16:16:48.358 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:48 smithi063 ceph-mon[112095]: from='osd.0 [v2:172.21.15.63:6802/2340994154,v1:172.21.15.63:6803/2340994154]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-07T16:16:48.358 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:48 smithi063 ceph-mon[112095]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:48.358 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:48 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:48.358 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:48 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:48.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:48 smithi152 ceph-mon[121113]: from='osd.0 [v2:172.21.15.63:6802/2340994154,v1:172.21.15.63:6803/2340994154]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-07T16:16:48.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:48 smithi152 ceph-mon[121113]: osdmap e7: 1 total, 0 up, 1 in 2023-12-07T16:16:48.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:48 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-07T16:16:48.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:48 smithi152 ceph-mon[121113]: from='osd.0 [v2:172.21.15.63:6802/2340994154,v1:172.21.15.63:6803/2340994154]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-07T16:16:48.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:48 smithi152 ceph-mon[121113]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T16:16:48.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:48 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:48.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:48 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:49.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:49 smithi063 ceph-mon[112095]: from='osd.0 [v2:172.21.15.63:6802/2340994154,v1:172.21.15.63:6803/2340994154]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2023-12-07T16:16:49.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:49 smithi063 ceph-mon[112095]: osdmap e8: 1 total, 0 up, 1 in 2023-12-07T16:16:49.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:49 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-07T16:16:49.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:49 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-07T16:16:49.455 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.420+0000 7f030f91d700 1 -- 172.21.15.63:0/3260519943 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03080fd730 msgr2=0x7f03080ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:16:49.455 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.420+0000 7f030f91d700 1 --2- 172.21.15.63:0/3260519943 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03080fd730 0x7f03080ffb10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0304004940 tx=0x7f0304009e30 comp rx=0 tx=0).stop 2023-12-07T16:16:49.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.420+0000 7f030f91d700 1 -- 172.21.15.63:0/3260519943 shutdown_connections 2023-12-07T16:16:49.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.420+0000 7f030f91d700 1 --2- 172.21.15.63:0/3260519943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0308100050 0x7f0308102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:49.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.420+0000 7f030f91d700 1 --2- 172.21.15.63:0/3260519943 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03080fd730 0x7f03080ffb10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:49.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.420+0000 7f030f91d700 1 -- 172.21.15.63:0/3260519943 >> 172.21.15.63:0/3260519943 conn(0x7f03080f71d0 msgr2=0x7f03080f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:16:49.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.420+0000 7f030f91d700 1 -- 172.21.15.63:0/3260519943 shutdown_connections 2023-12-07T16:16:49.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.420+0000 7f030f91d700 1 -- 172.21.15.63:0/3260519943 wait complete. 2023-12-07T16:16:49.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.421+0000 7f030f91d700 1 Processor -- start 2023-12-07T16:16:49.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.421+0000 7f030f91d700 1 -- start start 2023-12-07T16:16:49.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.421+0000 7f030f91d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03080fd730 0x7f030810f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:16:49.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.421+0000 7f030f91d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0308100050 0x7f030810fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:16:49.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.421+0000 7f030f91d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0308110190 con 0x7f03080fd730 2023-12-07T16:16:49.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.421+0000 7f030f91d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0308110a30 con 0x7f0308100050 2023-12-07T16:16:49.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.421+0000 7f030d6b9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03080fd730 0x7f030810f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:16:49.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.421+0000 7f030d6b9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03080fd730 0x7f030810f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35152/0 (socket says 172.21.15.63:35152) 2023-12-07T16:16:49.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.421+0000 7f030d6b9700 1 -- 172.21.15.63:0/1593836227 learned_addr learned my addr 172.21.15.63:0/1593836227 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:16:49.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.421+0000 7f030ceb8700 1 --2- 172.21.15.63:0/1593836227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0308100050 0x7f030810fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:16:49.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.421+0000 7f030d6b9700 1 -- 172.21.15.63:0/1593836227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0308100050 msgr2=0x7f030810fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:16:49.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.421+0000 7f030d6b9700 1 --2- 172.21.15.63:0/1593836227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0308100050 0x7f030810fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:16:49.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.422+0000 7f030d6b9700 1 -- 172.21.15.63:0/1593836227 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0304005040 con 0x7f03080fd730 2023-12-07T16:16:49.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.422+0000 7f030d6b9700 1 --2- 172.21.15.63:0/1593836227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03080fd730 0x7f030810f650 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f030400b3b0 tx=0x7f0304009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:16:49.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.422+0000 7f02fdffb700 1 -- 172.21.15.63:0/1593836227 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f030400e040 con 0x7f03080fd730 2023-12-07T16:16:49.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.422+0000 7f02fdffb700 1 -- 172.21.15.63:0/1593836227 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f030400bc50 con 0x7f03080fd730 2023-12-07T16:16:49.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.422+0000 7f030f91d700 1 -- 172.21.15.63:0/1593836227 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0308110cb0 con 0x7f03080fd730 2023-12-07T16:16:49.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.422+0000 7f02fdffb700 1 -- 172.21.15.63:0/1593836227 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f030401c630 con 0x7f03080fd730 2023-12-07T16:16:49.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.422+0000 7f030f91d700 1 -- 172.21.15.63:0/1593836227 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03081111f0 con 0x7f03080fd730 2023-12-07T16:16:49.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.423+0000 7f030f91d700 1 -- 172.21.15.63:0/1593836227 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030804bb80 con 0x7f03080fd730 2023-12-07T16:16:49.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.424+0000 7f02fdffb700 1 -- 172.21.15.63:0/1593836227 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f0304013420 con 0x7f03080fd730 2023-12-07T16:16:49.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.424+0000 7f02fdffb700 1 --2- 172.21.15.63:0/1593836227 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f02f4068ed0 0x7f02f406b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:16:49.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.425+0000 7f02fdffb700 1 -- 172.21.15.63:0/1593836227 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f0304087e80 con 0x7f03080fd730 2023-12-07T16:16:49.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.425+0000 7f030ceb8700 1 --2- 172.21.15.63:0/1593836227 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f02f4068ed0 0x7f02f406b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:16:49.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.425+0000 7f030ceb8700 1 --2- 172.21.15.63:0/1593836227 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f02f4068ed0 0x7f02f406b380 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f02f8009fd0 tx=0x7f02f800b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:16:49.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.428+0000 7f02fdffb700 1 -- 172.21.15.63:0/1593836227 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0304058c40 con 0x7f03080fd730 2023-12-07T16:16:49.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:49 smithi152 ceph-mon[121113]: from='osd.0 [v2:172.21.15.63:6802/2340994154,v1:172.21.15.63:6803/2340994154]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2023-12-07T16:16:49.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:49 smithi152 ceph-mon[121113]: osdmap e8: 1 total, 0 up, 1 in 2023-12-07T16:16:49.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:49 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-07T16:16:49.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:49 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-07T16:16:49.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:16:49.633+0000 7f030f91d700 1 -- 172.21.15.63:0/1593836227 --> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f03081118d0 con 0x7f02f4068ed0 2023-12-07T16:16:50.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:50 smithi063 ceph-mon[112095]: purged_snaps scrub starts 2023-12-07T16:16:50.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:50 smithi063 ceph-mon[112095]: purged_snaps scrub ok 2023-12-07T16:16:50.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:50 smithi063 ceph-mon[112095]: osd.0 [v2:172.21.15.63:6802/2340994154,v1:172.21.15.63:6803/2340994154] boot 2023-12-07T16:16:50.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:50 smithi063 ceph-mon[112095]: osdmap e9: 1 total, 1 up, 1 in 2023-12-07T16:16:50.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:50 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-07T16:16:50.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:50 smithi063 ceph-mon[112095]: pgmap v24: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-07T16:16:50.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:50 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-07T16:16:50.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:50 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-07T16:16:50.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:50 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:50.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:50 smithi152 ceph-mon[121113]: purged_snaps scrub starts 2023-12-07T16:16:50.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:50 smithi152 ceph-mon[121113]: purged_snaps scrub ok 2023-12-07T16:16:50.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:50 smithi152 ceph-mon[121113]: osd.0 [v2:172.21.15.63:6802/2340994154,v1:172.21.15.63:6803/2340994154] boot 2023-12-07T16:16:50.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:50 smithi152 ceph-mon[121113]: osdmap e9: 1 total, 1 up, 1 in 2023-12-07T16:16:50.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:50 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-07T16:16:50.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:50 smithi152 ceph-mon[121113]: pgmap v24: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-07T16:16:50.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:50 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-07T16:16:50.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:50 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-07T16:16:50.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:50 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:51.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:51 smithi063 ceph-mon[112095]: from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:16:51.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:51 smithi063 ceph-mon[112095]: osdmap e10: 1 total, 1 up, 1 in 2023-12-07T16:16:51.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:51 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:51.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:51 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:51.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:51 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:16:51.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:51 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:51.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:51 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:51.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:51 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:16:51.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:51 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:51.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:51 smithi152 ceph-mon[121113]: from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:16:51.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:51 smithi152 ceph-mon[121113]: osdmap e10: 1 total, 1 up, 1 in 2023-12-07T16:16:51.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:51 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:51.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:51 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:51.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:51 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:16:51.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:51 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:51.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:51 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:51.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:51 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:16:51.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:51 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:52.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:52 smithi152 ceph-mon[121113]: Detected new or changed devices on smithi063 2023-12-07T16:16:52.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:52 smithi152 ceph-mon[121113]: Adjusting osd_memory_target on smithi063 to 12898M 2023-12-07T16:16:52.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:52 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:16:52.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:52 smithi152 ceph-mon[121113]: pgmap v26: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-07T16:16:52.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:52 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/2531050575' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4f6f5869-8c07-49cf-8d7e-4eaab3f54f9a"}]: dispatch 2023-12-07T16:16:52.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:52 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/2531050575' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4f6f5869-8c07-49cf-8d7e-4eaab3f54f9a"}]': finished 2023-12-07T16:16:52.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:52 smithi152 ceph-mon[121113]: osdmap e11: 2 total, 1 up, 2 in 2023-12-07T16:16:52.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:52 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-07T16:16:52.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:52 smithi063 ceph-mon[112095]: Detected new or changed devices on smithi063 2023-12-07T16:16:52.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:52 smithi063 ceph-mon[112095]: Adjusting osd_memory_target on smithi063 to 12898M 2023-12-07T16:16:52.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:52 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:16:52.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:52 smithi063 ceph-mon[112095]: pgmap v26: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-07T16:16:52.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:52 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2531050575' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4f6f5869-8c07-49cf-8d7e-4eaab3f54f9a"}]: dispatch 2023-12-07T16:16:52.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:52 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2531050575' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4f6f5869-8c07-49cf-8d7e-4eaab3f54f9a"}]': finished 2023-12-07T16:16:52.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:52 smithi063 ceph-mon[112095]: osdmap e11: 2 total, 1 up, 2 in 2023-12-07T16:16:52.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:52 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-07T16:16:53.596 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:53 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:53.597 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:53 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:53.597 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:53 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/1510610102' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-07T16:16:53.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:53 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:53.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:53 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:53.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:53 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/1510610102' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-07T16:16:54.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:54 smithi063 ceph-mon[112095]: pgmap v28: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-07T16:16:54.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:54 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:54.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:54 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:54.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:54 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:54.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:54 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:16:54.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:54 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:54.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:54 smithi152 ceph-mon[121113]: pgmap v28: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-07T16:16:54.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:54 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:54.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:54 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:54.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:54 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:54.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:54 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:16:54.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:54 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:16:56.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:56 smithi063 ceph-mon[112095]: pgmap v29: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-07T16:16:56.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:56 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:16:56.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:56 smithi152 ceph-mon[121113]: pgmap v29: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-07T16:16:56.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:56 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:16:58.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:58 smithi063 ceph-mon[112095]: pgmap v30: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-07T16:16:58.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:58 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-07T16:16:58.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:58 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:58.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:58 smithi152 ceph-mon[121113]: pgmap v30: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-07T16:16:58.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:58 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-07T16:16:58.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:58 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:16:59.618 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:16:59 smithi063 ceph-mon[112095]: Deploying daemon osd.1 on smithi063 2023-12-07T16:16:59.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:16:59 smithi152 ceph-mon[121113]: Deploying daemon osd.1 on smithi063 2023-12-07T16:17:00.554 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:00 smithi063 ceph-mon[112095]: pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-07T16:17:00.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:00 smithi152 ceph-mon[121113]: pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-07T16:17:02.462 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:02 smithi063 ceph-mon[112095]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-07T16:17:02.462 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:02 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:02.462 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:02 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:02.462 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:02 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:17:02.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:02 smithi152 ceph-mon[121113]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-07T16:17:02.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:02 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:02.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:02 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:02.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:02 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:17:04.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:04.331+0000 7f02fdffb700 1 -- 172.21.15.63:0/1593836227 <== mgr.14212 v2:172.21.15.63:6800/184283085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f03081118d0 con 0x7f02f4068ed0 2023-12-07T16:17:04.330 INFO:teuthology.orchestra.run.smithi063.stdout:Created osd(s) 1 on host 'smithi063' 2023-12-07T16:17:04.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:04.333+0000 7f030f91d700 1 -- 172.21.15.63:0/1593836227 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f02f4068ed0 msgr2=0x7f02f406b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:17:04.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:04.333+0000 7f030f91d700 1 --2- 172.21.15.63:0/1593836227 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f02f4068ed0 0x7f02f406b380 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f02f8009fd0 tx=0x7f02f800b040 comp rx=0 tx=0).stop 2023-12-07T16:17:04.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:04.333+0000 7f030f91d700 1 -- 172.21.15.63:0/1593836227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03080fd730 msgr2=0x7f030810f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:17:04.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:04.333+0000 7f030f91d700 1 --2- 172.21.15.63:0/1593836227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03080fd730 0x7f030810f650 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f030400b3b0 tx=0x7f0304009e30 comp rx=0 tx=0).stop 2023-12-07T16:17:04.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:04.333+0000 7f030f91d700 1 -- 172.21.15.63:0/1593836227 shutdown_connections 2023-12-07T16:17:04.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:04.333+0000 7f030f91d700 1 --2- 172.21.15.63:0/1593836227 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f02f4068ed0 0x7f02f406b380 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:17:04.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:04.333+0000 7f030f91d700 1 --2- 172.21.15.63:0/1593836227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03080fd730 0x7f030810f650 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:17:04.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:04.333+0000 7f030f91d700 1 --2- 172.21.15.63:0/1593836227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0308100050 0x7f030810fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:17:04.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:04.333+0000 7f030f91d700 1 -- 172.21.15.63:0/1593836227 >> 172.21.15.63:0/1593836227 conn(0x7f03080f71d0 msgr2=0x7f03080fb520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:17:04.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:04.333+0000 7f030f91d700 1 -- 172.21.15.63:0/1593836227 shutdown_connections 2023-12-07T16:17:04.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:04.333+0000 7f030f91d700 1 -- 172.21.15.63:0/1593836227 wait complete. 2023-12-07T16:17:04.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:04 smithi063 ceph-mon[112095]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-07T16:17:04.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:04 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:04.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:04 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:04.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:04 smithi152 ceph-mon[121113]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-07T16:17:04.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:04 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:04.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:04 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:04.882 DEBUG:teuthology.orchestra.run.smithi063:osd.1> sudo journalctl -f -n 0 -u ceph-8c493298-951b-11ee-95a2-87774f69a715@osd.1.service 2023-12-07T16:17:04.884 INFO:tasks.cephadm:Deploying osd.2 on smithi063 with /dev/vg_nvme/lv_2... 2023-12-07T16:17:04.885 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-07T16:17:04.920 INFO:journalctl@ceph.osd.1.smithi063.stdout:-- Logs begin at Thu 2023-12-07 15:43:10 UTC. -- 2023-12-07T16:17:05.307 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:17:06.123 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:17:05 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-1[144680]: 2023-12-07T16:17:05.712+0000 7f15de46a540 -1 osd.1 0 log_to_monitors true 2023-12-07T16:17:06.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:06 smithi063 ceph-mon[112095]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-07T16:17:06.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:06 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:06.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:06 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:06.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:06 smithi063 ceph-mon[112095]: from='osd.1 [v2:172.21.15.63:6810/1466128324,v1:172.21.15.63:6811/1466128324]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-07T16:17:06.656 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-07T16:17:06.656 INFO:teuthology.orchestra.run.smithi063.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-07T16:17:06.656 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 10+0 records in 2023-12-07T16:17:06.656 INFO:teuthology.orchestra.run.smithi063.stderr:10+0 records out 2023-12-07T16:17:06.656 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114955 s, 912 MB/s 2023-12-07T16:17:06.656 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping successful for: 2023-12-07T16:17:06.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:06 smithi152 ceph-mon[121113]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-07T16:17:06.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:06 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:06.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:06 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:06.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:06 smithi152 ceph-mon[121113]: from='osd.1 [v2:172.21.15.63:6810/1466128324,v1:172.21.15.63:6811/1466128324]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-07T16:17:07.331 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi063:vg_nvme/lv_2 2023-12-07T16:17:07.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:07 smithi152 ceph-mon[121113]: from='osd.1 [v2:172.21.15.63:6810/1466128324,v1:172.21.15.63:6811/1466128324]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-07T16:17:07.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:07 smithi152 ceph-mon[121113]: osdmap e12: 2 total, 1 up, 2 in 2023-12-07T16:17:07.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:07 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-07T16:17:07.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:07 smithi152 ceph-mon[121113]: from='osd.1 [v2:172.21.15.63:6810/1466128324,v1:172.21.15.63:6811/1466128324]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-07T16:17:07.626 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:17:07.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:07 smithi063 ceph-mon[112095]: from='osd.1 [v2:172.21.15.63:6810/1466128324,v1:172.21.15.63:6811/1466128324]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-07T16:17:07.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:07 smithi063 ceph-mon[112095]: osdmap e12: 2 total, 1 up, 2 in 2023-12-07T16:17:07.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:07 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-07T16:17:07.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:07 smithi063 ceph-mon[112095]: from='osd.1 [v2:172.21.15.63:6810/1466128324,v1:172.21.15.63:6811/1466128324]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-07T16:17:07.656 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:17:07 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-1[144680]: 2023-12-07T16:17:07.362+0000 7f15d4c4f700 -1 osd.1 0 waiting for initial osdmap 2023-12-07T16:17:07.656 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:17:07 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-1[144680]: 2023-12-07T16:17:07.367+0000 7f15cfa4a700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T16:17:08.477 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:08 smithi063 ceph-mon[112095]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-07T16:17:08.478 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:08 smithi063 ceph-mon[112095]: from='osd.1 [v2:172.21.15.63:6810/1466128324,v1:172.21.15.63:6811/1466128324]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2023-12-07T16:17:08.478 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:08 smithi063 ceph-mon[112095]: osdmap e13: 2 total, 1 up, 2 in 2023-12-07T16:17:08.478 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:08 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-07T16:17:08.478 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:08 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-07T16:17:08.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:08 smithi152 ceph-mon[121113]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-07T16:17:08.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:08 smithi152 ceph-mon[121113]: from='osd.1 [v2:172.21.15.63:6810/1466128324,v1:172.21.15.63:6811/1466128324]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2023-12-07T16:17:08.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:08 smithi152 ceph-mon[121113]: osdmap e13: 2 total, 1 up, 2 in 2023-12-07T16:17:08.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:08 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-07T16:17:08.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:08 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-07T16:17:08.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.937+0000 7fa76b911700 1 -- 172.21.15.63:0/3790781201 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7640fcd00 msgr2=0x7fa7640fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:17:08.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.937+0000 7fa76b911700 1 --2- 172.21.15.63:0/3790781201 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7640fcd00 0x7fa7640fd150 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa754004940 tx=0x7fa754009e30 comp rx=0 tx=0).stop 2023-12-07T16:17:08.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.937+0000 7fa76b911700 1 -- 172.21.15.63:0/3790781201 shutdown_connections 2023-12-07T16:17:08.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.937+0000 7fa76b911700 1 --2- 172.21.15.63:0/3790781201 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7640fcd00 0x7fa7640fd150 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:17:08.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.937+0000 7fa76b911700 1 --2- 172.21.15.63:0/3790781201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7640fbaf0 0x7fa7640fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:17:08.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.937+0000 7fa76b911700 1 -- 172.21.15.63:0/3790781201 >> 172.21.15.63:0/3790781201 conn(0x7fa7640f7190 msgr2=0x7fa7640f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:17:08.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.937+0000 7fa76b911700 1 -- 172.21.15.63:0/3790781201 shutdown_connections 2023-12-07T16:17:08.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.937+0000 7fa76b911700 1 -- 172.21.15.63:0/3790781201 wait complete. 2023-12-07T16:17:08.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.938+0000 7fa76b911700 1 Processor -- start 2023-12-07T16:17:08.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.938+0000 7fa76b911700 1 -- start start 2023-12-07T16:17:08.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.938+0000 7fa76b911700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7640fbaf0 0x7fa76410c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:17:08.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.938+0000 7fa76b911700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7640fcd00 0x7fa76410c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:17:08.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.938+0000 7fa76b911700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76410d040 con 0x7fa7640fcd00 2023-12-07T16:17:08.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.938+0000 7fa76b911700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76410d880 con 0x7fa7640fbaf0 2023-12-07T16:17:08.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.938+0000 7fa768eac700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7640fcd00 0x7fa76410c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:17:08.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.938+0000 7fa768eac700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7640fcd00 0x7fa76410c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59704/0 (socket says 172.21.15.63:59704) 2023-12-07T16:17:08.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.938+0000 7fa768eac700 1 -- 172.21.15.63:0/3190439253 learned_addr learned my addr 172.21.15.63:0/3190439253 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:17:08.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.938+0000 7fa7696ad700 1 --2- 172.21.15.63:0/3190439253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7640fbaf0 0x7fa76410c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:17:08.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.943+0000 7fa768eac700 1 -- 172.21.15.63:0/3190439253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7640fbaf0 msgr2=0x7fa76410c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:17:08.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.943+0000 7fa768eac700 1 --2- 172.21.15.63:0/3190439253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7640fbaf0 0x7fa76410c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:17:08.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.943+0000 7fa768eac700 1 -- 172.21.15.63:0/3190439253 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa754005040 con 0x7fa7640fcd00 2023-12-07T16:17:08.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.943+0000 7fa768eac700 1 --2- 172.21.15.63:0/3190439253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7640fcd00 0x7fa76410c9b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa754009380 tx=0x7fa754009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:17:08.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.945+0000 7fa759ffb700 1 -- 172.21.15.63:0/3190439253 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa75400e040 con 0x7fa7640fcd00 2023-12-07T16:17:08.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.945+0000 7fa76b911700 1 -- 172.21.15.63:0/3190439253 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76410db00 con 0x7fa7640fcd00 2023-12-07T16:17:08.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.946+0000 7fa76b911700 1 -- 172.21.15.63:0/3190439253 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76410e040 con 0x7fa7640fcd00 2023-12-07T16:17:08.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.946+0000 7fa759ffb700 1 -- 172.21.15.63:0/3190439253 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa754004290 con 0x7fa7640fcd00 2023-12-07T16:17:08.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.946+0000 7fa759ffb700 1 -- 172.21.15.63:0/3190439253 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa754025400 con 0x7fa7640fcd00 2023-12-07T16:17:08.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.947+0000 7fa76b911700 1 -- 172.21.15.63:0/3190439253 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76404bb80 con 0x7fa7640fcd00 2023-12-07T16:17:08.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.948+0000 7fa759ffb700 1 -- 172.21.15.63:0/3190439253 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7fa754013420 con 0x7fa7640fcd00 2023-12-07T16:17:08.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.949+0000 7fa759ffb700 1 --2- 172.21.15.63:0/3190439253 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fa750068ed0 0x7fa75006b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:17:08.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.949+0000 7fa759ffb700 1 -- 172.21.15.63:0/3190439253 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2410+0+0 (secure 0 0 0) 0x7fa754087ad0 con 0x7fa7640fcd00 2023-12-07T16:17:08.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.949+0000 7fa7696ad700 1 --2- 172.21.15.63:0/3190439253 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fa750068ed0 0x7fa75006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:17:08.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.949+0000 7fa7696ad700 1 --2- 172.21.15.63:0/3190439253 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fa750068ed0 0x7fa75006b380 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa7640fcb60 tx=0x7fa7600091a0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:17:08.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:08.953+0000 7fa759ffb700 1 -- 172.21.15.63:0/3190439253 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa7540586e0 con 0x7fa7640fcd00 2023-12-07T16:17:09.159 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:09.161+0000 7fa76b911700 1 -- 172.21.15.63:0/3190439253 --> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa76410e4d0 con 0x7fa750068ed0 2023-12-07T16:17:09.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:09 smithi063 ceph-mon[112095]: purged_snaps scrub starts 2023-12-07T16:17:09.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:09 smithi063 ceph-mon[112095]: purged_snaps scrub ok 2023-12-07T16:17:09.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:09 smithi063 ceph-mon[112095]: osd.1 [v2:172.21.15.63:6810/1466128324,v1:172.21.15.63:6811/1466128324] boot 2023-12-07T16:17:09.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:09 smithi063 ceph-mon[112095]: osdmap e14: 2 total, 2 up, 2 in 2023-12-07T16:17:09.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-07T16:17:09.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:09.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:09.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:17:09.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:17:09.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:09.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:17:09.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:17:09.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:09.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:17:09.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-07T16:17:09.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-07T16:17:09.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:17:09.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:09 smithi152 ceph-mon[121113]: purged_snaps scrub starts 2023-12-07T16:17:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:09 smithi152 ceph-mon[121113]: purged_snaps scrub ok 2023-12-07T16:17:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:09 smithi152 ceph-mon[121113]: osd.1 [v2:172.21.15.63:6810/1466128324,v1:172.21.15.63:6811/1466128324] boot 2023-12-07T16:17:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:09 smithi152 ceph-mon[121113]: osdmap e14: 2 total, 2 up, 2 in 2023-12-07T16:17:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:09 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-07T16:17:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:09 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:09 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:09 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:17:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:09 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:17:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:09 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:09 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:17:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:09 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:17:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:09 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:09 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:17:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:09 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-07T16:17:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:09 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-07T16:17:09.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:09 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:17:10.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:10 smithi063 ceph-mon[112095]: Detected new or changed devices on smithi063 2023-12-07T16:17:10.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:10 smithi063 ceph-mon[112095]: Adjusting osd_memory_target on smithi063 to 6449M 2023-12-07T16:17:10.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:10 smithi063 ceph-mon[112095]: from='client.14278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:17:10.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:10 smithi063 ceph-mon[112095]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-07T16:17:10.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:10 smithi063 ceph-mon[112095]: osdmap e15: 2 total, 2 up, 2 in 2023-12-07T16:17:10.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:10 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:17:10.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:10 smithi152 ceph-mon[121113]: Detected new or changed devices on smithi063 2023-12-07T16:17:10.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:10 smithi152 ceph-mon[121113]: Adjusting osd_memory_target on smithi063 to 6449M 2023-12-07T16:17:10.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:10 smithi152 ceph-mon[121113]: from='client.14278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:17:10.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:10 smithi152 ceph-mon[121113]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-07T16:17:10.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:10 smithi152 ceph-mon[121113]: osdmap e15: 2 total, 2 up, 2 in 2023-12-07T16:17:10.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:10 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:17:12.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:12 smithi152 ceph-mon[121113]: pgmap v41: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-07T16:17:12.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:12 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/2586307304' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42f79427-9cc3-42aa-91ab-4c28094437d8"}]: dispatch 2023-12-07T16:17:12.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:12 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/2586307304' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "42f79427-9cc3-42aa-91ab-4c28094437d8"}]': finished 2023-12-07T16:17:12.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:12 smithi152 ceph-mon[121113]: osdmap e16: 3 total, 2 up, 3 in 2023-12-07T16:17:12.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:12 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T16:17:12.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:12 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/3446690970' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-07T16:17:12.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:12 smithi063 ceph-mon[112095]: pgmap v41: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-07T16:17:12.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:12 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2586307304' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42f79427-9cc3-42aa-91ab-4c28094437d8"}]: dispatch 2023-12-07T16:17:12.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:12 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2586307304' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "42f79427-9cc3-42aa-91ab-4c28094437d8"}]': finished 2023-12-07T16:17:12.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:12 smithi063 ceph-mon[112095]: osdmap e16: 3 total, 2 up, 3 in 2023-12-07T16:17:12.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:12 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T16:17:12.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:12 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/3446690970' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-07T16:17:13.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:13 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:13.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:13 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:13.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:13 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:17:13.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:13 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:17:13.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:13 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:13.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:13 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:13.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:13 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:13.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:13 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:17:13.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:13 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:17:13.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:13 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:14.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:14 smithi152 ceph-mon[121113]: pgmap v43: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-07T16:17:14.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:14 smithi063 ceph-mon[112095]: pgmap v43: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-07T16:17:16.587 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:16 smithi063 ceph-mon[112095]: pgmap v44: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-07T16:17:16.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:16 smithi152 ceph-mon[121113]: pgmap v44: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-07T16:17:18.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:18 smithi152 ceph-mon[121113]: pgmap v45: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-07T16:17:18.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:18 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-07T16:17:18.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:18 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:17:18.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:18 smithi063 ceph-mon[112095]: pgmap v45: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-07T16:17:18.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:18 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-07T16:17:18.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:18 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:17:19.564 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:19 smithi063 ceph-mon[112095]: Deploying daemon osd.2 on smithi063 2023-12-07T16:17:19.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:19 smithi152 ceph-mon[121113]: Deploying daemon osd.2 on smithi063 2023-12-07T16:17:20.724 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:20 smithi063 ceph-mon[112095]: pgmap v46: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-07T16:17:20.745 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:20 smithi152 ceph-mon[121113]: pgmap v46: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-07T16:17:22.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:22 smithi152 ceph-mon[121113]: pgmap v47: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-07T16:17:22.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:22 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:22.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:22 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:22.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:22 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:17:22.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:22 smithi063 ceph-mon[112095]: pgmap v47: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-07T16:17:22.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:22 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:22.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:22 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:22.803 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:22 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:17:24.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:24.004+0000 7fa759ffb700 1 -- 172.21.15.63:0/3190439253 <== mgr.14212 v2:172.21.15.63:6800/184283085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa76410e4d0 con 0x7fa750068ed0 2023-12-07T16:17:24.002 INFO:teuthology.orchestra.run.smithi063.stdout:Created osd(s) 2 on host 'smithi063' 2023-12-07T16:17:24.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:24.005+0000 7fa76b911700 1 -- 172.21.15.63:0/3190439253 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fa750068ed0 msgr2=0x7fa75006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:17:24.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:24.005+0000 7fa76b911700 1 --2- 172.21.15.63:0/3190439253 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fa750068ed0 0x7fa75006b380 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa7640fcb60 tx=0x7fa7600091a0 comp rx=0 tx=0).stop 2023-12-07T16:17:24.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:24.005+0000 7fa76b911700 1 -- 172.21.15.63:0/3190439253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7640fcd00 msgr2=0x7fa76410c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:17:24.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:24.005+0000 7fa76b911700 1 --2- 172.21.15.63:0/3190439253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7640fcd00 0x7fa76410c9b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa754009380 tx=0x7fa754009e30 comp rx=0 tx=0).stop 2023-12-07T16:17:24.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:24.005+0000 7fa76b911700 1 -- 172.21.15.63:0/3190439253 shutdown_connections 2023-12-07T16:17:24.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:24.005+0000 7fa76b911700 1 --2- 172.21.15.63:0/3190439253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa7640fbaf0 0x7fa76410c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:17:24.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:24.005+0000 7fa76b911700 1 --2- 172.21.15.63:0/3190439253 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fa750068ed0 0x7fa75006b380 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:17:24.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:24.005+0000 7fa76b911700 1 --2- 172.21.15.63:0/3190439253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7640fcd00 0x7fa76410c9b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:17:24.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:24.005+0000 7fa76b911700 1 -- 172.21.15.63:0/3190439253 >> 172.21.15.63:0/3190439253 conn(0x7fa7640f7190 msgr2=0x7fa7640fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:17:24.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:24.005+0000 7fa76b911700 1 -- 172.21.15.63:0/3190439253 shutdown_connections 2023-12-07T16:17:24.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:17:24.005+0000 7fa76b911700 1 -- 172.21.15.63:0/3190439253 wait complete. 2023-12-07T16:17:24.508 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:24 smithi063 ceph-mon[112095]: pgmap v48: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-07T16:17:24.508 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:24 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:24.508 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:24 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:24.509 DEBUG:teuthology.orchestra.run.smithi063:osd.2> sudo journalctl -f -n 0 -u ceph-8c493298-951b-11ee-95a2-87774f69a715@osd.2.service 2023-12-07T16:17:24.511 INFO:tasks.cephadm:Deploying osd.3 on smithi152 with /dev/vg_nvme/lv_4... 2023-12-07T16:17:24.511 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-07T16:17:24.542 INFO:journalctl@ceph.osd.2.smithi063.stdout:-- Logs begin at Thu 2023-12-07 15:43:10 UTC. -- 2023-12-07T16:17:24.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:24 smithi152 ceph-mon[121113]: pgmap v48: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-07T16:17:24.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:24 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:24.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:24 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:24.777 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-07T16:17:25.589 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:25 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:17:25.590 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:25 smithi152 ceph-mon[121113]: from='osd.2 [v2:172.21.15.63:6818/1582539682,v1:172.21.15.63:6819/1582539682]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-07T16:17:25.590 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:25 smithi152 ceph-mon[121113]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-07T16:17:25.590 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:25 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:25.590 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:25 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:25.858 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:17:25 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-2[154315]: 2023-12-07T16:17:25.421+0000 7fe275b1a540 -1 osd.2 0 log_to_monitors true 2023-12-07T16:17:25.859 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:25 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:17:25.859 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:25 smithi063 ceph-mon[112095]: from='osd.2 [v2:172.21.15.63:6818/1582539682,v1:172.21.15.63:6819/1582539682]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-07T16:17:25.859 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:25 smithi063 ceph-mon[112095]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-07T16:17:25.859 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:25 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:25.859 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:25 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:26.039 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-07T16:17:26.039 INFO:teuthology.orchestra.run.smithi152.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-07T16:17:26.039 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10+0 records in 2023-12-07T16:17:26.039 INFO:teuthology.orchestra.run.smithi152.stderr:10+0 records out 2023-12-07T16:17:26.039 INFO:teuthology.orchestra.run.smithi152.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111281 s, 942 MB/s 2023-12-07T16:17:26.039 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping successful for: 2023-12-07T16:17:26.409 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi152:vg_nvme/lv_4 2023-12-07T16:17:26.666 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-07T16:17:26.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:26 smithi152 ceph-mon[121113]: pgmap v49: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-07T16:17:26.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:26 smithi152 ceph-mon[121113]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-07T16:17:26.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:26 smithi152 ceph-mon[121113]: osdmap e17: 3 total, 2 up, 3 in 2023-12-07T16:17:26.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:26 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T16:17:26.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:26 smithi152 ceph-mon[121113]: from='osd.2 [v2:172.21.15.63:6818/1582539682,v1:172.21.15.63:6819/1582539682]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-07T16:17:26.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:26 smithi152 ceph-mon[121113]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-07T16:17:26.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:26 smithi063 ceph-mon[112095]: pgmap v49: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-07T16:17:26.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:26 smithi063 ceph-mon[112095]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-07T16:17:26.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:26 smithi063 ceph-mon[112095]: osdmap e17: 3 total, 2 up, 3 in 2023-12-07T16:17:26.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:26 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T16:17:26.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:26 smithi063 ceph-mon[112095]: from='osd.2 [v2:172.21.15.63:6818/1582539682,v1:172.21.15.63:6819/1582539682]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-07T16:17:26.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:26 smithi063 ceph-mon[112095]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-07T16:17:26.907 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:17:26 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-2[154315]: 2023-12-07T16:17:26.490+0000 7fe26c2ff700 -1 osd.2 0 waiting for initial osdmap 2023-12-07T16:17:26.907 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:17:26 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-2[154315]: 2023-12-07T16:17:26.496+0000 7fe2680fc700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T16:17:27.594 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.595+0000 7fe4a9b29700 1 -- 172.21.15.152:0/4206854094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4a40fcd00 msgr2=0x7fe4a40fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:17:27.594 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.595+0000 7fe4a9b29700 1 --2- 172.21.15.152:0/4206854094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4a40fcd00 0x7fe4a40fd150 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe498004940 tx=0x7fe498009e30 comp rx=0 tx=0).stop 2023-12-07T16:17:27.594 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.595+0000 7fe4a9b29700 1 -- 172.21.15.152:0/4206854094 shutdown_connections 2023-12-07T16:17:27.594 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.595+0000 7fe4a9b29700 1 --2- 172.21.15.152:0/4206854094 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4a40fcd00 0x7fe4a40fd150 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:17:27.594 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.595+0000 7fe4a9b29700 1 --2- 172.21.15.152:0/4206854094 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4a40fbaf0 0x7fe4a40fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:17:27.594 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.595+0000 7fe4a9b29700 1 -- 172.21.15.152:0/4206854094 >> 172.21.15.152:0/4206854094 conn(0x7fe4a40f7190 msgr2=0x7fe4a40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:17:27.594 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.595+0000 7fe4a9b29700 1 -- 172.21.15.152:0/4206854094 shutdown_connections 2023-12-07T16:17:27.594 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.595+0000 7fe4a9b29700 1 -- 172.21.15.152:0/4206854094 wait complete. 2023-12-07T16:17:27.594 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.595+0000 7fe4a9b29700 1 Processor -- start 2023-12-07T16:17:27.594 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.595+0000 7fe4a9b29700 1 -- start start 2023-12-07T16:17:27.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.595+0000 7fe4a9b29700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4a40fbaf0 0x7fe4a410d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:17:27.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.595+0000 7fe4a9b29700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4a40fcd00 0x7fe4a410da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:17:27.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.595+0000 7fe4a9b29700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a410e090 con 0x7fe4a40fbaf0 2023-12-07T16:17:27.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.595+0000 7fe4a9b29700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a410e930 con 0x7fe4a40fcd00 2023-12-07T16:17:27.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.596+0000 7fe4a2ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4a40fcd00 0x7fe4a410da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:17:27.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.596+0000 7fe4a37fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4a40fbaf0 0x7fe4a410d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:17:27.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.596+0000 7fe4a2ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4a40fcd00 0x7fe4a410da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39576/0 (socket says 172.21.15.152:39576) 2023-12-07T16:17:27.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.596+0000 7fe4a2ffd700 1 -- 172.21.15.152:0/1793422323 learned_addr learned my addr 172.21.15.152:0/1793422323 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-07T16:17:27.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.596+0000 7fe4a2ffd700 1 -- 172.21.15.152:0/1793422323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4a40fbaf0 msgr2=0x7fe4a410d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:17:27.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.596+0000 7fe4a2ffd700 1 --2- 172.21.15.152:0/1793422323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4a40fbaf0 0x7fe4a410d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:17:27.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.596+0000 7fe4a2ffd700 1 -- 172.21.15.152:0/1793422323 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe498005040 con 0x7fe4a40fcd00 2023-12-07T16:17:27.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.596+0000 7fe4a2ffd700 1 --2- 172.21.15.152:0/1793422323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4a40fcd00 0x7fe4a410da90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe498009fd0 tx=0x7fe498009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:17:27.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.596+0000 7fe48bfff700 1 -- 172.21.15.152:0/1793422323 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe49800e040 con 0x7fe4a40fcd00 2023-12-07T16:17:27.596 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.596+0000 7fe48bfff700 1 -- 172.21.15.152:0/1793422323 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe498004290 con 0x7fe4a40fcd00 2023-12-07T16:17:27.596 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.596+0000 7fe4a9b29700 1 -- 172.21.15.152:0/1793422323 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a410ebb0 con 0x7fe4a40fcd00 2023-12-07T16:17:27.596 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.596+0000 7fe48bfff700 1 -- 172.21.15.152:0/1793422323 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe49801c3f0 con 0x7fe4a40fcd00 2023-12-07T16:17:27.596 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.596+0000 7fe4a9b29700 1 -- 172.21.15.152:0/1793422323 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a410f0f0 con 0x7fe4a40fcd00 2023-12-07T16:17:27.596 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.597+0000 7fe4a9b29700 1 -- 172.21.15.152:0/1793422323 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a404bb80 con 0x7fe4a40fcd00 2023-12-07T16:17:27.596 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.598+0000 7fe48bfff700 1 -- 172.21.15.152:0/1793422323 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7fe49800bc50 con 0x7fe4a40fcd00 2023-12-07T16:17:27.597 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.598+0000 7fe48bfff700 1 --2- 172.21.15.152:0/1793422323 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe48c068ed0 0x7fe48c06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:17:27.597 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.599+0000 7fe48bfff700 1 -- 172.21.15.152:0/1793422323 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 2842+0+0 (secure 0 0 0) 0x7fe498088160 con 0x7fe4a40fcd00 2023-12-07T16:17:27.597 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.599+0000 7fe4a37fe700 1 --2- 172.21.15.152:0/1793422323 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe48c068ed0 0x7fe48c06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:17:27.597 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.599+0000 7fe4a37fe700 1 --2- 172.21.15.152:0/1793422323 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe48c068ed0 0x7fe48c06b380 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40fcb60 tx=0x7fe49400b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:17:27.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.603+0000 7fe48bfff700 1 -- 172.21.15.152:0/1793422323 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe498058bc0 con 0x7fe4a40fcd00 2023-12-07T16:17:27.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:27 smithi152 ceph-mon[121113]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2023-12-07T16:17:27.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:27 smithi152 ceph-mon[121113]: osdmap e18: 3 total, 2 up, 3 in 2023-12-07T16:17:27.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:27 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T16:17:27.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:27 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T16:17:27.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:27.792+0000 7fe4a9b29700 1 -- 172.21.15.152:0/1793422323 --> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4a410f5c0 con 0x7fe48c068ed0 2023-12-07T16:17:27.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:27 smithi063 ceph-mon[112095]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2023-12-07T16:17:27.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:27 smithi063 ceph-mon[112095]: osdmap e18: 3 total, 2 up, 3 in 2023-12-07T16:17:27.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:27 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T16:17:27.805 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:27 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T16:17:28.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:28 smithi152 ceph-mon[121113]: purged_snaps scrub starts 2023-12-07T16:17:28.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:28 smithi152 ceph-mon[121113]: purged_snaps scrub ok 2023-12-07T16:17:28.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:28 smithi152 ceph-mon[121113]: pgmap v52: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-07T16:17:28.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:28 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T16:17:28.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:28 smithi152 ceph-mon[121113]: osd.2 [v2:172.21.15.63:6818/1582539682,v1:172.21.15.63:6819/1582539682] boot 2023-12-07T16:17:28.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:28 smithi152 ceph-mon[121113]: osdmap e19: 3 total, 3 up, 3 in 2023-12-07T16:17:28.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:28 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T16:17:28.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:28 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-07T16:17:28.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:28 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-07T16:17:28.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:28 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:17:28.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:28 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:28.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:28 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:28.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:28 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:17:28.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:28 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:17:28.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:28 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:17:28.745 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:28 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:28.745 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:28 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:17:28.745 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:28 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:17:28.745 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:28 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:28.745 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:28 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:17:28.745 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:28 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:17:28.745 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:28 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:17:28.745 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:28 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:28.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:28 smithi063 ceph-mon[112095]: purged_snaps scrub starts 2023-12-07T16:17:28.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:28 smithi063 ceph-mon[112095]: purged_snaps scrub ok 2023-12-07T16:17:28.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:28 smithi063 ceph-mon[112095]: pgmap v52: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-07T16:17:28.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:28 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T16:17:28.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:28 smithi063 ceph-mon[112095]: osd.2 [v2:172.21.15.63:6818/1582539682,v1:172.21.15.63:6819/1582539682] boot 2023-12-07T16:17:28.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:28 smithi063 ceph-mon[112095]: osdmap e19: 3 total, 3 up, 3 in 2023-12-07T16:17:28.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:28 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T16:17:28.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:28 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-07T16:17:28.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:28 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-07T16:17:28.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:28 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:17:28.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:28 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:28.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:28 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:28.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:28 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:17:28.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:28 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:17:28.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:28 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:17:28.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:28 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:28.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:28 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:17:28.908 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:28 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:17:28.908 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:28 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:28.908 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:28 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:17:28.908 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:28 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:17:28.908 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:28 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:17:28.908 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:28 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:30.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:29 smithi063 ceph-mon[112095]: from='client.24133 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:17:30.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:29 smithi063 ceph-mon[112095]: Detected new or changed devices on smithi063 2023-12-07T16:17:30.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:29 smithi063 ceph-mon[112095]: Adjusting osd_memory_target on smithi063 to 4299M 2023-12-07T16:17:30.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:29 smithi063 ceph-mon[112095]: osdmap e20: 3 total, 3 up, 3 in 2023-12-07T16:17:30.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:29 smithi152 ceph-mon[121113]: from='client.24133 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:17:30.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:29 smithi152 ceph-mon[121113]: Detected new or changed devices on smithi063 2023-12-07T16:17:30.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:29 smithi152 ceph-mon[121113]: Adjusting osd_memory_target on smithi063 to 4299M 2023-12-07T16:17:30.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:29 smithi152 ceph-mon[121113]: osdmap e20: 3 total, 3 up, 3 in 2023-12-07T16:17:31.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:30 smithi063 ceph-mon[112095]: pgmap v55: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-07T16:17:31.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:30 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-07T16:17:31.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:30 smithi063 ceph-mon[112095]: from='client.? 172.21.15.152:0/1878772113' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "57bde3cf-c59d-4ccb-9d76-894dc48e51b6"}]: dispatch 2023-12-07T16:17:31.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:30 smithi063 ceph-mon[112095]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "57bde3cf-c59d-4ccb-9d76-894dc48e51b6"}]: dispatch 2023-12-07T16:17:31.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:30 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-07T16:17:31.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:30 smithi063 ceph-mon[112095]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57bde3cf-c59d-4ccb-9d76-894dc48e51b6"}]': finished 2023-12-07T16:17:31.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:30 smithi063 ceph-mon[112095]: osdmap e21: 4 total, 3 up, 4 in 2023-12-07T16:17:31.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:30 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T16:17:31.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:30 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-07T16:17:31.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:30 smithi063 ceph-mon[112095]: from='client.? 172.21.15.152:0/2439715305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-07T16:17:31.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:30 smithi152 ceph-mon[121113]: pgmap v55: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-07T16:17:31.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:30 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-07T16:17:31.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:30 smithi152 ceph-mon[121113]: from='client.? 172.21.15.152:0/1878772113' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "57bde3cf-c59d-4ccb-9d76-894dc48e51b6"}]: dispatch 2023-12-07T16:17:31.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:30 smithi152 ceph-mon[121113]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "57bde3cf-c59d-4ccb-9d76-894dc48e51b6"}]: dispatch 2023-12-07T16:17:31.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:30 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-07T16:17:31.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:30 smithi152 ceph-mon[121113]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57bde3cf-c59d-4ccb-9d76-894dc48e51b6"}]': finished 2023-12-07T16:17:31.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:30 smithi152 ceph-mon[121113]: osdmap e21: 4 total, 3 up, 4 in 2023-12-07T16:17:31.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:30 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T16:17:31.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:30 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-07T16:17:31.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:30 smithi152 ceph-mon[121113]: from='client.? 172.21.15.152:0/2439715305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-07T16:17:31.655 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:17:31 smithi063 sudo[160258]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-07T16:17:31.656 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:17:31 smithi063 sudo[160258]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-07T16:17:31.656 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:17:31 smithi063 sudo[160258]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-07T16:17:31.656 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:17:31 smithi063 sudo[160258]: pam_unix(sudo:session): session closed for user root 2023-12-07T16:17:31.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:31.824+0000 7fe48bfff700 1 -- 172.21.15.152:0/1793422323 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe498055500 con 0x7fe4a40fcd00 2023-12-07T16:17:32.155 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:17:31 smithi063 sudo[160261]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-07T16:17:32.156 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:17:31 smithi063 sudo[160261]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-07T16:17:32.156 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:17:31 smithi063 sudo[160261]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-07T16:17:32.156 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:17:31 smithi063 sudo[160261]: pam_unix(sudo:session): session closed for user root 2023-12-07T16:17:32.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:31 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-07T16:17:32.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:31 smithi063 ceph-mon[112095]: osdmap e22: 4 total, 3 up, 4 in 2023-12-07T16:17:32.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:31 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T16:17:32.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:31 smithi063 ceph-mon[112095]: pgmap v58: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-07T16:17:32.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:31 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-07T16:17:32.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:31 smithi152 ceph-mon[121113]: osdmap e22: 4 total, 3 up, 4 in 2023-12-07T16:17:32.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:31 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T16:17:32.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:31 smithi152 ceph-mon[121113]: pgmap v58: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-07T16:17:32.655 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:17:32 smithi063 sudo[160264]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-07T16:17:32.656 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:17:32 smithi063 sudo[160264]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-07T16:17:32.656 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:17:32 smithi063 sudo[160264]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-07T16:17:32.656 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:17:32 smithi063 sudo[160264]: pam_unix(sudo:session): session closed for user root 2023-12-07T16:17:33.155 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:17:32 smithi063 sudo[160267]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-07T16:17:33.156 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:17:32 smithi063 sudo[160267]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-07T16:17:33.156 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:17:32 smithi063 sudo[160267]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-07T16:17:33.156 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:17:32 smithi063 sudo[160267]: pam_unix(sudo:session): session closed for user root 2023-12-07T16:17:33.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:32 smithi063 ceph-mon[112095]: osdmap e23: 4 total, 3 up, 4 in 2023-12-07T16:17:33.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:32 smithi063 ceph-mon[112095]: mgrmap e19: smithi063.yohyyx(active, since 96s), standbys: smithi152.sxayfb 2023-12-07T16:17:33.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:32 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T16:17:33.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:32 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:33.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:32 smithi152 ceph-mon[121113]: osdmap e23: 4 total, 3 up, 4 in 2023-12-07T16:17:33.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:32 smithi152 ceph-mon[121113]: mgrmap e19: smithi063.yohyyx(active, since 96s), standbys: smithi152.sxayfb 2023-12-07T16:17:33.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:32 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T16:17:33.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:32 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:33.605 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:17:33 smithi063 sudo[160270]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-07T16:17:33.605 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:17:33 smithi063 sudo[160270]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-07T16:17:33.605 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:17:33 smithi063 sudo[160270]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-07T16:17:33.605 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:17:33 smithi063 sudo[160270]: pam_unix(sudo:session): session closed for user root 2023-12-07T16:17:33.905 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:17:33 smithi063 sudo[160273]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-07T16:17:33.905 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:17:33 smithi063 sudo[160273]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-07T16:17:33.905 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:17:33 smithi063 sudo[160273]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-07T16:17:33.906 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:17:33 smithi063 sudo[160273]: pam_unix(sudo:session): session closed for user root 2023-12-07T16:17:34.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:34 smithi063 sudo[160276]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-07T16:17:34.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:34 smithi063 sudo[160276]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-07T16:17:34.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:34 smithi063 sudo[160276]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-07T16:17:34.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:34 smithi063 sudo[160276]: pam_unix(sudo:session): session closed for user root 2023-12-07T16:17:34.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:34 smithi063 sudo[160279]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-07T16:17:34.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:34 smithi063 sudo[160279]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-07T16:17:34.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:34 smithi063 sudo[160279]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-07T16:17:34.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:34 smithi063 sudo[160279]: pam_unix(sudo:session): session closed for user root 2023-12-07T16:17:34.996 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:34 smithi152 sudo[126524]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-07T16:17:34.996 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:34 smithi152 sudo[126524]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-07T16:17:34.996 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:34 smithi152 sudo[126524]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-07T16:17:34.996 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:34 smithi152 sudo[126524]: pam_unix(sudo:session): session closed for user root 2023-12-07T16:17:35.262 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:34 smithi152 sudo[126547]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-07T16:17:35.262 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:34 smithi152 sudo[126547]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-07T16:17:35.262 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:35 smithi152 sudo[126547]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-07T16:17:35.262 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:35 smithi152 sudo[126547]: pam_unix(sudo:session): session closed for user root 2023-12-07T16:17:35.262 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:35 smithi152 ceph-mon[121113]: pgmap v60: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-07T16:17:35.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:35 smithi063 ceph-mon[112095]: pgmap v60: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-07T16:17:36.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:36 smithi152 ceph-mon[121113]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-07T16:17:36.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:36 smithi152 ceph-mon[121113]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-07T16:17:36.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:36 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-07T16:17:36.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:36 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:17:36.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:36 smithi152 ceph-mon[121113]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-07T16:17:36.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:36 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-07T16:17:36.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:36 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:17:36.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:36 smithi152 ceph-mon[121113]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-07T16:17:36.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:36 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:36.403 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:36 smithi152 ceph-mon[121113]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-07T16:17:36.403 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:36 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-07T16:17:36.403 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:36 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:17:36.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:36 smithi063 ceph-mon[112095]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-07T16:17:36.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:36 smithi063 ceph-mon[112095]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-07T16:17:36.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:36 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-07T16:17:36.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:36 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:17:36.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:36 smithi063 ceph-mon[112095]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-07T16:17:36.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:36 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-07T16:17:36.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:36 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:17:36.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:36 smithi063 ceph-mon[112095]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-07T16:17:36.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:36 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:36.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:36 smithi063 ceph-mon[112095]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-07T16:17:36.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:36 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-07T16:17:36.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:36 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:17:37.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:37 smithi063 ceph-mon[112095]: Deploying daemon osd.3 on smithi152 2023-12-07T16:17:37.425 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:37 smithi152 ceph-mon[121113]: Deploying daemon osd.3 on smithi152 2023-12-07T16:17:38.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:38 smithi063 ceph-mon[112095]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-07T16:17:38.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:38 smithi152 ceph-mon[121113]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-07T16:17:40.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:40 smithi063 ceph-mon[112095]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-07T16:17:40.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:40 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:40.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:40 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:40.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:40 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:17:40.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:40 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:17:40.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:40 smithi152 ceph-mon[121113]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-07T16:17:40.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:40 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:40.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:40 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:40.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:40 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:17:40.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:40 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:17:42.190 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:42.191+0000 7fe48bfff700 1 -- 172.21.15.152:0/1793422323 <== mgr.14212 v2:172.21.15.63:6800/184283085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe4a410f5c0 con 0x7fe48c068ed0 2023-12-07T16:17:42.190 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 3 on host 'smithi152' 2023-12-07T16:17:42.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:42.193+0000 7fe4a9b29700 1 -- 172.21.15.152:0/1793422323 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe48c068ed0 msgr2=0x7fe48c06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:17:42.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:42.193+0000 7fe4a9b29700 1 --2- 172.21.15.152:0/1793422323 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe48c068ed0 0x7fe48c06b380 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40fcb60 tx=0x7fe49400b040 comp rx=0 tx=0).stop 2023-12-07T16:17:42.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:42.193+0000 7fe4a9b29700 1 -- 172.21.15.152:0/1793422323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4a40fcd00 msgr2=0x7fe4a410da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:17:42.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:42.193+0000 7fe4a9b29700 1 --2- 172.21.15.152:0/1793422323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4a40fcd00 0x7fe4a410da90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe498009fd0 tx=0x7fe498009e30 comp rx=0 tx=0).stop 2023-12-07T16:17:42.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:42.193+0000 7fe4a9b29700 1 -- 172.21.15.152:0/1793422323 shutdown_connections 2023-12-07T16:17:42.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:42.193+0000 7fe4a9b29700 1 --2- 172.21.15.152:0/1793422323 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe48c068ed0 0x7fe48c06b380 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:17:42.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:42.193+0000 7fe4a9b29700 1 --2- 172.21.15.152:0/1793422323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4a40fbaf0 0x7fe4a410d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:17:42.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:42.193+0000 7fe4a9b29700 1 --2- 172.21.15.152:0/1793422323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4a40fcd00 0x7fe4a410da90 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:17:42.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:42.193+0000 7fe4a9b29700 1 -- 172.21.15.152:0/1793422323 >> 172.21.15.152:0/1793422323 conn(0x7fe4a40f7190 msgr2=0x7fe4a4065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:17:42.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:42.194+0000 7fe4a9b29700 1 -- 172.21.15.152:0/1793422323 shutdown_connections 2023-12-07T16:17:42.192 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:42.194+0000 7fe4a9b29700 1 -- 172.21.15.152:0/1793422323 wait complete. 2023-12-07T16:17:42.568 DEBUG:teuthology.orchestra.run.smithi152:osd.3> sudo journalctl -f -n 0 -u ceph-8c493298-951b-11ee-95a2-87774f69a715@osd.3.service 2023-12-07T16:17:42.570 INFO:tasks.cephadm:Deploying osd.4 on smithi152 with /dev/vg_nvme/lv_3... 2023-12-07T16:17:42.570 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-07T16:17:42.601 INFO:journalctl@ceph.osd.3.smithi152.stdout:-- Logs begin at Thu 2023-12-07 15:43:14 UTC. -- 2023-12-07T16:17:42.736 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:42 smithi152 ceph-mon[121113]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-12-07T16:17:42.736 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:42 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:42.736 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:42 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:42.736 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:42 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:17:42.737 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:42 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:17:42.737 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:42 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:42.737 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:42 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:42.737 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:42 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:42.737 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:42 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:17:42.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:42 smithi063 ceph-mon[112095]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-12-07T16:17:42.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:42 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:42.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:42 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:42.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:42 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:17:42.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:42 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:17:42.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:42 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:42.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:42 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:42.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:42 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:42.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:42 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:17:43.174 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-07T16:17:43.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:43 smithi152 ceph-mon[121113]: from='osd.3 [v2:172.21.15.152:6800/913468029,v1:172.21.15.152:6801/913468029]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-07T16:17:43.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:43 smithi152 ceph-mon[121113]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-07T16:17:43.743 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:17:43 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-3[127309]: 2023-12-07T16:17:43.484+0000 7f0ea3659540 -1 osd.3 0 log_to_monitors true 2023-12-07T16:17:43.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:43 smithi063 ceph-mon[112095]: from='osd.3 [v2:172.21.15.152:6800/913468029,v1:172.21.15.152:6801/913468029]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-07T16:17:43.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:43 smithi063 ceph-mon[112095]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-07T16:17:44.557 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-07T16:17:44.557 INFO:teuthology.orchestra.run.smithi152.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-07T16:17:44.557 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10+0 records in 2023-12-07T16:17:44.557 INFO:teuthology.orchestra.run.smithi152.stderr:10+0 records out 2023-12-07T16:17:44.557 INFO:teuthology.orchestra.run.smithi152.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111659 s, 939 MB/s 2023-12-07T16:17:44.557 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 2023-12-07T16:17:44.557 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping successful for: 2023-12-07T16:17:44.743 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:17:44 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-3[127309]: 2023-12-07T16:17:44.568+0000 7f0e99e3e700 -1 osd.3 0 waiting for initial osdmap 2023-12-07T16:17:44.743 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:17:44 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-3[127309]: 2023-12-07T16:17:44.575+0000 7f0e96c3d700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T16:17:44.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:44 smithi152 ceph-mon[121113]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-12-07T16:17:44.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:44 smithi152 ceph-mon[121113]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-07T16:17:44.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:44 smithi152 ceph-mon[121113]: osdmap e24: 4 total, 3 up, 4 in 2023-12-07T16:17:44.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:44 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T16:17:44.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:44 smithi152 ceph-mon[121113]: from='osd.3 [v2:172.21.15.152:6800/913468029,v1:172.21.15.152:6801/913468029]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-07T16:17:44.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:44 smithi152 ceph-mon[121113]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-07T16:17:44.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:44 smithi063 ceph-mon[112095]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-12-07T16:17:44.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:44 smithi063 ceph-mon[112095]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-07T16:17:44.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:44 smithi063 ceph-mon[112095]: osdmap e24: 4 total, 3 up, 4 in 2023-12-07T16:17:44.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:44 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T16:17:44.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:44 smithi063 ceph-mon[112095]: from='osd.3 [v2:172.21.15.152:6800/913468029,v1:172.21.15.152:6801/913468029]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-07T16:17:44.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:44 smithi063 ceph-mon[112095]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-07T16:17:45.140 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi152:vg_nvme/lv_3 2023-12-07T16:17:45.400 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-07T16:17:45.845 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:45 smithi152 ceph-mon[121113]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-12-07T16:17:45.845 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:45 smithi152 ceph-mon[121113]: osdmap e25: 4 total, 3 up, 4 in 2023-12-07T16:17:45.845 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:45 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T16:17:45.845 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:45 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T16:17:45.845 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:45 smithi152 ceph-mon[121113]: Detected new or changed devices on smithi152 2023-12-07T16:17:45.845 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:45 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:45.845 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:45 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:45.845 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:45 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:17:45.846 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:45 smithi152 ceph-mon[121113]: Adjusting osd_memory_target on smithi152 to 15970M 2023-12-07T16:17:45.846 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:45 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:45.846 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:45 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:17:45.846 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:45 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:17:45.846 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:45 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:45.846 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:45 smithi152 ceph-mon[121113]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-12-07T16:17:45.846 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:45 smithi152 ceph-mon[121113]: osd.3 [v2:172.21.15.152:6800/913468029,v1:172.21.15.152:6801/913468029] boot 2023-12-07T16:17:45.846 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:45 smithi152 ceph-mon[121113]: osdmap e26: 4 total, 4 up, 4 in 2023-12-07T16:17:45.846 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:45 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T16:17:45.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:45 smithi063 ceph-mon[112095]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-12-07T16:17:45.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:45 smithi063 ceph-mon[112095]: osdmap e25: 4 total, 3 up, 4 in 2023-12-07T16:17:45.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:45 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T16:17:45.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:45 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T16:17:45.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:45 smithi063 ceph-mon[112095]: Detected new or changed devices on smithi152 2023-12-07T16:17:45.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:45 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:45.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:45 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:45.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:45 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:17:45.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:45 smithi063 ceph-mon[112095]: Adjusting osd_memory_target on smithi152 to 15970M 2023-12-07T16:17:45.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:45 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:45.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:45 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:17:45.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:45 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:17:45.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:45 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:45.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:45 smithi063 ceph-mon[112095]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-12-07T16:17:45.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:45 smithi063 ceph-mon[112095]: osd.3 [v2:172.21.15.152:6800/913468029,v1:172.21.15.152:6801/913468029] boot 2023-12-07T16:17:45.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:45 smithi063 ceph-mon[112095]: osdmap e26: 4 total, 4 up, 4 in 2023-12-07T16:17:45.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:45 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T16:17:46.356 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.354+0000 7f13ace5c700 1 -- 172.21.15.152:0/3775567299 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13a80fbaf0 msgr2=0x7f13a80fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:17:46.356 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.354+0000 7f13ace5c700 1 --2- 172.21.15.152:0/3775567299 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13a80fbaf0 0x7f13a80fbf00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1398004940 tx=0x7f1398009e30 comp rx=0 tx=0).stop 2023-12-07T16:17:46.356 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.354+0000 7f13ace5c700 1 -- 172.21.15.152:0/3775567299 shutdown_connections 2023-12-07T16:17:46.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.354+0000 7f13ace5c700 1 --2- 172.21.15.152:0/3775567299 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13a80fcd00 0x7f13a80fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:17:46.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.354+0000 7f13ace5c700 1 --2- 172.21.15.152:0/3775567299 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13a80fbaf0 0x7f13a80fbf00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:17:46.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.354+0000 7f13ace5c700 1 -- 172.21.15.152:0/3775567299 >> 172.21.15.152:0/3775567299 conn(0x7f13a80f71b0 msgr2=0x7f13a80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:17:46.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.354+0000 7f13ace5c700 1 -- 172.21.15.152:0/3775567299 shutdown_connections 2023-12-07T16:17:46.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.354+0000 7f13ace5c700 1 -- 172.21.15.152:0/3775567299 wait complete. 2023-12-07T16:17:46.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.355+0000 7f13ace5c700 1 Processor -- start 2023-12-07T16:17:46.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.355+0000 7f13ace5c700 1 -- start start 2023-12-07T16:17:46.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.355+0000 7f13ace5c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13a80fbaf0 0x7f13a810d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:17:46.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.355+0000 7f13ace5c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13a80fcd00 0x7f13a810dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:17:46.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.355+0000 7f13ace5c700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a810e0b0 con 0x7f13a80fcd00 2023-12-07T16:17:46.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.355+0000 7f13ace5c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a810e950 con 0x7f13a80fbaf0 2023-12-07T16:17:46.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.355+0000 7f13a659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13a80fbaf0 0x7f13a810d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:17:46.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.355+0000 7f13a659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13a80fbaf0 0x7f13a810d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45210/0 (socket says 172.21.15.152:45210) 2023-12-07T16:17:46.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.355+0000 7f13a659c700 1 -- 172.21.15.152:0/2353312484 learned_addr learned my addr 172.21.15.152:0/2353312484 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-07T16:17:46.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.355+0000 7f13a5d9b700 1 --2- 172.21.15.152:0/2353312484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13a80fcd00 0x7f13a810dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:17:46.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.356+0000 7f13a659c700 1 -- 172.21.15.152:0/2353312484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13a80fcd00 msgr2=0x7f13a810dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:17:46.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.356+0000 7f13a659c700 1 --2- 172.21.15.152:0/2353312484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13a80fcd00 0x7f13a810dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:17:46.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.356+0000 7f13a659c700 1 -- 172.21.15.152:0/2353312484 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1398005040 con 0x7f13a80fbaf0 2023-12-07T16:17:46.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.356+0000 7f13a659c700 1 --2- 172.21.15.152:0/2353312484 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13a80fbaf0 0x7f13a810d570 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1398004f90 tx=0x7f1398009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:17:46.359 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.356+0000 7f1396ffd700 1 -- 172.21.15.152:0/2353312484 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f139800e040 con 0x7f13a80fbaf0 2023-12-07T16:17:46.359 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.356+0000 7f1396ffd700 1 -- 172.21.15.152:0/2353312484 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f139800bc50 con 0x7f13a80fbaf0 2023-12-07T16:17:46.359 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.356+0000 7f13ace5c700 1 -- 172.21.15.152:0/2353312484 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a810ebd0 con 0x7f13a80fbaf0 2023-12-07T16:17:46.359 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.356+0000 7f1396ffd700 1 -- 172.21.15.152:0/2353312484 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f139801c630 con 0x7f13a80fbaf0 2023-12-07T16:17:46.359 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.356+0000 7f13ace5c700 1 -- 172.21.15.152:0/2353312484 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a810f110 con 0x7f13a80fbaf0 2023-12-07T16:17:46.359 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.357+0000 7f13ace5c700 1 -- 172.21.15.152:0/2353312484 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a804bb80 con 0x7f13a80fbaf0 2023-12-07T16:17:46.359 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.357+0000 7f1396ffd700 1 -- 172.21.15.152:0/2353312484 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f1398013420 con 0x7f13a80fbaf0 2023-12-07T16:17:46.359 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.358+0000 7f1396ffd700 1 --2- 172.21.15.152:0/2353312484 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f1390068f60 0x7f139006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:17:46.359 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.358+0000 7f1396ffd700 1 -- 172.21.15.152:0/2353312484 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 3803+0+0 (secure 0 0 0) 0x7f13980879e0 con 0x7f13a80fbaf0 2023-12-07T16:17:46.359 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.358+0000 7f13a5d9b700 1 --2- 172.21.15.152:0/2353312484 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f1390068f60 0x7f139006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:17:46.360 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.358+0000 7f13a5d9b700 1 --2- 172.21.15.152:0/2353312484 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f1390068f60 0x7f139006b410 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f139c004f40 tx=0x7f139c00b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:17:46.360 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.362+0000 7f1396ffd700 1 -- 172.21.15.152:0/2353312484 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1398058060 con 0x7f13a80fbaf0 2023-12-07T16:17:46.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:17:46.556+0000 7f13ace5c700 1 -- 172.21.15.152:0/2353312484 --> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f13a810f580 con 0x7f1390068f60 2023-12-07T16:17:47.105 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:46 smithi152 ceph-mon[121113]: purged_snaps scrub starts 2023-12-07T16:17:47.106 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:46 smithi152 ceph-mon[121113]: purged_snaps scrub ok 2023-12-07T16:17:47.106 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:46 smithi152 ceph-mon[121113]: osdmap e27: 4 total, 4 up, 4 in 2023-12-07T16:17:47.106 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:46 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-07T16:17:47.106 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:46 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-07T16:17:47.106 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:46 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:17:47.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:46 smithi063 ceph-mon[112095]: purged_snaps scrub starts 2023-12-07T16:17:47.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:46 smithi063 ceph-mon[112095]: purged_snaps scrub ok 2023-12-07T16:17:47.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:46 smithi063 ceph-mon[112095]: osdmap e27: 4 total, 4 up, 4 in 2023-12-07T16:17:47.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:46 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-07T16:17:47.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:46 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-07T16:17:47.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:46 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:17:48.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:48 smithi063 ceph-mon[112095]: from='client.24155 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:17:48.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:48 smithi063 ceph-mon[112095]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-07T16:17:48.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:48 smithi063 ceph-mon[112095]: osdmap e28: 4 total, 4 up, 4 in 2023-12-07T16:17:48.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:48 smithi152 ceph-mon[121113]: from='client.24155 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:17:48.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:48 smithi152 ceph-mon[121113]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-07T16:17:48.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:48 smithi152 ceph-mon[121113]: osdmap e28: 4 total, 4 up, 4 in 2023-12-07T16:17:49.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:49 smithi063 ceph-mon[112095]: from='client.? 172.21.15.152:0/3016856969' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1de5b172-cde3-4139-a24d-8d8c2d3f71da"}]: dispatch 2023-12-07T16:17:49.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:49 smithi063 ceph-mon[112095]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1de5b172-cde3-4139-a24d-8d8c2d3f71da"}]: dispatch 2023-12-07T16:17:49.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:49 smithi063 ceph-mon[112095]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1de5b172-cde3-4139-a24d-8d8c2d3f71da"}]': finished 2023-12-07T16:17:49.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:49 smithi063 ceph-mon[112095]: osdmap e29: 5 total, 4 up, 5 in 2023-12-07T16:17:49.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:49 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-07T16:17:49.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:49 smithi063 ceph-mon[112095]: from='client.? 172.21.15.152:0/3796701424' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-07T16:17:49.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:49 smithi152 ceph-mon[121113]: from='client.? 172.21.15.152:0/3016856969' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1de5b172-cde3-4139-a24d-8d8c2d3f71da"}]: dispatch 2023-12-07T16:17:49.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:49 smithi152 ceph-mon[121113]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1de5b172-cde3-4139-a24d-8d8c2d3f71da"}]: dispatch 2023-12-07T16:17:49.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:49 smithi152 ceph-mon[121113]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1de5b172-cde3-4139-a24d-8d8c2d3f71da"}]': finished 2023-12-07T16:17:49.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:49 smithi152 ceph-mon[121113]: osdmap e29: 5 total, 4 up, 5 in 2023-12-07T16:17:49.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:49 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-07T16:17:49.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:49 smithi152 ceph-mon[121113]: from='client.? 172.21.15.152:0/3796701424' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-07T16:17:50.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:50 smithi063 ceph-mon[112095]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-07T16:17:50.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:50 smithi063 ceph-mon[112095]: osdmap e30: 5 total, 4 up, 5 in 2023-12-07T16:17:50.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:50 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-07T16:17:50.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:50 smithi152 ceph-mon[121113]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-07T16:17:50.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:50 smithi152 ceph-mon[121113]: osdmap e30: 5 total, 4 up, 5 in 2023-12-07T16:17:50.745 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:50 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-07T16:17:52.480 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:52 smithi152 ceph-mon[121113]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 123 KiB/s, 0 objects/s recovering 2023-12-07T16:17:52.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:52 smithi063 ceph-mon[112095]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 123 KiB/s, 0 objects/s recovering 2023-12-07T16:17:54.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:54 smithi063 ceph-mon[112095]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-07T16:17:54.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:54 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-07T16:17:54.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:54 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:17:54.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:54 smithi152 ceph-mon[121113]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-07T16:17:54.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:54 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-07T16:17:54.698 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:54 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:17:55.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:55 smithi063 ceph-mon[112095]: Deploying daemon osd.4 on smithi152 2023-12-07T16:17:55.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:55 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:17:55.708 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:55 smithi152 ceph-mon[121113]: Deploying daemon osd.4 on smithi152 2023-12-07T16:17:55.708 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:55 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:17:56.615 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:56 smithi152 ceph-mon[121113]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2023-12-07T16:17:56.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:56 smithi063 ceph-mon[112095]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2023-12-07T16:17:58.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:58 smithi152 ceph-mon[121113]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-12-07T16:17:58.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:58 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:58.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:58 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:58.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:17:58 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:17:58.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:58 smithi063 ceph-mon[112095]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-12-07T16:17:58.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:58 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:58.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:58 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:17:58.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:17:58 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:18:00.363 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:00.365+0000 7f1396ffd700 1 -- 172.21.15.152:0/2353312484 <== mgr.14212 v2:172.21.15.63:6800/184283085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f13a810f580 con 0x7f1390068f60 2023-12-07T16:18:00.364 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 4 on host 'smithi152' 2023-12-07T16:18:00.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:00.368+0000 7f13ace5c700 1 -- 172.21.15.152:0/2353312484 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f1390068f60 msgr2=0x7f139006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:00.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:00.368+0000 7f13ace5c700 1 --2- 172.21.15.152:0/2353312484 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f1390068f60 0x7f139006b410 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f139c004f40 tx=0x7f139c00b040 comp rx=0 tx=0).stop 2023-12-07T16:18:00.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:00.368+0000 7f13ace5c700 1 -- 172.21.15.152:0/2353312484 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13a80fbaf0 msgr2=0x7f13a810d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:00.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:00.368+0000 7f13ace5c700 1 --2- 172.21.15.152:0/2353312484 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13a80fbaf0 0x7f13a810d570 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1398004f90 tx=0x7f1398009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:00.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:00.368+0000 7f13ace5c700 1 -- 172.21.15.152:0/2353312484 shutdown_connections 2023-12-07T16:18:00.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:00.368+0000 7f13ace5c700 1 --2- 172.21.15.152:0/2353312484 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13a80fbaf0 0x7f13a810d570 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:00.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:00.368+0000 7f13ace5c700 1 --2- 172.21.15.152:0/2353312484 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f1390068f60 0x7f139006b410 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:00.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:00.368+0000 7f13ace5c700 1 --2- 172.21.15.152:0/2353312484 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13a80fcd00 0x7f13a810dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:00.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:00.368+0000 7f13ace5c700 1 -- 172.21.15.152:0/2353312484 >> 172.21.15.152:0/2353312484 conn(0x7f13a80f71b0 msgr2=0x7f13a80f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:00.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:00.368+0000 7f13ace5c700 1 -- 172.21.15.152:0/2353312484 shutdown_connections 2023-12-07T16:18:00.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:00.368+0000 7f13ace5c700 1 -- 172.21.15.152:0/2353312484 wait complete. 2023-12-07T16:18:00.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:00 smithi152 ceph-mon[121113]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-07T16:18:00.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:00 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:00.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:00 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:00.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:00 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:18:00.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:00 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:18:00.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:00 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:00.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:00 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:00.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:00 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:00.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:00 smithi063 ceph-mon[112095]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-07T16:18:00.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:00 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:00.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:00 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:00.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:00 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:18:00.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:00 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:18:00.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:00 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:00.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:00 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:00.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:00 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:00.746 DEBUG:teuthology.orchestra.run.smithi152:osd.4> sudo journalctl -f -n 0 -u ceph-8c493298-951b-11ee-95a2-87774f69a715@osd.4.service 2023-12-07T16:18:00.749 INFO:tasks.cephadm:Deploying osd.5 on smithi152 with /dev/vg_nvme/lv_2... 2023-12-07T16:18:00.749 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-07T16:18:00.777 INFO:journalctl@ceph.osd.4.smithi152.stdout:-- Logs begin at Thu 2023-12-07 15:43:14 UTC. -- 2023-12-07T16:18:01.462 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-07T16:18:01.640 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:01 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:18:01.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:01 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:18:01.992 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:18:01 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-4[135885]: 2023-12-07T16:18:01.781+0000 7ff076fc4540 -1 osd.4 0 log_to_monitors true 2023-12-07T16:18:02.606 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:02 smithi152 ceph-mon[121113]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-07T16:18:02.606 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:02 smithi152 ceph-mon[121113]: from='osd.4 [v2:172.21.15.152:6808/1195082814,v1:172.21.15.152:6809/1195082814]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-07T16:18:02.606 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:02 smithi152 ceph-mon[121113]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-07T16:18:02.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:02 smithi063 ceph-mon[112095]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-07T16:18:02.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:02 smithi063 ceph-mon[112095]: from='osd.4 [v2:172.21.15.152:6808/1195082814,v1:172.21.15.152:6809/1195082814]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-07T16:18:02.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:02 smithi063 ceph-mon[112095]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-07T16:18:02.959 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-07T16:18:02.959 INFO:teuthology.orchestra.run.smithi152.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-07T16:18:02.960 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10+0 records in 2023-12-07T16:18:02.960 INFO:teuthology.orchestra.run.smithi152.stderr:10+0 records out 2023-12-07T16:18:02.960 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111959 s, 937 MB/s 2023-12-07T16:18:02.960 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping successful for: 2023-12-07T16:18:03.463 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi152:vg_nvme/lv_2 2023-12-07T16:18:03.492 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:18:03 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-4[135885]: 2023-12-07T16:18:03.378+0000 7ff06d7a9700 -1 osd.4 0 waiting for initial osdmap 2023-12-07T16:18:03.492 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:18:03 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-4[135885]: 2023-12-07T16:18:03.387+0000 7ff0685a4700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T16:18:03.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:03 smithi152 ceph-mon[121113]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-07T16:18:03.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:03 smithi152 ceph-mon[121113]: osdmap e31: 5 total, 4 up, 5 in 2023-12-07T16:18:03.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:03 smithi152 ceph-mon[121113]: from='osd.4 [v2:172.21.15.152:6808/1195082814,v1:172.21.15.152:6809/1195082814]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-07T16:18:03.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:03 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-07T16:18:03.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:03 smithi152 ceph-mon[121113]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-07T16:18:03.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:03 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:03.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:03 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:03.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:03 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:18:03.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:03 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:18:03.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:03 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:03.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:03 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:18:03.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:03 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:18:03.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:03 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:03.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:03 smithi152 ceph-mon[121113]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-12-07T16:18:03.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:03 smithi152 ceph-mon[121113]: osdmap e32: 5 total, 4 up, 5 in 2023-12-07T16:18:03.494 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:03 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-07T16:18:03.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:03 smithi063 ceph-mon[112095]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-07T16:18:03.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:03 smithi063 ceph-mon[112095]: osdmap e31: 5 total, 4 up, 5 in 2023-12-07T16:18:03.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:03 smithi063 ceph-mon[112095]: from='osd.4 [v2:172.21.15.152:6808/1195082814,v1:172.21.15.152:6809/1195082814]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-07T16:18:03.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:03 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-07T16:18:03.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:03 smithi063 ceph-mon[112095]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-07T16:18:03.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:03 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:03.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:03 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:03.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:03 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:18:03.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:03 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:18:03.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:03 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:03.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:03 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:18:03.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:03 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:18:03.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:03 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:03.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:03 smithi063 ceph-mon[112095]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-12-07T16:18:03.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:03 smithi063 ceph-mon[112095]: osdmap e32: 5 total, 4 up, 5 in 2023-12-07T16:18:03.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:03 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-07T16:18:03.723 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-07T16:18:04.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:04 smithi152 ceph-mon[121113]: Detected new or changed devices on smithi152 2023-12-07T16:18:04.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:04 smithi152 ceph-mon[121113]: Adjusting osd_memory_target on smithi152 to 7985M 2023-12-07T16:18:04.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:04 smithi152 ceph-mon[121113]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-07T16:18:04.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:04 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-07T16:18:04.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:04 smithi152 ceph-mon[121113]: osd.4 [v2:172.21.15.152:6808/1195082814,v1:172.21.15.152:6809/1195082814] boot 2023-12-07T16:18:04.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:04 smithi152 ceph-mon[121113]: osdmap e33: 5 total, 5 up, 5 in 2023-12-07T16:18:04.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:04 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-07T16:18:04.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:04 smithi063 ceph-mon[112095]: Detected new or changed devices on smithi152 2023-12-07T16:18:04.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:04 smithi063 ceph-mon[112095]: Adjusting osd_memory_target on smithi152 to 7985M 2023-12-07T16:18:04.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:04 smithi063 ceph-mon[112095]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-07T16:18:04.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:04 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-07T16:18:04.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:04 smithi063 ceph-mon[112095]: osd.4 [v2:172.21.15.152:6808/1195082814,v1:172.21.15.152:6809/1195082814] boot 2023-12-07T16:18:04.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:04 smithi063 ceph-mon[112095]: osdmap e33: 5 total, 5 up, 5 in 2023-12-07T16:18:04.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:04 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-07T16:18:04.725 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.727+0000 7f62b05b0700 1 -- 172.21.15.152:0/775777634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62a80ffd70 msgr2=0x7f62a81021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:04.725 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.727+0000 7f62b05b0700 1 --2- 172.21.15.152:0/775777634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62a80ffd70 0x7f62a81021d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f62a4004940 tx=0x7f62a4009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:04.726 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.727+0000 7f62b05b0700 1 -- 172.21.15.152:0/775777634 shutdown_connections 2023-12-07T16:18:04.726 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.727+0000 7f62b05b0700 1 --2- 172.21.15.152:0/775777634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62a80ffd70 0x7f62a81021d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:04.726 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.727+0000 7f62b05b0700 1 --2- 172.21.15.152:0/775777634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62a8066090 0x7f62a80ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:04.726 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.727+0000 7f62b05b0700 1 -- 172.21.15.152:0/775777634 >> 172.21.15.152:0/775777634 conn(0x7f62a80f7190 msgr2=0x7f62a80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:04.726 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.727+0000 7f62b05b0700 1 -- 172.21.15.152:0/775777634 shutdown_connections 2023-12-07T16:18:04.726 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.728+0000 7f62b05b0700 1 -- 172.21.15.152:0/775777634 wait complete. 2023-12-07T16:18:04.728 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.728+0000 7f62b05b0700 1 Processor -- start 2023-12-07T16:18:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.728+0000 7f62b05b0700 1 -- start start 2023-12-07T16:18:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.728+0000 7f62b05b0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62a8066090 0x7f62a80fd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.728+0000 7f62b05b0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62a80ffd70 0x7f62a80fb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.728+0000 7f62b05b0700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a80fbca0 con 0x7f62a80ffd70 2023-12-07T16:18:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.728+0000 7f62b05b0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a80fbe10 con 0x7f62a8066090 2023-12-07T16:18:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.728+0000 7f62ae34c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62a8066090 0x7f62a80fd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.728+0000 7f62ae34c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62a8066090 0x7f62a80fd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54436/0 (socket says 172.21.15.152:54436) 2023-12-07T16:18:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.728+0000 7f62ae34c700 1 -- 172.21.15.152:0/3867689588 learned_addr learned my addr 172.21.15.152:0/3867689588 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-07T16:18:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.728+0000 7f62adb4b700 1 --2- 172.21.15.152:0/3867689588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62a80ffd70 0x7f62a80fb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.728+0000 7f62ae34c700 1 -- 172.21.15.152:0/3867689588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62a80ffd70 msgr2=0x7f62a80fb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.728+0000 7f62ae34c700 1 --2- 172.21.15.152:0/3867689588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62a80ffd70 0x7f62a80fb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.728+0000 7f62ae34c700 1 -- 172.21.15.152:0/3867689588 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a4005040 con 0x7f62a8066090 2023-12-07T16:18:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.729+0000 7f62ae34c700 1 --2- 172.21.15.152:0/3867689588 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62a8066090 0x7f62a80fd220 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6298002a50 tx=0x7f62980046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.729+0000 7f629effd700 1 -- 172.21.15.152:0/3867689588 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6298007cc0 con 0x7f62a8066090 2023-12-07T16:18:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.729+0000 7f629effd700 1 -- 172.21.15.152:0/3867689588 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f629800f040 con 0x7f62a8066090 2023-12-07T16:18:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.729+0000 7f62b05b0700 1 -- 172.21.15.152:0/3867689588 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a80fc0f0 con 0x7f62a8066090 2023-12-07T16:18:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.729+0000 7f629effd700 1 -- 172.21.15.152:0/3867689588 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f629800d9c0 con 0x7f62a8066090 2023-12-07T16:18:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.729+0000 7f62b05b0700 1 -- 172.21.15.152:0/3867689588 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a8115530 con 0x7f62a8066090 2023-12-07T16:18:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.730+0000 7f62b05b0700 1 -- 172.21.15.152:0/3867689588 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a81075c0 con 0x7f62a8066090 2023-12-07T16:18:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.730+0000 7f629effd700 1 -- 172.21.15.152:0/3867689588 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f629800db20 con 0x7f62a8066090 2023-12-07T16:18:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.730+0000 7f629effd700 1 --2- 172.21.15.152:0/3867689588 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f6294068f60 0x7f629406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.731+0000 7f629effd700 1 -- 172.21.15.152:0/3867689588 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f62980864f0 con 0x7f62a8066090 2023-12-07T16:18:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.731+0000 7f62adb4b700 1 --2- 172.21.15.152:0/3867689588 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f6294068f60 0x7f629406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:04.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.731+0000 7f62adb4b700 1 --2- 172.21.15.152:0/3867689588 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f6294068f60 0x7f629406b410 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f62a4004890 tx=0x7f62a4009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:04.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.735+0000 7f629effd700 1 -- 172.21.15.152:0/3867689588 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6298056940 con 0x7f62a8066090 2023-12-07T16:18:04.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:04.923+0000 7f62b05b0700 1 -- 172.21.15.152:0/3867689588 --> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f62a802b250 con 0x7f6294068f60 2023-12-07T16:18:05.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:05 smithi063 ceph-mon[112095]: purged_snaps scrub starts 2023-12-07T16:18:05.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:05 smithi063 ceph-mon[112095]: purged_snaps scrub ok 2023-12-07T16:18:05.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:05 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-07T16:18:05.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:05 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-07T16:18:05.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:05 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:18:05.658 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:05 smithi152 ceph-mon[121113]: purged_snaps scrub starts 2023-12-07T16:18:05.658 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:05 smithi152 ceph-mon[121113]: purged_snaps scrub ok 2023-12-07T16:18:05.658 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:05 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-07T16:18:05.658 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:05 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-07T16:18:05.658 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:05 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:18:06.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:06 smithi063 ceph-mon[112095]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:18:06.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:06 smithi063 ceph-mon[112095]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-07T16:18:06.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:06 smithi063 ceph-mon[112095]: osdmap e34: 5 total, 5 up, 5 in 2023-12-07T16:18:06.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:06 smithi152 ceph-mon[121113]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:18:06.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:06 smithi152 ceph-mon[121113]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-07T16:18:06.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:06 smithi152 ceph-mon[121113]: osdmap e34: 5 total, 5 up, 5 in 2023-12-07T16:18:07.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:07 smithi152 ceph-mon[121113]: from='client.? 172.21.15.152:0/3619430112' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "15256051-a7b8-4fb0-8bc5-d865cb551551"}]: dispatch 2023-12-07T16:18:07.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:07 smithi152 ceph-mon[121113]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "15256051-a7b8-4fb0-8bc5-d865cb551551"}]: dispatch 2023-12-07T16:18:07.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:07 smithi152 ceph-mon[121113]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "15256051-a7b8-4fb0-8bc5-d865cb551551"}]': finished 2023-12-07T16:18:07.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:07 smithi152 ceph-mon[121113]: osdmap e35: 6 total, 5 up, 6 in 2023-12-07T16:18:07.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:07 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-07T16:18:07.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:07 smithi152 ceph-mon[121113]: from='client.? 172.21.15.152:0/1002830145' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-07T16:18:07.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:07 smithi063 ceph-mon[112095]: from='client.? 172.21.15.152:0/3619430112' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "15256051-a7b8-4fb0-8bc5-d865cb551551"}]: dispatch 2023-12-07T16:18:07.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:07 smithi063 ceph-mon[112095]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "15256051-a7b8-4fb0-8bc5-d865cb551551"}]: dispatch 2023-12-07T16:18:07.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:07 smithi063 ceph-mon[112095]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "15256051-a7b8-4fb0-8bc5-d865cb551551"}]': finished 2023-12-07T16:18:07.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:07 smithi063 ceph-mon[112095]: osdmap e35: 6 total, 5 up, 6 in 2023-12-07T16:18:07.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:07 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-07T16:18:07.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:07 smithi063 ceph-mon[112095]: from='client.? 172.21.15.152:0/1002830145' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-07T16:18:08.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:08 smithi063 ceph-mon[112095]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-07T16:18:08.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:08 smithi152 ceph-mon[121113]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-07T16:18:10.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:10 smithi063 ceph-mon[112095]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-07T16:18:10.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:10 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:18:10.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:10 smithi152 ceph-mon[121113]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-07T16:18:10.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:10 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:18:12.649 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:12 smithi152 ceph-mon[121113]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-07T16:18:12.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:12 smithi063 ceph-mon[112095]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-07T16:18:13.583 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:13 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-07T16:18:13.583 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:13 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:18:13.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:13 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-07T16:18:13.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:13 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:18:14.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:14 smithi063 ceph-mon[112095]: Deploying daemon osd.5 on smithi152 2023-12-07T16:18:14.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:14 smithi063 ceph-mon[112095]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-07T16:18:14.682 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:14 smithi152 ceph-mon[121113]: Deploying daemon osd.5 on smithi152 2023-12-07T16:18:14.682 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:14 smithi152 ceph-mon[121113]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-07T16:18:16.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:16 smithi152 ceph-mon[121113]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-07T16:18:16.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:16 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:16.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:16 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:16.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:16 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:18:16.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:16 smithi063 ceph-mon[112095]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-07T16:18:16.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:16 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:16.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:16 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:16.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:16 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:18:18.531 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 5 on host 'smithi152' 2023-12-07T16:18:18.533 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:18.532+0000 7f629effd700 1 -- 172.21.15.152:0/3867689588 <== mgr.14212 v2:172.21.15.63:6800/184283085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f62a802b250 con 0x7f6294068f60 2023-12-07T16:18:18.533 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:18.535+0000 7f62b05b0700 1 -- 172.21.15.152:0/3867689588 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f6294068f60 msgr2=0x7f629406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:18.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:18.535+0000 7f62b05b0700 1 --2- 172.21.15.152:0/3867689588 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f6294068f60 0x7f629406b410 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f62a4004890 tx=0x7f62a4009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:18.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:18.535+0000 7f62b05b0700 1 -- 172.21.15.152:0/3867689588 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62a8066090 msgr2=0x7f62a80fd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:18.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:18.535+0000 7f62b05b0700 1 --2- 172.21.15.152:0/3867689588 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62a8066090 0x7f62a80fd220 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6298002a50 tx=0x7f62980046b0 comp rx=0 tx=0).stop 2023-12-07T16:18:18.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:18.535+0000 7f62b05b0700 1 -- 172.21.15.152:0/3867689588 shutdown_connections 2023-12-07T16:18:18.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:18.535+0000 7f62b05b0700 1 --2- 172.21.15.152:0/3867689588 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62a8066090 0x7f62a80fd220 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:18.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:18.535+0000 7f62b05b0700 1 --2- 172.21.15.152:0/3867689588 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f6294068f60 0x7f629406b410 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:18.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:18.535+0000 7f62b05b0700 1 --2- 172.21.15.152:0/3867689588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62a80ffd70 0x7f62a80fb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:18.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:18.535+0000 7f62b05b0700 1 -- 172.21.15.152:0/3867689588 >> 172.21.15.152:0/3867689588 conn(0x7f62a80f7190 msgr2=0x7f62a80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:18.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:18.535+0000 7f62b05b0700 1 -- 172.21.15.152:0/3867689588 shutdown_connections 2023-12-07T16:18:18.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:18.535+0000 7f62b05b0700 1 -- 172.21.15.152:0/3867689588 wait complete. 2023-12-07T16:18:18.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:18 smithi063 ceph-mon[112095]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-07T16:18:18.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:18 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:18.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:18 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:18.731 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:18 smithi152 ceph-mon[121113]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-07T16:18:18.731 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:18 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:18.731 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:18 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:18.979 DEBUG:teuthology.orchestra.run.smithi152:osd.5> sudo journalctl -f -n 0 -u ceph-8c493298-951b-11ee-95a2-87774f69a715@osd.5.service 2023-12-07T16:18:19.021 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2023-12-07T16:18:19.021 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph osd stat -f json 2023-12-07T16:18:19.050 INFO:journalctl@ceph.osd.5.smithi152.stdout:-- Logs begin at Thu 2023-12-07 15:43:14 UTC. -- 2023-12-07T16:18:19.304 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:19.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:19 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:19.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:19 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:19.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:19 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:19.796 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:19 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:20.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.334+0000 7f1354667700 1 -- 172.21.15.63:0/1849116746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f134c0fbaf0 msgr2=0x7f134c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:20.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.334+0000 7f1354667700 1 --2- 172.21.15.63:0/1849116746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f134c0fbaf0 0x7f134c0fbf00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1348004940 tx=0x7f1348009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:20.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.334+0000 7f1354667700 1 -- 172.21.15.63:0/1849116746 shutdown_connections 2023-12-07T16:18:20.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.334+0000 7f1354667700 1 --2- 172.21.15.63:0/1849116746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f134c0fcd00 0x7f134c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:20.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.334+0000 7f1354667700 1 --2- 172.21.15.63:0/1849116746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f134c0fbaf0 0x7f134c0fbf00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:20.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.334+0000 7f1354667700 1 -- 172.21.15.63:0/1849116746 >> 172.21.15.63:0/1849116746 conn(0x7f134c0f7190 msgr2=0x7f134c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:20.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.334+0000 7f1354667700 1 -- 172.21.15.63:0/1849116746 shutdown_connections 2023-12-07T16:18:20.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.334+0000 7f1354667700 1 -- 172.21.15.63:0/1849116746 wait complete. 2023-12-07T16:18:20.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.335+0000 7f1354667700 1 Processor -- start 2023-12-07T16:18:20.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.335+0000 7f1354667700 1 -- start start 2023-12-07T16:18:20.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.335+0000 7f1354667700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f134c0fbaf0 0x7f134c10c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:20.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.335+0000 7f1354667700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f134c0fcd00 0x7f134c10c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:20.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.335+0000 7f1354667700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134c10cf30 con 0x7f134c0fcd00 2023-12-07T16:18:20.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.335+0000 7f1354667700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134c10d7d0 con 0x7f134c0fbaf0 2023-12-07T16:18:20.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.335+0000 7f1351c02700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f134c0fcd00 0x7f134c10c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:20.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.335+0000 7f1351c02700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f134c0fcd00 0x7f134c10c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41318/0 (socket says 172.21.15.63:41318) 2023-12-07T16:18:20.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.335+0000 7f1351c02700 1 -- 172.21.15.63:0/2847354748 learned_addr learned my addr 172.21.15.63:0/2847354748 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:20.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.335+0000 7f1352403700 1 --2- 172.21.15.63:0/2847354748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f134c0fbaf0 0x7f134c10c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:20.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.335+0000 7f1351c02700 1 -- 172.21.15.63:0/2847354748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f134c0fbaf0 msgr2=0x7f134c10c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:20.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.335+0000 7f1351c02700 1 --2- 172.21.15.63:0/2847354748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f134c0fbaf0 0x7f134c10c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:20.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.335+0000 7f1351c02700 1 -- 172.21.15.63:0/2847354748 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1348005040 con 0x7f134c0fcd00 2023-12-07T16:18:20.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.336+0000 7f1351c02700 1 --2- 172.21.15.63:0/2847354748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f134c0fcd00 0x7f134c10c930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f133c00eb40 tx=0x7f133c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:20.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.336+0000 7f1342ffd700 1 -- 172.21.15.63:0/2847354748 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f133c007cc0 con 0x7f134c0fcd00 2023-12-07T16:18:20.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.336+0000 7f1342ffd700 1 -- 172.21.15.63:0/2847354748 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f133c00f040 con 0x7f134c0fcd00 2023-12-07T16:18:20.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.336+0000 7f1354667700 1 -- 172.21.15.63:0/2847354748 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134c10da50 con 0x7f134c0fcd00 2023-12-07T16:18:20.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.336+0000 7f1342ffd700 1 -- 172.21.15.63:0/2847354748 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f133c00c990 con 0x7f134c0fcd00 2023-12-07T16:18:20.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.336+0000 7f1354667700 1 -- 172.21.15.63:0/2847354748 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f134c10df90 con 0x7f134c0fcd00 2023-12-07T16:18:20.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.337+0000 7f1354667700 1 -- 172.21.15.63:0/2847354748 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f134c04bb80 con 0x7f134c0fcd00 2023-12-07T16:18:20.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.337+0000 7f1342ffd700 1 -- 172.21.15.63:0/2847354748 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f133c00cc00 con 0x7f134c0fcd00 2023-12-07T16:18:20.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.338+0000 7f1342ffd700 1 --2- 172.21.15.63:0/2847354748 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f1338068f70 0x7f133806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:20.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.338+0000 7f1342ffd700 1 -- 172.21.15.63:0/2847354748 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4317+0+0 (secure 0 0 0) 0x7f133c086510 con 0x7f134c0fcd00 2023-12-07T16:18:20.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.338+0000 7f1352403700 1 --2- 172.21.15.63:0/2847354748 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f1338068f70 0x7f133806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:20.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.338+0000 7f1352403700 1 --2- 172.21.15.63:0/2847354748 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f1338068f70 0x7f133806b420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f134800b0d0 tx=0x7f1348009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:20.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.342+0000 7f1342ffd700 1 -- 172.21.15.63:0/2847354748 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f133c04da00 con 0x7f134c0fcd00 2023-12-07T16:18:20.489 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:18:20 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[143897]: 2023-12-07T16:18:20.208+0000 7fc15910e540 -1 osd.5 0 log_to_monitors true 2023-12-07T16:18:20.531 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.534+0000 7f1354667700 1 -- 172.21.15.63:0/2847354748 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f134c104490 con 0x7f134c0fcd00 2023-12-07T16:18:20.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.534+0000 7f1342ffd700 1 -- 172.21.15.63:0/2847354748 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v36) v1 ==== 74+0+130 (secure 0 0 0) 0x7f133c056920 con 0x7f134c0fcd00 2023-12-07T16:18:20.532 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:18:20.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.536+0000 7f1354667700 1 -- 172.21.15.63:0/2847354748 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f1338068f70 msgr2=0x7f133806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:20.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.536+0000 7f1354667700 1 --2- 172.21.15.63:0/2847354748 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f1338068f70 0x7f133806b420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f134800b0d0 tx=0x7f1348009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:20.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.536+0000 7f1354667700 1 -- 172.21.15.63:0/2847354748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f134c0fcd00 msgr2=0x7f134c10c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:20.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.536+0000 7f1354667700 1 --2- 172.21.15.63:0/2847354748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f134c0fcd00 0x7f134c10c930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f133c00eb40 tx=0x7f133c00b040 comp rx=0 tx=0).stop 2023-12-07T16:18:20.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.536+0000 7f1354667700 1 -- 172.21.15.63:0/2847354748 shutdown_connections 2023-12-07T16:18:20.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.536+0000 7f1354667700 1 --2- 172.21.15.63:0/2847354748 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f134c0fbaf0 0x7f134c10c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:20.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.536+0000 7f1354667700 1 --2- 172.21.15.63:0/2847354748 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f1338068f70 0x7f133806b420 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:20.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.536+0000 7f1354667700 1 --2- 172.21.15.63:0/2847354748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f134c0fcd00 0x7f134c10c930 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:20.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.536+0000 7f1354667700 1 -- 172.21.15.63:0/2847354748 >> 172.21.15.63:0/2847354748 conn(0x7f134c0f7190 msgr2=0x7f134c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:20.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.536+0000 7f1354667700 1 -- 172.21.15.63:0/2847354748 shutdown_connections 2023-12-07T16:18:20.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:20.536+0000 7f1354667700 1 -- 172.21.15.63:0/2847354748 wait complete. 2023-12-07T16:18:20.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:20 smithi152 ceph-mon[121113]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-07T16:18:20.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:20 smithi152 ceph-mon[121113]: from='osd.5 [v2:172.21.15.152:6816/26565095,v1:172.21.15.152:6817/26565095]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-07T16:18:20.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:20 smithi152 ceph-mon[121113]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-07T16:18:20.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:20 smithi063 ceph-mon[112095]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-07T16:18:20.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:20 smithi063 ceph-mon[112095]: from='osd.5 [v2:172.21.15.152:6816/26565095,v1:172.21.15.152:6817/26565095]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-07T16:18:20.815 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:20 smithi063 ceph-mon[112095]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-07T16:18:20.899 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":36,"num_osds":6,"num_up_osds":5,"osd_up_since":1701965884,"num_in_osds":6,"osd_in_since":1701965886,"num_remapped_pgs":0} 2023-12-07T16:18:21.900 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph osd stat -f json 2023-12-07T16:18:21.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:21 smithi063 ceph-mon[112095]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-07T16:18:21.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:21 smithi063 ceph-mon[112095]: osdmap e36: 6 total, 5 up, 6 in 2023-12-07T16:18:21.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:21 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-07T16:18:21.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:21 smithi063 ceph-mon[112095]: from='osd.5 [v2:172.21.15.152:6816/26565095,v1:172.21.15.152:6817/26565095]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-07T16:18:21.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:21 smithi063 ceph-mon[112095]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-07T16:18:21.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:21 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2847354748' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-07T16:18:21.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:21 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:21.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:21 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:21.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:21 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:18:21.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:21 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:18:21.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:21 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:18:21.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:21 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:21.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:21 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:18:21.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:21 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:18:21.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:21 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:21.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:21 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:18:21.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:21 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:18:21.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:21 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:18:21.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:21 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:21.992 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:18:21 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[143897]: 2023-12-07T16:18:21.510+0000 7fc14f8f3700 -1 osd.5 0 waiting for initial osdmap 2023-12-07T16:18:21.992 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:18:21 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[143897]: 2023-12-07T16:18:21.519+0000 7fc14c6f2700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T16:18:21.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:21 smithi152 ceph-mon[121113]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-07T16:18:21.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:21 smithi152 ceph-mon[121113]: osdmap e36: 6 total, 5 up, 6 in 2023-12-07T16:18:21.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:21 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-07T16:18:21.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:21 smithi152 ceph-mon[121113]: from='osd.5 [v2:172.21.15.152:6816/26565095,v1:172.21.15.152:6817/26565095]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-07T16:18:21.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:21 smithi152 ceph-mon[121113]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-07T16:18:21.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:21 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/2847354748' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-07T16:18:21.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:21 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:21.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:21 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:21.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:21 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:18:21.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:21 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:18:21.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:21 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:18:21.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:21 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:21.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:21 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:18:21.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:21 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:18:21.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:21 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:21.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:21 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:18:21.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:21 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:18:21.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:21 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:18:21.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:21 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:22.186 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:22.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:22 smithi063 ceph-mon[112095]: Detected new or changed devices on smithi152 2023-12-07T16:18:22.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:22 smithi063 ceph-mon[112095]: Adjusting osd_memory_target on smithi152 to 5323M 2023-12-07T16:18:22.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:22 smithi063 ceph-mon[112095]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-07T16:18:22.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:22 smithi063 ceph-mon[112095]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-12-07T16:18:22.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:22 smithi063 ceph-mon[112095]: osdmap e37: 6 total, 5 up, 6 in 2023-12-07T16:18:22.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:22 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-07T16:18:22.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:22 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-07T16:18:22.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:22 smithi152 ceph-mon[121113]: Detected new or changed devices on smithi152 2023-12-07T16:18:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:22 smithi152 ceph-mon[121113]: Adjusting osd_memory_target on smithi152 to 5323M 2023-12-07T16:18:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:22 smithi152 ceph-mon[121113]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-07T16:18:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:22 smithi152 ceph-mon[121113]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-12-07T16:18:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:22 smithi152 ceph-mon[121113]: osdmap e37: 6 total, 5 up, 6 in 2023-12-07T16:18:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:22 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-07T16:18:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:22 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-07T16:18:23.206 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.207+0000 7f8453f62700 1 -- 172.21.15.63:0/2752290362 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f844c066090 msgr2=0x7f844c0ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.207+0000 7f8453f62700 1 --2- 172.21.15.63:0/2752290362 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f844c066090 0x7f844c0ff7a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8448004940 tx=0x7f8448009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.207+0000 7f8453f62700 1 -- 172.21.15.63:0/2752290362 shutdown_connections 2023-12-07T16:18:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.207+0000 7f8453f62700 1 --2- 172.21.15.63:0/2752290362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f844c0ffd70 0x7f844c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.207+0000 7f8453f62700 1 --2- 172.21.15.63:0/2752290362 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f844c066090 0x7f844c0ff7a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.207+0000 7f8453f62700 1 -- 172.21.15.63:0/2752290362 >> 172.21.15.63:0/2752290362 conn(0x7f844c0f7190 msgr2=0x7f844c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.207+0000 7f8453f62700 1 -- 172.21.15.63:0/2752290362 shutdown_connections 2023-12-07T16:18:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.207+0000 7f8453f62700 1 -- 172.21.15.63:0/2752290362 wait complete. 2023-12-07T16:18:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.208+0000 7f8453f62700 1 Processor -- start 2023-12-07T16:18:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.208+0000 7f8453f62700 1 -- start start 2023-12-07T16:18:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.208+0000 7f8453f62700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f844c066090 0x7f844c10d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.208+0000 7f8453f62700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f844c0ffd70 0x7f844c10dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.208+0000 7f8453f62700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c10e0c0 con 0x7f844c066090 2023-12-07T16:18:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.208+0000 7f8453f62700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c10e960 con 0x7f844c0ffd70 2023-12-07T16:18:23.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.208+0000 7f8451cfe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f844c066090 0x7f844c10d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:23.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.208+0000 7f8451cfe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f844c066090 0x7f844c10d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41328/0 (socket says 172.21.15.63:41328) 2023-12-07T16:18:23.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.208+0000 7f8451cfe700 1 -- 172.21.15.63:0/1044705000 learned_addr learned my addr 172.21.15.63:0/1044705000 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:23.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.208+0000 7f84514fd700 1 --2- 172.21.15.63:0/1044705000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f844c0ffd70 0x7f844c10dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:23.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.208+0000 7f8451cfe700 1 -- 172.21.15.63:0/1044705000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f844c0ffd70 msgr2=0x7f844c10dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:23.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.208+0000 7f8451cfe700 1 --2- 172.21.15.63:0/1044705000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f844c0ffd70 0x7f844c10dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:23.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.208+0000 7f8451cfe700 1 -- 172.21.15.63:0/1044705000 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8448005040 con 0x7f844c066090 2023-12-07T16:18:23.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.208+0000 7f84514fd700 1 --2- 172.21.15.63:0/1044705000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f844c0ffd70 0x7f844c10dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T16:18:23.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.208+0000 7f8451cfe700 1 --2- 172.21.15.63:0/1044705000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f844c066090 0x7f844c10d580 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8448009360 tx=0x7f8448009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:23.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.209+0000 7f84427fc700 1 -- 172.21.15.63:0/1044705000 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f844800e040 con 0x7f844c066090 2023-12-07T16:18:23.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.209+0000 7f84427fc700 1 -- 172.21.15.63:0/1044705000 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f844800bcd0 con 0x7f844c066090 2023-12-07T16:18:23.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.209+0000 7f8453f62700 1 -- 172.21.15.63:0/1044705000 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f844c10ebe0 con 0x7f844c066090 2023-12-07T16:18:23.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.209+0000 7f84427fc700 1 -- 172.21.15.63:0/1044705000 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f844801c630 con 0x7f844c066090 2023-12-07T16:18:23.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.209+0000 7f8453f62700 1 -- 172.21.15.63:0/1044705000 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f844c10f120 con 0x7f844c066090 2023-12-07T16:18:23.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.210+0000 7f8453f62700 1 -- 172.21.15.63:0/1044705000 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f844c1075e0 con 0x7f844c066090 2023-12-07T16:18:23.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.210+0000 7f84427fc700 1 -- 172.21.15.63:0/1044705000 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8448013960 con 0x7f844c066090 2023-12-07T16:18:23.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.211+0000 7f84427fc700 1 --2- 172.21.15.63:0/1044705000 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f8438068f60 0x7f843806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:23.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.211+0000 7f84514fd700 1 --2- 172.21.15.63:0/1044705000 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f8438068f60 0x7f843806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:23.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.211+0000 7f84427fc700 1 -- 172.21.15.63:0/1044705000 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8448087f20 con 0x7f844c066090 2023-12-07T16:18:23.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.211+0000 7f84514fd700 1 --2- 172.21.15.63:0/1044705000 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f8438068f60 0x7f843806b410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f843c009fd0 tx=0x7f843c00b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.215+0000 7f84427fc700 1 -- 172.21.15.63:0/1044705000 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f84480b9a00 con 0x7f844c066090 2023-12-07T16:18:23.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.407+0000 7f8453f62700 1 -- 172.21.15.63:0/1044705000 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f844c04bb80 con 0x7f844c066090 2023-12-07T16:18:23.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.407+0000 7f84427fc700 1 -- 172.21.15.63:0/1044705000 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7f84480581c0 con 0x7f844c066090 2023-12-07T16:18:23.405 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:18:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.409+0000 7f8453f62700 1 -- 172.21.15.63:0/1044705000 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f8438068f60 msgr2=0x7f843806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.409+0000 7f8453f62700 1 --2- 172.21.15.63:0/1044705000 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f8438068f60 0x7f843806b410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f843c009fd0 tx=0x7f843c00b040 comp rx=0 tx=0).stop 2023-12-07T16:18:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.409+0000 7f8453f62700 1 -- 172.21.15.63:0/1044705000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f844c066090 msgr2=0x7f844c10d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.409+0000 7f8453f62700 1 --2- 172.21.15.63:0/1044705000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f844c066090 0x7f844c10d580 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8448009360 tx=0x7f8448009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.409+0000 7f8453f62700 1 -- 172.21.15.63:0/1044705000 shutdown_connections 2023-12-07T16:18:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.409+0000 7f8453f62700 1 --2- 172.21.15.63:0/1044705000 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f8438068f60 0x7f843806b410 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.409+0000 7f8453f62700 1 --2- 172.21.15.63:0/1044705000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f844c066090 0x7f844c10d580 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.409+0000 7f8453f62700 1 --2- 172.21.15.63:0/1044705000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f844c0ffd70 0x7f844c10dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.409+0000 7f8453f62700 1 -- 172.21.15.63:0/1044705000 >> 172.21.15.63:0/1044705000 conn(0x7f844c0f7190 msgr2=0x7f844c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.409+0000 7f8453f62700 1 -- 172.21.15.63:0/1044705000 shutdown_connections 2023-12-07T16:18:23.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:23.409+0000 7f8453f62700 1 -- 172.21.15.63:0/1044705000 wait complete. 2023-12-07T16:18:23.723 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:23 smithi063 ceph-mon[112095]: purged_snaps scrub starts 2023-12-07T16:18:23.724 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:23 smithi063 ceph-mon[112095]: purged_snaps scrub ok 2023-12-07T16:18:23.724 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:23 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-07T16:18:23.724 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:23 smithi063 ceph-mon[112095]: osd.5 [v2:172.21.15.152:6816/26565095,v1:172.21.15.152:6817/26565095] boot 2023-12-07T16:18:23.724 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:23 smithi063 ceph-mon[112095]: osdmap e38: 6 total, 6 up, 6 in 2023-12-07T16:18:23.724 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:23 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-07T16:18:23.724 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:23 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/1044705000' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-07T16:18:23.783 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":38,"num_osds":6,"num_up_osds":6,"osd_up_since":1701965902,"num_in_osds":6,"osd_in_since":1701965886,"num_remapped_pgs":0} 2023-12-07T16:18:23.784 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph osd dump --format=json 2023-12-07T16:18:23.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:23 smithi152 ceph-mon[121113]: purged_snaps scrub starts 2023-12-07T16:18:23.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:23 smithi152 ceph-mon[121113]: purged_snaps scrub ok 2023-12-07T16:18:23.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:23 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-07T16:18:23.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:23 smithi152 ceph-mon[121113]: osd.5 [v2:172.21.15.152:6816/26565095,v1:172.21.15.152:6817/26565095] boot 2023-12-07T16:18:23.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:23 smithi152 ceph-mon[121113]: osdmap e38: 6 total, 6 up, 6 in 2023-12-07T16:18:23.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:23 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-07T16:18:23.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:23 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/1044705000' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-07T16:18:24.095 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:24.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:24 smithi063 ceph-mon[112095]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-07T16:18:24.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:24 smithi063 ceph-mon[112095]: osdmap e39: 6 total, 6 up, 6 in 2023-12-07T16:18:24.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:24 smithi152 ceph-mon[121113]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-07T16:18:24.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:24 smithi152 ceph-mon[121113]: osdmap e39: 6 total, 6 up, 6 in 2023-12-07T16:18:25.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.148+0000 7f701836d700 1 -- 172.21.15.63:0/186528962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7010102c20 msgr2=0x7f7010102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:25.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.148+0000 7f701836d700 1 --2- 172.21.15.63:0/186528962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7010102c20 0x7f7010102ff0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7000004940 tx=0x7f7000009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:25.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.148+0000 7f701836d700 1 -- 172.21.15.63:0/186528962 shutdown_connections 2023-12-07T16:18:25.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.148+0000 7f701836d700 1 --2- 172.21.15.63:0/186528962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7010065390 0x7f7010065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:25.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.148+0000 7f701836d700 1 --2- 172.21.15.63:0/186528962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7010102c20 0x7f7010102ff0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:25.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.148+0000 7f701836d700 1 -- 172.21.15.63:0/186528962 >> 172.21.15.63:0/186528962 conn(0x7f70100719b0 msgr2=0x7f7010071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:25.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.148+0000 7f701836d700 1 -- 172.21.15.63:0/186528962 shutdown_connections 2023-12-07T16:18:25.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.148+0000 7f701836d700 1 -- 172.21.15.63:0/186528962 wait complete. 2023-12-07T16:18:25.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.148+0000 7f701836d700 1 Processor -- start 2023-12-07T16:18:25.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.148+0000 7f701836d700 1 -- start start 2023-12-07T16:18:25.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.149+0000 7f701836d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7010065390 0x7f7010113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:25.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.149+0000 7f701836d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7010102c20 0x7f7010113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:25.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.149+0000 7f701836d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7010114220 con 0x7f7010065390 2023-12-07T16:18:25.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.149+0000 7f701836d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701010d570 con 0x7f7010102c20 2023-12-07T16:18:25.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.149+0000 7f7016109700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7010065390 0x7f7010113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:25.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.149+0000 7f7016109700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7010065390 0x7f7010113690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41352/0 (socket says 172.21.15.63:41352) 2023-12-07T16:18:25.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.149+0000 7f7016109700 1 -- 172.21.15.63:0/1830172756 learned_addr learned my addr 172.21.15.63:0/1830172756 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:25.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.149+0000 7f7015908700 1 --2- 172.21.15.63:0/1830172756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7010102c20 0x7f7010113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:25.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.149+0000 7f7016109700 1 -- 172.21.15.63:0/1830172756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7010102c20 msgr2=0x7f7010113bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:25.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.149+0000 7f7016109700 1 --2- 172.21.15.63:0/1830172756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7010102c20 0x7f7010113bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:25.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.149+0000 7f7016109700 1 -- 172.21.15.63:0/1830172756 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7000005040 con 0x7f7010065390 2023-12-07T16:18:25.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.149+0000 7f7015908700 1 --2- 172.21.15.63:0/1830172756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7010102c20 0x7f7010113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T16:18:25.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.149+0000 7f7016109700 1 --2- 172.21.15.63:0/1830172756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7010065390 0x7f7010113690 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7000009180 tx=0x7f7000009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:25.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.149+0000 7f7006ffd700 1 -- 172.21.15.63:0/1830172756 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f700000e040 con 0x7f7010065390 2023-12-07T16:18:25.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.149+0000 7f701836d700 1 -- 172.21.15.63:0/1830172756 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f701010d7f0 con 0x7f7010065390 2023-12-07T16:18:25.150 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.149+0000 7f7006ffd700 1 -- 172.21.15.63:0/1830172756 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7000013420 con 0x7f7010065390 2023-12-07T16:18:25.150 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.149+0000 7f7006ffd700 1 -- 172.21.15.63:0/1830172756 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f700001c630 con 0x7f7010065390 2023-12-07T16:18:25.150 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.150+0000 7f701836d700 1 -- 172.21.15.63:0/1830172756 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f701010dd30 con 0x7f7010065390 2023-12-07T16:18:25.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.150+0000 7f701836d700 1 -- 172.21.15.63:0/1830172756 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70100fff40 con 0x7f7010065390 2023-12-07T16:18:25.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.151+0000 7f7006ffd700 1 -- 172.21.15.63:0/1830172756 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f70000139e0 con 0x7f7010065390 2023-12-07T16:18:25.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.151+0000 7f7006ffd700 1 --2- 172.21.15.63:0/1830172756 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f6ffc068f60 0x7f6ffc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:25.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.151+0000 7f7006ffd700 1 -- 172.21.15.63:0/1830172756 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7000087df0 con 0x7f7010065390 2023-12-07T16:18:25.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.151+0000 7f7015908700 1 --2- 172.21.15.63:0/1830172756 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f6ffc068f60 0x7f6ffc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:25.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.152+0000 7f7015908700 1 --2- 172.21.15.63:0/1830172756 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f6ffc068f60 0x7f6ffc06b410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f700c007fd0 tx=0x7f700c009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:25.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.156+0000 7f7006ffd700 1 -- 172.21.15.63:0/1830172756 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7000057ff0 con 0x7f7010065390 2023-12-07T16:18:25.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.349+0000 7f701836d700 1 -- 172.21.15.63:0/1830172756 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f701004bb80 con 0x7f7010065390 2023-12-07T16:18:25.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.350+0000 7f7006ffd700 1 -- 172.21.15.63:0/1830172756 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11057 (secure 0 0 0) 0x7f7000057b80 con 0x7f7010065390 2023-12-07T16:18:25.348 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:18:25.348 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":39,"fsid":"8c493298-951b-11ee-95a2-87774f69a715","created":"2023-12-07T16:14:03.401177+0000","modified":"2023-12-07T16:18:23.512847+0000","last_up_change":"2023-12-07T16:18:22.506548+0000","last_in_change":"2023-12-07T16:18:06.682768+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T16:17:29.746142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"d8cce319-d8dc-49e7-8596-ba27cc0f8836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2340994154},{"type":"v1","addr":"172.21.15.63:6803","nonce":2340994154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2340994154},{"type":"v1","addr":"172.21.15.63:6805","nonce":2340994154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2340994154},{"type":"v1","addr":"172.21.15.63:6809","nonce":2340994154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2340994154},{"type":"v1","addr":"172.21.15.63:6807","nonce":2340994154}]},"public_addr":"172.21.15.63:6803/2340994154","cluster_addr":"172.21.15.63:6805/2340994154","heartbeat_back_addr":"172.21.15.63:6809/2340994154","heartbeat_front_addr":"172.21.15.63:6807/2340994154","state":["exists","up"]},{"osd":1,"uuid":"4f6f5869-8c07-49cf-8d7e-4eaab3f54f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":1466128324},{"type":"v1","addr":"172.21.15.63:6811","nonce":1466128324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":1466128324},{"type":"v1","addr":"172.21.15.63:6813","nonce":1466128324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1466128324},{"type":"v1","addr":"172.21.15.63:6817","nonce":1466128324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":1466128324},{"type":"v1","addr":"172.21.15.63:6815","nonce":1466128324}]},"public_addr":"172.21.15.63:6811/1466128324","cluster_addr":"172.21.15.63:6813/1466128324","heartbeat_back_addr":"172.21.15.63:6817/1466128324","heartbeat_front_addr":"172.21.15.63:6815/1466128324","state":["exists","up"]},{"osd":2,"uuid":"42f79427-9cc3-42aa-91ab-4c28094437d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":1582539682},{"type":"v1","addr":"172.21.15.63:6819","nonce":1582539682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1582539682},{"type":"v1","addr":"172.21.15.63:6821","nonce":1582539682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1582539682},{"type":"v1","addr":"172.21.15.63:6825","nonce":1582539682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1582539682},{"type":"v1","addr":"172.21.15.63:6823","nonce":1582539682}]},"public_addr":"172.21.15.63:6819/1582539682","cluster_addr":"172.21.15.63:6821/1582539682","heartbeat_back_addr":"172.21.15.63:6825/1582539682","heartbeat_front_addr":"172.21.15.63:6823/1582539682","state":["exists","up"]},{"osd":3,"uuid":"57bde3cf-c59d-4ccb-9d76-894dc48e51b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":913468029},{"type":"v1","addr":"172.21.15.152:6801","nonce":913468029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":913468029},{"type":"v1","addr":"172.21.15.152:6803","nonce":913468029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":913468029},{"type":"v1","addr":"172.21.15.152:6807","nonce":913468029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":913468029},{"type":"v1","addr":"172.21.15.152:6805","nonce":913468029}]},"public_addr":"172.21.15.152:6801/913468029","cluster_addr":"172.21.15.152:6803/913468029","heartbeat_back_addr":"172.21.15.152:6807/913468029","heartbeat_front_addr":"172.21.15.152:6805/913468029","state":["exists","up"]},{"osd":4,"uuid":"1de5b172-cde3-4139-a24d-8d8c2d3f71da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1195082814},{"type":"v1","addr":"172.21.15.152:6809","nonce":1195082814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1195082814},{"type":"v1","addr":"172.21.15.152:6811","nonce":1195082814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1195082814},{"type":"v1","addr":"172.21.15.152:6815","nonce":1195082814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1195082814},{"type":"v1","addr":"172.21.15.152:6813","nonce":1195082814}]},"public_addr":"172.21.15.152:6809/1195082814","cluster_addr":"172.21.15.152:6811/1195082814","heartbeat_back_addr":"172.21.15.152:6815/1195082814","heartbeat_front_addr":"172.21.15.152:6813/1195082814","state":["exists","up"]},{"osd":5,"uuid":"15256051-a7b8-4fb0-8bc5-d865cb551551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":26565095},{"type":"v1","addr":"172.21.15.152:6817","nonce":26565095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":26565095},{"type":"v1","addr":"172.21.15.152:6819","nonce":26565095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":26565095},{"type":"v1","addr":"172.21.15.152:6823","nonce":26565095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":26565095},{"type":"v1","addr":"172.21.15.152:6821","nonce":26565095}]},"public_addr":"172.21.15.152:6817/26565095","cluster_addr":"172.21.15.152:6819/26565095","heartbeat_back_addr":"172.21.15.152:6823/26565095","heartbeat_front_addr":"172.21.15.152:6821/26565095","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:16:47.295417+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:17:06.714097+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:17:26.421837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:17:44.503538+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:18:02.822131+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:18:21.243021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:6800/4069965417":"2023-12-08T16:15:55.242508+0000","172.21.15.63:6801/1052036735":"2023-12-08T16:14:59.065782+0000","172.21.15.63:0/3523609322":"2023-12-08T16:14:59.065782+0000","172.21.15.63:6800/1052036735":"2023-12-08T16:14:59.065782+0000","172.21.15.63:6801/4069965417":"2023-12-08T16:15:55.242508+0000","172.21.15.63:0/127598952":"2023-12-08T16:14:59.065782+0000","172.21.15.63:0/4058757998":"2023-12-08T16:14:27.410651+0000","172.21.15.63:0/396959949":"2023-12-08T16:15:55.242508+0000","172.21.15.63:0/1270045079":"2023-12-08T16:15:55.242508+0000","172.21.15.63:0/1828519471":"2023-12-08T16:14:27.410651+0000","172.21.15.63:6800/2117148141":"2023-12-08T16:14:27.410651+0000","172.21.15.63:6801/2117148141":"2023-12-08T16:14:27.410651+0000","172.21.15.63:0/3827601892":"2023-12-08T16:15:55.242508+0000","172.21.15.63:0/997543331":"2023-12-08T16:14:27.410651+0000","172.21.15.63:0/363151719":"2023-12-08T16:14:59.065782+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T16:18:25.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.352+0000 7f701836d700 1 -- 172.21.15.63:0/1830172756 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f6ffc068f60 msgr2=0x7f6ffc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:25.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.352+0000 7f701836d700 1 --2- 172.21.15.63:0/1830172756 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f6ffc068f60 0x7f6ffc06b410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f700c007fd0 tx=0x7f700c009040 comp rx=0 tx=0).stop 2023-12-07T16:18:25.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.352+0000 7f701836d700 1 -- 172.21.15.63:0/1830172756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7010065390 msgr2=0x7f7010113690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:25.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.352+0000 7f701836d700 1 --2- 172.21.15.63:0/1830172756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7010065390 0x7f7010113690 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7000009180 tx=0x7f7000009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:25.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.352+0000 7f701836d700 1 -- 172.21.15.63:0/1830172756 shutdown_connections 2023-12-07T16:18:25.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.352+0000 7f701836d700 1 --2- 172.21.15.63:0/1830172756 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f6ffc068f60 0x7f6ffc06b410 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:25.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.352+0000 7f701836d700 1 --2- 172.21.15.63:0/1830172756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7010065390 0x7f7010113690 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:25.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.352+0000 7f701836d700 1 --2- 172.21.15.63:0/1830172756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7010102c20 0x7f7010113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:25.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.352+0000 7f701836d700 1 -- 172.21.15.63:0/1830172756 >> 172.21.15.63:0/1830172756 conn(0x7f70100719b0 msgr2=0x7f70100fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:25.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.352+0000 7f701836d700 1 -- 172.21.15.63:0/1830172756 shutdown_connections 2023-12-07T16:18:25.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:25.352+0000 7f701836d700 1 -- 172.21.15.63:0/1830172756 wait complete. 2023-12-07T16:18:25.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:25 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:18:25.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:25 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/1830172756' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-07T16:18:25.774 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T16:17:29.746142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-07T16:18:25.775 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph osd pool get .mgr pg_num 2023-12-07T16:18:25.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:25 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:18:25.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:25 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/1830172756' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-07T16:18:26.045 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:26.854 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:26 smithi063 ceph-mon[112095]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:26.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:26 smithi152 ceph-mon[121113]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:27.035 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.036+0000 7f399cdb7700 1 -- 172.21.15.63:0/3484369253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3998101b00 msgr2=0x7f3998101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:27.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.036+0000 7f399cdb7700 1 --2- 172.21.15.63:0/3484369253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3998101b00 0x7f3998101ed0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f398c004940 tx=0x7f398c009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:27.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.036+0000 7f399cdb7700 1 -- 172.21.15.63:0/3484369253 shutdown_connections 2023-12-07T16:18:27.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.036+0000 7f399cdb7700 1 --2- 172.21.15.63:0/3484369253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39980fbb40 0x7f39980fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:27.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.036+0000 7f399cdb7700 1 --2- 172.21.15.63:0/3484369253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3998101b00 0x7f3998101ed0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:27.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.036+0000 7f399cdb7700 1 -- 172.21.15.63:0/3484369253 >> 172.21.15.63:0/3484369253 conn(0x7f39980719b0 msgr2=0x7f3998071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:27.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.036+0000 7f399cdb7700 1 -- 172.21.15.63:0/3484369253 shutdown_connections 2023-12-07T16:18:27.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.036+0000 7f399cdb7700 1 -- 172.21.15.63:0/3484369253 wait complete. 2023-12-07T16:18:27.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.036+0000 7f399cdb7700 1 Processor -- start 2023-12-07T16:18:27.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.036+0000 7f399cdb7700 1 -- start start 2023-12-07T16:18:27.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.037+0000 7f399cdb7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39980fbb40 0x7f3998112570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:27.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.037+0000 7f399cdb7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3998101b00 0x7f3998112ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:27.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.037+0000 7f399cdb7700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3998113100 con 0x7f39980fbb40 2023-12-07T16:18:27.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.037+0000 7f399cdb7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399810c430 con 0x7f3998101b00 2023-12-07T16:18:27.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.037+0000 7f399659c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39980fbb40 0x7f3998112570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:27.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.037+0000 7f399659c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39980fbb40 0x7f3998112570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41362/0 (socket says 172.21.15.63:41362) 2023-12-07T16:18:27.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.037+0000 7f399659c700 1 -- 172.21.15.63:0/1129362336 learned_addr learned my addr 172.21.15.63:0/1129362336 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:27.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.037+0000 7f3995d9b700 1 --2- 172.21.15.63:0/1129362336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3998101b00 0x7f3998112ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:27.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.037+0000 7f399659c700 1 -- 172.21.15.63:0/1129362336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3998101b00 msgr2=0x7f3998112ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:27.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.037+0000 7f399659c700 1 --2- 172.21.15.63:0/1129362336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3998101b00 0x7f3998112ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:27.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.037+0000 7f399659c700 1 -- 172.21.15.63:0/1129362336 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c005040 con 0x7f39980fbb40 2023-12-07T16:18:27.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.037+0000 7f3995d9b700 1 --2- 172.21.15.63:0/1129362336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3998101b00 0x7f3998112ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T16:18:27.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.037+0000 7f399659c700 1 --2- 172.21.15.63:0/1129362336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39980fbb40 0x7f3998112570 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f398c00b3b0 tx=0x7f398c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:27.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.037+0000 7f3986ffd700 1 -- 172.21.15.63:0/1129362336 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f398c00e040 con 0x7f39980fbb40 2023-12-07T16:18:27.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.037+0000 7f3986ffd700 1 -- 172.21.15.63:0/1129362336 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f398c00bc50 con 0x7f39980fbb40 2023-12-07T16:18:27.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.037+0000 7f399cdb7700 1 -- 172.21.15.63:0/1129362336 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f399810c6b0 con 0x7f39980fbb40 2023-12-07T16:18:27.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.037+0000 7f3986ffd700 1 -- 172.21.15.63:0/1129362336 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f398c013420 con 0x7f39980fbb40 2023-12-07T16:18:27.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.037+0000 7f399cdb7700 1 -- 172.21.15.63:0/1129362336 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f399810cbf0 con 0x7f39980fbb40 2023-12-07T16:18:27.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.038+0000 7f399cdb7700 1 -- 172.21.15.63:0/1129362336 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3998103fb0 con 0x7f39980fbb40 2023-12-07T16:18:27.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.039+0000 7f3986ffd700 1 -- 172.21.15.63:0/1129362336 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f398c01c430 con 0x7f39980fbb40 2023-12-07T16:18:27.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.039+0000 7f3986ffd700 1 --2- 172.21.15.63:0/1129362336 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f3980068f60 0x7f398006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:27.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.039+0000 7f3986ffd700 1 -- 172.21.15.63:0/1129362336 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f398c087780 con 0x7f39980fbb40 2023-12-07T16:18:27.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.039+0000 7f3995d9b700 1 --2- 172.21.15.63:0/1129362336 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f3980068f60 0x7f398006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:27.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.040+0000 7f3995d9b700 1 --2- 172.21.15.63:0/1129362336 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f3980068f60 0x7f398006b410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3988009fd0 tx=0x7f3988009f20 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:27.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.044+0000 7f3986ffd700 1 -- 172.21.15.63:0/1129362336 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f398c057b70 con 0x7f39980fbb40 2023-12-07T16:18:27.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.236+0000 7f399cdb7700 1 -- 172.21.15.63:0/1129362336 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f399804bc10 con 0x7f39980fbb40 2023-12-07T16:18:27.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.237+0000 7f3986ffd700 1 -- 172.21.15.63:0/1129362336 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f398c057700 con 0x7f39980fbb40 2023-12-07T16:18:27.235 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-07T16:18:27.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.239+0000 7f399cdb7700 1 -- 172.21.15.63:0/1129362336 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f3980068f60 msgr2=0x7f398006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:27.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.239+0000 7f399cdb7700 1 --2- 172.21.15.63:0/1129362336 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f3980068f60 0x7f398006b410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3988009fd0 tx=0x7f3988009f20 comp rx=0 tx=0).stop 2023-12-07T16:18:27.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.239+0000 7f399cdb7700 1 -- 172.21.15.63:0/1129362336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39980fbb40 msgr2=0x7f3998112570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:27.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.239+0000 7f399cdb7700 1 --2- 172.21.15.63:0/1129362336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39980fbb40 0x7f3998112570 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f398c00b3b0 tx=0x7f398c009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:27.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.239+0000 7f399cdb7700 1 -- 172.21.15.63:0/1129362336 shutdown_connections 2023-12-07T16:18:27.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.239+0000 7f399cdb7700 1 --2- 172.21.15.63:0/1129362336 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f3980068f60 0x7f398006b410 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:27.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.239+0000 7f399cdb7700 1 --2- 172.21.15.63:0/1129362336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39980fbb40 0x7f3998112570 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:27.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.239+0000 7f399cdb7700 1 --2- 172.21.15.63:0/1129362336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3998101b00 0x7f3998112ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:27.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.239+0000 7f399cdb7700 1 -- 172.21.15.63:0/1129362336 >> 172.21.15.63:0/1129362336 conn(0x7f39980719b0 msgr2=0x7f39980fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:27.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.239+0000 7f399cdb7700 1 -- 172.21.15.63:0/1129362336 shutdown_connections 2023-12-07T16:18:27.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:27.239+0000 7f399cdb7700 1 -- 172.21.15.63:0/1129362336 wait complete. 2023-12-07T16:18:27.600 INFO:tasks.cephadm:Setting up client nodes... 2023-12-07T16:18:27.600 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-07T16:18:27.870 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:27.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:27 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/1129362336' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-07T16:18:27.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:27 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/1129362336' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-07T16:18:28.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:28 smithi063 ceph-mon[112095]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:28.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.927+0000 7fd357bdf700 1 -- 172.21.15.63:0/1289761698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd350066090 msgr2=0x7fd3500ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:28.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.927+0000 7fd357bdf700 1 --2- 172.21.15.63:0/1289761698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd350066090 0x7fd3500ff7a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd344004940 tx=0x7fd344009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:28.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.927+0000 7fd357bdf700 1 -- 172.21.15.63:0/1289761698 shutdown_connections 2023-12-07T16:18:28.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.927+0000 7fd357bdf700 1 --2- 172.21.15.63:0/1289761698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3500ffd70 0x7fd3501021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:28.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.927+0000 7fd357bdf700 1 --2- 172.21.15.63:0/1289761698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd350066090 0x7fd3500ff7a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:28.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.927+0000 7fd357bdf700 1 -- 172.21.15.63:0/1289761698 >> 172.21.15.63:0/1289761698 conn(0x7fd3500f7190 msgr2=0x7fd3500f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:28.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.927+0000 7fd357bdf700 1 -- 172.21.15.63:0/1289761698 shutdown_connections 2023-12-07T16:18:28.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.927+0000 7fd357bdf700 1 -- 172.21.15.63:0/1289761698 wait complete. 2023-12-07T16:18:28.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.928+0000 7fd357bdf700 1 Processor -- start 2023-12-07T16:18:28.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.928+0000 7fd357bdf700 1 -- start start 2023-12-07T16:18:28.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.928+0000 7fd357bdf700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd350066090 0x7fd35010d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:28.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.928+0000 7fd357bdf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3500ffd70 0x7fd35010dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:28.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.928+0000 7fd357bdf700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35010e150 con 0x7fd350066090 2023-12-07T16:18:28.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.928+0000 7fd357bdf700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35010e990 con 0x7fd3500ffd70 2023-12-07T16:18:28.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.928+0000 7fd35597b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd350066090 0x7fd35010d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:28.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.928+0000 7fd35597b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd350066090 0x7fd35010d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41370/0 (socket says 172.21.15.63:41370) 2023-12-07T16:18:28.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.928+0000 7fd35597b700 1 -- 172.21.15.63:0/3948086865 learned_addr learned my addr 172.21.15.63:0/3948086865 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:28.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.928+0000 7fd35517a700 1 --2- 172.21.15.63:0/3948086865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3500ffd70 0x7fd35010dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:28.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.928+0000 7fd35597b700 1 -- 172.21.15.63:0/3948086865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3500ffd70 msgr2=0x7fd35010dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:28.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.928+0000 7fd35597b700 1 --2- 172.21.15.63:0/3948086865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3500ffd70 0x7fd35010dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:28.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.928+0000 7fd35597b700 1 -- 172.21.15.63:0/3948086865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd344005040 con 0x7fd350066090 2023-12-07T16:18:28.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.928+0000 7fd35597b700 1 --2- 172.21.15.63:0/3948086865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd350066090 0x7fd35010d580 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd344009360 tx=0x7fd344009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:28.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.929+0000 7fd3427fc700 1 -- 172.21.15.63:0/3948086865 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd34400e040 con 0x7fd350066090 2023-12-07T16:18:28.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.929+0000 7fd3427fc700 1 -- 172.21.15.63:0/3948086865 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd34400bc50 con 0x7fd350066090 2023-12-07T16:18:28.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.929+0000 7fd357bdf700 1 -- 172.21.15.63:0/3948086865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd35010ec10 con 0x7fd350066090 2023-12-07T16:18:28.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.929+0000 7fd3427fc700 1 -- 172.21.15.63:0/3948086865 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd34401c3f0 con 0x7fd350066090 2023-12-07T16:18:28.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.929+0000 7fd357bdf700 1 -- 172.21.15.63:0/3948086865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35010f150 con 0x7fd350066090 2023-12-07T16:18:28.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.930+0000 7fd357bdf700 1 -- 172.21.15.63:0/3948086865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd35004bb80 con 0x7fd350066090 2023-12-07T16:18:28.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.931+0000 7fd3427fc700 1 -- 172.21.15.63:0/3948086865 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd344013420 con 0x7fd350066090 2023-12-07T16:18:28.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.931+0000 7fd3427fc700 1 --2- 172.21.15.63:0/3948086865 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd33c068f60 0x7fd33c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:28.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.931+0000 7fd3427fc700 1 -- 172.21.15.63:0/3948086865 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd3440887a0 con 0x7fd350066090 2023-12-07T16:18:28.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.931+0000 7fd35517a700 1 --2- 172.21.15.63:0/3948086865 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd33c068f60 0x7fd33c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:28.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.931+0000 7fd35517a700 1 --2- 172.21.15.63:0/3948086865 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd33c068f60 0x7fd33c06b410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd350065dd0 tx=0x7fd34c0091a0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:28.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:28.935+0000 7fd3427fc700 1 -- 172.21.15.63:0/3948086865 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd344058ae0 con 0x7fd350066090 2023-12-07T16:18:28.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:28 smithi152 ceph-mon[121113]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:29.205 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:29.208+0000 7fd357bdf700 1 -- 172.21.15.63:0/3948086865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fd350105620 con 0x7fd350066090 2023-12-07T16:18:29.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:29.212+0000 7fd3427fc700 1 -- 172.21.15.63:0/3948086865 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7fd344058670 con 0x7fd350066090 2023-12-07T16:18:29.209 INFO:teuthology.orchestra.run.smithi063.stdout:[client.0] 2023-12-07T16:18:29.209 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBV8HFlbPh1DBAAouydn2Ae9MYFhWy34qAndQ== 2023-12-07T16:18:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:29.214+0000 7fd357bdf700 1 -- 172.21.15.63:0/3948086865 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd33c068f60 msgr2=0x7fd33c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:29.214+0000 7fd357bdf700 1 --2- 172.21.15.63:0/3948086865 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd33c068f60 0x7fd33c06b410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd350065dd0 tx=0x7fd34c0091a0 comp rx=0 tx=0).stop 2023-12-07T16:18:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:29.214+0000 7fd357bdf700 1 -- 172.21.15.63:0/3948086865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd350066090 msgr2=0x7fd35010d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:29.214+0000 7fd357bdf700 1 --2- 172.21.15.63:0/3948086865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd350066090 0x7fd35010d580 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd344009360 tx=0x7fd344009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:29.214+0000 7fd357bdf700 1 -- 172.21.15.63:0/3948086865 shutdown_connections 2023-12-07T16:18:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:29.214+0000 7fd357bdf700 1 --2- 172.21.15.63:0/3948086865 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd33c068f60 0x7fd33c06b410 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:29.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:29.214+0000 7fd357bdf700 1 --2- 172.21.15.63:0/3948086865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd350066090 0x7fd35010d580 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:29.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:29.214+0000 7fd357bdf700 1 --2- 172.21.15.63:0/3948086865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd3500ffd70 0x7fd35010dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:29.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:29.214+0000 7fd357bdf700 1 -- 172.21.15.63:0/3948086865 >> 172.21.15.63:0/3948086865 conn(0x7fd3500f7190 msgr2=0x7fd3500f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:29.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:29.214+0000 7fd357bdf700 1 -- 172.21.15.63:0/3948086865 shutdown_connections 2023-12-07T16:18:29.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:29.214+0000 7fd357bdf700 1 -- 172.21.15.63:0/3948086865 wait complete. 2023-12-07T16:18:29.581 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-07T16:18:29.582 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-12-07T16:18:29.582 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-07T16:18:29.622 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-07T16:18:29.895 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-07T16:18:29.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:29 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/3948086865' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-07T16:18:29.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:29 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/3948086865' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-07T16:18:29.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:29 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/3948086865' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-07T16:18:29.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:29 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/3948086865' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-07T16:18:30.729 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:30 smithi152 ceph-mon[121113]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:30.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:30 smithi063 ceph-mon[112095]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:30.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.929+0000 7fc1c87a8700 1 -- 172.21.15.152:0/2138362531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c00fde90 msgr2=0x7fc1c00fe300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:30.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.929+0000 7fc1c87a8700 1 --2- 172.21.15.152:0/2138362531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c00fde90 0x7fc1c00fe300 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc004940 tx=0x7fc1bc009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:30.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.929+0000 7fc1c87a8700 1 -- 172.21.15.152:0/2138362531 shutdown_connections 2023-12-07T16:18:30.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.929+0000 7fc1c87a8700 1 --2- 172.21.15.152:0/2138362531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c00fde90 0x7fc1c00fe300 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:30.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.929+0000 7fc1c87a8700 1 --2- 172.21.15.152:0/2138362531 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1c00fcbe0 0x7fc1c00fcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:30.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.929+0000 7fc1c87a8700 1 -- 172.21.15.152:0/2138362531 >> 172.21.15.152:0/2138362531 conn(0x7fc1c00f8360 msgr2=0x7fc1c00fa770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:30.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.929+0000 7fc1c87a8700 1 -- 172.21.15.152:0/2138362531 shutdown_connections 2023-12-07T16:18:30.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.929+0000 7fc1c87a8700 1 -- 172.21.15.152:0/2138362531 wait complete. 2023-12-07T16:18:30.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.929+0000 7fc1c87a8700 1 Processor -- start 2023-12-07T16:18:30.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.929+0000 7fc1c87a8700 1 -- start start 2023-12-07T16:18:30.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.930+0000 7fc1c87a8700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1c00fcbe0 0x7fc1c010d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:30.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.930+0000 7fc1c87a8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c00fde90 0x7fc1c010da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:30.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.930+0000 7fc1c87a8700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c010e0e0 con 0x7fc1c00fcbe0 2023-12-07T16:18:30.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.930+0000 7fc1c87a8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c010e920 con 0x7fc1c00fde90 2023-12-07T16:18:30.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.930+0000 7fc1c5d43700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c00fde90 0x7fc1c010da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:30.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.930+0000 7fc1c5d43700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c00fde90 0x7fc1c010da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52322/0 (socket says 172.21.15.152:52322) 2023-12-07T16:18:30.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.930+0000 7fc1c5d43700 1 -- 172.21.15.152:0/3495173989 learned_addr learned my addr 172.21.15.152:0/3495173989 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-07T16:18:30.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.930+0000 7fc1c6544700 1 --2- 172.21.15.152:0/3495173989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1c00fcbe0 0x7fc1c010d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:30.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.930+0000 7fc1c5d43700 1 -- 172.21.15.152:0/3495173989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1c00fcbe0 msgr2=0x7fc1c010d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:30.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.930+0000 7fc1c5d43700 1 --2- 172.21.15.152:0/3495173989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1c00fcbe0 0x7fc1c010d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:30.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.930+0000 7fc1c5d43700 1 -- 172.21.15.152:0/3495173989 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1bc005040 con 0x7fc1c00fde90 2023-12-07T16:18:30.930 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.930+0000 7fc1c6544700 1 --2- 172.21.15.152:0/3495173989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1c00fcbe0 0x7fc1c010d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T16:18:30.930 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.930+0000 7fc1c5d43700 1 --2- 172.21.15.152:0/3495173989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c00fde90 0x7fc1c010da50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc009380 tx=0x7fc1bc009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:30.930 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.930+0000 7fc1b6ffd700 1 -- 172.21.15.152:0/3495173989 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1bc00e040 con 0x7fc1c00fde90 2023-12-07T16:18:30.930 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.930+0000 7fc1c87a8700 1 -- 172.21.15.152:0/3495173989 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c010eba0 con 0x7fc1c00fde90 2023-12-07T16:18:30.930 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.930+0000 7fc1b6ffd700 1 -- 172.21.15.152:0/3495173989 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc1bc00bda0 con 0x7fc1c00fde90 2023-12-07T16:18:30.930 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.930+0000 7fc1b6ffd700 1 -- 172.21.15.152:0/3495173989 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1bc01c630 con 0x7fc1c00fde90 2023-12-07T16:18:30.930 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.930+0000 7fc1c87a8700 1 -- 172.21.15.152:0/3495173989 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c010f0e0 con 0x7fc1c00fde90 2023-12-07T16:18:30.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.931+0000 7fc1c87a8700 1 -- 172.21.15.152:0/3495173989 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c004bb80 con 0x7fc1c00fde90 2023-12-07T16:18:30.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.932+0000 7fc1b6ffd700 1 -- 172.21.15.152:0/3495173989 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc1bc0139d0 con 0x7fc1c00fde90 2023-12-07T16:18:30.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.932+0000 7fc1b6ffd700 1 --2- 172.21.15.152:0/3495173989 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fc1ac068f60 0x7fc1ac06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:30.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.932+0000 7fc1b6ffd700 1 -- 172.21.15.152:0/3495173989 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc1bc087ed0 con 0x7fc1c00fde90 2023-12-07T16:18:30.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.932+0000 7fc1c6544700 1 --2- 172.21.15.152:0/3495173989 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fc1ac068f60 0x7fc1ac06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:30.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.933+0000 7fc1c6544700 1 --2- 172.21.15.152:0/3495173989 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fc1ac068f60 0x7fc1ac06b410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0006fd0 tx=0x7fc1b0008040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:30.934 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:30.936+0000 7fc1b6ffd700 1 -- 172.21.15.152:0/3495173989 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc1bc058170 con 0x7fc1c00fde90 2023-12-07T16:18:31.190 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:31.192+0000 7fc1c87a8700 1 -- 172.21.15.152:0/3495173989 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fc1c010f540 con 0x7fc1c00fde90 2023-12-07T16:18:31.195 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:31.197+0000 7fc1b6ffd700 1 -- 172.21.15.152:0/3495173989 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7fc1bc057d00 con 0x7fc1c00fde90 2023-12-07T16:18:31.195 INFO:teuthology.orchestra.run.smithi152.stdout:[client.1] 2023-12-07T16:18:31.195 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQBX8HFlLPyUCxAAPEVxEer8ojvkoyxUpZs+Dg== 2023-12-07T16:18:31.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:31.199+0000 7fc1c87a8700 1 -- 172.21.15.152:0/3495173989 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fc1ac068f60 msgr2=0x7fc1ac06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:31.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:31.199+0000 7fc1c87a8700 1 --2- 172.21.15.152:0/3495173989 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fc1ac068f60 0x7fc1ac06b410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0006fd0 tx=0x7fc1b0008040 comp rx=0 tx=0).stop 2023-12-07T16:18:31.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:31.199+0000 7fc1c87a8700 1 -- 172.21.15.152:0/3495173989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c00fde90 msgr2=0x7fc1c010da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:31.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:31.199+0000 7fc1c87a8700 1 --2- 172.21.15.152:0/3495173989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c00fde90 0x7fc1c010da50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc009380 tx=0x7fc1bc009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:31.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:31.199+0000 7fc1c87a8700 1 -- 172.21.15.152:0/3495173989 shutdown_connections 2023-12-07T16:18:31.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:31.199+0000 7fc1c87a8700 1 --2- 172.21.15.152:0/3495173989 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fc1ac068f60 0x7fc1ac06b410 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:31.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:31.199+0000 7fc1c87a8700 1 --2- 172.21.15.152:0/3495173989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1c00fcbe0 0x7fc1c010d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:31.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:31.199+0000 7fc1c87a8700 1 --2- 172.21.15.152:0/3495173989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1c00fde90 0x7fc1c010da50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:31.198 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:31.199+0000 7fc1c87a8700 1 -- 172.21.15.152:0/3495173989 >> 172.21.15.152:0/3495173989 conn(0x7fc1c00f8360 msgr2=0x7fc1c01010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:31.198 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:31.199+0000 7fc1c87a8700 1 -- 172.21.15.152:0/3495173989 shutdown_connections 2023-12-07T16:18:31.198 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-07T16:18:31.199+0000 7fc1c87a8700 1 -- 172.21.15.152:0/3495173989 wait complete. 2023-12-07T16:18:31.559 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-07T16:18:31.559 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2023-12-07T16:18:31.559 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-07T16:18:31.599 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-07T16:18:31.599 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-12-07T16:18:31.599 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph mgr dump --format=json 2023-12-07T16:18:31.880 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:31.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:31 smithi063 ceph-mon[112095]: from='client.? 172.21.15.152:0/3495173989' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-07T16:18:31.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:31 smithi063 ceph-mon[112095]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-07T16:18:31.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:31 smithi063 ceph-mon[112095]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-07T16:18:31.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:31 smithi152 ceph-mon[121113]: from='client.? 172.21.15.152:0/3495173989' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-07T16:18:31.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:31 smithi152 ceph-mon[121113]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-07T16:18:31.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:31 smithi152 ceph-mon[121113]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-07T16:18:32.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:32 smithi063 ceph-mon[112095]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:32.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.906+0000 7f3b636a5700 1 -- 172.21.15.63:0/946243309 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b5c102c20 msgr2=0x7f3b5c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:32.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.906+0000 7f3b636a5700 1 --2- 172.21.15.63:0/946243309 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b5c102c20 0x7f3b5c102ff0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3b58004940 tx=0x7f3b58009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:32.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.906+0000 7f3b636a5700 1 -- 172.21.15.63:0/946243309 shutdown_connections 2023-12-07T16:18:32.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.906+0000 7f3b636a5700 1 --2- 172.21.15.63:0/946243309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b5c065390 0x7f3b5c065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:32.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.906+0000 7f3b636a5700 1 --2- 172.21.15.63:0/946243309 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b5c102c20 0x7f3b5c102ff0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:32.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.906+0000 7f3b636a5700 1 -- 172.21.15.63:0/946243309 >> 172.21.15.63:0/946243309 conn(0x7f3b5c0719b0 msgr2=0x7f3b5c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:32.905 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.906+0000 7f3b636a5700 1 -- 172.21.15.63:0/946243309 shutdown_connections 2023-12-07T16:18:32.905 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.906+0000 7f3b636a5700 1 -- 172.21.15.63:0/946243309 wait complete. 2023-12-07T16:18:32.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.907+0000 7f3b636a5700 1 Processor -- start 2023-12-07T16:18:32.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.907+0000 7f3b636a5700 1 -- start start 2023-12-07T16:18:32.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.907+0000 7f3b636a5700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b5c065390 0x7f3b5c113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:32.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.907+0000 7f3b636a5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b5c102c20 0x7f3b5c113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:32.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.907+0000 7f3b636a5700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c114220 con 0x7f3b5c065390 2023-12-07T16:18:32.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.907+0000 7f3b636a5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c10d570 con 0x7f3b5c102c20 2023-12-07T16:18:32.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.907+0000 7f3b61441700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b5c065390 0x7f3b5c113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:32.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.907+0000 7f3b61441700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b5c065390 0x7f3b5c113690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53108/0 (socket says 172.21.15.63:53108) 2023-12-07T16:18:32.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.907+0000 7f3b61441700 1 -- 172.21.15.63:0/3562258298 learned_addr learned my addr 172.21.15.63:0/3562258298 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:32.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.908+0000 7f3b60c40700 1 --2- 172.21.15.63:0/3562258298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b5c102c20 0x7f3b5c113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:32.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.908+0000 7f3b61441700 1 -- 172.21.15.63:0/3562258298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b5c102c20 msgr2=0x7f3b5c113bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:32.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.908+0000 7f3b61441700 1 --2- 172.21.15.63:0/3562258298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b5c102c20 0x7f3b5c113bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:32.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.908+0000 7f3b61441700 1 -- 172.21.15.63:0/3562258298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b58005040 con 0x7f3b5c065390 2023-12-07T16:18:32.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.908+0000 7f3b61441700 1 --2- 172.21.15.63:0/3562258298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b5c065390 0x7f3b5c113690 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3b5800b3b0 tx=0x7f3b58009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:32.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.908+0000 7f3b51ffb700 1 -- 172.21.15.63:0/3562258298 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b5800e040 con 0x7f3b5c065390 2023-12-07T16:18:32.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.908+0000 7f3b636a5700 1 -- 172.21.15.63:0/3562258298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5c10d7f0 con 0x7f3b5c065390 2023-12-07T16:18:32.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.908+0000 7f3b51ffb700 1 -- 172.21.15.63:0/3562258298 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3b5800bc50 con 0x7f3b5c065390 2023-12-07T16:18:32.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.908+0000 7f3b51ffb700 1 -- 172.21.15.63:0/3562258298 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b58013420 con 0x7f3b5c065390 2023-12-07T16:18:32.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.908+0000 7f3b636a5700 1 -- 172.21.15.63:0/3562258298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5c10dd30 con 0x7f3b5c065390 2023-12-07T16:18:32.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.909+0000 7f3b636a5700 1 -- 172.21.15.63:0/3562258298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b5c0fff40 con 0x7f3b5c065390 2023-12-07T16:18:32.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.910+0000 7f3b51ffb700 1 -- 172.21.15.63:0/3562258298 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f3b5801c430 con 0x7f3b5c065390 2023-12-07T16:18:32.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.910+0000 7f3b51ffb700 1 --2- 172.21.15.63:0/3562258298 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f3b48068f60 0x7f3b4806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:32.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.910+0000 7f3b51ffb700 1 -- 172.21.15.63:0/3562258298 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3b58087830 con 0x7f3b5c065390 2023-12-07T16:18:32.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.910+0000 7f3b60c40700 1 --2- 172.21.15.63:0/3562258298 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f3b48068f60 0x7f3b4806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:32.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.911+0000 7f3b60c40700 1 --2- 172.21.15.63:0/3562258298 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f3b48068f60 0x7f3b4806b410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c10ef70 tx=0x7f3b4c00b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:32.912 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:32.915+0000 7f3b51ffb700 1 -- 172.21.15.63:0/3562258298 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3b58057b80 con 0x7f3b5c065390 2023-12-07T16:18:32.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:32 smithi152 ceph-mon[121113]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:33.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:33.164+0000 7f3b636a5700 1 -- 172.21.15.63:0/3562258298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f3b5c04bb80 con 0x7f3b5c065390 2023-12-07T16:18:33.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:33.167+0000 7f3b51ffb700 1 -- 172.21.15.63:0/3562258298 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+166771 (secure 0 0 0) 0x7f3b58057710 con 0x7f3b5c065390 2023-12-07T16:18:33.167 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:18:33.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:33.169+0000 7f3b636a5700 1 -- 172.21.15.63:0/3562258298 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f3b48068f60 msgr2=0x7f3b4806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:33.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:33.169+0000 7f3b636a5700 1 --2- 172.21.15.63:0/3562258298 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f3b48068f60 0x7f3b4806b410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c10ef70 tx=0x7f3b4c00b040 comp rx=0 tx=0).stop 2023-12-07T16:18:33.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:33.169+0000 7f3b636a5700 1 -- 172.21.15.63:0/3562258298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b5c065390 msgr2=0x7f3b5c113690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:33.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:33.169+0000 7f3b636a5700 1 --2- 172.21.15.63:0/3562258298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b5c065390 0x7f3b5c113690 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3b5800b3b0 tx=0x7f3b58009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:33.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:33.169+0000 7f3b636a5700 1 -- 172.21.15.63:0/3562258298 shutdown_connections 2023-12-07T16:18:33.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:33.169+0000 7f3b636a5700 1 --2- 172.21.15.63:0/3562258298 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f3b48068f60 0x7f3b4806b410 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:33.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:33.169+0000 7f3b636a5700 1 --2- 172.21.15.63:0/3562258298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b5c065390 0x7f3b5c113690 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:33.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:33.169+0000 7f3b636a5700 1 --2- 172.21.15.63:0/3562258298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b5c102c20 0x7f3b5c113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:33.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:33.169+0000 7f3b636a5700 1 -- 172.21.15.63:0/3562258298 >> 172.21.15.63:0/3562258298 conn(0x7f3b5c0719b0 msgr2=0x7f3b5c0fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:33.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:33.169+0000 7f3b636a5700 1 -- 172.21.15.63:0/3562258298 shutdown_connections 2023-12-07T16:18:33.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:33.169+0000 7f3b636a5700 1 -- 172.21.15.63:0/3562258298 wait complete. 2023-12-07T16:18:33.532 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":19,"active_gid":14212,"active_name":"smithi063.yohyyx","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":184283085},{"type":"v1","addr":"172.21.15.63:6801","nonce":184283085}]},"active_addr":"172.21.15.63:6801/184283085","active_change":"2023-12-07T16:15:55.242675+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14232,"name":"smithi152.sxayfb","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.63:8443/","prometheus":"http://172.21.15.63:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":273758973}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":335090021}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":2684412075}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":916788374}]}]} 2023-12-07T16:18:33.538 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-12-07T16:18:33.538 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-12-07T16:18:33.538 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph osd dump --format=json 2023-12-07T16:18:33.808 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:33.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:33 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/3562258298' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-07T16:18:33.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:33 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/3562258298' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-07T16:18:34.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.745+0000 7f29fa385700 1 -- 172.21.15.63:0/1353749174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29f4101b00 msgr2=0x7f29f4101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:34.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.745+0000 7f29fa385700 1 --2- 172.21.15.63:0/1353749174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29f4101b00 0x7f29f4101ed0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f29e4004940 tx=0x7f29e4009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:34.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.745+0000 7f29fa385700 1 -- 172.21.15.63:0/1353749174 shutdown_connections 2023-12-07T16:18:34.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.745+0000 7f29fa385700 1 --2- 172.21.15.63:0/1353749174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29f40fbb40 0x7f29f40fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:34.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.745+0000 7f29fa385700 1 --2- 172.21.15.63:0/1353749174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29f4101b00 0x7f29f4101ed0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:34.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.745+0000 7f29fa385700 1 -- 172.21.15.63:0/1353749174 >> 172.21.15.63:0/1353749174 conn(0x7f29f40719b0 msgr2=0x7f29f4071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:34.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.745+0000 7f29fa385700 1 -- 172.21.15.63:0/1353749174 shutdown_connections 2023-12-07T16:18:34.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.745+0000 7f29fa385700 1 -- 172.21.15.63:0/1353749174 wait complete. 2023-12-07T16:18:34.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.746+0000 7f29fa385700 1 Processor -- start 2023-12-07T16:18:34.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.746+0000 7f29fa385700 1 -- start start 2023-12-07T16:18:34.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.746+0000 7f29fa385700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29f40fbb40 0x7f29f410e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:34.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.746+0000 7f29fa385700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29f4101b00 0x7f29f410ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:34.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.746+0000 7f29fa385700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f410f260 con 0x7f29f4101b00 2023-12-07T16:18:34.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.746+0000 7f29fa385700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f410f3a0 con 0x7f29f40fbb40 2023-12-07T16:18:34.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.746+0000 7f29f37fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29f4101b00 0x7f29f410ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:34.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.746+0000 7f29f37fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29f4101b00 0x7f29f410ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53132/0 (socket says 172.21.15.63:53132) 2023-12-07T16:18:34.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.746+0000 7f29f37fe700 1 -- 172.21.15.63:0/543986831 learned_addr learned my addr 172.21.15.63:0/543986831 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:34.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.746+0000 7f29f3fff700 1 --2- 172.21.15.63:0/543986831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29f40fbb40 0x7f29f410e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:34.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.747+0000 7f29f37fe700 1 -- 172.21.15.63:0/543986831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29f40fbb40 msgr2=0x7f29f410e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:34.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.747+0000 7f29f37fe700 1 --2- 172.21.15.63:0/543986831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29f40fbb40 0x7f29f410e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:34.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.747+0000 7f29f37fe700 1 -- 172.21.15.63:0/543986831 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e4005040 con 0x7f29f4101b00 2023-12-07T16:18:34.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.747+0000 7f29f37fe700 1 --2- 172.21.15.63:0/543986831 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29f4101b00 0x7f29f410ec40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f29e800b7c0 tx=0x7f29e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:34.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.747+0000 7f29f0ff9700 1 -- 172.21.15.63:0/543986831 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29e800f6f0 con 0x7f29f4101b00 2023-12-07T16:18:34.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.747+0000 7f29fa385700 1 -- 172.21.15.63:0/543986831 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f41176d0 con 0x7f29f4101b00 2023-12-07T16:18:34.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.747+0000 7f29f0ff9700 1 -- 172.21.15.63:0/543986831 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f29e800fd00 con 0x7f29f4101b00 2023-12-07T16:18:34.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.747+0000 7f29f0ff9700 1 -- 172.21.15.63:0/543986831 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29e8011e90 con 0x7f29f4101b00 2023-12-07T16:18:34.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.747+0000 7f29fa385700 1 -- 172.21.15.63:0/543986831 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f4117c10 con 0x7f29f4101b00 2023-12-07T16:18:34.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.748+0000 7f29fa385700 1 -- 172.21.15.63:0/543986831 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f4103fb0 con 0x7f29f4101b00 2023-12-07T16:18:34.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.748+0000 7f29f0ff9700 1 -- 172.21.15.63:0/543986831 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f29e800f850 con 0x7f29f4101b00 2023-12-07T16:18:34.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.749+0000 7f29f0ff9700 1 --2- 172.21.15.63:0/543986831 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f29dc068f60 0x7f29dc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:34.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.749+0000 7f29f0ff9700 1 -- 172.21.15.63:0/543986831 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f29e8086880 con 0x7f29f4101b00 2023-12-07T16:18:34.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.749+0000 7f29f3fff700 1 --2- 172.21.15.63:0/543986831 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f29dc068f60 0x7f29dc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:34.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.749+0000 7f29f3fff700 1 --2- 172.21.15.63:0/543986831 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f29dc068f60 0x7f29dc06b410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f29e4004f90 tx=0x7f29e4009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:34.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.753+0000 7f29f0ff9700 1 -- 172.21.15.63:0/543986831 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f29e8053090 con 0x7f29f4101b00 2023-12-07T16:18:34.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:34 smithi063 ceph-mon[112095]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:34.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.944+0000 7f29fa385700 1 -- 172.21.15.63:0/543986831 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29f40734d0 con 0x7f29f4101b00 2023-12-07T16:18:34.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.944+0000 7f29f0ff9700 1 -- 172.21.15.63:0/543986831 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11057 (secure 0 0 0) 0x7f29e80566b0 con 0x7f29f4101b00 2023-12-07T16:18:34.943 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:18:34.943 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":39,"fsid":"8c493298-951b-11ee-95a2-87774f69a715","created":"2023-12-07T16:14:03.401177+0000","modified":"2023-12-07T16:18:23.512847+0000","last_up_change":"2023-12-07T16:18:22.506548+0000","last_in_change":"2023-12-07T16:18:06.682768+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T16:17:29.746142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"d8cce319-d8dc-49e7-8596-ba27cc0f8836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2340994154},{"type":"v1","addr":"172.21.15.63:6803","nonce":2340994154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2340994154},{"type":"v1","addr":"172.21.15.63:6805","nonce":2340994154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2340994154},{"type":"v1","addr":"172.21.15.63:6809","nonce":2340994154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2340994154},{"type":"v1","addr":"172.21.15.63:6807","nonce":2340994154}]},"public_addr":"172.21.15.63:6803/2340994154","cluster_addr":"172.21.15.63:6805/2340994154","heartbeat_back_addr":"172.21.15.63:6809/2340994154","heartbeat_front_addr":"172.21.15.63:6807/2340994154","state":["exists","up"]},{"osd":1,"uuid":"4f6f5869-8c07-49cf-8d7e-4eaab3f54f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":1466128324},{"type":"v1","addr":"172.21.15.63:6811","nonce":1466128324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":1466128324},{"type":"v1","addr":"172.21.15.63:6813","nonce":1466128324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1466128324},{"type":"v1","addr":"172.21.15.63:6817","nonce":1466128324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":1466128324},{"type":"v1","addr":"172.21.15.63:6815","nonce":1466128324}]},"public_addr":"172.21.15.63:6811/1466128324","cluster_addr":"172.21.15.63:6813/1466128324","heartbeat_back_addr":"172.21.15.63:6817/1466128324","heartbeat_front_addr":"172.21.15.63:6815/1466128324","state":["exists","up"]},{"osd":2,"uuid":"42f79427-9cc3-42aa-91ab-4c28094437d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":1582539682},{"type":"v1","addr":"172.21.15.63:6819","nonce":1582539682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1582539682},{"type":"v1","addr":"172.21.15.63:6821","nonce":1582539682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1582539682},{"type":"v1","addr":"172.21.15.63:6825","nonce":1582539682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1582539682},{"type":"v1","addr":"172.21.15.63:6823","nonce":1582539682}]},"public_addr":"172.21.15.63:6819/1582539682","cluster_addr":"172.21.15.63:6821/1582539682","heartbeat_back_addr":"172.21.15.63:6825/1582539682","heartbeat_front_addr":"172.21.15.63:6823/1582539682","state":["exists","up"]},{"osd":3,"uuid":"57bde3cf-c59d-4ccb-9d76-894dc48e51b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":913468029},{"type":"v1","addr":"172.21.15.152:6801","nonce":913468029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":913468029},{"type":"v1","addr":"172.21.15.152:6803","nonce":913468029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":913468029},{"type":"v1","addr":"172.21.15.152:6807","nonce":913468029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":913468029},{"type":"v1","addr":"172.21.15.152:6805","nonce":913468029}]},"public_addr":"172.21.15.152:6801/913468029","cluster_addr":"172.21.15.152:6803/913468029","heartbeat_back_addr":"172.21.15.152:6807/913468029","heartbeat_front_addr":"172.21.15.152:6805/913468029","state":["exists","up"]},{"osd":4,"uuid":"1de5b172-cde3-4139-a24d-8d8c2d3f71da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1195082814},{"type":"v1","addr":"172.21.15.152:6809","nonce":1195082814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1195082814},{"type":"v1","addr":"172.21.15.152:6811","nonce":1195082814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1195082814},{"type":"v1","addr":"172.21.15.152:6815","nonce":1195082814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1195082814},{"type":"v1","addr":"172.21.15.152:6813","nonce":1195082814}]},"public_addr":"172.21.15.152:6809/1195082814","cluster_addr":"172.21.15.152:6811/1195082814","heartbeat_back_addr":"172.21.15.152:6815/1195082814","heartbeat_front_addr":"172.21.15.152:6813/1195082814","state":["exists","up"]},{"osd":5,"uuid":"15256051-a7b8-4fb0-8bc5-d865cb551551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":26565095},{"type":"v1","addr":"172.21.15.152:6817","nonce":26565095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":26565095},{"type":"v1","addr":"172.21.15.152:6819","nonce":26565095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":26565095},{"type":"v1","addr":"172.21.15.152:6823","nonce":26565095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":26565095},{"type":"v1","addr":"172.21.15.152:6821","nonce":26565095}]},"public_addr":"172.21.15.152:6817/26565095","cluster_addr":"172.21.15.152:6819/26565095","heartbeat_back_addr":"172.21.15.152:6823/26565095","heartbeat_front_addr":"172.21.15.152:6821/26565095","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:16:47.295417+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:17:06.714097+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:17:26.421837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:17:44.503538+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:18:02.822131+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:18:21.243021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:6800/4069965417":"2023-12-08T16:15:55.242508+0000","172.21.15.63:6801/1052036735":"2023-12-08T16:14:59.065782+0000","172.21.15.63:0/3523609322":"2023-12-08T16:14:59.065782+0000","172.21.15.63:6800/1052036735":"2023-12-08T16:14:59.065782+0000","172.21.15.63:6801/4069965417":"2023-12-08T16:15:55.242508+0000","172.21.15.63:0/127598952":"2023-12-08T16:14:59.065782+0000","172.21.15.63:0/4058757998":"2023-12-08T16:14:27.410651+0000","172.21.15.63:0/396959949":"2023-12-08T16:15:55.242508+0000","172.21.15.63:0/1270045079":"2023-12-08T16:15:55.242508+0000","172.21.15.63:0/1828519471":"2023-12-08T16:14:27.410651+0000","172.21.15.63:6800/2117148141":"2023-12-08T16:14:27.410651+0000","172.21.15.63:6801/2117148141":"2023-12-08T16:14:27.410651+0000","172.21.15.63:0/3827601892":"2023-12-08T16:15:55.242508+0000","172.21.15.63:0/997543331":"2023-12-08T16:14:27.410651+0000","172.21.15.63:0/363151719":"2023-12-08T16:14:59.065782+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T16:18:34.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.946+0000 7f29fa385700 1 -- 172.21.15.63:0/543986831 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f29dc068f60 msgr2=0x7f29dc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:34.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.946+0000 7f29fa385700 1 --2- 172.21.15.63:0/543986831 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f29dc068f60 0x7f29dc06b410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f29e4004f90 tx=0x7f29e4009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:34.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.946+0000 7f29fa385700 1 -- 172.21.15.63:0/543986831 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29f4101b00 msgr2=0x7f29f410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:34.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.946+0000 7f29fa385700 1 --2- 172.21.15.63:0/543986831 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29f4101b00 0x7f29f410ec40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f29e800b7c0 tx=0x7f29e8009250 comp rx=0 tx=0).stop 2023-12-07T16:18:34.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.946+0000 7f29fa385700 1 -- 172.21.15.63:0/543986831 shutdown_connections 2023-12-07T16:18:34.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.946+0000 7f29fa385700 1 --2- 172.21.15.63:0/543986831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29f40fbb40 0x7f29f410e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:34.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.946+0000 7f29fa385700 1 --2- 172.21.15.63:0/543986831 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f29dc068f60 0x7f29dc06b410 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:34.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.946+0000 7f29fa385700 1 --2- 172.21.15.63:0/543986831 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29f4101b00 0x7f29f410ec40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:34.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.946+0000 7f29fa385700 1 -- 172.21.15.63:0/543986831 >> 172.21.15.63:0/543986831 conn(0x7f29f40719b0 msgr2=0x7f29f40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:34.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.947+0000 7f29fa385700 1 -- 172.21.15.63:0/543986831 shutdown_connections 2023-12-07T16:18:34.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:34.947+0000 7f29fa385700 1 -- 172.21.15.63:0/543986831 wait complete. 2023-12-07T16:18:34.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:34 smithi152 ceph-mon[121113]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:35.275 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-12-07T16:18:35.276 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph osd dump --format=json 2023-12-07T16:18:35.548 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:35.842 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:35 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/543986831' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-07T16:18:35.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:35 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/543986831' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-07T16:18:36.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.571+0000 7facfbc71700 1 -- 172.21.15.63:0/2463354230 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facf4101270 msgr2=0x7facf4101640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:36.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.571+0000 7facfbc71700 1 --2- 172.21.15.63:0/2463354230 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facf4101270 0x7facf4101640 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7facf0004a50 tx=0x7facf000af40 comp rx=0 tx=0).stop 2023-12-07T16:18:36.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.571+0000 7facfbc71700 1 -- 172.21.15.63:0/2463354230 shutdown_connections 2023-12-07T16:18:36.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.571+0000 7facfbc71700 1 --2- 172.21.15.63:0/2463354230 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf4101c10 0x7facf40fb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:36.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.571+0000 7facfbc71700 1 --2- 172.21.15.63:0/2463354230 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facf4101270 0x7facf4101640 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:36.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.571+0000 7facfbc71700 1 -- 172.21.15.63:0/2463354230 >> 172.21.15.63:0/2463354230 conn(0x7facf40711a0 msgr2=0x7facf40715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:36.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.571+0000 7facfbc71700 1 -- 172.21.15.63:0/2463354230 shutdown_connections 2023-12-07T16:18:36.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.571+0000 7facfbc71700 1 -- 172.21.15.63:0/2463354230 wait complete. 2023-12-07T16:18:36.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.571+0000 7facfbc71700 1 Processor -- start 2023-12-07T16:18:36.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.572+0000 7facfbc71700 1 -- start start 2023-12-07T16:18:36.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.572+0000 7facfbc71700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facf4101270 0x7facf4111360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:36.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.572+0000 7facfbc71700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf4101c10 0x7facf41118a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:36.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.572+0000 7facfbc71700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf4111ef0 con 0x7facf4101270 2023-12-07T16:18:36.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.572+0000 7facfbc71700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf410b200 con 0x7facf4101c10 2023-12-07T16:18:36.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.572+0000 7facf9a0d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facf4101270 0x7facf4111360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:36.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.572+0000 7facf9a0d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facf4101270 0x7facf4111360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53152/0 (socket says 172.21.15.63:53152) 2023-12-07T16:18:36.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.572+0000 7facf9a0d700 1 -- 172.21.15.63:0/2948134313 learned_addr learned my addr 172.21.15.63:0/2948134313 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:36.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.572+0000 7facf920c700 1 --2- 172.21.15.63:0/2948134313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf4101c10 0x7facf41118a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:36.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.572+0000 7facf9a0d700 1 -- 172.21.15.63:0/2948134313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf4101c10 msgr2=0x7facf41118a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:36.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.572+0000 7facf9a0d700 1 --2- 172.21.15.63:0/2948134313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf4101c10 0x7facf41118a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:36.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.572+0000 7facf9a0d700 1 -- 172.21.15.63:0/2948134313 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf0005040 con 0x7facf4101270 2023-12-07T16:18:36.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.572+0000 7facf9a0d700 1 --2- 172.21.15.63:0/2948134313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facf4101270 0x7facf4111360 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7facf000cee0 tx=0x7facf000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:36.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.573+0000 7facea7fc700 1 -- 172.21.15.63:0/2948134313 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facf000f040 con 0x7facf4101270 2023-12-07T16:18:36.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.573+0000 7facea7fc700 1 -- 172.21.15.63:0/2948134313 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7facf000ac00 con 0x7facf4101270 2023-12-07T16:18:36.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.573+0000 7facfbc71700 1 -- 172.21.15.63:0/2948134313 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf410b480 con 0x7facf4101270 2023-12-07T16:18:36.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.573+0000 7facea7fc700 1 -- 172.21.15.63:0/2948134313 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facf001d610 con 0x7facf4101270 2023-12-07T16:18:36.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.573+0000 7facfbc71700 1 -- 172.21.15.63:0/2948134313 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf410b9c0 con 0x7facf4101270 2023-12-07T16:18:36.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.574+0000 7facfbc71700 1 -- 172.21.15.63:0/2948134313 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf4072cc0 con 0x7facf4101270 2023-12-07T16:18:36.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.574+0000 7facea7fc700 1 -- 172.21.15.63:0/2948134313 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7facf0014420 con 0x7facf4101270 2023-12-07T16:18:36.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.575+0000 7facea7fc700 1 --2- 172.21.15.63:0/2948134313 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7face0068f60 0x7face006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:36.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.575+0000 7facea7fc700 1 -- 172.21.15.63:0/2948134313 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7facf0088f10 con 0x7facf4101270 2023-12-07T16:18:36.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.575+0000 7facf920c700 1 --2- 172.21.15.63:0/2948134313 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7face0068f60 0x7face006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:36.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.575+0000 7facf920c700 1 --2- 172.21.15.63:0/2948134313 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7face0068f60 0x7face006b410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7facf410cc00 tx=0x7face400b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:36.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.579+0000 7facea7fc700 1 -- 172.21.15.63:0/2948134313 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7facf0059250 con 0x7facf4101270 2023-12-07T16:18:36.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.774+0000 7facfbc71700 1 -- 172.21.15.63:0/2948134313 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facf410c940 con 0x7facf4101270 2023-12-07T16:18:36.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.775+0000 7facea7fc700 1 -- 172.21.15.63:0/2948134313 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11057 (secure 0 0 0) 0x7facf0058de0 con 0x7facf4101270 2023-12-07T16:18:36.774 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:18:36.774 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":39,"fsid":"8c493298-951b-11ee-95a2-87774f69a715","created":"2023-12-07T16:14:03.401177+0000","modified":"2023-12-07T16:18:23.512847+0000","last_up_change":"2023-12-07T16:18:22.506548+0000","last_in_change":"2023-12-07T16:18:06.682768+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T16:17:29.746142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"d8cce319-d8dc-49e7-8596-ba27cc0f8836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2340994154},{"type":"v1","addr":"172.21.15.63:6803","nonce":2340994154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2340994154},{"type":"v1","addr":"172.21.15.63:6805","nonce":2340994154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2340994154},{"type":"v1","addr":"172.21.15.63:6809","nonce":2340994154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2340994154},{"type":"v1","addr":"172.21.15.63:6807","nonce":2340994154}]},"public_addr":"172.21.15.63:6803/2340994154","cluster_addr":"172.21.15.63:6805/2340994154","heartbeat_back_addr":"172.21.15.63:6809/2340994154","heartbeat_front_addr":"172.21.15.63:6807/2340994154","state":["exists","up"]},{"osd":1,"uuid":"4f6f5869-8c07-49cf-8d7e-4eaab3f54f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":1466128324},{"type":"v1","addr":"172.21.15.63:6811","nonce":1466128324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":1466128324},{"type":"v1","addr":"172.21.15.63:6813","nonce":1466128324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1466128324},{"type":"v1","addr":"172.21.15.63:6817","nonce":1466128324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":1466128324},{"type":"v1","addr":"172.21.15.63:6815","nonce":1466128324}]},"public_addr":"172.21.15.63:6811/1466128324","cluster_addr":"172.21.15.63:6813/1466128324","heartbeat_back_addr":"172.21.15.63:6817/1466128324","heartbeat_front_addr":"172.21.15.63:6815/1466128324","state":["exists","up"]},{"osd":2,"uuid":"42f79427-9cc3-42aa-91ab-4c28094437d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":1582539682},{"type":"v1","addr":"172.21.15.63:6819","nonce":1582539682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1582539682},{"type":"v1","addr":"172.21.15.63:6821","nonce":1582539682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1582539682},{"type":"v1","addr":"172.21.15.63:6825","nonce":1582539682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1582539682},{"type":"v1","addr":"172.21.15.63:6823","nonce":1582539682}]},"public_addr":"172.21.15.63:6819/1582539682","cluster_addr":"172.21.15.63:6821/1582539682","heartbeat_back_addr":"172.21.15.63:6825/1582539682","heartbeat_front_addr":"172.21.15.63:6823/1582539682","state":["exists","up"]},{"osd":3,"uuid":"57bde3cf-c59d-4ccb-9d76-894dc48e51b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":913468029},{"type":"v1","addr":"172.21.15.152:6801","nonce":913468029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":913468029},{"type":"v1","addr":"172.21.15.152:6803","nonce":913468029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":913468029},{"type":"v1","addr":"172.21.15.152:6807","nonce":913468029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":913468029},{"type":"v1","addr":"172.21.15.152:6805","nonce":913468029}]},"public_addr":"172.21.15.152:6801/913468029","cluster_addr":"172.21.15.152:6803/913468029","heartbeat_back_addr":"172.21.15.152:6807/913468029","heartbeat_front_addr":"172.21.15.152:6805/913468029","state":["exists","up"]},{"osd":4,"uuid":"1de5b172-cde3-4139-a24d-8d8c2d3f71da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1195082814},{"type":"v1","addr":"172.21.15.152:6809","nonce":1195082814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1195082814},{"type":"v1","addr":"172.21.15.152:6811","nonce":1195082814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1195082814},{"type":"v1","addr":"172.21.15.152:6815","nonce":1195082814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1195082814},{"type":"v1","addr":"172.21.15.152:6813","nonce":1195082814}]},"public_addr":"172.21.15.152:6809/1195082814","cluster_addr":"172.21.15.152:6811/1195082814","heartbeat_back_addr":"172.21.15.152:6815/1195082814","heartbeat_front_addr":"172.21.15.152:6813/1195082814","state":["exists","up"]},{"osd":5,"uuid":"15256051-a7b8-4fb0-8bc5-d865cb551551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":26565095},{"type":"v1","addr":"172.21.15.152:6817","nonce":26565095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":26565095},{"type":"v1","addr":"172.21.15.152:6819","nonce":26565095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":26565095},{"type":"v1","addr":"172.21.15.152:6823","nonce":26565095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":26565095},{"type":"v1","addr":"172.21.15.152:6821","nonce":26565095}]},"public_addr":"172.21.15.152:6817/26565095","cluster_addr":"172.21.15.152:6819/26565095","heartbeat_back_addr":"172.21.15.152:6823/26565095","heartbeat_front_addr":"172.21.15.152:6821/26565095","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:16:47.295417+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:17:06.714097+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:17:26.421837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:17:44.503538+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:18:02.822131+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:18:21.243021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:6800/4069965417":"2023-12-08T16:15:55.242508+0000","172.21.15.63:6801/1052036735":"2023-12-08T16:14:59.065782+0000","172.21.15.63:0/3523609322":"2023-12-08T16:14:59.065782+0000","172.21.15.63:6800/1052036735":"2023-12-08T16:14:59.065782+0000","172.21.15.63:6801/4069965417":"2023-12-08T16:15:55.242508+0000","172.21.15.63:0/127598952":"2023-12-08T16:14:59.065782+0000","172.21.15.63:0/4058757998":"2023-12-08T16:14:27.410651+0000","172.21.15.63:0/396959949":"2023-12-08T16:15:55.242508+0000","172.21.15.63:0/1270045079":"2023-12-08T16:15:55.242508+0000","172.21.15.63:0/1828519471":"2023-12-08T16:14:27.410651+0000","172.21.15.63:6800/2117148141":"2023-12-08T16:14:27.410651+0000","172.21.15.63:6801/2117148141":"2023-12-08T16:14:27.410651+0000","172.21.15.63:0/3827601892":"2023-12-08T16:15:55.242508+0000","172.21.15.63:0/997543331":"2023-12-08T16:14:27.410651+0000","172.21.15.63:0/363151719":"2023-12-08T16:14:59.065782+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T16:18:36.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.777+0000 7facfbc71700 1 -- 172.21.15.63:0/2948134313 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7face0068f60 msgr2=0x7face006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:36.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.777+0000 7facfbc71700 1 --2- 172.21.15.63:0/2948134313 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7face0068f60 0x7face006b410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7facf410cc00 tx=0x7face400b040 comp rx=0 tx=0).stop 2023-12-07T16:18:36.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.777+0000 7facfbc71700 1 -- 172.21.15.63:0/2948134313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facf4101270 msgr2=0x7facf4111360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:36.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.777+0000 7facfbc71700 1 --2- 172.21.15.63:0/2948134313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facf4101270 0x7facf4111360 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7facf000cee0 tx=0x7facf000af40 comp rx=0 tx=0).stop 2023-12-07T16:18:36.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.777+0000 7facfbc71700 1 -- 172.21.15.63:0/2948134313 shutdown_connections 2023-12-07T16:18:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.777+0000 7facfbc71700 1 --2- 172.21.15.63:0/2948134313 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7face0068f60 0x7face006b410 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.777+0000 7facfbc71700 1 --2- 172.21.15.63:0/2948134313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facf4101270 0x7facf4111360 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.777+0000 7facfbc71700 1 --2- 172.21.15.63:0/2948134313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf4101c10 0x7facf41118a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.777+0000 7facfbc71700 1 -- 172.21.15.63:0/2948134313 >> 172.21.15.63:0/2948134313 conn(0x7facf40711a0 msgr2=0x7facf40fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.778+0000 7facfbc71700 1 -- 172.21.15.63:0/2948134313 shutdown_connections 2023-12-07T16:18:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:36.778+0000 7facfbc71700 1 -- 172.21.15.63:0/2948134313 wait complete. 2023-12-07T16:18:36.801 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:36 smithi063 ceph-mon[112095]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:36.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:36 smithi152 ceph-mon[121113]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:37.149 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2023-12-07T16:18:37.150 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2023-12-07T16:18:37.150 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2023-12-07T16:18:37.151 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2023-12-07T16:18:37.151 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2023-12-07T16:18:37.151 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2023-12-07T16:18:37.487 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:37.902 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:37 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2948134313' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-07T16:18:37.933 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:37.935 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:37.938 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:37.938 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:37.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:37 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/2948134313' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-07T16:18:38.836 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:38 smithi063 ceph-mon[112095]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:38.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:38 smithi152 ceph-mon[121113]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:39.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.099+0000 7f646929a700 1 -- 172.21.15.63:0/2441351236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64640fbb40 msgr2=0x7f64640fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:39.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.099+0000 7f646929a700 1 --2- 172.21.15.63:0/2441351236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64640fbb40 0x7f64640fbfb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6458004940 tx=0x7f6458009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:39.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.099+0000 7f646929a700 1 -- 172.21.15.63:0/2441351236 shutdown_connections 2023-12-07T16:18:39.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.099+0000 7f646929a700 1 --2- 172.21.15.63:0/2441351236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64640fbb40 0x7f64640fbfb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:39.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.099+0000 7f646929a700 1 --2- 172.21.15.63:0/2441351236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6464101b00 0x7f6464101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:39.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.099+0000 7f646929a700 1 -- 172.21.15.63:0/2441351236 >> 172.21.15.63:0/2441351236 conn(0x7f64640719b0 msgr2=0x7f6464071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:39.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.100+0000 7f646929a700 1 -- 172.21.15.63:0/2441351236 shutdown_connections 2023-12-07T16:18:39.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.100+0000 7f646929a700 1 -- 172.21.15.63:0/2441351236 wait complete. 2023-12-07T16:18:39.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.100+0000 7f646929a700 1 Processor -- start 2023-12-07T16:18:39.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.100+0000 7f646929a700 1 -- start start 2023-12-07T16:18:39.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.100+0000 7f646929a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64640fbb40 0x7f64640fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:39.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.100+0000 7f646929a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6464101b00 0x7f64640fdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:39.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.100+0000 7f646929a700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64640fe2f0 con 0x7f64640fbb40 2023-12-07T16:18:39.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.100+0000 7f646929a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64640fe460 con 0x7f6464101b00 2023-12-07T16:18:39.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.101+0000 7f6462ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64640fbb40 0x7f64640fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:39.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.101+0000 7f6462ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64640fbb40 0x7f64640fd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53174/0 (socket says 172.21.15.63:53174) 2023-12-07T16:18:39.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.101+0000 7f6462ffd700 1 -- 172.21.15.63:0/1531090087 learned_addr learned my addr 172.21.15.63:0/1531090087 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:39.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.101+0000 7f64627fc700 1 --2- 172.21.15.63:0/1531090087 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6464101b00 0x7f64640fdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:39.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.101+0000 7f6462ffd700 1 -- 172.21.15.63:0/1531090087 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6464101b00 msgr2=0x7f64640fdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:39.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.101+0000 7f6462ffd700 1 --2- 172.21.15.63:0/1531090087 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6464101b00 0x7f64640fdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:39.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.101+0000 7f6462ffd700 1 -- 172.21.15.63:0/1531090087 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6458005040 con 0x7f64640fbb40 2023-12-07T16:18:39.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.101+0000 7f6462ffd700 1 --2- 172.21.15.63:0/1531090087 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64640fbb40 0x7f64640fd720 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f645400b790 tx=0x7f6454009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:39.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.101+0000 7f644b7fe700 1 -- 172.21.15.63:0/1531090087 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f645400f770 con 0x7f64640fbb40 2023-12-07T16:18:39.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.101+0000 7f644b7fe700 1 -- 172.21.15.63:0/1531090087 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f645400fd80 con 0x7f64640fbb40 2023-12-07T16:18:39.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.101+0000 7f646929a700 1 -- 172.21.15.63:0/1531090087 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64641199f0 con 0x7f64640fbb40 2023-12-07T16:18:39.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.101+0000 7f644b7fe700 1 -- 172.21.15.63:0/1531090087 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f645400d310 con 0x7f64640fbb40 2023-12-07T16:18:39.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.101+0000 7f646929a700 1 -- 172.21.15.63:0/1531090087 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6464119ee0 con 0x7f64640fbb40 2023-12-07T16:18:39.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.102+0000 7f646929a700 1 -- 172.21.15.63:0/1531090087 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6464065de0 con 0x7f64640fbb40 2023-12-07T16:18:39.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.103+0000 7f644b7fe700 1 -- 172.21.15.63:0/1531090087 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f6454010420 con 0x7f64640fbb40 2023-12-07T16:18:39.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.103+0000 7f644b7fe700 1 --2- 172.21.15.63:0/1531090087 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f644c068f60 0x7f644c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:39.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.103+0000 7f644b7fe700 1 -- 172.21.15.63:0/1531090087 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6454086a40 con 0x7f64640fbb40 2023-12-07T16:18:39.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.103+0000 7f64627fc700 1 --2- 172.21.15.63:0/1531090087 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f644c068f60 0x7f644c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:39.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.103+0000 7f644b7fe700 1 --2- 172.21.15.63:0/1531090087 >> [v2:172.21.15.152:6808/1195082814,v1:172.21.15.152:6809/1195082814] conn(0x7f644c06ec30 0x7f644c071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:39.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.103+0000 7f644b7fe700 1 -- 172.21.15.63:0/1531090087 --> [v2:172.21.15.152:6808/1195082814,v1:172.21.15.152:6809/1195082814] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f644c0716f0 con 0x7f644c06ec30 2023-12-07T16:18:39.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.103+0000 7f644b7fe700 1 -- 172.21.15.63:0/1531090087 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f645408b220 con 0x7f64640fbb40 2023-12-07T16:18:39.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.103+0000 7f64637fe700 1 --2- 172.21.15.63:0/1531090087 >> [v2:172.21.15.152:6808/1195082814,v1:172.21.15.152:6809/1195082814] conn(0x7f644c06ec30 0x7f644c071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:39.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.104+0000 7f64627fc700 1 --2- 172.21.15.63:0/1531090087 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f644c068f60 0x7f644c06b410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f645800b3b0 tx=0x7f6458009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:39.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.104+0000 7f64637fe700 1 --2- 172.21.15.63:0/1531090087 >> [v2:172.21.15.152:6808/1195082814,v1:172.21.15.152:6809/1195082814] conn(0x7f644c06ec30 0x7f644c071040 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:39.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.105+0000 7f644b7fe700 1 -- 172.21.15.63:0/1531090087 <== osd.4 v2:172.21.15.152:6808/1195082814 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f644c0716f0 con 0x7f644c06ec30 2023-12-07T16:18:39.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.119+0000 7f646929a700 1 -- 172.21.15.63:0/1531090087 --> [v2:172.21.15.152:6808/1195082814,v1:172.21.15.152:6809/1195082814] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6464066190 con 0x7f644c06ec30 2023-12-07T16:18:39.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.120+0000 7f644b7fe700 1 -- 172.21.15.63:0/1531090087 <== osd.4 v2:172.21.15.152:6808/1195082814 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6464066190 con 0x7f644c06ec30 2023-12-07T16:18:39.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.120+0000 7f646929a700 1 -- 172.21.15.63:0/1531090087 >> [v2:172.21.15.152:6808/1195082814,v1:172.21.15.152:6809/1195082814] conn(0x7f644c06ec30 msgr2=0x7f644c071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:39.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.120+0000 7f646929a700 1 --2- 172.21.15.63:0/1531090087 >> [v2:172.21.15.152:6808/1195082814,v1:172.21.15.152:6809/1195082814] conn(0x7f644c06ec30 0x7f644c071040 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:39.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.120+0000 7f646929a700 1 -- 172.21.15.63:0/1531090087 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f644c068f60 msgr2=0x7f644c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:39.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.120+0000 7f646929a700 1 --2- 172.21.15.63:0/1531090087 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f644c068f60 0x7f644c06b410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f645800b3b0 tx=0x7f6458009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:39.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.120+0000 7f646929a700 1 -- 172.21.15.63:0/1531090087 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64640fbb40 msgr2=0x7f64640fd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:39.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.120+0000 7f646929a700 1 --2- 172.21.15.63:0/1531090087 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64640fbb40 0x7f64640fd720 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f645400b790 tx=0x7f6454009250 comp rx=0 tx=0).stop 2023-12-07T16:18:39.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.121+0000 7f646929a700 1 -- 172.21.15.63:0/1531090087 shutdown_connections 2023-12-07T16:18:39.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.121+0000 7f646929a700 1 --2- 172.21.15.63:0/1531090087 >> [v2:172.21.15.152:6808/1195082814,v1:172.21.15.152:6809/1195082814] conn(0x7f644c06ec30 0x7f644c071040 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:39.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.121+0000 7f646929a700 1 --2- 172.21.15.63:0/1531090087 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f644c068f60 0x7f644c06b410 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:39.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.121+0000 7f646929a700 1 --2- 172.21.15.63:0/1531090087 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64640fbb40 0x7f64640fd720 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:39.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.121+0000 7f646929a700 1 --2- 172.21.15.63:0/1531090087 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6464101b00 0x7f64640fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:39.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.121+0000 7f646929a700 1 -- 172.21.15.63:0/1531090087 >> 172.21.15.63:0/1531090087 conn(0x7f64640719b0 msgr2=0x7f6464065450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:39.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.121+0000 7f646929a700 1 -- 172.21.15.63:0/1531090087 shutdown_connections 2023-12-07T16:18:39.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:39.121+0000 7f646929a700 1 -- 172.21.15.63:0/1531090087 wait complete. 2023-12-07T16:18:39.661 INFO:teuthology.orchestra.run.smithi063.stdout:141733920777 2023-12-07T16:18:39.662 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.4 2023-12-07T16:18:39.754 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:40.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.293+0000 7f0525fdb700 1 -- 172.21.15.63:0/3231379000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0520101b00 msgr2=0x7f0520101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:40.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.293+0000 7f0525fdb700 1 --2- 172.21.15.63:0/3231379000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0520101b00 0x7f0520101ed0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0510004940 tx=0x7f0510009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:40.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.293+0000 7f0525fdb700 1 -- 172.21.15.63:0/3231379000 shutdown_connections 2023-12-07T16:18:40.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.293+0000 7f0525fdb700 1 --2- 172.21.15.63:0/3231379000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05200fbb40 0x7f05200fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:40.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.293+0000 7f0525fdb700 1 --2- 172.21.15.63:0/3231379000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0520101b00 0x7f0520101ed0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:40.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.293+0000 7f0525fdb700 1 -- 172.21.15.63:0/3231379000 >> 172.21.15.63:0/3231379000 conn(0x7f05200719b0 msgr2=0x7f0520071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:40.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.293+0000 7f0525fdb700 1 -- 172.21.15.63:0/3231379000 shutdown_connections 2023-12-07T16:18:40.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.293+0000 7f0525fdb700 1 -- 172.21.15.63:0/3231379000 wait complete. 2023-12-07T16:18:40.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.294+0000 7f0525fdb700 1 Processor -- start 2023-12-07T16:18:40.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.294+0000 7f0525fdb700 1 -- start start 2023-12-07T16:18:40.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.294+0000 7f0525fdb700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05200fbb40 0x7f052010e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:40.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.294+0000 7f0525fdb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0520101b00 0x7f052010ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:40.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.294+0000 7f0525fdb700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052010f1c0 con 0x7f05200fbb40 2023-12-07T16:18:40.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.294+0000 7f0525fdb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052010f300 con 0x7f0520101b00 2023-12-07T16:18:40.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.294+0000 7f051f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05200fbb40 0x7f052010e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:40.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.294+0000 7f051f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05200fbb40 0x7f052010e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55254/0 (socket says 172.21.15.63:55254) 2023-12-07T16:18:40.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.294+0000 7f051f7fe700 1 -- 172.21.15.63:0/2924873608 learned_addr learned my addr 172.21.15.63:0/2924873608 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:40.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.294+0000 7f051effd700 1 --2- 172.21.15.63:0/2924873608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0520101b00 0x7f052010ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:40.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.294+0000 7f051f7fe700 1 -- 172.21.15.63:0/2924873608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0520101b00 msgr2=0x7f052010ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:40.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.294+0000 7f051f7fe700 1 --2- 172.21.15.63:0/2924873608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0520101b00 0x7f052010ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:40.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.294+0000 7f051f7fe700 1 -- 172.21.15.63:0/2924873608 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0510005040 con 0x7f05200fbb40 2023-12-07T16:18:40.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.294+0000 7f051effd700 1 --2- 172.21.15.63:0/2924873608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0520101b00 0x7f052010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T16:18:40.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.295+0000 7f051f7fe700 1 --2- 172.21.15.63:0/2924873608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05200fbb40 0x7f052010e6f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0510009180 tx=0x7f0510009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:40.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.295+0000 7f0507fff700 1 -- 172.21.15.63:0/2924873608 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f051000e040 con 0x7f05200fbb40 2023-12-07T16:18:40.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.295+0000 7f0525fdb700 1 -- 172.21.15.63:0/2924873608 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0520117600 con 0x7f05200fbb40 2023-12-07T16:18:40.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.295+0000 7f0507fff700 1 -- 172.21.15.63:0/2924873608 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0510013420 con 0x7f05200fbb40 2023-12-07T16:18:40.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.295+0000 7f0507fff700 1 -- 172.21.15.63:0/2924873608 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f051001c630 con 0x7f05200fbb40 2023-12-07T16:18:40.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.295+0000 7f0525fdb700 1 -- 172.21.15.63:0/2924873608 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0520117b10 con 0x7f05200fbb40 2023-12-07T16:18:40.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.296+0000 7f0525fdb700 1 -- 172.21.15.63:0/2924873608 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f052005e380 con 0x7f05200fbb40 2023-12-07T16:18:40.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.296+0000 7f0507fff700 1 -- 172.21.15.63:0/2924873608 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f05100139e0 con 0x7f05200fbb40 2023-12-07T16:18:40.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.297+0000 7f0507fff700 1 --2- 172.21.15.63:0/2924873608 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f0508068f60 0x7f050806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:40.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.297+0000 7f0507fff700 1 -- 172.21.15.63:0/2924873608 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0510088840 con 0x7f05200fbb40 2023-12-07T16:18:40.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.297+0000 7f051effd700 1 --2- 172.21.15.63:0/2924873608 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f0508068f60 0x7f050806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:40.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.297+0000 7f0507fff700 1 --2- 172.21.15.63:0/2924873608 >> [v2:172.21.15.63:6810/1466128324,v1:172.21.15.63:6811/1466128324] conn(0x7f050806ec30 0x7f0508071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:40.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.297+0000 7f0507fff700 1 -- 172.21.15.63:0/2924873608 --> [v2:172.21.15.63:6810/1466128324,v1:172.21.15.63:6811/1466128324] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f05080716f0 con 0x7f050806ec30 2023-12-07T16:18:40.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.297+0000 7f0507fff700 1 -- 172.21.15.63:0/2924873608 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0510088c20 con 0x7f05200fbb40 2023-12-07T16:18:40.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.297+0000 7f051ffff700 1 --2- 172.21.15.63:0/2924873608 >> [v2:172.21.15.63:6810/1466128324,v1:172.21.15.63:6811/1466128324] conn(0x7f050806ec30 0x7f0508071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:40.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.297+0000 7f051effd700 1 --2- 172.21.15.63:0/2924873608 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f0508068f60 0x7f050806b410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0520065e30 tx=0x7f0514009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:40.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.297+0000 7f051ffff700 1 --2- 172.21.15.63:0/2924873608 >> [v2:172.21.15.63:6810/1466128324,v1:172.21.15.63:6811/1466128324] conn(0x7f050806ec30 0x7f0508071040 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:40.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.298+0000 7f0507fff700 1 -- 172.21.15.63:0/2924873608 <== osd.1 v2:172.21.15.63:6810/1466128324 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f05080716f0 con 0x7f050806ec30 2023-12-07T16:18:40.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.313+0000 7f0525fdb700 1 -- 172.21.15.63:0/2924873608 --> [v2:172.21.15.63:6810/1466128324,v1:172.21.15.63:6811/1466128324] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f052005e800 con 0x7f050806ec30 2023-12-07T16:18:40.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.314+0000 7f0507fff700 1 -- 172.21.15.63:0/2924873608 <== osd.1 v2:172.21.15.63:6810/1466128324 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f052005e800 con 0x7f050806ec30 2023-12-07T16:18:40.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.314+0000 7f0525fdb700 1 -- 172.21.15.63:0/2924873608 >> [v2:172.21.15.63:6810/1466128324,v1:172.21.15.63:6811/1466128324] conn(0x7f050806ec30 msgr2=0x7f0508071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:40.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.314+0000 7f0525fdb700 1 --2- 172.21.15.63:0/2924873608 >> [v2:172.21.15.63:6810/1466128324,v1:172.21.15.63:6811/1466128324] conn(0x7f050806ec30 0x7f0508071040 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:40.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.314+0000 7f0525fdb700 1 -- 172.21.15.63:0/2924873608 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f0508068f60 msgr2=0x7f050806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:40.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.314+0000 7f0525fdb700 1 --2- 172.21.15.63:0/2924873608 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f0508068f60 0x7f050806b410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0520065e30 tx=0x7f0514009040 comp rx=0 tx=0).stop 2023-12-07T16:18:40.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.314+0000 7f0525fdb700 1 -- 172.21.15.63:0/2924873608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05200fbb40 msgr2=0x7f052010e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:40.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.314+0000 7f0525fdb700 1 --2- 172.21.15.63:0/2924873608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05200fbb40 0x7f052010e6f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0510009180 tx=0x7f0510009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:40.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.314+0000 7f0525fdb700 1 -- 172.21.15.63:0/2924873608 shutdown_connections 2023-12-07T16:18:40.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.314+0000 7f0525fdb700 1 --2- 172.21.15.63:0/2924873608 >> [v2:172.21.15.63:6810/1466128324,v1:172.21.15.63:6811/1466128324] conn(0x7f050806ec30 0x7f0508071040 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:40.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.314+0000 7f0525fdb700 1 --2- 172.21.15.63:0/2924873608 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f0508068f60 0x7f050806b410 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:40.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.314+0000 7f0525fdb700 1 --2- 172.21.15.63:0/2924873608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05200fbb40 0x7f052010e6f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:40.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.314+0000 7f0525fdb700 1 --2- 172.21.15.63:0/2924873608 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0520101b00 0x7f052010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:40.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.314+0000 7f0525fdb700 1 -- 172.21.15.63:0/2924873608 >> 172.21.15.63:0/2924873608 conn(0x7f05200719b0 msgr2=0x7f05200fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:40.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.314+0000 7f0525fdb700 1 -- 172.21.15.63:0/2924873608 shutdown_connections 2023-12-07T16:18:40.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.314+0000 7f0525fdb700 1 -- 172.21.15.63:0/2924873608 wait complete. 2023-12-07T16:18:40.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.877+0000 7f40657c2700 1 -- 172.21.15.63:0/3852803243 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40601035a0 msgr2=0x7f40600fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:40.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.877+0000 7f40657c2700 1 --2- 172.21.15.63:0/3852803243 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40601035a0 0x7f40600fcc10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4050004940 tx=0x7f4050009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:40.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.878+0000 7f40657c2700 1 -- 172.21.15.63:0/3852803243 shutdown_connections 2023-12-07T16:18:40.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.878+0000 7f40657c2700 1 --2- 172.21.15.63:0/3852803243 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40601035a0 0x7f40600fcc10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:40.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.878+0000 7f40657c2700 1 --2- 172.21.15.63:0/3852803243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4060102c00 0x7f4060102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:40.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.878+0000 7f40657c2700 1 -- 172.21.15.63:0/3852803243 >> 172.21.15.63:0/3852803243 conn(0x7f40600f8790 msgr2=0x7f40600faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:40.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.878+0000 7f40657c2700 1 -- 172.21.15.63:0/3852803243 shutdown_connections 2023-12-07T16:18:40.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.878+0000 7f40657c2700 1 -- 172.21.15.63:0/3852803243 wait complete. 2023-12-07T16:18:40.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.878+0000 7f40657c2700 1 Processor -- start 2023-12-07T16:18:40.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.879+0000 7f40657c2700 1 -- start start 2023-12-07T16:18:40.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.879+0000 7f40657c2700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4060102c00 0x7f4060113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:40.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.879+0000 7f40657c2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40601035a0 0x7f4060113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:40.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.879+0000 7f40657c2700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40601141e0 con 0x7f4060102c00 2023-12-07T16:18:40.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.879+0000 7f40657c2700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406010d4d0 con 0x7f40601035a0 2023-12-07T16:18:40.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.879+0000 7f405effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4060102c00 0x7f4060113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:40.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.879+0000 7f405effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4060102c00 0x7f4060113610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55278/0 (socket says 172.21.15.63:55278) 2023-12-07T16:18:40.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.879+0000 7f405effd700 1 -- 172.21.15.63:0/1484767500 learned_addr learned my addr 172.21.15.63:0/1484767500 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:40.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.879+0000 7f405e7fc700 1 --2- 172.21.15.63:0/1484767500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40601035a0 0x7f4060113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:40.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.879+0000 7f405effd700 1 -- 172.21.15.63:0/1484767500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40601035a0 msgr2=0x7f4060113b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:40.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.879+0000 7f405effd700 1 --2- 172.21.15.63:0/1484767500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40601035a0 0x7f4060113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:40.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.879+0000 7f405effd700 1 -- 172.21.15.63:0/1484767500 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4050005040 con 0x7f4060102c00 2023-12-07T16:18:40.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.879+0000 7f405effd700 1 --2- 172.21.15.63:0/1484767500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4060102c00 0x7f4060113610 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4054002a50 tx=0x7f40540046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:40.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.879+0000 7f40477fe700 1 -- 172.21.15.63:0/1484767500 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4054007cc0 con 0x7f4060102c00 2023-12-07T16:18:40.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.879+0000 7f40477fe700 1 -- 172.21.15.63:0/1484767500 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f405400f040 con 0x7f4060102c00 2023-12-07T16:18:40.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.880+0000 7f40657c2700 1 -- 172.21.15.63:0/1484767500 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f406010d760 con 0x7f4060102c00 2023-12-07T16:18:40.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.880+0000 7f40477fe700 1 -- 172.21.15.63:0/1484767500 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4054009540 con 0x7f4060102c00 2023-12-07T16:18:40.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.880+0000 7f40657c2700 1 -- 172.21.15.63:0/1484767500 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406010dca0 con 0x7f4060102c00 2023-12-07T16:18:40.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.880+0000 7f40657c2700 1 -- 172.21.15.63:0/1484767500 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f406010e190 con 0x7f4060102c00 2023-12-07T16:18:40.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.881+0000 7f40477fe700 1 -- 172.21.15.63:0/1484767500 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f40540096a0 con 0x7f4060102c00 2023-12-07T16:18:40.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.881+0000 7f40477fe700 1 --2- 172.21.15.63:0/1484767500 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f4048068f60 0x7f404806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:40.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.881+0000 7f40477fe700 1 -- 172.21.15.63:0/1484767500 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4054086780 con 0x7f4060102c00 2023-12-07T16:18:40.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.881+0000 7f405e7fc700 1 --2- 172.21.15.63:0/1484767500 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f4048068f60 0x7f404806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:40.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.882+0000 7f40477fe700 1 --2- 172.21.15.63:0/1484767500 >> [v2:172.21.15.152:6816/26565095,v1:172.21.15.152:6817/26565095] conn(0x7f404806ec30 0x7f4048071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:40.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.882+0000 7f40477fe700 1 -- 172.21.15.63:0/1484767500 --> [v2:172.21.15.152:6816/26565095,v1:172.21.15.152:6817/26565095] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f40480716f0 con 0x7f404806ec30 2023-12-07T16:18:40.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.882+0000 7f40477fe700 1 -- 172.21.15.63:0/1484767500 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4054088d70 con 0x7f4060102c00 2023-12-07T16:18:40.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.882+0000 7f405e7fc700 1 --2- 172.21.15.63:0/1484767500 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f4048068f60 0x7f404806b410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4050009fd0 tx=0x7f4050009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:40.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.882+0000 7f405f7fe700 1 --2- 172.21.15.63:0/1484767500 >> [v2:172.21.15.152:6816/26565095,v1:172.21.15.152:6817/26565095] conn(0x7f404806ec30 0x7f4048071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:40.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.882+0000 7f405f7fe700 1 --2- 172.21.15.63:0/1484767500 >> [v2:172.21.15.152:6816/26565095,v1:172.21.15.152:6817/26565095] conn(0x7f404806ec30 0x7f4048071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:40.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.883+0000 7f40477fe700 1 -- 172.21.15.63:0/1484767500 <== osd.5 v2:172.21.15.152:6816/26565095 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f40480716f0 con 0x7f404806ec30 2023-12-07T16:18:40.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.898+0000 7f40657c2700 1 -- 172.21.15.63:0/1484767500 --> [v2:172.21.15.152:6816/26565095,v1:172.21.15.152:6817/26565095] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f406005e2f0 con 0x7f404806ec30 2023-12-07T16:18:40.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.898+0000 7f40477fe700 1 -- 172.21.15.63:0/1484767500 <== osd.5 v2:172.21.15.152:6816/26565095 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f406005e2f0 con 0x7f404806ec30 2023-12-07T16:18:40.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.899+0000 7f40657c2700 1 -- 172.21.15.63:0/1484767500 >> [v2:172.21.15.152:6816/26565095,v1:172.21.15.152:6817/26565095] conn(0x7f404806ec30 msgr2=0x7f4048071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:40.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.899+0000 7f40657c2700 1 --2- 172.21.15.63:0/1484767500 >> [v2:172.21.15.152:6816/26565095,v1:172.21.15.152:6817/26565095] conn(0x7f404806ec30 0x7f4048071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:40.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.899+0000 7f40657c2700 1 -- 172.21.15.63:0/1484767500 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f4048068f60 msgr2=0x7f404806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:40.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.899+0000 7f40657c2700 1 --2- 172.21.15.63:0/1484767500 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f4048068f60 0x7f404806b410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4050009fd0 tx=0x7f4050009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:40.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.899+0000 7f40657c2700 1 -- 172.21.15.63:0/1484767500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4060102c00 msgr2=0x7f4060113610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:40.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.899+0000 7f40657c2700 1 --2- 172.21.15.63:0/1484767500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4060102c00 0x7f4060113610 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4054002a50 tx=0x7f40540046b0 comp rx=0 tx=0).stop 2023-12-07T16:18:40.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.899+0000 7f40657c2700 1 -- 172.21.15.63:0/1484767500 shutdown_connections 2023-12-07T16:18:40.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.899+0000 7f40657c2700 1 --2- 172.21.15.63:0/1484767500 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f4048068f60 0x7f404806b410 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:40.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.899+0000 7f40657c2700 1 --2- 172.21.15.63:0/1484767500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4060102c00 0x7f4060113610 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:40.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.899+0000 7f40657c2700 1 --2- 172.21.15.63:0/1484767500 >> [v2:172.21.15.152:6816/26565095,v1:172.21.15.152:6817/26565095] conn(0x7f404806ec30 0x7f4048071040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:40.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.899+0000 7f40657c2700 1 --2- 172.21.15.63:0/1484767500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40601035a0 0x7f4060113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:40.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.899+0000 7f40657c2700 1 -- 172.21.15.63:0/1484767500 >> 172.21.15.63:0/1484767500 conn(0x7f40600f8790 msgr2=0x7f40600fa330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:40.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.899+0000 7f40657c2700 1 -- 172.21.15.63:0/1484767500 shutdown_connections 2023-12-07T16:18:40.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:40.899+0000 7f40657c2700 1 -- 172.21.15.63:0/1484767500 wait complete. 2023-12-07T16:18:40.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:40 smithi063 ceph-mon[112095]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:40.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:40 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:18:40.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:40 smithi152 ceph-mon[121113]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:40.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:40 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:18:41.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.378+0000 7f52e7a3b700 1 -- 172.21.15.63:0/2353536674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52e00fe5f0 msgr2=0x7f52e0106c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:41.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.378+0000 7f52e7a3b700 1 --2- 172.21.15.63:0/2353536674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52e00fe5f0 0x7f52e0106c30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f52d0004940 tx=0x7f52d0009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:41.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.378+0000 7f52e7a3b700 1 -- 172.21.15.63:0/2353536674 shutdown_connections 2023-12-07T16:18:41.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.378+0000 7f52e7a3b700 1 --2- 172.21.15.63:0/2353536674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52e00fe5f0 0x7f52e0106c30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:41.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.378+0000 7f52e7a3b700 1 --2- 172.21.15.63:0/2353536674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52e00fdc50 0x7f52e00fe020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:41.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.378+0000 7f52e7a3b700 1 -- 172.21.15.63:0/2353536674 >> 172.21.15.63:0/2353536674 conn(0x7f52e00f7680 msgr2=0x7f52e00f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:41.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.378+0000 7f52e7a3b700 1 -- 172.21.15.63:0/2353536674 shutdown_connections 2023-12-07T16:18:41.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.378+0000 7f52e7a3b700 1 -- 172.21.15.63:0/2353536674 wait complete. 2023-12-07T16:18:41.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.379+0000 7f52e7a3b700 1 Processor -- start 2023-12-07T16:18:41.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.379+0000 7f52e7a3b700 1 -- start start 2023-12-07T16:18:41.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.379+0000 7f52e7a3b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52e00fdc50 0x7f52e01136a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:41.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.379+0000 7f52e7a3b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52e00fe5f0 0x7f52e0113c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:41.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.379+0000 7f52e7a3b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e0114270 con 0x7f52e00fdc50 2023-12-07T16:18:41.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.379+0000 7f52e7a3b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e010d560 con 0x7f52e00fe5f0 2023-12-07T16:18:41.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.379+0000 7f52e57d7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52e00fdc50 0x7f52e01136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:41.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.379+0000 7f52e57d7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52e00fdc50 0x7f52e01136a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55298/0 (socket says 172.21.15.63:55298) 2023-12-07T16:18:41.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.379+0000 7f52e57d7700 1 -- 172.21.15.63:0/1119949335 learned_addr learned my addr 172.21.15.63:0/1119949335 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:41.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.379+0000 7f52e4fd6700 1 --2- 172.21.15.63:0/1119949335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52e00fe5f0 0x7f52e0113c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:41.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.379+0000 7f52e57d7700 1 -- 172.21.15.63:0/1119949335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52e00fe5f0 msgr2=0x7f52e0113c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:41.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.379+0000 7f52e57d7700 1 --2- 172.21.15.63:0/1119949335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52e00fe5f0 0x7f52e0113c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:41.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.379+0000 7f52e57d7700 1 -- 172.21.15.63:0/1119949335 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d0005040 con 0x7f52e00fdc50 2023-12-07T16:18:41.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.379+0000 7f52e4fd6700 1 --2- 172.21.15.63:0/1119949335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52e00fe5f0 0x7f52e0113c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T16:18:41.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.380+0000 7f52e57d7700 1 --2- 172.21.15.63:0/1119949335 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52e00fdc50 0x7f52e01136a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f52dc002a50 tx=0x7f52dc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:41.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.380+0000 7f52d5ffb700 1 -- 172.21.15.63:0/1119949335 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52dc007cc0 con 0x7f52e00fdc50 2023-12-07T16:18:41.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.380+0000 7f52d5ffb700 1 -- 172.21.15.63:0/1119949335 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f52dc00f040 con 0x7f52e00fdc50 2023-12-07T16:18:41.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.380+0000 7f52e7a3b700 1 -- 172.21.15.63:0/1119949335 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e010d7f0 con 0x7f52e00fdc50 2023-12-07T16:18:41.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.380+0000 7f52d5ffb700 1 -- 172.21.15.63:0/1119949335 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52dc009540 con 0x7f52e00fdc50 2023-12-07T16:18:41.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.380+0000 7f52e7a3b700 1 -- 172.21.15.63:0/1119949335 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e010dd30 con 0x7f52e00fdc50 2023-12-07T16:18:41.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.381+0000 7f52e7a3b700 1 -- 172.21.15.63:0/1119949335 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f52e010e1d0 con 0x7f52e00fdc50 2023-12-07T16:18:41.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.381+0000 7f52d5ffb700 1 -- 172.21.15.63:0/1119949335 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f52dc0096a0 con 0x7f52e00fdc50 2023-12-07T16:18:41.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.382+0000 7f52d5ffb700 1 --2- 172.21.15.63:0/1119949335 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f52cc068f60 0x7f52cc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:41.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.382+0000 7f52d5ffb700 1 -- 172.21.15.63:0/1119949335 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f52dc086860 con 0x7f52e00fdc50 2023-12-07T16:18:41.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.382+0000 7f52e4fd6700 1 --2- 172.21.15.63:0/1119949335 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f52cc068f60 0x7f52cc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:41.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.382+0000 7f52d5ffb700 1 --2- 172.21.15.63:0/1119949335 >> [v2:172.21.15.63:6818/1582539682,v1:172.21.15.63:6819/1582539682] conn(0x7f52cc06ec30 0x7f52cc071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:41.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.382+0000 7f52d5ffb700 1 -- 172.21.15.63:0/1119949335 --> [v2:172.21.15.63:6818/1582539682,v1:172.21.15.63:6819/1582539682] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f52cc0716f0 con 0x7f52cc06ec30 2023-12-07T16:18:41.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.382+0000 7f52d5ffb700 1 -- 172.21.15.63:0/1119949335 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f52dc08b220 con 0x7f52e00fdc50 2023-12-07T16:18:41.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.382+0000 7f52e5fd8700 1 --2- 172.21.15.63:0/1119949335 >> [v2:172.21.15.63:6818/1582539682,v1:172.21.15.63:6819/1582539682] conn(0x7f52cc06ec30 0x7f52cc071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:41.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.382+0000 7f52e4fd6700 1 --2- 172.21.15.63:0/1119949335 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f52cc068f60 0x7f52cc06b410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f52d000b3b0 tx=0x7f52d0009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:41.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.382+0000 7f52e5fd8700 1 --2- 172.21.15.63:0/1119949335 >> [v2:172.21.15.63:6818/1582539682,v1:172.21.15.63:6819/1582539682] conn(0x7f52cc06ec30 0x7f52cc071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:41.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.383+0000 7f52d5ffb700 1 -- 172.21.15.63:0/1119949335 <== osd.2 v2:172.21.15.63:6818/1582539682 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f52cc0716f0 con 0x7f52cc06ec30 2023-12-07T16:18:41.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.398+0000 7f52e7a3b700 1 -- 172.21.15.63:0/1119949335 --> [v2:172.21.15.63:6818/1582539682,v1:172.21.15.63:6819/1582539682] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f52e00fb280 con 0x7f52cc06ec30 2023-12-07T16:18:41.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.398+0000 7f52d5ffb700 1 -- 172.21.15.63:0/1119949335 <== osd.2 v2:172.21.15.63:6818/1582539682 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f52e00fb280 con 0x7f52cc06ec30 2023-12-07T16:18:41.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.399+0000 7f52e7a3b700 1 -- 172.21.15.63:0/1119949335 >> [v2:172.21.15.63:6818/1582539682,v1:172.21.15.63:6819/1582539682] conn(0x7f52cc06ec30 msgr2=0x7f52cc071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:41.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.399+0000 7f52e7a3b700 1 --2- 172.21.15.63:0/1119949335 >> [v2:172.21.15.63:6818/1582539682,v1:172.21.15.63:6819/1582539682] conn(0x7f52cc06ec30 0x7f52cc071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:41.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.399+0000 7f52e7a3b700 1 -- 172.21.15.63:0/1119949335 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f52cc068f60 msgr2=0x7f52cc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:41.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.399+0000 7f52e7a3b700 1 --2- 172.21.15.63:0/1119949335 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f52cc068f60 0x7f52cc06b410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f52d000b3b0 tx=0x7f52d0009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:41.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.399+0000 7f52e7a3b700 1 -- 172.21.15.63:0/1119949335 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52e00fdc50 msgr2=0x7f52e01136a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:41.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.399+0000 7f52e7a3b700 1 --2- 172.21.15.63:0/1119949335 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52e00fdc50 0x7f52e01136a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f52dc002a50 tx=0x7f52dc0046b0 comp rx=0 tx=0).stop 2023-12-07T16:18:41.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.399+0000 7f52e7a3b700 1 -- 172.21.15.63:0/1119949335 shutdown_connections 2023-12-07T16:18:41.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.399+0000 7f52e7a3b700 1 --2- 172.21.15.63:0/1119949335 >> [v2:172.21.15.63:6818/1582539682,v1:172.21.15.63:6819/1582539682] conn(0x7f52cc06ec30 0x7f52cc071040 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:41.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.399+0000 7f52e7a3b700 1 --2- 172.21.15.63:0/1119949335 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f52cc068f60 0x7f52cc06b410 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:41.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.399+0000 7f52e7a3b700 1 --2- 172.21.15.63:0/1119949335 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52e00fdc50 0x7f52e01136a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:41.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.399+0000 7f52e7a3b700 1 --2- 172.21.15.63:0/1119949335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52e00fe5f0 0x7f52e0113c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:41.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.399+0000 7f52e7a3b700 1 -- 172.21.15.63:0/1119949335 >> 172.21.15.63:0/1119949335 conn(0x7f52e00f7680 msgr2=0x7f52e01013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:41.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.399+0000 7f52e7a3b700 1 -- 172.21.15.63:0/1119949335 shutdown_connections 2023-12-07T16:18:41.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.399+0000 7f52e7a3b700 1 -- 172.21.15.63:0/1119949335 wait complete. 2023-12-07T16:18:41.442 INFO:teuthology.orchestra.run.smithi063.stdout:60129542165 2023-12-07T16:18:41.442 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.1 2023-12-07T16:18:41.606 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:41.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.971+0000 7fc2760f5700 1 -- 172.21.15.63:0/3435863937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc270102c20 msgr2=0x7fc270102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:41.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.971+0000 7fc2760f5700 1 --2- 172.21.15.63:0/3435863937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc270102c20 0x7fc270102ff0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc260004940 tx=0x7fc260009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:41.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.971+0000 7fc2760f5700 1 -- 172.21.15.63:0/3435863937 shutdown_connections 2023-12-07T16:18:41.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.971+0000 7fc2760f5700 1 --2- 172.21.15.63:0/3435863937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc270065390 0x7fc270065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:41.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.971+0000 7fc2760f5700 1 --2- 172.21.15.63:0/3435863937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc270102c20 0x7fc270102ff0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:41.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.971+0000 7fc2760f5700 1 -- 172.21.15.63:0/3435863937 >> 172.21.15.63:0/3435863937 conn(0x7fc2700719b0 msgr2=0x7fc270071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:41.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.971+0000 7fc2760f5700 1 -- 172.21.15.63:0/3435863937 shutdown_connections 2023-12-07T16:18:41.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.971+0000 7fc2760f5700 1 -- 172.21.15.63:0/3435863937 wait complete. 2023-12-07T16:18:41.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.972+0000 7fc2760f5700 1 Processor -- start 2023-12-07T16:18:41.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.972+0000 7fc2760f5700 1 -- start start 2023-12-07T16:18:41.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.972+0000 7fc2760f5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc270065390 0x7fc270113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:41.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.972+0000 7fc2760f5700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc270102c20 0x7fc270113c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:41.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.972+0000 7fc2760f5700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27010d540 con 0x7fc270102c20 2023-12-07T16:18:41.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.972+0000 7fc2760f5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27010d6b0 con 0x7fc270065390 2023-12-07T16:18:41.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.972+0000 7fc26effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc270102c20 0x7fc270113c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:41.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.972+0000 7fc26effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc270102c20 0x7fc270113c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55316/0 (socket says 172.21.15.63:55316) 2023-12-07T16:18:41.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.972+0000 7fc26effd700 1 -- 172.21.15.63:0/3964132615 learned_addr learned my addr 172.21.15.63:0/3964132615 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:41.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.972+0000 7fc26f7fe700 1 --2- 172.21.15.63:0/3964132615 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc270065390 0x7fc270113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:41.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.972+0000 7fc26effd700 1 -- 172.21.15.63:0/3964132615 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc270065390 msgr2=0x7fc270113680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:41.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.972+0000 7fc26effd700 1 --2- 172.21.15.63:0/3964132615 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc270065390 0x7fc270113680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:41.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.972+0000 7fc26effd700 1 -- 172.21.15.63:0/3964132615 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc260005040 con 0x7fc270102c20 2023-12-07T16:18:41.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.973+0000 7fc26effd700 1 --2- 172.21.15.63:0/3964132615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc270102c20 0x7fc270113c00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc26400b790 tx=0x7fc264009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:41.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.973+0000 7fc257fff700 1 -- 172.21.15.63:0/3964132615 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc26400f6f0 con 0x7fc270102c20 2023-12-07T16:18:41.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.973+0000 7fc2760f5700 1 -- 172.21.15.63:0/3964132615 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc27010d990 con 0x7fc270102c20 2023-12-07T16:18:41.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.973+0000 7fc257fff700 1 -- 172.21.15.63:0/3964132615 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc26400fd00 con 0x7fc270102c20 2023-12-07T16:18:41.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.973+0000 7fc257fff700 1 -- 172.21.15.63:0/3964132615 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2640103a0 con 0x7fc270102c20 2023-12-07T16:18:41.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.973+0000 7fc2760f5700 1 -- 172.21.15.63:0/3964132615 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27010ded0 con 0x7fc270102c20 2023-12-07T16:18:41.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.974+0000 7fc2760f5700 1 -- 172.21.15.63:0/3964132615 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc27010e3d0 con 0x7fc270102c20 2023-12-07T16:18:41.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.974+0000 7fc257fff700 1 -- 172.21.15.63:0/3964132615 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc26400f850 con 0x7fc270102c20 2023-12-07T16:18:41.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.975+0000 7fc257fff700 1 --2- 172.21.15.63:0/3964132615 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fc258068f60 0x7fc25806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:41.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.975+0000 7fc257fff700 1 -- 172.21.15.63:0/3964132615 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc264086870 con 0x7fc270102c20 2023-12-07T16:18:41.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.975+0000 7fc26f7fe700 1 --2- 172.21.15.63:0/3964132615 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fc258068f60 0x7fc25806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:41.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.975+0000 7fc257fff700 1 --2- 172.21.15.63:0/3964132615 >> [v2:172.21.15.63:6802/2340994154,v1:172.21.15.63:6803/2340994154] conn(0x7fc25806ec30 0x7fc258071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:41.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.975+0000 7fc257fff700 1 -- 172.21.15.63:0/3964132615 --> [v2:172.21.15.63:6802/2340994154,v1:172.21.15.63:6803/2340994154] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2580716f0 con 0x7fc25806ec30 2023-12-07T16:18:41.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.975+0000 7fc257fff700 1 -- 172.21.15.63:0/3964132615 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc26408b220 con 0x7fc270102c20 2023-12-07T16:18:41.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.975+0000 7fc26ffff700 1 --2- 172.21.15.63:0/3964132615 >> [v2:172.21.15.63:6802/2340994154,v1:172.21.15.63:6803/2340994154] conn(0x7fc25806ec30 0x7fc258071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:41.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.975+0000 7fc26f7fe700 1 --2- 172.21.15.63:0/3964132615 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fc258068f60 0x7fc25806b410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc26000b3b0 tx=0x7fc260009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:41.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.975+0000 7fc26ffff700 1 --2- 172.21.15.63:0/3964132615 >> [v2:172.21.15.63:6802/2340994154,v1:172.21.15.63:6803/2340994154] conn(0x7fc25806ec30 0x7fc258071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:41.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.976+0000 7fc257fff700 1 -- 172.21.15.63:0/3964132615 <== osd.0 v2:172.21.15.63:6802/2340994154 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc2580716f0 con 0x7fc25806ec30 2023-12-07T16:18:41.989 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.991+0000 7fc2760f5700 1 -- 172.21.15.63:0/3964132615 --> [v2:172.21.15.63:6802/2340994154,v1:172.21.15.63:6803/2340994154] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc27005e2c0 con 0x7fc25806ec30 2023-12-07T16:18:41.990 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.991+0000 7fc257fff700 1 -- 172.21.15.63:0/3964132615 <== osd.0 v2:172.21.15.63:6802/2340994154 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc27005e2c0 con 0x7fc25806ec30 2023-12-07T16:18:41.990 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.991+0000 7fc2760f5700 1 -- 172.21.15.63:0/3964132615 >> [v2:172.21.15.63:6802/2340994154,v1:172.21.15.63:6803/2340994154] conn(0x7fc25806ec30 msgr2=0x7fc258071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:41.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.991+0000 7fc2760f5700 1 --2- 172.21.15.63:0/3964132615 >> [v2:172.21.15.63:6802/2340994154,v1:172.21.15.63:6803/2340994154] conn(0x7fc25806ec30 0x7fc258071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:41.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.992+0000 7fc2760f5700 1 -- 172.21.15.63:0/3964132615 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fc258068f60 msgr2=0x7fc25806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:41.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.992+0000 7fc2760f5700 1 --2- 172.21.15.63:0/3964132615 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fc258068f60 0x7fc25806b410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc26000b3b0 tx=0x7fc260009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:41.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.992+0000 7fc2760f5700 1 -- 172.21.15.63:0/3964132615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc270102c20 msgr2=0x7fc270113c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:41.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.992+0000 7fc2760f5700 1 --2- 172.21.15.63:0/3964132615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc270102c20 0x7fc270113c00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc26400b790 tx=0x7fc264009250 comp rx=0 tx=0).stop 2023-12-07T16:18:41.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.992+0000 7fc2760f5700 1 -- 172.21.15.63:0/3964132615 shutdown_connections 2023-12-07T16:18:41.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.992+0000 7fc2760f5700 1 --2- 172.21.15.63:0/3964132615 >> [v2:172.21.15.63:6802/2340994154,v1:172.21.15.63:6803/2340994154] conn(0x7fc25806ec30 0x7fc258071040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:41.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.992+0000 7fc2760f5700 1 --2- 172.21.15.63:0/3964132615 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc270065390 0x7fc270113680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:41.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.992+0000 7fc2760f5700 1 --2- 172.21.15.63:0/3964132615 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fc258068f60 0x7fc25806b410 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:41.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.992+0000 7fc2760f5700 1 --2- 172.21.15.63:0/3964132615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc270102c20 0x7fc270113c00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:41.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.992+0000 7fc2760f5700 1 -- 172.21.15.63:0/3964132615 >> 172.21.15.63:0/3964132615 conn(0x7fc2700719b0 msgr2=0x7fc2700faaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:41.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.992+0000 7fc2760f5700 1 -- 172.21.15.63:0/3964132615 shutdown_connections 2023-12-07T16:18:41.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:41.992+0000 7fc2760f5700 1 -- 172.21.15.63:0/3964132615 wait complete. 2023-12-07T16:18:42.073 INFO:teuthology.orchestra.run.smithi063.stdout:163208757255 2023-12-07T16:18:42.073 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.5 2023-12-07T16:18:42.730 INFO:teuthology.orchestra.run.smithi063.stdout:38654705689 2023-12-07T16:18:42.730 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.0 2023-12-07T16:18:42.848 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:42 smithi063 ceph-mon[112095]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:42.866 INFO:teuthology.orchestra.run.smithi063.stdout:81604378642 2023-12-07T16:18:42.867 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.2 2023-12-07T16:18:42.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:42 smithi152 ceph-mon[121113]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:43.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.331+0000 7f4416fb9700 1 -- 172.21.15.63:0/670285821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4410103590 msgr2=0x7f44100fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:43.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.331+0000 7f4416fb9700 1 --2- 172.21.15.63:0/670285821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4410103590 0x7f44100fcc00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f43fc004940 tx=0x7f43fc009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:43.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.331+0000 7f4416fb9700 1 -- 172.21.15.63:0/670285821 shutdown_connections 2023-12-07T16:18:43.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.331+0000 7f4416fb9700 1 --2- 172.21.15.63:0/670285821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4410103590 0x7f44100fcc00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:43.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.331+0000 7f4416fb9700 1 --2- 172.21.15.63:0/670285821 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4410102bf0 0x7f4410102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:43.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.331+0000 7f4416fb9700 1 -- 172.21.15.63:0/670285821 >> 172.21.15.63:0/670285821 conn(0x7f44100f87a0 msgr2=0x7f44100fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:43.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.331+0000 7f4416fb9700 1 -- 172.21.15.63:0/670285821 shutdown_connections 2023-12-07T16:18:43.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.331+0000 7f4416fb9700 1 -- 172.21.15.63:0/670285821 wait complete. 2023-12-07T16:18:43.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.332+0000 7f4416fb9700 1 Processor -- start 2023-12-07T16:18:43.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.332+0000 7f4416fb9700 1 -- start start 2023-12-07T16:18:43.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.332+0000 7f4416fb9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4410102bf0 0x7f4410113620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:43.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.332+0000 7f4416fb9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4410103590 0x7f4410113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:43.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.332+0000 7f4416fb9700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44101141f0 con 0x7f4410103590 2023-12-07T16:18:43.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.332+0000 7f4416fb9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441010d4e0 con 0x7f4410102bf0 2023-12-07T16:18:43.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.332+0000 7f440ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4410103590 0x7f4410113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:43.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.332+0000 7f440ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4410103590 0x7f4410113ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55328/0 (socket says 172.21.15.63:55328) 2023-12-07T16:18:43.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.332+0000 7f440ffff700 1 -- 172.21.15.63:0/2493213180 learned_addr learned my addr 172.21.15.63:0/2493213180 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:43.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.333+0000 7f4414d55700 1 --2- 172.21.15.63:0/2493213180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4410102bf0 0x7f4410113620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:43.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.333+0000 7f440ffff700 1 -- 172.21.15.63:0/2493213180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4410102bf0 msgr2=0x7f4410113620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:43.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.333+0000 7f440ffff700 1 --2- 172.21.15.63:0/2493213180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4410102bf0 0x7f4410113620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:43.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.333+0000 7f440ffff700 1 -- 172.21.15.63:0/2493213180 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43fc005040 con 0x7f4410103590 2023-12-07T16:18:43.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.333+0000 7f4414d55700 1 --2- 172.21.15.63:0/2493213180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4410102bf0 0x7f4410113620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T16:18:43.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.333+0000 7f440ffff700 1 --2- 172.21.15.63:0/2493213180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4410103590 0x7f4410113ba0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f43fc009380 tx=0x7f43fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:43.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.333+0000 7f440d7fa700 1 -- 172.21.15.63:0/2493213180 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43fc00e040 con 0x7f4410103590 2023-12-07T16:18:43.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.333+0000 7f4416fb9700 1 -- 172.21.15.63:0/2493213180 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441010d710 con 0x7f4410103590 2023-12-07T16:18:43.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.333+0000 7f440d7fa700 1 -- 172.21.15.63:0/2493213180 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f43fc00bc50 con 0x7f4410103590 2023-12-07T16:18:43.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.333+0000 7f440d7fa700 1 -- 172.21.15.63:0/2493213180 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43fc01c3f0 con 0x7f4410103590 2023-12-07T16:18:43.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.333+0000 7f4416fb9700 1 -- 172.21.15.63:0/2493213180 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441010dc50 con 0x7f4410103590 2023-12-07T16:18:43.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.334+0000 7f4416fb9700 1 -- 172.21.15.63:0/2493213180 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44101050c0 con 0x7f4410103590 2023-12-07T16:18:43.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.335+0000 7f440d7fa700 1 -- 172.21.15.63:0/2493213180 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f43fc013420 con 0x7f4410103590 2023-12-07T16:18:43.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.336+0000 7f440d7fa700 1 --2- 172.21.15.63:0/2493213180 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f4400068f60 0x7f440006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:43.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.336+0000 7f440d7fa700 1 -- 172.21.15.63:0/2493213180 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f43fc0888c0 con 0x7f4410103590 2023-12-07T16:18:43.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.336+0000 7f4414d55700 1 --2- 172.21.15.63:0/2493213180 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f4400068f60 0x7f440006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:43.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.336+0000 7f4414d55700 1 --2- 172.21.15.63:0/2493213180 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f4400068f60 0x7f440006b410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f44040041d0 tx=0x7f4404009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:43.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.340+0000 7f440d7fa700 1 -- 172.21.15.63:0/2493213180 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f43fc058c00 con 0x7f4410103590 2023-12-07T16:18:43.379 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:43.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.447+0000 7faf649db700 1 -- 172.21.15.63:0/4025291648 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf600fbb40 msgr2=0x7faf600fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:43.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.447+0000 7faf649db700 1 --2- 172.21.15.63:0/4025291648 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf600fbb40 0x7faf600fbfb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7faf54004940 tx=0x7faf54009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:43.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.447+0000 7faf649db700 1 -- 172.21.15.63:0/4025291648 shutdown_connections 2023-12-07T16:18:43.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.447+0000 7faf649db700 1 --2- 172.21.15.63:0/4025291648 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf600fbb40 0x7faf600fbfb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:43.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.447+0000 7faf649db700 1 --2- 172.21.15.63:0/4025291648 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf60101b00 0x7faf60101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:43.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.447+0000 7faf649db700 1 -- 172.21.15.63:0/4025291648 >> 172.21.15.63:0/4025291648 conn(0x7faf600719b0 msgr2=0x7faf60071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:43.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.447+0000 7faf649db700 1 -- 172.21.15.63:0/4025291648 shutdown_connections 2023-12-07T16:18:43.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.447+0000 7faf649db700 1 -- 172.21.15.63:0/4025291648 wait complete. 2023-12-07T16:18:43.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.447+0000 7faf649db700 1 Processor -- start 2023-12-07T16:18:43.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.448+0000 7faf649db700 1 -- start start 2023-12-07T16:18:43.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.448+0000 7faf649db700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf600fbb40 0x7faf600fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:43.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.448+0000 7faf649db700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf60101b00 0x7faf600fdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:43.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.448+0000 7faf649db700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf600fe2d0 con 0x7faf600fbb40 2023-12-07T16:18:43.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.448+0000 7faf649db700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf600fe440 con 0x7faf60101b00 2023-12-07T16:18:43.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.448+0000 7faf5e59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf600fbb40 0x7faf600fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:43.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.448+0000 7faf5e59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf600fbb40 0x7faf600fd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55348/0 (socket says 172.21.15.63:55348) 2023-12-07T16:18:43.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.448+0000 7faf5e59c700 1 -- 172.21.15.63:0/1274735532 learned_addr learned my addr 172.21.15.63:0/1274735532 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:43.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.448+0000 7faf5dd9b700 1 --2- 172.21.15.63:0/1274735532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf60101b00 0x7faf600fdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:43.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.448+0000 7faf5e59c700 1 -- 172.21.15.63:0/1274735532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf60101b00 msgr2=0x7faf600fdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:43.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.448+0000 7faf5e59c700 1 --2- 172.21.15.63:0/1274735532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf60101b00 0x7faf600fdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:43.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.448+0000 7faf5e59c700 1 -- 172.21.15.63:0/1274735532 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf54005040 con 0x7faf600fbb40 2023-12-07T16:18:43.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.448+0000 7faf5e59c700 1 --2- 172.21.15.63:0/1274735532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf600fbb40 0x7faf600fd720 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faf50002a50 tx=0x7faf500046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:43.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.448+0000 7faf4effd700 1 -- 172.21.15.63:0/1274735532 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf50007cc0 con 0x7faf600fbb40 2023-12-07T16:18:43.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.449+0000 7faf649db700 1 -- 172.21.15.63:0/1274735532 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf601198f0 con 0x7faf600fbb40 2023-12-07T16:18:43.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.449+0000 7faf4effd700 1 -- 172.21.15.63:0/1274735532 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faf5000f040 con 0x7faf600fbb40 2023-12-07T16:18:43.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.449+0000 7faf4effd700 1 -- 172.21.15.63:0/1274735532 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf5000d9c0 con 0x7faf600fbb40 2023-12-07T16:18:43.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.449+0000 7faf649db700 1 -- 172.21.15.63:0/1274735532 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf60119e30 con 0x7faf600fbb40 2023-12-07T16:18:43.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.449+0000 7faf649db700 1 -- 172.21.15.63:0/1274735532 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faf60100af0 con 0x7faf600fbb40 2023-12-07T16:18:43.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.450+0000 7faf4effd700 1 -- 172.21.15.63:0/1274735532 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7faf5000db20 con 0x7faf600fbb40 2023-12-07T16:18:43.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.450+0000 7faf4effd700 1 --2- 172.21.15.63:0/1274735532 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7faf48068f60 0x7faf4806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:43.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.451+0000 7faf4effd700 1 -- 172.21.15.63:0/1274735532 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7faf50086830 con 0x7faf600fbb40 2023-12-07T16:18:43.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.451+0000 7faf5dd9b700 1 --2- 172.21.15.63:0/1274735532 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7faf48068f60 0x7faf4806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:43.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.451+0000 7faf4effd700 1 --2- 172.21.15.63:0/1274735532 >> [v2:172.21.15.152:6800/913468029,v1:172.21.15.152:6801/913468029] conn(0x7faf4806ec30 0x7faf48071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:43.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.451+0000 7faf4effd700 1 -- 172.21.15.63:0/1274735532 --> [v2:172.21.15.152:6800/913468029,v1:172.21.15.152:6801/913468029] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf480716f0 con 0x7faf4806ec30 2023-12-07T16:18:43.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.451+0000 7faf4effd700 1 -- 172.21.15.63:0/1274735532 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf50088de0 con 0x7faf600fbb40 2023-12-07T16:18:43.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.451+0000 7faf5dd9b700 1 --2- 172.21.15.63:0/1274735532 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7faf48068f60 0x7faf4806b410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faf600ff120 tx=0x7faf54009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:43.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.451+0000 7faf5ed9d700 1 --2- 172.21.15.63:0/1274735532 >> [v2:172.21.15.152:6800/913468029,v1:172.21.15.152:6801/913468029] conn(0x7faf4806ec30 0x7faf48071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:43.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.452+0000 7faf5ed9d700 1 --2- 172.21.15.63:0/1274735532 >> [v2:172.21.15.152:6800/913468029,v1:172.21.15.152:6801/913468029] conn(0x7faf4806ec30 0x7faf48071040 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:43.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.452+0000 7faf4effd700 1 -- 172.21.15.63:0/1274735532 <== osd.3 v2:172.21.15.152:6800/913468029 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7faf480716f0 con 0x7faf4806ec30 2023-12-07T16:18:43.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.471+0000 7faf649db700 1 -- 172.21.15.63:0/1274735532 --> [v2:172.21.15.152:6800/913468029,v1:172.21.15.152:6801/913468029] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faf600734d0 con 0x7faf4806ec30 2023-12-07T16:18:43.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.472+0000 7faf4effd700 1 -- 172.21.15.63:0/1274735532 <== osd.3 v2:172.21.15.152:6800/913468029 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7faf600734d0 con 0x7faf4806ec30 2023-12-07T16:18:43.471 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.472+0000 7faf649db700 1 -- 172.21.15.63:0/1274735532 >> [v2:172.21.15.152:6800/913468029,v1:172.21.15.152:6801/913468029] conn(0x7faf4806ec30 msgr2=0x7faf48071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:43.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.472+0000 7faf649db700 1 --2- 172.21.15.63:0/1274735532 >> [v2:172.21.15.152:6800/913468029,v1:172.21.15.152:6801/913468029] conn(0x7faf4806ec30 0x7faf48071040 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:43.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.472+0000 7faf649db700 1 -- 172.21.15.63:0/1274735532 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7faf48068f60 msgr2=0x7faf4806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:43.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.472+0000 7faf649db700 1 --2- 172.21.15.63:0/1274735532 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7faf48068f60 0x7faf4806b410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faf600ff120 tx=0x7faf54009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:43.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.472+0000 7faf649db700 1 -- 172.21.15.63:0/1274735532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf600fbb40 msgr2=0x7faf600fd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:43.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.472+0000 7faf649db700 1 --2- 172.21.15.63:0/1274735532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf600fbb40 0x7faf600fd720 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faf50002a50 tx=0x7faf500046b0 comp rx=0 tx=0).stop 2023-12-07T16:18:43.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.472+0000 7faf649db700 1 -- 172.21.15.63:0/1274735532 shutdown_connections 2023-12-07T16:18:43.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.472+0000 7faf649db700 1 --2- 172.21.15.63:0/1274735532 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7faf48068f60 0x7faf4806b410 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:43.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.472+0000 7faf649db700 1 --2- 172.21.15.63:0/1274735532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf600fbb40 0x7faf600fd720 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:43.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.473+0000 7faf649db700 1 --2- 172.21.15.63:0/1274735532 >> [v2:172.21.15.152:6800/913468029,v1:172.21.15.152:6801/913468029] conn(0x7faf4806ec30 0x7faf48071040 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:43.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.473+0000 7faf649db700 1 --2- 172.21.15.63:0/1274735532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf60101b00 0x7faf600fdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:43.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.473+0000 7faf649db700 1 -- 172.21.15.63:0/1274735532 >> 172.21.15.63:0/1274735532 conn(0x7faf600719b0 msgr2=0x7faf600654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:43.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.473+0000 7faf649db700 1 -- 172.21.15.63:0/1274735532 shutdown_connections 2023-12-07T16:18:43.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.473+0000 7faf649db700 1 -- 172.21.15.63:0/1274735532 wait complete. 2023-12-07T16:18:43.557 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.559+0000 7f4416fb9700 1 -- 172.21.15.63:0/2493213180 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f44100fc3a0 con 0x7f4410103590 2023-12-07T16:18:43.557 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.559+0000 7f440d7fa700 1 -- 172.21.15.63:0/2493213180 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f43fc058790 con 0x7f4410103590 2023-12-07T16:18:43.558 INFO:teuthology.orchestra.run.smithi063.stdout:141733920778 2023-12-07T16:18:43.560 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.561+0000 7f4416fb9700 1 -- 172.21.15.63:0/2493213180 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f4400068f60 msgr2=0x7f440006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:43.560 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.561+0000 7f4416fb9700 1 --2- 172.21.15.63:0/2493213180 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f4400068f60 0x7f440006b410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f44040041d0 tx=0x7f4404009040 comp rx=0 tx=0).stop 2023-12-07T16:18:43.560 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.561+0000 7f4416fb9700 1 -- 172.21.15.63:0/2493213180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4410103590 msgr2=0x7f4410113ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:43.560 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.561+0000 7f4416fb9700 1 --2- 172.21.15.63:0/2493213180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4410103590 0x7f4410113ba0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f43fc009380 tx=0x7f43fc009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:43.560 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.561+0000 7f4416fb9700 1 -- 172.21.15.63:0/2493213180 shutdown_connections 2023-12-07T16:18:43.560 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.561+0000 7f4416fb9700 1 --2- 172.21.15.63:0/2493213180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4410102bf0 0x7f4410113620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:43.560 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.561+0000 7f4416fb9700 1 --2- 172.21.15.63:0/2493213180 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f4400068f60 0x7f440006b410 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:43.560 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.561+0000 7f4416fb9700 1 --2- 172.21.15.63:0/2493213180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4410103590 0x7f4410113ba0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:43.560 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.561+0000 7f4416fb9700 1 -- 172.21.15.63:0/2493213180 >> 172.21.15.63:0/2493213180 conn(0x7f44100f87a0 msgr2=0x7f44100fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:43.561 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.561+0000 7f4416fb9700 1 -- 172.21.15.63:0/2493213180 shutdown_connections 2023-12-07T16:18:43.561 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:43.561+0000 7f4416fb9700 1 -- 172.21.15.63:0/2493213180 wait complete. 2023-12-07T16:18:43.616 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:43.668 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:43.757 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:43 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2493213180' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-07T16:18:43.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:43 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/2493213180' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-07T16:18:44.056 INFO:teuthology.orchestra.run.smithi063.stdout:111669149710 2023-12-07T16:18:44.057 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.3 2023-12-07T16:18:44.594 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:44.720 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920777 got 141733920778 for osd.4 2023-12-07T16:18:44.720 DEBUG:teuthology.parallel:result is None 2023-12-07T16:18:44.862 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:44 smithi063 ceph-mon[112095]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:44.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:44 smithi152 ceph-mon[121113]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:45.545 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:45.712 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:45 smithi063 ceph-mon[112095]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:45.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:45 smithi152 ceph-mon[121113]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:46.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.007+0000 7f4a166a6700 1 -- 172.21.15.63:0/1347893885 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a10104ef0 msgr2=0x7f4a101052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:46.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.007+0000 7f4a166a6700 1 --2- 172.21.15.63:0/1347893885 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a10104ef0 0x7f4a101052c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4a00004940 tx=0x7f4a00009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.007+0000 7f4a166a6700 1 -- 172.21.15.63:0/1347893885 shutdown_connections 2023-12-07T16:18:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.007+0000 7f4a166a6700 1 --2- 172.21.15.63:0/1347893885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a10105890 0x7f4a100fef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.007+0000 7f4a166a6700 1 --2- 172.21.15.63:0/1347893885 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a10104ef0 0x7f4a101052c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.007+0000 7f4a166a6700 1 -- 172.21.15.63:0/1347893885 >> 172.21.15.63:0/1347893885 conn(0x7f4a100faaa0 msgr2=0x7f4a100fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.007+0000 7f4a166a6700 1 -- 172.21.15.63:0/1347893885 shutdown_connections 2023-12-07T16:18:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.007+0000 7f4a166a6700 1 -- 172.21.15.63:0/1347893885 wait complete. 2023-12-07T16:18:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.008+0000 7f4a166a6700 1 Processor -- start 2023-12-07T16:18:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.008+0000 7f4a166a6700 1 -- start start 2023-12-07T16:18:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.008+0000 7f4a166a6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a10104ef0 0x7f4a101158b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.008+0000 7f4a166a6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a10105890 0x7f4a10115df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.008+0000 7f4a166a6700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a10116440 con 0x7f4a10104ef0 2023-12-07T16:18:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.008+0000 7f4a166a6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1010f770 con 0x7f4a10105890 2023-12-07T16:18:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.008+0000 7f4a0ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a10104ef0 0x7f4a101158b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:46.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.008+0000 7f4a0ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a10104ef0 0x7f4a101158b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55366/0 (socket says 172.21.15.63:55366) 2023-12-07T16:18:46.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.008+0000 7f4a0ffff700 1 -- 172.21.15.63:0/2084997915 learned_addr learned my addr 172.21.15.63:0/2084997915 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:46.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.009+0000 7f4a0f7fe700 1 --2- 172.21.15.63:0/2084997915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a10105890 0x7f4a10115df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:46.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.009+0000 7f4a0ffff700 1 -- 172.21.15.63:0/2084997915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a10105890 msgr2=0x7f4a10115df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:46.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.009+0000 7f4a0ffff700 1 --2- 172.21.15.63:0/2084997915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a10105890 0x7f4a10115df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:46.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.009+0000 7f4a0ffff700 1 -- 172.21.15.63:0/2084997915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a00005040 con 0x7f4a10104ef0 2023-12-07T16:18:46.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.009+0000 7f4a0f7fe700 1 --2- 172.21.15.63:0/2084997915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a10105890 0x7f4a10115df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T16:18:46.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.009+0000 7f4a0ffff700 1 --2- 172.21.15.63:0/2084997915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a10104ef0 0x7f4a101158b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000b3b0 tx=0x7f4a00009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:46.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.009+0000 7f4a0cff9700 1 -- 172.21.15.63:0/2084997915 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a0000e040 con 0x7f4a10104ef0 2023-12-07T16:18:46.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.009+0000 7f4a166a6700 1 -- 172.21.15.63:0/2084997915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1010f9f0 con 0x7f4a10104ef0 2023-12-07T16:18:46.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.009+0000 7f4a0cff9700 1 -- 172.21.15.63:0/2084997915 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4a0000bc50 con 0x7f4a10104ef0 2023-12-07T16:18:46.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.009+0000 7f4a0cff9700 1 -- 172.21.15.63:0/2084997915 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a00013420 con 0x7f4a10104ef0 2023-12-07T16:18:46.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.009+0000 7f4a166a6700 1 -- 172.21.15.63:0/2084997915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1010ff30 con 0x7f4a10104ef0 2023-12-07T16:18:46.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.010+0000 7f4a166a6700 1 -- 172.21.15.63:0/2084997915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a10102200 con 0x7f4a10104ef0 2023-12-07T16:18:46.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.011+0000 7f4a0cff9700 1 -- 172.21.15.63:0/2084997915 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f4a0001c430 con 0x7f4a10104ef0 2023-12-07T16:18:46.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.011+0000 7f4a0cff9700 1 --2- 172.21.15.63:0/2084997915 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f49f8068f60 0x7f49f806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:46.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.011+0000 7f4a0cff9700 1 -- 172.21.15.63:0/2084997915 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4a00087870 con 0x7f4a10104ef0 2023-12-07T16:18:46.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.011+0000 7f4a0f7fe700 1 --2- 172.21.15.63:0/2084997915 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f49f8068f60 0x7f49f806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:46.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.012+0000 7f4a0f7fe700 1 --2- 172.21.15.63:0/2084997915 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f49f8068f60 0x7f49f806b410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4a04007fd0 tx=0x7f4a04009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:46.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.016+0000 7f4a0cff9700 1 -- 172.21.15.63:0/2084997915 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4a00057bc0 con 0x7f4a10104ef0 2023-12-07T16:18:46.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.118+0000 7f0cbcf43700 1 -- 172.21.15.63:0/4243768357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cb8102410 msgr2=0x7f0cb80fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:46.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.118+0000 7f0cbcf43700 1 --2- 172.21.15.63:0/4243768357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cb8102410 0x7f0cb80fc2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0cac004940 tx=0x7f0cac009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:46.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.118+0000 7f0cbcf43700 1 -- 172.21.15.63:0/4243768357 shutdown_connections 2023-12-07T16:18:46.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.118+0000 7f0cbcf43700 1 --2- 172.21.15.63:0/4243768357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cb8102410 0x7f0cb80fc2f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:46.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.118+0000 7f0cbcf43700 1 --2- 172.21.15.63:0/4243768357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cb8101b00 0x7f0cb8101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:46.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.118+0000 7f0cbcf43700 1 -- 172.21.15.63:0/4243768357 >> 172.21.15.63:0/4243768357 conn(0x7f0cb80711a0 msgr2=0x7f0cb80715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:46.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.118+0000 7f0cbcf43700 1 -- 172.21.15.63:0/4243768357 shutdown_connections 2023-12-07T16:18:46.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.118+0000 7f0cbcf43700 1 -- 172.21.15.63:0/4243768357 wait complete. 2023-12-07T16:18:46.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.119+0000 7f0cbcf43700 1 Processor -- start 2023-12-07T16:18:46.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.119+0000 7f0cbcf43700 1 -- start start 2023-12-07T16:18:46.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.119+0000 7f0cbcf43700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cb8101b00 0x7f0cb8113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:46.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.119+0000 7f0cbcf43700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cb8102410 0x7f0cb8113c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:46.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.119+0000 7f0cbcf43700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb8114250 con 0x7f0cb8102410 2023-12-07T16:18:46.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.119+0000 7f0cbcf43700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb810d540 con 0x7f0cb8101b00 2023-12-07T16:18:46.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.119+0000 7f0cb5d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cb8102410 0x7f0cb8113c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:46.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.119+0000 7f0cb5d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cb8102410 0x7f0cb8113c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55394/0 (socket says 172.21.15.63:55394) 2023-12-07T16:18:46.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.119+0000 7f0cb5d9b700 1 -- 172.21.15.63:0/2045641614 learned_addr learned my addr 172.21.15.63:0/2045641614 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:46.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.119+0000 7f0cb659c700 1 --2- 172.21.15.63:0/2045641614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cb8101b00 0x7f0cb8113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:46.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.119+0000 7f0cb5d9b700 1 -- 172.21.15.63:0/2045641614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cb8101b00 msgr2=0x7f0cb8113680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:46.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.119+0000 7f0cb5d9b700 1 --2- 172.21.15.63:0/2045641614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cb8101b00 0x7f0cb8113680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:46.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.119+0000 7f0cb5d9b700 1 -- 172.21.15.63:0/2045641614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cac005040 con 0x7f0cb8102410 2023-12-07T16:18:46.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.120+0000 7f0cb659c700 1 --2- 172.21.15.63:0/2045641614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cb8101b00 0x7f0cb8113680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T16:18:46.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.120+0000 7f0cb5d9b700 1 --2- 172.21.15.63:0/2045641614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cb8102410 0x7f0cb8113c00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0cac009fd0 tx=0x7f0cac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:46.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.120+0000 7f0ca6ffd700 1 -- 172.21.15.63:0/2045641614 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cac00e040 con 0x7f0cb8102410 2023-12-07T16:18:46.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.120+0000 7f0ca6ffd700 1 -- 172.21.15.63:0/2045641614 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0cac00bd20 con 0x7f0cb8102410 2023-12-07T16:18:46.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.120+0000 7f0ca6ffd700 1 -- 172.21.15.63:0/2045641614 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cac01c630 con 0x7f0cb8102410 2023-12-07T16:18:46.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.120+0000 7f0cbcf43700 1 -- 172.21.15.63:0/2045641614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb810d770 con 0x7f0cb8102410 2023-12-07T16:18:46.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.120+0000 7f0cbcf43700 1 -- 172.21.15.63:0/2045641614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb810dcb0 con 0x7f0cb8102410 2023-12-07T16:18:46.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.121+0000 7f0cbcf43700 1 -- 172.21.15.63:0/2045641614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb80ffe70 con 0x7f0cb8102410 2023-12-07T16:18:46.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.122+0000 7f0ca6ffd700 1 -- 172.21.15.63:0/2045641614 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f0cac013420 con 0x7f0cb8102410 2023-12-07T16:18:46.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.123+0000 7f0ca6ffd700 1 --2- 172.21.15.63:0/2045641614 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f0ca0068f60 0x7f0ca006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:46.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.123+0000 7f0ca6ffd700 1 -- 172.21.15.63:0/2045641614 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0cac087f30 con 0x7f0cb8102410 2023-12-07T16:18:46.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.123+0000 7f0cb659c700 1 --2- 172.21.15.63:0/2045641614 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f0ca0068f60 0x7f0ca006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:46.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.123+0000 7f0cb659c700 1 --2- 172.21.15.63:0/2045641614 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f0ca0068f60 0x7f0ca006b410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009fd0 tx=0x7f0ca800b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:46.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.127+0000 7f0ca6ffd700 1 -- 172.21.15.63:0/2045641614 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0cac058270 con 0x7f0cb8102410 2023-12-07T16:18:46.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.220+0000 7f4a166a6700 1 -- 172.21.15.63:0/2084997915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4a1004bb80 con 0x7f4a10104ef0 2023-12-07T16:18:46.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.220+0000 7f4a0cff9700 1 -- 172.21.15.63:0/2084997915 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4a00057750 con 0x7f4a10104ef0 2023-12-07T16:18:46.219 INFO:teuthology.orchestra.run.smithi063.stdout:38654705690 2023-12-07T16:18:46.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.222+0000 7f4a166a6700 1 -- 172.21.15.63:0/2084997915 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f49f8068f60 msgr2=0x7f49f806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:46.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.222+0000 7f4a166a6700 1 --2- 172.21.15.63:0/2084997915 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f49f8068f60 0x7f49f806b410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4a04007fd0 tx=0x7f4a04009040 comp rx=0 tx=0).stop 2023-12-07T16:18:46.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.222+0000 7f4a166a6700 1 -- 172.21.15.63:0/2084997915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a10104ef0 msgr2=0x7f4a101158b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:46.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.222+0000 7f4a166a6700 1 --2- 172.21.15.63:0/2084997915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a10104ef0 0x7f4a101158b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000b3b0 tx=0x7f4a00009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:46.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.222+0000 7f4a166a6700 1 -- 172.21.15.63:0/2084997915 shutdown_connections 2023-12-07T16:18:46.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.222+0000 7f4a166a6700 1 --2- 172.21.15.63:0/2084997915 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f49f8068f60 0x7f49f806b410 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:46.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.222+0000 7f4a166a6700 1 --2- 172.21.15.63:0/2084997915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a10104ef0 0x7f4a101158b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:46.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.222+0000 7f4a166a6700 1 --2- 172.21.15.63:0/2084997915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a10105890 0x7f4a10115df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:46.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.222+0000 7f4a166a6700 1 -- 172.21.15.63:0/2084997915 >> 172.21.15.63:0/2084997915 conn(0x7f4a100faaa0 msgr2=0x7f4a100fc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:46.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.222+0000 7f4a166a6700 1 -- 172.21.15.63:0/2084997915 shutdown_connections 2023-12-07T16:18:46.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.222+0000 7f4a166a6700 1 -- 172.21.15.63:0/2084997915 wait complete. 2023-12-07T16:18:46.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.076+0000 7f7cab1a4700 1 -- 172.21.15.63:0/1410130503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca4105780 msgr2=0x7f7ca40fedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:46.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.076+0000 7f7cab1a4700 1 --2- 172.21.15.63:0/1410130503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca4105780 0x7f7ca40fedf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7c90004940 tx=0x7f7c90009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:46.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.076+0000 7f7cab1a4700 1 -- 172.21.15.63:0/1410130503 shutdown_connections 2023-12-07T16:18:46.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.076+0000 7f7cab1a4700 1 --2- 172.21.15.63:0/1410130503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca4105780 0x7f7ca40fedf0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:46.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.076+0000 7f7cab1a4700 1 --2- 172.21.15.63:0/1410130503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ca4104de0 0x7f7ca41051b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:46.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.076+0000 7f7cab1a4700 1 -- 172.21.15.63:0/1410130503 >> 172.21.15.63:0/1410130503 conn(0x7f7ca40fa9b0 msgr2=0x7f7ca40fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:46.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.076+0000 7f7cab1a4700 1 -- 172.21.15.63:0/1410130503 shutdown_connections 2023-12-07T16:18:46.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.076+0000 7f7cab1a4700 1 -- 172.21.15.63:0/1410130503 wait complete. 2023-12-07T16:18:46.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.077+0000 7f7cab1a4700 1 Processor -- start 2023-12-07T16:18:46.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.077+0000 7f7cab1a4700 1 -- start start 2023-12-07T16:18:46.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.077+0000 7f7cab1a4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca4104de0 0x7f7ca41157a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:46.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.077+0000 7f7cab1a4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ca4105780 0x7f7ca4115ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:46.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.077+0000 7f7cab1a4700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca4116330 con 0x7f7ca4104de0 2023-12-07T16:18:46.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.077+0000 7f7cab1a4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca410f660 con 0x7f7ca4105780 2023-12-07T16:18:46.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.077+0000 7f7ca8f40700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca4104de0 0x7f7ca41157a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:46.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.077+0000 7f7ca8f40700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca4104de0 0x7f7ca41157a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55376/0 (socket says 172.21.15.63:55376) 2023-12-07T16:18:46.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.077+0000 7f7ca8f40700 1 -- 172.21.15.63:0/2745198489 learned_addr learned my addr 172.21.15.63:0/2745198489 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:46.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.078+0000 7f7ca3fff700 1 --2- 172.21.15.63:0/2745198489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ca4105780 0x7f7ca4115ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:46.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.078+0000 7f7ca8f40700 1 -- 172.21.15.63:0/2745198489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ca4105780 msgr2=0x7f7ca4115ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:46.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.078+0000 7f7ca8f40700 1 --2- 172.21.15.63:0/2745198489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ca4105780 0x7f7ca4115ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:46.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.078+0000 7f7ca8f40700 1 -- 172.21.15.63:0/2745198489 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c90005040 con 0x7f7ca4104de0 2023-12-07T16:18:46.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.078+0000 7f7ca8f40700 1 --2- 172.21.15.63:0/2745198489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca4104de0 0x7f7ca41157a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7c9800eb40 tx=0x7f7c9800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:46.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.078+0000 7f7ca17fa700 1 -- 172.21.15.63:0/2745198489 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c98007cc0 con 0x7f7ca4104de0 2023-12-07T16:18:46.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.078+0000 7f7cab1a4700 1 -- 172.21.15.63:0/2745198489 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca410f800 con 0x7f7ca4104de0 2023-12-07T16:18:46.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.078+0000 7f7ca17fa700 1 -- 172.21.15.63:0/2745198489 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7c9800f040 con 0x7f7ca4104de0 2023-12-07T16:18:46.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.078+0000 7f7ca17fa700 1 -- 172.21.15.63:0/2745198489 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c9800c990 con 0x7f7ca4104de0 2023-12-07T16:18:46.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.078+0000 7f7cab1a4700 1 -- 172.21.15.63:0/2745198489 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca410fd10 con 0x7f7ca4104de0 2023-12-07T16:18:46.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.080+0000 7f7cab1a4700 1 -- 172.21.15.63:0/2745198489 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca41072b0 con 0x7f7ca4104de0 2023-12-07T16:18:46.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.080+0000 7f7ca17fa700 1 -- 172.21.15.63:0/2745198489 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f7c9800caf0 con 0x7f7ca4104de0 2023-12-07T16:18:46.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.081+0000 7f7ca17fa700 1 --2- 172.21.15.63:0/2745198489 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f7c94068f60 0x7f7c9406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:46.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.081+0000 7f7ca17fa700 1 -- 172.21.15.63:0/2745198489 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7c980884d0 con 0x7f7ca4104de0 2023-12-07T16:18:46.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.081+0000 7f7ca3fff700 1 --2- 172.21.15.63:0/2745198489 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f7c94068f60 0x7f7c9406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:46.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.082+0000 7f7ca3fff700 1 --2- 172.21.15.63:0/2745198489 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f7c94068f60 0x7f7c9406b410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7c90000c00 tx=0x7f7c90009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:46.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.086+0000 7f7ca17fa700 1 -- 172.21.15.63:0/2745198489 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7c9804da00 con 0x7f7ca4104de0 2023-12-07T16:18:46.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.288+0000 7f7cab1a4700 1 -- 172.21.15.63:0/2745198489 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7ca4110d80 con 0x7f7ca4104de0 2023-12-07T16:18:46.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.288+0000 7f7ca17fa700 1 -- 172.21.15.63:0/2745198489 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c98019090 con 0x7f7ca4104de0 2023-12-07T16:18:46.287 INFO:teuthology.orchestra.run.smithi063.stdout:163208757256 2023-12-07T16:18:46.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.290+0000 7f7cab1a4700 1 -- 172.21.15.63:0/2745198489 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f7c94068f60 msgr2=0x7f7c9406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:46.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.290+0000 7f7cab1a4700 1 --2- 172.21.15.63:0/2745198489 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f7c94068f60 0x7f7c9406b410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7c90000c00 tx=0x7f7c90009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:46.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.290+0000 7f7cab1a4700 1 -- 172.21.15.63:0/2745198489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca4104de0 msgr2=0x7f7ca41157a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:46.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.290+0000 7f7cab1a4700 1 --2- 172.21.15.63:0/2745198489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca4104de0 0x7f7ca41157a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7c9800eb40 tx=0x7f7c9800b040 comp rx=0 tx=0).stop 2023-12-07T16:18:46.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.290+0000 7f7cab1a4700 1 -- 172.21.15.63:0/2745198489 shutdown_connections 2023-12-07T16:18:46.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.290+0000 7f7cab1a4700 1 --2- 172.21.15.63:0/2745198489 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f7c94068f60 0x7f7c9406b410 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:46.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.290+0000 7f7cab1a4700 1 --2- 172.21.15.63:0/2745198489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ca4104de0 0x7f7ca41157a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:46.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.290+0000 7f7cab1a4700 1 --2- 172.21.15.63:0/2745198489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7ca4105780 0x7f7ca4115ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:46.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.290+0000 7f7cab1a4700 1 -- 172.21.15.63:0/2745198489 >> 172.21.15.63:0/2745198489 conn(0x7f7ca40fa9b0 msgr2=0x7f7ca40fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:46.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.290+0000 7f7cab1a4700 1 -- 172.21.15.63:0/2745198489 shutdown_connections 2023-12-07T16:18:46.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.290+0000 7f7cab1a4700 1 -- 172.21.15.63:0/2745198489 wait complete. 2023-12-07T16:18:46.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.347+0000 7f0cbcf43700 1 -- 172.21.15.63:0/2045641614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0cb804bb80 con 0x7f0cb8102410 2023-12-07T16:18:46.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.347+0000 7f0ca6ffd700 1 -- 172.21.15.63:0/2045641614 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0cac057e00 con 0x7f0cb8102410 2023-12-07T16:18:46.346 INFO:teuthology.orchestra.run.smithi063.stdout:60129542166 2023-12-07T16:18:46.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.349+0000 7f0cbcf43700 1 -- 172.21.15.63:0/2045641614 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f0ca0068f60 msgr2=0x7f0ca006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:46.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.350+0000 7f0cbcf43700 1 --2- 172.21.15.63:0/2045641614 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f0ca0068f60 0x7f0ca006b410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009fd0 tx=0x7f0ca800b040 comp rx=0 tx=0).stop 2023-12-07T16:18:46.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.350+0000 7f0cbcf43700 1 -- 172.21.15.63:0/2045641614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cb8102410 msgr2=0x7f0cb8113c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:46.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.350+0000 7f0cbcf43700 1 --2- 172.21.15.63:0/2045641614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cb8102410 0x7f0cb8113c00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0cac009fd0 tx=0x7f0cac009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:46.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.350+0000 7f0cbcf43700 1 -- 172.21.15.63:0/2045641614 shutdown_connections 2023-12-07T16:18:46.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.350+0000 7f0cbcf43700 1 --2- 172.21.15.63:0/2045641614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0cb8101b00 0x7f0cb8113680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:46.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.350+0000 7f0cbcf43700 1 --2- 172.21.15.63:0/2045641614 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f0ca0068f60 0x7f0ca006b410 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:46.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.350+0000 7f0cbcf43700 1 --2- 172.21.15.63:0/2045641614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cb8102410 0x7f0cb8113c00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:46.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.350+0000 7f0cbcf43700 1 -- 172.21.15.63:0/2045641614 >> 172.21.15.63:0/2045641614 conn(0x7f0cb80711a0 msgr2=0x7f0cb81060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:46.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.350+0000 7f0cbcf43700 1 -- 172.21.15.63:0/2045641614 shutdown_connections 2023-12-07T16:18:46.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:46.350+0000 7f0cbcf43700 1 -- 172.21.15.63:0/2045641614 wait complete. 2023-12-07T16:18:46.754 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:46 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2084997915' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-07T16:18:46.754 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:46 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2745198489' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-07T16:18:46.754 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:46 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2045641614' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-07T16:18:46.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:46 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/2084997915' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-07T16:18:46.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:46 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/2745198489' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-07T16:18:46.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:46 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/2045641614' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-07T16:18:47.317 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757255 got 163208757256 for osd.5 2023-12-07T16:18:47.317 DEBUG:teuthology.parallel:result is None 2023-12-07T16:18:47.452 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705689 got 38654705690 for osd.0 2023-12-07T16:18:47.452 DEBUG:teuthology.parallel:result is None 2023-12-07T16:18:47.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.732+0000 7f0c83a4d700 1 -- 172.21.15.63:0/292103513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c7c0fe580 msgr2=0x7f0c7c106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:47.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.732+0000 7f0c83a4d700 1 --2- 172.21.15.63:0/292103513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c7c0fe580 0x7f0c7c106c50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0c70004940 tx=0x7f0c70009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:47.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.732+0000 7f0c83a4d700 1 -- 172.21.15.63:0/292103513 shutdown_connections 2023-12-07T16:18:47.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.732+0000 7f0c83a4d700 1 --2- 172.21.15.63:0/292103513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c7c0fe580 0x7f0c7c106c50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:47.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.732+0000 7f0c83a4d700 1 --2- 172.21.15.63:0/292103513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c7c0fdbe0 0x7f0c7c0fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:47.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.732+0000 7f0c83a4d700 1 -- 172.21.15.63:0/292103513 >> 172.21.15.63:0/292103513 conn(0x7f0c7c0f7680 msgr2=0x7f0c7c0f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:47.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.732+0000 7f0c83a4d700 1 -- 172.21.15.63:0/292103513 shutdown_connections 2023-12-07T16:18:47.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.732+0000 7f0c83a4d700 1 -- 172.21.15.63:0/292103513 wait complete. 2023-12-07T16:18:47.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.733+0000 7f0c83a4d700 1 Processor -- start 2023-12-07T16:18:47.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.733+0000 7f0c83a4d700 1 -- start start 2023-12-07T16:18:47.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.733+0000 7f0c83a4d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c7c0fdbe0 0x7f0c7c113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:47.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.733+0000 7f0c83a4d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c7c0fe580 0x7f0c7c113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:47.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.733+0000 7f0c83a4d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c1142b0 con 0x7f0c7c0fdbe0 2023-12-07T16:18:47.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.733+0000 7f0c83a4d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c10d570 con 0x7f0c7c0fe580 2023-12-07T16:18:47.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.733+0000 7f0c817e9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c7c0fdbe0 0x7f0c7c113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:47.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.733+0000 7f0c817e9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c7c0fdbe0 0x7f0c7c113690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55414/0 (socket says 172.21.15.63:55414) 2023-12-07T16:18:47.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.733+0000 7f0c817e9700 1 -- 172.21.15.63:0/430910494 learned_addr learned my addr 172.21.15.63:0/430910494 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:47.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.733+0000 7f0c80fe8700 1 --2- 172.21.15.63:0/430910494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c7c0fe580 0x7f0c7c113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:47.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.733+0000 7f0c817e9700 1 -- 172.21.15.63:0/430910494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c7c0fe580 msgr2=0x7f0c7c113bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:47.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.733+0000 7f0c817e9700 1 --2- 172.21.15.63:0/430910494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c7c0fe580 0x7f0c7c113bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:47.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.733+0000 7f0c817e9700 1 -- 172.21.15.63:0/430910494 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c70005040 con 0x7f0c7c0fdbe0 2023-12-07T16:18:47.735 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.734+0000 7f0c817e9700 1 --2- 172.21.15.63:0/430910494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c7c0fdbe0 0x7f0c7c113690 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0c7800b790 tx=0x7f0c78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:47.735 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.734+0000 7f0c6dffb700 1 -- 172.21.15.63:0/430910494 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c7800f770 con 0x7f0c7c0fdbe0 2023-12-07T16:18:47.735 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.734+0000 7f0c6dffb700 1 -- 172.21.15.63:0/430910494 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0c7800fd80 con 0x7f0c7c0fdbe0 2023-12-07T16:18:47.735 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.734+0000 7f0c83a4d700 1 -- 172.21.15.63:0/430910494 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c7c10d850 con 0x7f0c7c0fdbe0 2023-12-07T16:18:47.735 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.734+0000 7f0c6dffb700 1 -- 172.21.15.63:0/430910494 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c7800d310 con 0x7f0c7c0fdbe0 2023-12-07T16:18:47.735 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.734+0000 7f0c83a4d700 1 -- 172.21.15.63:0/430910494 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c7c10dd90 con 0x7f0c7c0fdbe0 2023-12-07T16:18:47.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.735+0000 7f0c83a4d700 1 -- 172.21.15.63:0/430910494 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c7c1042b0 con 0x7f0c7c0fdbe0 2023-12-07T16:18:47.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.735+0000 7f0c6dffb700 1 -- 172.21.15.63:0/430910494 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f0c78010420 con 0x7f0c7c0fdbe0 2023-12-07T16:18:47.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.736+0000 7f0c6dffb700 1 --2- 172.21.15.63:0/430910494 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f0c68068f60 0x7f0c6806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:47.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.736+0000 7f0c6dffb700 1 -- 172.21.15.63:0/430910494 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0c78086920 con 0x7f0c7c0fdbe0 2023-12-07T16:18:47.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.736+0000 7f0c80fe8700 1 --2- 172.21.15.63:0/430910494 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f0c68068f60 0x7f0c6806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:47.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.736+0000 7f0c80fe8700 1 --2- 172.21.15.63:0/430910494 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f0c68068f60 0x7f0c6806b410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000b3b0 tx=0x7f0c70009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:47.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.740+0000 7f0c6dffb700 1 -- 172.21.15.63:0/430910494 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0c78056c60 con 0x7f0c7c0fdbe0 2023-12-07T16:18:47.855 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542165 got 60129542166 for osd.1 2023-12-07T16:18:47.855 DEBUG:teuthology.parallel:result is None 2023-12-07T16:18:47.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.935+0000 7f0c83a4d700 1 -- 172.21.15.63:0/430910494 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0c7c0fb280 con 0x7f0c7c0fdbe0 2023-12-07T16:18:47.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.936+0000 7f0c6dffb700 1 -- 172.21.15.63:0/430910494 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c780567f0 con 0x7f0c7c0fdbe0 2023-12-07T16:18:47.935 INFO:teuthology.orchestra.run.smithi063.stdout:111669149711 2023-12-07T16:18:47.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.938+0000 7f0c83a4d700 1 -- 172.21.15.63:0/430910494 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f0c68068f60 msgr2=0x7f0c6806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:47.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.938+0000 7f0c83a4d700 1 --2- 172.21.15.63:0/430910494 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f0c68068f60 0x7f0c6806b410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000b3b0 tx=0x7f0c70009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:47.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.938+0000 7f0c83a4d700 1 -- 172.21.15.63:0/430910494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c7c0fdbe0 msgr2=0x7f0c7c113690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:47.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.938+0000 7f0c83a4d700 1 --2- 172.21.15.63:0/430910494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c7c0fdbe0 0x7f0c7c113690 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0c7800b790 tx=0x7f0c78009250 comp rx=0 tx=0).stop 2023-12-07T16:18:47.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.938+0000 7f0c83a4d700 1 -- 172.21.15.63:0/430910494 shutdown_connections 2023-12-07T16:18:47.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.938+0000 7f0c83a4d700 1 --2- 172.21.15.63:0/430910494 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f0c68068f60 0x7f0c6806b410 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:47.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.938+0000 7f0c83a4d700 1 --2- 172.21.15.63:0/430910494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c7c0fdbe0 0x7f0c7c113690 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:47.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.938+0000 7f0c83a4d700 1 --2- 172.21.15.63:0/430910494 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c7c0fe580 0x7f0c7c113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:47.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.938+0000 7f0c83a4d700 1 -- 172.21.15.63:0/430910494 >> 172.21.15.63:0/430910494 conn(0x7f0c7c0f7680 msgr2=0x7f0c7c101430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:47.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.938+0000 7f0c83a4d700 1 -- 172.21.15.63:0/430910494 shutdown_connections 2023-12-07T16:18:47.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:47.938+0000 7f0c83a4d700 1 -- 172.21.15.63:0/430910494 wait complete. 2023-12-07T16:18:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.001+0000 7fc9ff4c3700 1 -- 172.21.15.63:0/308078772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9f8101b00 msgr2=0x7fc9f8101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.001+0000 7fc9ff4c3700 1 --2- 172.21.15.63:0/308078772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9f8101b00 0x7fc9f8101ed0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec004940 tx=0x7fc9ec009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.001+0000 7fc9ff4c3700 1 -- 172.21.15.63:0/308078772 shutdown_connections 2023-12-07T16:18:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.001+0000 7fc9ff4c3700 1 --2- 172.21.15.63:0/308078772 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9f80fbb40 0x7fc9f80fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.001+0000 7fc9ff4c3700 1 --2- 172.21.15.63:0/308078772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9f8101b00 0x7fc9f8101ed0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.001+0000 7fc9ff4c3700 1 -- 172.21.15.63:0/308078772 >> 172.21.15.63:0/308078772 conn(0x7fc9f80719b0 msgr2=0x7fc9f8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:48.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.001+0000 7fc9ff4c3700 1 -- 172.21.15.63:0/308078772 shutdown_connections 2023-12-07T16:18:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.001+0000 7fc9ff4c3700 1 -- 172.21.15.63:0/308078772 wait complete. 2023-12-07T16:18:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.002+0000 7fc9ff4c3700 1 Processor -- start 2023-12-07T16:18:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.002+0000 7fc9ff4c3700 1 -- start start 2023-12-07T16:18:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.002+0000 7fc9ff4c3700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9f80fbb40 0x7fc9f810e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.002+0000 7fc9ff4c3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9f8101b00 0x7fc9f810ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.002+0000 7fc9ff4c3700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f810f1c0 con 0x7fc9f80fbb40 2023-12-07T16:18:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.002+0000 7fc9ff4c3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f810f300 con 0x7fc9f8101b00 2023-12-07T16:18:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.002+0000 7fc9fd25f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9f80fbb40 0x7fc9f810e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.002+0000 7fc9fd25f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9f80fbb40 0x7fc9f810e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55436/0 (socket says 172.21.15.63:55436) 2023-12-07T16:18:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.002+0000 7fc9fd25f700 1 -- 172.21.15.63:0/2148522120 learned_addr learned my addr 172.21.15.63:0/2148522120 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.002+0000 7fc9fca5e700 1 --2- 172.21.15.63:0/2148522120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9f8101b00 0x7fc9f810ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:48.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.002+0000 7fc9fd25f700 1 -- 172.21.15.63:0/2148522120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9f8101b00 msgr2=0x7fc9f810ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:48.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.002+0000 7fc9fd25f700 1 --2- 172.21.15.63:0/2148522120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9f8101b00 0x7fc9f810ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:48.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.002+0000 7fc9fd25f700 1 -- 172.21.15.63:0/2148522120 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ec005040 con 0x7fc9f80fbb40 2023-12-07T16:18:48.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.002+0000 7fc9fca5e700 1 --2- 172.21.15.63:0/2148522120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9f8101b00 0x7fc9f810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T16:18:48.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.002+0000 7fc9fd25f700 1 --2- 172.21.15.63:0/2148522120 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9f80fbb40 0x7fc9f810e6f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec009360 tx=0x7fc9ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:48.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.003+0000 7fc9e9ffb700 1 -- 172.21.15.63:0/2148522120 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9ec00e040 con 0x7fc9f80fbb40 2023-12-07T16:18:48.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.003+0000 7fc9e9ffb700 1 -- 172.21.15.63:0/2148522120 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc9ec00bc50 con 0x7fc9f80fbb40 2023-12-07T16:18:48.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.003+0000 7fc9ff4c3700 1 -- 172.21.15.63:0/2148522120 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f8117600 con 0x7fc9f80fbb40 2023-12-07T16:18:48.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.003+0000 7fc9e9ffb700 1 -- 172.21.15.63:0/2148522120 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9ec01c630 con 0x7fc9f80fbb40 2023-12-07T16:18:48.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.003+0000 7fc9ff4c3700 1 -- 172.21.15.63:0/2148522120 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f8117b10 con 0x7fc9f80fbb40 2023-12-07T16:18:48.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.004+0000 7fc9ff4c3700 1 -- 172.21.15.63:0/2148522120 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f8103fb0 con 0x7fc9f80fbb40 2023-12-07T16:18:48.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.004+0000 7fc9e9ffb700 1 -- 172.21.15.63:0/2148522120 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc9ec013420 con 0x7fc9f80fbb40 2023-12-07T16:18:48.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.005+0000 7fc9e9ffb700 1 --2- 172.21.15.63:0/2148522120 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fc9e4068f70 0x7fc9e406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:48.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.005+0000 7fc9e9ffb700 1 -- 172.21.15.63:0/2148522120 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc9ec087d50 con 0x7fc9f80fbb40 2023-12-07T16:18:48.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.005+0000 7fc9fca5e700 1 --2- 172.21.15.63:0/2148522120 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fc9e4068f70 0x7fc9e406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:48.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.005+0000 7fc9fca5e700 1 --2- 172.21.15.63:0/2148522120 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fc9e4068f70 0x7fc9e406b420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8065e30 tx=0x7fc9f4009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:48.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.009+0000 7fc9e9ffb700 1 -- 172.21.15.63:0/2148522120 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc9ec054560 con 0x7fc9f80fbb40 2023-12-07T16:18:48.206 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.207+0000 7fc9ff4c3700 1 -- 172.21.15.63:0/2148522120 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc9f80734d0 con 0x7fc9f80fbb40 2023-12-07T16:18:48.206 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.207+0000 7fc9e9ffb700 1 -- 172.21.15.63:0/2148522120 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc9ec057b80 con 0x7fc9f80fbb40 2023-12-07T16:18:48.207 INFO:teuthology.orchestra.run.smithi063.stdout:81604378643 2023-12-07T16:18:48.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.210+0000 7fc9ff4c3700 1 -- 172.21.15.63:0/2148522120 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fc9e4068f70 msgr2=0x7fc9e406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:48.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.210+0000 7fc9ff4c3700 1 --2- 172.21.15.63:0/2148522120 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fc9e4068f70 0x7fc9e406b420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8065e30 tx=0x7fc9f4009040 comp rx=0 tx=0).stop 2023-12-07T16:18:48.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.210+0000 7fc9ff4c3700 1 -- 172.21.15.63:0/2148522120 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9f80fbb40 msgr2=0x7fc9f810e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:48.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.210+0000 7fc9ff4c3700 1 --2- 172.21.15.63:0/2148522120 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9f80fbb40 0x7fc9f810e6f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec009360 tx=0x7fc9ec009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:48.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.210+0000 7fc9ff4c3700 1 -- 172.21.15.63:0/2148522120 shutdown_connections 2023-12-07T16:18:48.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.210+0000 7fc9ff4c3700 1 --2- 172.21.15.63:0/2148522120 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fc9e4068f70 0x7fc9e406b420 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:48.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.210+0000 7fc9ff4c3700 1 --2- 172.21.15.63:0/2148522120 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9f80fbb40 0x7fc9f810e6f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:48.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.210+0000 7fc9ff4c3700 1 --2- 172.21.15.63:0/2148522120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9f8101b00 0x7fc9f810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:48.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.210+0000 7fc9ff4c3700 1 -- 172.21.15.63:0/2148522120 >> 172.21.15.63:0/2148522120 conn(0x7fc9f80719b0 msgr2=0x7fc9f80fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:48.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.210+0000 7fc9ff4c3700 1 -- 172.21.15.63:0/2148522120 shutdown_connections 2023-12-07T16:18:48.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:48.210+0000 7fc9ff4c3700 1 -- 172.21.15.63:0/2148522120 wait complete. 2023-12-07T16:18:48.388 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149710 got 111669149711 for osd.3 2023-12-07T16:18:48.388 DEBUG:teuthology.parallel:result is None 2023-12-07T16:18:48.503 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:48 smithi063 ceph-mon[112095]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:48.504 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:48 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/430910494' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-07T16:18:48.504 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:48 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2148522120' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-07T16:18:48.571 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378642 got 81604378643 for osd.2 2023-12-07T16:18:48.571 DEBUG:teuthology.parallel:result is None 2023-12-07T16:18:48.571 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-12-07T16:18:48.571 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph pg dump --format=json 2023-12-07T16:18:48.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:48 smithi152 ceph-mon[121113]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:48.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:48 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/430910494' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-07T16:18:48.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:48 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/2148522120' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-07T16:18:48.843 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:49.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.814+0000 7f6f950d3700 1 -- 172.21.15.63:0/3550008895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f90101b00 msgr2=0x7f6f90101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:49.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.814+0000 7f6f950d3700 1 --2- 172.21.15.63:0/3550008895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f90101b00 0x7f6f90101ed0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009ce0 tx=0x7f6f80004d10 comp rx=0 tx=0).stop 2023-12-07T16:18:49.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.814+0000 7f6f950d3700 1 -- 172.21.15.63:0/3550008895 shutdown_connections 2023-12-07T16:18:49.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.814+0000 7f6f950d3700 1 --2- 172.21.15.63:0/3550008895 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f900fbb40 0x7f6f900fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:49.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.814+0000 7f6f950d3700 1 --2- 172.21.15.63:0/3550008895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f90101b00 0x7f6f90101ed0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:49.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.814+0000 7f6f950d3700 1 -- 172.21.15.63:0/3550008895 >> 172.21.15.63:0/3550008895 conn(0x7f6f900719b0 msgr2=0x7f6f90071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:49.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.814+0000 7f6f950d3700 1 -- 172.21.15.63:0/3550008895 shutdown_connections 2023-12-07T16:18:49.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.814+0000 7f6f950d3700 1 -- 172.21.15.63:0/3550008895 wait complete. 2023-12-07T16:18:49.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.815+0000 7f6f950d3700 1 Processor -- start 2023-12-07T16:18:49.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.815+0000 7f6f950d3700 1 -- start start 2023-12-07T16:18:49.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.815+0000 7f6f950d3700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f900fbb40 0x7f6f90112660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:49.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.815+0000 7f6f950d3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f90101b00 0x7f6f90112ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:49.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.815+0000 7f6f950d3700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f901131f0 con 0x7f6f900fbb40 2023-12-07T16:18:49.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.815+0000 7f6f950d3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9010c4e0 con 0x7f6f90101b00 2023-12-07T16:18:49.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.815+0000 7f6f8ed9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f900fbb40 0x7f6f90112660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:49.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.815+0000 7f6f8ed9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f900fbb40 0x7f6f90112660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54776/0 (socket says 172.21.15.63:54776) 2023-12-07T16:18:49.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.815+0000 7f6f8ed9d700 1 -- 172.21.15.63:0/1315272812 learned_addr learned my addr 172.21.15.63:0/1315272812 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:49.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.816+0000 7f6f8e59c700 1 --2- 172.21.15.63:0/1315272812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f90101b00 0x7f6f90112ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:49.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.816+0000 7f6f8ed9d700 1 -- 172.21.15.63:0/1315272812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f90101b00 msgr2=0x7f6f90112ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:49.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.816+0000 7f6f8ed9d700 1 --2- 172.21.15.63:0/1315272812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f90101b00 0x7f6f90112ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:49.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.816+0000 7f6f8ed9d700 1 -- 172.21.15.63:0/1315272812 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f80009940 con 0x7f6f900fbb40 2023-12-07T16:18:49.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.816+0000 7f6f8ed9d700 1 --2- 172.21.15.63:0/1315272812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f900fbb40 0x7f6f90112660 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6f80003400 tx=0x7f6f80004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:49.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.816+0000 7f6f777fe700 1 -- 172.21.15.63:0/1315272812 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f8000e040 con 0x7f6f900fbb40 2023-12-07T16:18:49.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.816+0000 7f6f777fe700 1 -- 172.21.15.63:0/1315272812 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6f80008ea0 con 0x7f6f900fbb40 2023-12-07T16:18:49.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.816+0000 7f6f950d3700 1 -- 172.21.15.63:0/1315272812 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f9010c760 con 0x7f6f900fbb40 2023-12-07T16:18:49.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.816+0000 7f6f777fe700 1 -- 172.21.15.63:0/1315272812 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f8001c600 con 0x7f6f900fbb40 2023-12-07T16:18:49.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.816+0000 7f6f950d3700 1 -- 172.21.15.63:0/1315272812 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9010cca0 con 0x7f6f900fbb40 2023-12-07T16:18:49.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.817+0000 7f6f950d3700 1 -- 172.21.15.63:0/1315272812 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f90112310 con 0x7f6f900fbb40 2023-12-07T16:18:49.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.817+0000 7f6f777fe700 1 -- 172.21.15.63:0/1315272812 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f6f80012ac0 con 0x7f6f900fbb40 2023-12-07T16:18:49.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.818+0000 7f6f777fe700 1 --2- 172.21.15.63:0/1315272812 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f6f78068f60 0x7f6f7806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:49.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.818+0000 7f6f8e59c700 1 --2- 172.21.15.63:0/1315272812 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f6f78068f60 0x7f6f7806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:49.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.818+0000 7f6f777fe700 1 -- 172.21.15.63:0/1315272812 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6f800885a0 con 0x7f6f900fbb40 2023-12-07T16:18:49.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.818+0000 7f6f8e59c700 1 --2- 172.21.15.63:0/1315272812 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f6f78068f60 0x7f6f7806b410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009b80 tx=0x7f6f8400b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:49.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:49.822+0000 7f6f777fe700 1 -- 172.21.15.63:0/1315272812 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6f80058840 con 0x7f6f900fbb40 2023-12-07T16:18:50.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:50.011+0000 7f6f950d3700 1 -- 172.21.15.63:0/1315272812 --> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f9004bb80 con 0x7f6f78068f60 2023-12-07T16:18:50.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:50.012+0000 7f6f777fe700 1 -- 172.21.15.63:0/1315272812 <== mgr.14212 v2:172.21.15.63:6800/184283085 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+22799 (secure 0 0 0) 0x7f6f9004bb80 con 0x7f6f78068f60 2023-12-07T16:18:50.011 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:18:50.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:50.014+0000 7f6f950d3700 1 -- 172.21.15.63:0/1315272812 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f6f78068f60 msgr2=0x7f6f7806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:50.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:50.014+0000 7f6f950d3700 1 --2- 172.21.15.63:0/1315272812 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f6f78068f60 0x7f6f7806b410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009b80 tx=0x7f6f8400b040 comp rx=0 tx=0).stop 2023-12-07T16:18:50.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:50.014+0000 7f6f950d3700 1 -- 172.21.15.63:0/1315272812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f900fbb40 msgr2=0x7f6f90112660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:50.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:50.014+0000 7f6f950d3700 1 --2- 172.21.15.63:0/1315272812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f900fbb40 0x7f6f90112660 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6f80003400 tx=0x7f6f80004d10 comp rx=0 tx=0).stop 2023-12-07T16:18:50.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:50.014+0000 7f6f950d3700 1 -- 172.21.15.63:0/1315272812 shutdown_connections 2023-12-07T16:18:50.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:50.014+0000 7f6f950d3700 1 --2- 172.21.15.63:0/1315272812 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f6f78068f60 0x7f6f7806b410 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:50.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:50.014+0000 7f6f950d3700 1 --2- 172.21.15.63:0/1315272812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f900fbb40 0x7f6f90112660 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:50.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:50.014+0000 7f6f950d3700 1 --2- 172.21.15.63:0/1315272812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f90101b00 0x7f6f90112ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:50.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:50.014+0000 7f6f950d3700 1 -- 172.21.15.63:0/1315272812 >> 172.21.15.63:0/1315272812 conn(0x7f6f900719b0 msgr2=0x7f6f900faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:50.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:50.014+0000 7f6f950d3700 1 -- 172.21.15.63:0/1315272812 shutdown_connections 2023-12-07T16:18:50.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:50.014+0000 7f6f950d3700 1 -- 172.21.15.63:0/1315272812 wait complete. 2023-12-07T16:18:50.014 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-07T16:18:50.378 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2023-12-07T16:18:49.276149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787556,"kb_used_data":3828,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683356,"statfs":{"total":575970213888,"available":574139756544,"internally_reserved":0,"allocated":3919872,"data_stored":2582244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002162"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":189,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-07T16:18:22.510167+0000","last_change":"2023-12-07T16:18:04.380391+0000","last_active":"2023-12-07T16:18:22.510167+0000","last_peered":"2023-12-07T16:18:22.510167+0000","last_clean":"2023-12-07T16:18:22.510167+0000","last_became_active":"2023-12-07T16:18:04.380089+0000","last_became_peered":"2023-12-07T16:18:04.380089+0000","last_unstale":"2023-12-07T16:18:22.510167+0000","last_undegraded":"2023-12-07T16:18:22.510167+0000","last_fullsized":"2023-12-07T16:18:22.510167+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T16:17:29.747134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T16:17:29.747134+0000","last_clean_scrub_stamp":"2023-12-07T16:17:29.747134+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:57:03.366900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447516,"statfs":{"total":95995035648,"available":95690256384,"internally_reserved":0,"allocated":356352,"data_stored":135190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]}]},{"osd":4,"up_from":33,"seq":141733920779,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447516,"statfs":{"total":95995035648,"available":95690256384,"internally_reserved":0,"allocated":356352,"data_stored":135190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149711,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298216,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446936,"statfs":{"total":95995035648,"available":95689662464,"internally_reserved":0,"allocated":950272,"data_stored":725558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378644,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447516,"statfs":{"total":95995035648,"available":95690256384,"internally_reserved":0,"allocated":356352,"data_stored":135190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 16:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Dec 7 16:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.248},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.27400000000000002}]},{"osd":3,"last update":"Thu Dec 7 16:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.56699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298216,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446936,"statfs":{"total":95995035648,"available":95689662464,"internally_reserved":0,"allocated":950272,"data_stored":725558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 16:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Dec 7 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.318}]},{"osd":3,"last update":"Thu Dec 7 16:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.6339999999999999,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298216,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446936,"statfs":{"total":95995035648,"available":95689662464,"internally_reserved":0,"allocated":950272,"data_stored":725558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 16:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.318}]},{"osd":2,"last update":"Thu Dec 7 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T16:18:50.379 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph pg dump --format=json 2023-12-07T16:18:50.651 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:50.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:50 smithi063 ceph-mon[112095]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:50.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:50 smithi152 ceph-mon[121113]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:51.517 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:51 smithi063 ceph-mon[112095]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T16:18:51.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.694+0000 7fa52e332700 1 -- 172.21.15.63:0/1830160082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5280fdc60 msgr2=0x7fa5280fe030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:51.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.694+0000 7fa52e332700 1 --2- 172.21.15.63:0/1830160082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5280fdc60 0x7fa5280fe030 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa518004940 tx=0x7fa518009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:51.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.694+0000 7fa52e332700 1 -- 172.21.15.63:0/1830160082 shutdown_connections 2023-12-07T16:18:51.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.694+0000 7fa52e332700 1 --2- 172.21.15.63:0/1830160082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5280fe600 0x7fa528106c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:51.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.694+0000 7fa52e332700 1 --2- 172.21.15.63:0/1830160082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5280fdc60 0x7fa5280fe030 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:51.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.694+0000 7fa52e332700 1 -- 172.21.15.63:0/1830160082 >> 172.21.15.63:0/1830160082 conn(0x7fa5280f7690 msgr2=0x7fa5280f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:51.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.694+0000 7fa52e332700 1 -- 172.21.15.63:0/1830160082 shutdown_connections 2023-12-07T16:18:51.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.694+0000 7fa52e332700 1 -- 172.21.15.63:0/1830160082 wait complete. 2023-12-07T16:18:51.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.694+0000 7fa52e332700 1 Processor -- start 2023-12-07T16:18:51.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.694+0000 7fa52e332700 1 -- start start 2023-12-07T16:18:51.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.695+0000 7fa52e332700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5280fdc60 0x7fa528113670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:51.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.695+0000 7fa52e332700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5280fe600 0x7fa528113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:51.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.695+0000 7fa52e332700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa528114240 con 0x7fa5280fe600 2023-12-07T16:18:51.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.695+0000 7fa52e332700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52810d530 con 0x7fa5280fdc60 2023-12-07T16:18:51.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.695+0000 7fa5277fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5280fe600 0x7fa528113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:51.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.695+0000 7fa5277fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5280fe600 0x7fa528113bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54788/0 (socket says 172.21.15.63:54788) 2023-12-07T16:18:51.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.695+0000 7fa5277fe700 1 -- 172.21.15.63:0/2349387064 learned_addr learned my addr 172.21.15.63:0/2349387064 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:51.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.695+0000 7fa527fff700 1 --2- 172.21.15.63:0/2349387064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5280fdc60 0x7fa528113670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:51.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.695+0000 7fa5277fe700 1 -- 172.21.15.63:0/2349387064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5280fdc60 msgr2=0x7fa528113670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:51.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.695+0000 7fa5277fe700 1 --2- 172.21.15.63:0/2349387064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5280fdc60 0x7fa528113670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:51.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.695+0000 7fa5277fe700 1 -- 172.21.15.63:0/2349387064 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa518005040 con 0x7fa5280fe600 2023-12-07T16:18:51.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.695+0000 7fa5277fe700 1 --2- 172.21.15.63:0/2349387064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5280fe600 0x7fa528113bf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00c8c0 tx=0x7fa51c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:51.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.695+0000 7fa524ff9700 1 -- 172.21.15.63:0/2349387064 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa51c00a760 con 0x7fa5280fe600 2023-12-07T16:18:51.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.695+0000 7fa52e332700 1 -- 172.21.15.63:0/2349387064 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa52810d7c0 con 0x7fa5280fe600 2023-12-07T16:18:51.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.695+0000 7fa524ff9700 1 -- 172.21.15.63:0/2349387064 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa51c00ad70 con 0x7fa5280fe600 2023-12-07T16:18:51.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.695+0000 7fa524ff9700 1 -- 172.21.15.63:0/2349387064 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa51c0113a0 con 0x7fa5280fe600 2023-12-07T16:18:51.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.696+0000 7fa52e332700 1 -- 172.21.15.63:0/2349387064 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa52810dd00 con 0x7fa5280fe600 2023-12-07T16:18:51.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.696+0000 7fa52e332700 1 -- 172.21.15.63:0/2349387064 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa528104250 con 0x7fa5280fe600 2023-12-07T16:18:51.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.697+0000 7fa524ff9700 1 -- 172.21.15.63:0/2349387064 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fa51c012400 con 0x7fa5280fe600 2023-12-07T16:18:51.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.697+0000 7fa524ff9700 1 --2- 172.21.15.63:0/2349387064 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fa510068f60 0x7fa51006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:51.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.697+0000 7fa524ff9700 1 -- 172.21.15.63:0/2349387064 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa51c086b90 con 0x7fa5280fe600 2023-12-07T16:18:51.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.697+0000 7fa527fff700 1 --2- 172.21.15.63:0/2349387064 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fa510068f60 0x7fa51006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:51.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.698+0000 7fa527fff700 1 --2- 172.21.15.63:0/2349387064 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fa510068f60 0x7fa51006b410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa518009fd0 tx=0x7fa518009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:51.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.702+0000 7fa524ff9700 1 -- 172.21.15.63:0/2349387064 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa51c056d90 con 0x7fa5280fe600 2023-12-07T16:18:51.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:51 smithi152 ceph-mon[121113]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T16:18:51.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.891+0000 7fa52e332700 1 -- 172.21.15.63:0/2349387064 --> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa52804bb80 con 0x7fa510068f60 2023-12-07T16:18:51.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.893+0000 7fa524ff9700 1 -- 172.21.15.63:0/2349387064 <== mgr.14212 v2:172.21.15.63:6800/184283085 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24652 (secure 0 0 0) 0x7fa52804bb80 con 0x7fa510068f60 2023-12-07T16:18:51.892 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:18:51.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.895+0000 7fa52e332700 1 -- 172.21.15.63:0/2349387064 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fa510068f60 msgr2=0x7fa51006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:51.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.895+0000 7fa52e332700 1 --2- 172.21.15.63:0/2349387064 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fa510068f60 0x7fa51006b410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa518009fd0 tx=0x7fa518009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:51.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.895+0000 7fa52e332700 1 -- 172.21.15.63:0/2349387064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5280fe600 msgr2=0x7fa528113bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:51.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.895+0000 7fa52e332700 1 --2- 172.21.15.63:0/2349387064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5280fe600 0x7fa528113bf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00c8c0 tx=0x7fa51c0044c0 comp rx=0 tx=0).stop 2023-12-07T16:18:51.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.895+0000 7fa52e332700 1 -- 172.21.15.63:0/2349387064 shutdown_connections 2023-12-07T16:18:51.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.895+0000 7fa52e332700 1 --2- 172.21.15.63:0/2349387064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa5280fdc60 0x7fa528113670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:51.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.895+0000 7fa52e332700 1 --2- 172.21.15.63:0/2349387064 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fa510068f60 0x7fa51006b410 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:51.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.895+0000 7fa52e332700 1 --2- 172.21.15.63:0/2349387064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5280fe600 0x7fa528113bf0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:51.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.895+0000 7fa52e332700 1 -- 172.21.15.63:0/2349387064 >> 172.21.15.63:0/2349387064 conn(0x7fa5280f7690 msgr2=0x7fa5281013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:51.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.895+0000 7fa52e332700 1 -- 172.21.15.63:0/2349387064 shutdown_connections 2023-12-07T16:18:51.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:51.895+0000 7fa52e332700 1 -- 172.21.15.63:0/2349387064 wait complete. 2023-12-07T16:18:51.895 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-07T16:18:52.215 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2023-12-07T16:18:51.276619+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787556,"kb_used_data":3828,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683356,"statfs":{"total":575970213888,"available":574139756544,"internally_reserved":0,"allocated":3919872,"data_stored":2582244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002296"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":189,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-07T16:18:22.510167+0000","last_change":"2023-12-07T16:18:04.380391+0000","last_active":"2023-12-07T16:18:22.510167+0000","last_peered":"2023-12-07T16:18:22.510167+0000","last_clean":"2023-12-07T16:18:22.510167+0000","last_became_active":"2023-12-07T16:18:04.380089+0000","last_became_peered":"2023-12-07T16:18:04.380089+0000","last_unstale":"2023-12-07T16:18:22.510167+0000","last_undegraded":"2023-12-07T16:18:22.510167+0000","last_fullsized":"2023-12-07T16:18:22.510167+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T16:17:29.747134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T16:17:29.747134+0000","last_clean_scrub_stamp":"2023-12-07T16:17:29.747134+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:57:03.366900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447516,"statfs":{"total":95995035648,"available":95690256384,"internally_reserved":0,"allocated":356352,"data_stored":135190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]}]},{"osd":4,"up_from":33,"seq":141733920780,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447516,"statfs":{"total":95995035648,"available":95690256384,"internally_reserved":0,"allocated":356352,"data_stored":135190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":3,"up_from":26,"seq":111669149712,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298216,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446936,"statfs":{"total":95995035648,"available":95689662464,"internally_reserved":0,"allocated":950272,"data_stored":725558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 16:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Dec 7 16:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Dec 7 16:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.38},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]}]},{"osd":2,"up_from":19,"seq":81604378644,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447516,"statfs":{"total":95995035648,"available":95690256384,"internally_reserved":0,"allocated":356352,"data_stored":135190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 16:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Dec 7 16:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.248},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.27400000000000002}]},{"osd":3,"last update":"Thu Dec 7 16:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.56699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298216,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446936,"statfs":{"total":95995035648,"available":95689662464,"internally_reserved":0,"allocated":950272,"data_stored":725558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 16:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Dec 7 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.318}]},{"osd":3,"last update":"Thu Dec 7 16:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.6339999999999999,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298216,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446936,"statfs":{"total":95995035648,"available":95689662464,"internally_reserved":0,"allocated":950272,"data_stored":725558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 16:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.29999999999999999}]},{"osd":2,"last update":"Thu Dec 7 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.316},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Dec 7 16:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T16:18:52.216 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-12-07T16:18:52.216 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-07T16:18:52.216 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-12-07T16:18:52.216 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph health --format=json 2023-12-07T16:18:52.489 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:52.615 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:52 smithi063 ceph-mon[112095]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:52.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:52 smithi152 ceph-mon[121113]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:53.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.551+0000 7fba79ff4700 1 -- 172.21.15.63:0/1323758322 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba74101b00 msgr2=0x7fba74101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:53.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.551+0000 7fba79ff4700 1 --2- 172.21.15.63:0/1323758322 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba74101b00 0x7fba74101ed0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fba64004940 tx=0x7fba64009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:53.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.551+0000 7fba79ff4700 1 -- 172.21.15.63:0/1323758322 shutdown_connections 2023-12-07T16:18:53.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.551+0000 7fba79ff4700 1 --2- 172.21.15.63:0/1323758322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba740fbb40 0x7fba740fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:53.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.551+0000 7fba79ff4700 1 --2- 172.21.15.63:0/1323758322 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba74101b00 0x7fba74101ed0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:53.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.551+0000 7fba79ff4700 1 -- 172.21.15.63:0/1323758322 >> 172.21.15.63:0/1323758322 conn(0x7fba740719b0 msgr2=0x7fba74071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:53.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.551+0000 7fba79ff4700 1 -- 172.21.15.63:0/1323758322 shutdown_connections 2023-12-07T16:18:53.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.551+0000 7fba79ff4700 1 -- 172.21.15.63:0/1323758322 wait complete. 2023-12-07T16:18:53.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.552+0000 7fba79ff4700 1 Processor -- start 2023-12-07T16:18:53.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.552+0000 7fba79ff4700 1 -- start start 2023-12-07T16:18:53.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.552+0000 7fba79ff4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba740fbb40 0x7fba74112550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:53.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.552+0000 7fba79ff4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba74101b00 0x7fba74112a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:53.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.552+0000 7fba79ff4700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba741130e0 con 0x7fba74101b00 2023-12-07T16:18:53.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.552+0000 7fba79ff4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7410c410 con 0x7fba740fbb40 2023-12-07T16:18:53.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.552+0000 7fba72ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba74101b00 0x7fba74112a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:53.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.552+0000 7fba72ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba74101b00 0x7fba74112a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54806/0 (socket says 172.21.15.63:54806) 2023-12-07T16:18:53.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.552+0000 7fba72ffd700 1 -- 172.21.15.63:0/4062944353 learned_addr learned my addr 172.21.15.63:0/4062944353 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:53.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.552+0000 7fba737fe700 1 --2- 172.21.15.63:0/4062944353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba740fbb40 0x7fba74112550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:53.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.553+0000 7fba72ffd700 1 -- 172.21.15.63:0/4062944353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba740fbb40 msgr2=0x7fba74112550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:53.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.553+0000 7fba72ffd700 1 --2- 172.21.15.63:0/4062944353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba740fbb40 0x7fba74112550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:53.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.553+0000 7fba72ffd700 1 -- 172.21.15.63:0/4062944353 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba64005040 con 0x7fba74101b00 2023-12-07T16:18:53.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.553+0000 7fba72ffd700 1 --2- 172.21.15.63:0/4062944353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba74101b00 0x7fba74112a90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fba5c002a50 tx=0x7fba5c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:53.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.553+0000 7fba6bfff700 1 -- 172.21.15.63:0/4062944353 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba5c007cc0 con 0x7fba74101b00 2023-12-07T16:18:53.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.553+0000 7fba6bfff700 1 -- 172.21.15.63:0/4062944353 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fba5c00f040 con 0x7fba74101b00 2023-12-07T16:18:53.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.553+0000 7fba79ff4700 1 -- 172.21.15.63:0/4062944353 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7410c6f0 con 0x7fba74101b00 2023-12-07T16:18:53.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.553+0000 7fba6bfff700 1 -- 172.21.15.63:0/4062944353 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba5c00d9c0 con 0x7fba74101b00 2023-12-07T16:18:53.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.553+0000 7fba79ff4700 1 -- 172.21.15.63:0/4062944353 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7410cc30 con 0x7fba74101b00 2023-12-07T16:18:53.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.554+0000 7fba79ff4700 1 -- 172.21.15.63:0/4062944353 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba74103fb0 con 0x7fba74101b00 2023-12-07T16:18:53.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.554+0000 7fba6bfff700 1 -- 172.21.15.63:0/4062944353 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fba5c00db20 con 0x7fba74101b00 2023-12-07T16:18:53.557 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.555+0000 7fba6bfff700 1 --2- 172.21.15.63:0/4062944353 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fba60069040 0x7fba6006b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:53.557 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.555+0000 7fba6bfff700 1 -- 172.21.15.63:0/4062944353 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fba5c086740 con 0x7fba74101b00 2023-12-07T16:18:53.557 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.555+0000 7fba737fe700 1 --2- 172.21.15.63:0/4062944353 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fba60069040 0x7fba6006b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:53.557 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.555+0000 7fba737fe700 1 --2- 172.21.15.63:0/4062944353 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fba60069040 0x7fba6006b4f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fba6400b3b0 tx=0x7fba64009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:53.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.559+0000 7fba6bfff700 1 -- 172.21.15.63:0/4062944353 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fba5c056940 con 0x7fba74101b00 2023-12-07T16:18:53.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:53 smithi063 ceph-mon[112095]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T16:18:53.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:53 smithi152 ceph-mon[121113]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T16:18:53.792 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.793+0000 7fba79ff4700 1 -- 172.21.15.63:0/4062944353 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fba7404bb80 con 0x7fba74101b00 2023-12-07T16:18:53.792 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.794+0000 7fba6bfff700 1 -- 172.21.15.63:0/4062944353 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fba5c0564d0 con 0x7fba74101b00 2023-12-07T16:18:53.792 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:18:53.793 INFO:teuthology.orchestra.run.smithi063.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-07T16:18:53.794 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.795+0000 7fba79ff4700 1 -- 172.21.15.63:0/4062944353 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fba60069040 msgr2=0x7fba6006b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:53.794 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.795+0000 7fba79ff4700 1 --2- 172.21.15.63:0/4062944353 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fba60069040 0x7fba6006b4f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fba6400b3b0 tx=0x7fba64009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:53.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.795+0000 7fba79ff4700 1 -- 172.21.15.63:0/4062944353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba74101b00 msgr2=0x7fba74112a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:53.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.795+0000 7fba79ff4700 1 --2- 172.21.15.63:0/4062944353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba74101b00 0x7fba74112a90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fba5c002a50 tx=0x7fba5c0046b0 comp rx=0 tx=0).stop 2023-12-07T16:18:53.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.795+0000 7fba79ff4700 1 -- 172.21.15.63:0/4062944353 shutdown_connections 2023-12-07T16:18:53.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.795+0000 7fba79ff4700 1 --2- 172.21.15.63:0/4062944353 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba740fbb40 0x7fba74112550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:53.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.795+0000 7fba79ff4700 1 --2- 172.21.15.63:0/4062944353 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fba60069040 0x7fba6006b4f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:53.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.795+0000 7fba79ff4700 1 --2- 172.21.15.63:0/4062944353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba74101b00 0x7fba74112a90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:53.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.795+0000 7fba79ff4700 1 -- 172.21.15.63:0/4062944353 >> 172.21.15.63:0/4062944353 conn(0x7fba740719b0 msgr2=0x7fba740fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:53.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.796+0000 7fba79ff4700 1 -- 172.21.15.63:0/4062944353 shutdown_connections 2023-12-07T16:18:53.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:53.796+0000 7fba79ff4700 1 -- 172.21.15.63:0/4062944353 wait complete. 2023-12-07T16:18:54.153 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-12-07T16:18:54.154 INFO:tasks.cephadm:Setup complete, yielding 2023-12-07T16:18:54.154 INFO:teuthology.run_tasks:Running task print... 2023-12-07T16:18:54.166 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2023-12-07T16:18:54.166 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-07T16:18:54.185 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi063.front.sepia.ceph.com 2023-12-07T16:18:54.186 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2023-12-07T16:18:54.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:54 smithi063 ceph-mon[112095]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:54.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:54 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/4062944353' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-07T16:18:54.457 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:54.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:54 smithi152 ceph-mon[121113]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:54.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:54 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/4062944353' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-07T16:18:55.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.482+0000 7f73fc3fa700 1 -- 172.21.15.63:0/3746726053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73f4100050 msgr2=0x7f73f4102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:55.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.482+0000 7f73fc3fa700 1 --2- 172.21.15.63:0/3746726053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73f4100050 0x7f73f4102430 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f73f0004940 tx=0x7f73f0009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:55.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.482+0000 7f73fc3fa700 1 -- 172.21.15.63:0/3746726053 shutdown_connections 2023-12-07T16:18:55.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.482+0000 7f73fc3fa700 1 --2- 172.21.15.63:0/3746726053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73f4100050 0x7f73f4102430 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:55.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.482+0000 7f73fc3fa700 1 --2- 172.21.15.63:0/3746726053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73f40fd730 0x7f73f40ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:55.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.482+0000 7f73fc3fa700 1 -- 172.21.15.63:0/3746726053 >> 172.21.15.63:0/3746726053 conn(0x7f73f40f71b0 msgr2=0x7f73f40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:55.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.482+0000 7f73fc3fa700 1 -- 172.21.15.63:0/3746726053 shutdown_connections 2023-12-07T16:18:55.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.482+0000 7f73fc3fa700 1 -- 172.21.15.63:0/3746726053 wait complete. 2023-12-07T16:18:55.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.483+0000 7f73fc3fa700 1 Processor -- start 2023-12-07T16:18:55.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.483+0000 7f73fc3fa700 1 -- start start 2023-12-07T16:18:55.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.483+0000 7f73fc3fa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73f40fd730 0x7f73f410d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:55.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.483+0000 7f73fc3fa700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73f4100050 0x7f73f410d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:55.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.483+0000 7f73fc3fa700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f410dfd0 con 0x7f73f4100050 2023-12-07T16:18:55.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.483+0000 7f73fc3fa700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f410e870 con 0x7f73f40fd730 2023-12-07T16:18:55.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.483+0000 7f73f9995700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73f4100050 0x7f73f410d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:55.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.483+0000 7f73f9995700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73f4100050 0x7f73f410d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54818/0 (socket says 172.21.15.63:54818) 2023-12-07T16:18:55.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.483+0000 7f73f9995700 1 -- 172.21.15.63:0/877778711 learned_addr learned my addr 172.21.15.63:0/877778711 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:55.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.483+0000 7f73fa196700 1 --2- 172.21.15.63:0/877778711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73f40fd730 0x7f73f410d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:55.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.483+0000 7f73f9995700 1 -- 172.21.15.63:0/877778711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73f40fd730 msgr2=0x7f73f410d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:55.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.483+0000 7f73f9995700 1 --2- 172.21.15.63:0/877778711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73f40fd730 0x7f73f410d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:55.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.483+0000 7f73f9995700 1 -- 172.21.15.63:0/877778711 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f0005040 con 0x7f73f4100050 2023-12-07T16:18:55.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.483+0000 7f73fa196700 1 --2- 172.21.15.63:0/877778711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73f40fd730 0x7f73f410d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T16:18:55.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.483+0000 7f73f9995700 1 --2- 172.21.15.63:0/877778711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73f4100050 0x7f73f410d9d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009380 tx=0x7f73f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:55.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.483+0000 7f73eaffd700 1 -- 172.21.15.63:0/877778711 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73f000e040 con 0x7f73f4100050 2023-12-07T16:18:55.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.484+0000 7f73eaffd700 1 -- 172.21.15.63:0/877778711 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f73f000bda0 con 0x7f73f4100050 2023-12-07T16:18:55.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.484+0000 7f73fc3fa700 1 -- 172.21.15.63:0/877778711 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f410eaf0 con 0x7f73f4100050 2023-12-07T16:18:55.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.484+0000 7f73eaffd700 1 -- 172.21.15.63:0/877778711 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73f001c630 con 0x7f73f4100050 2023-12-07T16:18:55.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.484+0000 7f73fc3fa700 1 -- 172.21.15.63:0/877778711 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f410f030 con 0x7f73f4100050 2023-12-07T16:18:55.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.485+0000 7f73fc3fa700 1 -- 172.21.15.63:0/877778711 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f404bb80 con 0x7f73f4100050 2023-12-07T16:18:55.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.485+0000 7f73eaffd700 1 -- 172.21.15.63:0/877778711 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f73f00139d0 con 0x7f73f4100050 2023-12-07T16:18:55.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.485+0000 7f73eaffd700 1 --2- 172.21.15.63:0/877778711 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f73e0068f60 0x7f73e006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:55.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.486+0000 7f73fa196700 1 --2- 172.21.15.63:0/877778711 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f73e0068f60 0x7f73e006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:55.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.486+0000 7f73eaffd700 1 -- 172.21.15.63:0/877778711 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f73f0087df0 con 0x7f73f4100050 2023-12-07T16:18:55.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.486+0000 7f73fa196700 1 --2- 172.21.15.63:0/877778711 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f73e0068f60 0x7f73e006b410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f73e4009b80 tx=0x7f73e400b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:55.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.490+0000 7f73eaffd700 1 -- 172.21.15.63:0/877778711 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f73f0058130 con 0x7f73f4100050 2023-12-07T16:18:55.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:55 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:18:55.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.682+0000 7f73fc3fa700 1 -- 172.21.15.63:0/877778711 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f73f4105580 con 0x7f73f4100050 2023-12-07T16:18:55.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.686+0000 7f73eaffd700 1 -- 172.21.15.63:0/877778711 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f73f0057cc0 con 0x7f73f4100050 2023-12-07T16:18:55.688 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.689+0000 7f73fc3fa700 1 -- 172.21.15.63:0/877778711 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f73e0068f60 msgr2=0x7f73e006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:55.688 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.689+0000 7f73fc3fa700 1 --2- 172.21.15.63:0/877778711 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f73e0068f60 0x7f73e006b410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f73e4009b80 tx=0x7f73e400b040 comp rx=0 tx=0).stop 2023-12-07T16:18:55.688 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.689+0000 7f73fc3fa700 1 -- 172.21.15.63:0/877778711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73f4100050 msgr2=0x7f73f410d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:55.688 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.689+0000 7f73fc3fa700 1 --2- 172.21.15.63:0/877778711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73f4100050 0x7f73f410d9d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009380 tx=0x7f73f0009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:55.688 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.689+0000 7f73fc3fa700 1 -- 172.21.15.63:0/877778711 shutdown_connections 2023-12-07T16:18:55.688 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.689+0000 7f73fc3fa700 1 --2- 172.21.15.63:0/877778711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f73f40fd730 0x7f73f410d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:55.688 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.689+0000 7f73fc3fa700 1 --2- 172.21.15.63:0/877778711 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f73e0068f60 0x7f73e006b410 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:55.688 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.689+0000 7f73fc3fa700 1 --2- 172.21.15.63:0/877778711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73f4100050 0x7f73f410d9d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:55.688 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.689+0000 7f73fc3fa700 1 -- 172.21.15.63:0/877778711 >> 172.21.15.63:0/877778711 conn(0x7f73f40f71b0 msgr2=0x7f73f40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:55.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.689+0000 7f73fc3fa700 1 -- 172.21.15.63:0/877778711 shutdown_connections 2023-12-07T16:18:55.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:55.689+0000 7f73fc3fa700 1 -- 172.21.15.63:0/877778711 wait complete. 2023-12-07T16:18:55.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:55 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:18:56.036 INFO:teuthology.run_tasks:Running task print... 2023-12-07T16:18:56.047 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2023-12-07T16:18:56.047 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-07T16:18:56.058 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi063.front.sepia.ceph.com 2023-12-07T16:18:56.058 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- bash -c 'ceph orch status' 2023-12-07T16:18:56.330 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:56.600 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:56 smithi063 ceph-mon[112095]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:56.600 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:56 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/877778711' entity='client.admin' 2023-12-07T16:18:56.601 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:56 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:18:56.601 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:56 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:18:56.601 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:56 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:18:56.601 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:56 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:56.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:56 smithi152 ceph-mon[121113]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:56.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:56 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/877778711' entity='client.admin' 2023-12-07T16:18:56.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:56 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:18:56.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:56 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:18:56.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:56 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:18:56.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:56 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:18:57.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.295+0000 7f84d62e3700 1 -- 172.21.15.63:0/654069090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84d00fbaf0 msgr2=0x7f84d00fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:57.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.295+0000 7f84d62e3700 1 --2- 172.21.15.63:0/654069090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84d00fbaf0 0x7f84d00fbf00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f84c0004940 tx=0x7f84c0009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:57.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.295+0000 7f84d62e3700 1 -- 172.21.15.63:0/654069090 shutdown_connections 2023-12-07T16:18:57.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.295+0000 7f84d62e3700 1 --2- 172.21.15.63:0/654069090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84d00fcd00 0x7f84d00fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:57.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.295+0000 7f84d62e3700 1 --2- 172.21.15.63:0/654069090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84d00fbaf0 0x7f84d00fbf00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:57.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.295+0000 7f84d62e3700 1 -- 172.21.15.63:0/654069090 >> 172.21.15.63:0/654069090 conn(0x7f84d00f7190 msgr2=0x7f84d00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:57.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.295+0000 7f84d62e3700 1 -- 172.21.15.63:0/654069090 shutdown_connections 2023-12-07T16:18:57.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.295+0000 7f84d62e3700 1 -- 172.21.15.63:0/654069090 wait complete. 2023-12-07T16:18:57.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.296+0000 7f84d62e3700 1 Processor -- start 2023-12-07T16:18:57.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.296+0000 7f84d62e3700 1 -- start start 2023-12-07T16:18:57.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.296+0000 7f84d62e3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84d00fbaf0 0x7f84d010c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:57.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.296+0000 7f84d62e3700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84d00fcd00 0x7f84d010c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:57.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.296+0000 7f84d62e3700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d010cfc0 con 0x7f84d00fcd00 2023-12-07T16:18:57.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.296+0000 7f84d62e3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d010d860 con 0x7f84d00fbaf0 2023-12-07T16:18:57.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.296+0000 7f84cf7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84d00fcd00 0x7f84d010c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:57.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.296+0000 7f84cf7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84d00fcd00 0x7f84d010c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54824/0 (socket says 172.21.15.63:54824) 2023-12-07T16:18:57.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.296+0000 7f84cf7fe700 1 -- 172.21.15.63:0/1951606673 learned_addr learned my addr 172.21.15.63:0/1951606673 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:57.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.296+0000 7f84cffff700 1 --2- 172.21.15.63:0/1951606673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84d00fbaf0 0x7f84d010c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:57.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.296+0000 7f84cf7fe700 1 -- 172.21.15.63:0/1951606673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84d00fbaf0 msgr2=0x7f84d010c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:57.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.296+0000 7f84cf7fe700 1 --2- 172.21.15.63:0/1951606673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84d00fbaf0 0x7f84d010c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:57.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.296+0000 7f84cf7fe700 1 -- 172.21.15.63:0/1951606673 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c0005040 con 0x7f84d00fcd00 2023-12-07T16:18:57.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.296+0000 7f84cffff700 1 --2- 172.21.15.63:0/1951606673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84d00fbaf0 0x7f84d010c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T16:18:57.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.297+0000 7f84cf7fe700 1 --2- 172.21.15.63:0/1951606673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84d00fcd00 0x7f84d010c9c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f84c400c830 tx=0x7f84c4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:57.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.297+0000 7f84ccff9700 1 -- 172.21.15.63:0/1951606673 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84c400a760 con 0x7f84d00fcd00 2023-12-07T16:18:57.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.297+0000 7f84d62e3700 1 -- 172.21.15.63:0/1951606673 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d010db40 con 0x7f84d00fcd00 2023-12-07T16:18:57.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.297+0000 7f84ccff9700 1 -- 172.21.15.63:0/1951606673 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f84c400ad70 con 0x7f84d00fcd00 2023-12-07T16:18:57.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.297+0000 7f84ccff9700 1 -- 172.21.15.63:0/1951606673 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84c40113a0 con 0x7f84d00fcd00 2023-12-07T16:18:57.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.297+0000 7f84d62e3700 1 -- 172.21.15.63:0/1951606673 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d010e080 con 0x7f84d00fcd00 2023-12-07T16:18:57.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.298+0000 7f84d62e3700 1 -- 172.21.15.63:0/1951606673 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d004bb80 con 0x7f84d00fcd00 2023-12-07T16:18:57.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.298+0000 7f84ccff9700 1 -- 172.21.15.63:0/1951606673 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f84c4012400 con 0x7f84d00fcd00 2023-12-07T16:18:57.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.299+0000 7f84ccff9700 1 --2- 172.21.15.63:0/1951606673 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f84b8068f70 0x7f84b806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:57.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.299+0000 7f84ccff9700 1 -- 172.21.15.63:0/1951606673 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f84c4086b10 con 0x7f84d00fcd00 2023-12-07T16:18:57.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.299+0000 7f84cffff700 1 --2- 172.21.15.63:0/1951606673 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f84b8068f70 0x7f84b806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:57.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.299+0000 7f84cffff700 1 --2- 172.21.15.63:0/1951606673 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f84b8068f70 0x7f84b806b420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f84c000b3b0 tx=0x7f84c0009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:57.302 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.303+0000 7f84ccff9700 1 -- 172.21.15.63:0/1951606673 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f84c4056d50 con 0x7f84d00fcd00 2023-12-07T16:18:57.508 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.509+0000 7f84d62e3700 1 -- 172.21.15.63:0/1951606673 --> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f84d010e500 con 0x7f84b8068f70 2023-12-07T16:18:57.509 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.510+0000 7f84ccff9700 1 -- 172.21.15.63:0/1951606673 <== mgr.14212 v2:172.21.15.63:6800/184283085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f84d010e500 con 0x7f84b8068f70 2023-12-07T16:18:57.509 INFO:teuthology.orchestra.run.smithi063.stdout:Backend: cephadm 2023-12-07T16:18:57.509 INFO:teuthology.orchestra.run.smithi063.stdout:Available: Yes 2023-12-07T16:18:57.509 INFO:teuthology.orchestra.run.smithi063.stdout:Paused: No 2023-12-07T16:18:57.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.512+0000 7f84d62e3700 1 -- 172.21.15.63:0/1951606673 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f84b8068f70 msgr2=0x7f84b806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:57.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.512+0000 7f84d62e3700 1 --2- 172.21.15.63:0/1951606673 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f84b8068f70 0x7f84b806b420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f84c000b3b0 tx=0x7f84c0009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:57.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.512+0000 7f84d62e3700 1 -- 172.21.15.63:0/1951606673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84d00fcd00 msgr2=0x7f84d010c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:57.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.512+0000 7f84d62e3700 1 --2- 172.21.15.63:0/1951606673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84d00fcd00 0x7f84d010c9c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f84c400c830 tx=0x7f84c4004470 comp rx=0 tx=0).stop 2023-12-07T16:18:57.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.512+0000 7f84d62e3700 1 -- 172.21.15.63:0/1951606673 shutdown_connections 2023-12-07T16:18:57.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.512+0000 7f84d62e3700 1 --2- 172.21.15.63:0/1951606673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84d00fbaf0 0x7f84d010c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:57.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.512+0000 7f84d62e3700 1 --2- 172.21.15.63:0/1951606673 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f84b8068f70 0x7f84b806b420 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:57.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.512+0000 7f84d62e3700 1 --2- 172.21.15.63:0/1951606673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84d00fcd00 0x7f84d010c9c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:57.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.512+0000 7f84d62e3700 1 -- 172.21.15.63:0/1951606673 >> 172.21.15.63:0/1951606673 conn(0x7f84d00f7190 msgr2=0x7f84d00fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:57.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.512+0000 7f84d62e3700 1 -- 172.21.15.63:0/1951606673 shutdown_connections 2023-12-07T16:18:57.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:57.512+0000 7f84d62e3700 1 -- 172.21.15.63:0/1951606673 wait complete. 2023-12-07T16:18:57.877 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- bash -c 'ceph orch ps' 2023-12-07T16:18:58.149 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:18:58.616 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:58 smithi063 ceph-mon[112095]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:58.617 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:18:58 smithi063 ceph-mon[112095]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:18:58.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:58 smithi152 ceph-mon[121113]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:18:58.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:18:58 smithi152 ceph-mon[121113]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:18:59.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.120+0000 7ff4663d3700 1 -- 172.21.15.63:0/2053755653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff460066920 msgr2=0x7ff4600ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:59.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.120+0000 7ff4663d3700 1 --2- 172.21.15.63:0/2053755653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff460066920 0x7ff4600ff7a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff450004940 tx=0x7ff450009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:59.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.120+0000 7ff4663d3700 1 -- 172.21.15.63:0/2053755653 shutdown_connections 2023-12-07T16:18:59.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.120+0000 7ff4663d3700 1 --2- 172.21.15.63:0/2053755653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4600ffd70 0x7ff4601021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:59.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.120+0000 7ff4663d3700 1 --2- 172.21.15.63:0/2053755653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff460066920 0x7ff4600ff7a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:59.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.120+0000 7ff4663d3700 1 -- 172.21.15.63:0/2053755653 >> 172.21.15.63:0/2053755653 conn(0x7ff4600f71b0 msgr2=0x7ff4600f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:59.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.120+0000 7ff4663d3700 1 -- 172.21.15.63:0/2053755653 shutdown_connections 2023-12-07T16:18:59.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.120+0000 7ff4663d3700 1 -- 172.21.15.63:0/2053755653 wait complete. 2023-12-07T16:18:59.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.120+0000 7ff4663d3700 1 Processor -- start 2023-12-07T16:18:59.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.120+0000 7ff4663d3700 1 -- start start 2023-12-07T16:18:59.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.121+0000 7ff4663d3700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff460066920 0x7ff4600fd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:59.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.121+0000 7ff4663d3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4600ffd70 0x7ff4600fb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:59.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.121+0000 7ff4663d3700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4600fbca0 con 0x7ff460066920 2023-12-07T16:18:59.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.121+0000 7ff4663d3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4600fbe10 con 0x7ff4600ffd70 2023-12-07T16:18:59.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.121+0000 7ff45ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff460066920 0x7ff4600fd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:59.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.121+0000 7ff45ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff460066920 0x7ff4600fd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54838/0 (socket says 172.21.15.63:54838) 2023-12-07T16:18:59.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.121+0000 7ff45ffff700 1 -- 172.21.15.63:0/2923377934 learned_addr learned my addr 172.21.15.63:0/2923377934 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:18:59.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.121+0000 7ff45f7fe700 1 --2- 172.21.15.63:0/2923377934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4600ffd70 0x7ff4600fb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:59.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.121+0000 7ff45ffff700 1 -- 172.21.15.63:0/2923377934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4600ffd70 msgr2=0x7ff4600fb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:59.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.121+0000 7ff45ffff700 1 --2- 172.21.15.63:0/2923377934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4600ffd70 0x7ff4600fb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:59.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.121+0000 7ff45ffff700 1 -- 172.21.15.63:0/2923377934 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff450005040 con 0x7ff460066920 2023-12-07T16:18:59.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.121+0000 7ff45ffff700 1 --2- 172.21.15.63:0/2923377934 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff460066920 0x7ff4600fd220 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff450009360 tx=0x7ff450009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:59.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.121+0000 7ff45cff9700 1 -- 172.21.15.63:0/2923377934 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff45000e040 con 0x7ff460066920 2023-12-07T16:18:59.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.121+0000 7ff4663d3700 1 -- 172.21.15.63:0/2923377934 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4600fc090 con 0x7ff460066920 2023-12-07T16:18:59.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.122+0000 7ff45cff9700 1 -- 172.21.15.63:0/2923377934 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff45000bc50 con 0x7ff460066920 2023-12-07T16:18:59.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.122+0000 7ff45cff9700 1 -- 172.21.15.63:0/2923377934 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff45001c3f0 con 0x7ff460066920 2023-12-07T16:18:59.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.122+0000 7ff4663d3700 1 -- 172.21.15.63:0/2923377934 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff460115580 con 0x7ff460066920 2023-12-07T16:18:59.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.122+0000 7ff4663d3700 1 -- 172.21.15.63:0/2923377934 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4601075e0 con 0x7ff460066920 2023-12-07T16:18:59.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.123+0000 7ff45cff9700 1 -- 172.21.15.63:0/2923377934 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff450013420 con 0x7ff460066920 2023-12-07T16:18:59.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.123+0000 7ff45cff9700 1 --2- 172.21.15.63:0/2923377934 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff448068f60 0x7ff44806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:18:59.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.123+0000 7ff45f7fe700 1 --2- 172.21.15.63:0/2923377934 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff448068f60 0x7ff44806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:18:59.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.123+0000 7ff45cff9700 1 -- 172.21.15.63:0/2923377934 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff450087dd0 con 0x7ff460066920 2023-12-07T16:18:59.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.124+0000 7ff45f7fe700 1 --2- 172.21.15.63:0/2923377934 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff448068f60 0x7ff44806b410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff454007fd0 tx=0x7ff454009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:18:59.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.128+0000 7ff45cff9700 1 -- 172.21.15.63:0/2923377934 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff450057ff0 con 0x7ff460066920 2023-12-07T16:18:59.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.327+0000 7ff4663d3700 1 -- 172.21.15.63:0/2923377934 --> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff46005e080 con 0x7ff448068f60 2023-12-07T16:18:59.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.336+0000 7ff45cff9700 1 -- 172.21.15.63:0/2923377934 <== mgr.14212 v2:172.21.15.63:6800/184283085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2718 (secure 0 0 0) 0x7ff46005e080 con 0x7ff448068f60 2023-12-07T16:18:59.334 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-07T16:18:59.335 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (2m) 93s ago 3m 25.2M - 0.25.0 c8568f914cd2 bfa7e53794bf 2023-12-07T16:18:59.335 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (3m) 93s ago 3m 7428k - 17.2.7-115-g4f62d9ad fcdfd00f81c7 80bed1094ab4 2023-12-07T16:18:59.335 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi152 smithi152 running (2m) 41s ago 2m 7495k - 17.2.7-115-g4f62d9ad fcdfd00f81c7 e2cd5532384b 2023-12-07T16:18:59.335 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (2m) 93s ago 3m 83.2M - 9.4.7 954c08fa6188 ead20992252b 2023-12-07T16:18:59.335 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.yohyyx smithi063 *:9283 running (4m) 93s ago 4m 483M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 e9b3a40f26fd 2023-12-07T16:18:59.335 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi152.sxayfb smithi152 *:8443,9283 running (2m) 41s ago 2m 438M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 f0df841e22a0 2023-12-07T16:18:59.335 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (4m) 93s ago 4m 59.7M 2048M 17.2.7-115-g4f62d9ad fcdfd00f81c7 736281f5463c 2023-12-07T16:18:59.335 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi152 smithi152 running (2m) 41s ago 2m 51.0M 2048M 17.2.7-115-g4f62d9ad fcdfd00f81c7 ecfe3add39d6 2023-12-07T16:18:59.335 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (3m) 93s ago 3m 16.4M - 1.5.0 0da6a335fe13 8412e0ac9145 2023-12-07T16:18:59.335 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi152 smithi152 *:9100 running (2m) 41s ago 2m 18.1M - 1.5.0 0da6a335fe13 fb0e82afe6a4 2023-12-07T16:18:59.335 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (2m) 93s ago 2m 43.4M 4299M 17.2.7-115-g4f62d9ad fcdfd00f81c7 bbdd7f82a7c3 2023-12-07T16:18:59.335 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (117s) 93s ago 117s 39.1M 4299M 17.2.7-115-g4f62d9ad fcdfd00f81c7 4372601f899e 2023-12-07T16:18:59.336 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (98s) 93s ago 97s 12.0M 4299M 17.2.7-115-g4f62d9ad fcdfd00f81c7 b0d432bbca05 2023-12-07T16:18:59.336 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi152 running (80s) 41s ago 79s 44.2M 5323M 17.2.7-115-g4f62d9ad fcdfd00f81c7 94d14402b489 2023-12-07T16:18:59.336 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi152 running (61s) 41s ago 61s 44.2M 5323M 17.2.7-115-g4f62d9ad fcdfd00f81c7 d3b8b2f12489 2023-12-07T16:18:59.336 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi152 running (43s) 41s ago 43s 11.8M 5323M 17.2.7-115-g4f62d9ad fcdfd00f81c7 e7f8d9f716bb 2023-12-07T16:18:59.336 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (2m) 93s ago 3m 37.1M - 2.43.0 a07b618ecd1d 32eb5a56be5e 2023-12-07T16:18:59.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.338+0000 7ff4663d3700 1 -- 172.21.15.63:0/2923377934 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff448068f60 msgr2=0x7ff44806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:59.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.338+0000 7ff4663d3700 1 --2- 172.21.15.63:0/2923377934 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff448068f60 0x7ff44806b410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff454007fd0 tx=0x7ff454009040 comp rx=0 tx=0).stop 2023-12-07T16:18:59.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.338+0000 7ff4663d3700 1 -- 172.21.15.63:0/2923377934 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff460066920 msgr2=0x7ff4600fd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:18:59.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.338+0000 7ff4663d3700 1 --2- 172.21.15.63:0/2923377934 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff460066920 0x7ff4600fd220 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff450009360 tx=0x7ff450009e30 comp rx=0 tx=0).stop 2023-12-07T16:18:59.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.338+0000 7ff4663d3700 1 -- 172.21.15.63:0/2923377934 shutdown_connections 2023-12-07T16:18:59.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.338+0000 7ff4663d3700 1 --2- 172.21.15.63:0/2923377934 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff448068f60 0x7ff44806b410 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:59.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.338+0000 7ff4663d3700 1 --2- 172.21.15.63:0/2923377934 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff460066920 0x7ff4600fd220 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:59.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.338+0000 7ff4663d3700 1 --2- 172.21.15.63:0/2923377934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4600ffd70 0x7ff4600fb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:18:59.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.338+0000 7ff4663d3700 1 -- 172.21.15.63:0/2923377934 >> 172.21.15.63:0/2923377934 conn(0x7ff4600f71b0 msgr2=0x7ff4600f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:18:59.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.338+0000 7ff4663d3700 1 -- 172.21.15.63:0/2923377934 shutdown_connections 2023-12-07T16:18:59.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:18:59.338+0000 7ff4663d3700 1 -- 172.21.15.63:0/2923377934 wait complete. 2023-12-07T16:18:59.703 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- bash -c 'ceph orch ls' 2023-12-07T16:18:59.974 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:19:00.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:00 smithi063 ceph-mon[112095]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:19:00.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:00 smithi063 ceph-mon[112095]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:19:00.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:00 smithi152 ceph-mon[121113]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:19:00.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:00 smithi152 ceph-mon[121113]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:19:00.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.968+0000 7f991967f700 1 -- 172.21.15.63:0/3034591056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99140fcbf0 msgr2=0x7f99140fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:00.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.968+0000 7f991967f700 1 --2- 172.21.15.63:0/3034591056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99140fcbf0 0x7f99140fd000 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9904004940 tx=0x7f9904009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:00.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.968+0000 7f991967f700 1 -- 172.21.15.63:0/3034591056 shutdown_connections 2023-12-07T16:19:00.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.968+0000 7f991967f700 1 --2- 172.21.15.63:0/3034591056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99140fde00 0x7f99140fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:00.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.968+0000 7f991967f700 1 --2- 172.21.15.63:0/3034591056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99140fcbf0 0x7f99140fd000 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:00.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.968+0000 7f991967f700 1 -- 172.21.15.63:0/3034591056 >> 172.21.15.63:0/3034591056 conn(0x7f99140f82d0 msgr2=0x7f99140fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:00.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.968+0000 7f991967f700 1 -- 172.21.15.63:0/3034591056 shutdown_connections 2023-12-07T16:19:00.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.968+0000 7f991967f700 1 -- 172.21.15.63:0/3034591056 wait complete. 2023-12-07T16:19:00.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.969+0000 7f991967f700 1 Processor -- start 2023-12-07T16:19:00.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.969+0000 7f991967f700 1 -- start start 2023-12-07T16:19:00.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.970+0000 7f991967f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99140fcbf0 0x7f991410d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:00.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.970+0000 7f991967f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99140fde00 0x7f991410daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:00.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.970+0000 7f991967f700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991410e0a0 con 0x7f99140fde00 2023-12-07T16:19:00.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.970+0000 7f991967f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991410e940 con 0x7f99140fcbf0 2023-12-07T16:19:00.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.970+0000 7f99127fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99140fde00 0x7f991410daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:00.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.970+0000 7f99127fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99140fde00 0x7f991410daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33160/0 (socket says 172.21.15.63:33160) 2023-12-07T16:19:00.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.970+0000 7f99127fc700 1 -- 172.21.15.63:0/2550331089 learned_addr learned my addr 172.21.15.63:0/2550331089 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:00.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.970+0000 7f9912ffd700 1 --2- 172.21.15.63:0/2550331089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99140fcbf0 0x7f991410d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:00.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.970+0000 7f99127fc700 1 -- 172.21.15.63:0/2550331089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99140fcbf0 msgr2=0x7f991410d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:00.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.970+0000 7f99127fc700 1 --2- 172.21.15.63:0/2550331089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99140fcbf0 0x7f991410d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:00.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.970+0000 7f99127fc700 1 -- 172.21.15.63:0/2550331089 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9904005040 con 0x7f99140fde00 2023-12-07T16:19:00.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.970+0000 7f99127fc700 1 --2- 172.21.15.63:0/2550331089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99140fde00 0x7f991410daa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f990800c8c0 tx=0x7f99080044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:00.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.970+0000 7f98fb7fe700 1 -- 172.21.15.63:0/2550331089 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f990800a760 con 0x7f99140fde00 2023-12-07T16:19:00.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.970+0000 7f98fb7fe700 1 -- 172.21.15.63:0/2550331089 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f990800ad70 con 0x7f99140fde00 2023-12-07T16:19:00.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.970+0000 7f98fb7fe700 1 -- 172.21.15.63:0/2550331089 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99080113a0 con 0x7f99140fde00 2023-12-07T16:19:00.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.970+0000 7f991967f700 1 -- 172.21.15.63:0/2550331089 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991410ec20 con 0x7f99140fde00 2023-12-07T16:19:00.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.970+0000 7f991967f700 1 -- 172.21.15.63:0/2550331089 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991410f160 con 0x7f99140fde00 2023-12-07T16:19:00.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.972+0000 7f991967f700 1 -- 172.21.15.63:0/2550331089 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f991404bb80 con 0x7f99140fde00 2023-12-07T16:19:00.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.972+0000 7f98fb7fe700 1 -- 172.21.15.63:0/2550331089 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f9908012400 con 0x7f99140fde00 2023-12-07T16:19:00.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.972+0000 7f98fb7fe700 1 --2- 172.21.15.63:0/2550331089 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f98fc068f70 0x7f98fc06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:00.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.972+0000 7f98fb7fe700 1 -- 172.21.15.63:0/2550331089 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9908086af0 con 0x7f99140fde00 2023-12-07T16:19:00.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.972+0000 7f9912ffd700 1 --2- 172.21.15.63:0/2550331089 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f98fc068f70 0x7f98fc06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:00.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.973+0000 7f9912ffd700 1 --2- 172.21.15.63:0/2550331089 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f98fc068f70 0x7f98fc06b420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f990400b7d0 tx=0x7f9904009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:00.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:00.977+0000 7f98fb7fe700 1 -- 172.21.15.63:0/2550331089 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9908056d90 con 0x7f99140fde00 2023-12-07T16:19:01.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:01.177+0000 7f991967f700 1 -- 172.21.15.63:0/2550331089 --> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f991410f560 con 0x7f98fc068f70 2023-12-07T16:19:01.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:01.181+0000 7f98fb7fe700 1 -- 172.21.15.63:0/2550331089 <== mgr.14212 v2:172.21.15.63:6800/184283085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1170 (secure 0 0 0) 0x7f991410f560 con 0x7f98fc068f70 2023-12-07T16:19:01.179 INFO:teuthology.orchestra.run.smithi063.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-12-07T16:19:01.180 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager ?:9093,9094 1/1 95s ago 4m count:1 2023-12-07T16:19:01.180 INFO:teuthology.orchestra.run.smithi063.stdout:crash 2/2 95s ago 4m * 2023-12-07T16:19:01.180 INFO:teuthology.orchestra.run.smithi063.stdout:grafana ?:3000 1/1 95s ago 4m count:1 2023-12-07T16:19:01.180 INFO:teuthology.orchestra.run.smithi063.stdout:mgr 2/2 95s ago 4m count:2 2023-12-07T16:19:01.180 INFO:teuthology.orchestra.run.smithi063.stdout:mon 2/2 95s ago 3m smithi063:172.21.15.63=smithi063;smithi152:172.21.15.152=smithi152;count:2 2023-12-07T16:19:01.180 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter ?:9100 2/2 95s ago 4m * 2023-12-07T16:19:01.180 INFO:teuthology.orchestra.run.smithi063.stdout:osd 6 95s ago - 2023-12-07T16:19:01.180 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus ?:9095 1/1 95s ago 4m count:1 2023-12-07T16:19:01.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:01.183+0000 7f991967f700 1 -- 172.21.15.63:0/2550331089 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f98fc068f70 msgr2=0x7f98fc06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:01.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:01.183+0000 7f991967f700 1 --2- 172.21.15.63:0/2550331089 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f98fc068f70 0x7f98fc06b420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f990400b7d0 tx=0x7f9904009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:01.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:01.183+0000 7f991967f700 1 -- 172.21.15.63:0/2550331089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99140fde00 msgr2=0x7f991410daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:01.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:01.183+0000 7f991967f700 1 --2- 172.21.15.63:0/2550331089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99140fde00 0x7f991410daa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f990800c8c0 tx=0x7f99080044c0 comp rx=0 tx=0).stop 2023-12-07T16:19:01.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:01.183+0000 7f991967f700 1 -- 172.21.15.63:0/2550331089 shutdown_connections 2023-12-07T16:19:01.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:01.183+0000 7f991967f700 1 --2- 172.21.15.63:0/2550331089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99140fcbf0 0x7f991410d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:01.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:01.183+0000 7f991967f700 1 --2- 172.21.15.63:0/2550331089 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f98fc068f70 0x7f98fc06b420 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:01.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:01.183+0000 7f991967f700 1 --2- 172.21.15.63:0/2550331089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99140fde00 0x7f991410daa0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:01.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:01.183+0000 7f991967f700 1 -- 172.21.15.63:0/2550331089 >> 172.21.15.63:0/2550331089 conn(0x7f99140f82d0 msgr2=0x7f9914101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:01.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:01.183+0000 7f991967f700 1 -- 172.21.15.63:0/2550331089 shutdown_connections 2023-12-07T16:19:01.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:01.183+0000 7f991967f700 1 -- 172.21.15.63:0/2550331089 wait complete. 2023-12-07T16:19:01.554 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- bash -c 'ceph orch host ls' 2023-12-07T16:19:01.824 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:19:02.642 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:02 smithi063 ceph-mon[112095]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:19:02.642 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:02 smithi063 ceph-mon[112095]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:19:02.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:02 smithi152 ceph-mon[121113]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:19:02.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:02 smithi152 ceph-mon[121113]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:19:02.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.836+0000 7f1977a1a700 1 -- 172.21.15.63:0/119709529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19700fde00 msgr2=0x7f19700fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:02.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.836+0000 7f1977a1a700 1 --2- 172.21.15.63:0/119709529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19700fde00 0x7f19700fe250 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1960004940 tx=0x7f1960009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:02.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.836+0000 7f1977a1a700 1 -- 172.21.15.63:0/119709529 shutdown_connections 2023-12-07T16:19:02.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.836+0000 7f1977a1a700 1 --2- 172.21.15.63:0/119709529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19700fde00 0x7f19700fe250 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:02.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.836+0000 7f1977a1a700 1 --2- 172.21.15.63:0/119709529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19700fcbf0 0x7f19700fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:02.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.836+0000 7f1977a1a700 1 -- 172.21.15.63:0/119709529 >> 172.21.15.63:0/119709529 conn(0x7f19700f82d0 msgr2=0x7f19700fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:02.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.836+0000 7f1977a1a700 1 -- 172.21.15.63:0/119709529 shutdown_connections 2023-12-07T16:19:02.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.836+0000 7f1977a1a700 1 -- 172.21.15.63:0/119709529 wait complete. 2023-12-07T16:19:02.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.836+0000 7f1977a1a700 1 Processor -- start 2023-12-07T16:19:02.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.836+0000 7f1977a1a700 1 -- start start 2023-12-07T16:19:02.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.837+0000 7f1977a1a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19700fcbf0 0x7f197010d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:02.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.837+0000 7f1977a1a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19700fde00 0x7f197010da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:02.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.837+0000 7f1977a1a700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197010e010 con 0x7f19700fcbf0 2023-12-07T16:19:02.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.837+0000 7f1977a1a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197010e8b0 con 0x7f19700fde00 2023-12-07T16:19:02.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.837+0000 7f19757b6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19700fcbf0 0x7f197010d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:02.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.837+0000 7f19757b6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19700fcbf0 0x7f197010d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33170/0 (socket says 172.21.15.63:33170) 2023-12-07T16:19:02.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.837+0000 7f19757b6700 1 -- 172.21.15.63:0/1217095389 learned_addr learned my addr 172.21.15.63:0/1217095389 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:02.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.837+0000 7f19757b6700 1 -- 172.21.15.63:0/1217095389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19700fde00 msgr2=0x7f197010da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:02.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.837+0000 7f19757b6700 1 --2- 172.21.15.63:0/1217095389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19700fde00 0x7f197010da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:02.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.837+0000 7f19757b6700 1 -- 172.21.15.63:0/1217095389 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1960005040 con 0x7f19700fcbf0 2023-12-07T16:19:02.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.837+0000 7f19757b6700 1 --2- 172.21.15.63:0/1217095389 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19700fcbf0 0x7f197010d4d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f196c002a80 tx=0x7f196c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:02.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.837+0000 7f1965ffb700 1 -- 172.21.15.63:0/1217095389 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f196c007cc0 con 0x7f19700fcbf0 2023-12-07T16:19:02.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.837+0000 7f1965ffb700 1 -- 172.21.15.63:0/1217095389 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f196c00f040 con 0x7f19700fcbf0 2023-12-07T16:19:02.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.837+0000 7f1977a1a700 1 -- 172.21.15.63:0/1217095389 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f197010eb90 con 0x7f19700fcbf0 2023-12-07T16:19:02.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.837+0000 7f1965ffb700 1 -- 172.21.15.63:0/1217095389 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f196c0095d0 con 0x7f19700fcbf0 2023-12-07T16:19:02.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.837+0000 7f1977a1a700 1 -- 172.21.15.63:0/1217095389 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197010f0d0 con 0x7f19700fcbf0 2023-12-07T16:19:02.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.839+0000 7f1977a1a700 1 -- 172.21.15.63:0/1217095389 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197004bb80 con 0x7f19700fcbf0 2023-12-07T16:19:02.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.839+0000 7f1965ffb700 1 -- 172.21.15.63:0/1217095389 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f196c009730 con 0x7f19700fcbf0 2023-12-07T16:19:02.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.839+0000 7f1965ffb700 1 --2- 172.21.15.63:0/1217095389 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f195c068f60 0x7f195c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:02.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.839+0000 7f1965ffb700 1 -- 172.21.15.63:0/1217095389 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f196c086240 con 0x7f19700fcbf0 2023-12-07T16:19:02.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.839+0000 7f1974fb5700 1 --2- 172.21.15.63:0/1217095389 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f195c068f60 0x7f195c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:02.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.840+0000 7f1974fb5700 1 --2- 172.21.15.63:0/1217095389 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f195c068f60 0x7f195c06b410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f196000b3b0 tx=0x7f1960009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:02.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:02.844+0000 7f1965ffb700 1 -- 172.21.15.63:0/1217095389 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f196c04ca00 con 0x7f19700fcbf0 2023-12-07T16:19:03.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:03.048+0000 7f1977a1a700 1 -- 172.21.15.63:0/1217095389 --> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f197010f640 con 0x7f195c068f60 2023-12-07T16:19:03.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:03.049+0000 7f1965ffb700 1 -- 172.21.15.63:0/1217095389 <== mgr.14212 v2:172.21.15.63:6800/184283085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f197010f640 con 0x7f195c068f60 2023-12-07T16:19:03.048 INFO:teuthology.orchestra.run.smithi063.stdout:HOST ADDR LABELS STATUS 2023-12-07T16:19:03.048 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063 172.21.15.63 2023-12-07T16:19:03.048 INFO:teuthology.orchestra.run.smithi063.stdout:smithi152 172.21.15.152 2023-12-07T16:19:03.048 INFO:teuthology.orchestra.run.smithi063.stdout:2 hosts in cluster 2023-12-07T16:19:03.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:03.051+0000 7f1977a1a700 1 -- 172.21.15.63:0/1217095389 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f195c068f60 msgr2=0x7f195c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:03.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:03.051+0000 7f1977a1a700 1 --2- 172.21.15.63:0/1217095389 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f195c068f60 0x7f195c06b410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f196000b3b0 tx=0x7f1960009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:03.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:03.051+0000 7f1977a1a700 1 -- 172.21.15.63:0/1217095389 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19700fcbf0 msgr2=0x7f197010d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:03.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:03.051+0000 7f1977a1a700 1 --2- 172.21.15.63:0/1217095389 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19700fcbf0 0x7f197010d4d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f196c002a80 tx=0x7f196c0046b0 comp rx=0 tx=0).stop 2023-12-07T16:19:03.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:03.051+0000 7f1977a1a700 1 -- 172.21.15.63:0/1217095389 shutdown_connections 2023-12-07T16:19:03.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:03.051+0000 7f1977a1a700 1 --2- 172.21.15.63:0/1217095389 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f195c068f60 0x7f195c06b410 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:03.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:03.051+0000 7f1977a1a700 1 --2- 172.21.15.63:0/1217095389 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19700fcbf0 0x7f197010d4d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:03.051 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:03.051+0000 7f1977a1a700 1 --2- 172.21.15.63:0/1217095389 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19700fde00 0x7f197010da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:03.051 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:03.051+0000 7f1977a1a700 1 -- 172.21.15.63:0/1217095389 >> 172.21.15.63:0/1217095389 conn(0x7f19700f82d0 msgr2=0x7f1970101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:03.051 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:03.051+0000 7f1977a1a700 1 -- 172.21.15.63:0/1217095389 shutdown_connections 2023-12-07T16:19:03.051 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:03.051+0000 7f1977a1a700 1 -- 172.21.15.63:0/1217095389 wait complete. 2023-12-07T16:19:03.419 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- bash -c 'ceph orch device ls' 2023-12-07T16:19:03.690 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:19:04.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:04 smithi063 ceph-mon[112095]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:19:04.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:04 smithi063 ceph-mon[112095]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:19:04.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.697+0000 7f05bc208700 1 -- 172.21.15.63:0/3148933185 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05b40fcd00 msgr2=0x7f05b40fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:04.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.697+0000 7f05bc208700 1 --2- 172.21.15.63:0/3148933185 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05b40fcd00 0x7f05b40fd150 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f05a8004940 tx=0x7f05a8009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.697+0000 7f05bc208700 1 -- 172.21.15.63:0/3148933185 shutdown_connections 2023-12-07T16:19:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.697+0000 7f05bc208700 1 --2- 172.21.15.63:0/3148933185 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05b40fcd00 0x7f05b40fd150 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.697+0000 7f05bc208700 1 --2- 172.21.15.63:0/3148933185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05b40fbaf0 0x7f05b40fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.697+0000 7f05bc208700 1 -- 172.21.15.63:0/3148933185 >> 172.21.15.63:0/3148933185 conn(0x7f05b40f71b0 msgr2=0x7f05b40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.697+0000 7f05bc208700 1 -- 172.21.15.63:0/3148933185 shutdown_connections 2023-12-07T16:19:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.697+0000 7f05bc208700 1 -- 172.21.15.63:0/3148933185 wait complete. 2023-12-07T16:19:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.698+0000 7f05bc208700 1 Processor -- start 2023-12-07T16:19:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.698+0000 7f05bc208700 1 -- start start 2023-12-07T16:19:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.698+0000 7f05bc208700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05b40fbaf0 0x7f05b410c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.698+0000 7f05bc208700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05b40fcd00 0x7f05b410c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.698+0000 7f05bc208700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b410d030 con 0x7f05b40fbaf0 2023-12-07T16:19:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.698+0000 7f05bc208700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b410d870 con 0x7f05b40fcd00 2023-12-07T16:19:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.698+0000 7f05b9fa4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05b40fbaf0 0x7f05b410c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.698+0000 7f05b9fa4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05b40fbaf0 0x7f05b410c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33178/0 (socket says 172.21.15.63:33178) 2023-12-07T16:19:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.698+0000 7f05b9fa4700 1 -- 172.21.15.63:0/1534070688 learned_addr learned my addr 172.21.15.63:0/1534070688 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.699+0000 7f05b97a3700 1 --2- 172.21.15.63:0/1534070688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05b40fcd00 0x7f05b410c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.699+0000 7f05b9fa4700 1 -- 172.21.15.63:0/1534070688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05b40fcd00 msgr2=0x7f05b410c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.699+0000 7f05b9fa4700 1 --2- 172.21.15.63:0/1534070688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05b40fcd00 0x7f05b410c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.699+0000 7f05b9fa4700 1 -- 172.21.15.63:0/1534070688 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a8005040 con 0x7f05b40fbaf0 2023-12-07T16:19:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.699+0000 7f05b9fa4700 1 --2- 172.21.15.63:0/1534070688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05b40fbaf0 0x7f05b410c460 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f05b000b790 tx=0x7f05b0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.699+0000 7f05a67fc700 1 -- 172.21.15.63:0/1534070688 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05b000f6f0 con 0x7f05b40fbaf0 2023-12-07T16:19:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.699+0000 7f05a67fc700 1 -- 172.21.15.63:0/1534070688 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f05b000fd00 con 0x7f05b40fbaf0 2023-12-07T16:19:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.699+0000 7f05bc208700 1 -- 172.21.15.63:0/1534070688 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b410db50 con 0x7f05b40fbaf0 2023-12-07T16:19:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.699+0000 7f05a67fc700 1 -- 172.21.15.63:0/1534070688 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05b00103a0 con 0x7f05b40fbaf0 2023-12-07T16:19:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.699+0000 7f05bc208700 1 -- 172.21.15.63:0/1534070688 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b410e090 con 0x7f05b40fbaf0 2023-12-07T16:19:04.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.700+0000 7f05bc208700 1 -- 172.21.15.63:0/1534070688 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b404bb80 con 0x7f05b40fbaf0 2023-12-07T16:19:04.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.700+0000 7f05a67fc700 1 -- 172.21.15.63:0/1534070688 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f05b000f850 con 0x7f05b40fbaf0 2023-12-07T16:19:04.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.701+0000 7f05a67fc700 1 --2- 172.21.15.63:0/1534070688 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f05a0068f60 0x7f05a006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:04.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.701+0000 7f05a67fc700 1 -- 172.21.15.63:0/1534070688 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f05b0086890 con 0x7f05b40fbaf0 2023-12-07T16:19:04.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.701+0000 7f05b97a3700 1 --2- 172.21.15.63:0/1534070688 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f05a0068f60 0x7f05a006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:04.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.701+0000 7f05b97a3700 1 --2- 172.21.15.63:0/1534070688 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f05a0068f60 0x7f05a006b410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f05a800b3b0 tx=0x7f05a8009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:04.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.705+0000 7f05a67fc700 1 -- 172.21.15.63:0/1534070688 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f05b0056ab0 con 0x7f05b40fbaf0 2023-12-07T16:19:04.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:04 smithi152 ceph-mon[121113]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:19:04.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:04 smithi152 ceph-mon[121113]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:19:04.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.906+0000 7f05bc208700 1 -- 172.21.15.63:0/1534070688 --> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f05b410e540 con 0x7f05a0068f60 2023-12-07T16:19:04.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.907+0000 7f05a67fc700 1 -- 172.21.15.63:0/1534070688 <== mgr.14212 v2:172.21.15.63:6800/184283085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f05b410e540 con 0x7f05a0068f60 2023-12-07T16:19:04.906 INFO:teuthology.orchestra.run.smithi063.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-12-07T16:19:04.906 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5344005B400BGN 372G No 97s ago Has a FileSystem, LVM detected 2023-12-07T16:19:04.906 INFO:teuthology.orchestra.run.smithi063.stdout:smithi152 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JT400BGN 372G No 43s ago Has a FileSystem, LVM detected 2023-12-07T16:19:04.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.909+0000 7f05bc208700 1 -- 172.21.15.63:0/1534070688 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f05a0068f60 msgr2=0x7f05a006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:04.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.909+0000 7f05bc208700 1 --2- 172.21.15.63:0/1534070688 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f05a0068f60 0x7f05a006b410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f05a800b3b0 tx=0x7f05a8009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:04.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.909+0000 7f05bc208700 1 -- 172.21.15.63:0/1534070688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05b40fbaf0 msgr2=0x7f05b410c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:04.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.909+0000 7f05bc208700 1 --2- 172.21.15.63:0/1534070688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05b40fbaf0 0x7f05b410c460 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f05b000b790 tx=0x7f05b0009220 comp rx=0 tx=0).stop 2023-12-07T16:19:04.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.909+0000 7f05bc208700 1 -- 172.21.15.63:0/1534070688 shutdown_connections 2023-12-07T16:19:04.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.909+0000 7f05bc208700 1 --2- 172.21.15.63:0/1534070688 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f05a0068f60 0x7f05a006b410 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:04.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.909+0000 7f05bc208700 1 --2- 172.21.15.63:0/1534070688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05b40fbaf0 0x7f05b410c460 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:04.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.909+0000 7f05bc208700 1 --2- 172.21.15.63:0/1534070688 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05b40fcd00 0x7f05b410c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:04.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.909+0000 7f05bc208700 1 -- 172.21.15.63:0/1534070688 >> 172.21.15.63:0/1534070688 conn(0x7f05b40f71b0 msgr2=0x7f05b40fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:04.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.909+0000 7f05bc208700 1 -- 172.21.15.63:0/1534070688 shutdown_connections 2023-12-07T16:19:04.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:04.909+0000 7f05bc208700 1 -- 172.21.15.63:0/1534070688 wait complete. 2023-12-07T16:19:05.295 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-07T16:19:05.306 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi063.front.sepia.ceph.com 2023-12-07T16:19:05.306 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2023-12-07T16:19:05.578 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:19:06.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.563+0000 7f37d9921700 1 -- 172.21.15.63:0/2131538157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37d40fbaf0 msgr2=0x7f37d40fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:06.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.563+0000 7f37d9921700 1 --2- 172.21.15.63:0/2131538157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37d40fbaf0 0x7f37d40fbf00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f37c4004940 tx=0x7f37c4009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:06.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.563+0000 7f37d9921700 1 -- 172.21.15.63:0/2131538157 shutdown_connections 2023-12-07T16:19:06.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.563+0000 7f37d9921700 1 --2- 172.21.15.63:0/2131538157 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37d40fcd00 0x7f37d40fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:06.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.563+0000 7f37d9921700 1 --2- 172.21.15.63:0/2131538157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37d40fbaf0 0x7f37d40fbf00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:06.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.563+0000 7f37d9921700 1 -- 172.21.15.63:0/2131538157 >> 172.21.15.63:0/2131538157 conn(0x7f37d40f7190 msgr2=0x7f37d40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:06.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.563+0000 7f37d9921700 1 -- 172.21.15.63:0/2131538157 shutdown_connections 2023-12-07T16:19:06.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.563+0000 7f37d9921700 1 -- 172.21.15.63:0/2131538157 wait complete. 2023-12-07T16:19:06.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.564+0000 7f37d9921700 1 Processor -- start 2023-12-07T16:19:06.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.564+0000 7f37d9921700 1 -- start start 2023-12-07T16:19:06.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.564+0000 7f37d9921700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37d40fbaf0 0x7f37d4110300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:06.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.564+0000 7f37d9921700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37d40fcd00 0x7f37d4112850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:06.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.564+0000 7f37d9921700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d40661a0 con 0x7f37d40fbaf0 2023-12-07T16:19:06.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.564+0000 7f37d9921700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d40662e0 con 0x7f37d40fcd00 2023-12-07T16:19:06.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.564+0000 7f37d2ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37d40fbaf0 0x7f37d4110300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:06.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.564+0000 7f37d2ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37d40fbaf0 0x7f37d4110300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33196/0 (socket says 172.21.15.63:33196) 2023-12-07T16:19:06.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.564+0000 7f37d2ffd700 1 -- 172.21.15.63:0/3391593459 learned_addr learned my addr 172.21.15.63:0/3391593459 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:06.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.564+0000 7f37d27fc700 1 --2- 172.21.15.63:0/3391593459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37d40fcd00 0x7f37d4112850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:06.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.564+0000 7f37d2ffd700 1 -- 172.21.15.63:0/3391593459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37d40fcd00 msgr2=0x7f37d4112850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:06.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.564+0000 7f37d2ffd700 1 --2- 172.21.15.63:0/3391593459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37d40fcd00 0x7f37d4112850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:06.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.564+0000 7f37d2ffd700 1 -- 172.21.15.63:0/3391593459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c4005040 con 0x7f37d40fbaf0 2023-12-07T16:19:06.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.564+0000 7f37d27fc700 1 --2- 172.21.15.63:0/3391593459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37d40fcd00 0x7f37d4112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T16:19:06.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.564+0000 7f37d2ffd700 1 --2- 172.21.15.63:0/3391593459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37d40fbaf0 0x7f37d4110300 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f37c4004f90 tx=0x7f37c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:06.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.565+0000 7f37bb7fe700 1 -- 172.21.15.63:0/3391593459 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37c400e040 con 0x7f37d40fbaf0 2023-12-07T16:19:06.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.565+0000 7f37bb7fe700 1 -- 172.21.15.63:0/3391593459 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f37c400bcd0 con 0x7f37d40fbaf0 2023-12-07T16:19:06.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.565+0000 7f37d9921700 1 -- 172.21.15.63:0/3391593459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d4112e80 con 0x7f37d40fbaf0 2023-12-07T16:19:06.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.565+0000 7f37bb7fe700 1 -- 172.21.15.63:0/3391593459 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37c401c630 con 0x7f37d40fbaf0 2023-12-07T16:19:06.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.565+0000 7f37d9921700 1 -- 172.21.15.63:0/3391593459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d41132e0 con 0x7f37d40fbaf0 2023-12-07T16:19:06.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.566+0000 7f37d9921700 1 -- 172.21.15.63:0/3391593459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37d404bb80 con 0x7f37d40fbaf0 2023-12-07T16:19:06.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.566+0000 7f37bb7fe700 1 -- 172.21.15.63:0/3391593459 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f37c4013960 con 0x7f37d40fbaf0 2023-12-07T16:19:06.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.566+0000 7f37bb7fe700 1 --2- 172.21.15.63:0/3391593459 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f37bc068f60 0x7f37bc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:06.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.567+0000 7f37d27fc700 1 --2- 172.21.15.63:0/3391593459 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f37bc068f60 0x7f37bc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:06.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.567+0000 7f37bb7fe700 1 -- 172.21.15.63:0/3391593459 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f37c4087f80 con 0x7f37d40fbaf0 2023-12-07T16:19:06.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.567+0000 7f37d27fc700 1 --2- 172.21.15.63:0/3391593459 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f37bc068f60 0x7f37bc06b410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f37c8009b10 tx=0x7f37c8008040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:06.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.571+0000 7f37bb7fe700 1 -- 172.21.15.63:0/3391593459 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f37c4054790 con 0x7f37d40fbaf0 2023-12-07T16:19:06.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:06 smithi063 ceph-mon[112095]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:19:06.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:06 smithi063 ceph-mon[112095]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:19:06.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:06 smithi152 ceph-mon[121113]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:19:06.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:06 smithi152 ceph-mon[121113]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:19:06.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:06.797+0000 7f37d9921700 1 -- 172.21.15.63:0/3391593459 --> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f37d4101650 con 0x7f37bc068f60 2023-12-07T16:19:07.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:07 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-07T16:19:07.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:07 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-07T16:19:08.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:08.371+0000 7f37bb7fe700 1 -- 172.21.15.63:0/3391593459 <== mgr.14212 v2:172.21.15.63:6800/184283085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f37d4101650 con 0x7f37bc068f60 2023-12-07T16:19:08.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:08.374+0000 7f37d9921700 1 -- 172.21.15.63:0/3391593459 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f37bc068f60 msgr2=0x7f37bc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:08.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:08.374+0000 7f37d9921700 1 --2- 172.21.15.63:0/3391593459 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f37bc068f60 0x7f37bc06b410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f37c8009b10 tx=0x7f37c8008040 comp rx=0 tx=0).stop 2023-12-07T16:19:08.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:08.374+0000 7f37d9921700 1 -- 172.21.15.63:0/3391593459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37d40fbaf0 msgr2=0x7f37d4110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:08.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:08.374+0000 7f37d9921700 1 --2- 172.21.15.63:0/3391593459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37d40fbaf0 0x7f37d4110300 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f37c4004f90 tx=0x7f37c4009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:08.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:08.374+0000 7f37d9921700 1 -- 172.21.15.63:0/3391593459 shutdown_connections 2023-12-07T16:19:08.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:08.374+0000 7f37d9921700 1 --2- 172.21.15.63:0/3391593459 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f37bc068f60 0x7f37bc06b410 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:08.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:08.374+0000 7f37d9921700 1 --2- 172.21.15.63:0/3391593459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37d40fbaf0 0x7f37d4110300 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:08.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:08.374+0000 7f37d9921700 1 --2- 172.21.15.63:0/3391593459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f37d40fcd00 0x7f37d4112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:08.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:08.374+0000 7f37d9921700 1 -- 172.21.15.63:0/3391593459 >> 172.21.15.63:0/3391593459 conn(0x7f37d40f7190 msgr2=0x7f37d40fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:08.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:08.374+0000 7f37d9921700 1 -- 172.21.15.63:0/3391593459 shutdown_connections 2023-12-07T16:19:08.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:08.374+0000 7f37d9921700 1 -- 172.21.15.63:0/3391593459 wait complete. 2023-12-07T16:19:08.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:08 smithi063 ceph-mon[112095]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:19:08.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:08 smithi063 ceph-mon[112095]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:19:08.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:08 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-07T16:19:08.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:08 smithi063 ceph-mon[112095]: osdmap e40: 6 total, 6 up, 6 in 2023-12-07T16:19:08.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:08 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-07T16:19:08.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:08 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-mon-smithi063[112072]: 2023-12-07T16:19:08.351+0000 7f9aed79d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-07T16:19:08.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:08 smithi152 ceph-mon[121113]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:19:08.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:08 smithi152 ceph-mon[121113]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:19:08.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:08 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-07T16:19:08.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:08 smithi152 ceph-mon[121113]: osdmap e40: 6 total, 6 up, 6 in 2023-12-07T16:19:08.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:08 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-07T16:19:08.749 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-07T16:19:09.415 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:19:09.560 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-07T16:19:09.560 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:09 smithi063 ceph-mon[112095]: osdmap e41: 6 total, 6 up, 6 in 2023-12-07T16:19:09.560 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-07T16:19:09.560 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:09 smithi063 ceph-mon[112095]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-07T16:19:09.560 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:09 smithi063 ceph-mon[112095]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-07T16:19:09.560 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:09 smithi063 ceph-mon[112095]: osdmap e42: 6 total, 6 up, 6 in 2023-12-07T16:19:09.561 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-07T16:19:09.561 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:09 smithi063 ceph-mon[112095]: fsmap cephfs:0 2023-12-07T16:19:09.561 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:09 smithi063 ceph-mon[112095]: Saving service mds.cephfs spec with placement count:4 2023-12-07T16:19:09.561 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:09.561 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:19:09.561 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:19:09.561 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:19:09.561 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:09.561 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi063.gsjgcq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-07T16:19:09.561 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi063.gsjgcq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-07T16:19:09.561 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:09 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:19:09.561 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:09 smithi063 ceph-mon[112095]: Deploying daemon mds.cephfs.smithi063.gsjgcq on smithi063 2023-12-07T16:19:09.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:09 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-07T16:19:09.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:09 smithi152 ceph-mon[121113]: osdmap e41: 6 total, 6 up, 6 in 2023-12-07T16:19:09.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:09 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-07T16:19:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:09 smithi152 ceph-mon[121113]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-07T16:19:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:09 smithi152 ceph-mon[121113]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-07T16:19:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:09 smithi152 ceph-mon[121113]: osdmap e42: 6 total, 6 up, 6 in 2023-12-07T16:19:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:09 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-07T16:19:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:09 smithi152 ceph-mon[121113]: fsmap cephfs:0 2023-12-07T16:19:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:09 smithi152 ceph-mon[121113]: Saving service mds.cephfs spec with placement count:4 2023-12-07T16:19:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:09 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:09 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:19:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:09 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:19:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:09 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:19:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:09 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:09 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi063.gsjgcq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-07T16:19:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:09 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi063.gsjgcq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-07T16:19:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:09 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:19:09.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:09 smithi152 ceph-mon[121113]: Deploying daemon mds.cephfs.smithi063.gsjgcq on smithi063 2023-12-07T16:19:10.482 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:10 smithi063 ceph-mon[112095]: pgmap v127: 65 pgs: 18 creating+peering, 14 active+clean, 33 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:19:10.482 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:10 smithi063 ceph-mon[112095]: osdmap e43: 6 total, 6 up, 6 in 2023-12-07T16:19:10.482 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:10 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:10.482 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:10 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:19:10.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.690+0000 7fcb3682a700 1 -- 172.21.15.63:0/1072687743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb30070510 msgr2=0x7fcb30070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:10.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.690+0000 7fcb3682a700 1 --2- 172.21.15.63:0/1072687743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb30070510 0x7fcb30070980 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcb24004940 tx=0x7fcb24009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:10.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.690+0000 7fcb3682a700 1 -- 172.21.15.63:0/1072687743 shutdown_connections 2023-12-07T16:19:10.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.690+0000 7fcb3682a700 1 --2- 172.21.15.63:0/1072687743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb30070510 0x7fcb30070980 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:10.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.690+0000 7fcb3682a700 1 --2- 172.21.15.63:0/1072687743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb30071b60 0x7fcb3006ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:10.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.690+0000 7fcb3682a700 1 -- 172.21.15.63:0/1072687743 >> 172.21.15.63:0/1072687743 conn(0x7fcb300f82d0 msgr2=0x7fcb300fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:10.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.691+0000 7fcb3682a700 1 -- 172.21.15.63:0/1072687743 shutdown_connections 2023-12-07T16:19:10.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.691+0000 7fcb3682a700 1 -- 172.21.15.63:0/1072687743 wait complete. 2023-12-07T16:19:10.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.691+0000 7fcb3682a700 1 Processor -- start 2023-12-07T16:19:10.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.691+0000 7fcb3682a700 1 -- start start 2023-12-07T16:19:10.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.692+0000 7fcb3682a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb30070510 0x7fcb3010f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:10.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.692+0000 7fcb3682a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb30071b60 0x7fcb3010fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:10.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.692+0000 7fcb3682a700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb301102c0 con 0x7fcb30070510 2023-12-07T16:19:10.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.692+0000 7fcb3682a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb30110b60 con 0x7fcb30071b60 2023-12-07T16:19:10.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.692+0000 7fcb2ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb30070510 0x7fcb3010f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:10.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.692+0000 7fcb2ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb30070510 0x7fcb3010f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37928/0 (socket says 172.21.15.63:37928) 2023-12-07T16:19:10.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.692+0000 7fcb2ffff700 1 -- 172.21.15.63:0/4098628614 learned_addr learned my addr 172.21.15.63:0/4098628614 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:10.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.692+0000 7fcb2f7fe700 1 --2- 172.21.15.63:0/4098628614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb30071b60 0x7fcb3010fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:10.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.692+0000 7fcb2ffff700 1 -- 172.21.15.63:0/4098628614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb30071b60 msgr2=0x7fcb3010fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:10.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.692+0000 7fcb2ffff700 1 --2- 172.21.15.63:0/4098628614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb30071b60 0x7fcb3010fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:10.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.692+0000 7fcb2ffff700 1 -- 172.21.15.63:0/4098628614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb24005040 con 0x7fcb30070510 2023-12-07T16:19:10.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.692+0000 7fcb2ffff700 1 --2- 172.21.15.63:0/4098628614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb30070510 0x7fcb3010f780 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcb20002a50 tx=0x7fcb200046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:10.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.692+0000 7fcb2cff9700 1 -- 172.21.15.63:0/4098628614 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb20007cc0 con 0x7fcb30070510 2023-12-07T16:19:10.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.692+0000 7fcb3682a700 1 -- 172.21.15.63:0/4098628614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb30110e40 con 0x7fcb30070510 2023-12-07T16:19:10.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.692+0000 7fcb2cff9700 1 -- 172.21.15.63:0/4098628614 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcb2000f040 con 0x7fcb30070510 2023-12-07T16:19:10.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.692+0000 7fcb2cff9700 1 -- 172.21.15.63:0/4098628614 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb2000d9c0 con 0x7fcb30070510 2023-12-07T16:19:10.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.692+0000 7fcb3682a700 1 -- 172.21.15.63:0/4098628614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb30111380 con 0x7fcb30070510 2023-12-07T16:19:10.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.693+0000 7fcb3682a700 1 -- 172.21.15.63:0/4098628614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb301096f0 con 0x7fcb30070510 2023-12-07T16:19:10.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.694+0000 7fcb2cff9700 1 -- 172.21.15.63:0/4098628614 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fcb2000db20 con 0x7fcb30070510 2023-12-07T16:19:10.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.694+0000 7fcb2cff9700 1 --2- 172.21.15.63:0/4098628614 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fcb18068f60 0x7fcb1806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:10.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.694+0000 7fcb2cff9700 1 -- 172.21.15.63:0/4098628614 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fcb20086ad0 con 0x7fcb30070510 2023-12-07T16:19:10.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.694+0000 7fcb2f7fe700 1 --2- 172.21.15.63:0/4098628614 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fcb18068f60 0x7fcb1806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:10.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.695+0000 7fcb2f7fe700 1 --2- 172.21.15.63:0/4098628614 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fcb18068f60 0x7fcb1806b410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcb24004890 tx=0x7fcb24009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:10.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.699+0000 7fcb2cff9700 1 -- 172.21.15.63:0/4098628614 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcb200569b0 con 0x7fcb30070510 2023-12-07T16:19:10.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:10 smithi152 ceph-mon[121113]: pgmap v127: 65 pgs: 18 creating+peering, 14 active+clean, 33 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:19:10.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:10 smithi152 ceph-mon[121113]: osdmap e43: 6 total, 6 up, 6 in 2023-12-07T16:19:10.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:10 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:10.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:10 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:19:10.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.934+0000 7fcb3682a700 1 -- 172.21.15.63:0/4098628614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcb301115a0 con 0x7fcb30070510 2023-12-07T16:19:10.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.934+0000 7fcb2cff9700 1 -- 172.21.15.63:0/4098628614 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7fcb20056540 con 0x7fcb30070510 2023-12-07T16:19:10.933 INFO:teuthology.orchestra.run.smithi063.stdout:e2 2023-12-07T16:19:10.933 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-07T16:19:10.933 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:19:10.933 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-07T16:19:10.933 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:19:10.933 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-07T16:19:10.933 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-07T16:19:10.933 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 2 2023-12-07T16:19:10.933 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-07T16:19:10.933 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-07T16:19:08.352640+0000 2023-12-07T16:19:10.933 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-07T16:19:08.352698+0000 2023-12-07T16:19:10.933 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-07T16:19:10.933 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-07T16:19:10.934 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-07T16:19:10.934 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-07T16:19:10.934 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-07T16:19:10.934 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-07T16:19:10.934 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-07T16:19:10.934 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 0 2023-12-07T16:19:10.934 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:19:10.934 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 1 2023-12-07T16:19:10.934 INFO:teuthology.orchestra.run.smithi063.stdout:in 2023-12-07T16:19:10.934 INFO:teuthology.orchestra.run.smithi063.stdout:up {} 2023-12-07T16:19:10.934 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-07T16:19:10.934 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-07T16:19:10.934 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-07T16:19:10.934 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-07T16:19:10.934 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-07T16:19:10.935 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data disabled 2023-12-07T16:19:10.935 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-07T16:19:10.935 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 0 2023-12-07T16:19:10.935 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:19:10.935 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:19:10.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.936+0000 7fcb3682a700 1 -- 172.21.15.63:0/4098628614 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fcb18068f60 msgr2=0x7fcb1806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:10.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.936+0000 7fcb3682a700 1 --2- 172.21.15.63:0/4098628614 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fcb18068f60 0x7fcb1806b410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcb24004890 tx=0x7fcb24009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:10.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.936+0000 7fcb3682a700 1 -- 172.21.15.63:0/4098628614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb30070510 msgr2=0x7fcb3010f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:10.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.936+0000 7fcb3682a700 1 --2- 172.21.15.63:0/4098628614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb30070510 0x7fcb3010f780 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcb20002a50 tx=0x7fcb200046b0 comp rx=0 tx=0).stop 2023-12-07T16:19:10.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.936+0000 7fcb3682a700 1 -- 172.21.15.63:0/4098628614 shutdown_connections 2023-12-07T16:19:10.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.936+0000 7fcb3682a700 1 --2- 172.21.15.63:0/4098628614 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fcb18068f60 0x7fcb1806b410 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:10.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.936+0000 7fcb3682a700 1 --2- 172.21.15.63:0/4098628614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb30070510 0x7fcb3010f780 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:10.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.936+0000 7fcb3682a700 1 --2- 172.21.15.63:0/4098628614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb30071b60 0x7fcb3010fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:10.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.936+0000 7fcb3682a700 1 -- 172.21.15.63:0/4098628614 >> 172.21.15.63:0/4098628614 conn(0x7fcb300f82d0 msgr2=0x7fcb300fa670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:10.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.936+0000 7fcb3682a700 1 -- 172.21.15.63:0/4098628614 shutdown_connections 2023-12-07T16:19:10.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:10.936+0000 7fcb3682a700 1 -- 172.21.15.63:0/4098628614 wait complete. 2023-12-07T16:19:10.936 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 2 2023-12-07T16:19:11.302 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-07T16:19:11.315 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi063.front.sepia.ceph.com 2023-12-07T16:19:11.316 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 2' 2023-12-07T16:19:11.597 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:19:11.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:11 smithi063 ceph-mon[112095]: osdmap e44: 6 total, 6 up, 6 in 2023-12-07T16:19:11.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:11 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:11.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:11 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:11.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:11 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:11.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:11 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.mrvngf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-07T16:19:11.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:11 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.mrvngf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-07T16:19:11.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:11 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:19:11.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:11 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/4098628614' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:19:11.716 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:11 smithi152 ceph-mon[121113]: osdmap e44: 6 total, 6 up, 6 in 2023-12-07T16:19:11.716 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:11.716 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:11.716 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:11.716 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.mrvngf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-07T16:19:11.716 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.mrvngf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-07T16:19:11.716 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:11 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:19:11.716 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:11 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/4098628614' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:19:12.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:12 smithi152 ceph-mon[121113]: Deploying daemon mds.cephfs.smithi152.mrvngf on smithi152 2023-12-07T16:19:12.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:12 smithi152 ceph-mon[121113]: pgmap v130: 65 pgs: 1 creating+activating, 18 creating+peering, 46 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:19:12.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:12 smithi152 ceph-mon[121113]: mds.? [v2:172.21.15.63:6826/1994067670,v1:172.21.15.63:6827/1994067670] up:boot 2023-12-07T16:19:12.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:12 smithi152 ceph-mon[121113]: daemon mds.cephfs.smithi063.gsjgcq assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-07T16:19:12.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:12 smithi152 ceph-mon[121113]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-07T16:19:12.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:12 smithi152 ceph-mon[121113]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-07T16:19:12.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:12 smithi152 ceph-mon[121113]: Cluster is now healthy 2023-12-07T16:19:12.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:12 smithi152 ceph-mon[121113]: fsmap cephfs:0 1 up:standby 2023-12-07T16:19:12.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:12 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.gsjgcq"}]: dispatch 2023-12-07T16:19:12.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:12 smithi152 ceph-mon[121113]: fsmap cephfs:1 {0=cephfs.smithi063.gsjgcq=up:creating} 2023-12-07T16:19:12.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:12 smithi152 ceph-mon[121113]: daemon mds.cephfs.smithi063.gsjgcq is now active in filesystem cephfs as rank 0 2023-12-07T16:19:12.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:12 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:12.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:12 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:12.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:12 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:12.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:12 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi063.yidolg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-07T16:19:12.494 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:12 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi063.yidolg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-07T16:19:12.494 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:12 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:19:12.494 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:12 smithi152 ceph-mon[121113]: mds.? [v2:172.21.15.63:6826/1994067670,v1:172.21.15.63:6827/1994067670] up:active 2023-12-07T16:19:12.494 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:12 smithi152 ceph-mon[121113]: mds.? [v2:172.21.15.152:6824/3157779064,v1:172.21.15.152:6825/3157779064] up:boot 2023-12-07T16:19:12.494 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:12 smithi152 ceph-mon[121113]: fsmap cephfs:1 {0=cephfs.smithi063.gsjgcq=up:active} 1 up:standby 2023-12-07T16:19:12.494 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:12 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.mrvngf"}]: dispatch 2023-12-07T16:19:12.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.638+0000 7fe71fa3d700 1 -- 172.21.15.63:0/2800606544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7180fdf60 msgr2=0x7fe7180fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:12.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.638+0000 7fe71fa3d700 1 --2- 172.21.15.63:0/2800606544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7180fdf60 0x7fe7180fe3b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe708004940 tx=0x7fe708009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:12.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.639+0000 7fe71fa3d700 1 -- 172.21.15.63:0/2800606544 shutdown_connections 2023-12-07T16:19:12.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.639+0000 7fe71fa3d700 1 --2- 172.21.15.63:0/2800606544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7180fdf60 0x7fe7180fe3b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:12.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.639+0000 7fe71fa3d700 1 --2- 172.21.15.63:0/2800606544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7180faed0 0x7fe7180fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:12.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.639+0000 7fe71fa3d700 1 -- 172.21.15.63:0/2800606544 >> 172.21.15.63:0/2800606544 conn(0x7fe7180f6950 msgr2=0x7fe7180f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:12.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.639+0000 7fe71fa3d700 1 -- 172.21.15.63:0/2800606544 shutdown_connections 2023-12-07T16:19:12.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.639+0000 7fe71fa3d700 1 -- 172.21.15.63:0/2800606544 wait complete. 2023-12-07T16:19:12.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.639+0000 7fe71fa3d700 1 Processor -- start 2023-12-07T16:19:12.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.639+0000 7fe71fa3d700 1 -- start start 2023-12-07T16:19:12.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.640+0000 7fe71fa3d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7180faed0 0x7fe71810d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:12.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.640+0000 7fe71fa3d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7180fdf60 0x7fe71810da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:12.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.640+0000 7fe71fa3d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71810e080 con 0x7fe7180faed0 2023-12-07T16:19:12.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.640+0000 7fe71fa3d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71810e920 con 0x7fe7180fdf60 2023-12-07T16:19:12.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.640+0000 7fe71d7d9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7180faed0 0x7fe71810d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:12.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.640+0000 7fe71d7d9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7180faed0 0x7fe71810d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37940/0 (socket says 172.21.15.63:37940) 2023-12-07T16:19:12.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.640+0000 7fe71d7d9700 1 -- 172.21.15.63:0/1474373521 learned_addr learned my addr 172.21.15.63:0/1474373521 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:12.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.640+0000 7fe71cfd8700 1 --2- 172.21.15.63:0/1474373521 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7180fdf60 0x7fe71810da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:12.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.640+0000 7fe71cfd8700 1 -- 172.21.15.63:0/1474373521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7180faed0 msgr2=0x7fe71810d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:12.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.640+0000 7fe71cfd8700 1 --2- 172.21.15.63:0/1474373521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7180faed0 0x7fe71810d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:12.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.640+0000 7fe71cfd8700 1 -- 172.21.15.63:0/1474373521 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe708005040 con 0x7fe7180fdf60 2023-12-07T16:19:12.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.640+0000 7fe71d7d9700 1 --2- 172.21.15.63:0/1474373521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7180faed0 0x7fe71810d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T16:19:12.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.640+0000 7fe71cfd8700 1 --2- 172.21.15.63:0/1474373521 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7180fdf60 0x7fe71810da80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe708009fd0 tx=0x7fe708009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:12.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.641+0000 7fe70dffb700 1 -- 172.21.15.63:0/1474373521 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe70800e040 con 0x7fe7180fdf60 2023-12-07T16:19:12.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.641+0000 7fe71fa3d700 1 -- 172.21.15.63:0/1474373521 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71810eba0 con 0x7fe7180fdf60 2023-12-07T16:19:12.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.641+0000 7fe71fa3d700 1 -- 172.21.15.63:0/1474373521 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71810f0e0 con 0x7fe7180fdf60 2023-12-07T16:19:12.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.641+0000 7fe70dffb700 1 -- 172.21.15.63:0/1474373521 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe708013420 con 0x7fe7180fdf60 2023-12-07T16:19:12.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.641+0000 7fe70dffb700 1 -- 172.21.15.63:0/1474373521 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe70801c630 con 0x7fe7180fdf60 2023-12-07T16:19:12.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.642+0000 7fe71fa3d700 1 -- 172.21.15.63:0/1474373521 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6fc0052e0 con 0x7fe7180fdf60 2023-12-07T16:19:12.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.643+0000 7fe70dffb700 1 -- 172.21.15.63:0/1474373521 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe70800bb80 con 0x7fe7180fdf60 2023-12-07T16:19:12.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.643+0000 7fe70dffb700 1 --2- 172.21.15.63:0/1474373521 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe704068f60 0x7fe70406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:12.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.643+0000 7fe70dffb700 1 -- 172.21.15.63:0/1474373521 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe708087930 con 0x7fe7180fdf60 2023-12-07T16:19:12.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.643+0000 7fe71d7d9700 1 --2- 172.21.15.63:0/1474373521 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe704068f60 0x7fe70406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:12.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.644+0000 7fe71d7d9700 1 --2- 172.21.15.63:0/1474373521 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe704068f60 0x7fe70406b410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe71400e580 tx=0x7fe71400b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:12.646 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.648+0000 7fe70dffb700 1 -- 172.21.15.63:0/1474373521 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe708057890 con 0x7fe7180fdf60 2023-12-07T16:19:12.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:12 smithi063 ceph-mon[112095]: Deploying daemon mds.cephfs.smithi152.mrvngf on smithi152 2023-12-07T16:19:12.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:12 smithi063 ceph-mon[112095]: pgmap v130: 65 pgs: 1 creating+activating, 18 creating+peering, 46 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:19:12.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:12 smithi063 ceph-mon[112095]: mds.? [v2:172.21.15.63:6826/1994067670,v1:172.21.15.63:6827/1994067670] up:boot 2023-12-07T16:19:12.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:12 smithi063 ceph-mon[112095]: daemon mds.cephfs.smithi063.gsjgcq assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-07T16:19:12.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:12 smithi063 ceph-mon[112095]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-07T16:19:12.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:12 smithi063 ceph-mon[112095]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-07T16:19:12.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:12 smithi063 ceph-mon[112095]: Cluster is now healthy 2023-12-07T16:19:12.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:12 smithi063 ceph-mon[112095]: fsmap cephfs:0 1 up:standby 2023-12-07T16:19:12.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:12 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.gsjgcq"}]: dispatch 2023-12-07T16:19:12.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:12 smithi063 ceph-mon[112095]: fsmap cephfs:1 {0=cephfs.smithi063.gsjgcq=up:creating} 2023-12-07T16:19:12.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:12 smithi063 ceph-mon[112095]: daemon mds.cephfs.smithi063.gsjgcq is now active in filesystem cephfs as rank 0 2023-12-07T16:19:12.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:12 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:12.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:12 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:12.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:12 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:12.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:12 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi063.yidolg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-07T16:19:12.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:12 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi063.yidolg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-07T16:19:12.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:12 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:19:12.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:12 smithi063 ceph-mon[112095]: mds.? [v2:172.21.15.63:6826/1994067670,v1:172.21.15.63:6827/1994067670] up:active 2023-12-07T16:19:12.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:12 smithi063 ceph-mon[112095]: mds.? [v2:172.21.15.152:6824/3157779064,v1:172.21.15.152:6825/3157779064] up:boot 2023-12-07T16:19:12.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:12 smithi063 ceph-mon[112095]: fsmap cephfs:1 {0=cephfs.smithi063.gsjgcq=up:active} 1 up:standby 2023-12-07T16:19:12.657 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:12 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.mrvngf"}]: dispatch 2023-12-07T16:19:12.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:12.898+0000 7fe71fa3d700 1 -- 172.21.15.63:0/1474373521 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7fe6fc005b10 con 0x7fe7180fdf60 2023-12-07T16:19:13.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:13.383+0000 7fe70dffb700 1 -- 172.21.15.63:0/1474373521 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7fe708057420 con 0x7fe7180fdf60 2023-12-07T16:19:13.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:13.385+0000 7fe71fa3d700 1 -- 172.21.15.63:0/1474373521 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe704068f60 msgr2=0x7fe70406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:13.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:13.385+0000 7fe71fa3d700 1 --2- 172.21.15.63:0/1474373521 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe704068f60 0x7fe70406b410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe71400e580 tx=0x7fe71400b040 comp rx=0 tx=0).stop 2023-12-07T16:19:13.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:13.385+0000 7fe71fa3d700 1 -- 172.21.15.63:0/1474373521 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7180fdf60 msgr2=0x7fe71810da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:13.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:13.385+0000 7fe71fa3d700 1 --2- 172.21.15.63:0/1474373521 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7180fdf60 0x7fe71810da80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe708009fd0 tx=0x7fe708009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:13.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:13.385+0000 7fe71fa3d700 1 -- 172.21.15.63:0/1474373521 shutdown_connections 2023-12-07T16:19:13.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:13.385+0000 7fe71fa3d700 1 --2- 172.21.15.63:0/1474373521 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe704068f60 0x7fe70406b410 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:13.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:13.385+0000 7fe71fa3d700 1 --2- 172.21.15.63:0/1474373521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe7180faed0 0x7fe71810d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:13.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:13.385+0000 7fe71fa3d700 1 --2- 172.21.15.63:0/1474373521 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7180fdf60 0x7fe71810da80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:13.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:13.385+0000 7fe71fa3d700 1 -- 172.21.15.63:0/1474373521 >> 172.21.15.63:0/1474373521 conn(0x7fe7180f6950 msgr2=0x7fe718101190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:13.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:13.385+0000 7fe71fa3d700 1 -- 172.21.15.63:0/1474373521 shutdown_connections 2023-12-07T16:19:13.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:13.385+0000 7fe71fa3d700 1 -- 172.21.15.63:0/1474373521 wait complete. 2023-12-07T16:19:13.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:13 smithi063 ceph-mon[112095]: Deploying daemon mds.cephfs.smithi063.yidolg on smithi063 2023-12-07T16:19:13.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:13 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/1474373521' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2023-12-07T16:19:13.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:13 smithi063 ceph-mon[112095]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2023-12-07T16:19:13.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:13 smithi152 ceph-mon[121113]: Deploying daemon mds.cephfs.smithi063.yidolg on smithi063 2023-12-07T16:19:13.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:13 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/1474373521' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2023-12-07T16:19:13.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:13 smithi152 ceph-mon[121113]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2023-12-07T16:19:13.777 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-07T16:19:13.788 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi063.front.sepia.ceph.com 2023-12-07T16:19:13.788 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2023-12-07T16:19:14.222 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:19:14.488 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:14 smithi063 ceph-mon[112095]: pgmap v131: 65 pgs: 1 creating+activating, 18 creating+peering, 46 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:19:14.488 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:14 smithi063 ceph-mon[112095]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-07T16:19:14.488 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:14 smithi063 ceph-mon[112095]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2023-12-07T16:19:14.488 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:14 smithi063 ceph-mon[112095]: daemon mds.cephfs.smithi152.mrvngf assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-07T16:19:14.489 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:14 smithi063 ceph-mon[112095]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2023-12-07T16:19:14.489 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:14 smithi063 ceph-mon[112095]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-07T16:19:14.489 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:14 smithi063 ceph-mon[112095]: fsmap cephfs:1 {0=cephfs.smithi063.gsjgcq=up:active} 1 up:standby 2023-12-07T16:19:14.489 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:14 smithi063 ceph-mon[112095]: fsmap cephfs:2 {0=cephfs.smithi063.gsjgcq=up:active,1=cephfs.smithi152.mrvngf=up:creating} 2023-12-07T16:19:14.489 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:14 smithi063 ceph-mon[112095]: daemon mds.cephfs.smithi152.mrvngf is now active in filesystem cephfs as rank 1 2023-12-07T16:19:14.489 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:14 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:14.489 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:14 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:14.489 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:14 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:14.489 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:14 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.aovwwd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-07T16:19:14.489 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:14 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.aovwwd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-07T16:19:14.489 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:14 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:19:14.737 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:14 smithi152 ceph-mon[121113]: pgmap v131: 65 pgs: 1 creating+activating, 18 creating+peering, 46 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:19:14.737 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:14 smithi152 ceph-mon[121113]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-07T16:19:14.738 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:14 smithi152 ceph-mon[121113]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2023-12-07T16:19:14.738 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:14 smithi152 ceph-mon[121113]: daemon mds.cephfs.smithi152.mrvngf assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-07T16:19:14.738 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:14 smithi152 ceph-mon[121113]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2023-12-07T16:19:14.738 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:14 smithi152 ceph-mon[121113]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-07T16:19:14.738 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:14 smithi152 ceph-mon[121113]: fsmap cephfs:1 {0=cephfs.smithi063.gsjgcq=up:active} 1 up:standby 2023-12-07T16:19:14.738 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:14 smithi152 ceph-mon[121113]: fsmap cephfs:2 {0=cephfs.smithi063.gsjgcq=up:active,1=cephfs.smithi152.mrvngf=up:creating} 2023-12-07T16:19:14.738 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:14 smithi152 ceph-mon[121113]: daemon mds.cephfs.smithi152.mrvngf is now active in filesystem cephfs as rank 1 2023-12-07T16:19:14.738 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:14 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:14.738 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:14 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:14.738 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:14 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:14.739 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:14 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.aovwwd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-07T16:19:14.739 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:14 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.aovwwd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-07T16:19:14.739 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:14 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:19:15.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.206+0000 7feb69ffa700 1 -- 172.21.15.63:0/3071398441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb640fbb00 msgr2=0x7feb640fbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:15.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.206+0000 7feb69ffa700 1 --2- 172.21.15.63:0/3071398441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb640fbb00 0x7feb640fbf10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7feb54004940 tx=0x7feb54009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:15.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.206+0000 7feb69ffa700 1 -- 172.21.15.63:0/3071398441 shutdown_connections 2023-12-07T16:19:15.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.206+0000 7feb69ffa700 1 --2- 172.21.15.63:0/3071398441 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb640fcd10 0x7feb640fd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:15.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.206+0000 7feb69ffa700 1 --2- 172.21.15.63:0/3071398441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb640fbb00 0x7feb640fbf10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:15.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.206+0000 7feb69ffa700 1 -- 172.21.15.63:0/3071398441 >> 172.21.15.63:0/3071398441 conn(0x7feb640f71c0 msgr2=0x7feb640f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:15.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.206+0000 7feb69ffa700 1 -- 172.21.15.63:0/3071398441 shutdown_connections 2023-12-07T16:19:15.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.206+0000 7feb69ffa700 1 -- 172.21.15.63:0/3071398441 wait complete. 2023-12-07T16:19:15.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.206+0000 7feb69ffa700 1 Processor -- start 2023-12-07T16:19:15.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.206+0000 7feb69ffa700 1 -- start start 2023-12-07T16:19:15.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.207+0000 7feb69ffa700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb640fbb00 0x7feb6410d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:15.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.207+0000 7feb69ffa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb640fcd10 0x7feb6410da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:15.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.207+0000 7feb69ffa700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6410e000 con 0x7feb640fbb00 2023-12-07T16:19:15.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.207+0000 7feb69ffa700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6410e8a0 con 0x7feb640fcd10 2023-12-07T16:19:15.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.207+0000 7feb637fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb640fbb00 0x7feb6410d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:15.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.207+0000 7feb637fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb640fbb00 0x7feb6410d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37982/0 (socket says 172.21.15.63:37982) 2023-12-07T16:19:15.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.207+0000 7feb637fe700 1 -- 172.21.15.63:0/2865412753 learned_addr learned my addr 172.21.15.63:0/2865412753 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:15.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.207+0000 7feb62ffd700 1 --2- 172.21.15.63:0/2865412753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb640fcd10 0x7feb6410da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:15.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.207+0000 7feb637fe700 1 -- 172.21.15.63:0/2865412753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb640fcd10 msgr2=0x7feb6410da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:15.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.207+0000 7feb637fe700 1 --2- 172.21.15.63:0/2865412753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb640fcd10 0x7feb6410da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:15.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.207+0000 7feb637fe700 1 -- 172.21.15.63:0/2865412753 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb54005040 con 0x7feb640fbb00 2023-12-07T16:19:15.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.207+0000 7feb637fe700 1 --2- 172.21.15.63:0/2865412753 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb640fbb00 0x7feb6410d4c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7feb54000c00 tx=0x7feb54009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:15.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.207+0000 7feb4bfff700 1 -- 172.21.15.63:0/2865412753 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb54021070 con 0x7feb640fbb00 2023-12-07T16:19:15.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.207+0000 7feb69ffa700 1 -- 172.21.15.63:0/2865412753 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb6410eb20 con 0x7feb640fbb00 2023-12-07T16:19:15.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.207+0000 7feb4bfff700 1 -- 172.21.15.63:0/2865412753 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feb5401c400 con 0x7feb640fbb00 2023-12-07T16:19:15.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.207+0000 7feb69ffa700 1 -- 172.21.15.63:0/2865412753 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb6410f000 con 0x7feb640fbb00 2023-12-07T16:19:15.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.208+0000 7feb4bfff700 1 -- 172.21.15.63:0/2865412753 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb5400e070 con 0x7feb640fbb00 2023-12-07T16:19:15.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.208+0000 7feb69ffa700 1 -- 172.21.15.63:0/2865412753 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb6404bb80 con 0x7feb640fbb00 2023-12-07T16:19:15.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.209+0000 7feb4bfff700 1 -- 172.21.15.63:0/2865412753 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7feb5401ca00 con 0x7feb640fbb00 2023-12-07T16:19:15.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.209+0000 7feb4bfff700 1 --2- 172.21.15.63:0/2865412753 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7feb4c068f60 0x7feb4c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:15.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.209+0000 7feb4bfff700 1 -- 172.21.15.63:0/2865412753 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7feb54087f70 con 0x7feb640fbb00 2023-12-07T16:19:15.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.209+0000 7feb62ffd700 1 --2- 172.21.15.63:0/2865412753 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7feb4c068f60 0x7feb4c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:15.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.210+0000 7feb62ffd700 1 --2- 172.21.15.63:0/2865412753 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7feb4c068f60 0x7feb4c06b410 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feb58009b80 tx=0x7feb5800b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:15.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.214+0000 7feb4bfff700 1 -- 172.21.15.63:0/2865412753 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7feb540b9a00 con 0x7feb640fbb00 2023-12-07T16:19:15.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:15.456+0000 7feb69ffa700 1 -- 172.21.15.63:0/2865412753 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7feb641044a0 con 0x7feb640fbb00 2023-12-07T16:19:15.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:15 smithi063 ceph-mon[112095]: Deploying daemon mds.cephfs.smithi152.aovwwd on smithi152 2023-12-07T16:19:15.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:15 smithi063 ceph-mon[112095]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2023-12-07T16:19:15.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:15 smithi063 ceph-mon[112095]: Cluster is now healthy 2023-12-07T16:19:15.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:15 smithi063 ceph-mon[112095]: mds.? [v2:172.21.15.152:6824/3157779064,v1:172.21.15.152:6825/3157779064] up:active 2023-12-07T16:19:15.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:15 smithi063 ceph-mon[112095]: mds.? [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] up:boot 2023-12-07T16:19:15.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:15 smithi063 ceph-mon[112095]: fsmap cephfs:2 {0=cephfs.smithi063.gsjgcq=up:active,1=cephfs.smithi152.mrvngf=up:active} 1 up:standby 2023-12-07T16:19:15.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:15 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.yidolg"}]: dispatch 2023-12-07T16:19:15.681 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:15 smithi152 ceph-mon[121113]: Deploying daemon mds.cephfs.smithi152.aovwwd on smithi152 2023-12-07T16:19:15.681 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:15 smithi152 ceph-mon[121113]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2023-12-07T16:19:15.681 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:15 smithi152 ceph-mon[121113]: Cluster is now healthy 2023-12-07T16:19:15.681 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:15 smithi152 ceph-mon[121113]: mds.? [v2:172.21.15.152:6824/3157779064,v1:172.21.15.152:6825/3157779064] up:active 2023-12-07T16:19:15.681 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:15 smithi152 ceph-mon[121113]: mds.? [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] up:boot 2023-12-07T16:19:15.681 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:15 smithi152 ceph-mon[121113]: fsmap cephfs:2 {0=cephfs.smithi063.gsjgcq=up:active,1=cephfs.smithi152.mrvngf=up:active} 1 up:standby 2023-12-07T16:19:15.681 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:15 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.yidolg"}]: dispatch 2023-12-07T16:19:16.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:16.395+0000 7feb4bfff700 1 -- 172.21.15.63:0/2865412753 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7feb54057ed0 con 0x7feb640fbb00 2023-12-07T16:19:16.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:16.397+0000 7feb69ffa700 1 -- 172.21.15.63:0/2865412753 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7feb4c068f60 msgr2=0x7feb4c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:16.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:16.397+0000 7feb69ffa700 1 --2- 172.21.15.63:0/2865412753 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7feb4c068f60 0x7feb4c06b410 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feb58009b80 tx=0x7feb5800b040 comp rx=0 tx=0).stop 2023-12-07T16:19:16.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:16.397+0000 7feb69ffa700 1 -- 172.21.15.63:0/2865412753 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb640fbb00 msgr2=0x7feb6410d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:16.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:16.397+0000 7feb69ffa700 1 --2- 172.21.15.63:0/2865412753 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb640fbb00 0x7feb6410d4c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7feb54000c00 tx=0x7feb54009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:16.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:16.399+0000 7feb69ffa700 1 -- 172.21.15.63:0/2865412753 shutdown_connections 2023-12-07T16:19:16.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:16.399+0000 7feb69ffa700 1 --2- 172.21.15.63:0/2865412753 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7feb4c068f60 0x7feb4c06b410 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:16.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:16.399+0000 7feb69ffa700 1 --2- 172.21.15.63:0/2865412753 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb640fbb00 0x7feb6410d4c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:16.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:16.399+0000 7feb69ffa700 1 --2- 172.21.15.63:0/2865412753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb640fcd10 0x7feb6410da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:16.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:16.399+0000 7feb69ffa700 1 -- 172.21.15.63:0/2865412753 >> 172.21.15.63:0/2865412753 conn(0x7feb640f71c0 msgr2=0x7feb64065be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:16.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:16.399+0000 7feb69ffa700 1 -- 172.21.15.63:0/2865412753 shutdown_connections 2023-12-07T16:19:16.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:16.399+0000 7feb69ffa700 1 -- 172.21.15.63:0/2865412753 wait complete. 2023-12-07T16:19:16.643 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:16 smithi063 ceph-mon[112095]: pgmap v132: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.9 KiB/s wr, 7 op/s 2023-12-07T16:19:16.643 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:16 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2865412753' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2023-12-07T16:19:16.643 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:16 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:16.643 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:16 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:16.644 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:16 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:16.644 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:16 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:16.644 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:16 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:16.644 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:16 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:19:16.663 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:16 smithi152 ceph-mon[121113]: pgmap v132: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.9 KiB/s wr, 7 op/s 2023-12-07T16:19:16.663 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:16 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/2865412753' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2023-12-07T16:19:16.663 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:16 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:16.663 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:16 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:16.663 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:16 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:16.664 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:16 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:16.664 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:16 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:16.664 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:16 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:19:17.061 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-07T16:19:17.075 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi063.front.sepia.ceph.com 2023-12-07T16:19:17.075 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2023-12-07T16:19:17.508 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:19:17.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:17 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2865412753' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2023-12-07T16:19:17.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:17 smithi063 ceph-mon[112095]: mds.? [v2:172.21.15.152:6826/2906349729,v1:172.21.15.152:6827/2906349729] up:boot 2023-12-07T16:19:17.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:17 smithi063 ceph-mon[112095]: fsmap cephfs:2 {0=cephfs.smithi063.gsjgcq=up:active,1=cephfs.smithi152.mrvngf=up:active} 2 up:standby 2023-12-07T16:19:17.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:17 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.aovwwd"}]: dispatch 2023-12-07T16:19:17.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:17 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/2865412753' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2023-12-07T16:19:17.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:17 smithi152 ceph-mon[121113]: mds.? [v2:172.21.15.152:6826/2906349729,v1:172.21.15.152:6827/2906349729] up:boot 2023-12-07T16:19:17.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:17 smithi152 ceph-mon[121113]: fsmap cephfs:2 {0=cephfs.smithi063.gsjgcq=up:active,1=cephfs.smithi152.mrvngf=up:active} 2 up:standby 2023-12-07T16:19:17.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:17 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.aovwwd"}]: dispatch 2023-12-07T16:19:18.635 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:18 smithi063 ceph-mon[112095]: pgmap v133: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s wr, 10 op/s 2023-12-07T16:19:18.635 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:18 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:18.635 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:18 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:18.635 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:18 smithi063 ceph-mon[112095]: mds.? [v2:172.21.15.152:6824/3157779064,v1:172.21.15.152:6825/3157779064] up:active 2023-12-07T16:19:18.635 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:18 smithi063 ceph-mon[112095]: mds.? [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] up:standby 2023-12-07T16:19:18.635 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:18 smithi063 ceph-mon[112095]: Dropping low affinity active daemon mds.cephfs.smithi063.gsjgcq in favor of higher affinity standby. 2023-12-07T16:19:18.635 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:18 smithi063 ceph-mon[112095]: Replacing daemon mds.cephfs.smithi063.gsjgcq as rank 0 with standby daemon mds.cephfs.smithi063.yidolg 2023-12-07T16:19:18.635 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:18 smithi063 ceph-mon[112095]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-07T16:19:18.636 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:18 smithi063 ceph-mon[112095]: fsmap cephfs:2 {0=cephfs.smithi063.gsjgcq=up:active,1=cephfs.smithi152.mrvngf=up:active} 2 up:standby 2023-12-07T16:19:18.636 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:18 smithi063 ceph-mon[112095]: osdmap e45: 6 total, 6 up, 6 in 2023-12-07T16:19:18.636 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:18 smithi063 ceph-mon[112095]: fsmap cephfs:2/2 {0=cephfs.smithi063.yidolg=up:replay,1=cephfs.smithi152.mrvngf=up:active} 1 up:standby 2023-12-07T16:19:18.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:18 smithi152 ceph-mon[121113]: pgmap v133: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s wr, 10 op/s 2023-12-07T16:19:18.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:18 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:18.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:18 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:18.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:18 smithi152 ceph-mon[121113]: mds.? [v2:172.21.15.152:6824/3157779064,v1:172.21.15.152:6825/3157779064] up:active 2023-12-07T16:19:18.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:18 smithi152 ceph-mon[121113]: mds.? [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] up:standby 2023-12-07T16:19:18.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:18 smithi152 ceph-mon[121113]: Dropping low affinity active daemon mds.cephfs.smithi063.gsjgcq in favor of higher affinity standby. 2023-12-07T16:19:18.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:18 smithi152 ceph-mon[121113]: Replacing daemon mds.cephfs.smithi063.gsjgcq as rank 0 with standby daemon mds.cephfs.smithi063.yidolg 2023-12-07T16:19:18.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:18 smithi152 ceph-mon[121113]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-07T16:19:18.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:18 smithi152 ceph-mon[121113]: fsmap cephfs:2 {0=cephfs.smithi063.gsjgcq=up:active,1=cephfs.smithi152.mrvngf=up:active} 2 up:standby 2023-12-07T16:19:18.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:18 smithi152 ceph-mon[121113]: osdmap e45: 6 total, 6 up, 6 in 2023-12-07T16:19:18.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:18 smithi152 ceph-mon[121113]: fsmap cephfs:2/2 {0=cephfs.smithi063.yidolg=up:replay,1=cephfs.smithi152.mrvngf=up:active} 1 up:standby 2023-12-07T16:19:18.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.839+0000 7f490d0b6700 1 -- 172.21.15.63:0/1612769636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49080fd730 msgr2=0x7f49080ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:18.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.839+0000 7f490d0b6700 1 --2- 172.21.15.63:0/1612769636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49080fd730 0x7f49080ffb10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f48f8004940 tx=0x7f48f8009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:18.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.839+0000 7f490d0b6700 1 -- 172.21.15.63:0/1612769636 shutdown_connections 2023-12-07T16:19:18.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.839+0000 7f490d0b6700 1 --2- 172.21.15.63:0/1612769636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4908100050 0x7f4908102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:18.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.839+0000 7f490d0b6700 1 --2- 172.21.15.63:0/1612769636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49080fd730 0x7f49080ffb10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:18.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.839+0000 7f490d0b6700 1 -- 172.21.15.63:0/1612769636 >> 172.21.15.63:0/1612769636 conn(0x7f49080f7190 msgr2=0x7f49080f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:18.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.839+0000 7f490d0b6700 1 -- 172.21.15.63:0/1612769636 shutdown_connections 2023-12-07T16:19:18.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.839+0000 7f490d0b6700 1 -- 172.21.15.63:0/1612769636 wait complete. 2023-12-07T16:19:18.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.840+0000 7f490d0b6700 1 Processor -- start 2023-12-07T16:19:18.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.840+0000 7f490d0b6700 1 -- start start 2023-12-07T16:19:18.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.840+0000 7f490d0b6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49080fd730 0x7f490810d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:18.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.840+0000 7f490d0b6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4908100050 0x7f490810da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:18.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.840+0000 7f490d0b6700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490810e060 con 0x7f49080fd730 2023-12-07T16:19:18.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.840+0000 7f490d0b6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490810e900 con 0x7f4908100050 2023-12-07T16:19:18.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.840+0000 7f4906d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49080fd730 0x7f490810d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:18.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.840+0000 7f4906d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49080fd730 0x7f490810d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38022/0 (socket says 172.21.15.63:38022) 2023-12-07T16:19:18.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.840+0000 7f4906d9d700 1 -- 172.21.15.63:0/3512635911 learned_addr learned my addr 172.21.15.63:0/3512635911 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:18.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.840+0000 7f490659c700 1 --2- 172.21.15.63:0/3512635911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4908100050 0x7f490810da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:18.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.840+0000 7f4906d9d700 1 -- 172.21.15.63:0/3512635911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4908100050 msgr2=0x7f490810da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:18.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.840+0000 7f4906d9d700 1 --2- 172.21.15.63:0/3512635911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4908100050 0x7f490810da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:18.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.840+0000 7f4906d9d700 1 -- 172.21.15.63:0/3512635911 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f8005040 con 0x7f49080fd730 2023-12-07T16:19:18.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.840+0000 7f490659c700 1 --2- 172.21.15.63:0/3512635911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4908100050 0x7f490810da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T16:19:18.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.840+0000 7f4906d9d700 1 --2- 172.21.15.63:0/3512635911 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49080fd730 0x7f490810d520 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f48f8009360 tx=0x7f48f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:18.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.841+0000 7f48ff7fe700 1 -- 172.21.15.63:0/3512635911 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48f800e040 con 0x7f49080fd730 2023-12-07T16:19:18.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.841+0000 7f490d0b6700 1 -- 172.21.15.63:0/3512635911 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f490810eb80 con 0x7f49080fd730 2023-12-07T16:19:18.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.841+0000 7f48ff7fe700 1 -- 172.21.15.63:0/3512635911 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f48f800bcd0 con 0x7f49080fd730 2023-12-07T16:19:18.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.841+0000 7f48ff7fe700 1 -- 172.21.15.63:0/3512635911 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48f801c630 con 0x7f49080fd730 2023-12-07T16:19:18.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.841+0000 7f490d0b6700 1 -- 172.21.15.63:0/3512635911 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f490810f0c0 con 0x7f49080fd730 2023-12-07T16:19:18.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.842+0000 7f490d0b6700 1 -- 172.21.15.63:0/3512635911 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49081075e0 con 0x7f49080fd730 2023-12-07T16:19:18.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.842+0000 7f48ff7fe700 1 -- 172.21.15.63:0/3512635911 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f48f8013960 con 0x7f49080fd730 2023-12-07T16:19:18.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.842+0000 7f48ff7fe700 1 --2- 172.21.15.63:0/3512635911 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f48f4068f60 0x7f48f406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:18.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.843+0000 7f48ff7fe700 1 -- 172.21.15.63:0/3512635911 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f48f80882b0 con 0x7f49080fd730 2023-12-07T16:19:18.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.843+0000 7f490659c700 1 --2- 172.21.15.63:0/3512635911 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f48f4068f60 0x7f48f406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:18.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.843+0000 7f490659c700 1 --2- 172.21.15.63:0/3512635911 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f48f4068f60 0x7f48f406b410 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f48f00041d0 tx=0x7f48f0009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:18.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:18.847+0000 7f48ff7fe700 1 -- 172.21.15.63:0/3512635911 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f48f80581c0 con 0x7f49080fd730 2023-12-07T16:19:19.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:19.104+0000 7f490d0b6700 1 -- 172.21.15.63:0/3512635911 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f490804bb80 con 0x7f49080fd730 2023-12-07T16:19:19.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:19.407+0000 7f48ff7fe700 1 -- 172.21.15.63:0/3512635911 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v12) v1 ==== 168+0+0 (secure 0 0 0) 0x7f48f8057d50 con 0x7f49080fd730 2023-12-07T16:19:19.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:19.409+0000 7f490d0b6700 1 -- 172.21.15.63:0/3512635911 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f48f4068f60 msgr2=0x7f48f406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:19.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:19.409+0000 7f490d0b6700 1 --2- 172.21.15.63:0/3512635911 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f48f4068f60 0x7f48f406b410 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f48f00041d0 tx=0x7f48f0009040 comp rx=0 tx=0).stop 2023-12-07T16:19:19.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:19.409+0000 7f490d0b6700 1 -- 172.21.15.63:0/3512635911 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49080fd730 msgr2=0x7f490810d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:19.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:19.409+0000 7f490d0b6700 1 --2- 172.21.15.63:0/3512635911 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49080fd730 0x7f490810d520 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f48f8009360 tx=0x7f48f8009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:19.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:19.409+0000 7f490d0b6700 1 -- 172.21.15.63:0/3512635911 shutdown_connections 2023-12-07T16:19:19.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:19.409+0000 7f490d0b6700 1 --2- 172.21.15.63:0/3512635911 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f48f4068f60 0x7f48f406b410 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:19.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:19.409+0000 7f490d0b6700 1 --2- 172.21.15.63:0/3512635911 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49080fd730 0x7f490810d520 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:19.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:19.409+0000 7f490d0b6700 1 --2- 172.21.15.63:0/3512635911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4908100050 0x7f490810da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:19.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:19.409+0000 7f490d0b6700 1 -- 172.21.15.63:0/3512635911 >> 172.21.15.63:0/3512635911 conn(0x7f49080f7190 msgr2=0x7f49080f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:19.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:19.410+0000 7f490d0b6700 1 -- 172.21.15.63:0/3512635911 shutdown_connections 2023-12-07T16:19:19.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:19.410+0000 7f490d0b6700 1 -- 172.21.15.63:0/3512635911 wait complete. 2023-12-07T16:19:19.408 INFO:teuthology.orchestra.run.smithi063.stderr:inline data enabled 2023-12-07T16:19:19.741 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:19 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/3512635911' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-07T16:19:19.741 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:19 smithi063 ceph-mon[112095]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2023-12-07T16:19:19.741 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:19 smithi063 ceph-mon[112095]: mds.? [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] up:resolve 2023-12-07T16:19:19.741 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:19 smithi063 ceph-mon[112095]: mds.? [v2:172.21.15.63:6826/3063200414,v1:172.21.15.63:6827/3063200414] up:boot 2023-12-07T16:19:19.741 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:19 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/3512635911' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2023-12-07T16:19:19.741 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:19 smithi063 ceph-mon[112095]: fsmap cephfs:2/2 {0=cephfs.smithi063.yidolg=up:resolve,1=cephfs.smithi152.mrvngf=up:active} 2 up:standby 2023-12-07T16:19:19.742 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:19 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.gsjgcq"}]: dispatch 2023-12-07T16:19:19.784 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-07T16:19:19.793 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi063.front.sepia.ceph.com 2023-12-07T16:19:19.794 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-07T16:19:19.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:19 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/3512635911' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-07T16:19:19.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:19 smithi152 ceph-mon[121113]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2023-12-07T16:19:19.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:19 smithi152 ceph-mon[121113]: mds.? [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] up:resolve 2023-12-07T16:19:19.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:19 smithi152 ceph-mon[121113]: mds.? [v2:172.21.15.63:6826/3063200414,v1:172.21.15.63:6827/3063200414] up:boot 2023-12-07T16:19:19.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:19 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/3512635911' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2023-12-07T16:19:19.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:19 smithi152 ceph-mon[121113]: fsmap cephfs:2/2 {0=cephfs.smithi063.yidolg=up:resolve,1=cephfs.smithi152.mrvngf=up:active} 2 up:standby 2023-12-07T16:19:19.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:19 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.gsjgcq"}]: dispatch 2023-12-07T16:19:20.081 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:19:20.882 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:20 smithi063 ceph-mon[112095]: pgmap v135: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 229 B/s rd, 2.7 KiB/s wr, 9 op/s 2023-12-07T16:19:20.882 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:20 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:20.882 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:20 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:20.882 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:20 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:19:20.883 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:20 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:19:20.883 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:20 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:20.883 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:20 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:20.883 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:20 smithi063 ceph-mon[112095]: mds.? [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] up:reconnect 2023-12-07T16:19:20.883 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:20 smithi063 ceph-mon[112095]: mds.? [v2:172.21.15.152:6826/2906349729,v1:172.21.15.152:6827/2906349729] up:standby 2023-12-07T16:19:20.883 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:20 smithi063 ceph-mon[112095]: fsmap cephfs:2/2 {0=cephfs.smithi063.yidolg=up:reconnect,1=cephfs.smithi152.mrvngf=up:active} 2 up:standby 2023-12-07T16:19:20.883 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:20 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:19:20.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:20 smithi152 ceph-mon[121113]: pgmap v135: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 229 B/s rd, 2.7 KiB/s wr, 9 op/s 2023-12-07T16:19:20.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:20 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:20.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:20 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:20.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:20 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:19:20.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:20 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:19:20.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:20 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:20.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:20 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:20.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:20 smithi152 ceph-mon[121113]: mds.? [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] up:reconnect 2023-12-07T16:19:20.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:20 smithi152 ceph-mon[121113]: mds.? [v2:172.21.15.152:6826/2906349729,v1:172.21.15.152:6827/2906349729] up:standby 2023-12-07T16:19:20.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:20 smithi152 ceph-mon[121113]: fsmap cephfs:2/2 {0=cephfs.smithi063.yidolg=up:reconnect,1=cephfs.smithi152.mrvngf=up:active} 2 up:standby 2023-12-07T16:19:20.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:20 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:19:21.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.062+0000 7ff1b2c82700 1 -- 172.21.15.63:0/770710329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1ac0fcbf0 msgr2=0x7ff1ac0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:21.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.062+0000 7ff1b2c82700 1 --2- 172.21.15.63:0/770710329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1ac0fcbf0 0x7ff1ac0fd000 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0004940 tx=0x7ff1a0009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:21.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.062+0000 7ff1b2c82700 1 -- 172.21.15.63:0/770710329 shutdown_connections 2023-12-07T16:19:21.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.062+0000 7ff1b2c82700 1 --2- 172.21.15.63:0/770710329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1ac0fde00 0x7ff1ac0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:21.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.062+0000 7ff1b2c82700 1 --2- 172.21.15.63:0/770710329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1ac0fcbf0 0x7ff1ac0fd000 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:21.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.062+0000 7ff1b2c82700 1 -- 172.21.15.63:0/770710329 >> 172.21.15.63:0/770710329 conn(0x7ff1ac0f82d0 msgr2=0x7ff1ac0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:21.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.062+0000 7ff1b2c82700 1 -- 172.21.15.63:0/770710329 shutdown_connections 2023-12-07T16:19:21.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.062+0000 7ff1b2c82700 1 -- 172.21.15.63:0/770710329 wait complete. 2023-12-07T16:19:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.063+0000 7ff1b2c82700 1 Processor -- start 2023-12-07T16:19:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.063+0000 7ff1b2c82700 1 -- start start 2023-12-07T16:19:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.063+0000 7ff1b2c82700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1ac0fcbf0 0x7ff1ac10d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.063+0000 7ff1b2c82700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1ac0fde00 0x7ff1ac10db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.063+0000 7ff1b2c82700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac10e1e0 con 0x7ff1ac0fcbf0 2023-12-07T16:19:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.063+0000 7ff1b2c82700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac10ea20 con 0x7ff1ac0fde00 2023-12-07T16:19:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.063+0000 7ff1b0a1e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1ac0fcbf0 0x7ff1ac10d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.063+0000 7ff1b0a1e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1ac0fcbf0 0x7ff1ac10d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55344/0 (socket says 172.21.15.63:55344) 2023-12-07T16:19:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.063+0000 7ff1b0a1e700 1 -- 172.21.15.63:0/1423002481 learned_addr learned my addr 172.21.15.63:0/1423002481 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.063+0000 7ff1b0a1e700 1 -- 172.21.15.63:0/1423002481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1ac0fde00 msgr2=0x7ff1ac10db50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-07T16:19:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.063+0000 7ff1b0a1e700 1 --2- 172.21.15.63:0/1423002481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1ac0fde00 0x7ff1ac10db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.063+0000 7ff1b0a1e700 1 -- 172.21.15.63:0/1423002481 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a0005040 con 0x7ff1ac0fcbf0 2023-12-07T16:19:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.064+0000 7ff1b0a1e700 1 --2- 172.21.15.63:0/1423002481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1ac0fcbf0 0x7ff1ac10d610 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0000c00 tx=0x7ff1a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.064+0000 7ff1a97fa700 1 -- 172.21.15.63:0/1423002481 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1a000e030 con 0x7ff1ac0fcbf0 2023-12-07T16:19:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.064+0000 7ff1a97fa700 1 -- 172.21.15.63:0/1423002481 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff1a0004290 con 0x7ff1ac0fcbf0 2023-12-07T16:19:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.064+0000 7ff1b2c82700 1 -- 172.21.15.63:0/1423002481 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1ac10eca0 con 0x7ff1ac0fcbf0 2023-12-07T16:19:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.064+0000 7ff1a97fa700 1 -- 172.21.15.63:0/1423002481 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1a001c400 con 0x7ff1ac0fcbf0 2023-12-07T16:19:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.064+0000 7ff1b2c82700 1 -- 172.21.15.63:0/1423002481 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ac10f1e0 con 0x7ff1ac0fcbf0 2023-12-07T16:19:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.065+0000 7ff1b2c82700 1 -- 172.21.15.63:0/1423002481 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1ac04bb80 con 0x7ff1ac0fcbf0 2023-12-07T16:19:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.065+0000 7ff1a97fa700 1 -- 172.21.15.63:0/1423002481 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff1a0013420 con 0x7ff1ac0fcbf0 2023-12-07T16:19:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.066+0000 7ff1a97fa700 1 --2- 172.21.15.63:0/1423002481 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff19c068f60 0x7ff19c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.066+0000 7ff1a97fa700 1 -- 172.21.15.63:0/1423002481 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff1a0088620 con 0x7ff1ac0fcbf0 2023-12-07T16:19:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.066+0000 7ff1abfff700 1 --2- 172.21.15.63:0/1423002481 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff19c068f60 0x7ff19c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.066+0000 7ff1abfff700 1 --2- 172.21.15.63:0/1423002481 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff19c068f60 0x7ff19c06b410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff198009740 tx=0x7ff198006c60 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:21.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.070+0000 7ff1a97fa700 1 -- 172.21.15.63:0/1423002481 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff1a00585d0 con 0x7ff1ac0fcbf0 2023-12-07T16:19:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.314+0000 7ff1b2c82700 1 -- 172.21.15.63:0/1423002481 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff1ac10f820 con 0x7ff1ac0fcbf0 2023-12-07T16:19:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.315+0000 7ff1a97fa700 1 -- 172.21.15.63:0/1423002481 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1822 (secure 0 0 0) 0x7ff1a0058160 con 0x7ff1ac0fcbf0 2023-12-07T16:19:21.313 INFO:teuthology.orchestra.run.smithi063.stdout:e13 2023-12-07T16:19:21.313 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-07T16:19:21.314 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:19:21.314 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-07T16:19:21.314 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:19:21.314 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-07T16:19:21.314 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-07T16:19:21.314 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 13 2023-12-07T16:19:21.314 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-07T16:19:21.314 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-07T16:19:08.352640+0000 2023-12-07T16:19:21.314 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-07T16:19:20.404921+0000 2023-12-07T16:19:21.314 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-07T16:19:21.315 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-07T16:19:21.315 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-07T16:19:21.315 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-07T16:19:21.315 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-07T16:19:21.315 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-07T16:19:21.315 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-07T16:19:21.315 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 45 2023-12-07T16:19:21.315 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:19:21.315 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 2 2023-12-07T16:19:21.315 INFO:teuthology.orchestra.run.smithi063.stdout:in 0,1 2023-12-07T16:19:21.316 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14478,1=24269} 2023-12-07T16:19:21.316 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-07T16:19:21.316 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-07T16:19:21.316 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-07T16:19:21.316 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-07T16:19:21.316 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-07T16:19:21.316 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-07T16:19:21.316 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-07T16:19:21.316 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-07T16:19:21.316 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.yidolg{0:14478} state up:reconnect seq 4 join_fscid=1 addr [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:19:21.316 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.mrvngf{1:24269} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.152:6824/3157779064,v1:172.21.15.152:6825/3157779064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:19:21.317 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:19:21.317 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:19:21.317 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-07T16:19:21.317 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:19:21.317 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.gsjgcq{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/3063200414,v1:172.21.15.63:6827/3063200414] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:19:21.317 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.aovwwd{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/2906349729,v1:172.21.15.152:6827/2906349729] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:19:21.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.317+0000 7ff1b2c82700 1 -- 172.21.15.63:0/1423002481 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff19c068f60 msgr2=0x7ff19c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:21.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.317+0000 7ff1b2c82700 1 --2- 172.21.15.63:0/1423002481 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff19c068f60 0x7ff19c06b410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff198009740 tx=0x7ff198006c60 comp rx=0 tx=0).stop 2023-12-07T16:19:21.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.317+0000 7ff1b2c82700 1 -- 172.21.15.63:0/1423002481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1ac0fcbf0 msgr2=0x7ff1ac10d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:21.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.317+0000 7ff1b2c82700 1 --2- 172.21.15.63:0/1423002481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1ac0fcbf0 0x7ff1ac10d610 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0000c00 tx=0x7ff1a0009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:21.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.317+0000 7ff1b2c82700 1 -- 172.21.15.63:0/1423002481 shutdown_connections 2023-12-07T16:19:21.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.317+0000 7ff1b2c82700 1 --2- 172.21.15.63:0/1423002481 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff19c068f60 0x7ff19c06b410 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:21.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.317+0000 7ff1b2c82700 1 --2- 172.21.15.63:0/1423002481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1ac0fcbf0 0x7ff1ac10d610 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:21.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.317+0000 7ff1b2c82700 1 --2- 172.21.15.63:0/1423002481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1ac0fde00 0x7ff1ac10db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:21.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.317+0000 7ff1b2c82700 1 -- 172.21.15.63:0/1423002481 >> 172.21.15.63:0/1423002481 conn(0x7ff1ac0f82d0 msgr2=0x7ff1ac101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:21.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.317+0000 7ff1b2c82700 1 -- 172.21.15.63:0/1423002481 shutdown_connections 2023-12-07T16:19:21.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:21.317+0000 7ff1b2c82700 1 -- 172.21.15.63:0/1423002481 wait complete. 2023-12-07T16:19:21.319 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 13 2023-12-07T16:19:21.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:21 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/1423002481' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:19:21.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:21 smithi152 ceph-mon[121113]: mds.? [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] up:rejoin 2023-12-07T16:19:21.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:21 smithi152 ceph-mon[121113]: fsmap cephfs:2/2 {0=cephfs.smithi063.yidolg=up:rejoin,1=cephfs.smithi152.mrvngf=up:active} 2 up:standby 2023-12-07T16:19:21.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:21 smithi152 ceph-mon[121113]: daemon mds.cephfs.smithi063.yidolg is now active in filesystem cephfs as rank 0 2023-12-07T16:19:21.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:21 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/1423002481' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:19:21.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:21 smithi063 ceph-mon[112095]: mds.? [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] up:rejoin 2023-12-07T16:19:21.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:21 smithi063 ceph-mon[112095]: fsmap cephfs:2/2 {0=cephfs.smithi063.yidolg=up:rejoin,1=cephfs.smithi152.mrvngf=up:active} 2 up:standby 2023-12-07T16:19:21.800 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:21 smithi063 ceph-mon[112095]: daemon mds.cephfs.smithi063.yidolg is now active in filesystem cephfs as rank 0 2023-12-07T16:19:21.823 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2023-12-07T16:19:22.224 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:19:22.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:22 smithi063 ceph-mon[112095]: pgmap v136: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2023-12-07T16:19:22.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:22 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:22.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:22 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:22.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:22 smithi063 ceph-mon[112095]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-07T16:19:22.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:22 smithi063 ceph-mon[112095]: mds.? [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] up:active 2023-12-07T16:19:22.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:22 smithi063 ceph-mon[112095]: fsmap cephfs:2 {0=cephfs.smithi063.yidolg=up:active,1=cephfs.smithi152.mrvngf=up:active} 2 up:standby 2023-12-07T16:19:22.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:22 smithi152 ceph-mon[121113]: pgmap v136: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2023-12-07T16:19:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:22 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:22 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:22 smithi152 ceph-mon[121113]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-07T16:19:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:22 smithi152 ceph-mon[121113]: mds.? [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] up:active 2023-12-07T16:19:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:22 smithi152 ceph-mon[121113]: fsmap cephfs:2 {0=cephfs.smithi063.yidolg=up:active,1=cephfs.smithi152.mrvngf=up:active} 2 up:standby 2023-12-07T16:19:23.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.512+0000 7fd85d394700 1 -- 172.21.15.63:0/2655554580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd858066920 msgr2=0x7fd8580ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:23.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.512+0000 7fd85d394700 1 --2- 172.21.15.63:0/2655554580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd858066920 0x7fd8580ff7a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd848004940 tx=0x7fd848009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:23.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.512+0000 7fd85d394700 1 -- 172.21.15.63:0/2655554580 shutdown_connections 2023-12-07T16:19:23.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.512+0000 7fd85d394700 1 --2- 172.21.15.63:0/2655554580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8580ffd70 0x7fd8581021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:23.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.512+0000 7fd85d394700 1 --2- 172.21.15.63:0/2655554580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd858066920 0x7fd8580ff7a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:23.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.512+0000 7fd85d394700 1 -- 172.21.15.63:0/2655554580 >> 172.21.15.63:0/2655554580 conn(0x7fd8580f71d0 msgr2=0x7fd8580f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:23.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.512+0000 7fd85d394700 1 -- 172.21.15.63:0/2655554580 shutdown_connections 2023-12-07T16:19:23.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.512+0000 7fd85d394700 1 -- 172.21.15.63:0/2655554580 wait complete. 2023-12-07T16:19:23.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.513+0000 7fd85d394700 1 Processor -- start 2023-12-07T16:19:23.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.513+0000 7fd85d394700 1 -- start start 2023-12-07T16:19:23.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.513+0000 7fd85d394700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd858066920 0x7fd8580fd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:23.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.513+0000 7fd85d394700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8580ffd70 0x7fd8580fb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:23.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.513+0000 7fd85d394700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8580fbca0 con 0x7fd858066920 2023-12-07T16:19:23.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.513+0000 7fd85d394700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8580fbe10 con 0x7fd8580ffd70 2023-12-07T16:19:23.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.513+0000 7fd856ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd858066920 0x7fd8580fd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:23.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.513+0000 7fd856ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd858066920 0x7fd8580fd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55364/0 (socket says 172.21.15.63:55364) 2023-12-07T16:19:23.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.513+0000 7fd856ffd700 1 -- 172.21.15.63:0/1488885432 learned_addr learned my addr 172.21.15.63:0/1488885432 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:23.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.514+0000 7fd8567fc700 1 --2- 172.21.15.63:0/1488885432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8580ffd70 0x7fd8580fb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:23.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.514+0000 7fd856ffd700 1 -- 172.21.15.63:0/1488885432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8580ffd70 msgr2=0x7fd8580fb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:23.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.514+0000 7fd856ffd700 1 --2- 172.21.15.63:0/1488885432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8580ffd70 0x7fd8580fb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:23.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.514+0000 7fd856ffd700 1 -- 172.21.15.63:0/1488885432 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd848005040 con 0x7fd858066920 2023-12-07T16:19:23.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.514+0000 7fd856ffd700 1 --2- 172.21.15.63:0/1488885432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd858066920 0x7fd8580fd220 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd848009360 tx=0x7fd848009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:23.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.514+0000 7fd83f7fe700 1 -- 172.21.15.63:0/1488885432 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd84800e040 con 0x7fd858066920 2023-12-07T16:19:23.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.514+0000 7fd85d394700 1 -- 172.21.15.63:0/1488885432 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8580fc090 con 0x7fd858066920 2023-12-07T16:19:23.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.514+0000 7fd83f7fe700 1 -- 172.21.15.63:0/1488885432 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd84800bcd0 con 0x7fd858066920 2023-12-07T16:19:23.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.514+0000 7fd83f7fe700 1 -- 172.21.15.63:0/1488885432 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd84801c630 con 0x7fd858066920 2023-12-07T16:19:23.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.514+0000 7fd85d394700 1 -- 172.21.15.63:0/1488885432 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8581155b0 con 0x7fd858066920 2023-12-07T16:19:23.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.515+0000 7fd85d394700 1 -- 172.21.15.63:0/1488885432 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8581075e0 con 0x7fd858066920 2023-12-07T16:19:23.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.515+0000 7fd83f7fe700 1 -- 172.21.15.63:0/1488885432 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd848013960 con 0x7fd858066920 2023-12-07T16:19:23.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.516+0000 7fd83f7fe700 1 --2- 172.21.15.63:0/1488885432 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd840068f60 0x7fd84006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:23.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.516+0000 7fd83f7fe700 1 -- 172.21.15.63:0/1488885432 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd8480882b0 con 0x7fd858066920 2023-12-07T16:19:23.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.516+0000 7fd8567fc700 1 --2- 172.21.15.63:0/1488885432 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd840068f60 0x7fd84006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:23.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.516+0000 7fd8567fc700 1 --2- 172.21.15.63:0/1488885432 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd840068f60 0x7fd84006b410 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd858066660 tx=0x7fd84c009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:23.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.520+0000 7fd83f7fe700 1 -- 172.21.15.63:0/1488885432 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd8480581c0 con 0x7fd858066920 2023-12-07T16:19:23.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.770+0000 7fd85d394700 1 -- 172.21.15.63:0/1488885432 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd85804bb80 con 0x7fd858066920 2023-12-07T16:19:23.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.771+0000 7fd83f7fe700 1 -- 172.21.15.63:0/1488885432 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4709 (secure 0 0 0) 0x7fd848057d50 con 0x7fd858066920 2023-12-07T16:19:23.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.773+0000 7fd85d394700 1 -- 172.21.15.63:0/1488885432 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd840068f60 msgr2=0x7fd84006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:23.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.773+0000 7fd85d394700 1 --2- 172.21.15.63:0/1488885432 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd840068f60 0x7fd84006b410 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd858066660 tx=0x7fd84c009040 comp rx=0 tx=0).stop 2023-12-07T16:19:23.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.773+0000 7fd85d394700 1 -- 172.21.15.63:0/1488885432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd858066920 msgr2=0x7fd8580fd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:23.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.773+0000 7fd85d394700 1 --2- 172.21.15.63:0/1488885432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd858066920 0x7fd8580fd220 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd848009360 tx=0x7fd848009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:23.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.773+0000 7fd85d394700 1 -- 172.21.15.63:0/1488885432 shutdown_connections 2023-12-07T16:19:23.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.773+0000 7fd85d394700 1 --2- 172.21.15.63:0/1488885432 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd840068f60 0x7fd84006b410 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:23.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.773+0000 7fd85d394700 1 --2- 172.21.15.63:0/1488885432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd858066920 0x7fd8580fd220 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:23.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.773+0000 7fd85d394700 1 --2- 172.21.15.63:0/1488885432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8580ffd70 0x7fd8580fb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:23.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.773+0000 7fd85d394700 1 -- 172.21.15.63:0/1488885432 >> 172.21.15.63:0/1488885432 conn(0x7fd8580f71d0 msgr2=0x7fd8580f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:23.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.774+0000 7fd85d394700 1 -- 172.21.15.63:0/1488885432 shutdown_connections 2023-12-07T16:19:23.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:23.774+0000 7fd85d394700 1 -- 172.21.15.63:0/1488885432 wait complete. 2023-12-07T16:19:23.772 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 15 2023-12-07T16:19:23.783 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-07T16:19:24.176 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2023-12-07T16:19:24.473 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:19:24.787 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:24 smithi063 ceph-mon[112095]: pgmap v137: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2023-12-07T16:19:24.788 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:24 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/1488885432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-07T16:19:24.788 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:24 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:24.788 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:24 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:24.788 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:24 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:19:24.788 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:24 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:19:24.788 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:24 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:24.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:24 smithi152 ceph-mon[121113]: pgmap v137: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2023-12-07T16:19:24.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:24 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/1488885432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-07T16:19:24.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:24 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:24.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:24 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:24.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:24 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:19:24.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:24 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:19:24.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:24 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:25.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.504+0000 7f90e044f700 1 -- 172.21.15.63:0/376668886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90d80fcd00 msgr2=0x7f90d80fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:25.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.504+0000 7f90e044f700 1 --2- 172.21.15.63:0/376668886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90d80fcd00 0x7f90d80fd150 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f90c8004940 tx=0x7f90c8009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:25.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.504+0000 7f90e044f700 1 -- 172.21.15.63:0/376668886 shutdown_connections 2023-12-07T16:19:25.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.504+0000 7f90e044f700 1 --2- 172.21.15.63:0/376668886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90d80fcd00 0x7f90d80fd150 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:25.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.504+0000 7f90e044f700 1 --2- 172.21.15.63:0/376668886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90d80fbaf0 0x7f90d80fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:25.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.504+0000 7f90e044f700 1 -- 172.21.15.63:0/376668886 >> 172.21.15.63:0/376668886 conn(0x7f90d80f7190 msgr2=0x7f90d80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:25.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.504+0000 7f90e044f700 1 -- 172.21.15.63:0/376668886 shutdown_connections 2023-12-07T16:19:25.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.504+0000 7f90e044f700 1 -- 172.21.15.63:0/376668886 wait complete. 2023-12-07T16:19:25.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.504+0000 7f90e044f700 1 Processor -- start 2023-12-07T16:19:25.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.505+0000 7f90e044f700 1 -- start start 2023-12-07T16:19:25.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.505+0000 7f90e044f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90d80fbaf0 0x7f90d810c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:25.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.505+0000 7f90e044f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90d80fcd00 0x7f90d810c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:25.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.505+0000 7f90e044f700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d810cfb0 con 0x7f90d80fbaf0 2023-12-07T16:19:25.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.505+0000 7f90e044f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d810d850 con 0x7f90d80fcd00 2023-12-07T16:19:25.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.505+0000 7f90de1eb700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90d80fbaf0 0x7f90d810c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:25.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.505+0000 7f90de1eb700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90d80fbaf0 0x7f90d810c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55370/0 (socket says 172.21.15.63:55370) 2023-12-07T16:19:25.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.505+0000 7f90de1eb700 1 -- 172.21.15.63:0/1042961801 learned_addr learned my addr 172.21.15.63:0/1042961801 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:25.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.505+0000 7f90dd9ea700 1 --2- 172.21.15.63:0/1042961801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90d80fcd00 0x7f90d810c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:25.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.505+0000 7f90de1eb700 1 -- 172.21.15.63:0/1042961801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90d80fcd00 msgr2=0x7f90d810c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:25.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.505+0000 7f90de1eb700 1 --2- 172.21.15.63:0/1042961801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90d80fcd00 0x7f90d810c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:25.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.505+0000 7f90de1eb700 1 -- 172.21.15.63:0/1042961801 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c8005040 con 0x7f90d80fbaf0 2023-12-07T16:19:25.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.505+0000 7f90de1eb700 1 --2- 172.21.15.63:0/1042961801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90d80fbaf0 0x7f90d810c470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f90d4002a80 tx=0x7f90d4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:25.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.505+0000 7f90ceffd700 1 -- 172.21.15.63:0/1042961801 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90d4007cc0 con 0x7f90d80fbaf0 2023-12-07T16:19:25.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.506+0000 7f90e044f700 1 -- 172.21.15.63:0/1042961801 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d810db30 con 0x7f90d80fbaf0 2023-12-07T16:19:25.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.506+0000 7f90ceffd700 1 -- 172.21.15.63:0/1042961801 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f90d400f040 con 0x7f90d80fbaf0 2023-12-07T16:19:25.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.506+0000 7f90ceffd700 1 -- 172.21.15.63:0/1042961801 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90d400d9c0 con 0x7f90d80fbaf0 2023-12-07T16:19:25.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.506+0000 7f90e044f700 1 -- 172.21.15.63:0/1042961801 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d810e070 con 0x7f90d80fbaf0 2023-12-07T16:19:25.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.507+0000 7f90e044f700 1 -- 172.21.15.63:0/1042961801 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d804bb80 con 0x7f90d80fbaf0 2023-12-07T16:19:25.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.507+0000 7f90ceffd700 1 -- 172.21.15.63:0/1042961801 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f90d400db20 con 0x7f90d80fbaf0 2023-12-07T16:19:25.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.507+0000 7f90ceffd700 1 --2- 172.21.15.63:0/1042961801 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f90c4068f60 0x7f90c406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:25.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.507+0000 7f90dd9ea700 1 --2- 172.21.15.63:0/1042961801 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f90c4068f60 0x7f90c406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:25.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.508+0000 7f90dd9ea700 1 --2- 172.21.15.63:0/1042961801 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f90c4068f60 0x7f90c406b410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f90c800b3b0 tx=0x7f90c8009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:25.507 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.508+0000 7f90ceffd700 1 -- 172.21.15.63:0/1042961801 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f90d4007e20 con 0x7f90d80fbaf0 2023-12-07T16:19:25.510 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.513+0000 7f90ceffd700 1 -- 172.21.15.63:0/1042961801 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f90d4056950 con 0x7f90d80fbaf0 2023-12-07T16:19:25.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.786+0000 7f90e044f700 1 -- 172.21.15.63:0/1042961801 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f90d8104490 con 0x7f90d80fbaf0 2023-12-07T16:19:25.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.786+0000 7f90ceffd700 1 -- 172.21.15.63:0/1042961801 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v15) v1 ==== 78+0+99 (secure 0 0 0) 0x7f90d40564e0 con 0x7f90d80fbaf0 2023-12-07T16:19:25.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.789+0000 7f90e044f700 1 -- 172.21.15.63:0/1042961801 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f90c4068f60 msgr2=0x7f90c406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:25.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.789+0000 7f90e044f700 1 --2- 172.21.15.63:0/1042961801 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f90c4068f60 0x7f90c406b410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f90c800b3b0 tx=0x7f90c8009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:25.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.789+0000 7f90e044f700 1 -- 172.21.15.63:0/1042961801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90d80fbaf0 msgr2=0x7f90d810c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:25.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.789+0000 7f90e044f700 1 --2- 172.21.15.63:0/1042961801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90d80fbaf0 0x7f90d810c470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f90d4002a80 tx=0x7f90d4004600 comp rx=0 tx=0).stop 2023-12-07T16:19:25.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.789+0000 7f90e044f700 1 -- 172.21.15.63:0/1042961801 shutdown_connections 2023-12-07T16:19:25.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.789+0000 7f90e044f700 1 --2- 172.21.15.63:0/1042961801 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f90c4068f60 0x7f90c406b410 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:25.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.789+0000 7f90e044f700 1 --2- 172.21.15.63:0/1042961801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90d80fbaf0 0x7f90d810c470 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:25.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.789+0000 7f90e044f700 1 --2- 172.21.15.63:0/1042961801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90d80fcd00 0x7f90d810c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:25.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.789+0000 7f90e044f700 1 -- 172.21.15.63:0/1042961801 >> 172.21.15.63:0/1042961801 conn(0x7f90d80f7190 msgr2=0x7f90d80fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:25.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.789+0000 7f90e044f700 1 -- 172.21.15.63:0/1042961801 shutdown_connections 2023-12-07T16:19:25.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:25.789+0000 7f90e044f700 1 -- 172.21.15.63:0/1042961801 wait complete. 2023-12-07T16:19:25.797 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-07T16:19:26.158 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2023-12-07T16:19:26.172 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T16:19:26.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.311+0000 7fd1c6d5d700 1 -- 172.21.15.63:0/1932223655 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1c0066510 msgr2=0x7fd1c00ff6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:26.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.311+0000 7fd1c6d5d700 1 --2- 172.21.15.63:0/1932223655 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1c0066510 0x7fd1c00ff6d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4004940 tx=0x7fd1b4009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:26.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.312+0000 7fd1c6d5d700 1 -- 172.21.15.63:0/1932223655 shutdown_connections 2023-12-07T16:19:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.312+0000 7fd1c6d5d700 1 --2- 172.21.15.63:0/1932223655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1c00ffca0 0x7fd1c01020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.312+0000 7fd1c6d5d700 1 --2- 172.21.15.63:0/1932223655 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1c0066510 0x7fd1c00ff6d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.312+0000 7fd1c6d5d700 1 -- 172.21.15.63:0/1932223655 >> 172.21.15.63:0/1932223655 conn(0x7fd1c00f7080 msgr2=0x7fd1c00f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.312+0000 7fd1c6d5d700 1 -- 172.21.15.63:0/1932223655 shutdown_connections 2023-12-07T16:19:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.312+0000 7fd1c6d5d700 1 -- 172.21.15.63:0/1932223655 wait complete. 2023-12-07T16:19:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.312+0000 7fd1c6d5d700 1 Processor -- start 2023-12-07T16:19:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.312+0000 7fd1c6d5d700 1 -- start start 2023-12-07T16:19:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.313+0000 7fd1c6d5d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1c0066510 0x7fd1c00fcf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.313+0000 7fd1c6d5d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1c00ffca0 0x7fd1c00fb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.313+0000 7fd1c6d5d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c00fbb10 con 0x7fd1c0066510 2023-12-07T16:19:26.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.313+0000 7fd1c6d5d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c00fbc80 con 0x7fd1c00ffca0 2023-12-07T16:19:26.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.313+0000 7fd1c4af9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1c0066510 0x7fd1c00fcf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:26.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.313+0000 7fd1c4af9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1c0066510 0x7fd1c00fcf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55386/0 (socket says 172.21.15.63:55386) 2023-12-07T16:19:26.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.313+0000 7fd1c4af9700 1 -- 172.21.15.63:0/3747972700 learned_addr learned my addr 172.21.15.63:0/3747972700 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:26.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.313+0000 7fd1bffff700 1 --2- 172.21.15.63:0/3747972700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1c00ffca0 0x7fd1c00fb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:26.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.313+0000 7fd1c4af9700 1 -- 172.21.15.63:0/3747972700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1c00ffca0 msgr2=0x7fd1c00fb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:26.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.313+0000 7fd1c4af9700 1 --2- 172.21.15.63:0/3747972700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1c00ffca0 0x7fd1c00fb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:26.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.313+0000 7fd1c4af9700 1 -- 172.21.15.63:0/3747972700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b4005040 con 0x7fd1c0066510 2023-12-07T16:19:26.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.313+0000 7fd1bffff700 1 --2- 172.21.15.63:0/3747972700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1c00ffca0 0x7fd1c00fb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T16:19:26.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.313+0000 7fd1c4af9700 1 --2- 172.21.15.63:0/3747972700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1c0066510 0x7fd1c00fcf70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400b3b0 tx=0x7fd1b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:26.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.316+0000 7fd1bd7fa700 1 -- 172.21.15.63:0/3747972700 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1b400e040 con 0x7fd1c0066510 2023-12-07T16:19:26.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.316+0000 7fd1bd7fa700 1 -- 172.21.15.63:0/3747972700 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd1b4009b10 con 0x7fd1c0066510 2023-12-07T16:19:26.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.316+0000 7fd1c6d5d700 1 -- 172.21.15.63:0/3747972700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c00fbf00 con 0x7fd1c0066510 2023-12-07T16:19:26.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.316+0000 7fd1bd7fa700 1 -- 172.21.15.63:0/3747972700 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1b401c630 con 0x7fd1c0066510 2023-12-07T16:19:26.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.316+0000 7fd1c6d5d700 1 -- 172.21.15.63:0/3747972700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c01153e0 con 0x7fd1c0066510 2023-12-07T16:19:26.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.317+0000 7fd1c6d5d700 1 -- 172.21.15.63:0/3747972700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c01054f0 con 0x7fd1c0066510 2023-12-07T16:19:26.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.317+0000 7fd1bd7fa700 1 -- 172.21.15.63:0/3747972700 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd1b4013960 con 0x7fd1c0066510 2023-12-07T16:19:26.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.318+0000 7fd1bd7fa700 1 --2- 172.21.15.63:0/3747972700 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd1b0068f60 0x7fd1b006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:26.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.318+0000 7fd1bd7fa700 1 -- 172.21.15.63:0/3747972700 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd1b4088200 con 0x7fd1c0066510 2023-12-07T16:19:26.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.318+0000 7fd1bffff700 1 --2- 172.21.15.63:0/3747972700 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd1b0068f60 0x7fd1b006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:26.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.318+0000 7fd1bffff700 1 --2- 172.21.15.63:0/3747972700 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd1b0068f60 0x7fd1b006b410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0066250 tx=0x7fd1ac008040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.323+0000 7fd1bd7fa700 1 -- 172.21.15.63:0/3747972700 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd1b4058110 con 0x7fd1c0066510 2023-12-07T16:19:26.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:26 smithi063 ceph-mon[112095]: pgmap v138: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 409 B/s wr, 7 op/s 2023-12-07T16:19:26.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:26 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:26.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:26 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:19:26.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:26 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/1042961801' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-07T16:19:26.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.517+0000 7fd1c6d5d700 1 -- 172.21.15.63:0/3747972700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1c01158f0 con 0x7fd1c0066510 2023-12-07T16:19:26.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.518+0000 7fd1bd7fa700 1 -- 172.21.15.63:0/3747972700 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+14372 (secure 0 0 0) 0x7fd1b4057ca0 con 0x7fd1c0066510 2023-12-07T16:19:26.516 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:19:26.516 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":45,"fsid":"8c493298-951b-11ee-95a2-87774f69a715","created":"2023-12-07T16:14:03.401177+0000","modified":"2023-12-07T16:19:18.402224+0000","last_up_change":"2023-12-07T16:18:22.506548+0000","last_in_change":"2023-12-07T16:18:06.682768+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T16:17:29.746142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-07T16:19:07.228292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-07T16:19:07.772770+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d8cce319-d8dc-49e7-8596-ba27cc0f8836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2340994154},{"type":"v1","addr":"172.21.15.63:6803","nonce":2340994154}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2340994154},{"type":"v1","addr":"172.21.15.63:6805","nonce":2340994154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2340994154},{"type":"v1","addr":"172.21.15.63:6809","nonce":2340994154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2340994154},{"type":"v1","addr":"172.21.15.63:6807","nonce":2340994154}]},"public_addr":"172.21.15.63:6803/2340994154","cluster_addr":"172.21.15.63:6805/2340994154","heartbeat_back_addr":"172.21.15.63:6809/2340994154","heartbeat_front_addr":"172.21.15.63:6807/2340994154","state":["exists","up"]},{"osd":1,"uuid":"4f6f5869-8c07-49cf-8d7e-4eaab3f54f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":1466128324},{"type":"v1","addr":"172.21.15.63:6811","nonce":1466128324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":1466128324},{"type":"v1","addr":"172.21.15.63:6813","nonce":1466128324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1466128324},{"type":"v1","addr":"172.21.15.63:6817","nonce":1466128324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":1466128324},{"type":"v1","addr":"172.21.15.63:6815","nonce":1466128324}]},"public_addr":"172.21.15.63:6811/1466128324","cluster_addr":"172.21.15.63:6813/1466128324","heartbeat_back_addr":"172.21.15.63:6817/1466128324","heartbeat_front_addr":"172.21.15.63:6815/1466128324","state":["exists","up"]},{"osd":2,"uuid":"42f79427-9cc3-42aa-91ab-4c28094437d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":1582539682},{"type":"v1","addr":"172.21.15.63:6819","nonce":1582539682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1582539682},{"type":"v1","addr":"172.21.15.63:6821","nonce":1582539682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1582539682},{"type":"v1","addr":"172.21.15.63:6825","nonce":1582539682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1582539682},{"type":"v1","addr":"172.21.15.63:6823","nonce":1582539682}]},"public_addr":"172.21.15.63:6819/1582539682","cluster_addr":"172.21.15.63:6821/1582539682","heartbeat_back_addr":"172.21.15.63:6825/1582539682","heartbeat_front_addr":"172.21.15.63:6823/1582539682","state":["exists","up"]},{"osd":3,"uuid":"57bde3cf-c59d-4ccb-9d76-894dc48e51b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":913468029},{"type":"v1","addr":"172.21.15.152:6801","nonce":913468029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":913468029},{"type":"v1","addr":"172.21.15.152:6803","nonce":913468029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":913468029},{"type":"v1","addr":"172.21.15.152:6807","nonce":913468029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":913468029},{"type":"v1","addr":"172.21.15.152:6805","nonce":913468029}]},"public_addr":"172.21.15.152:6801/913468029","cluster_addr":"172.21.15.152:6803/913468029","heartbeat_back_addr":"172.21.15.152:6807/913468029","heartbeat_front_addr":"172.21.15.152:6805/913468029","state":["exists","up"]},{"osd":4,"uuid":"1de5b172-cde3-4139-a24d-8d8c2d3f71da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1195082814},{"type":"v1","addr":"172.21.15.152:6809","nonce":1195082814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1195082814},{"type":"v1","addr":"172.21.15.152:6811","nonce":1195082814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1195082814},{"type":"v1","addr":"172.21.15.152:6815","nonce":1195082814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1195082814},{"type":"v1","addr":"172.21.15.152:6813","nonce":1195082814}]},"public_addr":"172.21.15.152:6809/1195082814","cluster_addr":"172.21.15.152:6811/1195082814","heartbeat_back_addr":"172.21.15.152:6815/1195082814","heartbeat_front_addr":"172.21.15.152:6813/1195082814","state":["exists","up"]},{"osd":5,"uuid":"15256051-a7b8-4fb0-8bc5-d865cb551551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":26565095},{"type":"v1","addr":"172.21.15.152:6817","nonce":26565095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":26565095},{"type":"v1","addr":"172.21.15.152:6819","nonce":26565095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":26565095},{"type":"v1","addr":"172.21.15.152:6823","nonce":26565095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":26565095},{"type":"v1","addr":"172.21.15.152:6821","nonce":26565095}]},"public_addr":"172.21.15.152:6817/26565095","cluster_addr":"172.21.15.152:6819/26565095","heartbeat_back_addr":"172.21.15.152:6823/26565095","heartbeat_front_addr":"172.21.15.152:6821/26565095","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:16:47.295417+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:17:06.714097+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:17:26.421837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:17:44.503538+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:18:02.822131+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:18:21.243021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/363151719":"2023-12-08T16:14:59.065782+0000","172.21.15.63:0/997543331":"2023-12-08T16:14:27.410651+0000","172.21.15.63:6827/1994067670":"2023-12-08T16:19:18.402193+0000","172.21.15.63:6801/2117148141":"2023-12-08T16:14:27.410651+0000","172.21.15.63:0/1828519471":"2023-12-08T16:14:27.410651+0000","172.21.15.63:6800/2117148141":"2023-12-08T16:14:27.410651+0000","172.21.15.63:0/1270045079":"2023-12-08T16:15:55.242508+0000","172.21.15.63:0/4058757998":"2023-12-08T16:14:27.410651+0000","172.21.15.63:0/127598952":"2023-12-08T16:14:59.065782+0000","172.21.15.63:6801/4069965417":"2023-12-08T16:15:55.242508+0000","172.21.15.63:0/3523609322":"2023-12-08T16:14:59.065782+0000","172.21.15.63:0/3827601892":"2023-12-08T16:15:55.242508+0000","172.21.15.63:0/396959949":"2023-12-08T16:15:55.242508+0000","172.21.15.63:6800/1052036735":"2023-12-08T16:14:59.065782+0000","172.21.15.63:6826/1994067670":"2023-12-08T16:19:18.402193+0000","172.21.15.63:6801/1052036735":"2023-12-08T16:14:59.065782+0000","172.21.15.63:6800/4069965417":"2023-12-08T16:15:55.242508+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T16:19:26.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.520+0000 7fd1c6d5d700 1 -- 172.21.15.63:0/3747972700 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd1b0068f60 msgr2=0x7fd1b006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:26.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.520+0000 7fd1c6d5d700 1 --2- 172.21.15.63:0/3747972700 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd1b0068f60 0x7fd1b006b410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0066250 tx=0x7fd1ac008040 comp rx=0 tx=0).stop 2023-12-07T16:19:26.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.520+0000 7fd1c6d5d700 1 -- 172.21.15.63:0/3747972700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1c0066510 msgr2=0x7fd1c00fcf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:26.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.520+0000 7fd1c6d5d700 1 --2- 172.21.15.63:0/3747972700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1c0066510 0x7fd1c00fcf70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400b3b0 tx=0x7fd1b4009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:26.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.520+0000 7fd1c6d5d700 1 -- 172.21.15.63:0/3747972700 shutdown_connections 2023-12-07T16:19:26.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.520+0000 7fd1c6d5d700 1 --2- 172.21.15.63:0/3747972700 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd1b0068f60 0x7fd1b006b410 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:26.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.520+0000 7fd1c6d5d700 1 --2- 172.21.15.63:0/3747972700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1c0066510 0x7fd1c00fcf70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:26.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.520+0000 7fd1c6d5d700 1 --2- 172.21.15.63:0/3747972700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1c00ffca0 0x7fd1c00fb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:26.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.520+0000 7fd1c6d5d700 1 -- 172.21.15.63:0/3747972700 >> 172.21.15.63:0/3747972700 conn(0x7fd1c00f7080 msgr2=0x7fd1c00f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:26.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.520+0000 7fd1c6d5d700 1 -- 172.21.15.63:0/3747972700 shutdown_connections 2023-12-07T16:19:26.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.520+0000 7fd1c6d5d700 1 -- 172.21.15.63:0/3747972700 wait complete. 2023-12-07T16:19:26.531 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T16:17:29.746142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-07T16:19:07.228292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-07T16:19:07.772770+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-07T16:19:26.531 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T16:19:26.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.658+0000 7ff21af2b700 1 -- 172.21.15.63:0/4002010080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2140fd5e0 msgr2=0x7ff2140ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:26.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.658+0000 7ff21af2b700 1 --2- 172.21.15.63:0/4002010080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2140fd5e0 0x7ff2140ff9c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff208004940 tx=0x7ff208009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:26.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.658+0000 7ff21af2b700 1 -- 172.21.15.63:0/4002010080 shutdown_connections 2023-12-07T16:19:26.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.658+0000 7ff21af2b700 1 --2- 172.21.15.63:0/4002010080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2140fff00 0x7ff2141022e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:26.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.658+0000 7ff21af2b700 1 --2- 172.21.15.63:0/4002010080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2140fd5e0 0x7ff2140ff9c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:26.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.658+0000 7ff21af2b700 1 -- 172.21.15.63:0/4002010080 >> 172.21.15.63:0/4002010080 conn(0x7ff2140f7060 msgr2=0x7ff2140f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:26.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.658+0000 7ff21af2b700 1 -- 172.21.15.63:0/4002010080 shutdown_connections 2023-12-07T16:19:26.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.658+0000 7ff21af2b700 1 -- 172.21.15.63:0/4002010080 wait complete. 2023-12-07T16:19:26.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.658+0000 7ff21af2b700 1 Processor -- start 2023-12-07T16:19:26.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.658+0000 7ff21af2b700 1 -- start start 2023-12-07T16:19:26.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.659+0000 7ff21af2b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2140fd5e0 0x7ff21410d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:26.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.659+0000 7ff21af2b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2140fff00 0x7ff21410d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:26.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.659+0000 7ff21af2b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21410ddd0 con 0x7ff2140fd5e0 2023-12-07T16:19:26.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.659+0000 7ff21af2b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21410df40 con 0x7ff2140fff00 2023-12-07T16:19:26.659 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.659+0000 7ff218cc7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2140fd5e0 0x7ff21410d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:26.659 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.659+0000 7ff218cc7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2140fd5e0 0x7ff21410d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55402/0 (socket says 172.21.15.63:55402) 2023-12-07T16:19:26.659 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.659+0000 7ff218cc7700 1 -- 172.21.15.63:0/3418989111 learned_addr learned my addr 172.21.15.63:0/3418989111 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:26.659 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.659+0000 7ff213fff700 1 --2- 172.21.15.63:0/3418989111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2140fff00 0x7ff21410d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:26.659 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.659+0000 7ff218cc7700 1 -- 172.21.15.63:0/3418989111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2140fff00 msgr2=0x7ff21410d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:26.659 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.659+0000 7ff218cc7700 1 --2- 172.21.15.63:0/3418989111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2140fff00 0x7ff21410d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:26.659 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.659+0000 7ff218cc7700 1 -- 172.21.15.63:0/3418989111 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff208005040 con 0x7ff2140fd5e0 2023-12-07T16:19:26.659 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.659+0000 7ff218cc7700 1 --2- 172.21.15.63:0/3418989111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2140fd5e0 0x7ff21410d290 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff208009360 tx=0x7ff208009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:26.659 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.659+0000 7ff2117fa700 1 -- 172.21.15.63:0/3418989111 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff20800e040 con 0x7ff2140fd5e0 2023-12-07T16:19:26.659 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.659+0000 7ff21af2b700 1 -- 172.21.15.63:0/3418989111 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff214112990 con 0x7ff2140fd5e0 2023-12-07T16:19:26.659 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.659+0000 7ff2117fa700 1 -- 172.21.15.63:0/3418989111 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff20800bc50 con 0x7ff2140fd5e0 2023-12-07T16:19:26.659 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.659+0000 7ff2117fa700 1 -- 172.21.15.63:0/3418989111 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff20801c3f0 con 0x7ff2140fd5e0 2023-12-07T16:19:26.659 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.659+0000 7ff21af2b700 1 -- 172.21.15.63:0/3418989111 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff214112f50 con 0x7ff2140fd5e0 2023-12-07T16:19:26.660 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.660+0000 7ff21af2b700 1 -- 172.21.15.63:0/3418989111 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff214107470 con 0x7ff2140fd5e0 2023-12-07T16:19:26.660 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.661+0000 7ff2117fa700 1 -- 172.21.15.63:0/3418989111 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff208013420 con 0x7ff2140fd5e0 2023-12-07T16:19:26.661 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.661+0000 7ff2117fa700 1 --2- 172.21.15.63:0/3418989111 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff204068f60 0x7ff20406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:26.661 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.661+0000 7ff2117fa700 1 -- 172.21.15.63:0/3418989111 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff208088160 con 0x7ff2140fd5e0 2023-12-07T16:19:26.661 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.661+0000 7ff213fff700 1 --2- 172.21.15.63:0/3418989111 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff204068f60 0x7ff20406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:26.661 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.662+0000 7ff213fff700 1 --2- 172.21.15.63:0/3418989111 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff204068f60 0x7ff20406b410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff200004f40 tx=0x7ff20000b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:26.663 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.665+0000 7ff2117fa700 1 -- 172.21.15.63:0/3418989111 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff208057ff0 con 0x7ff2140fd5e0 2023-12-07T16:19:26.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:26 smithi152 ceph-mon[121113]: pgmap v138: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 409 B/s wr, 7 op/s 2023-12-07T16:19:26.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:26 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:26.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:26 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:19:26.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:26 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/1042961801' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-07T16:19:26.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.861+0000 7ff21af2b700 1 -- 172.21.15.63:0/3418989111 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff21402b2a0 con 0x7ff2140fd5e0 2023-12-07T16:19:26.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.861+0000 7ff2117fa700 1 -- 172.21.15.63:0/3418989111 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff208057b80 con 0x7ff2140fd5e0 2023-12-07T16:19:26.859 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-07T16:19:26.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.863+0000 7ff21af2b700 1 -- 172.21.15.63:0/3418989111 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff204068f60 msgr2=0x7ff20406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:26.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.863+0000 7ff21af2b700 1 --2- 172.21.15.63:0/3418989111 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff204068f60 0x7ff20406b410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff200004f40 tx=0x7ff20000b040 comp rx=0 tx=0).stop 2023-12-07T16:19:26.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.863+0000 7ff21af2b700 1 -- 172.21.15.63:0/3418989111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2140fd5e0 msgr2=0x7ff21410d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:26.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.863+0000 7ff21af2b700 1 --2- 172.21.15.63:0/3418989111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2140fd5e0 0x7ff21410d290 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff208009360 tx=0x7ff208009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:26.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.863+0000 7ff21af2b700 1 -- 172.21.15.63:0/3418989111 shutdown_connections 2023-12-07T16:19:26.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.863+0000 7ff21af2b700 1 --2- 172.21.15.63:0/3418989111 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff204068f60 0x7ff20406b410 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:26.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.863+0000 7ff21af2b700 1 --2- 172.21.15.63:0/3418989111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2140fd5e0 0x7ff21410d290 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:26.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.863+0000 7ff21af2b700 1 --2- 172.21.15.63:0/3418989111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2140fff00 0x7ff21410d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:26.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.863+0000 7ff21af2b700 1 -- 172.21.15.63:0/3418989111 >> 172.21.15.63:0/3418989111 conn(0x7ff2140f7060 msgr2=0x7ff2140f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:26.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.863+0000 7ff21af2b700 1 -- 172.21.15.63:0/3418989111 shutdown_connections 2023-12-07T16:19:26.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:26.863+0000 7ff21af2b700 1 -- 172.21.15.63:0/3418989111 wait complete. 2023-12-07T16:19:26.873 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-07T16:19:27.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.001+0000 7f4ec6044700 1 -- 172.21.15.63:0/1214358335 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ec00fcb80 msgr2=0x7f4ec00fcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:27.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.001+0000 7f4ec6044700 1 --2- 172.21.15.63:0/1214358335 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ec00fcb80 0x7f4ec00fcfd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4004940 tx=0x7f4eb4009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:27.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.001+0000 7f4ec6044700 1 -- 172.21.15.63:0/1214358335 shutdown_connections 2023-12-07T16:19:27.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.001+0000 7f4ec6044700 1 --2- 172.21.15.63:0/1214358335 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ec00fcb80 0x7f4ec00fcfd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:27.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.001+0000 7f4ec6044700 1 --2- 172.21.15.63:0/1214358335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ec00fb970 0x7f4ec00fbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:27.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.001+0000 7f4ec6044700 1 -- 172.21.15.63:0/1214358335 >> 172.21.15.63:0/1214358335 conn(0x7f4ec00f7010 msgr2=0x7f4ec00f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:27.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.001+0000 7f4ec6044700 1 -- 172.21.15.63:0/1214358335 shutdown_connections 2023-12-07T16:19:27.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.001+0000 7f4ec6044700 1 -- 172.21.15.63:0/1214358335 wait complete. 2023-12-07T16:19:27.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.002+0000 7f4ec6044700 1 Processor -- start 2023-12-07T16:19:27.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.002+0000 7f4ec6044700 1 -- start start 2023-12-07T16:19:27.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.002+0000 7f4ec6044700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ec00fb970 0x7f4ec010d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:27.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.002+0000 7f4ec6044700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ec00fcb80 0x7f4ec010d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:27.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.002+0000 7f4ec6044700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec010ddc0 con 0x7f4ec00fcb80 2023-12-07T16:19:27.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.002+0000 7f4ec6044700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec010df30 con 0x7f4ec00fb970 2023-12-07T16:19:27.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.002+0000 7f4ebeffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ec00fcb80 0x7f4ec010d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:27.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.002+0000 7f4ebeffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ec00fcb80 0x7f4ec010d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55418/0 (socket says 172.21.15.63:55418) 2023-12-07T16:19:27.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.002+0000 7f4ebeffd700 1 -- 172.21.15.63:0/3101540115 learned_addr learned my addr 172.21.15.63:0/3101540115 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:27.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.002+0000 7f4ebf7fe700 1 --2- 172.21.15.63:0/3101540115 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ec00fb970 0x7f4ec010d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:27.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.003+0000 7f4ebeffd700 1 -- 172.21.15.63:0/3101540115 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ec00fb970 msgr2=0x7f4ec010d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:27.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.003+0000 7f4ebeffd700 1 --2- 172.21.15.63:0/3101540115 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ec00fb970 0x7f4ec010d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:27.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.003+0000 7f4ebeffd700 1 -- 172.21.15.63:0/3101540115 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb4005040 con 0x7f4ec00fcb80 2023-12-07T16:19:27.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.003+0000 7f4ebeffd700 1 --2- 172.21.15.63:0/3101540115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ec00fcb80 0x7f4ec010d7c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4009360 tx=0x7f4eb4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:27.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.003+0000 7f4ea7fff700 1 -- 172.21.15.63:0/3101540115 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4eb400e040 con 0x7f4ec00fcb80 2023-12-07T16:19:27.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.003+0000 7f4ec6044700 1 -- 172.21.15.63:0/3101540115 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec0112980 con 0x7f4ec00fcb80 2023-12-07T16:19:27.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.003+0000 7f4ea7fff700 1 -- 172.21.15.63:0/3101540115 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4eb400bc50 con 0x7f4ec00fcb80 2023-12-07T16:19:27.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.003+0000 7f4ea7fff700 1 -- 172.21.15.63:0/3101540115 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4eb401c3f0 con 0x7f4ec00fcb80 2023-12-07T16:19:27.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.003+0000 7f4ec6044700 1 -- 172.21.15.63:0/3101540115 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec0112f40 con 0x7f4ec00fcb80 2023-12-07T16:19:27.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.004+0000 7f4ec6044700 1 -- 172.21.15.63:0/3101540115 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec00652d0 con 0x7f4ec00fcb80 2023-12-07T16:19:27.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.004+0000 7f4ea7fff700 1 -- 172.21.15.63:0/3101540115 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f4eb4013420 con 0x7f4ec00fcb80 2023-12-07T16:19:27.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.005+0000 7f4ea7fff700 1 --2- 172.21.15.63:0/3101540115 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f4ea8068f60 0x7f4ea806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:27.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.005+0000 7f4ea7fff700 1 -- 172.21.15.63:0/3101540115 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4eb4088160 con 0x7f4ec00fcb80 2023-12-07T16:19:27.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.005+0000 7f4ebf7fe700 1 --2- 172.21.15.63:0/3101540115 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f4ea8068f60 0x7f4ea806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:27.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.005+0000 7f4ebf7fe700 1 --2- 172.21.15.63:0/3101540115 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f4ea8068f60 0x7f4ea806b410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4ec00fc9e0 tx=0x7f4eb0009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:27.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.009+0000 7f4ea7fff700 1 -- 172.21.15.63:0/3101540115 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4eb4057ff0 con 0x7f4ec00fcb80 2023-12-07T16:19:27.197 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.199+0000 7f4ec6044700 1 -- 172.21.15.63:0/3101540115 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f4ec0113190 con 0x7f4ec00fcb80 2023-12-07T16:19:27.197 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.200+0000 7f4ea7fff700 1 -- 172.21.15.63:0/3101540115 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v45) v1 ==== 107+0+11 (secure 0 0 0) 0x7f4eb4057b80 con 0x7f4ec00fcb80 2023-12-07T16:19:27.198 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-07T16:19:27.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.202+0000 7f4ec6044700 1 -- 172.21.15.63:0/3101540115 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f4ea8068f60 msgr2=0x7f4ea806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:27.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.202+0000 7f4ec6044700 1 --2- 172.21.15.63:0/3101540115 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f4ea8068f60 0x7f4ea806b410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4ec00fc9e0 tx=0x7f4eb0009040 comp rx=0 tx=0).stop 2023-12-07T16:19:27.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.202+0000 7f4ec6044700 1 -- 172.21.15.63:0/3101540115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ec00fcb80 msgr2=0x7f4ec010d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:27.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.202+0000 7f4ec6044700 1 --2- 172.21.15.63:0/3101540115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ec00fcb80 0x7f4ec010d7c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4009360 tx=0x7f4eb4009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:27.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.202+0000 7f4ec6044700 1 -- 172.21.15.63:0/3101540115 shutdown_connections 2023-12-07T16:19:27.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.202+0000 7f4ec6044700 1 --2- 172.21.15.63:0/3101540115 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ec00fb970 0x7f4ec010d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:27.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.202+0000 7f4ec6044700 1 --2- 172.21.15.63:0/3101540115 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f4ea8068f60 0x7f4ea806b410 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:27.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.202+0000 7f4ec6044700 1 --2- 172.21.15.63:0/3101540115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ec00fcb80 0x7f4ec010d7c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:27.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.202+0000 7f4ec6044700 1 -- 172.21.15.63:0/3101540115 >> 172.21.15.63:0/3101540115 conn(0x7f4ec00f7010 msgr2=0x7f4ec00ffdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:27.201 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.202+0000 7f4ec6044700 1 -- 172.21.15.63:0/3101540115 shutdown_connections 2023-12-07T16:19:27.201 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.202+0000 7f4ec6044700 1 -- 172.21.15.63:0/3101540115 wait complete. 2023-12-07T16:19:27.212 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-07T16:19:27.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.340+0000 7fdc9e2f7700 1 -- 172.21.15.63:0/3245785643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc980ffc50 msgr2=0x7fdc98102050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:27.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.340+0000 7fdc9e2f7700 1 --2- 172.21.15.63:0/3245785643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc980ffc50 0x7fdc98102050 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c004940 tx=0x7fdc8c009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:27.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.340+0000 7fdc9e2f7700 1 -- 172.21.15.63:0/3245785643 shutdown_connections 2023-12-07T16:19:27.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.340+0000 7fdc9e2f7700 1 --2- 172.21.15.63:0/3245785643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc980ffc50 0x7fdc98102050 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:27.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.340+0000 7fdc9e2f7700 1 --2- 172.21.15.63:0/3245785643 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc98065840 0x7fdc980ff680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:27.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.340+0000 7fdc9e2f7700 1 -- 172.21.15.63:0/3245785643 >> 172.21.15.63:0/3245785643 conn(0x7fdc980f7010 msgr2=0x7fdc980f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:27.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.340+0000 7fdc9e2f7700 1 -- 172.21.15.63:0/3245785643 shutdown_connections 2023-12-07T16:19:27.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.340+0000 7fdc9e2f7700 1 -- 172.21.15.63:0/3245785643 wait complete. 2023-12-07T16:19:27.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.340+0000 7fdc9e2f7700 1 Processor -- start 2023-12-07T16:19:27.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.341+0000 7fdc9e2f7700 1 -- start start 2023-12-07T16:19:27.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.341+0000 7fdc9e2f7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc98065840 0x7fdc9810d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:27.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.341+0000 7fdc9e2f7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc980ffc50 0x7fdc9810d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:27.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.341+0000 7fdc9e2f7700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9810de00 con 0x7fdc980ffc50 2023-12-07T16:19:27.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.341+0000 7fdc9e2f7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9810df70 con 0x7fdc98065840 2023-12-07T16:19:27.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.341+0000 7fdc977fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc980ffc50 0x7fdc9810d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:27.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.341+0000 7fdc977fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc980ffc50 0x7fdc9810d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55438/0 (socket says 172.21.15.63:55438) 2023-12-07T16:19:27.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.341+0000 7fdc977fe700 1 -- 172.21.15.63:0/1047465707 learned_addr learned my addr 172.21.15.63:0/1047465707 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:27.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.341+0000 7fdc97fff700 1 --2- 172.21.15.63:0/1047465707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc98065840 0x7fdc9810d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:27.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.341+0000 7fdc977fe700 1 -- 172.21.15.63:0/1047465707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc98065840 msgr2=0x7fdc9810d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:27.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.341+0000 7fdc977fe700 1 --2- 172.21.15.63:0/1047465707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc98065840 0x7fdc9810d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:27.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.341+0000 7fdc977fe700 1 -- 172.21.15.63:0/1047465707 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c005040 con 0x7fdc980ffc50 2023-12-07T16:19:27.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.341+0000 7fdc977fe700 1 --2- 172.21.15.63:0/1047465707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc980ffc50 0x7fdc9810d800 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c009360 tx=0x7fdc8c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:27.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.342+0000 7fdc94ff9700 1 -- 172.21.15.63:0/1047465707 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc8c00e040 con 0x7fdc980ffc50 2023-12-07T16:19:27.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.342+0000 7fdc94ff9700 1 -- 172.21.15.63:0/1047465707 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdc8c004290 con 0x7fdc980ffc50 2023-12-07T16:19:27.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.342+0000 7fdc9e2f7700 1 -- 172.21.15.63:0/1047465707 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc981129c0 con 0x7fdc980ffc50 2023-12-07T16:19:27.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.342+0000 7fdc94ff9700 1 -- 172.21.15.63:0/1047465707 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc8c01c3f0 con 0x7fdc980ffc50 2023-12-07T16:19:27.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.342+0000 7fdc9e2f7700 1 -- 172.21.15.63:0/1047465707 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc98112f80 con 0x7fdc980ffc50 2023-12-07T16:19:27.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.343+0000 7fdc9e2f7700 1 -- 172.21.15.63:0/1047465707 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc98107460 con 0x7fdc980ffc50 2023-12-07T16:19:27.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.343+0000 7fdc94ff9700 1 -- 172.21.15.63:0/1047465707 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fdc8c0137e0 con 0x7fdc980ffc50 2023-12-07T16:19:27.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.343+0000 7fdc94ff9700 1 --2- 172.21.15.63:0/1047465707 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fdc80068f70 0x7fdc8006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:27.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.344+0000 7fdc94ff9700 1 -- 172.21.15.63:0/1047465707 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fdc8c088000 con 0x7fdc980ffc50 2023-12-07T16:19:27.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.344+0000 7fdc97fff700 1 --2- 172.21.15.63:0/1047465707 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fdc80068f70 0x7fdc8006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:27.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.344+0000 7fdc97fff700 1 --2- 172.21.15.63:0/1047465707 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fdc80068f70 0x7fdc8006b420 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdc880041d0 tx=0x7fdc880043c0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:27.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.348+0000 7fdc94ff9700 1 -- 172.21.15.63:0/1047465707 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdc8c057f10 con 0x7fdc980ffc50 2023-12-07T16:19:27.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:27 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/3747972700' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-07T16:19:27.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:27 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/3418989111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-07T16:19:27.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:27 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/3101540115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-07T16:19:27.541 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.543+0000 7fdc9e2f7700 1 -- 172.21.15.63:0/1047465707 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fdc9802b2c0 con 0x7fdc980ffc50 2023-12-07T16:19:27.541 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.544+0000 7fdc94ff9700 1 -- 172.21.15.63:0/1047465707 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v45) v1 ==== 107+0+11 (secure 0 0 0) 0x7fdc8c057aa0 con 0x7fdc980ffc50 2023-12-07T16:19:27.542 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-07T16:19:27.544 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.546+0000 7fdc9e2f7700 1 -- 172.21.15.63:0/1047465707 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fdc80068f70 msgr2=0x7fdc8006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:27.544 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.546+0000 7fdc9e2f7700 1 --2- 172.21.15.63:0/1047465707 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fdc80068f70 0x7fdc8006b420 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdc880041d0 tx=0x7fdc880043c0 comp rx=0 tx=0).stop 2023-12-07T16:19:27.544 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.546+0000 7fdc9e2f7700 1 -- 172.21.15.63:0/1047465707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc980ffc50 msgr2=0x7fdc9810d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:27.544 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.546+0000 7fdc9e2f7700 1 --2- 172.21.15.63:0/1047465707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc980ffc50 0x7fdc9810d800 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c009360 tx=0x7fdc8c009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:27.544 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.546+0000 7fdc9e2f7700 1 -- 172.21.15.63:0/1047465707 shutdown_connections 2023-12-07T16:19:27.544 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.546+0000 7fdc9e2f7700 1 --2- 172.21.15.63:0/1047465707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc98065840 0x7fdc9810d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:27.545 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.546+0000 7fdc9e2f7700 1 --2- 172.21.15.63:0/1047465707 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fdc80068f70 0x7fdc8006b420 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:27.545 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.546+0000 7fdc9e2f7700 1 --2- 172.21.15.63:0/1047465707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc980ffc50 0x7fdc9810d800 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:27.545 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.546+0000 7fdc9e2f7700 1 -- 172.21.15.63:0/1047465707 >> 172.21.15.63:0/1047465707 conn(0x7fdc980f7010 msgr2=0x7fdc980f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:27.545 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.546+0000 7fdc9e2f7700 1 -- 172.21.15.63:0/1047465707 shutdown_connections 2023-12-07T16:19:27.545 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.546+0000 7fdc9e2f7700 1 -- 172.21.15.63:0/1047465707 wait complete. 2023-12-07T16:19:27.555 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:27 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/3747972700' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-07T16:19:27.555 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:27 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/3418989111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-07T16:19:27.555 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:27 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/3101540115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-07T16:19:27.556 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T16:19:27.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.680+0000 7ff945a21700 1 -- 172.21.15.63:0/1267347989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9400fb960 msgr2=0x7ff9400fbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:27.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.680+0000 7ff945a21700 1 --2- 172.21.15.63:0/1267347989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9400fb960 0x7ff9400fbd70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff934004940 tx=0x7ff934009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:27.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.680+0000 7ff945a21700 1 -- 172.21.15.63:0/1267347989 shutdown_connections 2023-12-07T16:19:27.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.680+0000 7ff945a21700 1 --2- 172.21.15.63:0/1267347989 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9400fcc10 0x7ff9400fd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:27.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.680+0000 7ff945a21700 1 --2- 172.21.15.63:0/1267347989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9400fb960 0x7ff9400fbd70 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:27.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.680+0000 7ff945a21700 1 -- 172.21.15.63:0/1267347989 >> 172.21.15.63:0/1267347989 conn(0x7ff9400f70a0 msgr2=0x7ff9400f94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:27.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.680+0000 7ff945a21700 1 -- 172.21.15.63:0/1267347989 shutdown_connections 2023-12-07T16:19:27.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.680+0000 7ff945a21700 1 -- 172.21.15.63:0/1267347989 wait complete. 2023-12-07T16:19:27.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.680+0000 7ff945a21700 1 Processor -- start 2023-12-07T16:19:27.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.680+0000 7ff945a21700 1 -- start start 2023-12-07T16:19:27.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.681+0000 7ff945a21700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9400fb960 0x7ff94010d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:27.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.681+0000 7ff945a21700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9400fcc10 0x7ff94010d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:27.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.681+0000 7ff945a21700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94010dd30 con 0x7ff9400fb960 2023-12-07T16:19:27.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.681+0000 7ff945a21700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94010dea0 con 0x7ff9400fcc10 2023-12-07T16:19:27.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.681+0000 7ff93effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9400fb960 0x7ff94010d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:27.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.681+0000 7ff93effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9400fb960 0x7ff94010d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55460/0 (socket says 172.21.15.63:55460) 2023-12-07T16:19:27.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.681+0000 7ff93effd700 1 -- 172.21.15.63:0/108151112 learned_addr learned my addr 172.21.15.63:0/108151112 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:27.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.681+0000 7ff93effd700 1 -- 172.21.15.63:0/108151112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9400fcc10 msgr2=0x7ff94010d730 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-07T16:19:27.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.681+0000 7ff93effd700 1 --2- 172.21.15.63:0/108151112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9400fcc10 0x7ff94010d730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:27.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.681+0000 7ff93effd700 1 -- 172.21.15.63:0/108151112 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff934005040 con 0x7ff9400fb960 2023-12-07T16:19:27.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.681+0000 7ff93effd700 1 --2- 172.21.15.63:0/108151112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9400fb960 0x7ff94010d1f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff934000c00 tx=0x7ff934009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:27.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.681+0000 7ff9277fe700 1 -- 172.21.15.63:0/108151112 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff934021070 con 0x7ff9400fb960 2023-12-07T16:19:27.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.681+0000 7ff9277fe700 1 -- 172.21.15.63:0/108151112 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff93401c400 con 0x7ff9400fb960 2023-12-07T16:19:27.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.681+0000 7ff945a21700 1 -- 172.21.15.63:0/108151112 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9401128f0 con 0x7ff9400fb960 2023-12-07T16:19:27.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.681+0000 7ff9277fe700 1 -- 172.21.15.63:0/108151112 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff93400e070 con 0x7ff9400fb960 2023-12-07T16:19:27.683 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.682+0000 7ff945a21700 1 -- 172.21.15.63:0/108151112 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff940112e50 con 0x7ff9400fb960 2023-12-07T16:19:27.684 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.682+0000 7ff945a21700 1 -- 172.21.15.63:0/108151112 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff940104310 con 0x7ff9400fb960 2023-12-07T16:19:27.684 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.683+0000 7ff9277fe700 1 -- 172.21.15.63:0/108151112 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff93401c570 con 0x7ff9400fb960 2023-12-07T16:19:27.684 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.683+0000 7ff9277fe700 1 --2- 172.21.15.63:0/108151112 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff928068f60 0x7ff92806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:27.684 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.684+0000 7ff9277fe700 1 -- 172.21.15.63:0/108151112 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff934088000 con 0x7ff9400fb960 2023-12-07T16:19:27.684 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.684+0000 7ff93e7fc700 1 --2- 172.21.15.63:0/108151112 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff928068f60 0x7ff92806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:27.684 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.684+0000 7ff93e7fc700 1 --2- 172.21.15.63:0/108151112 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff928068f60 0x7ff92806b410 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff930009fd0 tx=0x7ff93000b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:27.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.688+0000 7ff9277fe700 1 -- 172.21.15.63:0/108151112 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff934057fb0 con 0x7ff9400fb960 2023-12-07T16:19:27.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.926+0000 7ff945a21700 1 -- 172.21.15.63:0/108151112 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff940113130 con 0x7ff9400fb960 2023-12-07T16:19:27.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.927+0000 7ff9277fe700 1 -- 172.21.15.63:0/108151112 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4709 (secure 0 0 0) 0x7ff93405d030 con 0x7ff9400fb960 2023-12-07T16:19:27.924 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:19:27.925 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14488,"name":"cephfs.smithi063.gsjgcq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6827/3063200414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3063200414},{"type":"v1","addr":"172.21.15.63:6827","nonce":3063200414}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24281,"name":"cephfs.smithi152.aovwwd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.152:6827/2906349729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":2906349729},{"type":"v1","addr":"172.21.15.152:6827","nonce":2906349729}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T16:19:08.352640+0000","modified":"2023-12-07T16:19:22.407210+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14478,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi063.yidolg","rank":0,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.63:6829/2335448497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2335448497},{"type":"v1","addr":"172.21.15.63:6829","nonce":2335448497}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi152.mrvngf","rank":1,"incarnation":7,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6825/3157779064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3157779064},{"type":"v1","addr":"172.21.15.152:6825","nonce":3157779064}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-12-07T16:19:27.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.928+0000 7ff945a21700 1 -- 172.21.15.63:0/108151112 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff928068f60 msgr2=0x7ff92806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:27.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.928+0000 7ff945a21700 1 --2- 172.21.15.63:0/108151112 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff928068f60 0x7ff92806b410 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff930009fd0 tx=0x7ff93000b040 comp rx=0 tx=0).stop 2023-12-07T16:19:27.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.929+0000 7ff945a21700 1 -- 172.21.15.63:0/108151112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9400fb960 msgr2=0x7ff94010d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:27.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.929+0000 7ff945a21700 1 --2- 172.21.15.63:0/108151112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9400fb960 0x7ff94010d1f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff934000c00 tx=0x7ff934009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:27.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.929+0000 7ff945a21700 1 -- 172.21.15.63:0/108151112 shutdown_connections 2023-12-07T16:19:27.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.929+0000 7ff945a21700 1 --2- 172.21.15.63:0/108151112 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff928068f60 0x7ff92806b410 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:27.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.929+0000 7ff945a21700 1 --2- 172.21.15.63:0/108151112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9400fb960 0x7ff94010d1f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:27.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.929+0000 7ff945a21700 1 --2- 172.21.15.63:0/108151112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9400fcc10 0x7ff94010d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:27.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.929+0000 7ff945a21700 1 -- 172.21.15.63:0/108151112 >> 172.21.15.63:0/108151112 conn(0x7ff9400f70a0 msgr2=0x7ff940065d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:27.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.929+0000 7ff945a21700 1 -- 172.21.15.63:0/108151112 shutdown_connections 2023-12-07T16:19:27.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:27.929+0000 7ff945a21700 1 -- 172.21.15.63:0/108151112 wait complete. 2023-12-07T16:19:27.928 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 15 2023-12-07T16:19:27.939 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 2, 'flags': 18} 2023-12-07T16:19:27.939 INFO:teuthology.run_tasks:Running task kclient... 2023-12-07T16:19:27.967 INFO:tasks.kclient:Mounting kernel clients... 2023-12-07T16:19:27.967 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-12-07T16:19:27.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:27.967 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2023-12-07T16:19:27.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:27.987 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2023-12-07T16:19:28.058 INFO:teuthology.orchestra.run.smithi063.stderr:Cannot find device "ceph-brx" 2023-12-07T16:19:28.058 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T16:19:28.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:28.059 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2023-12-07T16:19:28.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:28.083 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2023-12-07T16:19:28.161 INFO:teuthology.orchestra.run.smithi152.stderr:Cannot find device "ceph-brx" 2023-12-07T16:19:28.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T16:19:28.163 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-12-07T16:19:28.163 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-07T16:19:28.163 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-07T16:19:28.163 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph fs ls 2023-12-07T16:19:28.436 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:19:28.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:28 smithi152 ceph-mon[121113]: pgmap v139: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 5 op/s 2023-12-07T16:19:28.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:28 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/1047465707' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-07T16:19:28.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:28 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/108151112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-07T16:19:28.551 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:28 smithi063 ceph-mon[112095]: pgmap v139: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 5 op/s 2023-12-07T16:19:28.551 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:28 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/1047465707' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-07T16:19:28.551 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:28 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/108151112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-07T16:19:29.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.448+0000 7fac6bdb4700 1 -- 172.21.15.63:0/3926111251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac640fbb40 msgr2=0x7fac640fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:29.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.448+0000 7fac6bdb4700 1 --2- 172.21.15.63:0/3926111251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac640fbb40 0x7fac640fbfb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fac54004940 tx=0x7fac54009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:29.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.448+0000 7fac6bdb4700 1 -- 172.21.15.63:0/3926111251 shutdown_connections 2023-12-07T16:19:29.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.448+0000 7fac6bdb4700 1 --2- 172.21.15.63:0/3926111251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac640fbb40 0x7fac640fbfb0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:29.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.448+0000 7fac6bdb4700 1 --2- 172.21.15.63:0/3926111251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac64101b00 0x7fac64101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:29.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.448+0000 7fac6bdb4700 1 -- 172.21.15.63:0/3926111251 >> 172.21.15.63:0/3926111251 conn(0x7fac640719b0 msgr2=0x7fac64071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:29.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.448+0000 7fac6bdb4700 1 -- 172.21.15.63:0/3926111251 shutdown_connections 2023-12-07T16:19:29.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.448+0000 7fac6bdb4700 1 -- 172.21.15.63:0/3926111251 wait complete. 2023-12-07T16:19:29.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.449+0000 7fac6bdb4700 1 Processor -- start 2023-12-07T16:19:29.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.449+0000 7fac6bdb4700 1 -- start start 2023-12-07T16:19:29.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.449+0000 7fac6bdb4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac640fbb40 0x7fac6410e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:29.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.449+0000 7fac6bdb4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac64101b00 0x7fac6410ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:29.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.449+0000 7fac6bdb4700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6410f290 con 0x7fac64101b00 2023-12-07T16:19:29.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.449+0000 7fac6bdb4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6410f400 con 0x7fac640fbb40 2023-12-07T16:19:29.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.449+0000 7fac6934f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac64101b00 0x7fac6410ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:29.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.449+0000 7fac6934f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac64101b00 0x7fac6410ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55488/0 (socket says 172.21.15.63:55488) 2023-12-07T16:19:29.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.449+0000 7fac6934f700 1 -- 172.21.15.63:0/3785967898 learned_addr learned my addr 172.21.15.63:0/3785967898 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:29.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.449+0000 7fac69b50700 1 --2- 172.21.15.63:0/3785967898 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac640fbb40 0x7fac6410e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:29.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.449+0000 7fac6934f700 1 -- 172.21.15.63:0/3785967898 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac640fbb40 msgr2=0x7fac6410e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:29.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.449+0000 7fac6934f700 1 --2- 172.21.15.63:0/3785967898 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac640fbb40 0x7fac6410e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:29.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.449+0000 7fac6934f700 1 -- 172.21.15.63:0/3785967898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac54005040 con 0x7fac64101b00 2023-12-07T16:19:29.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.450+0000 7fac6934f700 1 --2- 172.21.15.63:0/3785967898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac64101b00 0x7fac6410ece0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fac54009180 tx=0x7fac54009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:29.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.450+0000 7fac5a7fc700 1 -- 172.21.15.63:0/3785967898 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac5400e040 con 0x7fac64101b00 2023-12-07T16:19:29.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.450+0000 7fac5a7fc700 1 -- 172.21.15.63:0/3785967898 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fac54013420 con 0x7fac64101b00 2023-12-07T16:19:29.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.450+0000 7fac6bdb4700 1 -- 172.21.15.63:0/3785967898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac64117710 con 0x7fac64101b00 2023-12-07T16:19:29.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.450+0000 7fac5a7fc700 1 -- 172.21.15.63:0/3785967898 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac5401c630 con 0x7fac64101b00 2023-12-07T16:19:29.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.450+0000 7fac6bdb4700 1 -- 172.21.15.63:0/3785967898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac64117c20 con 0x7fac64101b00 2023-12-07T16:19:29.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.451+0000 7fac6bdb4700 1 -- 172.21.15.63:0/3785967898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac64103fb0 con 0x7fac64101b00 2023-12-07T16:19:29.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.451+0000 7fac5a7fc700 1 -- 172.21.15.63:0/3785967898 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fac540139e0 con 0x7fac64101b00 2023-12-07T16:19:29.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.452+0000 7fac5a7fc700 1 --2- 172.21.15.63:0/3785967898 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fac50068f60 0x7fac5006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:29.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.452+0000 7fac5a7fc700 1 -- 172.21.15.63:0/3785967898 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fac540880e0 con 0x7fac64101b00 2023-12-07T16:19:29.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.452+0000 7fac69b50700 1 --2- 172.21.15.63:0/3785967898 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fac50068f60 0x7fac5006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:29.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.452+0000 7fac69b50700 1 --2- 172.21.15.63:0/3785967898 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fac50068f60 0x7fac5006b410 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fac60004990 tx=0x7fac60009ee0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:29.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.456+0000 7fac5a7fc700 1 -- 172.21.15.63:0/3785967898 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fac54054560 con 0x7fac64101b00 2023-12-07T16:19:29.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.695+0000 7fac6bdb4700 1 -- 172.21.15.63:0/3785967898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fac6404bb80 con 0x7fac64101b00 2023-12-07T16:19:29.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.695+0000 7fac5a7fc700 1 -- 172.21.15.63:0/3785967898 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7fac54057b80 con 0x7fac64101b00 2023-12-07T16:19:29.693 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-07T16:19:29.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.697+0000 7fac6bdb4700 1 -- 172.21.15.63:0/3785967898 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fac50068f60 msgr2=0x7fac5006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:29.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.697+0000 7fac6bdb4700 1 --2- 172.21.15.63:0/3785967898 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fac50068f60 0x7fac5006b410 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fac60004990 tx=0x7fac60009ee0 comp rx=0 tx=0).stop 2023-12-07T16:19:29.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.697+0000 7fac6bdb4700 1 -- 172.21.15.63:0/3785967898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac64101b00 msgr2=0x7fac6410ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:29.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.697+0000 7fac6bdb4700 1 --2- 172.21.15.63:0/3785967898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac64101b00 0x7fac6410ece0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fac54009180 tx=0x7fac54009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:29.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.697+0000 7fac6bdb4700 1 -- 172.21.15.63:0/3785967898 shutdown_connections 2023-12-07T16:19:29.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.697+0000 7fac6bdb4700 1 --2- 172.21.15.63:0/3785967898 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac640fbb40 0x7fac6410e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:29.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.697+0000 7fac6bdb4700 1 --2- 172.21.15.63:0/3785967898 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fac50068f60 0x7fac5006b410 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:29.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.697+0000 7fac6bdb4700 1 --2- 172.21.15.63:0/3785967898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac64101b00 0x7fac6410ece0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:29.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.697+0000 7fac6bdb4700 1 -- 172.21.15.63:0/3785967898 >> 172.21.15.63:0/3785967898 conn(0x7fac640719b0 msgr2=0x7fac640fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:29.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.698+0000 7fac6bdb4700 1 -- 172.21.15.63:0/3785967898 shutdown_connections 2023-12-07T16:19:29.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:29.698+0000 7fac6bdb4700 1 -- 172.21.15.63:0/3785967898 wait complete. 2023-12-07T16:19:30.057 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-07T16:19:30.057 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-07T16:19:30.057 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi063.front.sepia.ceph.com 2023-12-07T16:19:30.057 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-07T16:19:30.058 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-07T16:19:30.058 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-07T16:19:30.058 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-07T16:19:30.058 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-07T16:19:30.058 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-07T16:19:30.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:30.058 DEBUG:teuthology.orchestra.run.smithi063:> ip addr 2023-12-07T16:19:30.078 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T16:19:30.078 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T16:19:30.078 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T16:19:30.078 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-07T16:19:30.079 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2023-12-07T16:19:30.079 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-07T16:19:30.079 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-07T16:19:30.079 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2023-12-07T16:19:30.079 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f0 2023-12-07T16:19:30.079 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-07T16:19:30.079 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2023-12-07T16:19:30.079 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f1 2023-12-07T16:19:30.079 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-07T16:19:30.079 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2023-12-07T16:19:30.079 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-07T16:19:30.079 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2023-12-07T16:19:30.079 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-07T16:19:30.079 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 41034sec preferred_lft 41034sec 2023-12-07T16:19:30.079 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2023-12-07T16:19:30.080 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-07T16:19:30.080 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-07T16:19:30.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:30.080 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-07T16:19:30.080 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-07T16:19:30.080 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add name ceph-brx type bridge 2023-12-07T16:19:30.080 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr flush dev ceph-brx 2023-12-07T16:19:30.080 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set ceph-brx up 2023-12-07T16:19:30.080 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-07T16:19:30.080 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-07T16:19:30.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:30.253 DEBUG:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-07T16:19:30.283 INFO:teuthology.orchestra.run.smithi063.stdout:1 2023-12-07T16:19:30.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:30.285 DEBUG:teuthology.orchestra.run.smithi063:> route 2023-12-07T16:19:30.364 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2023-12-07T16:19:30.365 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-07T16:19:30.365 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-07T16:19:30.365 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-07T16:19:30.365 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-07T16:19:30.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:30.365 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-07T16:19:30.365 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-07T16:19:30.365 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-07T16:19:30.365 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-07T16:19:30.365 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-07T16:19:30.366 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-07T16:19:30.551 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:30 smithi063 ceph-mon[112095]: pgmap v140: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-07T16:19:30.551 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:30 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/3785967898' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-07T16:19:30.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:30.642 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2023-12-07T16:19:30.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:30.661 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list-id 2023-12-07T16:19:30.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:30.719 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-07T16:19:30.719 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-07T16:19:30.719 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-07T16:19:30.719 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-07T16:19:30.719 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-07T16:19:30.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:30 smithi152 ceph-mon[121113]: pgmap v140: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-07T16:19:30.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:30 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/3785967898' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-07T16:19:30.816 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-07T16:19:30.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:30.816 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-07T16:19:30.816 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-07T16:19:30.816 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-07T16:19:30.816 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-07T16:19:30.816 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-07T16:19:30.816 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-07T16:19:30.817 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-07T16:19:30.817 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-07T16:19:31.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:31.042 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-07T16:19:31.042 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-07T16:19:31.042 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set brx.0 up 2023-12-07T16:19:31.042 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set dev brx.0 master ceph-brx 2023-12-07T16:19:31.043 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-07T16:19:31.141 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T16:19:31.142 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-07T16:19:31.160 INFO:teuthology.orchestra.run.smithi063.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-07T16:19:31.160 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T16:19:31.161 DEBUG:teuthology.orchestra.run.smithi063:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-07T16:19:31.218 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-07T16:19:31.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:31.219 DEBUG:teuthology.orchestra.run.smithi063:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-07T16:19:31.313 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-07T16:19:31.314 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-07T16:19:31.314 INFO:teuthology.orchestra.run.smithi063.stdout:invalid new device string format 2023-12-07T16:19:31.388 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-07T16:19:31.388 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-07T16:19:31.388 INFO:teuthology.orchestra.run.smithi063.stdout:invalid new device string format 2023-12-07T16:19:31.388 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.152:3300" 2023-12-07T16:19:31.388 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-07T16:19:31.406 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-07T16:19:31.407 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-07T16:19:31.407 INFO:teuthology.orchestra.run.smithi063.stdout:invalid new device string format 2023-12-07T16:19:31.407 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.152:3300" 2023-12-07T16:19:31.407 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-07T16:19:31.407 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:6789,172.21.15.152:6789" 2023-12-07T16:19:31.407 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.63:6789,172.21.15.152:6789:/ 2023-12-07T16:19:31.407 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8c493298-951b-11ee-95a2-87774f69a715" will pass to kernel 2023-12-07T16:19:31.409 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-07T16:19:31.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:31.410 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-07T16:19:31.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:31.442 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T16:19:31.526 INFO:teuthology.orchestra.run.smithi063.stdout:client14530 2023-12-07T16:19:31.527 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-07T16:19:31.527 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T16:19:31.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:31.586 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T16:19:31.673 INFO:teuthology.orchestra.run.smithi063.stdout:client14530 2023-12-07T16:19:31.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:31.673 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T16:19:31.717 INFO:teuthology.orchestra.run.smithi063.stdout:client14530 2023-12-07T16:19:31.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:31.717 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/8c493298-951b-11ee-95a2-87774f69a715.client14530/status') 2023-12-07T16:19:31.813 INFO:teuthology.orchestra.run.smithi063.stdout:instance: client.14530 (3)192.168.0.1:0/3518210947 2023-12-07T16:19:31.813 INFO:teuthology.orchestra.run.smithi063.stdout:blocklisted: false 2023-12-07T16:19:31.813 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records in 2023-12-07T16:19:31.813 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records out 2023-12-07T16:19:31.813 INFO:teuthology.orchestra.run.smithi063.stderr:70 bytes copied, 2.3706e-05 s, 3.0 MB/s 2023-12-07T16:19:31.815 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-12-07T16:19:31.815 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-07T16:19:31.815 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-07T16:19:31.815 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 8c493298-951b-11ee-95a2-87774f69a715 -- ceph fs ls 2023-12-07T16:19:32.086 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:19:32.529 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:32 smithi063 ceph-mon[112095]: pgmap v141: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-07T16:19:32.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:32 smithi152 ceph-mon[121113]: pgmap v141: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-07T16:19:33.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.060+0000 7fe455420700 1 -- 172.21.15.63:0/772200589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe450101b00 msgr2=0x7fe450101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:33.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.060+0000 7fe455420700 1 --2- 172.21.15.63:0/772200589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe450101b00 0x7fe450101ed0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe444004940 tx=0x7fe444009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:33.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.060+0000 7fe455420700 1 -- 172.21.15.63:0/772200589 shutdown_connections 2023-12-07T16:19:33.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.060+0000 7fe455420700 1 --2- 172.21.15.63:0/772200589 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4500fbb40 0x7fe4500fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:33.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.060+0000 7fe455420700 1 --2- 172.21.15.63:0/772200589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe450101b00 0x7fe450101ed0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:33.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.060+0000 7fe455420700 1 -- 172.21.15.63:0/772200589 >> 172.21.15.63:0/772200589 conn(0x7fe4500f76c0 msgr2=0x7fe4500f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:33.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.060+0000 7fe455420700 1 -- 172.21.15.63:0/772200589 shutdown_connections 2023-12-07T16:19:33.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.060+0000 7fe455420700 1 -- 172.21.15.63:0/772200589 wait complete. 2023-12-07T16:19:33.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.061+0000 7fe455420700 1 Processor -- start 2023-12-07T16:19:33.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.061+0000 7fe455420700 1 -- start start 2023-12-07T16:19:33.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.061+0000 7fe455420700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4500fbb40 0x7fe450112580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:33.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.061+0000 7fe455420700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe450101b00 0x7fe450112ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:33.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.061+0000 7fe455420700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4501131a0 con 0x7fe4500fbb40 2023-12-07T16:19:33.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.061+0000 7fe455420700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45010c440 con 0x7fe450101b00 2023-12-07T16:19:33.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.061+0000 7fe44effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4500fbb40 0x7fe450112580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:33.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.061+0000 7fe44effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4500fbb40 0x7fe450112580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52946/0 (socket says 172.21.15.63:52946) 2023-12-07T16:19:33.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.061+0000 7fe44effd700 1 -- 172.21.15.63:0/3256572204 learned_addr learned my addr 172.21.15.63:0/3256572204 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:33.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.061+0000 7fe44e7fc700 1 --2- 172.21.15.63:0/3256572204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe450101b00 0x7fe450112ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:33.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.061+0000 7fe44effd700 1 -- 172.21.15.63:0/3256572204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe450101b00 msgr2=0x7fe450112ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:33.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.061+0000 7fe44effd700 1 --2- 172.21.15.63:0/3256572204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe450101b00 0x7fe450112ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:33.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.061+0000 7fe44effd700 1 -- 172.21.15.63:0/3256572204 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe444005040 con 0x7fe4500fbb40 2023-12-07T16:19:33.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.061+0000 7fe44effd700 1 --2- 172.21.15.63:0/3256572204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4500fbb40 0x7fe450112580 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe44400b3b0 tx=0x7fe444009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:33.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.062+0000 7fe4377fe700 1 -- 172.21.15.63:0/3256572204 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe44400e040 con 0x7fe4500fbb40 2023-12-07T16:19:33.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.062+0000 7fe4377fe700 1 -- 172.21.15.63:0/3256572204 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe44400bc50 con 0x7fe4500fbb40 2023-12-07T16:19:33.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.062+0000 7fe455420700 1 -- 172.21.15.63:0/3256572204 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45010c6c0 con 0x7fe4500fbb40 2023-12-07T16:19:33.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.062+0000 7fe4377fe700 1 -- 172.21.15.63:0/3256572204 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe444013420 con 0x7fe4500fbb40 2023-12-07T16:19:33.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.062+0000 7fe455420700 1 -- 172.21.15.63:0/3256572204 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe45010cc00 con 0x7fe4500fbb40 2023-12-07T16:19:33.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.063+0000 7fe455420700 1 -- 172.21.15.63:0/3256572204 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4500fb2c0 con 0x7fe4500fbb40 2023-12-07T16:19:33.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.063+0000 7fe4377fe700 1 -- 172.21.15.63:0/3256572204 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe44401c430 con 0x7fe4500fbb40 2023-12-07T16:19:33.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.063+0000 7fe4377fe700 1 --2- 172.21.15.63:0/3256572204 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe438068f60 0x7fe43806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:33.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.063+0000 7fe4377fe700 1 -- 172.21.15.63:0/3256572204 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe444087be0 con 0x7fe4500fbb40 2023-12-07T16:19:33.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.064+0000 7fe44e7fc700 1 --2- 172.21.15.63:0/3256572204 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe438068f60 0x7fe43806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:33.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.064+0000 7fe44e7fc700 1 --2- 172.21.15.63:0/3256572204 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe438068f60 0x7fe43806b410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe440006fd0 tx=0x7fe440008040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:33.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.068+0000 7fe4377fe700 1 -- 172.21.15.63:0/3256572204 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe444057ba0 con 0x7fe4500fbb40 2023-12-07T16:19:33.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.307+0000 7fe455420700 1 -- 172.21.15.63:0/3256572204 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe45010dc00 con 0x7fe4500fbb40 2023-12-07T16:19:33.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.307+0000 7fe4377fe700 1 -- 172.21.15.63:0/3256572204 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7fe444057730 con 0x7fe4500fbb40 2023-12-07T16:19:33.305 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-07T16:19:33.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.309+0000 7fe455420700 1 -- 172.21.15.63:0/3256572204 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe438068f60 msgr2=0x7fe43806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:33.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.309+0000 7fe455420700 1 --2- 172.21.15.63:0/3256572204 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe438068f60 0x7fe43806b410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe440006fd0 tx=0x7fe440008040 comp rx=0 tx=0).stop 2023-12-07T16:19:33.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.309+0000 7fe455420700 1 -- 172.21.15.63:0/3256572204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4500fbb40 msgr2=0x7fe450112580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:33.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.309+0000 7fe455420700 1 --2- 172.21.15.63:0/3256572204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4500fbb40 0x7fe450112580 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe44400b3b0 tx=0x7fe444009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:33.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.309+0000 7fe455420700 1 -- 172.21.15.63:0/3256572204 shutdown_connections 2023-12-07T16:19:33.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.309+0000 7fe455420700 1 --2- 172.21.15.63:0/3256572204 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe438068f60 0x7fe43806b410 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:33.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.309+0000 7fe455420700 1 --2- 172.21.15.63:0/3256572204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4500fbb40 0x7fe450112580 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:33.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.309+0000 7fe455420700 1 --2- 172.21.15.63:0/3256572204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe450101b00 0x7fe450112ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:33.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.309+0000 7fe455420700 1 -- 172.21.15.63:0/3256572204 >> 172.21.15.63:0/3256572204 conn(0x7fe4500f76c0 msgr2=0x7fe4500f91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:33.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.310+0000 7fe455420700 1 -- 172.21.15.63:0/3256572204 shutdown_connections 2023-12-07T16:19:33.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:33.310+0000 7fe455420700 1 -- 172.21.15.63:0/3256572204 wait complete. 2023-12-07T16:19:33.597 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:33 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/3256572204' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-07T16:19:33.674 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-07T16:19:33.674 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-07T16:19:33.674 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi152.front.sepia.ceph.com 2023-12-07T16:19:33.674 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-07T16:19:33.674 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-07T16:19:33.674 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-07T16:19:33.674 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-07T16:19:33.674 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-07T16:19:33.674 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-07T16:19:33.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:33.675 DEBUG:teuthology.orchestra.run.smithi152:> ip addr 2023-12-07T16:19:33.697 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T16:19:33.697 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T16:19:33.697 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T16:19:33.697 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-12-07T16:19:33.697 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2023-12-07T16:19:33.697 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-12-07T16:19:33.697 INFO:teuthology.orchestra.run.smithi152.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-07T16:19:33.697 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:44 brd ff:ff:ff:ff:ff:ff 2023-12-07T16:19:33.697 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f0 2023-12-07T16:19:33.697 INFO:teuthology.orchestra.run.smithi152.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-07T16:19:33.698 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:45 brd ff:ff:ff:ff:ff:ff 2023-12-07T16:19:33.698 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f1 2023-12-07T16:19:33.698 INFO:teuthology.orchestra.run.smithi152.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-07T16:19:33.698 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e2 brd ff:ff:ff:ff:ff:ff 2023-12-07T16:19:33.698 INFO:teuthology.orchestra.run.smithi152.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-07T16:19:33.698 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e3 brd ff:ff:ff:ff:ff:ff 2023-12-07T16:19:33.698 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.21.15.152/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-07T16:19:33.698 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft 41035sec preferred_lft 41035sec 2023-12-07T16:19:33.698 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::ec4:7aff:fe88:6de3/64 scope link 2023-12-07T16:19:33.698 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-12-07T16:19:33.699 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-07T16:19:33.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:33.699 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-12-07T16:19:33.699 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-12-07T16:19:33.699 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add name ceph-brx type bridge 2023-12-07T16:19:33.699 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr flush dev ceph-brx 2023-12-07T16:19:33.699 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set ceph-brx up 2023-12-07T16:19:33.699 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-07T16:19:33.699 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-12-07T16:19:33.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:33 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/3256572204' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-07T16:19:33.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:33.860 DEBUG:teuthology.orchestra.run.smithi152:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-07T16:19:33.928 INFO:teuthology.orchestra.run.smithi152.stdout:1 2023-12-07T16:19:33.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:33.929 DEBUG:teuthology.orchestra.run.smithi152:> route 2023-12-07T16:19:34.018 INFO:teuthology.orchestra.run.smithi152.stdout:Kernel IP routing table 2023-12-07T16:19:34.018 INFO:teuthology.orchestra.run.smithi152.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-07T16:19:34.018 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-07T16:19:34.018 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-07T16:19:34.018 INFO:teuthology.orchestra.run.smithi152.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-07T16:19:34.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:34.018 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-12-07T16:19:34.019 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-12-07T16:19:34.019 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-07T16:19:34.019 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-07T16:19:34.019 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-07T16:19:34.019 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-12-07T16:19:34.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:34.243 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2023-12-07T16:19:34.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:34.260 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list-id 2023-12-07T16:19:34.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:34.318 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-12-07T16:19:34.318 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-12-07T16:19:34.318 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-07T16:19:34.318 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-07T16:19:34.318 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-12-07T16:19:34.414 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-07T16:19:34.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:34.414 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-12-07T16:19:34.415 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-12-07T16:19:34.415 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-07T16:19:34.415 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-07T16:19:34.415 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-07T16:19:34.415 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-07T16:19:34.415 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-07T16:19:34.415 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-12-07T16:19:34.586 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:34 smithi152 ceph-mon[121113]: pgmap v142: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-07T16:19:34.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:34.618 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-12-07T16:19:34.618 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-12-07T16:19:34.618 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set brx.0 up 2023-12-07T16:19:34.618 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set dev brx.0 master ceph-brx 2023-12-07T16:19:34.618 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-12-07T16:19:34.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:34 smithi063 ceph-mon[112095]: pgmap v142: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-07T16:19:34.714 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T16:19:34.714 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-07T16:19:34.732 INFO:teuthology.orchestra.run.smithi152.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-07T16:19:34.732 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T16:19:34.732 DEBUG:teuthology.orchestra.run.smithi152:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-07T16:19:34.790 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-07T16:19:34.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:34.790 DEBUG:teuthology.orchestra.run.smithi152:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-07T16:19:34.894 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-07T16:19:34.894 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-07T16:19:34.894 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2023-12-07T16:19:34.966 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-07T16:19:34.966 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-07T16:19:34.966 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2023-12-07T16:19:34.966 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.152:3300" 2023-12-07T16:19:34.966 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-07T16:19:34.984 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-07T16:19:34.984 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-07T16:19:34.984 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2023-12-07T16:19:34.984 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.152:3300" 2023-12-07T16:19:34.984 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-07T16:19:34.984 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.63:6789,172.21.15.152:6789" 2023-12-07T16:19:34.984 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.63:6789,172.21.15.152:6789:/ 2023-12-07T16:19:34.984 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=8c493298-951b-11ee-95a2-87774f69a715" will pass to kernel 2023-12-07T16:19:34.987 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-07T16:19:34.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:34.987 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-07T16:19:35.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:35.014 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T16:19:35.088 INFO:teuthology.orchestra.run.smithi152.stdout:client24309 2023-12-07T16:19:35.089 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-07T16:19:35.089 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T16:19:35.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:35.148 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T16:19:35.220 INFO:teuthology.orchestra.run.smithi152.stdout:client24309 2023-12-07T16:19:35.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:35.221 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T16:19:35.294 INFO:teuthology.orchestra.run.smithi152.stdout:client24309 2023-12-07T16:19:35.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:19:35.295 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/8c493298-951b-11ee-95a2-87774f69a715.client24309/status') 2023-12-07T16:19:35.375 INFO:teuthology.orchestra.run.smithi152.stdout:instance: client.24309 (3)192.168.0.1:0/763320069 2023-12-07T16:19:35.375 INFO:teuthology.orchestra.run.smithi152.stdout:blocklisted: false 2023-12-07T16:19:35.376 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records in 2023-12-07T16:19:35.376 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records out 2023-12-07T16:19:35.376 INFO:teuthology.orchestra.run.smithi152.stderr:69 bytes copied, 2.2107e-05 s, 3.1 MB/s 2023-12-07T16:19:35.377 INFO:teuthology.run_tasks:Running task print... 2023-12-07T16:19:35.387 INFO:teuthology.task.print:**** done client 2023-12-07T16:19:35.387 INFO:teuthology.run_tasks:Running task parallel... 2023-12-07T16:19:35.455 INFO:teuthology.task.parallel:starting parallel... 2023-12-07T16:19:35.456 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-07T16:19:35.456 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-07T16:19:35.456 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi063.front.sepia.ceph.com 2023-12-07T16:19:35.457 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2023-12-07T16:19:35.457 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-07T16:19:35.457 INFO:teuthology.task.sequential:In sequential, running task workunit... 2023-12-07T16:19:35.460 INFO:tasks.workunit:Pulling workunits from ref e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-07T16:19:35.461 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-07T16:19:35.461 INFO:tasks.workunit:timeout=3h 2023-12-07T16:19:35.461 INFO:tasks.workunit:cleanup=True 2023-12-07T16:19:35.461 DEBUG:teuthology.orchestra.run.smithi063:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-07T16:19:35.488 INFO:teuthology.orchestra.run.smithi063.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-12-07T16:19:35.488 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-12-07T16:19:35.488 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 99h/153d Inode: 1 Links: 2 2023-12-07T16:19:35.488 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T16:19:35.488 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-07T16:19:35.488 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-07T16:19:35.488 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2023-12-07 16:19:11.377802409 +0000 2023-12-07T16:19:35.488 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2023-12-07 16:19:31.439427405 +0000 2023-12-07T16:19:35.488 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2023-12-07 16:19:11.377802409 +0000 2023-12-07T16:19:35.488 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-12-07T16:19:35.488 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-12-07T16:19:35.564 DEBUG:teuthology.orchestra.run.smithi152:> stat -- /home/ubuntu/cephtest/mnt.1 2023-12-07T16:19:35.583 INFO:teuthology.orchestra.run.smithi152.stdout: File: /home/ubuntu/cephtest/mnt.1 2023-12-07T16:19:35.583 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2023-12-07T16:19:35.583 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 78h/120d Inode: 1 Links: 3 2023-12-07T16:19:35.583 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T16:19:35.583 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-07T16:19:35.583 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-07T16:19:35.583 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-12-07 16:19:35.561386880 +0000 2023-12-07T16:19:35.583 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-12-07 16:19:35.561386880 +0000 2023-12-07T16:19:35.583 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2023-12-07 16:19:11.377802409 +0000 2023-12-07T16:19:35.584 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2023-12-07T16:19:35.584 DEBUG:teuthology.orchestra.run.smithi152:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2023-12-07T16:19:35.654 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-07T16:19:35.654 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-07T16:19:35.673 INFO:tasks.workunit.client.0.smithi063.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-07T16:19:35.712 INFO:tasks.workunit.client.1.smithi152.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2023-12-07T16:19:35.759 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:19:36.569 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:36 smithi063 ceph-mon[112095]: pgmap v143: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2023-12-07T16:19:36.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:36 smithi152 ceph-mon[121113]: pgmap v143: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2023-12-07T16:19:36.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.763+0000 7f60155a2700 1 -- 172.21.15.63:0/3236700066 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60100fcbf0 msgr2=0x7f60100fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:36.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.763+0000 7f60155a2700 1 --2- 172.21.15.63:0/3236700066 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60100fcbf0 0x7f60100fd000 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6000004940 tx=0x7f6000009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:36.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.763+0000 7f60155a2700 1 -- 172.21.15.63:0/3236700066 shutdown_connections 2023-12-07T16:19:36.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.763+0000 7f60155a2700 1 --2- 172.21.15.63:0/3236700066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60100fde00 0x7f60100fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:36.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.763+0000 7f60155a2700 1 --2- 172.21.15.63:0/3236700066 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60100fcbf0 0x7f60100fd000 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:36.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.763+0000 7f60155a2700 1 -- 172.21.15.63:0/3236700066 >> 172.21.15.63:0/3236700066 conn(0x7f60100f82d0 msgr2=0x7f60100fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:36.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.763+0000 7f60155a2700 1 -- 172.21.15.63:0/3236700066 shutdown_connections 2023-12-07T16:19:36.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.763+0000 7f60155a2700 1 -- 172.21.15.63:0/3236700066 wait complete. 2023-12-07T16:19:36.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.763+0000 7f60155a2700 1 Processor -- start 2023-12-07T16:19:36.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.764+0000 7f60155a2700 1 -- start start 2023-12-07T16:19:36.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.764+0000 7f60155a2700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60100fcbf0 0x7f601010d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:36.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.764+0000 7f60155a2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60100fde00 0x7f601010daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:36.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.764+0000 7f60155a2700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601010e0a0 con 0x7f60100fcbf0 2023-12-07T16:19:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.764+0000 7f60155a2700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601010e940 con 0x7f60100fde00 2023-12-07T16:19:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.764+0000 7f600effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60100fcbf0 0x7f601010d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.764+0000 7f600effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60100fcbf0 0x7f601010d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52968/0 (socket says 172.21.15.63:52968) 2023-12-07T16:19:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.764+0000 7f600effd700 1 -- 172.21.15.63:0/1080393072 learned_addr learned my addr 172.21.15.63:0/1080393072 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.764+0000 7f600e7fc700 1 --2- 172.21.15.63:0/1080393072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60100fde00 0x7f601010daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.764+0000 7f600effd700 1 -- 172.21.15.63:0/1080393072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60100fde00 msgr2=0x7f601010daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.764+0000 7f600effd700 1 --2- 172.21.15.63:0/1080393072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60100fde00 0x7f601010daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.764+0000 7f600effd700 1 -- 172.21.15.63:0/1080393072 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6000005040 con 0x7f60100fcbf0 2023-12-07T16:19:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.764+0000 7f600effd700 1 --2- 172.21.15.63:0/1080393072 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60100fcbf0 0x7f601010d560 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6000004f90 tx=0x7f6000009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.764+0000 7f5ff77fe700 1 -- 172.21.15.63:0/1080393072 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f600000e040 con 0x7f60100fcbf0 2023-12-07T16:19:36.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.764+0000 7f5ff77fe700 1 -- 172.21.15.63:0/1080393072 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f600000bc50 con 0x7f60100fcbf0 2023-12-07T16:19:36.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.764+0000 7f60155a2700 1 -- 172.21.15.63:0/1080393072 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f601010ebc0 con 0x7f60100fcbf0 2023-12-07T16:19:36.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.765+0000 7f5ff77fe700 1 -- 172.21.15.63:0/1080393072 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f600001c630 con 0x7f60100fcbf0 2023-12-07T16:19:36.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.765+0000 7f60155a2700 1 -- 172.21.15.63:0/1080393072 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601010f100 con 0x7f60100fcbf0 2023-12-07T16:19:36.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.766+0000 7f60155a2700 1 -- 172.21.15.63:0/1080393072 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f601004bb80 con 0x7f60100fcbf0 2023-12-07T16:19:36.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.766+0000 7f5ff77fe700 1 -- 172.21.15.63:0/1080393072 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f6000013420 con 0x7f60100fcbf0 2023-12-07T16:19:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.766+0000 7f5ff77fe700 1 --2- 172.21.15.63:0/1080393072 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f5ff8068f60 0x7f5ff806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.766+0000 7f5ff77fe700 1 -- 172.21.15.63:0/1080393072 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f60000881b0 con 0x7f60100fcbf0 2023-12-07T16:19:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.766+0000 7f600e7fc700 1 --2- 172.21.15.63:0/1080393072 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f5ff8068f60 0x7f5ff806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.767+0000 7f600e7fc700 1 --2- 172.21.15.63:0/1080393072 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f5ff8068f60 0x7f5ff806b410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6004004f40 tx=0x7f600400b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:36.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.771+0000 7f5ff77fe700 1 -- 172.21.15.63:0/1080393072 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f60000580c0 con 0x7f60100fcbf0 2023-12-07T16:19:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.963+0000 7f60155a2700 1 -- 172.21.15.63:0/1080393072 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f6010105590 con 0x7f60100fcbf0 2023-12-07T16:19:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:36.963+0000 7f5ff77fe700 1 -- 172.21.15.63:0/1080393072 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21) v1 ==== 179+0+0 (secure 0 0 0) 0x7f6000057c50 con 0x7f60100fcbf0 2023-12-07T16:19:36.963 INFO:teuthology.orchestra.run.smithi063.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2023-12-07T16:19:37.324 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-07T16:19:37.325 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi063.front.sepia.ceph.com 2023-12-07T16:19:37.325 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2023-12-07T16:19:37.638 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:19:38.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:38 smithi063 ceph-mon[112095]: pgmap v144: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 682 B/s wr, 1 op/s 2023-12-07T16:19:38.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.648+0000 7f8e406e7700 1 -- 172.21.15.63:0/2108203571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e380fcd00 msgr2=0x7f8e380fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:38.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.648+0000 7f8e406e7700 1 --2- 172.21.15.63:0/2108203571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e380fcd00 0x7f8e380fd150 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8e28004940 tx=0x7f8e28009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:38.649 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.649+0000 7f8e406e7700 1 -- 172.21.15.63:0/2108203571 shutdown_connections 2023-12-07T16:19:38.649 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.649+0000 7f8e406e7700 1 --2- 172.21.15.63:0/2108203571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e380fcd00 0x7f8e380fd150 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:38.649 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.649+0000 7f8e406e7700 1 --2- 172.21.15.63:0/2108203571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e380fbaf0 0x7f8e380fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:38.649 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.649+0000 7f8e406e7700 1 -- 172.21.15.63:0/2108203571 >> 172.21.15.63:0/2108203571 conn(0x7f8e380f7190 msgr2=0x7f8e380f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:38.649 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.649+0000 7f8e406e7700 1 -- 172.21.15.63:0/2108203571 shutdown_connections 2023-12-07T16:19:38.649 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.649+0000 7f8e406e7700 1 -- 172.21.15.63:0/2108203571 wait complete. 2023-12-07T16:19:38.649 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.649+0000 7f8e406e7700 1 Processor -- start 2023-12-07T16:19:38.649 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.649+0000 7f8e406e7700 1 -- start start 2023-12-07T16:19:38.649 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.649+0000 7f8e406e7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e380fbaf0 0x7f8e380ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:38.649 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.649+0000 7f8e406e7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e380fcd00 0x7f8e380fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:38.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.649+0000 7f8e406e7700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380fe6d0 con 0x7f8e380fbaf0 2023-12-07T16:19:38.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.649+0000 7f8e406e7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380fe840 con 0x7f8e380fcd00 2023-12-07T16:19:38.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.650+0000 7f8e3e483700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e380fbaf0 0x7f8e380ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:38.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.650+0000 7f8e3e483700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e380fbaf0 0x7f8e380ffbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52980/0 (socket says 172.21.15.63:52980) 2023-12-07T16:19:38.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.650+0000 7f8e3e483700 1 -- 172.21.15.63:0/2114289295 learned_addr learned my addr 172.21.15.63:0/2114289295 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:38.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.650+0000 7f8e3e483700 1 -- 172.21.15.63:0/2114289295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e380fcd00 msgr2=0x7f8e380fe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:38.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.650+0000 7f8e3e483700 1 --2- 172.21.15.63:0/2114289295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e380fcd00 0x7f8e380fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:38.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.650+0000 7f8e3e483700 1 -- 172.21.15.63:0/2114289295 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e28005040 con 0x7f8e380fbaf0 2023-12-07T16:19:38.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.650+0000 7f8e3e483700 1 --2- 172.21.15.63:0/2114289295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e380fbaf0 0x7f8e380ffbc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8e3400b790 tx=0x7f8e34009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:38.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.650+0000 7f8e2effd700 1 -- 172.21.15.63:0/2114289295 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e3400f6f0 con 0x7f8e380fbaf0 2023-12-07T16:19:38.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.650+0000 7f8e2effd700 1 -- 172.21.15.63:0/2114289295 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8e3400fd00 con 0x7f8e380fbaf0 2023-12-07T16:19:38.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.650+0000 7f8e406e7700 1 -- 172.21.15.63:0/2114289295 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e380feb20 con 0x7f8e380fbaf0 2023-12-07T16:19:38.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.650+0000 7f8e2effd700 1 -- 172.21.15.63:0/2114289295 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e340103a0 con 0x7f8e380fbaf0 2023-12-07T16:19:38.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.650+0000 7f8e406e7700 1 -- 172.21.15.63:0/2114289295 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e380feea0 con 0x7f8e380fbaf0 2023-12-07T16:19:38.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.651+0000 7f8e406e7700 1 -- 172.21.15.63:0/2114289295 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e3804bb80 con 0x7f8e380fbaf0 2023-12-07T16:19:38.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.652+0000 7f8e2effd700 1 -- 172.21.15.63:0/2114289295 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8e3400f850 con 0x7f8e380fbaf0 2023-12-07T16:19:38.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.652+0000 7f8e2effd700 1 --2- 172.21.15.63:0/2114289295 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f8e24068f60 0x7f8e2406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:38.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.652+0000 7f8e2effd700 1 -- 172.21.15.63:0/2114289295 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8e34086c20 con 0x7f8e380fbaf0 2023-12-07T16:19:38.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.652+0000 7f8e3dc82700 1 --2- 172.21.15.63:0/2114289295 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f8e24068f60 0x7f8e2406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:38.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.653+0000 7f8e3dc82700 1 --2- 172.21.15.63:0/2114289295 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f8e24068f60 0x7f8e2406b410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8e2800b3b0 tx=0x7f8e28009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:38.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.657+0000 7f8e2effd700 1 -- 172.21.15.63:0/2114289295 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8e34056ab0 con 0x7f8e380fbaf0 2023-12-07T16:19:38.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:38 smithi152 ceph-mon[121113]: pgmap v144: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 682 B/s wr, 1 op/s 2023-12-07T16:19:38.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.848+0000 7f8e406e7700 1 -- 172.21.15.63:0/2114289295 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f8e38104530 con 0x7f8e380fbaf0 2023-12-07T16:19:38.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.849+0000 7f8e2effd700 1 -- 172.21.15.63:0/2114289295 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f8e34056640 con 0x7f8e380fbaf0 2023-12-07T16:19:38.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.850+0000 7f8e406e7700 1 -- 172.21.15.63:0/2114289295 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f8e24068f60 msgr2=0x7f8e2406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:38.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.850+0000 7f8e406e7700 1 --2- 172.21.15.63:0/2114289295 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f8e24068f60 0x7f8e2406b410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8e2800b3b0 tx=0x7f8e28009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:38.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.850+0000 7f8e406e7700 1 -- 172.21.15.63:0/2114289295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e380fbaf0 msgr2=0x7f8e380ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:38.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.850+0000 7f8e406e7700 1 --2- 172.21.15.63:0/2114289295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e380fbaf0 0x7f8e380ffbc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8e3400b790 tx=0x7f8e34009220 comp rx=0 tx=0).stop 2023-12-07T16:19:38.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.850+0000 7f8e406e7700 1 -- 172.21.15.63:0/2114289295 shutdown_connections 2023-12-07T16:19:38.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.850+0000 7f8e406e7700 1 --2- 172.21.15.63:0/2114289295 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f8e24068f60 0x7f8e2406b410 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:38.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.850+0000 7f8e406e7700 1 --2- 172.21.15.63:0/2114289295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e380fbaf0 0x7f8e380ffbc0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:38.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.850+0000 7f8e406e7700 1 --2- 172.21.15.63:0/2114289295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e380fcd00 0x7f8e380fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:38.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.850+0000 7f8e406e7700 1 -- 172.21.15.63:0/2114289295 >> 172.21.15.63:0/2114289295 conn(0x7f8e380f7190 msgr2=0x7f8e38065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:38.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.851+0000 7f8e406e7700 1 -- 172.21.15.63:0/2114289295 shutdown_connections 2023-12-07T16:19:38.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:38.851+0000 7f8e406e7700 1 -- 172.21.15.63:0/2114289295 wait complete. 2023-12-07T16:19:39.215 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2023-12-07T16:19:39.489 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:19:40.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.465+0000 7ff639764700 1 -- 172.21.15.63:0/1530526329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6340fbaf0 msgr2=0x7ff6340fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:40.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.465+0000 7ff639764700 1 --2- 172.21.15.63:0/1530526329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6340fbaf0 0x7ff6340fbf00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff624004940 tx=0x7ff624009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:40.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.465+0000 7ff639764700 1 -- 172.21.15.63:0/1530526329 shutdown_connections 2023-12-07T16:19:40.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.465+0000 7ff639764700 1 --2- 172.21.15.63:0/1530526329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6340fcd00 0x7ff6340fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:40.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.465+0000 7ff639764700 1 --2- 172.21.15.63:0/1530526329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6340fbaf0 0x7ff6340fbf00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:40.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.465+0000 7ff639764700 1 -- 172.21.15.63:0/1530526329 >> 172.21.15.63:0/1530526329 conn(0x7ff6340f7190 msgr2=0x7ff6340f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:40.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.465+0000 7ff639764700 1 -- 172.21.15.63:0/1530526329 shutdown_connections 2023-12-07T16:19:40.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.465+0000 7ff639764700 1 -- 172.21.15.63:0/1530526329 wait complete. 2023-12-07T16:19:40.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.466+0000 7ff639764700 1 Processor -- start 2023-12-07T16:19:40.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.466+0000 7ff639764700 1 -- start start 2023-12-07T16:19:40.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.466+0000 7ff639764700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6340fbaf0 0x7ff63410c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:40.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.466+0000 7ff639764700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6340fcd00 0x7ff63410c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:40.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.466+0000 7ff639764700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63410cfc0 con 0x7ff6340fcd00 2023-12-07T16:19:40.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.466+0000 7ff639764700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63410d860 con 0x7ff6340fbaf0 2023-12-07T16:19:40.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.466+0000 7ff6327fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6340fcd00 0x7ff63410c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:40.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.466+0000 7ff6327fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6340fcd00 0x7ff63410c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34130/0 (socket says 172.21.15.63:34130) 2023-12-07T16:19:40.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.466+0000 7ff6327fc700 1 -- 172.21.15.63:0/1423328915 learned_addr learned my addr 172.21.15.63:0/1423328915 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:40.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.466+0000 7ff6327fc700 1 -- 172.21.15.63:0/1423328915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6340fbaf0 msgr2=0x7ff63410c480 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-07T16:19:40.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.466+0000 7ff6327fc700 1 --2- 172.21.15.63:0/1423328915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6340fbaf0 0x7ff63410c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:40.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.467+0000 7ff6327fc700 1 -- 172.21.15.63:0/1423328915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff624005040 con 0x7ff6340fcd00 2023-12-07T16:19:40.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.467+0000 7ff6327fc700 1 --2- 172.21.15.63:0/1423328915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6340fcd00 0x7ff63410c9c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff61c002a50 tx=0x7ff61c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:40.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.467+0000 7ff62b7fe700 1 -- 172.21.15.63:0/1423328915 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff61c007cc0 con 0x7ff6340fcd00 2023-12-07T16:19:40.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.467+0000 7ff639764700 1 -- 172.21.15.63:0/1423328915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff63410db40 con 0x7ff6340fcd00 2023-12-07T16:19:40.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.467+0000 7ff62b7fe700 1 -- 172.21.15.63:0/1423328915 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff61c00f040 con 0x7ff6340fcd00 2023-12-07T16:19:40.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.467+0000 7ff62b7fe700 1 -- 172.21.15.63:0/1423328915 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff61c009540 con 0x7ff6340fcd00 2023-12-07T16:19:40.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.467+0000 7ff639764700 1 -- 172.21.15.63:0/1423328915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff63410e080 con 0x7ff6340fcd00 2023-12-07T16:19:40.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.468+0000 7ff639764700 1 -- 172.21.15.63:0/1423328915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63404bb80 con 0x7ff6340fcd00 2023-12-07T16:19:40.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.468+0000 7ff62b7fe700 1 -- 172.21.15.63:0/1423328915 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff61c0096a0 con 0x7ff6340fcd00 2023-12-07T16:19:40.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.469+0000 7ff62b7fe700 1 --2- 172.21.15.63:0/1423328915 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff620068f60 0x7ff62006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:40.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.469+0000 7ff62b7fe700 1 -- 172.21.15.63:0/1423328915 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff61c086cc0 con 0x7ff6340fcd00 2023-12-07T16:19:40.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.469+0000 7ff632ffd700 1 --2- 172.21.15.63:0/1423328915 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff620068f60 0x7ff62006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:40.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.469+0000 7ff632ffd700 1 --2- 172.21.15.63:0/1423328915 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff620068f60 0x7ff62006b410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff624009fd0 tx=0x7ff624009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:40.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.473+0000 7ff62b7fe700 1 -- 172.21.15.63:0/1423328915 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff61c08c020 con 0x7ff6340fcd00 2023-12-07T16:19:40.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:40 smithi063 ceph-mon[112095]: pgmap v145: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-07T16:19:40.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:40 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:19:40.663 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.665+0000 7ff639764700 1 -- 172.21.15.63:0/1423328915 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7ff634104490 con 0x7ff6340fcd00 2023-12-07T16:19:40.663 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.665+0000 7ff62b7fe700 1 -- 172.21.15.63:0/1423328915 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7ff61c056ab0 con 0x7ff6340fcd00 2023-12-07T16:19:40.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.667+0000 7ff639764700 1 -- 172.21.15.63:0/1423328915 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff620068f60 msgr2=0x7ff62006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:40.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.667+0000 7ff639764700 1 --2- 172.21.15.63:0/1423328915 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff620068f60 0x7ff62006b410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff624009fd0 tx=0x7ff624009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:40.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.667+0000 7ff639764700 1 -- 172.21.15.63:0/1423328915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6340fcd00 msgr2=0x7ff63410c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:40.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.667+0000 7ff639764700 1 --2- 172.21.15.63:0/1423328915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6340fcd00 0x7ff63410c9c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff61c002a50 tx=0x7ff61c0046b0 comp rx=0 tx=0).stop 2023-12-07T16:19:40.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.667+0000 7ff639764700 1 -- 172.21.15.63:0/1423328915 shutdown_connections 2023-12-07T16:19:40.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.667+0000 7ff639764700 1 --2- 172.21.15.63:0/1423328915 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6340fbaf0 0x7ff63410c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:40.666 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.667+0000 7ff639764700 1 --2- 172.21.15.63:0/1423328915 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7ff620068f60 0x7ff62006b410 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:40.666 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.667+0000 7ff639764700 1 --2- 172.21.15.63:0/1423328915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6340fcd00 0x7ff63410c9c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:40.666 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.667+0000 7ff639764700 1 -- 172.21.15.63:0/1423328915 >> 172.21.15.63:0/1423328915 conn(0x7ff6340f7190 msgr2=0x7ff6340fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:40.666 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.667+0000 7ff639764700 1 -- 172.21.15.63:0/1423328915 shutdown_connections 2023-12-07T16:19:40.666 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:40.667+0000 7ff639764700 1 -- 172.21.15.63:0/1423328915 wait complete. 2023-12-07T16:19:40.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:40 smithi152 ceph-mon[121113]: pgmap v145: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-07T16:19:40.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:40 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:19:41.023 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph config set global log_to_journald false --force' 2023-12-07T16:19:41.295 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:19:42.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.347+0000 7fe1b3396700 1 -- 172.21.15.63:0/3239410973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac0ffd80 msgr2=0x7fe1ac1021e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:42.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.347+0000 7fe1b3396700 1 --2- 172.21.15.63:0/3239410973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac0ffd80 0x7fe1ac1021e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe19c004940 tx=0x7fe19c009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:42.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.347+0000 7fe1b3396700 1 -- 172.21.15.63:0/3239410973 shutdown_connections 2023-12-07T16:19:42.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.347+0000 7fe1b3396700 1 --2- 172.21.15.63:0/3239410973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac0ffd80 0x7fe1ac1021e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:42.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.347+0000 7fe1b3396700 1 --2- 172.21.15.63:0/3239410973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1ac066920 0x7fe1ac0ff7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:42.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.347+0000 7fe1b3396700 1 -- 172.21.15.63:0/3239410973 >> 172.21.15.63:0/3239410973 conn(0x7fe1ac0f71c0 msgr2=0x7fe1ac0f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:42.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.347+0000 7fe1b3396700 1 -- 172.21.15.63:0/3239410973 shutdown_connections 2023-12-07T16:19:42.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.347+0000 7fe1b3396700 1 -- 172.21.15.63:0/3239410973 wait complete. 2023-12-07T16:19:42.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.348+0000 7fe1b3396700 1 Processor -- start 2023-12-07T16:19:42.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.348+0000 7fe1b3396700 1 -- start start 2023-12-07T16:19:42.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.348+0000 7fe1b3396700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1ac066920 0x7fe1ac0fd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:42.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.348+0000 7fe1b3396700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac0ffd80 0x7fe1ac0fb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:42.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.348+0000 7fe1b3396700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0fbd40 con 0x7fe1ac0ffd80 2023-12-07T16:19:42.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.348+0000 7fe1b3396700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0fbeb0 con 0x7fe1ac066920 2023-12-07T16:19:42.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.348+0000 7fe1b0931700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac0ffd80 0x7fe1ac0fb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:42.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.348+0000 7fe1b0931700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac0ffd80 0x7fe1ac0fb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34136/0 (socket says 172.21.15.63:34136) 2023-12-07T16:19:42.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.348+0000 7fe1b0931700 1 -- 172.21.15.63:0/3145162543 learned_addr learned my addr 172.21.15.63:0/3145162543 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:42.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.348+0000 7fe1b1132700 1 --2- 172.21.15.63:0/3145162543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1ac066920 0x7fe1ac0fd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:42.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.348+0000 7fe1b0931700 1 -- 172.21.15.63:0/3145162543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1ac066920 msgr2=0x7fe1ac0fd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:42.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.348+0000 7fe1b0931700 1 --2- 172.21.15.63:0/3145162543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1ac066920 0x7fe1ac0fd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:42.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.348+0000 7fe1b0931700 1 -- 172.21.15.63:0/3145162543 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19c005040 con 0x7fe1ac0ffd80 2023-12-07T16:19:42.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.348+0000 7fe1b1132700 1 --2- 172.21.15.63:0/3145162543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1ac066920 0x7fe1ac0fd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T16:19:42.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.349+0000 7fe1b0931700 1 --2- 172.21.15.63:0/3145162543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac0ffd80 0x7fe1ac0fb6b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe19c000c00 tx=0x7fe19c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:42.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.349+0000 7fe1a1ffb700 1 -- 172.21.15.63:0/3145162543 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe19c00e040 con 0x7fe1ac0ffd80 2023-12-07T16:19:42.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.349+0000 7fe1b3396700 1 -- 172.21.15.63:0/3145162543 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ac0fc130 con 0x7fe1ac0ffd80 2023-12-07T16:19:42.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.349+0000 7fe1a1ffb700 1 -- 172.21.15.63:0/3145162543 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe19c009af0 con 0x7fe1ac0ffd80 2023-12-07T16:19:42.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.349+0000 7fe1a1ffb700 1 -- 172.21.15.63:0/3145162543 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe19c01c630 con 0x7fe1ac0ffd80 2023-12-07T16:19:42.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.349+0000 7fe1b3396700 1 -- 172.21.15.63:0/3145162543 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ac1155c0 con 0x7fe1ac0ffd80 2023-12-07T16:19:42.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.350+0000 7fe1b3396700 1 -- 172.21.15.63:0/3145162543 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ac04bb80 con 0x7fe1ac0ffd80 2023-12-07T16:19:42.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.350+0000 7fe1a1ffb700 1 -- 172.21.15.63:0/3145162543 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe19c00bcd0 con 0x7fe1ac0ffd80 2023-12-07T16:19:42.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.351+0000 7fe1a1ffb700 1 --2- 172.21.15.63:0/3145162543 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe198068f60 0x7fe19806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:42.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.351+0000 7fe1a1ffb700 1 -- 172.21.15.63:0/3145162543 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe19c0882a0 con 0x7fe1ac0ffd80 2023-12-07T16:19:42.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.351+0000 7fe1b1132700 1 --2- 172.21.15.63:0/3145162543 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe198068f60 0x7fe19806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:42.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.351+0000 7fe1b1132700 1 --2- 172.21.15.63:0/3145162543 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe198068f60 0x7fe19806b410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8006fd0 tx=0x7fe1a8008040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:42.353 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.355+0000 7fe1a1ffb700 1 -- 172.21.15.63:0/3145162543 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe19c0581c0 con 0x7fe1ac0ffd80 2023-12-07T16:19:42.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:42 smithi063 ceph-mon[112095]: pgmap v146: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2023-12-07T16:19:42.546 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.548+0000 7fe1b3396700 1 -- 172.21.15.63:0/3145162543 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fe1ac105610 con 0x7fe1ac0ffd80 2023-12-07T16:19:42.546 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.548+0000 7fe1a1ffb700 1 -- 172.21.15.63:0/3145162543 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7fe19c057d50 con 0x7fe1ac0ffd80 2023-12-07T16:19:42.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.550+0000 7fe1b3396700 1 -- 172.21.15.63:0/3145162543 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe198068f60 msgr2=0x7fe19806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:42.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.550+0000 7fe1b3396700 1 --2- 172.21.15.63:0/3145162543 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe198068f60 0x7fe19806b410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8006fd0 tx=0x7fe1a8008040 comp rx=0 tx=0).stop 2023-12-07T16:19:42.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.550+0000 7fe1b3396700 1 -- 172.21.15.63:0/3145162543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac0ffd80 msgr2=0x7fe1ac0fb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:42.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.550+0000 7fe1b3396700 1 --2- 172.21.15.63:0/3145162543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac0ffd80 0x7fe1ac0fb6b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe19c000c00 tx=0x7fe19c009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:42.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.550+0000 7fe1b3396700 1 -- 172.21.15.63:0/3145162543 shutdown_connections 2023-12-07T16:19:42.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.550+0000 7fe1b3396700 1 --2- 172.21.15.63:0/3145162543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1ac066920 0x7fe1ac0fd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:42.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.550+0000 7fe1b3396700 1 --2- 172.21.15.63:0/3145162543 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe198068f60 0x7fe19806b410 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:42.549 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.550+0000 7fe1b3396700 1 --2- 172.21.15.63:0/3145162543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ac0ffd80 0x7fe1ac0fb6b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:42.549 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.550+0000 7fe1b3396700 1 -- 172.21.15.63:0/3145162543 >> 172.21.15.63:0/3145162543 conn(0x7fe1ac0f71c0 msgr2=0x7fe1ac0f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:42.549 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.550+0000 7fe1b3396700 1 -- 172.21.15.63:0/3145162543 shutdown_connections 2023-12-07T16:19:42.549 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:42.550+0000 7fe1b3396700 1 -- 172.21.15.63:0/3145162543 wait complete. 2023-12-07T16:19:42.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:42 smithi152 ceph-mon[121113]: pgmap v146: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2023-12-07T16:19:42.914 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2023-12-07T16:19:43.186 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:19:44.224 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.225+0000 7fc5a6846700 1 -- 172.21.15.63:0/73000635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5a00fbaf0 msgr2=0x7fc5a00fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:44.224 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.225+0000 7fc5a6846700 1 --2- 172.21.15.63:0/73000635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5a00fbaf0 0x7fc5a00fbf00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc590004940 tx=0x7fc590009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:44.224 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.225+0000 7fc5a6846700 1 -- 172.21.15.63:0/73000635 shutdown_connections 2023-12-07T16:19:44.224 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.225+0000 7fc5a6846700 1 --2- 172.21.15.63:0/73000635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5a00fcd00 0x7fc5a00fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:44.224 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.225+0000 7fc5a6846700 1 --2- 172.21.15.63:0/73000635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5a00fbaf0 0x7fc5a00fbf00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:44.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.225+0000 7fc5a6846700 1 -- 172.21.15.63:0/73000635 >> 172.21.15.63:0/73000635 conn(0x7fc5a00f7190 msgr2=0x7fc5a00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:44.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.225+0000 7fc5a6846700 1 -- 172.21.15.63:0/73000635 shutdown_connections 2023-12-07T16:19:44.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.225+0000 7fc5a6846700 1 -- 172.21.15.63:0/73000635 wait complete. 2023-12-07T16:19:44.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.225+0000 7fc5a6846700 1 Processor -- start 2023-12-07T16:19:44.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.226+0000 7fc5a6846700 1 -- start start 2023-12-07T16:19:44.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.226+0000 7fc5a6846700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5a00fbaf0 0x7fc5a010d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:44.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.226+0000 7fc5a6846700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5a00fcd00 0x7fc5a010dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:44.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.226+0000 7fc5a6846700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a010e0e0 con 0x7fc5a00fcd00 2023-12-07T16:19:44.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.226+0000 7fc5a6846700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a010e980 con 0x7fc5a00fbaf0 2023-12-07T16:19:44.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.226+0000 7fc59f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5a00fcd00 0x7fc5a010dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:44.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.226+0000 7fc59f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5a00fcd00 0x7fc5a010dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34160/0 (socket says 172.21.15.63:34160) 2023-12-07T16:19:44.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.226+0000 7fc59f7fe700 1 -- 172.21.15.63:0/3856848614 learned_addr learned my addr 172.21.15.63:0/3856848614 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:44.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.226+0000 7fc59ffff700 1 --2- 172.21.15.63:0/3856848614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5a00fbaf0 0x7fc5a010d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:44.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.226+0000 7fc59f7fe700 1 -- 172.21.15.63:0/3856848614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5a00fbaf0 msgr2=0x7fc5a010d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:44.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.226+0000 7fc59f7fe700 1 --2- 172.21.15.63:0/3856848614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5a00fbaf0 0x7fc5a010d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:44.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.226+0000 7fc59f7fe700 1 -- 172.21.15.63:0/3856848614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc590005040 con 0x7fc5a00fcd00 2023-12-07T16:19:44.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.226+0000 7fc59f7fe700 1 --2- 172.21.15.63:0/3856848614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5a00fcd00 0x7fc5a010dae0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc59400c810 tx=0x7fc594004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:44.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.227+0000 7fc59cff9700 1 -- 172.21.15.63:0/3856848614 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc594012810 con 0x7fc5a00fcd00 2023-12-07T16:19:44.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.227+0000 7fc59cff9700 1 -- 172.21.15.63:0/3856848614 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc594012e20 con 0x7fc5a00fcd00 2023-12-07T16:19:44.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.227+0000 7fc5a6846700 1 -- 172.21.15.63:0/3856848614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a010ec60 con 0x7fc5a00fcd00 2023-12-07T16:19:44.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.227+0000 7fc59cff9700 1 -- 172.21.15.63:0/3856848614 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5940102e0 con 0x7fc5a00fcd00 2023-12-07T16:19:44.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.227+0000 7fc5a6846700 1 -- 172.21.15.63:0/3856848614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a010f1a0 con 0x7fc5a00fcd00 2023-12-07T16:19:44.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.228+0000 7fc5a6846700 1 -- 172.21.15.63:0/3856848614 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a004bb80 con 0x7fc5a00fcd00 2023-12-07T16:19:44.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.228+0000 7fc59cff9700 1 -- 172.21.15.63:0/3856848614 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc594011380 con 0x7fc5a00fcd00 2023-12-07T16:19:44.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.228+0000 7fc59cff9700 1 --2- 172.21.15.63:0/3856848614 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fc588068f60 0x7fc58806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:44.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.229+0000 7fc59cff9700 1 -- 172.21.15.63:0/3856848614 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc5940871b0 con 0x7fc5a00fcd00 2023-12-07T16:19:44.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.229+0000 7fc59ffff700 1 --2- 172.21.15.63:0/3856848614 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fc588068f60 0x7fc58806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:44.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.229+0000 7fc59ffff700 1 --2- 172.21.15.63:0/3856848614 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fc588068f60 0x7fc58806b410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc590004890 tx=0x7fc590009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:44.230 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.233+0000 7fc59cff9700 1 -- 172.21.15.63:0/3856848614 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc594057040 con 0x7fc5a00fcd00 2023-12-07T16:19:44.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.443+0000 7fc5a6846700 1 -- 172.21.15.63:0/3856848614 --> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5a010f610 con 0x7fc588068f60 2023-12-07T16:19:44.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.448+0000 7fc59cff9700 1 -- 172.21.15.63:0/3856848614 <== mgr.14212 v2:172.21.15.63:6800/184283085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fc5a010f610 con 0x7fc588068f60 2023-12-07T16:19:44.446 INFO:teuthology.orchestra.run.smithi063.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-07T16:19:44.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.450+0000 7fc5a6846700 1 -- 172.21.15.63:0/3856848614 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fc588068f60 msgr2=0x7fc58806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:44.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.450+0000 7fc5a6846700 1 --2- 172.21.15.63:0/3856848614 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fc588068f60 0x7fc58806b410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc590004890 tx=0x7fc590009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:44.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.450+0000 7fc5a6846700 1 -- 172.21.15.63:0/3856848614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5a00fcd00 msgr2=0x7fc5a010dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:44.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.450+0000 7fc5a6846700 1 --2- 172.21.15.63:0/3856848614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5a00fcd00 0x7fc5a010dae0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc59400c810 tx=0x7fc594004470 comp rx=0 tx=0).stop 2023-12-07T16:19:44.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.450+0000 7fc5a6846700 1 -- 172.21.15.63:0/3856848614 shutdown_connections 2023-12-07T16:19:44.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.450+0000 7fc5a6846700 1 --2- 172.21.15.63:0/3856848614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5a00fbaf0 0x7fc5a010d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:44.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.450+0000 7fc5a6846700 1 --2- 172.21.15.63:0/3856848614 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fc588068f60 0x7fc58806b410 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:44.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.450+0000 7fc5a6846700 1 --2- 172.21.15.63:0/3856848614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5a00fcd00 0x7fc5a010dae0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:44.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.450+0000 7fc5a6846700 1 -- 172.21.15.63:0/3856848614 >> 172.21.15.63:0/3856848614 conn(0x7fc5a00f7190 msgr2=0x7fc5a00f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:44.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.450+0000 7fc5a6846700 1 -- 172.21.15.63:0/3856848614 shutdown_connections 2023-12-07T16:19:44.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:44.451+0000 7fc5a6846700 1 -- 172.21.15.63:0/3856848614 wait complete. 2023-12-07T16:19:44.643 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:44 smithi063 ceph-mon[112095]: pgmap v147: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2023-12-07T16:19:44.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:44 smithi152 ceph-mon[121113]: pgmap v147: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2023-12-07T16:19:44.809 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-07T16:19:44.810 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi063.front.sepia.ceph.com 2023-12-07T16:19:44.810 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2023-12-07T16:19:45.088 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:19:45.560 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:45 smithi063 ceph-mon[112095]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:19:45.560 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:45 smithi063 ceph-mon[112095]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-07T16:19:45.560 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:45 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:45.560 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:45 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:19:45.561 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:45 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:19:45.561 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:45 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:19:45.561 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:45 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:45.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:45 smithi152 ceph-mon[121113]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:19:45.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:45 smithi152 ceph-mon[121113]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-07T16:19:45.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:45 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:45.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:45 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:19:45.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:45 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:19:45.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:45 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:19:45.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:45 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:19:46.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.148+0000 7f1d292ac700 1 -- 172.21.15.63:0/3367867309 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d240fff90 msgr2=0x7f1d24100400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:46.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.148+0000 7f1d292ac700 1 --2- 172.21.15.63:0/3367867309 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d240fff90 0x7f1d24100400 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1d18004940 tx=0x7f1d18009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.148+0000 7f1d292ac700 1 -- 172.21.15.63:0/3367867309 shutdown_connections 2023-12-07T16:19:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.148+0000 7f1d292ac700 1 --2- 172.21.15.63:0/3367867309 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d240fff90 0x7f1d24100400 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.148+0000 7f1d292ac700 1 --2- 172.21.15.63:0/3367867309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d240fee20 0x7f1d240ff230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.148+0000 7f1d292ac700 1 -- 172.21.15.63:0/3367867309 >> 172.21.15.63:0/3367867309 conn(0x7f1d240fa5d0 msgr2=0x7f1d240fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.148+0000 7f1d292ac700 1 -- 172.21.15.63:0/3367867309 shutdown_connections 2023-12-07T16:19:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.148+0000 7f1d292ac700 1 -- 172.21.15.63:0/3367867309 wait complete. 2023-12-07T16:19:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.149+0000 7f1d292ac700 1 Processor -- start 2023-12-07T16:19:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.149+0000 7f1d292ac700 1 -- start start 2023-12-07T16:19:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.149+0000 7f1d292ac700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d240fee20 0x7f1d2410f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:46.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.149+0000 7f1d292ac700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d240fff90 0x7f1d2410fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:46.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.149+0000 7f1d292ac700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d24110310 con 0x7f1d240fee20 2023-12-07T16:19:46.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.149+0000 7f1d292ac700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d24110bb0 con 0x7f1d240fff90 2023-12-07T16:19:46.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.149+0000 7f1d22ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d240fee20 0x7f1d2410f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:46.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.149+0000 7f1d22ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d240fee20 0x7f1d2410f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34172/0 (socket says 172.21.15.63:34172) 2023-12-07T16:19:46.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.149+0000 7f1d22ffd700 1 -- 172.21.15.63:0/119437740 learned_addr learned my addr 172.21.15.63:0/119437740 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:46.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.149+0000 7f1d227fc700 1 --2- 172.21.15.63:0/119437740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d240fff90 0x7f1d2410fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:46.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.149+0000 7f1d22ffd700 1 -- 172.21.15.63:0/119437740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d240fff90 msgr2=0x7f1d2410fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:46.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.149+0000 7f1d22ffd700 1 --2- 172.21.15.63:0/119437740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d240fff90 0x7f1d2410fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:46.150 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.149+0000 7f1d22ffd700 1 -- 172.21.15.63:0/119437740 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d18005040 con 0x7f1d240fee20 2023-12-07T16:19:46.150 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.149+0000 7f1d22ffd700 1 --2- 172.21.15.63:0/119437740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d240fee20 0x7f1d2410f7d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1d14002a50 tx=0x7f1d140046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:46.150 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.150+0000 7f1d0b7fe700 1 -- 172.21.15.63:0/119437740 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d14007cc0 con 0x7f1d240fee20 2023-12-07T16:19:46.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.150+0000 7f1d0b7fe700 1 -- 172.21.15.63:0/119437740 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1d1400f040 con 0x7f1d240fee20 2023-12-07T16:19:46.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.150+0000 7f1d292ac700 1 -- 172.21.15.63:0/119437740 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d24110e90 con 0x7f1d240fee20 2023-12-07T16:19:46.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.150+0000 7f1d0b7fe700 1 -- 172.21.15.63:0/119437740 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d1400d9c0 con 0x7f1d240fee20 2023-12-07T16:19:46.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.150+0000 7f1d292ac700 1 -- 172.21.15.63:0/119437740 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d241113d0 con 0x7f1d240fee20 2023-12-07T16:19:46.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.151+0000 7f1d292ac700 1 -- 172.21.15.63:0/119437740 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d2404bb80 con 0x7f1d240fee20 2023-12-07T16:19:46.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.151+0000 7f1d0b7fe700 1 -- 172.21.15.63:0/119437740 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f1d1400db20 con 0x7f1d240fee20 2023-12-07T16:19:46.152 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.152+0000 7f1d0b7fe700 1 --2- 172.21.15.63:0/119437740 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f1d0c068f60 0x7f1d0c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:46.152 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.152+0000 7f1d0b7fe700 1 -- 172.21.15.63:0/119437740 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1d14086b20 con 0x7f1d240fee20 2023-12-07T16:19:46.152 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.152+0000 7f1d227fc700 1 --2- 172.21.15.63:0/119437740 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f1d0c068f60 0x7f1d0c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:46.152 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.152+0000 7f1d227fc700 1 --2- 172.21.15.63:0/119437740 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f1d0c068f60 0x7f1d0c06b410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800b3b0 tx=0x7f1d18009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:46.154 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.156+0000 7f1d0b7fe700 1 -- 172.21.15.63:0/119437740 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1d140569b0 con 0x7f1d240fee20 2023-12-07T16:19:46.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.394+0000 7f1d292ac700 1 -- 172.21.15.63:0/119437740 --> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d24111a20 con 0x7f1d0c068f60 2023-12-07T16:19:46.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.395+0000 7f1d0b7fe700 1 -- 172.21.15.63:0/119437740 <== mgr.14212 v2:172.21.15.63:6800/184283085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f1d24111a20 con 0x7f1d0c068f60 2023-12-07T16:19:46.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.397+0000 7f1d292ac700 1 -- 172.21.15.63:0/119437740 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f1d0c068f60 msgr2=0x7f1d0c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:46.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.397+0000 7f1d292ac700 1 --2- 172.21.15.63:0/119437740 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f1d0c068f60 0x7f1d0c06b410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800b3b0 tx=0x7f1d18009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:46.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.397+0000 7f1d292ac700 1 -- 172.21.15.63:0/119437740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d240fee20 msgr2=0x7f1d2410f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:46.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.397+0000 7f1d292ac700 1 --2- 172.21.15.63:0/119437740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d240fee20 0x7f1d2410f7d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1d14002a50 tx=0x7f1d140046b0 comp rx=0 tx=0).stop 2023-12-07T16:19:46.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.397+0000 7f1d292ac700 1 -- 172.21.15.63:0/119437740 shutdown_connections 2023-12-07T16:19:46.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.397+0000 7f1d292ac700 1 --2- 172.21.15.63:0/119437740 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f1d0c068f60 0x7f1d0c06b410 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:46.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.397+0000 7f1d292ac700 1 --2- 172.21.15.63:0/119437740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d240fee20 0x7f1d2410f7d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:46.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.397+0000 7f1d292ac700 1 --2- 172.21.15.63:0/119437740 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d240fff90 0x7f1d2410fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:46.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.397+0000 7f1d292ac700 1 -- 172.21.15.63:0/119437740 >> 172.21.15.63:0/119437740 conn(0x7f1d240fa5d0 msgr2=0x7f1d24103250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:46.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.398+0000 7f1d292ac700 1 -- 172.21.15.63:0/119437740 shutdown_connections 2023-12-07T16:19:46.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.398+0000 7f1d292ac700 1 -- 172.21.15.63:0/119437740 wait complete. 2023-12-07T16:19:46.407 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-07T16:19:46.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.516+0000 7f2233c15700 1 -- 172.21.15.63:0/1680542059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f222c0fbaf0 msgr2=0x7f222c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:46.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.516+0000 7f2233c15700 1 --2- 172.21.15.63:0/1680542059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f222c0fbaf0 0x7f222c0fbf00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2228004940 tx=0x7f2228009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:46.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.516+0000 7f2233c15700 1 -- 172.21.15.63:0/1680542059 shutdown_connections 2023-12-07T16:19:46.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.516+0000 7f2233c15700 1 --2- 172.21.15.63:0/1680542059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f222c0fcd00 0x7f222c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:46.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.516+0000 7f2233c15700 1 --2- 172.21.15.63:0/1680542059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f222c0fbaf0 0x7f222c0fbf00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:46.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.516+0000 7f2233c15700 1 -- 172.21.15.63:0/1680542059 >> 172.21.15.63:0/1680542059 conn(0x7f222c0f7190 msgr2=0x7f222c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:46.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.516+0000 7f2233c15700 1 -- 172.21.15.63:0/1680542059 shutdown_connections 2023-12-07T16:19:46.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.516+0000 7f2233c15700 1 -- 172.21.15.63:0/1680542059 wait complete. 2023-12-07T16:19:46.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.517+0000 7f2233c15700 1 Processor -- start 2023-12-07T16:19:46.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.517+0000 7f2233c15700 1 -- start start 2023-12-07T16:19:46.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.517+0000 7f2233c15700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f222c0fbaf0 0x7f222c1102a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:46.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.517+0000 7f2233c15700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f222c0fcd00 0x7f222c1127f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:46.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.517+0000 7f2233c15700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c066110 con 0x7f222c0fbaf0 2023-12-07T16:19:46.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.517+0000 7f2233c15700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c066250 con 0x7f222c0fcd00 2023-12-07T16:19:46.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.517+0000 7f22319b1700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f222c0fbaf0 0x7f222c1102a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:46.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.517+0000 7f22319b1700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f222c0fbaf0 0x7f222c1102a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34192/0 (socket says 172.21.15.63:34192) 2023-12-07T16:19:46.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.517+0000 7f22319b1700 1 -- 172.21.15.63:0/1473568015 learned_addr learned my addr 172.21.15.63:0/1473568015 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:46.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.518+0000 7f22319b1700 1 -- 172.21.15.63:0/1473568015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f222c0fcd00 msgr2=0x7f222c1127f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:46.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.518+0000 7f22319b1700 1 --2- 172.21.15.63:0/1473568015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f222c0fcd00 0x7f222c1127f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:46.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.518+0000 7f22319b1700 1 -- 172.21.15.63:0/1473568015 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2228005040 con 0x7f222c0fbaf0 2023-12-07T16:19:46.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.518+0000 7f22319b1700 1 --2- 172.21.15.63:0/1473568015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f222c0fbaf0 0x7f222c1102a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2228000c00 tx=0x7f2228009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:46.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.518+0000 7f22227fc700 1 -- 172.21.15.63:0/1473568015 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f222800e040 con 0x7f222c0fbaf0 2023-12-07T16:19:46.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.518+0000 7f22227fc700 1 -- 172.21.15.63:0/1473568015 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2228009af0 con 0x7f222c0fbaf0 2023-12-07T16:19:46.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.518+0000 7f2233c15700 1 -- 172.21.15.63:0/1473568015 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f222c112df0 con 0x7f222c0fbaf0 2023-12-07T16:19:46.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.518+0000 7f22227fc700 1 -- 172.21.15.63:0/1473568015 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f222801c630 con 0x7f222c0fbaf0 2023-12-07T16:19:46.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.518+0000 7f2233c15700 1 -- 172.21.15.63:0/1473568015 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f222c1132b0 con 0x7f222c0fbaf0 2023-12-07T16:19:46.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.519+0000 7f2233c15700 1 -- 172.21.15.63:0/1473568015 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f222c04bb80 con 0x7f222c0fbaf0 2023-12-07T16:19:46.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.520+0000 7f22227fc700 1 -- 172.21.15.63:0/1473568015 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f222800bcd0 con 0x7f222c0fbaf0 2023-12-07T16:19:46.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.520+0000 7f22227fc700 1 --2- 172.21.15.63:0/1473568015 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f2218068f60 0x7f221806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:46.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.520+0000 7f22311b0700 1 --2- 172.21.15.63:0/1473568015 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f2218068f60 0x7f221806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:46.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.520+0000 7f22227fc700 1 -- 172.21.15.63:0/1473568015 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2228088100 con 0x7f222c0fbaf0 2023-12-07T16:19:46.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.521+0000 7f22311b0700 1 --2- 172.21.15.63:0/1473568015 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f2218068f60 0x7f221806b410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f221c004d00 tx=0x7f221c009ce0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:46.522 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.524+0000 7f22227fc700 1 -- 172.21.15.63:0/1473568015 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2228054620 con 0x7f222c0fbaf0 2023-12-07T16:19:46.742 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.744+0000 7f2233c15700 1 -- 172.21.15.63:0/1473568015 --> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f222c101670 con 0x7f2218068f60 2023-12-07T16:19:46.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:46 smithi152 ceph-mon[121113]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-07T16:19:46.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:46 smithi152 ceph-mon[121113]: pgmap v148: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2023-12-07T16:19:46.743 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.745+0000 7f22227fc700 1 -- 172.21.15.63:0/1473568015 <== mgr.14212 v2:172.21.15.63:6800/184283085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f222c101670 con 0x7f2218068f60 2023-12-07T16:19:46.745 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.747+0000 7f2233c15700 1 -- 172.21.15.63:0/1473568015 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f2218068f60 msgr2=0x7f221806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:46.745 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.747+0000 7f2233c15700 1 --2- 172.21.15.63:0/1473568015 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f2218068f60 0x7f221806b410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f221c004d00 tx=0x7f221c009ce0 comp rx=0 tx=0).stop 2023-12-07T16:19:46.745 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.747+0000 7f2233c15700 1 -- 172.21.15.63:0/1473568015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f222c0fbaf0 msgr2=0x7f222c1102a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:46.745 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.747+0000 7f2233c15700 1 --2- 172.21.15.63:0/1473568015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f222c0fbaf0 0x7f222c1102a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2228000c00 tx=0x7f2228009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:46.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.747+0000 7f2233c15700 1 -- 172.21.15.63:0/1473568015 shutdown_connections 2023-12-07T16:19:46.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.747+0000 7f2233c15700 1 --2- 172.21.15.63:0/1473568015 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f2218068f60 0x7f221806b410 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:46.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.747+0000 7f2233c15700 1 --2- 172.21.15.63:0/1473568015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f222c0fbaf0 0x7f222c1102a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:46.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.747+0000 7f2233c15700 1 --2- 172.21.15.63:0/1473568015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f222c0fcd00 0x7f222c1127f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:46.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.747+0000 7f2233c15700 1 -- 172.21.15.63:0/1473568015 >> 172.21.15.63:0/1473568015 conn(0x7f222c0f7190 msgr2=0x7f222c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:46.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.747+0000 7f2233c15700 1 -- 172.21.15.63:0/1473568015 shutdown_connections 2023-12-07T16:19:46.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.747+0000 7f2233c15700 1 -- 172.21.15.63:0/1473568015 wait complete. 2023-12-07T16:19:46.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.854+0000 7f7b5e0d9700 1 -- 172.21.15.63:0/4264716584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b580fdb80 msgr2=0x7f7b58104440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:46.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.854+0000 7f7b5e0d9700 1 --2- 172.21.15.63:0/4264716584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b580fdb80 0x7f7b58104440 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c004940 tx=0x7f7b4c009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:46.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.854+0000 7f7b5e0d9700 1 -- 172.21.15.63:0/4264716584 shutdown_connections 2023-12-07T16:19:46.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.854+0000 7f7b5e0d9700 1 --2- 172.21.15.63:0/4264716584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b580fdb80 0x7f7b58104440 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:46.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.855+0000 7f7b5e0d9700 1 --2- 172.21.15.63:0/4264716584 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b580fd1a0 0x7f7b580fd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:46.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.855+0000 7f7b5e0d9700 1 -- 172.21.15.63:0/4264716584 >> 172.21.15.63:0/4264716584 conn(0x7f7b580f6950 msgr2=0x7f7b580f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:46.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.855+0000 7f7b5e0d9700 1 -- 172.21.15.63:0/4264716584 shutdown_connections 2023-12-07T16:19:46.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.855+0000 7f7b5e0d9700 1 -- 172.21.15.63:0/4264716584 wait complete. 2023-12-07T16:19:46.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.855+0000 7f7b5e0d9700 1 Processor -- start 2023-12-07T16:19:46.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.856+0000 7f7b5e0d9700 1 -- start start 2023-12-07T16:19:46.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.856+0000 7f7b5e0d9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b580fd1a0 0x7f7b5810f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:46.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.856+0000 7f7b5e0d9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b5810fd30 0x7f7b58110bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:46.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.856+0000 7f7b5e0d9700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b581101f0 con 0x7f7b580fd1a0 2023-12-07T16:19:46.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.856+0000 7f7b5e0d9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b58110330 con 0x7f7b5810fd30 2023-12-07T16:19:46.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.856+0000 7f7b577fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b580fd1a0 0x7f7b5810f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:46.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.856+0000 7f7b577fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b580fd1a0 0x7f7b5810f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34220/0 (socket says 172.21.15.63:34220) 2023-12-07T16:19:46.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.856+0000 7f7b577fe700 1 -- 172.21.15.63:0/1076748731 learned_addr learned my addr 172.21.15.63:0/1076748731 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:46.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.856+0000 7f7b56ffd700 1 --2- 172.21.15.63:0/1076748731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b5810fd30 0x7f7b58110bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:46.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.856+0000 7f7b577fe700 1 -- 172.21.15.63:0/1076748731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b5810fd30 msgr2=0x7f7b58110bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:46.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.856+0000 7f7b577fe700 1 --2- 172.21.15.63:0/1076748731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b5810fd30 0x7f7b58110bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:46.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.856+0000 7f7b577fe700 1 -- 172.21.15.63:0/1076748731 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c005040 con 0x7f7b580fd1a0 2023-12-07T16:19:46.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.856+0000 7f7b56ffd700 1 --2- 172.21.15.63:0/1076748731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b5810fd30 0x7f7b58110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T16:19:46.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.856+0000 7f7b577fe700 1 --2- 172.21.15.63:0/1076748731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b580fd1a0 0x7f7b5810f7f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7b48002a50 tx=0x7f7b480046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:46.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.857+0000 7f7b3ffff700 1 -- 172.21.15.63:0/1076748731 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b48007cc0 con 0x7f7b580fd1a0 2023-12-07T16:19:46.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.857+0000 7f7b3ffff700 1 -- 172.21.15.63:0/1076748731 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7b4800f040 con 0x7f7b580fd1a0 2023-12-07T16:19:46.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.857+0000 7f7b5e0d9700 1 -- 172.21.15.63:0/1076748731 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b58111230 con 0x7f7b580fd1a0 2023-12-07T16:19:46.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.857+0000 7f7b3ffff700 1 -- 172.21.15.63:0/1076748731 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b48009540 con 0x7f7b580fd1a0 2023-12-07T16:19:46.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.857+0000 7f7b5e0d9700 1 -- 172.21.15.63:0/1076748731 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b58111740 con 0x7f7b580fd1a0 2023-12-07T16:19:46.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.858+0000 7f7b5e0d9700 1 -- 172.21.15.63:0/1076748731 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b58109810 con 0x7f7b580fd1a0 2023-12-07T16:19:46.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.858+0000 7f7b3ffff700 1 -- 172.21.15.63:0/1076748731 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f7b480096a0 con 0x7f7b580fd1a0 2023-12-07T16:19:46.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.859+0000 7f7b3ffff700 1 --2- 172.21.15.63:0/1076748731 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f7b40068f70 0x7f7b4006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:46.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.859+0000 7f7b3ffff700 1 -- 172.21.15.63:0/1076748731 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f7b48086b10 con 0x7f7b580fd1a0 2023-12-07T16:19:46.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.859+0000 7f7b56ffd700 1 --2- 172.21.15.63:0/1076748731 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f7b40068f70 0x7f7b4006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:46.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.859+0000 7f7b56ffd700 1 --2- 172.21.15.63:0/1076748731 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f7b40068f70 0x7f7b4006b420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c000c00 tx=0x7f7b4c009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:46.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:46.865+0000 7f7b3ffff700 1 -- 172.21.15.63:0/1076748731 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7b48056a20 con 0x7f7b580fd1a0 2023-12-07T16:19:46.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:46 smithi063 ceph-mon[112095]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149 2023-12-07T16:19:46.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:46 smithi063 ceph-mon[112095]: pgmap v148: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2023-12-07T16:19:47.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.088+0000 7f7b5e0d9700 1 -- 172.21.15.63:0/1076748731 --> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b580fdb80 con 0x7f7b40068f70 2023-12-07T16:19:47.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.098+0000 7f7b3ffff700 1 -- 172.21.15.63:0/1076748731 <== mgr.14212 v2:172.21.15.63:6800/184283085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f7b580fdb80 con 0x7f7b40068f70 2023-12-07T16:19:47.096 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-07T16:19:47.096 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (3m) 22s ago 4m 27.3M - 0.25.0 c8568f914cd2 bfa7e53794bf 2023-12-07T16:19:47.096 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (4m) 22s ago 4m 7428k - 17.2.7-115-g4f62d9ad fcdfd00f81c7 80bed1094ab4 2023-12-07T16:19:47.096 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi152 smithi152 running (3m) 25s ago 3m 7495k - 17.2.7-115-g4f62d9ad fcdfd00f81c7 e2cd5532384b 2023-12-07T16:19:47.096 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (3m) 22s ago 4m 91.5M - 9.4.7 954c08fa6188 ead20992252b 2023-12-07T16:19:47.096 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.gsjgcq smithi063 running (36s) 22s ago 36s 12.0M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 f70e4f098e4c 2023-12-07T16:19:47.096 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.yidolg smithi063 running (33s) 22s ago 32s 14.7M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5b053ef5fb7f 2023-12-07T16:19:47.096 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.aovwwd smithi152 running (31s) 25s ago 31s 12.9M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 80190948a595 2023-12-07T16:19:47.096 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.mrvngf smithi152 running (35s) 25s ago 34s 15.8M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5f60b893f840 2023-12-07T16:19:47.097 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.yohyyx smithi063 *:9283 running (5m) 22s ago 5m 494M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 e9b3a40f26fd 2023-12-07T16:19:47.097 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi152.sxayfb smithi152 *:8443,9283 running (3m) 25s ago 3m 438M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 f0df841e22a0 2023-12-07T16:19:47.097 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (5m) 22s ago 5m 77.6M 2048M 17.2.7-115-g4f62d9ad fcdfd00f81c7 736281f5463c 2023-12-07T16:19:47.097 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi152 smithi152 running (3m) 25s ago 3m 57.7M 2048M 17.2.7-115-g4f62d9ad fcdfd00f81c7 ecfe3add39d6 2023-12-07T16:19:47.097 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (4m) 22s ago 4m 16.3M - 1.5.0 0da6a335fe13 8412e0ac9145 2023-12-07T16:19:47.097 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi152 smithi152 *:9100 running (3m) 25s ago 3m 18.4M - 1.5.0 0da6a335fe13 fb0e82afe6a4 2023-12-07T16:19:47.097 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (3m) 22s ago 3m 58.2M 4299M 17.2.7-115-g4f62d9ad fcdfd00f81c7 bbdd7f82a7c3 2023-12-07T16:19:47.097 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (2m) 22s ago 2m 59.9M 4299M 17.2.7-115-g4f62d9ad fcdfd00f81c7 4372601f899e 2023-12-07T16:19:47.097 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (2m) 22s ago 2m 56.2M 4299M 17.2.7-115-g4f62d9ad fcdfd00f81c7 b0d432bbca05 2023-12-07T16:19:47.097 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi152 running (2m) 25s ago 2m 57.1M 5323M 17.2.7-115-g4f62d9ad fcdfd00f81c7 94d14402b489 2023-12-07T16:19:47.097 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi152 running (109s) 25s ago 109s 53.2M 5323M 17.2.7-115-g4f62d9ad fcdfd00f81c7 d3b8b2f12489 2023-12-07T16:19:47.098 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi152 running (91s) 25s ago 90s 49.7M 5323M 17.2.7-115-g4f62d9ad fcdfd00f81c7 e7f8d9f716bb 2023-12-07T16:19:47.098 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (3m) 22s ago 3m 48.7M - 2.43.0 a07b618ecd1d 32eb5a56be5e 2023-12-07T16:19:47.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.100+0000 7f7b5e0d9700 1 -- 172.21.15.63:0/1076748731 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f7b40068f70 msgr2=0x7f7b4006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:47.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.100+0000 7f7b5e0d9700 1 --2- 172.21.15.63:0/1076748731 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f7b40068f70 0x7f7b4006b420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c000c00 tx=0x7f7b4c009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:47.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.100+0000 7f7b5e0d9700 1 -- 172.21.15.63:0/1076748731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b580fd1a0 msgr2=0x7f7b5810f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:47.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.100+0000 7f7b5e0d9700 1 --2- 172.21.15.63:0/1076748731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b580fd1a0 0x7f7b5810f7f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7b48002a50 tx=0x7f7b480046b0 comp rx=0 tx=0).stop 2023-12-07T16:19:47.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.100+0000 7f7b5e0d9700 1 -- 172.21.15.63:0/1076748731 shutdown_connections 2023-12-07T16:19:47.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.100+0000 7f7b5e0d9700 1 --2- 172.21.15.63:0/1076748731 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f7b40068f70 0x7f7b4006b420 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:47.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.100+0000 7f7b5e0d9700 1 --2- 172.21.15.63:0/1076748731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b580fd1a0 0x7f7b5810f7f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:47.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.100+0000 7f7b5e0d9700 1 --2- 172.21.15.63:0/1076748731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b5810fd30 0x7f7b58110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:47.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.100+0000 7f7b5e0d9700 1 -- 172.21.15.63:0/1076748731 >> 172.21.15.63:0/1076748731 conn(0x7f7b580f6950 msgr2=0x7f7b580f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:47.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.100+0000 7f7b5e0d9700 1 -- 172.21.15.63:0/1076748731 shutdown_connections 2023-12-07T16:19:47.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.100+0000 7f7b5e0d9700 1 -- 172.21.15.63:0/1076748731 wait complete. 2023-12-07T16:19:47.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.213+0000 7f142d20b700 1 -- 172.21.15.63:0/3394445749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14280fc0e0 msgr2=0x7f14280fc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:47.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.213+0000 7f142d20b700 1 --2- 172.21.15.63:0/3394445749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14280fc0e0 0x7f14280fc4f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1418004940 tx=0x7f1418009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:47.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.213+0000 7f142d20b700 1 -- 172.21.15.63:0/3394445749 shutdown_connections 2023-12-07T16:19:47.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.213+0000 7f142d20b700 1 --2- 172.21.15.63:0/3394445749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14280fcac0 0x7f14280fcf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:47.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.213+0000 7f142d20b700 1 --2- 172.21.15.63:0/3394445749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14280fc0e0 0x7f14280fc4f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:47.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.213+0000 7f142d20b700 1 -- 172.21.15.63:0/3394445749 >> 172.21.15.63:0/3394445749 conn(0x7f14280f6950 msgr2=0x7f14280f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:47.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.213+0000 7f142d20b700 1 -- 172.21.15.63:0/3394445749 shutdown_connections 2023-12-07T16:19:47.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.213+0000 7f142d20b700 1 -- 172.21.15.63:0/3394445749 wait complete. 2023-12-07T16:19:47.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.214+0000 7f142d20b700 1 Processor -- start 2023-12-07T16:19:47.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.214+0000 7f142d20b700 1 -- start start 2023-12-07T16:19:47.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.214+0000 7f142d20b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14280fc0e0 0x7f142810d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:47.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.214+0000 7f142d20b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14280fcac0 0x7f142810dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:47.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.214+0000 7f142d20b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142810e0b0 con 0x7f14280fc0e0 2023-12-07T16:19:47.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.214+0000 7f142d20b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142810e950 con 0x7f14280fcac0 2023-12-07T16:19:47.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.214+0000 7f1426d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14280fc0e0 0x7f142810d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:47.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.214+0000 7f1426d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14280fc0e0 0x7f142810d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34230/0 (socket says 172.21.15.63:34230) 2023-12-07T16:19:47.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.214+0000 7f1426d9d700 1 -- 172.21.15.63:0/3392787771 learned_addr learned my addr 172.21.15.63:0/3392787771 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:47.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.214+0000 7f142659c700 1 --2- 172.21.15.63:0/3392787771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14280fcac0 0x7f142810dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:47.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.214+0000 7f1426d9d700 1 -- 172.21.15.63:0/3392787771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14280fcac0 msgr2=0x7f142810dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:47.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.214+0000 7f1426d9d700 1 --2- 172.21.15.63:0/3392787771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14280fcac0 0x7f142810dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:47.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.214+0000 7f1426d9d700 1 -- 172.21.15.63:0/3392787771 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1418005040 con 0x7f14280fc0e0 2023-12-07T16:19:47.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.215+0000 7f1426d9d700 1 --2- 172.21.15.63:0/3392787771 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14280fc0e0 0x7f142810d570 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1418000c00 tx=0x7f1418009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:47.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.215+0000 7f140f7fe700 1 -- 172.21.15.63:0/3392787771 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1418021070 con 0x7f14280fc0e0 2023-12-07T16:19:47.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.215+0000 7f140f7fe700 1 -- 172.21.15.63:0/3392787771 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f141801c400 con 0x7f14280fc0e0 2023-12-07T16:19:47.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.215+0000 7f142d20b700 1 -- 172.21.15.63:0/3392787771 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f142810ebd0 con 0x7f14280fc0e0 2023-12-07T16:19:47.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.215+0000 7f140f7fe700 1 -- 172.21.15.63:0/3392787771 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f141800e070 con 0x7f14280fc0e0 2023-12-07T16:19:47.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.215+0000 7f142d20b700 1 -- 172.21.15.63:0/3392787771 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142810f0b0 con 0x7f14280fc0e0 2023-12-07T16:19:47.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.216+0000 7f142d20b700 1 -- 172.21.15.63:0/3392787771 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f142804bb80 con 0x7f14280fc0e0 2023-12-07T16:19:47.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.216+0000 7f140f7fe700 1 -- 172.21.15.63:0/3392787771 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f141801c9e0 con 0x7f14280fc0e0 2023-12-07T16:19:47.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.217+0000 7f140f7fe700 1 --2- 172.21.15.63:0/3392787771 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f1410068f60 0x7f141006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:47.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.217+0000 7f142659c700 1 --2- 172.21.15.63:0/3392787771 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f1410068f60 0x7f141006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:47.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.217+0000 7f140f7fe700 1 -- 172.21.15.63:0/3392787771 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1418088030 con 0x7f14280fc0e0 2023-12-07T16:19:47.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.217+0000 7f142659c700 1 --2- 172.21.15.63:0/3392787771 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f1410068f60 0x7f141006b410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f141c004600 tx=0x7f141c00b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:47.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.221+0000 7f140f7fe700 1 -- 172.21.15.63:0/3392787771 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1418057f40 con 0x7f14280fc0e0 2023-12-07T16:19:47.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.524+0000 7f142d20b700 1 -- 172.21.15.63:0/3392787771 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1428113b90 con 0x7f14280fc0e0 2023-12-07T16:19:47.522 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.524+0000 7f140f7fe700 1 -- 172.21.15.63:0/3392787771 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f1418057ad0 con 0x7f14280fc0e0 2023-12-07T16:19:47.522 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:19:47.522 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-07T16:19:47.522 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 2 2023-12-07T16:19:47.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:19:47.523 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-07T16:19:47.523 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 2 2023-12-07T16:19:47.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:19:47.523 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-07T16:19:47.523 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 6 2023-12-07T16:19:47.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:19:47.523 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-07T16:19:47.523 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 4 2023-12-07T16:19:47.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:19:47.523 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-07T16:19:47.523 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 14 2023-12-07T16:19:47.524 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-07T16:19:47.524 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:19:47.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.526+0000 7f142d20b700 1 -- 172.21.15.63:0/3392787771 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f1410068f60 msgr2=0x7f141006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:47.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.526+0000 7f142d20b700 1 --2- 172.21.15.63:0/3392787771 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f1410068f60 0x7f141006b410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f141c004600 tx=0x7f141c00b040 comp rx=0 tx=0).stop 2023-12-07T16:19:47.524 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.526+0000 7f142d20b700 1 -- 172.21.15.63:0/3392787771 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14280fc0e0 msgr2=0x7f142810d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:47.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.526+0000 7f142d20b700 1 --2- 172.21.15.63:0/3392787771 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14280fc0e0 0x7f142810d570 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1418000c00 tx=0x7f1418009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:47.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.526+0000 7f142d20b700 1 -- 172.21.15.63:0/3392787771 shutdown_connections 2023-12-07T16:19:47.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.526+0000 7f142d20b700 1 --2- 172.21.15.63:0/3392787771 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f1410068f60 0x7f141006b410 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:47.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.526+0000 7f142d20b700 1 --2- 172.21.15.63:0/3392787771 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14280fc0e0 0x7f142810d570 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:47.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.526+0000 7f142d20b700 1 --2- 172.21.15.63:0/3392787771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14280fcac0 0x7f142810dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:47.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.526+0000 7f142d20b700 1 -- 172.21.15.63:0/3392787771 >> 172.21.15.63:0/3392787771 conn(0x7f14280f6950 msgr2=0x7f14281000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:47.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.526+0000 7f142d20b700 1 -- 172.21.15.63:0/3392787771 shutdown_connections 2023-12-07T16:19:47.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.526+0000 7f142d20b700 1 -- 172.21.15.63:0/3392787771 wait complete. 2023-12-07T16:19:47.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.635+0000 7f51667be700 1 -- 172.21.15.63:0/757547841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51600fcd00 msgr2=0x7f51600fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:47.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.635+0000 7f51667be700 1 --2- 172.21.15.63:0/757547841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51600fcd00 0x7f51600fd150 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5148004940 tx=0x7f5148009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:47.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.635+0000 7f51667be700 1 -- 172.21.15.63:0/757547841 shutdown_connections 2023-12-07T16:19:47.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.635+0000 7f51667be700 1 --2- 172.21.15.63:0/757547841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51600fcd00 0x7f51600fd150 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:47.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.635+0000 7f51667be700 1 --2- 172.21.15.63:0/757547841 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51600fbaf0 0x7f51600fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:47.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.635+0000 7f51667be700 1 -- 172.21.15.63:0/757547841 >> 172.21.15.63:0/757547841 conn(0x7f51600f7190 msgr2=0x7f51600f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:47.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.635+0000 7f51667be700 1 -- 172.21.15.63:0/757547841 shutdown_connections 2023-12-07T16:19:47.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.635+0000 7f51667be700 1 -- 172.21.15.63:0/757547841 wait complete. 2023-12-07T16:19:47.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.636+0000 7f51667be700 1 Processor -- start 2023-12-07T16:19:47.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.636+0000 7f51667be700 1 -- start start 2023-12-07T16:19:47.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.636+0000 7f51667be700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51600fbaf0 0x7f5160110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:47.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.636+0000 7f51667be700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51600fcd00 0x7f51601127c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:47.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.636+0000 7f51667be700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5160066130 con 0x7f51600fcd00 2023-12-07T16:19:47.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.636+0000 7f51667be700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5160066270 con 0x7f51600fbaf0 2023-12-07T16:19:47.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.636+0000 7f5157fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51600fcd00 0x7f51601127c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:47.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.636+0000 7f5157fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51600fcd00 0x7f51601127c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34242/0 (socket says 172.21.15.63:34242) 2023-12-07T16:19:47.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.636+0000 7f5157fff700 1 -- 172.21.15.63:0/1452791807 learned_addr learned my addr 172.21.15.63:0/1452791807 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:47.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.636+0000 7f515ffff700 1 --2- 172.21.15.63:0/1452791807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51600fbaf0 0x7f5160110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:47.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.637+0000 7f5157fff700 1 -- 172.21.15.63:0/1452791807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51600fbaf0 msgr2=0x7f5160110270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:47.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.637+0000 7f5157fff700 1 --2- 172.21.15.63:0/1452791807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51600fbaf0 0x7f5160110270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:47.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.637+0000 7f5157fff700 1 -- 172.21.15.63:0/1452791807 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5148005040 con 0x7f51600fcd00 2023-12-07T16:19:47.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.637+0000 7f5157fff700 1 --2- 172.21.15.63:0/1452791807 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51600fcd00 0x7f51601127c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5148009380 tx=0x7f5148009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:47.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.637+0000 7f515d7fa700 1 -- 172.21.15.63:0/1452791807 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f514800e040 con 0x7f51600fcd00 2023-12-07T16:19:47.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.637+0000 7f515d7fa700 1 -- 172.21.15.63:0/1452791807 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5148004290 con 0x7f51600fcd00 2023-12-07T16:19:47.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.637+0000 7f515d7fa700 1 -- 172.21.15.63:0/1452791807 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f514801c630 con 0x7f51600fcd00 2023-12-07T16:19:47.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.637+0000 7f51667be700 1 -- 172.21.15.63:0/1452791807 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5160112dc0 con 0x7f51600fcd00 2023-12-07T16:19:47.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.637+0000 7f51667be700 1 -- 172.21.15.63:0/1452791807 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51601132b0 con 0x7f51600fcd00 2023-12-07T16:19:47.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.638+0000 7f51667be700 1 -- 172.21.15.63:0/1452791807 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f516004bb80 con 0x7f51600fcd00 2023-12-07T16:19:47.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.639+0000 7f515d7fa700 1 -- 172.21.15.63:0/1452791807 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f514800bcd0 con 0x7f51600fcd00 2023-12-07T16:19:47.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.640+0000 7f515d7fa700 1 --2- 172.21.15.63:0/1452791807 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f514c068f70 0x7f514c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:47.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.640+0000 7f515d7fa700 1 -- 172.21.15.63:0/1452791807 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f5148088ca0 con 0x7f51600fcd00 2023-12-07T16:19:47.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.640+0000 7f515ffff700 1 --2- 172.21.15.63:0/1452791807 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f514c068f70 0x7f514c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:47.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.640+0000 7f515ffff700 1 --2- 172.21.15.63:0/1452791807 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f514c068f70 0x7f514c06b420 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5150009fd0 tx=0x7f5150009f00 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:47.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.643+0000 7f515d7fa700 1 -- 172.21.15.63:0/1452791807 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f51480551c0 con 0x7f51600fcd00 2023-12-07T16:19:47.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:47 smithi152 ceph-mon[121113]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:19:47.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.905+0000 7f51667be700 1 -- 172.21.15.63:0/1452791807 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5160104490 con 0x7f51600fcd00 2023-12-07T16:19:47.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.906+0000 7f515d7fa700 1 -- 172.21.15.63:0/1452791807 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1819 (secure 0 0 0) 0x7f51480587e0 con 0x7f51600fcd00 2023-12-07T16:19:47.904 INFO:teuthology.orchestra.run.smithi063.stdout:e15 2023-12-07T16:19:47.904 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-07T16:19:47.904 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:19:47.904 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-07T16:19:47.904 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:19:47.904 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-07T16:19:47.904 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-07T16:19:47.904 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 15 2023-12-07T16:19:47.904 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-07T16:19:47.904 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-07T16:19:08.352640+0000 2023-12-07T16:19:47.905 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-07T16:19:22.407210+0000 2023-12-07T16:19:47.905 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-07T16:19:47.905 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-07T16:19:47.905 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-07T16:19:47.905 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-07T16:19:47.905 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-07T16:19:47.905 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-07T16:19:47.905 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-07T16:19:47.905 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 45 2023-12-07T16:19:47.905 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:19:47.906 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 2 2023-12-07T16:19:47.906 INFO:teuthology.orchestra.run.smithi063.stdout:in 0,1 2023-12-07T16:19:47.906 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14478,1=24269} 2023-12-07T16:19:47.906 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-07T16:19:47.906 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-07T16:19:47.906 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-07T16:19:47.906 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-07T16:19:47.906 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-07T16:19:47.906 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-07T16:19:47.906 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-07T16:19:47.907 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-07T16:19:47.907 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.yidolg{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:19:47.907 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.mrvngf{1:24269} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.152:6824/3157779064,v1:172.21.15.152:6825/3157779064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:19:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:19:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:19:47.907 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-07T16:19:47.907 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:19:47.907 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.gsjgcq{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/3063200414,v1:172.21.15.63:6827/3063200414] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:19:47.907 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.aovwwd{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/2906349729,v1:172.21.15.152:6827/2906349729] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:19:47.908 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:47 smithi063 ceph-mon[112095]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:19:47.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.908+0000 7f51667be700 1 -- 172.21.15.63:0/1452791807 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f514c068f70 msgr2=0x7f514c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:47.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.908+0000 7f51667be700 1 --2- 172.21.15.63:0/1452791807 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f514c068f70 0x7f514c06b420 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5150009fd0 tx=0x7f5150009f00 comp rx=0 tx=0).stop 2023-12-07T16:19:47.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.908+0000 7f51667be700 1 -- 172.21.15.63:0/1452791807 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51600fcd00 msgr2=0x7f51601127c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:47.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.908+0000 7f51667be700 1 --2- 172.21.15.63:0/1452791807 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51600fcd00 0x7f51601127c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5148009380 tx=0x7f5148009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:47.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.908+0000 7f51667be700 1 -- 172.21.15.63:0/1452791807 shutdown_connections 2023-12-07T16:19:47.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.908+0000 7f51667be700 1 --2- 172.21.15.63:0/1452791807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51600fbaf0 0x7f5160110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:47.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.908+0000 7f51667be700 1 --2- 172.21.15.63:0/1452791807 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f514c068f70 0x7f514c06b420 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:47.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.908+0000 7f51667be700 1 --2- 172.21.15.63:0/1452791807 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51600fcd00 0x7f51601127c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:47.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.908+0000 7f51667be700 1 -- 172.21.15.63:0/1452791807 >> 172.21.15.63:0/1452791807 conn(0x7f51600f7190 msgr2=0x7f51600fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:47.910 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.908+0000 7f51667be700 1 -- 172.21.15.63:0/1452791807 shutdown_connections 2023-12-07T16:19:47.910 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:47.908+0000 7f51667be700 1 -- 172.21.15.63:0/1452791807 wait complete. 2023-12-07T16:19:47.910 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 15 2023-12-07T16:19:48.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.020+0000 7fcb53130700 1 -- 172.21.15.63:0/3856013976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb4c0ffd70 msgr2=0x7fcb4c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:48.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.020+0000 7fcb53130700 1 --2- 172.21.15.63:0/3856013976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb4c0ffd70 0x7fcb4c1021d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcb38004940 tx=0x7fcb38009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:48.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.020+0000 7fcb53130700 1 -- 172.21.15.63:0/3856013976 shutdown_connections 2023-12-07T16:19:48.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.020+0000 7fcb53130700 1 --2- 172.21.15.63:0/3856013976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb4c0ffd70 0x7fcb4c1021d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:48.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.020+0000 7fcb53130700 1 --2- 172.21.15.63:0/3856013976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb4c066090 0x7fcb4c0ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:48.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.020+0000 7fcb53130700 1 -- 172.21.15.63:0/3856013976 >> 172.21.15.63:0/3856013976 conn(0x7fcb4c0f7190 msgr2=0x7fcb4c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:48.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.020+0000 7fcb53130700 1 -- 172.21.15.63:0/3856013976 shutdown_connections 2023-12-07T16:19:48.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.020+0000 7fcb53130700 1 -- 172.21.15.63:0/3856013976 wait complete. 2023-12-07T16:19:48.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.021+0000 7fcb53130700 1 Processor -- start 2023-12-07T16:19:48.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.021+0000 7fcb53130700 1 -- start start 2023-12-07T16:19:48.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.021+0000 7fcb53130700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb4c066090 0x7fcb4c10d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:48.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.021+0000 7fcb53130700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb4c0ffd70 0x7fcb4c10da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:48.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.021+0000 7fcb53130700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c10e070 con 0x7fcb4c066090 2023-12-07T16:19:48.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.021+0000 7fcb53130700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c10e910 con 0x7fcb4c0ffd70 2023-12-07T16:19:48.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.021+0000 7fcb50ecc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb4c066090 0x7fcb4c10d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:48.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.021+0000 7fcb50ecc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb4c066090 0x7fcb4c10d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34262/0 (socket says 172.21.15.63:34262) 2023-12-07T16:19:48.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.021+0000 7fcb50ecc700 1 -- 172.21.15.63:0/1410396944 learned_addr learned my addr 172.21.15.63:0/1410396944 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:48.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.022+0000 7fcb4bfff700 1 --2- 172.21.15.63:0/1410396944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb4c0ffd70 0x7fcb4c10da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:48.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.022+0000 7fcb50ecc700 1 -- 172.21.15.63:0/1410396944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb4c0ffd70 msgr2=0x7fcb4c10da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:48.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.022+0000 7fcb50ecc700 1 --2- 172.21.15.63:0/1410396944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb4c0ffd70 0x7fcb4c10da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:48.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.022+0000 7fcb50ecc700 1 -- 172.21.15.63:0/1410396944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb38005040 con 0x7fcb4c066090 2023-12-07T16:19:48.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.022+0000 7fcb50ecc700 1 --2- 172.21.15.63:0/1410396944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb4c066090 0x7fcb4c10d530 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcb40002a50 tx=0x7fcb400046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:48.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.022+0000 7fcb497fa700 1 -- 172.21.15.63:0/1410396944 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb40007cc0 con 0x7fcb4c066090 2023-12-07T16:19:48.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.022+0000 7fcb497fa700 1 -- 172.21.15.63:0/1410396944 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcb4000f040 con 0x7fcb4c066090 2023-12-07T16:19:48.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.022+0000 7fcb53130700 1 -- 172.21.15.63:0/1410396944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4c10ebf0 con 0x7fcb4c066090 2023-12-07T16:19:48.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.022+0000 7fcb497fa700 1 -- 172.21.15.63:0/1410396944 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb4000d9c0 con 0x7fcb4c066090 2023-12-07T16:19:48.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.022+0000 7fcb53130700 1 -- 172.21.15.63:0/1410396944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4c10f130 con 0x7fcb4c066090 2023-12-07T16:19:48.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.024+0000 7fcb53130700 1 -- 172.21.15.63:0/1410396944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb4c1075c0 con 0x7fcb4c066090 2023-12-07T16:19:48.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.024+0000 7fcb497fa700 1 -- 172.21.15.63:0/1410396944 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fcb4000db20 con 0x7fcb4c066090 2023-12-07T16:19:48.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.024+0000 7fcb497fa700 1 --2- 172.21.15.63:0/1410396944 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fcb3c068f60 0x7fcb3c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:48.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.024+0000 7fcb497fa700 1 -- 172.21.15.63:0/1410396944 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fcb40086a30 con 0x7fcb4c066090 2023-12-07T16:19:48.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.025+0000 7fcb4bfff700 1 --2- 172.21.15.63:0/1410396944 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fcb3c068f60 0x7fcb3c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:48.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.025+0000 7fcb4bfff700 1 --2- 172.21.15.63:0/1410396944 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fcb3c068f60 0x7fcb3c06b410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcb38004890 tx=0x7fcb38009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:48.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.029+0000 7fcb497fa700 1 -- 172.21.15.63:0/1410396944 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcb40056940 con 0x7fcb4c066090 2023-12-07T16:19:48.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.266+0000 7fcb53130700 1 -- 172.21.15.63:0/1410396944 --> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb4c10f410 con 0x7fcb3c068f60 2023-12-07T16:19:48.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.267+0000 7fcb497fa700 1 -- 172.21.15.63:0/1410396944 <== mgr.14212 v2:172.21.15.63:6800/184283085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fcb4c10f410 con 0x7fcb3c068f60 2023-12-07T16:19:48.265 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:19:48.265 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149", 2023-12-07T16:19:48.265 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-07T16:19:48.265 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-07T16:19:48.265 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [], 2023-12-07T16:19:48.265 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "", 2023-12-07T16:19:48.265 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:e6605fb8725c25c4838cef6a39f30df73f1ed149 image", 2023-12-07T16:19:48.265 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-07T16:19:48.266 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:19:48.267 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.269+0000 7fcb53130700 1 -- 172.21.15.63:0/1410396944 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fcb3c068f60 msgr2=0x7fcb3c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:48.267 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.269+0000 7fcb53130700 1 --2- 172.21.15.63:0/1410396944 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fcb3c068f60 0x7fcb3c06b410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcb38004890 tx=0x7fcb38009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:48.267 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.269+0000 7fcb53130700 1 -- 172.21.15.63:0/1410396944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb4c066090 msgr2=0x7fcb4c10d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:48.267 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.269+0000 7fcb53130700 1 --2- 172.21.15.63:0/1410396944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb4c066090 0x7fcb4c10d530 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcb40002a50 tx=0x7fcb400046b0 comp rx=0 tx=0).stop 2023-12-07T16:19:48.267 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.269+0000 7fcb53130700 1 -- 172.21.15.63:0/1410396944 shutdown_connections 2023-12-07T16:19:48.267 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.269+0000 7fcb53130700 1 --2- 172.21.15.63:0/1410396944 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fcb3c068f60 0x7fcb3c06b410 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:48.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.269+0000 7fcb53130700 1 --2- 172.21.15.63:0/1410396944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb4c066090 0x7fcb4c10d530 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:48.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.269+0000 7fcb53130700 1 --2- 172.21.15.63:0/1410396944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb4c0ffd70 0x7fcb4c10da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:48.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.269+0000 7fcb53130700 1 -- 172.21.15.63:0/1410396944 >> 172.21.15.63:0/1410396944 conn(0x7fcb4c0f7190 msgr2=0x7fcb4c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:48.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.269+0000 7fcb53130700 1 -- 172.21.15.63:0/1410396944 shutdown_connections 2023-12-07T16:19:48.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.269+0000 7fcb53130700 1 -- 172.21.15.63:0/1410396944 wait complete. 2023-12-07T16:19:48.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.384+0000 7fd5c89e3700 1 -- 172.21.15.63:0/2366761105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5c40fde00 msgr2=0x7fd5c40fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:48.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.384+0000 7fd5c89e3700 1 --2- 172.21.15.63:0/2366761105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5c40fde00 0x7fd5c40fe250 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8004940 tx=0x7fd5b8009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:48.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.384+0000 7fd5c89e3700 1 -- 172.21.15.63:0/2366761105 shutdown_connections 2023-12-07T16:19:48.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.384+0000 7fd5c89e3700 1 --2- 172.21.15.63:0/2366761105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5c40fde00 0x7fd5c40fe250 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:48.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.384+0000 7fd5c89e3700 1 --2- 172.21.15.63:0/2366761105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5c40fcbf0 0x7fd5c40fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:48.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.384+0000 7fd5c89e3700 1 -- 172.21.15.63:0/2366761105 >> 172.21.15.63:0/2366761105 conn(0x7fd5c40f82d0 msgr2=0x7fd5c40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:48.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.384+0000 7fd5c89e3700 1 -- 172.21.15.63:0/2366761105 shutdown_connections 2023-12-07T16:19:48.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.384+0000 7fd5c89e3700 1 -- 172.21.15.63:0/2366761105 wait complete. 2023-12-07T16:19:48.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.385+0000 7fd5c89e3700 1 Processor -- start 2023-12-07T16:19:48.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.385+0000 7fd5c89e3700 1 -- start start 2023-12-07T16:19:48.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.385+0000 7fd5c89e3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5c40fcbf0 0x7fd5c410d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:48.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.385+0000 7fd5c89e3700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5c40fde00 0x7fd5c410da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:48.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.385+0000 7fd5c89e3700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c410e030 con 0x7fd5c40fde00 2023-12-07T16:19:48.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.385+0000 7fd5c89e3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c410e8d0 con 0x7fd5c40fcbf0 2023-12-07T16:19:48.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.385+0000 7fd5c1d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5c40fde00 0x7fd5c410da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:48.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.385+0000 7fd5c1d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5c40fde00 0x7fd5c410da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34292/0 (socket says 172.21.15.63:34292) 2023-12-07T16:19:48.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.385+0000 7fd5c1d9b700 1 -- 172.21.15.63:0/27832706 learned_addr learned my addr 172.21.15.63:0/27832706 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:19:48.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.385+0000 7fd5c259c700 1 --2- 172.21.15.63:0/27832706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5c40fcbf0 0x7fd5c410d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:48.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.385+0000 7fd5c1d9b700 1 -- 172.21.15.63:0/27832706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5c40fcbf0 msgr2=0x7fd5c410d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:48.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.385+0000 7fd5c1d9b700 1 --2- 172.21.15.63:0/27832706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5c40fcbf0 0x7fd5c410d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:48.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.385+0000 7fd5c1d9b700 1 -- 172.21.15.63:0/27832706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b8005040 con 0x7fd5c40fde00 2023-12-07T16:19:48.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.386+0000 7fd5c259c700 1 --2- 172.21.15.63:0/27832706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5c40fcbf0 0x7fd5c410d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T16:19:48.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.386+0000 7fd5c1d9b700 1 --2- 172.21.15.63:0/27832706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5c40fde00 0x7fd5c410da30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8000c00 tx=0x7fd5b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:48.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.386+0000 7fd5b2ffd700 1 -- 172.21.15.63:0/27832706 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5b8021070 con 0x7fd5c40fde00 2023-12-07T16:19:48.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.386+0000 7fd5c89e3700 1 -- 172.21.15.63:0/27832706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c410eb50 con 0x7fd5c40fde00 2023-12-07T16:19:48.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.386+0000 7fd5b2ffd700 1 -- 172.21.15.63:0/27832706 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd5b801c400 con 0x7fd5c40fde00 2023-12-07T16:19:48.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.386+0000 7fd5b2ffd700 1 -- 172.21.15.63:0/27832706 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5b800e070 con 0x7fd5c40fde00 2023-12-07T16:19:48.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.386+0000 7fd5c89e3700 1 -- 172.21.15.63:0/27832706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c410f030 con 0x7fd5c40fde00 2023-12-07T16:19:48.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.387+0000 7fd5c89e3700 1 -- 172.21.15.63:0/27832706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c404bb80 con 0x7fd5c40fde00 2023-12-07T16:19:48.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.387+0000 7fd5b2ffd700 1 -- 172.21.15.63:0/27832706 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fd5b801c570 con 0x7fd5c40fde00 2023-12-07T16:19:48.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.388+0000 7fd5b2ffd700 1 --2- 172.21.15.63:0/27832706 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd5ac068f60 0x7fd5ac06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:19:48.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.388+0000 7fd5b2ffd700 1 -- 172.21.15.63:0/27832706 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd5b80880f0 con 0x7fd5c40fde00 2023-12-07T16:19:48.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.388+0000 7fd5c259c700 1 --2- 172.21.15.63:0/27832706 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd5ac068f60 0x7fd5ac06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:19:48.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.388+0000 7fd5c259c700 1 --2- 172.21.15.63:0/27832706 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd5ac068f60 0x7fd5ac06b410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4004600 tx=0x7fd5b400b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:19:48.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.393+0000 7fd5b2ffd700 1 -- 172.21.15.63:0/27832706 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd5b8058000 con 0x7fd5c40fde00 2023-12-07T16:19:48.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.705+0000 7fd5c89e3700 1 -- 172.21.15.63:0/27832706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd5c410f310 con 0x7fd5c40fde00 2023-12-07T16:19:48.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.705+0000 7fd5b2ffd700 1 -- 172.21.15.63:0/27832706 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fd5b8057b90 con 0x7fd5c40fde00 2023-12-07T16:19:48.703 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-07T16:19:48.703 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-07T16:19:48.703 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-07T16:19:48.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.708+0000 7fd5c89e3700 1 -- 172.21.15.63:0/27832706 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd5ac068f60 msgr2=0x7fd5ac06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:48.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.708+0000 7fd5c89e3700 1 --2- 172.21.15.63:0/27832706 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd5ac068f60 0x7fd5ac06b410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4004600 tx=0x7fd5b400b040 comp rx=0 tx=0).stop 2023-12-07T16:19:48.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.708+0000 7fd5c89e3700 1 -- 172.21.15.63:0/27832706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5c40fde00 msgr2=0x7fd5c410da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:19:48.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.708+0000 7fd5c89e3700 1 --2- 172.21.15.63:0/27832706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5c40fde00 0x7fd5c410da30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8000c00 tx=0x7fd5b8009e30 comp rx=0 tx=0).stop 2023-12-07T16:19:48.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.709+0000 7fd5c89e3700 1 -- 172.21.15.63:0/27832706 shutdown_connections 2023-12-07T16:19:48.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.709+0000 7fd5c89e3700 1 --2- 172.21.15.63:0/27832706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5c40fcbf0 0x7fd5c410d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:48.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.709+0000 7fd5c89e3700 1 --2- 172.21.15.63:0/27832706 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fd5ac068f60 0x7fd5ac06b410 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:48.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.709+0000 7fd5c89e3700 1 --2- 172.21.15.63:0/27832706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5c40fde00 0x7fd5c410da30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:19:48.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.709+0000 7fd5c89e3700 1 -- 172.21.15.63:0/27832706 >> 172.21.15.63:0/27832706 conn(0x7fd5c40f82d0 msgr2=0x7fd5c4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:19:48.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.709+0000 7fd5c89e3700 1 -- 172.21.15.63:0/27832706 shutdown_connections 2023-12-07T16:19:48.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:19:48.709+0000 7fd5c89e3700 1 -- 172.21.15.63:0/27832706 wait complete. 2023-12-07T16:19:48.745 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:48 smithi152 ceph-mon[121113]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:19:48.745 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:48 smithi152 ceph-mon[121113]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:19:48.745 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:48 smithi152 ceph-mon[121113]: pgmap v149: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2023-12-07T16:19:48.745 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:48 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/3392787771' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:19:48.745 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:48 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/1452791807' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:19:48.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:48 smithi063 ceph-mon[112095]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:19:48.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:48 smithi063 ceph-mon[112095]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:19:48.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:48 smithi063 ceph-mon[112095]: pgmap v149: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2023-12-07T16:19:48.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:48 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/3392787771' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:19:48.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:48 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/1452791807' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:19:49.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:49 smithi152 ceph-mon[121113]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:19:49.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:49 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/27832706' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:19:49.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:49 smithi063 ceph-mon[112095]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:19:49.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:49 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/27832706' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:19:50.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:50 smithi152 ceph-mon[121113]: pgmap v150: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-07T16:19:50.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:50 smithi063 ceph-mon[112095]: pgmap v150: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-07T16:19:52.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:52 smithi152 ceph-mon[121113]: pgmap v151: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-07T16:19:52.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:52 smithi063 ceph-mon[112095]: pgmap v151: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-07T16:19:54.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:54 smithi152 ceph-mon[121113]: pgmap v152: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:19:54.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:54 smithi063 ceph-mon[112095]: pgmap v152: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:19:55.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:55 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:19:55.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:55 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:19:56.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:56 smithi152 ceph-mon[121113]: pgmap v153: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:19:56.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:56 smithi063 ceph-mon[112095]: pgmap v153: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:19:58.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:19:58 smithi152 ceph-mon[121113]: pgmap v154: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:19:58.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:19:58 smithi063 ceph-mon[112095]: pgmap v154: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:00.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:00 smithi152 ceph-mon[121113]: pgmap v155: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:00.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:00 smithi152 ceph-mon[121113]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-07T16:20:00.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:00 smithi152 ceph-mon[121113]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-07T16:20:00.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:00 smithi152 ceph-mon[121113]: fs cephfs has deprecated feature inline_data enabled. 2023-12-07T16:20:00.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:00 smithi063 ceph-mon[112095]: pgmap v155: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:00.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:00 smithi063 ceph-mon[112095]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-07T16:20:00.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:00 smithi063 ceph-mon[112095]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-07T16:20:00.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:00 smithi063 ceph-mon[112095]: fs cephfs has deprecated feature inline_data enabled. 2023-12-07T16:20:02.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:02 smithi063 ceph-mon[112095]: pgmap v156: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:02.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:02 smithi152 ceph-mon[121113]: pgmap v156: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:04.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:04 smithi063 ceph-mon[112095]: pgmap v157: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:04.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:04 smithi152 ceph-mon[121113]: pgmap v157: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:06.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:06 smithi063 ceph-mon[112095]: pgmap v158: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:06.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:06 smithi152 ceph-mon[121113]: pgmap v158: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:08.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:08 smithi063 ceph-mon[112095]: pgmap v159: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:08.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:08 smithi152 ceph-mon[121113]: pgmap v159: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:10.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:10 smithi063 ceph-mon[112095]: pgmap v160: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:10.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:10 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:20:10.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:10 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:20:10.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:10 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:20:10.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:10 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:20:10.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:10 smithi152 ceph-mon[121113]: pgmap v160: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:10.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:10 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:20:10.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:10 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:20:10.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:10 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:20:10.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:10 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:20:11.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:11 smithi063 ceph-mon[112095]: Upgrade: Target is version 19.0.0-13-ge6605fb8 (unknown) 2023-12-07T16:20:11.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:11 smithi063 ceph-mon[112095]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a, digests ['quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a'] 2023-12-07T16:20:11.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:11 smithi063 ceph-mon[112095]: Upgrade: Need to upgrade myself (mgr.smithi063.yohyyx) 2023-12-07T16:20:11.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:11 smithi152 ceph-mon[121113]: Upgrade: Target is version 19.0.0-13-ge6605fb8 (unknown) 2023-12-07T16:20:11.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:11 smithi152 ceph-mon[121113]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a, digests ['quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a'] 2023-12-07T16:20:11.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:11 smithi152 ceph-mon[121113]: Upgrade: Need to upgrade myself (mgr.smithi063.yohyyx) 2023-12-07T16:20:12.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:12 smithi063 ceph-mon[112095]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a on smithi152 2023-12-07T16:20:12.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:12 smithi063 ceph-mon[112095]: pgmap v161: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-07T16:20:12.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:12 smithi152 ceph-mon[121113]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a on smithi152 2023-12-07T16:20:12.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:12 smithi152 ceph-mon[121113]: pgmap v161: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-07T16:20:14.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:14 smithi063 ceph-mon[112095]: pgmap v162: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-07T16:20:14.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:14 smithi152 ceph-mon[121113]: pgmap v162: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-07T16:20:16.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:16 smithi063 ceph-mon[112095]: pgmap v163: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-07T16:20:16.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:16 smithi152 ceph-mon[121113]: pgmap v163: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-07T16:20:18.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.817+0000 7faba85c0700 1 -- 172.21.15.63:0/1597779269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faba0100050 msgr2=0x7faba0102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:18.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.817+0000 7faba85c0700 1 --2- 172.21.15.63:0/1597779269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faba0100050 0x7faba0102430 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fab90004940 tx=0x7fab90009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:18.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.818+0000 7faba85c0700 1 -- 172.21.15.63:0/1597779269 shutdown_connections 2023-12-07T16:20:18.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.818+0000 7faba85c0700 1 --2- 172.21.15.63:0/1597779269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faba0100050 0x7faba0102430 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:18.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.818+0000 7faba85c0700 1 --2- 172.21.15.63:0/1597779269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faba00fd730 0x7faba00ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:18.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.818+0000 7faba85c0700 1 -- 172.21.15.63:0/1597779269 >> 172.21.15.63:0/1597779269 conn(0x7faba00f7190 msgr2=0x7faba00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:18.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.818+0000 7faba85c0700 1 -- 172.21.15.63:0/1597779269 shutdown_connections 2023-12-07T16:20:18.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.818+0000 7faba85c0700 1 -- 172.21.15.63:0/1597779269 wait complete. 2023-12-07T16:20:18.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.818+0000 7faba85c0700 1 Processor -- start 2023-12-07T16:20:18.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.818+0000 7faba85c0700 1 -- start start 2023-12-07T16:20:18.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.819+0000 7faba85c0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faba00fd730 0x7faba010f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:18.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.819+0000 7faba85c0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faba0100050 0x7faba010fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:18.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.819+0000 7faba85c0700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba01101f0 con 0x7faba0100050 2023-12-07T16:20:18.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.819+0000 7faba85c0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba0110a90 con 0x7faba00fd730 2023-12-07T16:20:18.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.819+0000 7faba5b5b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faba0100050 0x7faba010fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:18.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.819+0000 7faba635c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faba00fd730 0x7faba010f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:18.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.819+0000 7faba5b5b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faba0100050 0x7faba010fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51152/0 (socket says 172.21.15.63:51152) 2023-12-07T16:20:18.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.819+0000 7faba635c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faba00fd730 0x7faba010f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.63:43696/0 (socket says 172.21.15.63:43696) 2023-12-07T16:20:18.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.819+0000 7faba5b5b700 1 -- 172.21.15.63:0/2228295874 learned_addr learned my addr 172.21.15.63:0/2228295874 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:20:18.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.819+0000 7faba635c700 1 -- 172.21.15.63:0/2228295874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faba0100050 msgr2=0x7faba010fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:18.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.819+0000 7faba635c700 1 --2- 172.21.15.63:0/2228295874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faba0100050 0x7faba010fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:18.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.819+0000 7faba635c700 1 -- 172.21.15.63:0/2228295874 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab90005040 con 0x7faba00fd730 2023-12-07T16:20:18.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.819+0000 7faba635c700 1 --2- 172.21.15.63:0/2228295874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faba00fd730 0x7faba010f6b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fab9c009fd0 tx=0x7fab9c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:18.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.820+0000 7fab96ffd700 1 -- 172.21.15.63:0/2228295874 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab9c004e90 con 0x7faba00fd730 2023-12-07T16:20:18.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.820+0000 7faba85c0700 1 -- 172.21.15.63:0/2228295874 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba0110d10 con 0x7faba00fd730 2023-12-07T16:20:18.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.820+0000 7fab96ffd700 1 -- 172.21.15.63:0/2228295874 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fab9c00f040 con 0x7faba00fd730 2023-12-07T16:20:18.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.820+0000 7fab96ffd700 1 -- 172.21.15.63:0/2228295874 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab9c00c9b0 con 0x7faba00fd730 2023-12-07T16:20:18.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.820+0000 7faba85c0700 1 -- 172.21.15.63:0/2228295874 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba0111250 con 0x7faba00fd730 2023-12-07T16:20:18.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.821+0000 7faba85c0700 1 -- 172.21.15.63:0/2228295874 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba004bb80 con 0x7faba00fd730 2023-12-07T16:20:18.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.822+0000 7fab96ffd700 1 -- 172.21.15.63:0/2228295874 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fab9c007cc0 con 0x7faba00fd730 2023-12-07T16:20:18.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.822+0000 7fab96ffd700 1 --2- 172.21.15.63:0/2228295874 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fab8c068f60 0x7fab8c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:18.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.823+0000 7fab96ffd700 1 -- 172.21.15.63:0/2228295874 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fab9c086870 con 0x7faba00fd730 2023-12-07T16:20:18.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.823+0000 7faba5b5b700 1 --2- 172.21.15.63:0/2228295874 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fab8c068f60 0x7fab8c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:18.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.823+0000 7faba5b5b700 1 --2- 172.21.15.63:0/2228295874 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fab8c068f60 0x7fab8c06b410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fab900135e0 tx=0x7fab90009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:18.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:18.829+0000 7fab96ffd700 1 -- 172.21.15.63:0/2228295874 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fab9c04da00 con 0x7faba00fd730 2023-12-07T16:20:18.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:18 smithi063 ceph-mon[112095]: pgmap v164: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-07T16:20:18.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:18 smithi152 ceph-mon[121113]: pgmap v164: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-07T16:20:19.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.090+0000 7faba85c0700 1 -- 172.21.15.63:0/2228295874 --> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faba0111930 con 0x7fab8c068f60 2023-12-07T16:20:19.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.092+0000 7fab96ffd700 1 -- 172.21.15.63:0/2228295874 <== mgr.14212 v2:172.21.15.63:6800/184283085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7faba0111930 con 0x7fab8c068f60 2023-12-07T16:20:19.094 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.095+0000 7faba85c0700 1 -- 172.21.15.63:0/2228295874 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fab8c068f60 msgr2=0x7fab8c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:19.094 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.095+0000 7faba85c0700 1 --2- 172.21.15.63:0/2228295874 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fab8c068f60 0x7fab8c06b410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fab900135e0 tx=0x7fab90009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:19.094 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.095+0000 7faba85c0700 1 -- 172.21.15.63:0/2228295874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faba00fd730 msgr2=0x7faba010f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:19.094 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.095+0000 7faba85c0700 1 --2- 172.21.15.63:0/2228295874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faba00fd730 0x7faba010f6b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fab9c009fd0 tx=0x7fab9c00b040 comp rx=0 tx=0).stop 2023-12-07T16:20:19.094 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.095+0000 7faba85c0700 1 -- 172.21.15.63:0/2228295874 shutdown_connections 2023-12-07T16:20:19.094 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.095+0000 7faba85c0700 1 --2- 172.21.15.63:0/2228295874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faba00fd730 0x7faba010f6b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:19.094 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.095+0000 7faba85c0700 1 --2- 172.21.15.63:0/2228295874 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fab8c068f60 0x7fab8c06b410 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:19.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.095+0000 7faba85c0700 1 --2- 172.21.15.63:0/2228295874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faba0100050 0x7faba010fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:19.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.095+0000 7faba85c0700 1 -- 172.21.15.63:0/2228295874 >> 172.21.15.63:0/2228295874 conn(0x7faba00f7190 msgr2=0x7faba00fb520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:19.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.096+0000 7faba85c0700 1 -- 172.21.15.63:0/2228295874 shutdown_connections 2023-12-07T16:20:19.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.096+0000 7faba85c0700 1 -- 172.21.15.63:0/2228295874 wait complete. 2023-12-07T16:20:19.108 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-07T16:20:19.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.243+0000 7f29bf580700 1 -- 172.21.15.63:0/2708978944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29b80fcd00 msgr2=0x7f29b80fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:19.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.243+0000 7f29bf580700 1 --2- 172.21.15.63:0/2708978944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29b80fcd00 0x7f29b80fd150 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f29a4004940 tx=0x7f29a4009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:19.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.244+0000 7f29bf580700 1 -- 172.21.15.63:0/2708978944 shutdown_connections 2023-12-07T16:20:19.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.244+0000 7f29bf580700 1 --2- 172.21.15.63:0/2708978944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29b80fcd00 0x7f29b80fd150 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:19.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.244+0000 7f29bf580700 1 --2- 172.21.15.63:0/2708978944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29b80fbaf0 0x7f29b80fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:19.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.244+0000 7f29bf580700 1 -- 172.21.15.63:0/2708978944 >> 172.21.15.63:0/2708978944 conn(0x7f29b80f7190 msgr2=0x7f29b80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:19.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.244+0000 7f29bf580700 1 -- 172.21.15.63:0/2708978944 shutdown_connections 2023-12-07T16:20:19.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.244+0000 7f29bf580700 1 -- 172.21.15.63:0/2708978944 wait complete. 2023-12-07T16:20:19.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.244+0000 7f29bf580700 1 Processor -- start 2023-12-07T16:20:19.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.245+0000 7f29bf580700 1 -- start start 2023-12-07T16:20:19.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.245+0000 7f29bf580700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29b80fbaf0 0x7f29b8065a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:19.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.245+0000 7f29bf580700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29b80fcd00 0x7f29b806e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:19.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.245+0000 7f29bf580700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b80660e0 con 0x7f29b80fcd00 2023-12-07T16:20:19.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.245+0000 7f29bf580700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b8066250 con 0x7f29b80fbaf0 2023-12-07T16:20:19.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.245+0000 7f29bcb1b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29b80fcd00 0x7f29b806e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:19.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.245+0000 7f29bcb1b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29b80fcd00 0x7f29b806e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51174/0 (socket says 172.21.15.63:51174) 2023-12-07T16:20:19.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.245+0000 7f29bcb1b700 1 -- 172.21.15.63:0/3818783391 learned_addr learned my addr 172.21.15.63:0/3818783391 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:20:19.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.245+0000 7f29bd31c700 1 --2- 172.21.15.63:0/3818783391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29b80fbaf0 0x7f29b8065a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:19.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.245+0000 7f29bcb1b700 1 -- 172.21.15.63:0/3818783391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29b80fbaf0 msgr2=0x7f29b8065a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:19.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.245+0000 7f29bcb1b700 1 --2- 172.21.15.63:0/3818783391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29b80fbaf0 0x7f29b8065a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:19.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.245+0000 7f29bcb1b700 1 -- 172.21.15.63:0/3818783391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a4005040 con 0x7f29b80fcd00 2023-12-07T16:20:19.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.246+0000 7f29bcb1b700 1 --2- 172.21.15.63:0/3818783391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29b80fcd00 0x7f29b806e860 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f29a4000c00 tx=0x7f29a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:19.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.246+0000 7f29b5ffb700 1 -- 172.21.15.63:0/3818783391 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29a4021070 con 0x7f29b80fcd00 2023-12-07T16:20:19.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.246+0000 7f29b5ffb700 1 -- 172.21.15.63:0/3818783391 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f29a401c400 con 0x7f29b80fcd00 2023-12-07T16:20:19.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.246+0000 7f29bf580700 1 -- 172.21.15.63:0/3818783391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b806ee00 con 0x7f29b80fcd00 2023-12-07T16:20:19.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.246+0000 7f29b5ffb700 1 -- 172.21.15.63:0/3818783391 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29a400e070 con 0x7f29b80fcd00 2023-12-07T16:20:19.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.246+0000 7f29bf580700 1 -- 172.21.15.63:0/3818783391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b806f340 con 0x7f29b80fcd00 2023-12-07T16:20:19.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.247+0000 7f29bf580700 1 -- 172.21.15.63:0/3818783391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b804bb80 con 0x7f29b80fcd00 2023-12-07T16:20:19.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.248+0000 7f29b5ffb700 1 -- 172.21.15.63:0/3818783391 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f29a401ca00 con 0x7f29b80fcd00 2023-12-07T16:20:19.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.249+0000 7f29b5ffb700 1 --2- 172.21.15.63:0/3818783391 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f29a8068f60 0x7f29a806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:19.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.249+0000 7f29b5ffb700 1 -- 172.21.15.63:0/3818783391 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f29a4088050 con 0x7f29b80fcd00 2023-12-07T16:20:19.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.249+0000 7f29bd31c700 1 --2- 172.21.15.63:0/3818783391 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f29a8068f60 0x7f29a806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:19.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.250+0000 7f29bd31c700 1 --2- 172.21.15.63:0/3818783391 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f29a8068f60 0x7f29a806b410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f29b80fcb60 tx=0x7f29ac00b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:19.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.257+0000 7f29b5ffb700 1 -- 172.21.15.63:0/3818783391 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f29a40544b0 con 0x7f29b80fcd00 2023-12-07T16:20:19.528 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.529+0000 7f29bf580700 1 -- 172.21.15.63:0/3818783391 --> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f29b8101650 con 0x7f29a8068f60 2023-12-07T16:20:19.529 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.531+0000 7f29b5ffb700 1 -- 172.21.15.63:0/3818783391 <== mgr.14212 v2:172.21.15.63:6800/184283085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f29b8101650 con 0x7f29a8068f60 2023-12-07T16:20:19.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.534+0000 7f29bf580700 1 -- 172.21.15.63:0/3818783391 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f29a8068f60 msgr2=0x7f29a806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:19.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.534+0000 7f29bf580700 1 --2- 172.21.15.63:0/3818783391 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f29a8068f60 0x7f29a806b410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f29b80fcb60 tx=0x7f29ac00b040 comp rx=0 tx=0).stop 2023-12-07T16:20:19.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.534+0000 7f29bf580700 1 -- 172.21.15.63:0/3818783391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29b80fcd00 msgr2=0x7f29b806e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:19.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.534+0000 7f29bf580700 1 --2- 172.21.15.63:0/3818783391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29b80fcd00 0x7f29b806e860 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f29a4000c00 tx=0x7f29a4009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:19.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.534+0000 7f29bf580700 1 -- 172.21.15.63:0/3818783391 shutdown_connections 2023-12-07T16:20:19.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.534+0000 7f29bf580700 1 --2- 172.21.15.63:0/3818783391 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29b80fbaf0 0x7f29b8065a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:19.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.534+0000 7f29bf580700 1 --2- 172.21.15.63:0/3818783391 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f29a8068f60 0x7f29a806b410 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:19.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.534+0000 7f29bf580700 1 --2- 172.21.15.63:0/3818783391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29b80fcd00 0x7f29b806e860 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:19.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.534+0000 7f29bf580700 1 -- 172.21.15.63:0/3818783391 >> 172.21.15.63:0/3818783391 conn(0x7f29b80f7190 msgr2=0x7f29b80fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:19.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.534+0000 7f29bf580700 1 -- 172.21.15.63:0/3818783391 shutdown_connections 2023-12-07T16:20:19.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.534+0000 7f29bf580700 1 -- 172.21.15.63:0/3818783391 wait complete. 2023-12-07T16:20:19.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.675+0000 7fce350a5700 1 -- 172.21.15.63:0/214922428 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce300fde00 msgr2=0x7fce300fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:19.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.675+0000 7fce350a5700 1 --2- 172.21.15.63:0/214922428 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce300fde00 0x7fce300fe250 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fce24004940 tx=0x7fce24009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:19.674 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.675+0000 7fce350a5700 1 -- 172.21.15.63:0/214922428 shutdown_connections 2023-12-07T16:20:19.674 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.675+0000 7fce350a5700 1 --2- 172.21.15.63:0/214922428 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce300fde00 0x7fce300fe250 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:19.674 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.675+0000 7fce350a5700 1 --2- 172.21.15.63:0/214922428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce300fcbf0 0x7fce300fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:19.674 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.675+0000 7fce350a5700 1 -- 172.21.15.63:0/214922428 >> 172.21.15.63:0/214922428 conn(0x7fce300f82d0 msgr2=0x7fce300fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:19.674 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.675+0000 7fce350a5700 1 -- 172.21.15.63:0/214922428 shutdown_connections 2023-12-07T16:20:19.674 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.675+0000 7fce350a5700 1 -- 172.21.15.63:0/214922428 wait complete. 2023-12-07T16:20:19.674 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.676+0000 7fce350a5700 1 Processor -- start 2023-12-07T16:20:19.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.676+0000 7fce350a5700 1 -- start start 2023-12-07T16:20:19.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.676+0000 7fce350a5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce300fcbf0 0x7fce3010d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:19.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.676+0000 7fce350a5700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce300fde00 0x7fce3010da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:19.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.676+0000 7fce350a5700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3010e030 con 0x7fce300fde00 2023-12-07T16:20:19.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.676+0000 7fce350a5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3010e8d0 con 0x7fce300fcbf0 2023-12-07T16:20:19.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.677+0000 7fce2e59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce300fde00 0x7fce3010da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:19.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.677+0000 7fce2ed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce300fcbf0 0x7fce3010d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:19.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.677+0000 7fce2ed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce300fcbf0 0x7fce3010d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.63:59240/0 (socket says 172.21.15.63:59240) 2023-12-07T16:20:19.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.677+0000 7fce2e59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce300fde00 0x7fce3010da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44080/0 (socket says 172.21.15.63:44080) 2023-12-07T16:20:19.676 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.677+0000 7fce2ed9d700 1 -- 172.21.15.63:0/1884211440 learned_addr learned my addr 172.21.15.63:0/1884211440 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:20:19.676 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.677+0000 7fce2ed9d700 1 -- 172.21.15.63:0/1884211440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce300fde00 msgr2=0x7fce3010da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:19.676 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.677+0000 7fce2ed9d700 1 --2- 172.21.15.63:0/1884211440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce300fde00 0x7fce3010da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:19.676 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.677+0000 7fce2ed9d700 1 -- 172.21.15.63:0/1884211440 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce24005040 con 0x7fce300fcbf0 2023-12-07T16:20:19.676 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.677+0000 7fce2e59c700 1 --2- 172.21.15.63:0/1884211440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce300fde00 0x7fce3010da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T16:20:19.676 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.677+0000 7fce2ed9d700 1 --2- 172.21.15.63:0/1884211440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce300fcbf0 0x7fce3010d4f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fce2000eb70 tx=0x7fce2000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:19.676 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.677+0000 7fce177fe700 1 -- 172.21.15.63:0/1884211440 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce20007cc0 con 0x7fce300fcbf0 2023-12-07T16:20:19.677 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.677+0000 7fce350a5700 1 -- 172.21.15.63:0/1884211440 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3010ead0 con 0x7fce300fcbf0 2023-12-07T16:20:19.677 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.678+0000 7fce177fe700 1 -- 172.21.15.63:0/1884211440 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fce2000f040 con 0x7fce300fcbf0 2023-12-07T16:20:19.677 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.678+0000 7fce177fe700 1 -- 172.21.15.63:0/1884211440 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce2000c9d0 con 0x7fce300fcbf0 2023-12-07T16:20:19.677 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.678+0000 7fce350a5700 1 -- 172.21.15.63:0/1884211440 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce3010f010 con 0x7fce300fcbf0 2023-12-07T16:20:19.677 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.679+0000 7fce350a5700 1 -- 172.21.15.63:0/1884211440 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce3004bb80 con 0x7fce300fcbf0 2023-12-07T16:20:19.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.680+0000 7fce177fe700 1 -- 172.21.15.63:0/1884211440 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fce2000cb30 con 0x7fce300fcbf0 2023-12-07T16:20:19.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.680+0000 7fce177fe700 1 --2- 172.21.15.63:0/1884211440 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fce18068f60 0x7fce1806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:19.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.680+0000 7fce177fe700 1 -- 172.21.15.63:0/1884211440 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fce200866a0 con 0x7fce300fcbf0 2023-12-07T16:20:19.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.680+0000 7fce2e59c700 1 --2- 172.21.15.63:0/1884211440 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fce18068f60 0x7fce1806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:19.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.681+0000 7fce2e59c700 1 --2- 172.21.15.63:0/1884211440 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fce18068f60 0x7fce1806b410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fce24000c00 tx=0x7fce24009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:19.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.689+0000 7fce177fe700 1 -- 172.21.15.63:0/1884211440 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fce20056660 con 0x7fce300fcbf0 2023-12-07T16:20:19.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.938+0000 7fce350a5700 1 -- 172.21.15.63:0/1884211440 --> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fce30102750 con 0x7fce18068f60 2023-12-07T16:20:19.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.955+0000 7fce177fe700 1 -- 172.21.15.63:0/1884211440 <== mgr.14212 v2:172.21.15.63:6800/184283085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7fce30102750 con 0x7fce18068f60 2023-12-07T16:20:19.954 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-07T16:20:19.954 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (3m) 55s ago 4m 27.3M - 0.25.0 c8568f914cd2 bfa7e53794bf 2023-12-07T16:20:19.954 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (5m) 55s ago 5m 7428k - 17.2.7-115-g4f62d9ad fcdfd00f81c7 80bed1094ab4 2023-12-07T16:20:19.954 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi152 smithi152 running (4m) 58s ago 4m 7495k - 17.2.7-115-g4f62d9ad fcdfd00f81c7 e2cd5532384b 2023-12-07T16:20:19.954 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (3m) 55s ago 4m 91.5M - 9.4.7 954c08fa6188 ead20992252b 2023-12-07T16:20:19.954 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.gsjgcq smithi063 running (69s) 55s ago 69s 12.0M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 f70e4f098e4c 2023-12-07T16:20:19.954 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.yidolg smithi063 running (66s) 55s ago 65s 14.7M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5b053ef5fb7f 2023-12-07T16:20:19.954 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.aovwwd smithi152 running (64s) 58s ago 64s 12.9M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 80190948a595 2023-12-07T16:20:19.954 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.mrvngf smithi152 running (68s) 58s ago 67s 15.8M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5f60b893f840 2023-12-07T16:20:19.954 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.yohyyx smithi063 *:9283 running (6m) 55s ago 6m 494M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 e9b3a40f26fd 2023-12-07T16:20:19.954 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi152.sxayfb smithi152 *:8443,9283 running (4m) 58s ago 4m 438M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 f0df841e22a0 2023-12-07T16:20:19.954 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (6m) 55s ago 6m 77.6M 2048M 17.2.7-115-g4f62d9ad fcdfd00f81c7 736281f5463c 2023-12-07T16:20:19.954 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi152 smithi152 running (4m) 58s ago 4m 57.7M 2048M 17.2.7-115-g4f62d9ad fcdfd00f81c7 ecfe3add39d6 2023-12-07T16:20:19.954 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (5m) 55s ago 5m 16.3M - 1.5.0 0da6a335fe13 8412e0ac9145 2023-12-07T16:20:19.954 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi152 smithi152 *:9100 running (4m) 58s ago 4m 18.4M - 1.5.0 0da6a335fe13 fb0e82afe6a4 2023-12-07T16:20:19.955 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (3m) 55s ago 3m 58.2M 4299M 17.2.7-115-g4f62d9ad fcdfd00f81c7 bbdd7f82a7c3 2023-12-07T16:20:19.955 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (3m) 55s ago 3m 59.9M 4299M 17.2.7-115-g4f62d9ad fcdfd00f81c7 4372601f899e 2023-12-07T16:20:19.955 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (2m) 55s ago 2m 56.2M 4299M 17.2.7-115-g4f62d9ad fcdfd00f81c7 b0d432bbca05 2023-12-07T16:20:19.955 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi152 running (2m) 58s ago 2m 57.1M 5323M 17.2.7-115-g4f62d9ad fcdfd00f81c7 94d14402b489 2023-12-07T16:20:19.955 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi152 running (2m) 58s ago 2m 53.2M 5323M 17.2.7-115-g4f62d9ad fcdfd00f81c7 d3b8b2f12489 2023-12-07T16:20:19.955 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi152 running (2m) 58s ago 2m 49.7M 5323M 17.2.7-115-g4f62d9ad fcdfd00f81c7 e7f8d9f716bb 2023-12-07T16:20:19.955 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (3m) 55s ago 4m 48.7M - 2.43.0 a07b618ecd1d 32eb5a56be5e 2023-12-07T16:20:19.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.958+0000 7fce350a5700 1 -- 172.21.15.63:0/1884211440 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fce18068f60 msgr2=0x7fce1806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:19.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.958+0000 7fce350a5700 1 --2- 172.21.15.63:0/1884211440 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fce18068f60 0x7fce1806b410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fce24000c00 tx=0x7fce24009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:19.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.958+0000 7fce350a5700 1 -- 172.21.15.63:0/1884211440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce300fcbf0 msgr2=0x7fce3010d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:19.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.958+0000 7fce350a5700 1 --2- 172.21.15.63:0/1884211440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce300fcbf0 0x7fce3010d4f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fce2000eb70 tx=0x7fce2000b040 comp rx=0 tx=0).stop 2023-12-07T16:20:19.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.958+0000 7fce350a5700 1 -- 172.21.15.63:0/1884211440 shutdown_connections 2023-12-07T16:20:19.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.958+0000 7fce350a5700 1 --2- 172.21.15.63:0/1884211440 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce300fcbf0 0x7fce3010d4f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:19.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.958+0000 7fce350a5700 1 --2- 172.21.15.63:0/1884211440 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fce18068f60 0x7fce1806b410 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:19.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.958+0000 7fce350a5700 1 --2- 172.21.15.63:0/1884211440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce300fde00 0x7fce3010da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:19.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.958+0000 7fce350a5700 1 -- 172.21.15.63:0/1884211440 >> 172.21.15.63:0/1884211440 conn(0x7fce300f82d0 msgr2=0x7fce30101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:19.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.958+0000 7fce350a5700 1 -- 172.21.15.63:0/1884211440 shutdown_connections 2023-12-07T16:20:19.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:19.958+0000 7fce350a5700 1 -- 172.21.15.63:0/1884211440 wait complete. 2023-12-07T16:20:20.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.072+0000 7f4c0cfa1700 1 -- 172.21.15.63:0/1981128248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c080ffe50 msgr2=0x7f4c08102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:20.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.072+0000 7f4c0cfa1700 1 --2- 172.21.15.63:0/1981128248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c080ffe50 0x7f4c08102230 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc004940 tx=0x7f4bfc009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:20.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.072+0000 7f4c0cfa1700 1 -- 172.21.15.63:0/1981128248 shutdown_connections 2023-12-07T16:20:20.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.072+0000 7f4c0cfa1700 1 --2- 172.21.15.63:0/1981128248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c080ffe50 0x7f4c08102230 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:20.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.072+0000 7f4c0cfa1700 1 --2- 172.21.15.63:0/1981128248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c080fd530 0x7f4c080ff910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:20.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.072+0000 7f4c0cfa1700 1 -- 172.21.15.63:0/1981128248 >> 172.21.15.63:0/1981128248 conn(0x7f4c080f6f70 msgr2=0x7f4c080f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:20.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.072+0000 7f4c0cfa1700 1 -- 172.21.15.63:0/1981128248 shutdown_connections 2023-12-07T16:20:20.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.072+0000 7f4c0cfa1700 1 -- 172.21.15.63:0/1981128248 wait complete. 2023-12-07T16:20:20.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.073+0000 7f4c0cfa1700 1 Processor -- start 2023-12-07T16:20:20.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.073+0000 7f4c0cfa1700 1 -- start start 2023-12-07T16:20:20.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.073+0000 7f4c0cfa1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c080fd530 0x7f4c0810d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:20.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.073+0000 7f4c0cfa1700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c080ffe50 0x7f4c0810d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:20.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.073+0000 7f4c0cfa1700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0810dd90 con 0x7f4c080ffe50 2023-12-07T16:20:20.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.073+0000 7f4c0cfa1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0810e630 con 0x7f4c080fd530 2023-12-07T16:20:20.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.074+0000 7f4c06ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c080ffe50 0x7f4c0810d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:20.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.074+0000 7f4c06ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c080ffe50 0x7f4c0810d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44098/0 (socket says 172.21.15.63:44098) 2023-12-07T16:20:20.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.074+0000 7f4c06ffd700 1 -- 172.21.15.63:0/3352752792 learned_addr learned my addr 172.21.15.63:0/3352752792 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:20:20.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.074+0000 7f4c077fe700 1 --2- 172.21.15.63:0/3352752792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c080fd530 0x7f4c0810d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:20.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.074+0000 7f4c06ffd700 1 -- 172.21.15.63:0/3352752792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c080fd530 msgr2=0x7f4c0810d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:20.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.074+0000 7f4c06ffd700 1 --2- 172.21.15.63:0/3352752792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c080fd530 0x7f4c0810d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:20.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.074+0000 7f4c06ffd700 1 -- 172.21.15.63:0/3352752792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bfc005040 con 0x7f4c080ffe50 2023-12-07T16:20:20.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.074+0000 7f4c06ffd700 1 --2- 172.21.15.63:0/3352752792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c080ffe50 0x7f4c0810d790 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc000c00 tx=0x7f4bfc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:20.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.074+0000 7f4beffff700 1 -- 172.21.15.63:0/3352752792 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bfc021070 con 0x7f4c080ffe50 2023-12-07T16:20:20.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.074+0000 7f4c0cfa1700 1 -- 172.21.15.63:0/3352752792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0810e8b0 con 0x7f4c080ffe50 2023-12-07T16:20:20.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.074+0000 7f4beffff700 1 -- 172.21.15.63:0/3352752792 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4bfc01c400 con 0x7f4c080ffe50 2023-12-07T16:20:20.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.074+0000 7f4beffff700 1 -- 172.21.15.63:0/3352752792 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bfc00e070 con 0x7f4c080ffe50 2023-12-07T16:20:20.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.074+0000 7f4c0cfa1700 1 -- 172.21.15.63:0/3352752792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0810ed90 con 0x7f4c080ffe50 2023-12-07T16:20:20.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.075+0000 7f4c0cfa1700 1 -- 172.21.15.63:0/3352752792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c081073c0 con 0x7f4c080ffe50 2023-12-07T16:20:20.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.076+0000 7f4beffff700 1 -- 172.21.15.63:0/3352752792 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f4bfc01c9c0 con 0x7f4c080ffe50 2023-12-07T16:20:20.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.077+0000 7f4beffff700 1 --2- 172.21.15.63:0/3352752792 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f4bf0068f60 0x7f4bf006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:20.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.077+0000 7f4beffff700 1 -- 172.21.15.63:0/3352752792 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4bfc0886a0 con 0x7f4c080ffe50 2023-12-07T16:20:20.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.077+0000 7f4c077fe700 1 --2- 172.21.15.63:0/3352752792 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f4bf0068f60 0x7f4bf006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:20.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.078+0000 7f4c077fe700 1 --2- 172.21.15.63:0/3352752792 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f4bf0068f60 0x7f4bf006b410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009b80 tx=0x7f4bf800b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:20.080 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.081+0000 7f4beffff700 1 -- 172.21.15.63:0/3352752792 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4bfc058650 con 0x7f4c080ffe50 2023-12-07T16:20:20.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.527+0000 7f4c0cfa1700 1 -- 172.21.15.63:0/3352752792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4c0804bb80 con 0x7f4c080ffe50 2023-12-07T16:20:20.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.528+0000 7f4beffff700 1 -- 172.21.15.63:0/3352752792 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f4bfc0581e0 con 0x7f4c080ffe50 2023-12-07T16:20:20.526 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:20:20.526 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-07T16:20:20.526 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 2 2023-12-07T16:20:20.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:20:20.526 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-07T16:20:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 2 2023-12-07T16:20:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:20:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-07T16:20:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 6 2023-12-07T16:20:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:20:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-07T16:20:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 4 2023-12-07T16:20:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:20:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-07T16:20:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 14 2023-12-07T16:20:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-07T16:20:20.527 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:20:20.528 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.530+0000 7f4c0cfa1700 1 -- 172.21.15.63:0/3352752792 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f4bf0068f60 msgr2=0x7f4bf006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:20.528 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.530+0000 7f4c0cfa1700 1 --2- 172.21.15.63:0/3352752792 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f4bf0068f60 0x7f4bf006b410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009b80 tx=0x7f4bf800b040 comp rx=0 tx=0).stop 2023-12-07T16:20:20.528 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.530+0000 7f4c0cfa1700 1 -- 172.21.15.63:0/3352752792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c080ffe50 msgr2=0x7f4c0810d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:20.528 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.530+0000 7f4c0cfa1700 1 --2- 172.21.15.63:0/3352752792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c080ffe50 0x7f4c0810d790 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc000c00 tx=0x7f4bfc009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:20.528 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.530+0000 7f4c0cfa1700 1 -- 172.21.15.63:0/3352752792 shutdown_connections 2023-12-07T16:20:20.528 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.530+0000 7f4c0cfa1700 1 --2- 172.21.15.63:0/3352752792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c080fd530 0x7f4c0810d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:20.528 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.530+0000 7f4c0cfa1700 1 --2- 172.21.15.63:0/3352752792 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7f4bf0068f60 0x7f4bf006b410 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:20.529 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.530+0000 7f4c0cfa1700 1 --2- 172.21.15.63:0/3352752792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c080ffe50 0x7f4c0810d790 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:20.529 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.530+0000 7f4c0cfa1700 1 -- 172.21.15.63:0/3352752792 >> 172.21.15.63:0/3352752792 conn(0x7f4c080f6f70 msgr2=0x7f4c080f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:20.529 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.530+0000 7f4c0cfa1700 1 -- 172.21.15.63:0/3352752792 shutdown_connections 2023-12-07T16:20:20.529 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.530+0000 7f4c0cfa1700 1 -- 172.21.15.63:0/3352752792 wait complete. 2023-12-07T16:20:20.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.655+0000 7fdf38a6d700 1 -- 172.21.15.63:0/2998292872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf340fcd00 msgr2=0x7fdf340fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:20.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.655+0000 7fdf38a6d700 1 --2- 172.21.15.63:0/2998292872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf340fcd00 0x7fdf340fd150 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdf28004940 tx=0x7fdf28009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:20.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.655+0000 7fdf38a6d700 1 -- 172.21.15.63:0/2998292872 shutdown_connections 2023-12-07T16:20:20.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.655+0000 7fdf38a6d700 1 --2- 172.21.15.63:0/2998292872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf340fcd00 0x7fdf340fd150 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:20.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.655+0000 7fdf38a6d700 1 --2- 172.21.15.63:0/2998292872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf340fbaf0 0x7fdf340fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:20.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.655+0000 7fdf38a6d700 1 -- 172.21.15.63:0/2998292872 >> 172.21.15.63:0/2998292872 conn(0x7fdf340f71d0 msgr2=0x7fdf340f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:20.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.655+0000 7fdf38a6d700 1 -- 172.21.15.63:0/2998292872 shutdown_connections 2023-12-07T16:20:20.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.655+0000 7fdf38a6d700 1 -- 172.21.15.63:0/2998292872 wait complete. 2023-12-07T16:20:20.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.655+0000 7fdf38a6d700 1 Processor -- start 2023-12-07T16:20:20.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.655+0000 7fdf38a6d700 1 -- start start 2023-12-07T16:20:20.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.656+0000 7fdf38a6d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf340fbaf0 0x7fdf3410d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:20.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.656+0000 7fdf38a6d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf340fcd00 0x7fdf3410da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:20.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.656+0000 7fdf38a6d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3410e010 con 0x7fdf340fcd00 2023-12-07T16:20:20.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.656+0000 7fdf38a6d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3410e8b0 con 0x7fdf340fbaf0 2023-12-07T16:20:20.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.656+0000 7fdf31d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf340fcd00 0x7fdf3410da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:20.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.656+0000 7fdf31d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf340fcd00 0x7fdf3410da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44114/0 (socket says 172.21.15.63:44114) 2023-12-07T16:20:20.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.656+0000 7fdf3259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf340fbaf0 0x7fdf3410d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:20.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.656+0000 7fdf31d9b700 1 -- 172.21.15.63:0/2825692384 learned_addr learned my addr 172.21.15.63:0/2825692384 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:20:20.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.656+0000 7fdf31d9b700 1 -- 172.21.15.63:0/2825692384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf340fbaf0 msgr2=0x7fdf3410d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:20.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.656+0000 7fdf31d9b700 1 --2- 172.21.15.63:0/2825692384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf340fbaf0 0x7fdf3410d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:20.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.656+0000 7fdf31d9b700 1 -- 172.21.15.63:0/2825692384 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf28005040 con 0x7fdf340fcd00 2023-12-07T16:20:20.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.656+0000 7fdf31d9b700 1 --2- 172.21.15.63:0/2825692384 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf340fcd00 0x7fdf3410da10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdf28000c00 tx=0x7fdf28009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:20.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.657+0000 7fdf22ffd700 1 -- 172.21.15.63:0/2825692384 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf28021070 con 0x7fdf340fcd00 2023-12-07T16:20:20.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.657+0000 7fdf22ffd700 1 -- 172.21.15.63:0/2825692384 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdf2801c400 con 0x7fdf340fcd00 2023-12-07T16:20:20.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.657+0000 7fdf38a6d700 1 -- 172.21.15.63:0/2825692384 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf3410eb30 con 0x7fdf340fcd00 2023-12-07T16:20:20.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.657+0000 7fdf38a6d700 1 -- 172.21.15.63:0/2825692384 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3410f010 con 0x7fdf340fcd00 2023-12-07T16:20:20.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.657+0000 7fdf22ffd700 1 -- 172.21.15.63:0/2825692384 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf2800e070 con 0x7fdf340fcd00 2023-12-07T16:20:20.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.658+0000 7fdf38a6d700 1 -- 172.21.15.63:0/2825692384 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf140052e0 con 0x7fdf340fcd00 2023-12-07T16:20:20.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.658+0000 7fdf22ffd700 1 -- 172.21.15.63:0/2825692384 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fdf28013a30 con 0x7fdf340fcd00 2023-12-07T16:20:20.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.659+0000 7fdf22ffd700 1 --2- 172.21.15.63:0/2825692384 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fdf1c068f60 0x7fdf1c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:20.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.659+0000 7fdf22ffd700 1 -- 172.21.15.63:0/2825692384 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fdf28087eb0 con 0x7fdf340fcd00 2023-12-07T16:20:20.660 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.662+0000 7fdf3259c700 1 --2- 172.21.15.63:0/2825692384 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fdf1c068f60 0x7fdf1c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:20.660 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.662+0000 7fdf3259c700 1 --2- 172.21.15.63:0/2825692384 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fdf1c068f60 0x7fdf1c06b410 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdf24009b80 tx=0x7fdf2400b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:20.662 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.664+0000 7fdf22ffd700 1 -- 172.21.15.63:0/2825692384 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdf28057e60 con 0x7fdf340fcd00 2023-12-07T16:20:20.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:20 smithi063 ceph-mon[112095]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:20:20.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:20 smithi063 ceph-mon[112095]: pgmap v165: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-07T16:20:20.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:20 smithi063 ceph-mon[112095]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:20:20.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.947+0000 7fdf38a6d700 1 -- 172.21.15.63:0/2825692384 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdf14005da0 con 0x7fdf340fcd00 2023-12-07T16:20:20.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.948+0000 7fdf22ffd700 1 -- 172.21.15.63:0/2825692384 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1819 (secure 0 0 0) 0x7fdf280579f0 con 0x7fdf340fcd00 2023-12-07T16:20:20.946 INFO:teuthology.orchestra.run.smithi063.stdout:e15 2023-12-07T16:20:20.946 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-07T16:20:20.946 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:20:20.946 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-07T16:20:20.946 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:20:20.947 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-07T16:20:20.947 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-07T16:20:20.947 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 15 2023-12-07T16:20:20.947 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-07T16:20:20.947 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-07T16:19:08.352640+0000 2023-12-07T16:20:20.947 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-07T16:19:22.407210+0000 2023-12-07T16:20:20.947 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-07T16:20:20.947 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-07T16:20:20.947 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-07T16:20:20.947 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-07T16:20:20.947 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-07T16:20:20.947 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-07T16:20:20.947 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-07T16:20:20.947 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 45 2023-12-07T16:20:20.947 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:20:20.947 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 2 2023-12-07T16:20:20.947 INFO:teuthology.orchestra.run.smithi063.stdout:in 0,1 2023-12-07T16:20:20.947 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14478,1=24269} 2023-12-07T16:20:20.948 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-07T16:20:20.948 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-07T16:20:20.948 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-07T16:20:20.948 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-07T16:20:20.948 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-07T16:20:20.948 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-07T16:20:20.948 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-07T16:20:20.948 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-07T16:20:20.948 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.yidolg{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:20:20.948 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.mrvngf{1:24269} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.152:6824/3157779064,v1:172.21.15.152:6825/3157779064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:20:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:20:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:20:20.948 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-07T16:20:20.948 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:20:20.948 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.gsjgcq{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/3063200414,v1:172.21.15.63:6827/3063200414] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:20:20.948 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.aovwwd{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/2906349729,v1:172.21.15.152:6827/2906349729] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:20:20.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.951+0000 7fdf38a6d700 1 -- 172.21.15.63:0/2825692384 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fdf1c068f60 msgr2=0x7fdf1c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:20.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.951+0000 7fdf38a6d700 1 --2- 172.21.15.63:0/2825692384 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fdf1c068f60 0x7fdf1c06b410 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdf24009b80 tx=0x7fdf2400b040 comp rx=0 tx=0).stop 2023-12-07T16:20:20.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.951+0000 7fdf38a6d700 1 -- 172.21.15.63:0/2825692384 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf340fcd00 msgr2=0x7fdf3410da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:20.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.951+0000 7fdf38a6d700 1 --2- 172.21.15.63:0/2825692384 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf340fcd00 0x7fdf3410da10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdf28000c00 tx=0x7fdf28009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:20.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.951+0000 7fdf38a6d700 1 -- 172.21.15.63:0/2825692384 shutdown_connections 2023-12-07T16:20:20.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.951+0000 7fdf38a6d700 1 --2- 172.21.15.63:0/2825692384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf340fbaf0 0x7fdf3410d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:20.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.951+0000 7fdf38a6d700 1 --2- 172.21.15.63:0/2825692384 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fdf1c068f60 0x7fdf1c06b410 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:20.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.951+0000 7fdf38a6d700 1 --2- 172.21.15.63:0/2825692384 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf340fcd00 0x7fdf3410da10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:20.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.951+0000 7fdf38a6d700 1 -- 172.21.15.63:0/2825692384 >> 172.21.15.63:0/2825692384 conn(0x7fdf340f71d0 msgr2=0x7fdf340fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:20.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.951+0000 7fdf38a6d700 1 -- 172.21.15.63:0/2825692384 shutdown_connections 2023-12-07T16:20:20.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:20.951+0000 7fdf38a6d700 1 -- 172.21.15.63:0/2825692384 wait complete. 2023-12-07T16:20:20.951 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 15 2023-12-07T16:20:20.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:20 smithi152 ceph-mon[121113]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:20:20.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:20 smithi152 ceph-mon[121113]: pgmap v165: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-07T16:20:20.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:20 smithi152 ceph-mon[121113]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:20:21.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.100+0000 7fe3d6533700 1 -- 172.21.15.63:0/1148886818 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d00fbaf0 msgr2=0x7fe3d00fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:21.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.100+0000 7fe3d6533700 1 --2- 172.21.15.63:0/1148886818 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d00fbaf0 0x7fe3d00fbf00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0004940 tx=0x7fe3c0009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:21.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.100+0000 7fe3d6533700 1 -- 172.21.15.63:0/1148886818 shutdown_connections 2023-12-07T16:20:21.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.100+0000 7fe3d6533700 1 --2- 172.21.15.63:0/1148886818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3d00fcd00 0x7fe3d00fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:21.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.100+0000 7fe3d6533700 1 --2- 172.21.15.63:0/1148886818 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d00fbaf0 0x7fe3d00fbf00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:21.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.100+0000 7fe3d6533700 1 -- 172.21.15.63:0/1148886818 >> 172.21.15.63:0/1148886818 conn(0x7fe3d00f7190 msgr2=0x7fe3d00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:21.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.100+0000 7fe3d6533700 1 -- 172.21.15.63:0/1148886818 shutdown_connections 2023-12-07T16:20:21.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.100+0000 7fe3d6533700 1 -- 172.21.15.63:0/1148886818 wait complete. 2023-12-07T16:20:21.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.101+0000 7fe3d6533700 1 Processor -- start 2023-12-07T16:20:21.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.101+0000 7fe3d6533700 1 -- start start 2023-12-07T16:20:21.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.101+0000 7fe3d6533700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3d00fbaf0 0x7fe3d010d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:21.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.101+0000 7fe3d6533700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d00fcd00 0x7fe3d010da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:21.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.101+0000 7fe3d6533700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d010e000 con 0x7fe3d00fcd00 2023-12-07T16:20:21.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.101+0000 7fe3d6533700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d010e8a0 con 0x7fe3d00fbaf0 2023-12-07T16:20:21.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.101+0000 7fe3cf7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d00fcd00 0x7fe3d010da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:21.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.101+0000 7fe3cf7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d00fcd00 0x7fe3d010da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44126/0 (socket says 172.21.15.63:44126) 2023-12-07T16:20:21.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.101+0000 7fe3cf7fe700 1 -- 172.21.15.63:0/1272062834 learned_addr learned my addr 172.21.15.63:0/1272062834 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:20:21.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.101+0000 7fe3cffff700 1 --2- 172.21.15.63:0/1272062834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3d00fbaf0 0x7fe3d010d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:21.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.102+0000 7fe3cf7fe700 1 -- 172.21.15.63:0/1272062834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3d00fbaf0 msgr2=0x7fe3d010d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:21.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.102+0000 7fe3cf7fe700 1 --2- 172.21.15.63:0/1272062834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3d00fbaf0 0x7fe3d010d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:21.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.102+0000 7fe3cf7fe700 1 -- 172.21.15.63:0/1272062834 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c0005040 con 0x7fe3d00fcd00 2023-12-07T16:20:21.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.102+0000 7fe3cf7fe700 1 --2- 172.21.15.63:0/1272062834 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d00fcd00 0x7fe3d010da00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe3c400eb40 tx=0x7fe3c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:21.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.102+0000 7fe3ccff9700 1 -- 172.21.15.63:0/1272062834 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3c4007cc0 con 0x7fe3d00fcd00 2023-12-07T16:20:21.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.102+0000 7fe3ccff9700 1 -- 172.21.15.63:0/1272062834 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe3c400f040 con 0x7fe3d00fcd00 2023-12-07T16:20:21.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.102+0000 7fe3ccff9700 1 -- 172.21.15.63:0/1272062834 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3c4009570 con 0x7fe3d00fcd00 2023-12-07T16:20:21.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.102+0000 7fe3d6533700 1 -- 172.21.15.63:0/1272062834 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d010eb20 con 0x7fe3d00fcd00 2023-12-07T16:20:21.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.102+0000 7fe3d6533700 1 -- 172.21.15.63:0/1272062834 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d010f060 con 0x7fe3d00fcd00 2023-12-07T16:20:21.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.103+0000 7fe3d6533700 1 -- 172.21.15.63:0/1272062834 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d01074e0 con 0x7fe3d00fcd00 2023-12-07T16:20:21.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.105+0000 7fe3ccff9700 1 -- 172.21.15.63:0/1272062834 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe3c40096d0 con 0x7fe3d00fcd00 2023-12-07T16:20:21.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.106+0000 7fe3ccff9700 1 --2- 172.21.15.63:0/1272062834 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe3b8068f60 0x7fe3b806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:21.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.106+0000 7fe3ccff9700 1 -- 172.21.15.63:0/1272062834 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe3c4086c30 con 0x7fe3d00fcd00 2023-12-07T16:20:21.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.106+0000 7fe3cffff700 1 --2- 172.21.15.63:0/1272062834 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe3b8068f60 0x7fe3b806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:21.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.107+0000 7fe3cffff700 1 --2- 172.21.15.63:0/1272062834 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe3b8068f60 0x7fe3b806b410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0000c00 tx=0x7fe3c0009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:21.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.109+0000 7fe3ccff9700 1 -- 172.21.15.63:0/1272062834 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe3c4056b60 con 0x7fe3d00fcd00 2023-12-07T16:20:21.441 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.443+0000 7fe3d6533700 1 -- 172.21.15.63:0/1272062834 --> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3d010f3b0 con 0x7fe3b8068f60 2023-12-07T16:20:21.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.445+0000 7fe3ccff9700 1 -- 172.21.15.63:0/1272062834 <== mgr.14212 v2:172.21.15.63:6800/184283085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fe3d010f3b0 con 0x7fe3b8068f60 2023-12-07T16:20:21.443 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:20:21.443 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-07T16:20:21.443 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-07T16:20:21.443 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-07T16:20:21.443 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [], 2023-12-07T16:20:21.443 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "0/21 daemons upgraded", 2023-12-07T16:20:21.443 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a image on host smithi152", 2023-12-07T16:20:21.444 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-07T16:20:21.444 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:20:21.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.447+0000 7fe3d6533700 1 -- 172.21.15.63:0/1272062834 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe3b8068f60 msgr2=0x7fe3b806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:21.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.447+0000 7fe3d6533700 1 --2- 172.21.15.63:0/1272062834 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe3b8068f60 0x7fe3b806b410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0000c00 tx=0x7fe3c0009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:21.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.447+0000 7fe3d6533700 1 -- 172.21.15.63:0/1272062834 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d00fcd00 msgr2=0x7fe3d010da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:21.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.447+0000 7fe3d6533700 1 --2- 172.21.15.63:0/1272062834 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d00fcd00 0x7fe3d010da00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe3c400eb40 tx=0x7fe3c400b040 comp rx=0 tx=0).stop 2023-12-07T16:20:21.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.447+0000 7fe3d6533700 1 -- 172.21.15.63:0/1272062834 shutdown_connections 2023-12-07T16:20:21.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.447+0000 7fe3d6533700 1 --2- 172.21.15.63:0/1272062834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3d00fbaf0 0x7fe3d010d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:21.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.447+0000 7fe3d6533700 1 --2- 172.21.15.63:0/1272062834 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fe3b8068f60 0x7fe3b806b410 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:21.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.447+0000 7fe3d6533700 1 --2- 172.21.15.63:0/1272062834 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3d00fcd00 0x7fe3d010da00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:21.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.447+0000 7fe3d6533700 1 -- 172.21.15.63:0/1272062834 >> 172.21.15.63:0/1272062834 conn(0x7fe3d00f7190 msgr2=0x7fe3d00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:21.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.447+0000 7fe3d6533700 1 -- 172.21.15.63:0/1272062834 shutdown_connections 2023-12-07T16:20:21.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.447+0000 7fe3d6533700 1 -- 172.21.15.63:0/1272062834 wait complete. 2023-12-07T16:20:21.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.568+0000 7fbb11e90700 1 -- 172.21.15.63:0/513090168 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb0c0fde00 msgr2=0x7fbb0c0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:21.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.568+0000 7fbb11e90700 1 --2- 172.21.15.63:0/513090168 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb0c0fde00 0x7fbb0c0fe250 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbb00004940 tx=0x7fbb00009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:21.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.568+0000 7fbb11e90700 1 -- 172.21.15.63:0/513090168 shutdown_connections 2023-12-07T16:20:21.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.568+0000 7fbb11e90700 1 --2- 172.21.15.63:0/513090168 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb0c0fde00 0x7fbb0c0fe250 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:21.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.568+0000 7fbb11e90700 1 --2- 172.21.15.63:0/513090168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb0c0fcbf0 0x7fbb0c0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:21.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.568+0000 7fbb11e90700 1 -- 172.21.15.63:0/513090168 >> 172.21.15.63:0/513090168 conn(0x7fbb0c0f82d0 msgr2=0x7fbb0c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:21.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.568+0000 7fbb11e90700 1 -- 172.21.15.63:0/513090168 shutdown_connections 2023-12-07T16:20:21.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.568+0000 7fbb11e90700 1 -- 172.21.15.63:0/513090168 wait complete. 2023-12-07T16:20:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.569+0000 7fbb11e90700 1 Processor -- start 2023-12-07T16:20:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.569+0000 7fbb11e90700 1 -- start start 2023-12-07T16:20:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.569+0000 7fbb11e90700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb0c0fcbf0 0x7fbb0c10d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.569+0000 7fbb11e90700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb0c0fde00 0x7fbb0c10da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.569+0000 7fbb11e90700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c10e030 con 0x7fbb0c0fde00 2023-12-07T16:20:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.569+0000 7fbb11e90700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c10e8d0 con 0x7fbb0c0fcbf0 2023-12-07T16:20:21.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.569+0000 7fbb0affd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb0c0fde00 0x7fbb0c10da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.569+0000 7fbb0affd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb0c0fde00 0x7fbb0c10da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44152/0 (socket says 172.21.15.63:44152) 2023-12-07T16:20:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.569+0000 7fbb0affd700 1 -- 172.21.15.63:0/275456051 learned_addr learned my addr 172.21.15.63:0/275456051 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:20:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.569+0000 7fbb0b7fe700 1 --2- 172.21.15.63:0/275456051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb0c0fcbf0 0x7fbb0c10d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.570+0000 7fbb0affd700 1 -- 172.21.15.63:0/275456051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb0c0fcbf0 msgr2=0x7fbb0c10d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.570+0000 7fbb0affd700 1 --2- 172.21.15.63:0/275456051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb0c0fcbf0 0x7fbb0c10d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.570+0000 7fbb0affd700 1 -- 172.21.15.63:0/275456051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb00005040 con 0x7fbb0c0fde00 2023-12-07T16:20:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.570+0000 7fbb0affd700 1 --2- 172.21.15.63:0/275456051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb0c0fde00 0x7fbb0c10da30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbb00000c00 tx=0x7fbb00009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.570+0000 7fbaf3fff700 1 -- 172.21.15.63:0/275456051 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb00021070 con 0x7fbb0c0fde00 2023-12-07T16:20:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.570+0000 7fbaf3fff700 1 -- 172.21.15.63:0/275456051 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbb0001c400 con 0x7fbb0c0fde00 2023-12-07T16:20:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.570+0000 7fbb11e90700 1 -- 172.21.15.63:0/275456051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb0c10eb50 con 0x7fbb0c0fde00 2023-12-07T16:20:21.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.570+0000 7fbaf3fff700 1 -- 172.21.15.63:0/275456051 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb0000e070 con 0x7fbb0c0fde00 2023-12-07T16:20:21.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.570+0000 7fbb11e90700 1 -- 172.21.15.63:0/275456051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0c10f030 con 0x7fbb0c0fde00 2023-12-07T16:20:21.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.571+0000 7fbb11e90700 1 -- 172.21.15.63:0/275456051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb0c04bb80 con 0x7fbb0c0fde00 2023-12-07T16:20:21.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.572+0000 7fbaf3fff700 1 -- 172.21.15.63:0/275456051 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fbb0001c9c0 con 0x7fbb0c0fde00 2023-12-07T16:20:21.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.572+0000 7fbaf3fff700 1 --2- 172.21.15.63:0/275456051 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fbaf4068f60 0x7fbaf406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:21.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.572+0000 7fbaf3fff700 1 -- 172.21.15.63:0/275456051 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fbb00088040 con 0x7fbb0c0fde00 2023-12-07T16:20:21.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.573+0000 7fbb0b7fe700 1 --2- 172.21.15.63:0/275456051 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fbaf4068f60 0x7fbaf406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:21.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.573+0000 7fbb0b7fe700 1 --2- 172.21.15.63:0/275456051 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fbaf4068f60 0x7fbaf406b410 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbafc009b80 tx=0x7fbafc00b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:21.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:21.580+0000 7fbaf3fff700 1 -- 172.21.15.63:0/275456051 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fbb00057f50 con 0x7fbb0c0fde00 2023-12-07T16:20:21.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:21 smithi063 ceph-mon[112095]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:20:21.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:21 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/3352752792' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:20:21.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:21 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2825692384' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:20:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:21 smithi152 ceph-mon[121113]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:20:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:21 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/3352752792' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:20:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:21 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/2825692384' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:20:22.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:22.013+0000 7fbb11e90700 1 -- 172.21.15.63:0/275456051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbb0c105590 con 0x7fbb0c0fde00 2023-12-07T16:20:22.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:22.014+0000 7fbaf3fff700 1 -- 172.21.15.63:0/275456051 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fbb00057ae0 con 0x7fbb0c0fde00 2023-12-07T16:20:22.012 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-07T16:20:22.012 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-07T16:20:22.012 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-07T16:20:22.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:22.017+0000 7fbb11e90700 1 -- 172.21.15.63:0/275456051 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fbaf4068f60 msgr2=0x7fbaf406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:22.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:22.017+0000 7fbb11e90700 1 --2- 172.21.15.63:0/275456051 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fbaf4068f60 0x7fbaf406b410 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbafc009b80 tx=0x7fbafc00b040 comp rx=0 tx=0).stop 2023-12-07T16:20:22.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:22.017+0000 7fbb11e90700 1 -- 172.21.15.63:0/275456051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb0c0fde00 msgr2=0x7fbb0c10da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:22.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:22.017+0000 7fbb11e90700 1 --2- 172.21.15.63:0/275456051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb0c0fde00 0x7fbb0c10da30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbb00000c00 tx=0x7fbb00009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:22.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:22.017+0000 7fbb11e90700 1 -- 172.21.15.63:0/275456051 shutdown_connections 2023-12-07T16:20:22.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:22.017+0000 7fbb11e90700 1 --2- 172.21.15.63:0/275456051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb0c0fcbf0 0x7fbb0c10d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:22.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:22.017+0000 7fbb11e90700 1 --2- 172.21.15.63:0/275456051 >> [v2:172.21.15.63:6800/184283085,v1:172.21.15.63:6801/184283085] conn(0x7fbaf4068f60 0x7fbaf406b410 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:22.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:22.017+0000 7fbb11e90700 1 --2- 172.21.15.63:0/275456051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb0c0fde00 0x7fbb0c10da30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:22.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:22.017+0000 7fbb11e90700 1 -- 172.21.15.63:0/275456051 >> 172.21.15.63:0/275456051 conn(0x7fbb0c0f82d0 msgr2=0x7fbb0c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:22.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:22.017+0000 7fbb11e90700 1 -- 172.21.15.63:0/275456051 shutdown_connections 2023-12-07T16:20:22.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:22.017+0000 7fbb11e90700 1 -- 172.21.15.63:0/275456051 wait complete. 2023-12-07T16:20:22.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:22 smithi063 ceph-mon[112095]: pgmap v166: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-07T16:20:22.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:22 smithi063 ceph-mon[112095]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:20:22.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:22 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/275456051' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:20:22.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:22 smithi152 ceph-mon[121113]: pgmap v166: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-07T16:20:22.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:22 smithi152 ceph-mon[121113]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:20:22.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:22 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/275456051' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:20:24.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:24 smithi063 ceph-mon[112095]: pgmap v167: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-07T16:20:24.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:24 smithi152 ceph-mon[121113]: pgmap v167: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-07T16:20:25.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:25 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:20:25.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:25 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:20:26.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:26 smithi063 ceph-mon[112095]: pgmap v168: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-07T16:20:26.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:26 smithi152 ceph-mon[121113]: pgmap v168: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-07T16:20:28.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:28 smithi063 ceph-mon[112095]: pgmap v169: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-07T16:20:28.998 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:28 smithi152 ceph-mon[121113]: pgmap v169: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-07T16:20:30.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:30 smithi063 ceph-mon[112095]: pgmap v170: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-07T16:20:30.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:30 smithi152 ceph-mon[121113]: pgmap v170: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-07T16:20:32.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:32 smithi063 ceph-mon[112095]: pgmap v171: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-07T16:20:32.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:32 smithi152 ceph-mon[121113]: pgmap v171: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-07T16:20:34.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:34 smithi063 ceph-mon[112095]: pgmap v172: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:34.996 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:34 smithi152 ceph-mon[121113]: pgmap v172: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:36.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:36 smithi063 ceph-mon[112095]: pgmap v173: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:36.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:36 smithi152 ceph-mon[121113]: pgmap v173: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:38.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:38 smithi063 ceph-mon[112095]: pgmap v174: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:38.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:38 smithi152 ceph-mon[121113]: pgmap v174: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:40.551 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:40 smithi063 ceph-mon[112095]: pgmap v175: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:40.552 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:40 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:20:40.552 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:40 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.sxayfb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-07T16:20:40.552 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:40 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-07T16:20:40.552 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:40 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:20:40.552 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:40 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:20:40.844 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:40 smithi152 ceph-mon[121113]: pgmap v175: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:40.844 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:40 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:20:40.844 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:40 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.sxayfb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-07T16:20:40.844 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:40 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-07T16:20:40.844 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:40 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:20:40.844 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:40 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:20:41.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:41 smithi063 ceph-mon[112095]: Upgrade: Updating mgr.smithi152.sxayfb 2023-12-07T16:20:41.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:41 smithi063 ceph-mon[112095]: Deploying daemon mgr.smithi152.sxayfb on smithi152 2023-12-07T16:20:41.951 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:41 smithi152 ceph-mon[121113]: Upgrade: Updating mgr.smithi152.sxayfb 2023-12-07T16:20:41.952 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:41 smithi152 ceph-mon[121113]: Deploying daemon mgr.smithi152.sxayfb on smithi152 2023-12-07T16:20:42.792 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:42 smithi152 ceph-mon[121113]: pgmap v176: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:42.792 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:42 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:20:42.792 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:42 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:20:42.792 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:42 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:20:42.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:42 smithi063 ceph-mon[112095]: pgmap v176: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:42.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:42 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:20:42.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:42 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:20:42.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:42 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:20:44.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:44 smithi063 ceph-mon[112095]: pgmap v177: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:44.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:44 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:20:44.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:44 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:20:44.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:44 smithi152 ceph-mon[121113]: pgmap v177: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:44.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:44 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:20:44.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:44 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:20:46.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:46 smithi152 ceph-mon[121113]: pgmap v178: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:46.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:46 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:20:46.744 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:46 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:20:46.839 INFO:tasks.workunit.client.0.smithi063.stderr:Updating files: 96% (11745/12123) Updating files: 97% (11760/12123) Updating files: 98% (11881/12123) Updating files: 99% (12002/12123) Updating files: 100% (12123/12123) Updating files: 100% (12123/12123), done. 2023-12-07T16:20:46.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:46 smithi063 ceph-mon[112095]: pgmap v178: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:46.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:46 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:20:46.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:46 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:20:47.453 INFO:tasks.workunit.client.0.smithi063.stderr:Note: switching to 'e6605fb8725c25c4838cef6a39f30df73f1ed149'. 2023-12-07T16:20:47.454 INFO:tasks.workunit.client.0.smithi063.stderr: 2023-12-07T16:20:47.454 INFO:tasks.workunit.client.0.smithi063.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-07T16:20:47.454 INFO:tasks.workunit.client.0.smithi063.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-07T16:20:47.454 INFO:tasks.workunit.client.0.smithi063.stderr:state without impacting any branches by switching back to a branch. 2023-12-07T16:20:47.454 INFO:tasks.workunit.client.0.smithi063.stderr: 2023-12-07T16:20:47.454 INFO:tasks.workunit.client.0.smithi063.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-07T16:20:47.454 INFO:tasks.workunit.client.0.smithi063.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-07T16:20:47.454 INFO:tasks.workunit.client.0.smithi063.stderr: 2023-12-07T16:20:47.454 INFO:tasks.workunit.client.0.smithi063.stderr: git switch -c 2023-12-07T16:20:47.455 INFO:tasks.workunit.client.0.smithi063.stderr: 2023-12-07T16:20:47.455 INFO:tasks.workunit.client.0.smithi063.stderr:Or undo this operation with: 2023-12-07T16:20:47.455 INFO:tasks.workunit.client.0.smithi063.stderr: 2023-12-07T16:20:47.455 INFO:tasks.workunit.client.0.smithi063.stderr: git switch - 2023-12-07T16:20:47.455 INFO:tasks.workunit.client.0.smithi063.stderr: 2023-12-07T16:20:47.455 INFO:tasks.workunit.client.0.smithi063.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-07T16:20:47.455 INFO:tasks.workunit.client.0.smithi063.stderr: 2023-12-07T16:20:47.455 INFO:tasks.workunit.client.0.smithi063.stderr:HEAD is now at e6605fb8725 Merge branch 'main' of https://github.com/dillona/ceph into wip-guits-testing-2023-12-05-0857 2023-12-07T16:20:47.457 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-07T16:20:47.492 INFO:tasks.workunit.client.0.smithi063.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-07T16:20:47.495 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-07T16:20:47.495 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-07T16:20:48.089 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-07T16:20:48.155 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-07T16:20:48.194 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-07T16:20:48.196 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-07T16:20:48.196 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-07T16:20:48.233 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-07T16:20:48.237 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-07T16:20:48.237 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-07T16:20:48.296 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2023-12-07T16:20:48.297 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-07T16:20:48.297 DEBUG:teuthology.orchestra.run.smithi063:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e6605fb8725c25c4838cef6a39f30df73f1ed149 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2023-12-07T16:20:48.362 INFO:tasks.workunit.client.0.smithi063.stderr:+ mkdir -p fsstress 2023-12-07T16:20:48.364 INFO:tasks.workunit.client.0.smithi063.stderr:+ pushd fsstress 2023-12-07T16:20:48.364 INFO:tasks.workunit.client.0.smithi063.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-07T16:20:48.365 INFO:tasks.workunit.client.0.smithi063.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-07T16:20:48.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:48 smithi152 ceph-mon[121113]: pgmap v179: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:48.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:48 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:20:48.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:48 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:20:48.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:48 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:20:48.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:48 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:20:48.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:48 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:20:48.843 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:48 smithi063 ceph-mon[112095]: pgmap v179: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:48.843 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:48 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:20:48.843 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:48 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:20:48.843 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:48 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:20:48.843 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:48 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:20:48.843 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:48 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' 2023-12-07T16:20:49.018 INFO:tasks.workunit.client.0.smithi063.stderr:+ tar xzf ltp-full.tgz 2023-12-07T16:20:49.472 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:49 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:20:49.472 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:49 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr fail", "who": "smithi063.yohyyx"}]: dispatch 2023-12-07T16:20:49.472 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:49 smithi063 ceph-mon[112095]: osdmap e46: 6 total, 6 up, 6 in 2023-12-07T16:20:49.472 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:49 smithi063 ceph-mon[112095]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "mgr fail", "who": "smithi063.yohyyx"}]': finished 2023-12-07T16:20:49.472 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:49 smithi063 ceph-mon[112095]: mgrmap e20: smithi152.sxayfb(active, starting, since 0.00701125s) 2023-12-07T16:20:49.643 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:49 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:20:49.644 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:49 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr fail", "who": "smithi063.yohyyx"}]: dispatch 2023-12-07T16:20:49.644 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:49 smithi152 ceph-mon[121113]: osdmap e46: 6 total, 6 up, 6 in 2023-12-07T16:20:49.644 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:49 smithi152 ceph-mon[121113]: from='mgr.14212 172.21.15.63:0/2001745281' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "mgr fail", "who": "smithi063.yohyyx"}]': finished 2023-12-07T16:20:49.644 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:49 smithi152 ceph-mon[121113]: mgrmap e20: smithi152.sxayfb(active, starting, since 0.00701125s) 2023-12-07T16:20:51.132 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: Active manager daemon smithi152.sxayfb restarted 2023-12-07T16:20:51.132 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: Activating manager daemon smithi152.sxayfb 2023-12-07T16:20:51.132 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: osdmap e47: 6 total, 6 up, 6 in 2023-12-07T16:20:51.132 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: mgrmap e21: smithi152.sxayfb(active, starting, since 0.00602718s) 2023-12-07T16:20:51.132 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: from='mgr.? 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.sxayfb/crt"}]: dispatch 2023-12-07T16:20:51.132 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.sxayfb/crt"}]: dispatch 2023-12-07T16:20:51.133 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-07T16:20:51.133 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:20:51.133 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.yidolg"}]: dispatch 2023-12-07T16:20:51.133 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.gsjgcq"}]: dispatch 2023-12-07T16:20:51.133 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.mrvngf"}]: dispatch 2023-12-07T16:20:51.133 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.aovwwd"}]: dispatch 2023-12-07T16:20:51.133 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mgr metadata", "who": "smithi152.sxayfb", "id": "smithi152.sxayfb"}]: dispatch 2023-12-07T16:20:51.133 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-07T16:20:51.133 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-07T16:20:51.133 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T16:20:51.133 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T16:20:51.134 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-07T16:20:51.134 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-07T16:20:51.134 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-07T16:20:51.134 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-07T16:20:51.134 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-07T16:20:51.134 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-07T16:20:51.134 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.sxayfb/key"}]: dispatch 2023-12-07T16:20:51.134 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:50 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-07T16:20:51.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: Active manager daemon smithi152.sxayfb restarted 2023-12-07T16:20:51.295 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: Activating manager daemon smithi152.sxayfb 2023-12-07T16:20:51.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: osdmap e47: 6 total, 6 up, 6 in 2023-12-07T16:20:51.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: mgrmap e21: smithi152.sxayfb(active, starting, since 0.00602718s) 2023-12-07T16:20:51.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: from='mgr.? 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.sxayfb/crt"}]: dispatch 2023-12-07T16:20:51.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.sxayfb/crt"}]: dispatch 2023-12-07T16:20:51.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-07T16:20:51.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:20:51.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.yidolg"}]: dispatch 2023-12-07T16:20:51.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.gsjgcq"}]: dispatch 2023-12-07T16:20:51.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.mrvngf"}]: dispatch 2023-12-07T16:20:51.296 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.aovwwd"}]: dispatch 2023-12-07T16:20:51.297 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mgr metadata", "who": "smithi152.sxayfb", "id": "smithi152.sxayfb"}]: dispatch 2023-12-07T16:20:51.297 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-07T16:20:51.297 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-07T16:20:51.297 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T16:20:51.297 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T16:20:51.297 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-07T16:20:51.297 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-07T16:20:51.297 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-07T16:20:51.297 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-07T16:20:51.297 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-07T16:20:51.298 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-07T16:20:51.298 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.sxayfb/key"}]: dispatch 2023-12-07T16:20:51.298 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:50 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-07T16:20:52.128 INFO:tasks.workunit.client.1.smithi152.stderr:Updating files: 91% (11069/12123) Updating files: 92% (11154/12123) Updating files: 93% (11275/12123) Updating files: 94% (11396/12123) Updating files: 95% (11517/12123) Updating files: 96% (11639/12123) Updating files: 97% (11760/12123) Updating files: 98% (11881/12123) Updating files: 99% (12002/12123) Updating files: 100% (12123/12123) Updating files: 100% (12123/12123), done. 2023-12-07T16:20:52.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.142+0000 7f3c08352700 1 -- 172.21.15.63:0/3191051713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c000fbaf0 msgr2=0x7f3c000fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:52.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.142+0000 7f3c08352700 1 --2- 172.21.15.63:0/3191051713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c000fbaf0 0x7f3c000fbf00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc004940 tx=0x7f3bfc009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:52.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.142+0000 7f3c08352700 1 -- 172.21.15.63:0/3191051713 shutdown_connections 2023-12-07T16:20:52.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.142+0000 7f3c08352700 1 --2- 172.21.15.63:0/3191051713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c000fcd00 0x7f3c000fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:52.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.142+0000 7f3c08352700 1 --2- 172.21.15.63:0/3191051713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c000fbaf0 0x7f3c000fbf00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:52.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.142+0000 7f3c08352700 1 -- 172.21.15.63:0/3191051713 >> 172.21.15.63:0/3191051713 conn(0x7f3c000f7190 msgr2=0x7f3c000f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:52.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.142+0000 7f3c08352700 1 -- 172.21.15.63:0/3191051713 shutdown_connections 2023-12-07T16:20:52.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.142+0000 7f3c08352700 1 -- 172.21.15.63:0/3191051713 wait complete. 2023-12-07T16:20:52.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.143+0000 7f3c08352700 1 Processor -- start 2023-12-07T16:20:52.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.143+0000 7f3c08352700 1 -- start start 2023-12-07T16:20:52.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.143+0000 7f3c08352700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c000fbaf0 0x7f3c001101f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:52.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.143+0000 7f3c08352700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c000fcd00 0x7f3c00112740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:52.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.143+0000 7f3c08352700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c00066130 con 0x7f3c000fcd00 2023-12-07T16:20:52.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.143+0000 7f3c08352700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c00066270 con 0x7f3c000fbaf0 2023-12-07T16:20:52.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.143+0000 7f3c058ed700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c000fcd00 0x7f3c00112740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:52.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.143+0000 7f3c058ed700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c000fcd00 0x7f3c00112740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58940/0 (socket says 172.21.15.63:58940) 2023-12-07T16:20:52.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.143+0000 7f3c058ed700 1 -- 172.21.15.63:0/3962127995 learned_addr learned my addr 172.21.15.63:0/3962127995 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:20:52.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.143+0000 7f3c060ee700 1 --2- 172.21.15.63:0/3962127995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c000fbaf0 0x7f3c001101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:52.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.143+0000 7f3c058ed700 1 -- 172.21.15.63:0/3962127995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c000fbaf0 msgr2=0x7f3c001101f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:52.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.143+0000 7f3c058ed700 1 --2- 172.21.15.63:0/3962127995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c000fbaf0 0x7f3c001101f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:52.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.143+0000 7f3c058ed700 1 -- 172.21.15.63:0/3962127995 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc005040 con 0x7f3c000fcd00 2023-12-07T16:20:52.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.144+0000 7f3c058ed700 1 --2- 172.21.15.63:0/3962127995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c000fcd00 0x7f3c00112740 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000eb40 tx=0x7f3bf000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:52.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.144+0000 7f3bf6ffd700 1 -- 172.21.15.63:0/3962127995 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bf0007cc0 con 0x7f3c000fcd00 2023-12-07T16:20:52.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.144+0000 7f3bf6ffd700 1 -- 172.21.15.63:0/3962127995 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3bf000f040 con 0x7f3c000fcd00 2023-12-07T16:20:52.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.144+0000 7f3c08352700 1 -- 172.21.15.63:0/3962127995 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c00112d40 con 0x7f3c000fcd00 2023-12-07T16:20:52.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.144+0000 7f3bf6ffd700 1 -- 172.21.15.63:0/3962127995 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bf000c980 con 0x7f3c000fcd00 2023-12-07T16:20:52.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.144+0000 7f3c08352700 1 -- 172.21.15.63:0/3962127995 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c00113230 con 0x7f3c000fcd00 2023-12-07T16:20:52.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.145+0000 7f3c08352700 1 -- 172.21.15.63:0/3962127995 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0004bb80 con 0x7f3c000fcd00 2023-12-07T16:20:52.145 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.145+0000 7f3bf6ffd700 1 -- 172.21.15.63:0/3962127995 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) v1 ==== 45377+0+0 (secure 0 0 0) 0x7f3bf000cbf0 con 0x7f3c000fcd00 2023-12-07T16:20:52.145 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.145+0000 7f3bf6ffd700 1 --2- 172.21.15.63:0/3962127995 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f3bec038350 0x7f3bec03a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:52.145 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.146+0000 7f3bf6ffd700 1 -- 172.21.15.63:0/3962127995 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f3bf004b770 con 0x7f3c000fcd00 2023-12-07T16:20:52.145 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.146+0000 7f3c060ee700 1 --2- 172.21.15.63:0/3962127995 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f3bec038350 0x7f3bec03a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:52.145 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.146+0000 7f3c060ee700 1 --2- 172.21.15.63:0/3962127995 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f3bec038350 0x7f3bec03a800 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc009fd0 tx=0x7f3bfc009e30 comp rx=0 tx=0).ready entity=mgr.14614 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:52.152 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.153+0000 7f3bf6ffd700 1 -- 172.21.15.63:0/3962127995 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f3bf0012d10 con 0x7f3c000fcd00 2023-12-07T16:20:52.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:51 smithi152 ceph-mon[121113]: Manager daemon smithi152.sxayfb is now available 2023-12-07T16:20:52.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:51 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:20:52.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:51 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:20:52.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:51 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:20:52.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:51 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:20:52.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:51 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.sxayfb/mirror_snapshot_schedule"}]: dispatch 2023-12-07T16:20:52.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:51 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.sxayfb/mirror_snapshot_schedule"}]: dispatch 2023-12-07T16:20:52.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:51 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.sxayfb/trash_purge_schedule"}]: dispatch 2023-12-07T16:20:52.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:51 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.sxayfb/trash_purge_schedule"}]: dispatch 2023-12-07T16:20:52.261 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:51 smithi063 ceph-mon[112095]: Manager daemon smithi152.sxayfb is now available 2023-12-07T16:20:52.261 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:51 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:20:52.261 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:51 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:20:52.261 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:51 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:20:52.261 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:51 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:20:52.261 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:51 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.sxayfb/mirror_snapshot_schedule"}]: dispatch 2023-12-07T16:20:52.261 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:51 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.sxayfb/mirror_snapshot_schedule"}]: dispatch 2023-12-07T16:20:52.261 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:51 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.sxayfb/trash_purge_schedule"}]: dispatch 2023-12-07T16:20:52.262 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:51 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.sxayfb/trash_purge_schedule"}]: dispatch 2023-12-07T16:20:52.302 INFO:tasks.workunit.client.1.smithi152.stderr:Note: switching to 'e6605fb8725c25c4838cef6a39f30df73f1ed149'. 2023-12-07T16:20:52.303 INFO:tasks.workunit.client.1.smithi152.stderr: 2023-12-07T16:20:52.303 INFO:tasks.workunit.client.1.smithi152.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-07T16:20:52.303 INFO:tasks.workunit.client.1.smithi152.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-07T16:20:52.303 INFO:tasks.workunit.client.1.smithi152.stderr:state without impacting any branches by switching back to a branch. 2023-12-07T16:20:52.303 INFO:tasks.workunit.client.1.smithi152.stderr: 2023-12-07T16:20:52.303 INFO:tasks.workunit.client.1.smithi152.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-07T16:20:52.303 INFO:tasks.workunit.client.1.smithi152.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-07T16:20:52.303 INFO:tasks.workunit.client.1.smithi152.stderr: 2023-12-07T16:20:52.303 INFO:tasks.workunit.client.1.smithi152.stderr: git switch -c 2023-12-07T16:20:52.303 INFO:tasks.workunit.client.1.smithi152.stderr: 2023-12-07T16:20:52.303 INFO:tasks.workunit.client.1.smithi152.stderr:Or undo this operation with: 2023-12-07T16:20:52.303 INFO:tasks.workunit.client.1.smithi152.stderr: 2023-12-07T16:20:52.303 INFO:tasks.workunit.client.1.smithi152.stderr: git switch - 2023-12-07T16:20:52.303 INFO:tasks.workunit.client.1.smithi152.stderr: 2023-12-07T16:20:52.303 INFO:tasks.workunit.client.1.smithi152.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-07T16:20:52.303 INFO:tasks.workunit.client.1.smithi152.stderr: 2023-12-07T16:20:52.304 INFO:tasks.workunit.client.1.smithi152.stderr:HEAD is now at e6605fb8725 Merge branch 'main' of https://github.com/dillona/ceph into wip-guits-testing-2023-12-05-0857 2023-12-07T16:20:52.305 DEBUG:teuthology.orchestra.run.smithi152:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2023-12-07T16:20:52.372 INFO:tasks.workunit.client.1.smithi152.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-07T16:20:52.374 INFO:tasks.workunit.client.1.smithi152.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-07T16:20:52.375 INFO:tasks.workunit.client.1.smithi152.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-07T16:20:52.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.435+0000 7f3c08352700 1 -- 172.21.15.63:0/3962127995 --> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c00101650 con 0x7f3bec038350 2023-12-07T16:20:52.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.444+0000 7f3bf6ffd700 1 -- 172.21.15.63:0/3962127995 <== mgr.14614 v2:172.21.15.152:6828/1927275654 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f3c00101650 con 0x7f3bec038350 2023-12-07T16:20:52.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.446+0000 7f3c08352700 1 -- 172.21.15.63:0/3962127995 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f3bec038350 msgr2=0x7f3bec03a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:52.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.446+0000 7f3c08352700 1 --2- 172.21.15.63:0/3962127995 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f3bec038350 0x7f3bec03a800 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc009fd0 tx=0x7f3bfc009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:52.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.446+0000 7f3c08352700 1 -- 172.21.15.63:0/3962127995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c000fcd00 msgr2=0x7f3c00112740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:52.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.446+0000 7f3c08352700 1 --2- 172.21.15.63:0/3962127995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c000fcd00 0x7f3c00112740 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000eb40 tx=0x7f3bf000b040 comp rx=0 tx=0).stop 2023-12-07T16:20:52.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.446+0000 7f3c08352700 1 -- 172.21.15.63:0/3962127995 shutdown_connections 2023-12-07T16:20:52.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.446+0000 7f3c08352700 1 --2- 172.21.15.63:0/3962127995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c000fbaf0 0x7f3c001101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:52.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.446+0000 7f3c08352700 1 --2- 172.21.15.63:0/3962127995 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f3bec038350 0x7f3bec03a800 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:52.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.446+0000 7f3c08352700 1 --2- 172.21.15.63:0/3962127995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c000fcd00 0x7f3c00112740 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:52.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.446+0000 7f3c08352700 1 -- 172.21.15.63:0/3962127995 >> 172.21.15.63:0/3962127995 conn(0x7f3c000f7190 msgr2=0x7f3c000fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:52.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.446+0000 7f3c08352700 1 -- 172.21.15.63:0/3962127995 shutdown_connections 2023-12-07T16:20:52.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.446+0000 7f3c08352700 1 -- 172.21.15.63:0/3962127995 wait complete. 2023-12-07T16:20:52.459 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-07T16:20:52.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.574+0000 7ff21cc81700 1 -- 172.21.15.63:0/3219777304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2180fcbf0 msgr2=0x7ff2180fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:52.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.574+0000 7ff21cc81700 1 --2- 172.21.15.63:0/3219777304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2180fcbf0 0x7ff2180fd000 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff208004940 tx=0x7ff208009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:52.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.574+0000 7ff21cc81700 1 -- 172.21.15.63:0/3219777304 shutdown_connections 2023-12-07T16:20:52.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.574+0000 7ff21cc81700 1 --2- 172.21.15.63:0/3219777304 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2180fde00 0x7ff2180fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:52.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.574+0000 7ff21cc81700 1 --2- 172.21.15.63:0/3219777304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2180fcbf0 0x7ff2180fd000 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:52.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.574+0000 7ff21cc81700 1 -- 172.21.15.63:0/3219777304 >> 172.21.15.63:0/3219777304 conn(0x7ff2180f82d0 msgr2=0x7ff2180fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:52.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.574+0000 7ff21cc81700 1 -- 172.21.15.63:0/3219777304 shutdown_connections 2023-12-07T16:20:52.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.574+0000 7ff21cc81700 1 -- 172.21.15.63:0/3219777304 wait complete. 2023-12-07T16:20:52.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.575+0000 7ff21cc81700 1 Processor -- start 2023-12-07T16:20:52.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.575+0000 7ff21cc81700 1 -- start start 2023-12-07T16:20:52.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.575+0000 7ff21cc81700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2180fcbf0 0x7ff21810d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:52.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.575+0000 7ff21cc81700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2180fde00 0x7ff21810da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:52.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.575+0000 7ff21cc81700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21810e010 con 0x7ff2180fde00 2023-12-07T16:20:52.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.575+0000 7ff21cc81700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21810e8b0 con 0x7ff2180fcbf0 2023-12-07T16:20:52.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.575+0000 7ff215d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2180fde00 0x7ff21810da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:52.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.575+0000 7ff215d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2180fde00 0x7ff21810da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58956/0 (socket says 172.21.15.63:58956) 2023-12-07T16:20:52.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.575+0000 7ff215d9b700 1 -- 172.21.15.63:0/3498513352 learned_addr learned my addr 172.21.15.63:0/3498513352 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:20:52.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.575+0000 7ff21659c700 1 --2- 172.21.15.63:0/3498513352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2180fcbf0 0x7ff21810d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:52.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.576+0000 7ff21659c700 1 -- 172.21.15.63:0/3498513352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2180fde00 msgr2=0x7ff21810da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:52.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.576+0000 7ff21659c700 1 --2- 172.21.15.63:0/3498513352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2180fde00 0x7ff21810da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:52.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.576+0000 7ff21659c700 1 -- 172.21.15.63:0/3498513352 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c005040 con 0x7ff2180fcbf0 2023-12-07T16:20:52.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.576+0000 7ff21659c700 1 --2- 172.21.15.63:0/3498513352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2180fcbf0 0x7ff21810d4d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff208000c00 tx=0x7ff208009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:52.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.576+0000 7ff206ffd700 1 -- 172.21.15.63:0/3498513352 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff20800e070 con 0x7ff2180fcbf0 2023-12-07T16:20:52.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.576+0000 7ff206ffd700 1 -- 172.21.15.63:0/3498513352 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff20801c400 con 0x7ff2180fcbf0 2023-12-07T16:20:52.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.576+0000 7ff206ffd700 1 -- 172.21.15.63:0/3498513352 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff20800b650 con 0x7ff2180fcbf0 2023-12-07T16:20:52.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.576+0000 7ff21cc81700 1 -- 172.21.15.63:0/3498513352 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff208005040 con 0x7ff2180fcbf0 2023-12-07T16:20:52.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.576+0000 7ff21cc81700 1 -- 172.21.15.63:0/3498513352 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21810ee80 con 0x7ff2180fcbf0 2023-12-07T16:20:52.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.577+0000 7ff21cc81700 1 -- 172.21.15.63:0/3498513352 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff21804bb80 con 0x7ff2180fcbf0 2023-12-07T16:20:52.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.578+0000 7ff206ffd700 1 -- 172.21.15.63:0/3498513352 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 22) v1 ==== 45377+0+0 (secure 0 0 0) 0x7ff20800b7b0 con 0x7ff2180fcbf0 2023-12-07T16:20:52.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.578+0000 7ff206ffd700 1 --2- 172.21.15.63:0/3498513352 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7ff200038350 0x7ff20003a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:52.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.578+0000 7ff206ffd700 1 -- 172.21.15.63:0/3498513352 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7ff20804d090 con 0x7ff2180fcbf0 2023-12-07T16:20:52.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.578+0000 7ff215d9b700 1 --2- 172.21.15.63:0/3498513352 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7ff200038350 0x7ff20003a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:52.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.579+0000 7ff215d9b700 1 --2- 172.21.15.63:0/3498513352 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7ff200038350 0x7ff20003a800 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0044e0 tx=0x7ff20c00b040 comp rx=0 tx=0).ready entity=mgr.14614 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:52.581 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.583+0000 7ff206ffd700 1 -- 172.21.15.63:0/3498513352 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7ff20807fce0 con 0x7ff2180fcbf0 2023-12-07T16:20:52.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.876+0000 7ff21cc81700 1 -- 172.21.15.63:0/3498513352 --> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff21810ea70 con 0x7ff200038350 2023-12-07T16:20:52.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.880+0000 7ff206ffd700 1 -- 172.21.15.63:0/3498513352 <== mgr.14614 v2:172.21.15.152:6828/1927275654 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7ff21810ea70 con 0x7ff200038350 2023-12-07T16:20:52.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.882+0000 7ff21cc81700 1 -- 172.21.15.63:0/3498513352 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7ff200038350 msgr2=0x7ff20003a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:52.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.882+0000 7ff21cc81700 1 --2- 172.21.15.63:0/3498513352 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7ff200038350 0x7ff20003a800 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0044e0 tx=0x7ff20c00b040 comp rx=0 tx=0).stop 2023-12-07T16:20:52.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.882+0000 7ff21cc81700 1 -- 172.21.15.63:0/3498513352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2180fcbf0 msgr2=0x7ff21810d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:52.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.882+0000 7ff21cc81700 1 --2- 172.21.15.63:0/3498513352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2180fcbf0 0x7ff21810d4d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff208000c00 tx=0x7ff208009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:52.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.882+0000 7ff21cc81700 1 -- 172.21.15.63:0/3498513352 shutdown_connections 2023-12-07T16:20:52.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.882+0000 7ff21cc81700 1 --2- 172.21.15.63:0/3498513352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2180fcbf0 0x7ff21810d4d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:52.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.882+0000 7ff21cc81700 1 --2- 172.21.15.63:0/3498513352 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7ff200038350 0x7ff20003a800 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:52.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.882+0000 7ff21cc81700 1 --2- 172.21.15.63:0/3498513352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2180fde00 0x7ff21810da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:52.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.882+0000 7ff21cc81700 1 -- 172.21.15.63:0/3498513352 >> 172.21.15.63:0/3498513352 conn(0x7ff2180f82d0 msgr2=0x7ff218101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:52.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.883+0000 7ff21cc81700 1 -- 172.21.15.63:0/3498513352 shutdown_connections 2023-12-07T16:20:52.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:52.883+0000 7ff21cc81700 1 -- 172.21.15.63:0/3498513352 wait complete. 2023-12-07T16:20:52.951 INFO:tasks.workunit.client.1.smithi152.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-07T16:20:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.008+0000 7f8bf6e92700 1 -- 172.21.15.63:0/1513808118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bf00fcd00 msgr2=0x7f8bf00fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.008+0000 7f8bf6e92700 1 --2- 172.21.15.63:0/1513808118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bf00fcd00 0x7f8bf00fd150 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc004940 tx=0x7f8bdc009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.008+0000 7f8bf6e92700 1 -- 172.21.15.63:0/1513808118 shutdown_connections 2023-12-07T16:20:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.008+0000 7f8bf6e92700 1 --2- 172.21.15.63:0/1513808118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bf00fcd00 0x7f8bf00fd150 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.008+0000 7f8bf6e92700 1 --2- 172.21.15.63:0/1513808118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bf00fbaf0 0x7f8bf00fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.008+0000 7f8bf6e92700 1 -- 172.21.15.63:0/1513808118 >> 172.21.15.63:0/1513808118 conn(0x7f8bf00f7190 msgr2=0x7f8bf00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.008+0000 7f8bf6e92700 1 -- 172.21.15.63:0/1513808118 shutdown_connections 2023-12-07T16:20:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.008+0000 7f8bf6e92700 1 -- 172.21.15.63:0/1513808118 wait complete. 2023-12-07T16:20:53.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.009+0000 7f8bf6e92700 1 Processor -- start 2023-12-07T16:20:53.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.009+0000 7f8bf6e92700 1 -- start start 2023-12-07T16:20:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.009+0000 7f8bf6e92700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bf00fbaf0 0x7f8bf00ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.009+0000 7f8bf6e92700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bf00fcd00 0x7f8bf00fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.009+0000 7f8bf6e92700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf00fe640 con 0x7f8bf00fcd00 2023-12-07T16:20:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.009+0000 7f8bf6e92700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf00fe7b0 con 0x7f8bf00fbaf0 2023-12-07T16:20:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.009+0000 7f8bf4c2e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bf00fbaf0 0x7f8bf00ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.009+0000 7f8beffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bf00fcd00 0x7f8bf00fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.010+0000 7f8bf4c2e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bf00fbaf0 0x7f8bf00ffbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.63:55062/0 (socket says 172.21.15.63:55062) 2023-12-07T16:20:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.010+0000 7f8beffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bf00fcd00 0x7f8bf00fe040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58970/0 (socket says 172.21.15.63:58970) 2023-12-07T16:20:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.010+0000 7f8bf4c2e700 1 -- 172.21.15.63:0/497435039 learned_addr learned my addr 172.21.15.63:0/497435039 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:20:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.010+0000 7f8beffff700 1 -- 172.21.15.63:0/497435039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bf00fbaf0 msgr2=0x7f8bf00ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.010+0000 7f8beffff700 1 --2- 172.21.15.63:0/497435039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bf00fbaf0 0x7f8bf00ffbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.010+0000 7f8beffff700 1 -- 172.21.15.63:0/497435039 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bdc005040 con 0x7f8bf00fcd00 2023-12-07T16:20:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.010+0000 7f8beffff700 1 --2- 172.21.15.63:0/497435039 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bf00fcd00 0x7f8bf00fe040 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00b0d0 tx=0x7f8bdc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.010+0000 7f8bed7fa700 1 -- 172.21.15.63:0/497435039 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bdc00e070 con 0x7f8bf00fcd00 2023-12-07T16:20:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.010+0000 7f8bf6e92700 1 -- 172.21.15.63:0/497435039 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf00fea30 con 0x7f8bf00fcd00 2023-12-07T16:20:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.010+0000 7f8bed7fa700 1 -- 172.21.15.63:0/497435039 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8bdc01c400 con 0x7f8bf00fcd00 2023-12-07T16:20:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.010+0000 7f8bed7fa700 1 -- 172.21.15.63:0/497435039 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bdc00b650 con 0x7f8bf00fcd00 2023-12-07T16:20:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.010+0000 7f8bf6e92700 1 -- 172.21.15.63:0/497435039 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf0115500 con 0x7f8bf00fcd00 2023-12-07T16:20:53.010 INFO:tasks.workunit.client.1.smithi152.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-07T16:20:53.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.011+0000 7f8bf6e92700 1 -- 172.21.15.63:0/497435039 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf004bb80 con 0x7f8bf00fcd00 2023-12-07T16:20:53.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.012+0000 7f8bed7fa700 1 -- 172.21.15.63:0/497435039 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 22) v1 ==== 45377+0+0 (secure 0 0 0) 0x7f8bdc01c9e0 con 0x7f8bf00fcd00 2023-12-07T16:20:53.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.012+0000 7f8bed7fa700 1 --2- 172.21.15.63:0/497435039 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f8be0038350 0x7f8be003a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:53.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.012+0000 7f8bed7fa700 1 -- 172.21.15.63:0/497435039 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f8bdc04d910 con 0x7f8bf00fcd00 2023-12-07T16:20:53.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.013+0000 7f8bf4c2e700 1 --2- 172.21.15.63:0/497435039 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f8be0038350 0x7f8be003a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.013+0000 7f8bf4c2e700 1 --2- 172.21.15.63:0/497435039 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f8be0038350 0x7f8be003a800 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00ff950 tx=0x7f8be400b040 comp rx=0 tx=0).ready entity=mgr.14614 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:53.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.022+0000 7f8bed7fa700 1 -- 172.21.15.63:0/497435039 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f8bdc01c570 con 0x7f8bf00fcd00 2023-12-07T16:20:53.047 INFO:tasks.workunit.client.1.smithi152.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-07T16:20:53.049 INFO:tasks.workunit.client.1.smithi152.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-07T16:20:53.049 INFO:tasks.workunit.client.1.smithi152.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-07T16:20:53.085 INFO:tasks.workunit.client.1.smithi152.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-07T16:20:53.088 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-07T16:20:53.089 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2023-12-07T16:20:53.148 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2023-12-07T16:20:53.149 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-07T16:20:53.149 DEBUG:teuthology.orchestra.run.smithi152:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e6605fb8725c25c4838cef6a39f30df73f1ed149 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2023-12-07T16:20:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:52 smithi063 ceph-mon[112095]: Deploying cephadm binary to smithi063 2023-12-07T16:20:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:52 smithi063 ceph-mon[112095]: Deploying cephadm binary to smithi152 2023-12-07T16:20:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:52 smithi063 ceph-mon[112095]: mgrmap e22: smithi152.sxayfb(active, since 1.06377s) 2023-12-07T16:20:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:52 smithi063 ceph-mon[112095]: pgmap v3: 65 pgs: 65 active+clean; 6.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:52 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:20:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:52 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:20:53.212 INFO:tasks.workunit.client.1.smithi152.stderr:+ mkdir -p fsstress 2023-12-07T16:20:53.213 INFO:tasks.workunit.client.1.smithi152.stderr:+ pushd fsstress 2023-12-07T16:20:53.213 INFO:tasks.workunit.client.1.smithi152.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-07T16:20:53.214 INFO:tasks.workunit.client.1.smithi152.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-07T16:20:53.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:52 smithi152 ceph-mon[121113]: Deploying cephadm binary to smithi063 2023-12-07T16:20:53.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:52 smithi152 ceph-mon[121113]: Deploying cephadm binary to smithi152 2023-12-07T16:20:53.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:52 smithi152 ceph-mon[121113]: mgrmap e22: smithi152.sxayfb(active, since 1.06377s) 2023-12-07T16:20:53.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:52 smithi152 ceph-mon[121113]: pgmap v3: 65 pgs: 65 active+clean; 6.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:53.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:52 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:20:53.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:52 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:20:53.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.334+0000 7f8bed7fa700 1 -- 172.21.15.63:0/497435039 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mgrmap(e 23) v1 ==== 45673+0+0 (secure 0 0 0) 0x7f8bdc04b910 con 0x7f8bf00fcd00 2023-12-07T16:20:53.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.391+0000 7f8bf6e92700 1 -- 172.21.15.63:0/497435039 --> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8bf0065a80 con 0x7f8be0038350 2023-12-07T16:20:53.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.415+0000 7f8bed7fa700 1 -- 172.21.15.63:0/497435039 <== mgr.14614 v2:172.21.15.152:6828/1927275654 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f8bf0065a80 con 0x7f8be0038350 2023-12-07T16:20:53.414 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-07T16:20:53.414 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (4m) 88s ago 5m 27.3M - 0.25.0 c8568f914cd2 bfa7e53794bf 2023-12-07T16:20:53.414 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (5m) 88s ago 5m 7428k - 17.2.7-115-g4f62d9ad fcdfd00f81c7 80bed1094ab4 2023-12-07T16:20:53.414 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi152 smithi152 running (4m) 8s ago 4m 7495k - 17.2.7-115-g4f62d9ad fcdfd00f81c7 e2cd5532384b 2023-12-07T16:20:53.414 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (4m) 88s ago 5m 91.5M - 9.4.7 954c08fa6188 ead20992252b 2023-12-07T16:20:53.414 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.gsjgcq smithi063 running (103s) 88s ago 102s 12.0M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 f70e4f098e4c 2023-12-07T16:20:53.414 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.yidolg smithi063 running (99s) 88s ago 99s 14.7M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5b053ef5fb7f 2023-12-07T16:20:53.415 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.aovwwd smithi152 running (97s) 8s ago 97s 13.3M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 80190948a595 2023-12-07T16:20:53.415 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.mrvngf smithi152 running (101s) 8s ago 101s 18.3M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5f60b893f840 2023-12-07T16:20:53.415 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.yohyyx smithi063 *:9283 running (6m) 88s ago 6m 494M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 e9b3a40f26fd 2023-12-07T16:20:53.415 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi152.sxayfb smithi152 *:8443,9283 running (11s) 8s ago 4m 47.5M - 19.0.0-13-ge6605fb8 104f332cd0a9 bfc7027421d2 2023-12-07T16:20:53.415 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (6m) 88s ago 6m 77.6M 2048M 17.2.7-115-g4f62d9ad fcdfd00f81c7 736281f5463c 2023-12-07T16:20:53.415 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi152 smithi152 running (4m) 8s ago 4m 48.0M 2048M 17.2.7-115-g4f62d9ad fcdfd00f81c7 ecfe3add39d6 2023-12-07T16:20:53.415 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (5m) 88s ago 5m 16.3M - 1.5.0 0da6a335fe13 8412e0ac9145 2023-12-07T16:20:53.415 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi152 smithi152 *:9100 running (4m) 8s ago 4m 18.7M - 1.5.0 0da6a335fe13 fb0e82afe6a4 2023-12-07T16:20:53.415 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (4m) 88s ago 4m 58.2M 4299M 17.2.7-115-g4f62d9ad fcdfd00f81c7 bbdd7f82a7c3 2023-12-07T16:20:53.415 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (3m) 88s ago 3m 59.9M 4299M 17.2.7-115-g4f62d9ad fcdfd00f81c7 4372601f899e 2023-12-07T16:20:53.416 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (3m) 88s ago 3m 56.2M 4299M 17.2.7-115-g4f62d9ad fcdfd00f81c7 b0d432bbca05 2023-12-07T16:20:53.416 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi152 running (3m) 8s ago 3m 61.4M 5323M 17.2.7-115-g4f62d9ad fcdfd00f81c7 94d14402b489 2023-12-07T16:20:53.416 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi152 running (2m) 8s ago 2m 56.9M 5323M 17.2.7-115-g4f62d9ad fcdfd00f81c7 d3b8b2f12489 2023-12-07T16:20:53.416 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi152 running (2m) 8s ago 2m 53.3M 5323M 17.2.7-115-g4f62d9ad fcdfd00f81c7 e7f8d9f716bb 2023-12-07T16:20:53.416 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (4m) 88s ago 5m 48.7M - 2.43.0 a07b618ecd1d 32eb5a56be5e 2023-12-07T16:20:53.417 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.417+0000 7f8bf6e92700 1 -- 172.21.15.63:0/497435039 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f8be0038350 msgr2=0x7f8be003a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:53.417 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.417+0000 7f8bf6e92700 1 --2- 172.21.15.63:0/497435039 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f8be0038350 0x7f8be003a800 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00ff950 tx=0x7f8be400b040 comp rx=0 tx=0).stop 2023-12-07T16:20:53.417 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.417+0000 7f8bf6e92700 1 -- 172.21.15.63:0/497435039 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bf00fcd00 msgr2=0x7f8bf00fe040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:53.417 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.417+0000 7f8bf6e92700 1 --2- 172.21.15.63:0/497435039 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bf00fcd00 0x7f8bf00fe040 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00b0d0 tx=0x7f8bdc009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:53.417 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.417+0000 7f8bf6e92700 1 -- 172.21.15.63:0/497435039 shutdown_connections 2023-12-07T16:20:53.417 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.417+0000 7f8bf6e92700 1 --2- 172.21.15.63:0/497435039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bf00fbaf0 0x7f8bf00ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:53.418 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.417+0000 7f8bf6e92700 1 --2- 172.21.15.63:0/497435039 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f8be0038350 0x7f8be003a800 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:53.418 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.417+0000 7f8bf6e92700 1 --2- 172.21.15.63:0/497435039 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bf00fcd00 0x7f8bf00fe040 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:53.418 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.417+0000 7f8bf6e92700 1 -- 172.21.15.63:0/497435039 >> 172.21.15.63:0/497435039 conn(0x7f8bf00f7190 msgr2=0x7f8bf0065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:53.418 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.417+0000 7f8bf6e92700 1 -- 172.21.15.63:0/497435039 shutdown_connections 2023-12-07T16:20:53.418 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.418+0000 7f8bf6e92700 1 -- 172.21.15.63:0/497435039 wait complete. 2023-12-07T16:20:53.536 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.537+0000 7f3ef708a700 1 -- 172.21.15.63:0/3122217379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ef00fbaf0 msgr2=0x7f3ef00fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:53.536 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.537+0000 7f3ef708a700 1 --2- 172.21.15.63:0/3122217379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ef00fbaf0 0x7f3ef00fbf00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4004940 tx=0x7f3ee4009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:53.536 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.537+0000 7f3ef708a700 1 -- 172.21.15.63:0/3122217379 shutdown_connections 2023-12-07T16:20:53.536 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.537+0000 7f3ef708a700 1 --2- 172.21.15.63:0/3122217379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ef00fcd00 0x7f3ef00fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:53.536 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.537+0000 7f3ef708a700 1 --2- 172.21.15.63:0/3122217379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ef00fbaf0 0x7f3ef00fbf00 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:53.536 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.537+0000 7f3ef708a700 1 -- 172.21.15.63:0/3122217379 >> 172.21.15.63:0/3122217379 conn(0x7f3ef00f71b0 msgr2=0x7f3ef00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:53.536 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.537+0000 7f3ef708a700 1 -- 172.21.15.63:0/3122217379 shutdown_connections 2023-12-07T16:20:53.536 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.537+0000 7f3ef708a700 1 -- 172.21.15.63:0/3122217379 wait complete. 2023-12-07T16:20:53.538 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.538+0000 7f3ef708a700 1 Processor -- start 2023-12-07T16:20:53.539 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.538+0000 7f3ef708a700 1 -- start start 2023-12-07T16:20:53.539 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.538+0000 7f3ef708a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ef00fbaf0 0x7f3ef010d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:53.539 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.538+0000 7f3ef708a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ef00fcd00 0x7f3ef010da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:53.539 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.538+0000 7f3ef708a700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef010e000 con 0x7f3ef00fbaf0 2023-12-07T16:20:53.539 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.538+0000 7f3ef708a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef010e8a0 con 0x7f3ef00fcd00 2023-12-07T16:20:53.539 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.538+0000 7f3ef4e26700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ef00fbaf0 0x7f3ef010d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:53.539 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.538+0000 7f3ef4e26700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ef00fbaf0 0x7f3ef010d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58992/0 (socket says 172.21.15.63:58992) 2023-12-07T16:20:53.539 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.538+0000 7f3ef4e26700 1 -- 172.21.15.63:0/618791695 learned_addr learned my addr 172.21.15.63:0/618791695 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:20:53.539 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.538+0000 7f3eeffff700 1 --2- 172.21.15.63:0/618791695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ef00fcd00 0x7f3ef010da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:53.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.539+0000 7f3eeffff700 1 -- 172.21.15.63:0/618791695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ef00fbaf0 msgr2=0x7f3ef010d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:53.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.539+0000 7f3eeffff700 1 --2- 172.21.15.63:0/618791695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ef00fbaf0 0x7f3ef010d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:53.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.539+0000 7f3eeffff700 1 -- 172.21.15.63:0/618791695 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee4005040 con 0x7f3ef00fcd00 2023-12-07T16:20:53.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.539+0000 7f3ef4e26700 1 --2- 172.21.15.63:0/618791695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ef00fbaf0 0x7f3ef010d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T16:20:53.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.539+0000 7f3eeffff700 1 --2- 172.21.15.63:0/618791695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ef00fcd00 0x7f3ef010da00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009fd0 tx=0x7f3edc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:53.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.539+0000 7f3eed7fa700 1 -- 172.21.15.63:0/618791695 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3edc004e90 con 0x7f3ef00fcd00 2023-12-07T16:20:53.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.539+0000 7f3ef708a700 1 -- 172.21.15.63:0/618791695 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef010eb20 con 0x7f3ef00fcd00 2023-12-07T16:20:53.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.539+0000 7f3eed7fa700 1 -- 172.21.15.63:0/618791695 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3edc00f040 con 0x7f3ef00fcd00 2023-12-07T16:20:53.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.539+0000 7f3eed7fa700 1 -- 172.21.15.63:0/618791695 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3edc00c9b0 con 0x7f3ef00fcd00 2023-12-07T16:20:53.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.539+0000 7f3ef708a700 1 -- 172.21.15.63:0/618791695 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef010f060 con 0x7f3ef00fcd00 2023-12-07T16:20:53.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.540+0000 7f3eed7fa700 1 -- 172.21.15.63:0/618791695 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) v1 ==== 45673+0+0 (secure 0 0 0) 0x7f3edc00cb10 con 0x7f3ef00fcd00 2023-12-07T16:20:53.541 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.540+0000 7f3eed7fa700 1 --2- 172.21.15.63:0/618791695 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f3ee00386e0 0x7f3ee003ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:53.541 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.540+0000 7f3ef708a700 1 -- 172.21.15.63:0/618791695 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef004bb80 con 0x7f3ef00fcd00 2023-12-07T16:20:53.542 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.541+0000 7f3eed7fa700 1 -- 172.21.15.63:0/618791695 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f3edc04bb50 con 0x7f3ef00fcd00 2023-12-07T16:20:53.542 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.541+0000 7f3ef4e26700 1 --2- 172.21.15.63:0/618791695 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f3ee00386e0 0x7f3ee003ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:53.542 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.541+0000 7f3ef4e26700 1 --2- 172.21.15.63:0/618791695 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f3ee00386e0 0x7f3ee003ab90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3ee40135e0 tx=0x7f3ee4009e30 comp rx=0 tx=0).ready entity=mgr.14614 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:53.544 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:53.546+0000 7f3eed7fa700 1 -- 172.21.15.63:0/618791695 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f3edc01b2c0 con 0x7f3ef00fcd00 2023-12-07T16:20:53.987 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:53 smithi063 ceph-mon[112095]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:20:53.987 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:53 smithi063 ceph-mon[112095]: [07/Dec/2023:16:20:52] ENGINE Bus STARTING 2023-12-07T16:20:53.987 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:53 smithi063 ceph-mon[112095]: [07/Dec/2023:16:20:52] ENGINE Serving on http://172.21.15.152:8765 2023-12-07T16:20:53.987 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:53 smithi063 ceph-mon[112095]: from='client.24405 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:20:53.987 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:53 smithi063 ceph-mon[112095]: pgmap v4: 65 pgs: 65 active+clean; 6.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:53.987 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:53 smithi063 ceph-mon[112095]: [07/Dec/2023:16:20:52] ENGINE Serving on https://172.21.15.152:7150 2023-12-07T16:20:53.987 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:53 smithi063 ceph-mon[112095]: [07/Dec/2023:16:20:52] ENGINE Bus STARTED 2023-12-07T16:20:53.987 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:53 smithi063 ceph-mon[112095]: mgrmap e23: smithi152.sxayfb(active, since 2s) 2023-12-07T16:20:53.988 INFO:tasks.workunit.client.1.smithi152.stderr:+ tar xzf ltp-full.tgz 2023-12-07T16:20:54.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.054+0000 7f3ef708a700 1 -- 172.21.15.63:0/618791695 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3ef010f4f0 con 0x7f3ef00fcd00 2023-12-07T16:20:54.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.056+0000 7f3eed7fa700 1 -- 172.21.15.63:0/618791695 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f3edc017120 con 0x7f3ef00fcd00 2023-12-07T16:20:54.064 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:20:54.064 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-07T16:20:54.064 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 2 2023-12-07T16:20:54.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:20:54.064 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-07T16:20:54.065 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 1 2023-12-07T16:20:54.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:20:54.065 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-07T16:20:54.065 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 6 2023-12-07T16:20:54.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:20:54.065 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-07T16:20:54.065 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 4 2023-12-07T16:20:54.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:20:54.065 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-07T16:20:54.065 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 12, 2023-12-07T16:20:54.065 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 1 2023-12-07T16:20:54.065 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-07T16:20:54.066 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:20:54.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.073+0000 7f3ef708a700 1 -- 172.21.15.63:0/618791695 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f3ee00386e0 msgr2=0x7f3ee003ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:54.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.073+0000 7f3ef708a700 1 --2- 172.21.15.63:0/618791695 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f3ee00386e0 0x7f3ee003ab90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3ee40135e0 tx=0x7f3ee4009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:54.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.073+0000 7f3ef708a700 1 -- 172.21.15.63:0/618791695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ef00fcd00 msgr2=0x7f3ef010da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:54.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.073+0000 7f3ef708a700 1 --2- 172.21.15.63:0/618791695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ef00fcd00 0x7f3ef010da00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009fd0 tx=0x7f3edc00b040 comp rx=0 tx=0).stop 2023-12-07T16:20:54.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.074+0000 7f3ef708a700 1 -- 172.21.15.63:0/618791695 shutdown_connections 2023-12-07T16:20:54.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.074+0000 7f3ef708a700 1 --2- 172.21.15.63:0/618791695 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f3ee00386e0 0x7f3ee003ab90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:54.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.074+0000 7f3ef708a700 1 --2- 172.21.15.63:0/618791695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ef00fbaf0 0x7f3ef010d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:54.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.074+0000 7f3ef708a700 1 --2- 172.21.15.63:0/618791695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ef00fcd00 0x7f3ef010da00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:54.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.074+0000 7f3ef708a700 1 -- 172.21.15.63:0/618791695 >> 172.21.15.63:0/618791695 conn(0x7f3ef00f71b0 msgr2=0x7f3ef00fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:54.083 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.084+0000 7f3ef708a700 1 -- 172.21.15.63:0/618791695 shutdown_connections 2023-12-07T16:20:54.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.086+0000 7f3ef708a700 1 -- 172.21.15.63:0/618791695 wait complete. 2023-12-07T16:20:54.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:53 smithi152 ceph-mon[121113]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:20:54.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:53 smithi152 ceph-mon[121113]: [07/Dec/2023:16:20:52] ENGINE Bus STARTING 2023-12-07T16:20:54.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:53 smithi152 ceph-mon[121113]: [07/Dec/2023:16:20:52] ENGINE Serving on http://172.21.15.152:8765 2023-12-07T16:20:54.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:53 smithi152 ceph-mon[121113]: from='client.24405 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:20:54.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:53 smithi152 ceph-mon[121113]: pgmap v4: 65 pgs: 65 active+clean; 6.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:54.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:53 smithi152 ceph-mon[121113]: [07/Dec/2023:16:20:52] ENGINE Serving on https://172.21.15.152:7150 2023-12-07T16:20:54.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:53 smithi152 ceph-mon[121113]: [07/Dec/2023:16:20:52] ENGINE Bus STARTED 2023-12-07T16:20:54.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:53 smithi152 ceph-mon[121113]: mgrmap e23: smithi152.sxayfb(active, since 2s) 2023-12-07T16:20:54.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.308+0000 7f5066c14700 1 -- 172.21.15.63:0/3150045199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50600fb520 msgr2=0x7f50600fd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:54.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.308+0000 7f5066c14700 1 --2- 172.21.15.63:0/3150045199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50600fb520 0x7f50600fd940 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f505c004940 tx=0x7f505c009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:54.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.312+0000 7f5066c14700 1 -- 172.21.15.63:0/3150045199 shutdown_connections 2023-12-07T16:20:54.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.312+0000 7f5066c14700 1 --2- 172.21.15.63:0/3150045199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50600fde80 0x7f5060100300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:54.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.312+0000 7f5066c14700 1 --2- 172.21.15.63:0/3150045199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50600fb520 0x7f50600fd940 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:54.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.312+0000 7f5066c14700 1 -- 172.21.15.63:0/3150045199 >> 172.21.15.63:0/3150045199 conn(0x7f50600f7190 msgr2=0x7f50600f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:54.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.320+0000 7f5066c14700 1 -- 172.21.15.63:0/3150045199 shutdown_connections 2023-12-07T16:20:54.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.321+0000 7f5066c14700 1 -- 172.21.15.63:0/3150045199 wait complete. 2023-12-07T16:20:54.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.322+0000 7f5066c14700 1 Processor -- start 2023-12-07T16:20:54.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.322+0000 7f5066c14700 1 -- start start 2023-12-07T16:20:54.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.322+0000 7f5066c14700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50600fb520 0x7f50601091f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:54.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.322+0000 7f5066c14700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50600fde80 0x7f5060109730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:54.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.322+0000 7f5066c14700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5060109e10 con 0x7f50600fde80 2023-12-07T16:20:54.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.322+0000 7f5066c14700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506011d800 con 0x7f50600fb520 2023-12-07T16:20:54.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.323+0000 7f50649b0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50600fb520 0x7f50601091f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:54.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.323+0000 7f50649b0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50600fb520 0x7f50601091f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.63:55096/0 (socket says 172.21.15.63:55096) 2023-12-07T16:20:54.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.323+0000 7f50649b0700 1 -- 172.21.15.63:0/2689715966 learned_addr learned my addr 172.21.15.63:0/2689715966 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:20:54.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.324+0000 7f50649b0700 1 -- 172.21.15.63:0/2689715966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50600fde80 msgr2=0x7f5060109730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:54.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.324+0000 7f50649b0700 1 --2- 172.21.15.63:0/2689715966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50600fde80 0x7f5060109730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:54.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.324+0000 7f50649b0700 1 -- 172.21.15.63:0/2689715966 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505c005040 con 0x7f50600fb520 2023-12-07T16:20:54.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.325+0000 7f50649b0700 1 --2- 172.21.15.63:0/2689715966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50600fb520 0x7f50601091f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f505c004f90 tx=0x7f505c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:54.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.326+0000 7f50557fa700 1 -- 172.21.15.63:0/2689715966 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f505c00e030 con 0x7f50600fb520 2023-12-07T16:20:54.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.326+0000 7f50557fa700 1 -- 172.21.15.63:0/2689715966 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f505c013420 con 0x7f50600fb520 2023-12-07T16:20:54.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.326+0000 7f50557fa700 1 -- 172.21.15.63:0/2689715966 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f505c01c640 con 0x7f50600fb520 2023-12-07T16:20:54.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.326+0000 7f5066c14700 1 -- 172.21.15.63:0/2689715966 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506011da80 con 0x7f50600fb520 2023-12-07T16:20:54.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.326+0000 7f5066c14700 1 -- 172.21.15.63:0/2689715966 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506011dfc0 con 0x7f50600fb520 2023-12-07T16:20:54.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.327+0000 7f5046ffd700 1 -- 172.21.15.63:0/2689715966 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f504c0052e0 con 0x7f50600fb520 2023-12-07T16:20:54.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.330+0000 7f50557fa700 1 -- 172.21.15.63:0/2689715966 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 23) v1 ==== 45673+0+0 (secure 0 0 0) 0x7f505c013a20 con 0x7f50600fb520 2023-12-07T16:20:54.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.330+0000 7f50557fa700 1 --2- 172.21.15.63:0/2689715966 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f5048038720 0x7f504803abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:54.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.330+0000 7f50557fa700 1 -- 172.21.15.63:0/2689715966 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f505c04e130 con 0x7f50600fb520 2023-12-07T16:20:54.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.334+0000 7f50557fa700 1 -- 172.21.15.63:0/2689715966 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f505c024980 con 0x7f50600fb520 2023-12-07T16:20:54.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.340+0000 7f5057fff700 1 --2- 172.21.15.63:0/2689715966 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f5048038720 0x7f504803abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:54.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.342+0000 7f5057fff700 1 --2- 172.21.15.63:0/2689715966 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f5048038720 0x7f504803abd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f506010a250 tx=0x7f5050006ce0 comp rx=0 tx=0).ready entity=mgr.14614 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:54.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.821+0000 7f5046ffd700 1 -- 172.21.15.63:0/2689715966 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f504c005da0 con 0x7f50600fb520 2023-12-07T16:20:54.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.822+0000 7f50557fa700 1 -- 172.21.15.63:0/2689715966 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1819 (secure 0 0 0) 0x7f505c033070 con 0x7f50600fb520 2023-12-07T16:20:54.832 INFO:teuthology.orchestra.run.smithi063.stdout:e15 2023-12-07T16:20:54.832 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-07T16:20:54.832 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:20:54.832 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-07T16:20:54.833 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:20:54.833 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-07T16:20:54.833 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-07T16:20:54.833 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 15 2023-12-07T16:20:54.833 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-07T16:20:54.833 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-07T16:19:08.352640+0000 2023-12-07T16:20:54.833 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-07T16:19:22.407210+0000 2023-12-07T16:20:54.833 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-07T16:20:54.833 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-07T16:20:54.833 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-07T16:20:54.833 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-07T16:20:54.834 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-07T16:20:54.834 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-07T16:20:54.834 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-07T16:20:54.834 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 45 2023-12-07T16:20:54.834 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:20:54.834 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 2 2023-12-07T16:20:54.834 INFO:teuthology.orchestra.run.smithi063.stdout:in 0,1 2023-12-07T16:20:54.834 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14478,1=24269} 2023-12-07T16:20:54.834 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-07T16:20:54.834 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-07T16:20:54.835 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-07T16:20:54.835 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-07T16:20:54.835 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-07T16:20:54.835 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-07T16:20:54.835 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-07T16:20:54.835 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-07T16:20:54.835 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.yidolg{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:20:54.835 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.mrvngf{1:24269} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.152:6824/3157779064,v1:172.21.15.152:6825/3157779064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:20:54.835 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:20:54.836 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:20:54.836 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-07T16:20:54.836 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:20:54.836 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.gsjgcq{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/3063200414,v1:172.21.15.63:6827/3063200414] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:20:54.836 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.aovwwd{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/2906349729,v1:172.21.15.152:6827/2906349729] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:20:54.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.826+0000 7f5046ffd700 1 -- 172.21.15.63:0/2689715966 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f5048038720 msgr2=0x7f504803abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:54.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.826+0000 7f5046ffd700 1 --2- 172.21.15.63:0/2689715966 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f5048038720 0x7f504803abd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f506010a250 tx=0x7f5050006ce0 comp rx=0 tx=0).stop 2023-12-07T16:20:54.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.826+0000 7f5046ffd700 1 -- 172.21.15.63:0/2689715966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50600fb520 msgr2=0x7f50601091f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:54.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.826+0000 7f5046ffd700 1 --2- 172.21.15.63:0/2689715966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50600fb520 0x7f50601091f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f505c004f90 tx=0x7f505c009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:54.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.827+0000 7f5046ffd700 1 -- 172.21.15.63:0/2689715966 shutdown_connections 2023-12-07T16:20:54.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.827+0000 7f5046ffd700 1 --2- 172.21.15.63:0/2689715966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50600fb520 0x7f50601091f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:54.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.827+0000 7f5046ffd700 1 --2- 172.21.15.63:0/2689715966 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f5048038720 0x7f504803abd0 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f506010a250 tx=0x7f5050006ce0 comp rx=0 tx=0).stop 2023-12-07T16:20:54.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.827+0000 7f5046ffd700 1 --2- 172.21.15.63:0/2689715966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50600fde80 0x7f5060109730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:54.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.827+0000 7f5046ffd700 1 -- 172.21.15.63:0/2689715966 >> 172.21.15.63:0/2689715966 conn(0x7f50600f7190 msgr2=0x7f50600f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:54.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.835+0000 7f5046ffd700 1 -- 172.21.15.63:0/2689715966 shutdown_connections 2023-12-07T16:20:54.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:54.837+0000 7f5046ffd700 1 -- 172.21.15.63:0/2689715966 wait complete. 2023-12-07T16:20:54.865 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 15 2023-12-07T16:20:55.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.009+0000 7f56fc252700 1 -- 172.21.15.63:0/3392758447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56f40fcac0 msgr2=0x7f56f40fcf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:55.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.009+0000 7f56fc252700 1 --2- 172.21.15.63:0/3392758447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56f40fcac0 0x7f56f40fcf10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f56e4004940 tx=0x7f56e4009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:55.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.009+0000 7f56fc252700 1 -- 172.21.15.63:0/3392758447 shutdown_connections 2023-12-07T16:20:55.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.009+0000 7f56fc252700 1 --2- 172.21.15.63:0/3392758447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56f40fcac0 0x7f56f40fcf10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:55.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.009+0000 7f56fc252700 1 --2- 172.21.15.63:0/3392758447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56f40fc0e0 0x7f56f40fc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:55.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.009+0000 7f56fc252700 1 -- 172.21.15.63:0/3392758447 >> 172.21.15.63:0/3392758447 conn(0x7f56f40f6950 msgr2=0x7f56f40f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:55.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.009+0000 7f56fc252700 1 -- 172.21.15.63:0/3392758447 shutdown_connections 2023-12-07T16:20:55.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.009+0000 7f56fc252700 1 -- 172.21.15.63:0/3392758447 wait complete. 2023-12-07T16:20:55.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.010+0000 7f56fc252700 1 Processor -- start 2023-12-07T16:20:55.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.010+0000 7f56fc252700 1 -- start start 2023-12-07T16:20:55.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.010+0000 7f56fc252700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56f40fc0e0 0x7f56f410f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:55.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.010+0000 7f56fc252700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56f40fcac0 0x7f56f410fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:55.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.010+0000 7f56fc252700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f4110250 con 0x7f56f40fc0e0 2023-12-07T16:20:55.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.010+0000 7f56fc252700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f4110af0 con 0x7f56f40fcac0 2023-12-07T16:20:55.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.010+0000 7f56f9fee700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56f40fc0e0 0x7f56f410f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:55.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.010+0000 7f56f9fee700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56f40fc0e0 0x7f56f410f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59036/0 (socket says 172.21.15.63:59036) 2023-12-07T16:20:55.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.010+0000 7f56f9fee700 1 -- 172.21.15.63:0/4169819750 learned_addr learned my addr 172.21.15.63:0/4169819750 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:20:55.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.010+0000 7f56f97ed700 1 --2- 172.21.15.63:0/4169819750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56f40fcac0 0x7f56f410fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:55.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.011+0000 7f56f9fee700 1 -- 172.21.15.63:0/4169819750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56f40fcac0 msgr2=0x7f56f410fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:55.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.011+0000 7f56f9fee700 1 --2- 172.21.15.63:0/4169819750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56f40fcac0 0x7f56f410fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:55.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.011+0000 7f56f9fee700 1 -- 172.21.15.63:0/4169819750 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e4005040 con 0x7f56f40fc0e0 2023-12-07T16:20:55.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.011+0000 7f56f97ed700 1 --2- 172.21.15.63:0/4169819750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56f40fcac0 0x7f56f410fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T16:20:55.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.011+0000 7f56f9fee700 1 --2- 172.21.15.63:0/4169819750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56f40fc0e0 0x7f56f410f710 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f56f000eb70 tx=0x7f56f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:55.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.011+0000 7f56ea7fc700 1 -- 172.21.15.63:0/4169819750 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56f0007cc0 con 0x7f56f40fc0e0 2023-12-07T16:20:55.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.011+0000 7f56fc252700 1 -- 172.21.15.63:0/4169819750 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f4110d70 con 0x7f56f40fc0e0 2023-12-07T16:20:55.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.011+0000 7f56fc252700 1 -- 172.21.15.63:0/4169819750 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f41112b0 con 0x7f56f40fc0e0 2023-12-07T16:20:55.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.011+0000 7f56ea7fc700 1 -- 172.21.15.63:0/4169819750 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f56f000f040 con 0x7f56f40fc0e0 2023-12-07T16:20:55.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.011+0000 7f56ea7fc700 1 -- 172.21.15.63:0/4169819750 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56f000c9d0 con 0x7f56f40fc0e0 2023-12-07T16:20:55.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.013+0000 7f56fc252700 1 -- 172.21.15.63:0/4169819750 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d80052e0 con 0x7f56f40fc0e0 2023-12-07T16:20:55.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.013+0000 7f56ea7fc700 1 -- 172.21.15.63:0/4169819750 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 24) v1 ==== 45729+0+0 (secure 0 0 0) 0x7f56f000cb30 con 0x7f56f40fc0e0 2023-12-07T16:20:55.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.014+0000 7f56ea7fc700 1 --2- 172.21.15.63:0/4169819750 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f56e00387b0 0x7f56e003ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:55.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.014+0000 7f56ea7fc700 1 -- 172.21.15.63:0/4169819750 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f56f004bcd0 con 0x7f56f40fc0e0 2023-12-07T16:20:55.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.014+0000 7f56f97ed700 1 --2- 172.21.15.63:0/4169819750 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f56e00387b0 0x7f56e003ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:55.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.015+0000 7f56f97ed700 1 --2- 172.21.15.63:0/4169819750 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f56e00387b0 0x7f56e003ac60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f56e4009fd0 tx=0x7f56e4009e30 comp rx=0 tx=0).ready entity=mgr.14614 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:55.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.019+0000 7f56ea7fc700 1 -- 172.21.15.63:0/4169819750 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f56f0051020 con 0x7f56f40fc0e0 2023-12-07T16:20:55.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:54 smithi152 ceph-mon[121113]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:20:55.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:54 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/618791695' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:20:55.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:54 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/2689715966' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:20:55.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.251+0000 7f56fc252700 1 -- 172.21.15.63:0/4169819750 --> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f56d8000bf0 con 0x7f56e00387b0 2023-12-07T16:20:55.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.262+0000 7f56ea7fc700 1 -- 172.21.15.63:0/4169819750 <== mgr.14614 v2:172.21.15.152:6828/1927275654 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f56d8000bf0 con 0x7f56e00387b0 2023-12-07T16:20:55.261 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:20:55.261 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-07T16:20:55.261 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-07T16:20:55.261 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-07T16:20:55.261 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [], 2023-12-07T16:20:55.261 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "1/21 daemons upgraded", 2023-12-07T16:20:55.261 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "", 2023-12-07T16:20:55.261 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-07T16:20:55.261 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:20:55.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.264+0000 7f56fc252700 1 -- 172.21.15.63:0/4169819750 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f56e00387b0 msgr2=0x7f56e003ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:55.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.264+0000 7f56fc252700 1 --2- 172.21.15.63:0/4169819750 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f56e00387b0 0x7f56e003ac60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f56e4009fd0 tx=0x7f56e4009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:55.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.264+0000 7f56fc252700 1 -- 172.21.15.63:0/4169819750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56f40fc0e0 msgr2=0x7f56f410f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:55.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.264+0000 7f56fc252700 1 --2- 172.21.15.63:0/4169819750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56f40fc0e0 0x7f56f410f710 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f56f000eb70 tx=0x7f56f000b040 comp rx=0 tx=0).stop 2023-12-07T16:20:55.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.264+0000 7f56fc252700 1 -- 172.21.15.63:0/4169819750 shutdown_connections 2023-12-07T16:20:55.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.264+0000 7f56fc252700 1 --2- 172.21.15.63:0/4169819750 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f56e00387b0 0x7f56e003ac60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:55.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.264+0000 7f56fc252700 1 --2- 172.21.15.63:0/4169819750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56f40fc0e0 0x7f56f410f710 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:55.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.264+0000 7f56fc252700 1 --2- 172.21.15.63:0/4169819750 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56f40fcac0 0x7f56f410fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:55.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.264+0000 7f56fc252700 1 -- 172.21.15.63:0/4169819750 >> 172.21.15.63:0/4169819750 conn(0x7f56f40f6950 msgr2=0x7f56f40fad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:55.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.265+0000 7f56fc252700 1 -- 172.21.15.63:0/4169819750 shutdown_connections 2023-12-07T16:20:55.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.265+0000 7f56fc252700 1 -- 172.21.15.63:0/4169819750 wait complete. 2023-12-07T16:20:55.376 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:54 smithi063 ceph-mon[112095]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:20:55.376 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:54 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/618791695' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:20:55.376 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:54 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2689715966' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:20:55.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.390+0000 7f0a8bf24700 1 -- 172.21.15.63:0/4077500987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a84066920 msgr2=0x7f0a84101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:55.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.390+0000 7f0a8bf24700 1 --2- 172.21.15.63:0/4077500987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a84066920 0x7f0a84101ba0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0a80004940 tx=0x7f0a80009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:55.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.391+0000 7f0a8bf24700 1 -- 172.21.15.63:0/4077500987 shutdown_connections 2023-12-07T16:20:55.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.391+0000 7f0a8bf24700 1 --2- 172.21.15.63:0/4077500987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a841020e0 0x7f0a841044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:55.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.391+0000 7f0a8bf24700 1 --2- 172.21.15.63:0/4077500987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a84066920 0x7f0a84101ba0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:55.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.391+0000 7f0a8bf24700 1 -- 172.21.15.63:0/4077500987 >> 172.21.15.63:0/4077500987 conn(0x7f0a840f71b0 msgr2=0x7f0a840f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:55.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.391+0000 7f0a8bf24700 1 -- 172.21.15.63:0/4077500987 shutdown_connections 2023-12-07T16:20:55.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.391+0000 7f0a8bf24700 1 -- 172.21.15.63:0/4077500987 wait complete. 2023-12-07T16:20:55.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.391+0000 7f0a8bf24700 1 Processor -- start 2023-12-07T16:20:55.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.392+0000 7f0a8bf24700 1 -- start start 2023-12-07T16:20:55.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.392+0000 7f0a8bf24700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a84066920 0x7f0a8410f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:55.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.392+0000 7f0a8bf24700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a841020e0 0x7f0a8410fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:55.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.392+0000 7f0a8bf24700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a84110220 con 0x7f0a84066920 2023-12-07T16:20:55.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.392+0000 7f0a8bf24700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a84110ac0 con 0x7f0a841020e0 2023-12-07T16:20:55.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.392+0000 7f0a89cc0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a84066920 0x7f0a8410f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:55.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.392+0000 7f0a894bf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a841020e0 0x7f0a8410fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:55.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.392+0000 7f0a89cc0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a84066920 0x7f0a8410f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59058/0 (socket says 172.21.15.63:59058) 2023-12-07T16:20:55.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.392+0000 7f0a89cc0700 1 -- 172.21.15.63:0/3792209218 learned_addr learned my addr 172.21.15.63:0/3792209218 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:20:55.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.392+0000 7f0a894bf700 1 -- 172.21.15.63:0/3792209218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a84066920 msgr2=0x7f0a8410f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:55.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.392+0000 7f0a894bf700 1 --2- 172.21.15.63:0/3792209218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a84066920 0x7f0a8410f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:55.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.392+0000 7f0a894bf700 1 -- 172.21.15.63:0/3792209218 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a80005040 con 0x7f0a841020e0 2023-12-07T16:20:55.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.392+0000 7f0a89cc0700 1 --2- 172.21.15.63:0/3792209218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a84066920 0x7f0a8410f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T16:20:55.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.393+0000 7f0a894bf700 1 --2- 172.21.15.63:0/3792209218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a841020e0 0x7f0a8410fc20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0a84066660 tx=0x7f0a7400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:55.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.393+0000 7f0a7a7fc700 1 -- 172.21.15.63:0/3792209218 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a74004e90 con 0x7f0a841020e0 2023-12-07T16:20:55.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.393+0000 7f0a7a7fc700 1 -- 172.21.15.63:0/3792209218 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0a7400f040 con 0x7f0a841020e0 2023-12-07T16:20:55.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.393+0000 7f0a8bf24700 1 -- 172.21.15.63:0/3792209218 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a84110d40 con 0x7f0a841020e0 2023-12-07T16:20:55.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.393+0000 7f0a7a7fc700 1 -- 172.21.15.63:0/3792209218 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a7400c980 con 0x7f0a841020e0 2023-12-07T16:20:55.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.393+0000 7f0a8bf24700 1 -- 172.21.15.63:0/3792209218 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a84111280 con 0x7f0a841020e0 2023-12-07T16:20:55.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.394+0000 7f0a7a7fc700 1 -- 172.21.15.63:0/3792209218 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 24) v1 ==== 45729+0+0 (secure 0 0 0) 0x7f0a740090d0 con 0x7f0a841020e0 2023-12-07T16:20:55.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.394+0000 7f0a7a7fc700 1 --2- 172.21.15.63:0/3792209218 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f0a70038760 0x7f0a7003ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:20:55.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.394+0000 7f0a7a7fc700 1 -- 172.21.15.63:0/3792209218 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f0a7404bc10 con 0x7f0a841020e0 2023-12-07T16:20:55.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.394+0000 7f0a8bf24700 1 -- 172.21.15.63:0/3792209218 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a8404bb80 con 0x7f0a841020e0 2023-12-07T16:20:55.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.394+0000 7f0a89cc0700 1 --2- 172.21.15.63:0/3792209218 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f0a70038760 0x7f0a7003ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:20:55.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.395+0000 7f0a89cc0700 1 --2- 172.21.15.63:0/3792209218 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f0a70038760 0x7f0a7003ac10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0a800135e0 tx=0x7f0a80009e30 comp rx=0 tx=0).ready entity=mgr.14614 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:20:55.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.399+0000 7f0a7a7fc700 1 -- 172.21.15.63:0/3792209218 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0a74009420 con 0x7f0a841020e0 2023-12-07T16:20:55.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.817+0000 7f0a8bf24700 1 -- 172.21.15.63:0/3792209218 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0a84111600 con 0x7f0a841020e0 2023-12-07T16:20:55.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.818+0000 7f0a7a7fc700 1 -- 172.21.15.63:0/3792209218 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f0a74019030 con 0x7f0a841020e0 2023-12-07T16:20:55.816 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-07T16:20:55.817 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-07T16:20:55.817 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-07T16:20:55.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.820+0000 7f0a8bf24700 1 -- 172.21.15.63:0/3792209218 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f0a70038760 msgr2=0x7f0a7003ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:55.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.820+0000 7f0a8bf24700 1 --2- 172.21.15.63:0/3792209218 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f0a70038760 0x7f0a7003ac10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0a800135e0 tx=0x7f0a80009e30 comp rx=0 tx=0).stop 2023-12-07T16:20:55.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.820+0000 7f0a8bf24700 1 -- 172.21.15.63:0/3792209218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a841020e0 msgr2=0x7f0a8410fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:20:55.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.820+0000 7f0a8bf24700 1 --2- 172.21.15.63:0/3792209218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a841020e0 0x7f0a8410fc20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0a84066660 tx=0x7f0a7400b040 comp rx=0 tx=0).stop 2023-12-07T16:20:55.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.821+0000 7f0a8bf24700 1 -- 172.21.15.63:0/3792209218 shutdown_connections 2023-12-07T16:20:55.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.821+0000 7f0a8bf24700 1 --2- 172.21.15.63:0/3792209218 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f0a70038760 0x7f0a7003ac10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:55.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.821+0000 7f0a8bf24700 1 --2- 172.21.15.63:0/3792209218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a84066920 0x7f0a8410f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:55.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.821+0000 7f0a8bf24700 1 --2- 172.21.15.63:0/3792209218 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a841020e0 0x7f0a8410fc20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:20:55.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.821+0000 7f0a8bf24700 1 -- 172.21.15.63:0/3792209218 >> 172.21.15.63:0/3792209218 conn(0x7f0a840f71b0 msgr2=0x7f0a840f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:20:55.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.821+0000 7f0a8bf24700 1 -- 172.21.15.63:0/3792209218 shutdown_connections 2023-12-07T16:20:55.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:20:55.821+0000 7f0a8bf24700 1 -- 172.21.15.63:0/3792209218 wait complete. 2023-12-07T16:20:56.291 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:55 smithi063 ceph-mon[112095]: pgmap v5: 65 pgs: 65 active+clean; 6.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:56.291 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:55 smithi063 ceph-mon[112095]: mgrmap e24: smithi152.sxayfb(active, since 4s) 2023-12-07T16:20:56.291 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:55 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/3792209218' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:20:56.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:55 smithi152 ceph-mon[121113]: pgmap v5: 65 pgs: 65 active+clean; 6.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:56.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:55 smithi152 ceph-mon[121113]: mgrmap e24: smithi152.sxayfb(active, since 4s) 2023-12-07T16:20:56.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:55 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/3792209218' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:20:56.998 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:57 smithi063 ceph-mon[112095]: from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:20:56.998 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:57 smithi063 ceph-mon[112095]: Standby manager daemon smithi063.yohyyx started 2023-12-07T16:20:56.998 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:57 smithi063 ceph-mon[112095]: from='mgr.? 172.21.15.63:0/1996574547' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi063.yohyyx/crt"}]: dispatch 2023-12-07T16:20:56.998 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:57 smithi063 ceph-mon[112095]: from='mgr.? 172.21.15.63:0/1996574547' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-07T16:20:56.999 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:57 smithi063 ceph-mon[112095]: from='mgr.? 172.21.15.63:0/1996574547' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi063.yohyyx/key"}]: dispatch 2023-12-07T16:20:56.999 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:57 smithi063 ceph-mon[112095]: from='mgr.? 172.21.15.63:0/1996574547' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-07T16:20:57.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:57 smithi152 ceph-mon[121113]: from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:20:57.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:57 smithi152 ceph-mon[121113]: Standby manager daemon smithi063.yohyyx started 2023-12-07T16:20:57.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:57 smithi152 ceph-mon[121113]: from='mgr.? 172.21.15.63:0/1996574547' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi063.yohyyx/crt"}]: dispatch 2023-12-07T16:20:57.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:57 smithi152 ceph-mon[121113]: from='mgr.? 172.21.15.63:0/1996574547' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-07T16:20:57.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:57 smithi152 ceph-mon[121113]: from='mgr.? 172.21.15.63:0/1996574547' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi063.yohyyx/key"}]: dispatch 2023-12-07T16:20:57.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:57 smithi152 ceph-mon[121113]: from='mgr.? 172.21.15.63:0/1996574547' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-07T16:20:58.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:58 smithi063 ceph-mon[112095]: pgmap v6: 65 pgs: 65 active+clean; 6.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:58.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:58 smithi063 ceph-mon[112095]: mgrmap e25: smithi152.sxayfb(active, since 6s), standbys: smithi063.yohyyx 2023-12-07T16:20:58.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:20:58 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mgr metadata", "who": "smithi063.yohyyx", "id": "smithi063.yohyyx"}]: dispatch 2023-12-07T16:20:58.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:58 smithi152 ceph-mon[121113]: pgmap v6: 65 pgs: 65 active+clean; 6.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:20:58.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:58 smithi152 ceph-mon[121113]: mgrmap e25: smithi152.sxayfb(active, since 6s), standbys: smithi063.yohyyx 2023-12-07T16:20:58.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:20:58 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mgr metadata", "who": "smithi063.yohyyx", "id": "smithi063.yohyyx"}]: dispatch 2023-12-07T16:21:00.001 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:00 smithi063 ceph-mon[112095]: pgmap v7: 65 pgs: 65 active+clean; 50 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 6.7 MiB/s wr, 660 op/s 2023-12-07T16:21:00.001 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:00 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:00.002 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:00 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:00.002 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:00 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:00.002 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:00 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:00.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:00 smithi152 ceph-mon[121113]: pgmap v7: 65 pgs: 65 active+clean; 50 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 6.7 MiB/s wr, 660 op/s 2023-12-07T16:21:00.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:00 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:00.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:00 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:00.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:00 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:00.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:00 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:01.368 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:01 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:01.368 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:01 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:01.368 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:01 smithi152 ceph-mon[121113]: pgmap v8: 65 pgs: 65 active+clean; 50 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 5.2 MiB/s wr, 512 op/s 2023-12-07T16:21:01.368 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:01 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:01.368 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:01 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:01.368 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:01 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:21:01.368 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:01 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:21:01.368 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:01 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:21:01.368 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:01 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:21:01.368 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:01 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:21:01.368 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:01 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:21:01.369 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:01 smithi152 ceph-mon[121113]: Adjusting osd_memory_target on smithi063 to 1568M 2023-12-07T16:21:01.369 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:01 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:01.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:01 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:01.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:01 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:01.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:01 smithi063 ceph-mon[112095]: pgmap v8: 65 pgs: 65 active+clean; 50 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 5.2 MiB/s wr, 512 op/s 2023-12-07T16:21:01.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:01 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:01.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:01 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:01.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:01 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:21:01.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:01 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:21:01.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:01 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:21:01.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:01 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:21:01.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:01 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:21:01.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:01 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:21:01.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:01 smithi063 ceph-mon[112095]: Adjusting osd_memory_target on smithi063 to 1568M 2023-12-07T16:21:01.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:01 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:03.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:03 smithi063 ceph-mon[112095]: pgmap v9: 65 pgs: 65 active+clean; 76 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 6.6 MiB/s wr, 536 op/s 2023-12-07T16:21:03.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:03 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:03.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:03 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:03.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:03 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:21:03.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:03 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:21:03.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:03 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:21:03.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:03 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:21:03.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:03 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:21:03.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:03 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:21:03.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:03 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:03.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:03 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:21:03.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:03 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:21:03.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:03 smithi152 ceph-mon[121113]: pgmap v9: 65 pgs: 65 active+clean; 76 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 6.6 MiB/s wr, 536 op/s 2023-12-07T16:21:03.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:03 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:03.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:03 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:03.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:03 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:21:03.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:03 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:21:03.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:03 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:21:03.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:03 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:21:03.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:03 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:21:03.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:03 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-07T16:21:03.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:03 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:03.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:03 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:21:03.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:03 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:21:04.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:04 smithi063 ceph-mon[112095]: Adjusting osd_memory_target on smithi152 to 2592M 2023-12-07T16:21:04.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:04 smithi063 ceph-mon[112095]: Updating smithi063:/etc/ceph/ceph.conf 2023-12-07T16:21:04.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:04 smithi063 ceph-mon[112095]: Updating smithi152:/etc/ceph/ceph.conf 2023-12-07T16:21:04.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:04 smithi063 ceph-mon[112095]: Updating smithi152:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-07T16:21:04.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:04 smithi063 ceph-mon[112095]: Updating smithi063:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-07T16:21:04.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:04 smithi063 ceph-mon[112095]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2023-12-07T16:21:04.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:04 smithi063 ceph-mon[112095]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2023-12-07T16:21:04.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:04 smithi063 ceph-mon[112095]: Updating smithi063:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-07T16:21:04.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:04 smithi063 ceph-mon[112095]: Updating smithi152:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-07T16:21:04.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:04 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:04.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:04 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:04.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:04 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:04.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:04 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:04.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:04 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:04.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:04 smithi152 ceph-mon[121113]: Adjusting osd_memory_target on smithi152 to 2592M 2023-12-07T16:21:04.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:04 smithi152 ceph-mon[121113]: Updating smithi063:/etc/ceph/ceph.conf 2023-12-07T16:21:04.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:04 smithi152 ceph-mon[121113]: Updating smithi152:/etc/ceph/ceph.conf 2023-12-07T16:21:04.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:04 smithi152 ceph-mon[121113]: Updating smithi152:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-07T16:21:04.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:04 smithi152 ceph-mon[121113]: Updating smithi063:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-07T16:21:04.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:04 smithi152 ceph-mon[121113]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2023-12-07T16:21:04.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:04 smithi152 ceph-mon[121113]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2023-12-07T16:21:04.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:04 smithi152 ceph-mon[121113]: Updating smithi063:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-07T16:21:04.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:04 smithi152 ceph-mon[121113]: Updating smithi152:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-07T16:21:04.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:04 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:04.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:04 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:04.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:04 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:04.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:04 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:04.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:04 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:05.598 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:05 smithi063 ceph-mon[112095]: fsmap cephfs:2 {0=cephfs.smithi063.yidolg=up:active,1=cephfs.smithi152.mrvngf=up:active} 2 up:standby 2023-12-07T16:21:05.598 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:05 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:05.598 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:05 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:05.598 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:05 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:05.598 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:05 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:05.598 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:05 smithi063 ceph-mon[112095]: Reconfiguring node-exporter.smithi063 (dependencies changed)... 2023-12-07T16:21:05.598 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:05 smithi063 ceph-mon[112095]: Reconfiguring daemon node-exporter.smithi063 on smithi063 2023-12-07T16:21:05.599 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:05 smithi063 ceph-mon[112095]: pgmap v10: 65 pgs: 65 active+clean; 76 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 488 op/s 2023-12-07T16:21:05.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:05 smithi152 ceph-mon[121113]: fsmap cephfs:2 {0=cephfs.smithi063.yidolg=up:active,1=cephfs.smithi152.mrvngf=up:active} 2 up:standby 2023-12-07T16:21:05.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:05 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:05.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:05 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:05.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:05 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:05.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:05 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:05.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:05 smithi152 ceph-mon[121113]: Reconfiguring node-exporter.smithi063 (dependencies changed)... 2023-12-07T16:21:05.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:05 smithi152 ceph-mon[121113]: Reconfiguring daemon node-exporter.smithi063 on smithi063 2023-12-07T16:21:05.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:05 smithi152 ceph-mon[121113]: pgmap v10: 65 pgs: 65 active+clean; 76 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 488 op/s 2023-12-07T16:21:07.142 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:06 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:07.142 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:06 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:07.142 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:06 smithi063 ceph-mon[112095]: Reconfiguring alertmanager.smithi063 (dependencies changed)... 2023-12-07T16:21:07.142 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:06 smithi063 ceph-mon[112095]: Reconfiguring daemon alertmanager.smithi063 on smithi063 2023-12-07T16:21:07.142 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:06 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:21:07.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:06 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:07.197 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:06 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:07.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:06 smithi152 ceph-mon[121113]: Reconfiguring alertmanager.smithi063 (dependencies changed)... 2023-12-07T16:21:07.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:06 smithi152 ceph-mon[121113]: Reconfiguring daemon alertmanager.smithi063 on smithi063 2023-12-07T16:21:07.198 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:06 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:21:08.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:07 smithi063 ceph-mon[112095]: pgmap v11: 65 pgs: 65 active+clean; 76 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 488 op/s 2023-12-07T16:21:08.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:07 smithi152 ceph-mon[121113]: pgmap v11: 65 pgs: 65 active+clean; 76 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 488 op/s 2023-12-07T16:21:10.274 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:10 smithi063 ceph-mon[112095]: pgmap v12: 65 pgs: 65 active+clean; 90 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 7.2 MiB/s wr, 494 op/s 2023-12-07T16:21:10.275 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:10 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:10.275 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:10 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:10.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:10 smithi152 ceph-mon[121113]: pgmap v12: 65 pgs: 65 active+clean; 90 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 7.2 MiB/s wr, 494 op/s 2023-12-07T16:21:10.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:10 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:10.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:10 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:11.202 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:11 smithi063 ceph-mon[112095]: Reconfiguring grafana.smithi063 (dependencies changed)... 2023-12-07T16:21:11.202 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:11 smithi063 ceph-mon[112095]: Reconfiguring daemon grafana.smithi063 on smithi063 2023-12-07T16:21:11.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:11 smithi152 ceph-mon[121113]: Reconfiguring grafana.smithi063 (dependencies changed)... 2023-12-07T16:21:11.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:11 smithi152 ceph-mon[121113]: Reconfiguring daemon grafana.smithi063 on smithi063 2023-12-07T16:21:12.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:12 smithi063 ceph-mon[112095]: pgmap v13: 65 pgs: 65 active+clean; 90 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.4 MiB/s wr, 113 op/s 2023-12-07T16:21:12.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:12 smithi152 ceph-mon[121113]: pgmap v13: 65 pgs: 65 active+clean; 90 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.4 MiB/s wr, 113 op/s 2023-12-07T16:21:13.849 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:13 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:13.850 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:13 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:13.850 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:13 smithi063 ceph-mon[112095]: Reconfiguring prometheus.smithi063 (dependencies changed)... 2023-12-07T16:21:13.850 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:13 smithi063 ceph-mon[112095]: pgmap v14: 65 pgs: 65 active+clean; 126 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 6.6 MiB/s wr, 518 op/s 2023-12-07T16:21:13.850 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:13 smithi063 ceph-mon[112095]: Reconfiguring daemon prometheus.smithi063 on smithi063 2023-12-07T16:21:13.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:13 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:13.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:13 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:13.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:13 smithi152 ceph-mon[121113]: Reconfiguring prometheus.smithi063 (dependencies changed)... 2023-12-07T16:21:13.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:13 smithi152 ceph-mon[121113]: pgmap v14: 65 pgs: 65 active+clean; 126 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 6.6 MiB/s wr, 518 op/s 2023-12-07T16:21:13.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:13 smithi152 ceph-mon[121113]: Reconfiguring daemon prometheus.smithi063 on smithi063 2023-12-07T16:21:15.355 INFO:tasks.workunit.client.0.smithi063.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-07T16:21:15.356 INFO:tasks.workunit.client.0.smithi063.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-07T16:21:15.356 INFO:tasks.workunit.client.0.smithi063.stderr:+ make 2023-12-07T16:21:15.372 INFO:tasks.workunit.client.0.smithi063.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-07T16:21:15.642 INFO:tasks.workunit.client.0.smithi063.stderr:++ readlink -f fsstress 2023-12-07T16:21:15.643 INFO:tasks.workunit.client.0.smithi063.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-07T16:21:15.643 INFO:tasks.workunit.client.0.smithi063.stderr:+ popd 2023-12-07T16:21:15.644 INFO:tasks.workunit.client.0.smithi063.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-07T16:21:15.644 INFO:tasks.workunit.client.0.smithi063.stderr:+ popd 2023-12-07T16:21:15.644 INFO:tasks.workunit.client.0.smithi063.stdout:~/cephtest/mnt.0/client.0/tmp 2023-12-07T16:21:15.644 INFO:tasks.workunit.client.0.smithi063.stderr:++ mktemp -d -p . 2023-12-07T16:21:15.646 INFO:tasks.workunit.client.0.smithi063.stderr:+ T=./tmp.8at1iWBuHS 2023-12-07T16:21:15.646 INFO:tasks.workunit.client.0.smithi063.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.8at1iWBuHS -l 1 -n 1000 -p 10 -v 2023-12-07T16:21:15.647 INFO:tasks.workunit.client.0.smithi063.stdout:seed = 1702371183 2023-12-07T16:21:15.649 INFO:tasks.workunit.client.0.smithi063.stdout:0/0: getdents . 0 2023-12-07T16:21:15.649 INFO:tasks.workunit.client.0.smithi063.stdout:0/1: dread - no filename 2023-12-07T16:21:15.649 INFO:tasks.workunit.client.0.smithi063.stdout:0/2: fsync - no filename 2023-12-07T16:21:15.650 INFO:tasks.workunit.client.0.smithi063.stdout:0/3: readlink - no filename 2023-12-07T16:21:15.650 INFO:tasks.workunit.client.0.smithi063.stdout:0/4: chown . 610808 1 2023-12-07T16:21:15.650 INFO:tasks.workunit.client.0.smithi063.stdout:0/5: chown . 239778 1 2023-12-07T16:21:15.650 INFO:tasks.workunit.client.0.smithi063.stdout:0/6: write - no filename 2023-12-07T16:21:15.650 INFO:tasks.workunit.client.0.smithi063.stdout:0/7: dread - no filename 2023-12-07T16:21:15.650 INFO:tasks.workunit.client.0.smithi063.stdout:1/0: truncate - no filename 2023-12-07T16:21:15.650 INFO:tasks.workunit.client.0.smithi063.stdout:1/1: rename - no filename 2023-12-07T16:21:15.650 INFO:tasks.workunit.client.0.smithi063.stdout:1/2: link - no file 2023-12-07T16:21:15.650 INFO:tasks.workunit.client.0.smithi063.stdout:1/3: stat - no entries 2023-12-07T16:21:15.650 INFO:tasks.workunit.client.0.smithi063.stdout:1/4: stat - no entries 2023-12-07T16:21:15.651 INFO:tasks.workunit.client.0.smithi063.stdout:1/5: truncate - no filename 2023-12-07T16:21:15.651 INFO:tasks.workunit.client.0.smithi063.stdout:1/6: getdents . 0 2023-12-07T16:21:15.651 INFO:tasks.workunit.client.0.smithi063.stdout:1/7: write - no filename 2023-12-07T16:21:15.651 INFO:tasks.workunit.client.0.smithi063.stdout:1/8: write - no filename 2023-12-07T16:21:15.651 INFO:tasks.workunit.client.0.smithi063.stdout:1/9: truncate - no filename 2023-12-07T16:21:15.651 INFO:tasks.workunit.client.0.smithi063.stdout:0/8: mknod c0 0 2023-12-07T16:21:15.651 INFO:tasks.workunit.client.0.smithi063.stdout:0/9: stat c0 0 2023-12-07T16:21:15.651 INFO:tasks.workunit.client.0.smithi063.stdout:2/0: dwrite - no filename 2023-12-07T16:21:15.652 INFO:tasks.workunit.client.0.smithi063.stdout:2/1: rename - no filename 2023-12-07T16:21:15.652 INFO:tasks.workunit.client.0.smithi063.stdout:2/2: chown . 3334 1 2023-12-07T16:21:15.652 INFO:tasks.workunit.client.0.smithi063.stdout:2/3: read - no filename 2023-12-07T16:21:15.652 INFO:tasks.workunit.client.0.smithi063.stdout:2/4: fsync - no filename 2023-12-07T16:21:15.652 INFO:tasks.workunit.client.0.smithi063.stdout:1/10: mkdir d0 0 2023-12-07T16:21:15.652 INFO:tasks.workunit.client.0.smithi063.stdout:1/11: dwrite - no filename 2023-12-07T16:21:15.652 INFO:tasks.workunit.client.0.smithi063.stdout:1/12: dwrite - no filename 2023-12-07T16:21:15.652 INFO:tasks.workunit.client.0.smithi063.stdout:1/13: link - no file 2023-12-07T16:21:15.652 INFO:tasks.workunit.client.0.smithi063.stdout:1/14: write - no filename 2023-12-07T16:21:15.653 INFO:tasks.workunit.client.0.smithi063.stdout:3/0: stat - no entries 2023-12-07T16:21:15.653 INFO:tasks.workunit.client.0.smithi063.stdout:3/1: write - no filename 2023-12-07T16:21:15.653 INFO:tasks.workunit.client.0.smithi063.stdout:3/2: readlink - no filename 2023-12-07T16:21:15.653 INFO:tasks.workunit.client.0.smithi063.stdout:2/5: mkdir d0 0 2023-12-07T16:21:15.653 INFO:tasks.workunit.client.0.smithi063.stdout:2/6: rename d0 to d0/d1 22 2023-12-07T16:21:15.653 INFO:tasks.workunit.client.0.smithi063.stdout:2/7: write - no filename 2023-12-07T16:21:15.653 INFO:tasks.workunit.client.0.smithi063.stdout:2/8: read - no filename 2023-12-07T16:21:15.653 INFO:tasks.workunit.client.0.smithi063.stdout:2/9: write - no filename 2023-12-07T16:21:15.653 INFO:tasks.workunit.client.0.smithi063.stdout:2/10: fdatasync - no filename 2023-12-07T16:21:15.653 INFO:tasks.workunit.client.0.smithi063.stdout:2/11: truncate - no filename 2023-12-07T16:21:15.653 INFO:tasks.workunit.client.0.smithi063.stdout:2/12: write - no filename 2023-12-07T16:21:15.654 INFO:tasks.workunit.client.0.smithi063.stdout:1/15: creat d0/f1 x:0 0 0 2023-12-07T16:21:15.655 INFO:tasks.workunit.client.0.smithi063.stdout:4/0: getdents . 0 2023-12-07T16:21:15.655 INFO:tasks.workunit.client.0.smithi063.stdout:4/1: write - no filename 2023-12-07T16:21:15.655 INFO:tasks.workunit.client.0.smithi063.stdout:4/2: dread - no filename 2023-12-07T16:21:15.656 INFO:tasks.workunit.client.0.smithi063.stdout:3/3: symlink l0 0 2023-12-07T16:21:15.656 INFO:tasks.workunit.client.0.smithi063.stdout:2/13: symlink d0/l2 0 2023-12-07T16:21:15.658 INFO:tasks.workunit.client.0.smithi063.stdout:1/16: mknod d0/c2 0 2023-12-07T16:21:15.658 INFO:tasks.workunit.client.0.smithi063.stdout:1/17: chown d0/f1 340 1 2023-12-07T16:21:15.658 INFO:tasks.workunit.client.0.smithi063.stdout:1/18: dread - d0/f1 zero size 2023-12-07T16:21:15.658 INFO:tasks.workunit.client.0.smithi063.stdout:0/10: getdents . 0 2023-12-07T16:21:15.684 INFO:tasks.workunit.client.0.smithi063.stdout:0/11: rename c0 to c1 0 2023-12-07T16:21:15.684 INFO:tasks.workunit.client.0.smithi063.stdout:1/19: creat d0/f3 x:0 0 0 2023-12-07T16:21:15.684 INFO:tasks.workunit.client.0.smithi063.stdout:0/12: write - no filename 2023-12-07T16:21:15.684 INFO:tasks.workunit.client.0.smithi063.stdout:6/0: link - no file 2023-12-07T16:21:15.690 INFO:tasks.workunit.client.0.smithi063.stdout:2/14: symlink d0/l3 0 2023-12-07T16:21:15.692 INFO:tasks.workunit.client.0.smithi063.stdout:3/4: mknod c1 0 2023-12-07T16:21:15.692 INFO:tasks.workunit.client.0.smithi063.stdout:3/5: write - no filename 2023-12-07T16:21:15.692 INFO:tasks.workunit.client.0.smithi063.stdout:5/0: creat f0 x:0 0 0 2023-12-07T16:21:15.692 INFO:tasks.workunit.client.0.smithi063.stdout:5/1: dread - f0 zero size 2023-12-07T16:21:15.703 INFO:tasks.workunit.client.0.smithi063.stdout:2/15: mknod d0/c4 0 2023-12-07T16:21:15.703 INFO:tasks.workunit.client.0.smithi063.stdout:2/16: fdatasync - no filename 2023-12-07T16:21:15.703 INFO:tasks.workunit.client.0.smithi063.stdout:1/20: creat d0/f4 x:0 0 0 2023-12-07T16:21:15.703 INFO:tasks.workunit.client.0.smithi063.stdout:1/21: rename d0 to d0/d5 22 2023-12-07T16:21:15.703 INFO:tasks.workunit.client.0.smithi063.stdout:6/1: mkdir d0 0 2023-12-07T16:21:15.703 INFO:tasks.workunit.client.0.smithi063.stdout:7/0: write - no filename 2023-12-07T16:21:15.703 INFO:tasks.workunit.client.0.smithi063.stdout:7/1: unlink - no file 2023-12-07T16:21:15.703 INFO:tasks.workunit.client.0.smithi063.stdout:0/13: creat f2 x:0 0 0 2023-12-07T16:21:15.703 INFO:tasks.workunit.client.0.smithi063.stdout:0/14: dread - f2 zero size 2023-12-07T16:21:15.703 INFO:tasks.workunit.client.0.smithi063.stdout:7/2: mknod c0 0 2023-12-07T16:21:15.703 INFO:tasks.workunit.client.0.smithi063.stdout:1/22: rename d0/c2 to d0/c6 0 2023-12-07T16:21:15.703 INFO:tasks.workunit.client.0.smithi063.stdout:6/2: symlink d0/l1 0 2023-12-07T16:21:15.704 INFO:tasks.workunit.client.0.smithi063.stdout:6/3: dread - no filename 2023-12-07T16:21:15.704 INFO:tasks.workunit.client.0.smithi063.stdout:6/4: write - no filename 2023-12-07T16:21:15.704 INFO:tasks.workunit.client.0.smithi063.stdout:6/5: chown d0/l1 12216 1 2023-12-07T16:21:15.704 INFO:tasks.workunit.client.0.smithi063.stdout:3/6: symlink l2 0 2023-12-07T16:21:15.704 INFO:tasks.workunit.client.0.smithi063.stdout:3/7: write - no filename 2023-12-07T16:21:15.704 INFO:tasks.workunit.client.0.smithi063.stdout:3/8: readlink l0 0 2023-12-07T16:21:15.704 INFO:tasks.workunit.client.0.smithi063.stdout:3/9: write - no filename 2023-12-07T16:21:15.704 INFO:tasks.workunit.client.0.smithi063.stdout:6/6: rename d0/l1 to d0/l2 0 2023-12-07T16:21:15.704 INFO:tasks.workunit.client.0.smithi063.stdout:6/7: truncate - no filename 2023-12-07T16:21:15.704 INFO:tasks.workunit.client.0.smithi063.stdout:7/3: creat f1 x:0 0 0 2023-12-07T16:21:15.705 INFO:tasks.workunit.client.0.smithi063.stdout:0/15: symlink l3 0 2023-12-07T16:21:15.705 INFO:tasks.workunit.client.0.smithi063.stdout:0/16: dread - f2 zero size 2023-12-07T16:21:15.707 INFO:tasks.workunit.client.0.smithi063.stdout:9/0: write - no filename 2023-12-07T16:21:15.709 INFO:tasks.workunit.client.0.smithi063.stdout:8/0: creat f0 x:0 0 0 2023-12-07T16:21:15.711 INFO:tasks.workunit.client.0.smithi063.stdout:7/4: mkdir d2 0 2023-12-07T16:21:15.711 INFO:tasks.workunit.client.0.smithi063.stdout:6/8: stat d0/l2 0 2023-12-07T16:21:15.711 INFO:tasks.workunit.client.0.smithi063.stdout:6/9: read - no filename 2023-12-07T16:21:15.711 INFO:tasks.workunit.client.0.smithi063.stdout:6/10: fdatasync - no filename 2023-12-07T16:21:15.711 INFO:tasks.workunit.client.0.smithi063.stdout:9/1: mkdir d0 0 2023-12-07T16:21:15.721 INFO:tasks.workunit.client.0.smithi063.stdout:7/5: link f1 d2/f3 0 2023-12-07T16:21:15.721 INFO:tasks.workunit.client.0.smithi063.stdout:7/6: write f1 [118088,87047] 0 2023-12-07T16:21:15.721 INFO:tasks.workunit.client.0.smithi063.stdout:0/17: mkdir d4 0 2023-12-07T16:21:15.721 INFO:tasks.workunit.client.0.smithi063.stdout:9/2: creat d0/f1 x:0 0 0 2023-12-07T16:21:15.724 INFO:tasks.workunit.client.0.smithi063.stdout:0/18: rename f2 to d4/f5 0 2023-12-07T16:21:15.724 INFO:tasks.workunit.client.0.smithi063.stdout:0/19: dread - d4/f5 zero size 2023-12-07T16:21:15.724 INFO:tasks.workunit.client.0.smithi063.stdout:0/20: dread - d4/f5 zero size 2023-12-07T16:21:15.727 INFO:tasks.workunit.client.0.smithi063.stdout:9/3: unlink d0/f1 0 2023-12-07T16:21:15.734 INFO:tasks.workunit.client.0.smithi063.stdout:9/4: creat d0/f2 x:0 0 0 2023-12-07T16:21:15.738 INFO:tasks.workunit.client.0.smithi063.stdout:9/5: creat d0/f3 x:0 0 0 2023-12-07T16:21:15.738 INFO:tasks.workunit.client.0.smithi063.stdout:9/6: rename d0 to d0/d4 22 2023-12-07T16:21:15.738 INFO:tasks.workunit.client.0.smithi063.stdout:9/7: chown d0/f2 13061792 1 2023-12-07T16:21:15.738 INFO:tasks.workunit.client.0.smithi063.stdout:9/8: write d0/f2 [847086,118550] 0 2023-12-07T16:21:15.738 INFO:tasks.workunit.client.0.smithi063.stdout:9/9: readlink - no filename 2023-12-07T16:21:16.225 INFO:tasks.workunit.client.0.smithi063.stdout:5/2: fsync f0 0 2023-12-07T16:21:16.236 INFO:tasks.workunit.client.0.smithi063.stdout:3/10: getdents . 0 2023-12-07T16:21:16.261 INFO:tasks.workunit.client.0.smithi063.stdout:0/21: getdents d4 0 2023-12-07T16:21:16.261 INFO:tasks.workunit.client.0.smithi063.stdout:0/22: dread - d4/f5 zero size 2023-12-07T16:21:16.261 INFO:tasks.workunit.client.0.smithi063.stdout:0/23: chown d4 12 1 2023-12-07T16:21:16.408 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:15 smithi063 ceph-mon[112095]: pgmap v15: 65 pgs: 65 active+clean; 126 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.5 MiB/s wr, 411 op/s 2023-12-07T16:21:16.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:15 smithi152 ceph-mon[121113]: pgmap v15: 65 pgs: 65 active+clean; 126 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.5 MiB/s wr, 411 op/s 2023-12-07T16:21:16.950 INFO:tasks.workunit.client.0.smithi063.stdout:5/3: stat f0 0 2023-12-07T16:21:16.955 INFO:tasks.workunit.client.0.smithi063.stdout:8/1: dwrite f0 [0,4194304] 0 2023-12-07T16:21:16.963 INFO:tasks.workunit.client.0.smithi063.stdout:8/2: dread f0 [0,4194304] 0 2023-12-07T16:21:16.964 INFO:tasks.workunit.client.0.smithi063.stdout:8/3: read f0 [4009641,129847] 0 2023-12-07T16:21:17.019 INFO:tasks.workunit.client.0.smithi063.stdout:9/10: dwrite d0/f3 [0,4194304] 0 2023-12-07T16:21:17.021 INFO:tasks.workunit.client.0.smithi063.stdout:9/11: write d0/f3 [1550159,126241] 0 2023-12-07T16:21:17.031 INFO:tasks.workunit.client.0.smithi063.stdout:7/7: dwrite d2/f3 [0,4194304] 0 2023-12-07T16:21:17.031 INFO:tasks.workunit.client.0.smithi063.stdout:7/8: rename d2 to d2/d4 22 2023-12-07T16:21:17.038 INFO:tasks.workunit.client.0.smithi063.stdout:9/12: dwrite d0/f2 [0,4194304] 0 2023-12-07T16:21:17.041 INFO:tasks.workunit.client.0.smithi063.stdout:9/13: write d0/f2 [910361,13399] 0 2023-12-07T16:21:17.060 INFO:tasks.workunit.client.0.smithi063.stdout:9/14: dwrite d0/f2 [0,4194304] 0 2023-12-07T16:21:17.060 INFO:tasks.workunit.client.0.smithi063.stdout:9/15: chown d0/f3 263288489 1 2023-12-07T16:21:18.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:17 smithi152 ceph-mon[121113]: pgmap v16: 65 pgs: 65 active+clean; 126 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.5 MiB/s wr, 411 op/s 2023-12-07T16:21:18.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:17 smithi063 ceph-mon[112095]: pgmap v16: 65 pgs: 65 active+clean; 126 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.5 MiB/s wr, 411 op/s 2023-12-07T16:21:20.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:19 smithi152 ceph-mon[121113]: pgmap v17: 65 pgs: 65 active+clean; 178 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 352 KiB/s rd, 9.0 MiB/s wr, 928 op/s 2023-12-07T16:21:20.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:19 smithi063 ceph-mon[112095]: pgmap v17: 65 pgs: 65 active+clean; 178 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 352 KiB/s rd, 9.0 MiB/s wr, 928 op/s 2023-12-07T16:21:20.550 INFO:tasks.workunit.client.0.smithi063.stdout:0/24: symlink d4/l6 0 2023-12-07T16:21:20.550 INFO:tasks.workunit.client.1.smithi152.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-07T16:21:20.551 INFO:tasks.workunit.client.1.smithi152.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-07T16:21:20.551 INFO:tasks.workunit.client.1.smithi152.stderr:+ make 2023-12-07T16:21:20.664 INFO:tasks.workunit.client.1.smithi152.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-07T16:21:21.703 INFO:tasks.workunit.client.0.smithi063.stdout:5/4: mkdir d1 0 2023-12-07T16:21:21.703 INFO:tasks.workunit.client.0.smithi063.stdout:5/5: chown d1 3 1 2023-12-07T16:21:21.707 INFO:tasks.workunit.client.0.smithi063.stdout:8/4: rename f0 to f1 0 2023-12-07T16:21:21.711 INFO:tasks.workunit.client.0.smithi063.stdout:7/9: creat d2/f5 x:0 0 0 2023-12-07T16:21:21.711 INFO:tasks.workunit.client.0.smithi063.stdout:9/16: symlink d0/l5 0 2023-12-07T16:21:21.714 INFO:tasks.workunit.client.0.smithi063.stdout:0/25: fsync d4/f5 0 2023-12-07T16:21:21.715 INFO:tasks.workunit.client.0.smithi063.stdout:0/26: read - d4/f5 zero size 2023-12-07T16:21:21.717 INFO:tasks.workunit.client.0.smithi063.stdout:5/6: rename f0 to d1/f2 0 2023-12-07T16:21:21.717 INFO:tasks.workunit.client.0.smithi063.stdout:5/7: read - d1/f2 zero size 2023-12-07T16:21:21.717 INFO:tasks.workunit.client.0.smithi063.stdout:5/8: dread - d1/f2 zero size 2023-12-07T16:21:21.718 INFO:tasks.workunit.client.0.smithi063.stdout:8/5: symlink l2 0 2023-12-07T16:21:21.718 INFO:tasks.workunit.client.0.smithi063.stdout:8/6: truncate f1 5071584 0 2023-12-07T16:21:21.720 INFO:tasks.workunit.client.0.smithi063.stdout:7/10: link d2/f3 d2/f6 0 2023-12-07T16:21:21.722 INFO:tasks.workunit.client.0.smithi063.stdout:8/7: creat f3 x:0 0 0 2023-12-07T16:21:21.723 INFO:tasks.workunit.client.0.smithi063.stdout:9/17: dread d0/f2 [0,4194304] 0 2023-12-07T16:21:21.723 INFO:tasks.workunit.client.0.smithi063.stdout:9/18: fdatasync d0/f3 0 2023-12-07T16:21:21.724 INFO:tasks.workunit.client.0.smithi063.stdout:7/11: creat d2/f7 x:0 0 0 2023-12-07T16:21:21.725 INFO:tasks.workunit.client.0.smithi063.stdout:0/27: rename d4/l6 to d4/l7 0 2023-12-07T16:21:21.726 INFO:tasks.workunit.client.0.smithi063.stdout:8/8: symlink l4 0 2023-12-07T16:21:21.729 INFO:tasks.workunit.client.0.smithi063.stdout:7/12: creat d2/f8 x:0 0 0 2023-12-07T16:21:21.731 INFO:tasks.workunit.client.0.smithi063.stdout:8/9: unlink l4 0 2023-12-07T16:21:21.732 INFO:tasks.workunit.client.0.smithi063.stdout:7/13: creat d2/f9 x:0 0 0 2023-12-07T16:21:21.732 INFO:tasks.workunit.client.0.smithi063.stdout:7/14: write d2/f9 [862536,127295] 0 2023-12-07T16:21:21.732 INFO:tasks.workunit.client.0.smithi063.stdout:7/15: chown c0 13981 1 2023-12-07T16:21:21.736 INFO:tasks.workunit.client.0.smithi063.stdout:8/10: dread f1 [0,4194304] 0 2023-12-07T16:21:21.738 INFO:tasks.workunit.client.0.smithi063.stdout:8/11: creat f5 x:0 0 0 2023-12-07T16:21:21.753 INFO:tasks.workunit.client.0.smithi063.stdout:7/16: dread d2/f6 [0,4194304] 0 2023-12-07T16:21:21.757 INFO:tasks.workunit.client.0.smithi063.stdout:8/12: dwrite f5 [0,4194304] 0 2023-12-07T16:21:21.759 INFO:tasks.workunit.client.0.smithi063.stdout:8/13: creat f6 x:0 0 0 2023-12-07T16:21:21.760 INFO:tasks.workunit.client.0.smithi063.stdout:8/14: fdatasync f3 0 2023-12-07T16:21:21.866 INFO:tasks.workunit.client.1.smithi152.stderr:++ readlink -f fsstress 2023-12-07T16:21:21.866 INFO:tasks.workunit.client.1.smithi152.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-07T16:21:21.867 INFO:tasks.workunit.client.1.smithi152.stderr:+ popd 2023-12-07T16:21:21.867 INFO:tasks.workunit.client.1.smithi152.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-07T16:21:21.867 INFO:tasks.workunit.client.1.smithi152.stdout:~/cephtest/mnt.1/client.1/tmp 2023-12-07T16:21:21.867 INFO:tasks.workunit.client.1.smithi152.stderr:+ popd 2023-12-07T16:21:21.868 INFO:tasks.workunit.client.1.smithi152.stderr:++ mktemp -d -p . 2023-12-07T16:21:21.868 INFO:tasks.workunit.client.1.smithi152.stderr:+ T=./tmp.SvNsZpREOA 2023-12-07T16:21:21.868 INFO:tasks.workunit.client.1.smithi152.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.SvNsZpREOA -l 1 -n 1000 -p 10 -v 2023-12-07T16:21:21.870 INFO:tasks.workunit.client.1.smithi152.stdout:seed = 1702667004 2023-12-07T16:21:21.873 INFO:tasks.workunit.client.1.smithi152.stdout:0/0: mkdir d0 0 2023-12-07T16:21:21.873 INFO:tasks.workunit.client.1.smithi152.stdout:0/1: fdatasync - no filename 2023-12-07T16:21:21.873 INFO:tasks.workunit.client.1.smithi152.stdout:0/2: link - no file 2023-12-07T16:21:21.874 INFO:tasks.workunit.client.1.smithi152.stdout:0/3: readlink - no filename 2023-12-07T16:21:21.874 INFO:tasks.workunit.client.1.smithi152.stdout:0/4: truncate - no filename 2023-12-07T16:21:21.874 INFO:tasks.workunit.client.1.smithi152.stdout:0/5: chown d0 3494 1 2023-12-07T16:21:21.874 INFO:tasks.workunit.client.1.smithi152.stdout:0/6: dwrite - no filename 2023-12-07T16:21:21.874 INFO:tasks.workunit.client.1.smithi152.stdout:0/7: dread - no filename 2023-12-07T16:21:21.874 INFO:tasks.workunit.client.1.smithi152.stdout:0/8: dread - no filename 2023-12-07T16:21:21.874 INFO:tasks.workunit.client.1.smithi152.stdout:0/9: chown d0 267951164 1 2023-12-07T16:21:21.874 INFO:tasks.workunit.client.1.smithi152.stdout:0/10: dread - no filename 2023-12-07T16:21:21.874 INFO:tasks.workunit.client.1.smithi152.stdout:0/11: chown d0 27 1 2023-12-07T16:21:21.874 INFO:tasks.workunit.client.1.smithi152.stdout:0/12: dwrite - no filename 2023-12-07T16:21:21.874 INFO:tasks.workunit.client.1.smithi152.stdout:0/13: dwrite - no filename 2023-12-07T16:21:21.874 INFO:tasks.workunit.client.1.smithi152.stdout:0/14: dwrite - no filename 2023-12-07T16:21:21.875 INFO:tasks.workunit.client.1.smithi152.stdout:0/15: truncate - no filename 2023-12-07T16:21:21.875 INFO:tasks.workunit.client.1.smithi152.stdout:0/16: write - no filename 2023-12-07T16:21:21.875 INFO:tasks.workunit.client.1.smithi152.stdout:0/17: dread - no filename 2023-12-07T16:21:21.875 INFO:tasks.workunit.client.1.smithi152.stdout:0/18: read - no filename 2023-12-07T16:21:21.875 INFO:tasks.workunit.client.1.smithi152.stdout:0/19: dwrite - no filename 2023-12-07T16:21:21.875 INFO:tasks.workunit.client.1.smithi152.stdout:0/20: truncate - no filename 2023-12-07T16:21:21.875 INFO:tasks.workunit.client.1.smithi152.stdout:0/21: truncate - no filename 2023-12-07T16:21:21.875 INFO:tasks.workunit.client.1.smithi152.stdout:0/22: readlink - no filename 2023-12-07T16:21:21.875 INFO:tasks.workunit.client.1.smithi152.stdout:0/23: unlink - no file 2023-12-07T16:21:21.875 INFO:tasks.workunit.client.1.smithi152.stdout:0/24: dwrite - no filename 2023-12-07T16:21:21.876 INFO:tasks.workunit.client.1.smithi152.stdout:2/0: link - no file 2023-12-07T16:21:21.876 INFO:tasks.workunit.client.1.smithi152.stdout:2/1: chown . 106 1 2023-12-07T16:21:21.876 INFO:tasks.workunit.client.1.smithi152.stdout:1/0: creat f0 x:0 0 0 2023-12-07T16:21:21.876 INFO:tasks.workunit.client.1.smithi152.stdout:1/1: stat f0 0 2023-12-07T16:21:21.877 INFO:tasks.workunit.client.1.smithi152.stdout:1/2: chown f0 83 1 2023-12-07T16:21:21.877 INFO:tasks.workunit.client.1.smithi152.stdout:0/25: creat d0/f1 x:0 0 0 2023-12-07T16:21:21.877 INFO:tasks.workunit.client.1.smithi152.stdout:3/0: getdents . 0 2023-12-07T16:21:21.877 INFO:tasks.workunit.client.1.smithi152.stdout:3/1: rmdir - no directory 2023-12-07T16:21:21.877 INFO:tasks.workunit.client.1.smithi152.stdout:3/2: readlink - no filename 2023-12-07T16:21:21.877 INFO:tasks.workunit.client.1.smithi152.stdout:3/3: chown . 471281178 1 2023-12-07T16:21:21.877 INFO:tasks.workunit.client.1.smithi152.stdout:3/4: dread - no filename 2023-12-07T16:21:21.877 INFO:tasks.workunit.client.1.smithi152.stdout:2/2: symlink l0 0 2023-12-07T16:21:21.878 INFO:tasks.workunit.client.1.smithi152.stdout:2/3: rmdir - no directory 2023-12-07T16:21:21.878 INFO:tasks.workunit.client.1.smithi152.stdout:1/3: mknod c1 0 2023-12-07T16:21:21.878 INFO:tasks.workunit.client.1.smithi152.stdout:0/26: symlink d0/l2 0 2023-12-07T16:21:21.878 INFO:tasks.workunit.client.1.smithi152.stdout:0/27: truncate d0/f1 689237 0 2023-12-07T16:21:21.879 INFO:tasks.workunit.client.1.smithi152.stdout:4/0: rename - no filename 2023-12-07T16:21:21.880 INFO:tasks.workunit.client.1.smithi152.stdout:2/4: creat f1 x:0 0 0 2023-12-07T16:21:21.880 INFO:tasks.workunit.client.1.smithi152.stdout:2/5: rmdir - no directory 2023-12-07T16:21:21.880 INFO:tasks.workunit.client.1.smithi152.stdout:2/6: chown f1 14977 1 2023-12-07T16:21:21.880 INFO:tasks.workunit.client.1.smithi152.stdout:2/7: dread - f1 zero size 2023-12-07T16:21:21.881 INFO:tasks.workunit.client.1.smithi152.stdout:1/4: unlink f0 0 2023-12-07T16:21:21.881 INFO:tasks.workunit.client.1.smithi152.stdout:1/5: write - no filename 2023-12-07T16:21:21.881 INFO:tasks.workunit.client.1.smithi152.stdout:1/6: readlink - no filename 2023-12-07T16:21:21.881 INFO:tasks.workunit.client.1.smithi152.stdout:1/7: write - no filename 2023-12-07T16:21:21.883 INFO:tasks.workunit.client.1.smithi152.stdout:4/1: mkdir d0 0 2023-12-07T16:21:21.883 INFO:tasks.workunit.client.1.smithi152.stdout:4/2: dread - no filename 2023-12-07T16:21:21.883 INFO:tasks.workunit.client.1.smithi152.stdout:2/8: mkdir d2 0 2023-12-07T16:21:21.884 INFO:tasks.workunit.client.1.smithi152.stdout:1/8: creat f2 x:0 0 0 2023-12-07T16:21:21.884 INFO:tasks.workunit.client.1.smithi152.stdout:1/9: write f2 [524587,113796] 0 2023-12-07T16:21:21.885 INFO:tasks.workunit.client.1.smithi152.stdout:6/0: chown . 2 1 2023-12-07T16:21:21.909 INFO:tasks.workunit.client.1.smithi152.stdout:7/0: chown . 3580 1 2023-12-07T16:21:21.909 INFO:tasks.workunit.client.1.smithi152.stdout:7/1: truncate - no filename 2023-12-07T16:21:21.909 INFO:tasks.workunit.client.1.smithi152.stdout:5/0: creat f0 x:0 0 0 2023-12-07T16:21:21.909 INFO:tasks.workunit.client.1.smithi152.stdout:5/1: dread - f0 zero size 2023-12-07T16:21:21.909 INFO:tasks.workunit.client.1.smithi152.stdout:4/3: creat d0/f1 x:0 0 0 2023-12-07T16:21:21.909 INFO:tasks.workunit.client.1.smithi152.stdout:2/9: link l0 d2/l3 0 2023-12-07T16:21:21.909 INFO:tasks.workunit.client.1.smithi152.stdout:2/10: rename d2 to d2/d4 22 2023-12-07T16:21:21.909 INFO:tasks.workunit.client.1.smithi152.stdout:2/11: fdatasync f1 0 2023-12-07T16:21:21.910 INFO:tasks.workunit.client.1.smithi152.stdout:1/10: creat f3 x:0 0 0 2023-12-07T16:21:21.913 INFO:tasks.workunit.client.1.smithi152.stdout:6/1: symlink l0 0 2023-12-07T16:21:21.913 INFO:tasks.workunit.client.1.smithi152.stdout:6/2: dwrite - no filename 2023-12-07T16:21:21.913 INFO:tasks.workunit.client.1.smithi152.stdout:6/3: dwrite - no filename 2023-12-07T16:21:21.914 INFO:tasks.workunit.client.1.smithi152.stdout:0/28: getdents d0 0 2023-12-07T16:21:21.914 INFO:tasks.workunit.client.1.smithi152.stdout:0/29: write d0/f1 [1391725,83773] 0 2023-12-07T16:21:21.917 INFO:tasks.workunit.client.1.smithi152.stdout:7/2: mknod c0 0 2023-12-07T16:21:21.917 INFO:tasks.workunit.client.1.smithi152.stdout:7/3: readlink - no filename 2023-12-07T16:21:21.917 INFO:tasks.workunit.client.1.smithi152.stdout:7/4: write - no filename 2023-12-07T16:21:21.920 INFO:tasks.workunit.client.1.smithi152.stdout:2/12: symlink d2/l5 0 2023-12-07T16:21:21.920 INFO:tasks.workunit.client.1.smithi152.stdout:2/13: read - f1 zero size 2023-12-07T16:21:21.926 INFO:tasks.workunit.client.1.smithi152.stdout:1/11: link f3 f4 0 2023-12-07T16:21:21.927 INFO:tasks.workunit.client.1.smithi152.stdout:1/12: dread - f3 zero size 2023-12-07T16:21:21.927 INFO:tasks.workunit.client.1.smithi152.stdout:1/13: readlink - no filename 2023-12-07T16:21:21.927 INFO:tasks.workunit.client.1.smithi152.stdout:9/0: read - no filename 2023-12-07T16:21:21.927 INFO:tasks.workunit.client.1.smithi152.stdout:9/1: dwrite - no filename 2023-12-07T16:21:21.927 INFO:tasks.workunit.client.1.smithi152.stdout:9/2: dwrite - no filename 2023-12-07T16:21:21.927 INFO:tasks.workunit.client.1.smithi152.stdout:9/3: link - no file 2023-12-07T16:21:21.927 INFO:tasks.workunit.client.1.smithi152.stdout:9/4: rename - no filename 2023-12-07T16:21:21.927 INFO:tasks.workunit.client.1.smithi152.stdout:9/5: dwrite - no filename 2023-12-07T16:21:21.927 INFO:tasks.workunit.client.1.smithi152.stdout:9/6: write - no filename 2023-12-07T16:21:21.929 INFO:tasks.workunit.client.1.smithi152.stdout:6/4: mknod c1 0 2023-12-07T16:21:21.929 INFO:tasks.workunit.client.1.smithi152.stdout:6/5: dread - no filename 2023-12-07T16:21:21.929 INFO:tasks.workunit.client.1.smithi152.stdout:8/0: mknod c0 0 2023-12-07T16:21:21.929 INFO:tasks.workunit.client.1.smithi152.stdout:8/1: readlink - no filename 2023-12-07T16:21:21.937 INFO:tasks.workunit.client.1.smithi152.stdout:9/7: mknod c0 0 2023-12-07T16:21:21.937 INFO:tasks.workunit.client.1.smithi152.stdout:9/8: chown c0 3786291 1 2023-12-07T16:21:21.938 INFO:tasks.workunit.client.1.smithi152.stdout:6/6: mkdir d2 0 2023-12-07T16:21:21.938 INFO:tasks.workunit.client.1.smithi152.stdout:6/7: dwrite - no filename 2023-12-07T16:21:21.940 INFO:tasks.workunit.client.1.smithi152.stdout:8/2: creat f1 x:0 0 0 2023-12-07T16:21:21.942 INFO:tasks.workunit.client.1.smithi152.stdout:9/9: mkdir d1 0 2023-12-07T16:21:21.944 INFO:tasks.workunit.client.1.smithi152.stdout:6/8: creat d2/f3 x:0 0 0 2023-12-07T16:21:21.944 INFO:tasks.workunit.client.1.smithi152.stdout:8/3: rename f1 to f2 0 2023-12-07T16:21:21.945 INFO:tasks.workunit.client.1.smithi152.stdout:9/10: link c0 d1/c2 0 2023-12-07T16:21:21.951 INFO:tasks.workunit.client.1.smithi152.stdout:6/9: creat d2/f4 x:0 0 0 2023-12-07T16:21:21.951 INFO:tasks.workunit.client.1.smithi152.stdout:6/10: dread - d2/f3 zero size 2023-12-07T16:21:21.951 INFO:tasks.workunit.client.1.smithi152.stdout:6/11: write d2/f3 [357327,38704] 0 2023-12-07T16:21:21.952 INFO:tasks.workunit.client.1.smithi152.stdout:6/12: truncate d2/f4 292147 0 2023-12-07T16:21:21.952 INFO:tasks.workunit.client.1.smithi152.stdout:6/13: chown d2/f4 70852 1 2023-12-07T16:21:21.952 INFO:tasks.workunit.client.1.smithi152.stdout:6/14: write d2/f4 [671012,49944] 0 2023-12-07T16:21:21.952 INFO:tasks.workunit.client.1.smithi152.stdout:6/15: chown l0 0 1 2023-12-07T16:21:21.952 INFO:tasks.workunit.client.1.smithi152.stdout:9/11: symlink d1/l3 0 2023-12-07T16:21:21.952 INFO:tasks.workunit.client.1.smithi152.stdout:9/12: dread - no filename 2023-12-07T16:21:21.952 INFO:tasks.workunit.client.1.smithi152.stdout:9/13: dwrite - no filename 2023-12-07T16:21:21.952 INFO:tasks.workunit.client.1.smithi152.stdout:9/14: fdatasync - no filename 2023-12-07T16:21:21.952 INFO:tasks.workunit.client.1.smithi152.stdout:9/15: write - no filename 2023-12-07T16:21:21.952 INFO:tasks.workunit.client.1.smithi152.stdout:9/16: dread - no filename 2023-12-07T16:21:21.958 INFO:tasks.workunit.client.1.smithi152.stdout:9/17: creat d1/f4 x:0 0 0 2023-12-07T16:21:21.959 INFO:tasks.workunit.client.1.smithi152.stdout:9/18: chown d1 2508 1 2023-12-07T16:21:21.969 INFO:tasks.workunit.client.1.smithi152.stdout:9/19: creat d1/f5 x:0 0 0 2023-12-07T16:21:21.969 INFO:tasks.workunit.client.1.smithi152.stdout:9/20: truncate d1/f5 664231 0 2023-12-07T16:21:21.977 INFO:tasks.workunit.client.1.smithi152.stdout:9/21: creat d1/f6 x:0 0 0 2023-12-07T16:21:22.163 INFO:tasks.workunit.client.1.smithi152.stdout:2/14: getdents d2 0 2023-12-07T16:21:22.193 INFO:tasks.workunit.client.1.smithi152.stdout:8/4: getdents . 0 2023-12-07T16:21:22.409 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:21 smithi063 ceph-mon[112095]: pgmap v18: 65 pgs: 65 active+clean; 178 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 352 KiB/s rd, 7.8 MiB/s wr, 922 op/s 2023-12-07T16:21:22.409 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:21 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:21:22.422 INFO:tasks.workunit.client.0.smithi063.stdout:9/19: getdents d0 0 2023-12-07T16:21:22.422 INFO:tasks.workunit.client.0.smithi063.stdout:0/28: getdents d4 0 2023-12-07T16:21:22.425 INFO:tasks.workunit.client.0.smithi063.stdout:9/20: write d0/f2 [5116691,86344] 0 2023-12-07T16:21:22.428 INFO:tasks.workunit.client.0.smithi063.stdout:0/29: symlink d4/l8 0 2023-12-07T16:21:22.428 INFO:tasks.workunit.client.0.smithi063.stdout:9/21: mknod d0/c6 0 2023-12-07T16:21:22.429 INFO:tasks.workunit.client.0.smithi063.stdout:8/15: write f5 [4426418,120016] 0 2023-12-07T16:21:22.430 INFO:tasks.workunit.client.0.smithi063.stdout:0/30: stat c1 0 2023-12-07T16:21:22.430 INFO:tasks.workunit.client.0.smithi063.stdout:0/31: dread - d4/f5 zero size 2023-12-07T16:21:22.433 INFO:tasks.workunit.client.0.smithi063.stdout:0/32: mknod d4/c9 0 2023-12-07T16:21:22.443 INFO:tasks.workunit.client.0.smithi063.stdout:0/33: creat d4/fa x:0 0 0 2023-12-07T16:21:22.443 INFO:tasks.workunit.client.0.smithi063.stdout:0/34: truncate d4/fa 585055 0 2023-12-07T16:21:22.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:22 smithi152 ceph-mon[121113]: pgmap v18: 65 pgs: 65 active+clean; 178 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 352 KiB/s rd, 7.8 MiB/s wr, 922 op/s 2023-12-07T16:21:22.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:22 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:21:22.666 INFO:tasks.workunit.client.1.smithi152.stdout:2/15: mknod d2/c6 0 2023-12-07T16:21:22.752 INFO:tasks.workunit.client.0.smithi063.stdout:0/35: dwrite d4/f5 [0,4194304] 0 2023-12-07T16:21:22.756 INFO:tasks.workunit.client.0.smithi063.stdout:0/36: creat d4/fb x:0 0 0 2023-12-07T16:21:22.756 INFO:tasks.workunit.client.0.smithi063.stdout:0/37: fdatasync d4/f5 0 2023-12-07T16:21:22.756 INFO:tasks.workunit.client.0.smithi063.stdout:0/38: write d4/fb [1009735,32066] 0 2023-12-07T16:21:22.761 INFO:tasks.workunit.client.0.smithi063.stdout:0/39: creat d4/fc x:0 0 0 2023-12-07T16:21:22.763 INFO:tasks.workunit.client.0.smithi063.stdout:0/40: mkdir d4/dd 0 2023-12-07T16:21:22.766 INFO:tasks.workunit.client.0.smithi063.stdout:0/41: mkdir d4/dd/de 0 2023-12-07T16:21:22.773 INFO:tasks.workunit.client.1.smithi152.stdout:9/22: dwrite d1/f5 [0,4194304] 0 2023-12-07T16:21:22.775 INFO:tasks.workunit.client.0.smithi063.stdout:0/42: dread d4/fa [0,4194304] 0 2023-12-07T16:21:22.775 INFO:tasks.workunit.client.0.smithi063.stdout:0/43: fdatasync d4/f5 0 2023-12-07T16:21:22.848 INFO:tasks.workunit.client.1.smithi152.stdout:0/30: truncate d0/f1 1218039 0 2023-12-07T16:21:22.858 INFO:tasks.workunit.client.0.smithi063.stdout:8/16: write f1 [2164207,43834] 0 2023-12-07T16:21:22.868 INFO:tasks.workunit.client.1.smithi152.stdout:1/14: dwrite f3 [0,4194304] 0 2023-12-07T16:21:22.880 INFO:tasks.workunit.client.0.smithi063.stdout:0/44: dwrite d4/fc [0,4194304] 0 2023-12-07T16:21:22.886 INFO:tasks.workunit.client.0.smithi063.stdout:0/45: creat d4/ff x:0 0 0 2023-12-07T16:21:22.886 INFO:tasks.workunit.client.0.smithi063.stdout:0/46: rename d4/dd to d4/dd/de/d10 22 2023-12-07T16:21:22.886 INFO:tasks.workunit.client.0.smithi063.stdout:0/47: chown d4/f5 28860 1 2023-12-07T16:21:22.887 INFO:tasks.workunit.client.0.smithi063.stdout:0/48: read - d4/ff zero size 2023-12-07T16:21:22.887 INFO:tasks.workunit.client.0.smithi063.stdout:0/49: symlink d4/dd/de/l11 0 2023-12-07T16:21:22.890 INFO:tasks.workunit.client.0.smithi063.stdout:0/50: rename d4/l7 to d4/dd/l12 0 2023-12-07T16:21:23.007 INFO:tasks.workunit.client.0.smithi063.stdout:8/17: truncate f5 4235075 0 2023-12-07T16:21:23.008 INFO:tasks.workunit.client.0.smithi063.stdout:8/18: mkdir d7 0 2023-12-07T16:21:23.008 INFO:tasks.workunit.client.0.smithi063.stdout:8/19: chown f5 7736857 1 2023-12-07T16:21:23.017 INFO:tasks.workunit.client.0.smithi063.stdout:0/51: unlink l3 0 2023-12-07T16:21:23.017 INFO:tasks.workunit.client.0.smithi063.stdout:0/52: stat d4/l8 0 2023-12-07T16:21:23.017 INFO:tasks.workunit.client.0.smithi063.stdout:8/20: fsync f5 0 2023-12-07T16:21:23.019 INFO:tasks.workunit.client.0.smithi063.stdout:8/21: write f1 [2466026,95181] 0 2023-12-07T16:21:23.021 INFO:tasks.workunit.client.0.smithi063.stdout:8/22: creat d7/f8 x:0 0 0 2023-12-07T16:21:23.021 INFO:tasks.workunit.client.0.smithi063.stdout:8/23: readlink l2 0 2023-12-07T16:21:23.021 INFO:tasks.workunit.client.0.smithi063.stdout:8/24: truncate d7/f8 158795 0 2023-12-07T16:21:23.032 INFO:tasks.workunit.client.0.smithi063.stdout:8/25: dread f1 [0,4194304] 0 2023-12-07T16:21:23.035 INFO:tasks.workunit.client.0.smithi063.stdout:0/53: dwrite d4/fa [0,4194304] 0 2023-12-07T16:21:23.035 INFO:tasks.workunit.client.0.smithi063.stdout:0/54: truncate d4/ff 975100 0 2023-12-07T16:21:23.037 INFO:tasks.workunit.client.0.smithi063.stdout:8/26: dread f1 [0,4194304] 0 2023-12-07T16:21:23.037 INFO:tasks.workunit.client.0.smithi063.stdout:8/27: dread - f3 zero size 2023-12-07T16:21:23.037 INFO:tasks.workunit.client.0.smithi063.stdout:8/28: fsync f6 0 2023-12-07T16:21:23.037 INFO:tasks.workunit.client.0.smithi063.stdout:8/29: write f3 [361794,16446] 0 2023-12-07T16:21:23.038 INFO:tasks.workunit.client.0.smithi063.stdout:0/55: rename d4/ff to d4/dd/de/f13 0 2023-12-07T16:21:23.038 INFO:tasks.workunit.client.0.smithi063.stdout:0/56: chown c1 4210 1 2023-12-07T16:21:23.038 INFO:tasks.workunit.client.0.smithi063.stdout:0/57: chown c1 361052 1 2023-12-07T16:21:23.040 INFO:tasks.workunit.client.0.smithi063.stdout:8/30: rename f1 to d7/f9 0 2023-12-07T16:21:23.042 INFO:tasks.workunit.client.0.smithi063.stdout:8/31: unlink f3 0 2023-12-07T16:21:23.042 INFO:tasks.workunit.client.0.smithi063.stdout:8/32: stat d7/f9 0 2023-12-07T16:21:23.043 INFO:tasks.workunit.client.0.smithi063.stdout:8/33: creat d7/fa x:0 0 0 2023-12-07T16:21:23.043 INFO:tasks.workunit.client.0.smithi063.stdout:8/34: stat d7/fa 0 2023-12-07T16:21:23.045 INFO:tasks.workunit.client.0.smithi063.stdout:8/35: rename d7/fa to d7/fb 0 2023-12-07T16:21:23.045 INFO:tasks.workunit.client.0.smithi063.stdout:8/36: chown d7 0 1 2023-12-07T16:21:23.045 INFO:tasks.workunit.client.0.smithi063.stdout:8/37: rename d7 to d7/dc 22 2023-12-07T16:21:23.045 INFO:tasks.workunit.client.0.smithi063.stdout:8/38: chown f5 2 1 2023-12-07T16:21:23.045 INFO:tasks.workunit.client.0.smithi063.stdout:8/39: dread - f6 zero size 2023-12-07T16:21:23.048 INFO:tasks.workunit.client.0.smithi063.stdout:0/58: truncate d4/dd/de/f13 593331 0 2023-12-07T16:21:23.048 INFO:tasks.workunit.client.0.smithi063.stdout:0/59: fdatasync d4/dd/de/f13 0 2023-12-07T16:21:23.048 INFO:tasks.workunit.client.0.smithi063.stdout:0/60: chown d4/l8 3 1 2023-12-07T16:21:23.050 INFO:tasks.workunit.client.0.smithi063.stdout:8/40: unlink d7/fb 0 2023-12-07T16:21:23.051 INFO:tasks.workunit.client.0.smithi063.stdout:8/41: creat d7/fd x:0 0 0 2023-12-07T16:21:23.053 INFO:tasks.workunit.client.0.smithi063.stdout:8/42: link l2 d7/le 0 2023-12-07T16:21:23.053 INFO:tasks.workunit.client.0.smithi063.stdout:0/61: dread d4/dd/de/f13 [0,4194304] 0 2023-12-07T16:21:23.054 INFO:tasks.workunit.client.0.smithi063.stdout:8/43: creat d7/ff x:0 0 0 2023-12-07T16:21:23.054 INFO:tasks.workunit.client.0.smithi063.stdout:0/62: write d4/fa [3183682,22444] 0 2023-12-07T16:21:23.056 INFO:tasks.workunit.client.0.smithi063.stdout:8/44: unlink f6 0 2023-12-07T16:21:23.057 INFO:tasks.workunit.client.0.smithi063.stdout:0/63: link d4/f5 d4/dd/f14 0 2023-12-07T16:21:23.058 INFO:tasks.workunit.client.0.smithi063.stdout:8/45: mknod d7/c10 0 2023-12-07T16:21:23.058 INFO:tasks.workunit.client.0.smithi063.stdout:8/46: stat d7 0 2023-12-07T16:21:23.059 INFO:tasks.workunit.client.0.smithi063.stdout:0/64: mkdir d4/dd/de/d15 0 2023-12-07T16:21:23.059 INFO:tasks.workunit.client.0.smithi063.stdout:8/47: mknod d7/c11 0 2023-12-07T16:21:23.060 INFO:tasks.workunit.client.0.smithi063.stdout:0/65: creat d4/f16 x:0 0 0 2023-12-07T16:21:23.061 INFO:tasks.workunit.client.0.smithi063.stdout:8/48: symlink d7/l12 0 2023-12-07T16:21:23.061 INFO:tasks.workunit.client.0.smithi063.stdout:8/49: fdatasync d7/f9 0 2023-12-07T16:21:23.061 INFO:tasks.workunit.client.0.smithi063.stdout:0/66: rename d4/fa to d4/f17 0 2023-12-07T16:21:23.062 INFO:tasks.workunit.client.0.smithi063.stdout:8/50: symlink d7/l13 0 2023-12-07T16:21:23.063 INFO:tasks.workunit.client.0.smithi063.stdout:8/51: mkdir d7/d14 0 2023-12-07T16:21:23.063 INFO:tasks.workunit.client.0.smithi063.stdout:8/52: write d7/f8 [951689,64630] 0 2023-12-07T16:21:23.064 INFO:tasks.workunit.client.0.smithi063.stdout:8/53: mkdir d7/d14/d15 0 2023-12-07T16:21:23.073 INFO:tasks.workunit.client.0.smithi063.stdout:0/67: dread d4/f17 [0,4194304] 0 2023-12-07T16:21:23.074 INFO:tasks.workunit.client.0.smithi063.stdout:0/68: chown d4/dd/de/d15 822975097 1 2023-12-07T16:21:23.076 INFO:tasks.workunit.client.0.smithi063.stdout:0/69: write d4/fc [878700,56383] 0 2023-12-07T16:21:23.076 INFO:tasks.workunit.client.0.smithi063.stdout:0/70: write d4/dd/de/f13 [717282,100557] 0 2023-12-07T16:21:23.076 INFO:tasks.workunit.client.0.smithi063.stdout:0/71: chown d4/dd/l12 1730566 1 2023-12-07T16:21:23.076 INFO:tasks.workunit.client.0.smithi063.stdout:0/72: chown d4/dd 52 1 2023-12-07T16:21:23.077 INFO:tasks.workunit.client.0.smithi063.stdout:8/54: dread f5 [0,4194304] 0 2023-12-07T16:21:23.077 INFO:tasks.workunit.client.0.smithi063.stdout:0/73: link d4/f5 d4/dd/de/d15/f18 0 2023-12-07T16:21:23.078 INFO:tasks.workunit.client.0.smithi063.stdout:8/55: creat d7/f16 x:0 0 0 2023-12-07T16:21:23.079 INFO:tasks.workunit.client.0.smithi063.stdout:8/56: creat d7/d14/f17 x:0 0 0 2023-12-07T16:21:23.080 INFO:tasks.workunit.client.0.smithi063.stdout:8/57: write f5 [2976389,25153] 0 2023-12-07T16:21:23.080 INFO:tasks.workunit.client.0.smithi063.stdout:8/58: dread - d7/ff zero size 2023-12-07T16:21:23.084 INFO:tasks.workunit.client.0.smithi063.stdout:0/74: fsync d4/f5 0 2023-12-07T16:21:23.085 INFO:tasks.workunit.client.0.smithi063.stdout:0/75: rmdir d4/dd 39 2023-12-07T16:21:23.086 INFO:tasks.workunit.client.0.smithi063.stdout:0/76: creat d4/dd/de/f19 x:0 0 0 2023-12-07T16:21:23.090 INFO:tasks.workunit.client.0.smithi063.stdout:0/77: getdents d4/dd/de 0 2023-12-07T16:21:23.104 INFO:tasks.workunit.client.0.smithi063.stdout:8/59: dwrite d7/fd [0,4194304] 0 2023-12-07T16:21:23.105 INFO:tasks.workunit.client.0.smithi063.stdout:8/60: write f5 [1908221,111896] 0 2023-12-07T16:21:23.105 INFO:tasks.workunit.client.0.smithi063.stdout:8/61: dread - d7/d14/f17 zero size 2023-12-07T16:21:23.105 INFO:tasks.workunit.client.0.smithi063.stdout:8/62: fsync d7/d14/f17 0 2023-12-07T16:21:23.107 INFO:tasks.workunit.client.0.smithi063.stdout:8/63: creat d7/d14/d15/f18 x:0 0 0 2023-12-07T16:21:23.109 INFO:tasks.workunit.client.0.smithi063.stdout:8/64: getdents d7 0 2023-12-07T16:21:23.110 INFO:tasks.workunit.client.0.smithi063.stdout:8/65: symlink d7/d14/d15/l19 0 2023-12-07T16:21:23.111 INFO:tasks.workunit.client.0.smithi063.stdout:8/66: mkdir d7/d14/d1a 0 2023-12-07T16:21:23.112 INFO:tasks.workunit.client.0.smithi063.stdout:8/67: rmdir d7 39 2023-12-07T16:21:23.113 INFO:tasks.workunit.client.0.smithi063.stdout:8/68: creat d7/f1b x:0 0 0 2023-12-07T16:21:23.114 INFO:tasks.workunit.client.0.smithi063.stdout:8/69: mknod d7/c1c 0 2023-12-07T16:21:23.114 INFO:tasks.workunit.client.0.smithi063.stdout:8/70: fdatasync d7/f16 0 2023-12-07T16:21:23.115 INFO:tasks.workunit.client.0.smithi063.stdout:8/71: link d7/l12 d7/d14/l1d 0 2023-12-07T16:21:23.115 INFO:tasks.workunit.client.0.smithi063.stdout:8/72: chown d7/le 5004 1 2023-12-07T16:21:23.115 INFO:tasks.workunit.client.0.smithi063.stdout:8/73: mknod d7/c1e 0 2023-12-07T16:21:23.132 INFO:tasks.workunit.client.0.smithi063.stdout:8/74: dwrite d7/f16 [0,4194304] 0 2023-12-07T16:21:23.134 INFO:tasks.workunit.client.0.smithi063.stdout:8/75: rename d7/c10 to d7/c1f 0 2023-12-07T16:21:23.135 INFO:tasks.workunit.client.0.smithi063.stdout:8/76: link d7/c11 d7/c20 0 2023-12-07T16:21:23.136 INFO:tasks.workunit.client.0.smithi063.stdout:8/77: creat d7/d14/f21 x:0 0 0 2023-12-07T16:21:23.148 INFO:tasks.workunit.client.0.smithi063.stdout:8/78: dread d7/fd [0,4194304] 0 2023-12-07T16:21:23.148 INFO:tasks.workunit.client.0.smithi063.stdout:8/79: getdents d7/d14/d1a 0 2023-12-07T16:21:23.149 INFO:tasks.workunit.client.0.smithi063.stdout:8/80: creat d7/d14/d1a/f22 x:0 0 0 2023-12-07T16:21:23.150 INFO:tasks.workunit.client.0.smithi063.stdout:8/81: rename d7/f16 to d7/f23 0 2023-12-07T16:21:23.151 INFO:tasks.workunit.client.0.smithi063.stdout:8/82: stat d7/c1f 0 2023-12-07T16:21:23.151 INFO:tasks.workunit.client.0.smithi063.stdout:8/83: creat d7/f24 x:0 0 0 2023-12-07T16:21:23.153 INFO:tasks.workunit.client.0.smithi063.stdout:8/84: unlink d7/l12 0 2023-12-07T16:21:23.158 INFO:tasks.workunit.client.0.smithi063.stdout:8/85: dread d7/fd [0,4194304] 0 2023-12-07T16:21:23.159 INFO:tasks.workunit.client.0.smithi063.stdout:8/86: symlink d7/l25 0 2023-12-07T16:21:23.160 INFO:tasks.workunit.client.0.smithi063.stdout:8/87: write d7/f9 [2564547,121427] 0 2023-12-07T16:21:23.165 INFO:tasks.workunit.client.0.smithi063.stdout:8/88: rmdir d7/d14 39 2023-12-07T16:21:23.171 INFO:tasks.workunit.client.0.smithi063.stdout:8/89: dread d7/f23 [0,4194304] 0 2023-12-07T16:21:23.202 INFO:tasks.workunit.client.0.smithi063.stdout:8/90: dread - d7/d14/d1a/f22 zero size 2023-12-07T16:21:23.202 INFO:tasks.workunit.client.0.smithi063.stdout:8/91: write d7/f9 [5666776,4340] 0 2023-12-07T16:21:23.202 INFO:tasks.workunit.client.0.smithi063.stdout:8/92: dread d7/fd [0,4194304] 0 2023-12-07T16:21:23.202 INFO:tasks.workunit.client.0.smithi063.stdout:8/93: chown d7/le 199 1 2023-12-07T16:21:23.203 INFO:tasks.workunit.client.0.smithi063.stdout:8/94: unlink d7/f8 0 2023-12-07T16:21:23.203 INFO:tasks.workunit.client.0.smithi063.stdout:8/95: dread f5 [0,4194304] 0 2023-12-07T16:21:23.203 INFO:tasks.workunit.client.0.smithi063.stdout:8/96: dread - d7/d14/d1a/f22 zero size 2023-12-07T16:21:23.203 INFO:tasks.workunit.client.0.smithi063.stdout:8/97: write d7/d14/f21 [439327,53002] 0 2023-12-07T16:21:23.203 INFO:tasks.workunit.client.0.smithi063.stdout:8/98: unlink d7/d14/l1d 0 2023-12-07T16:21:23.209 INFO:tasks.workunit.client.0.smithi063.stdout:8/99: dwrite d7/ff [0,4194304] 0 2023-12-07T16:21:23.209 INFO:tasks.workunit.client.0.smithi063.stdout:8/100: readlink d7/l25 0 2023-12-07T16:21:23.209 INFO:tasks.workunit.client.0.smithi063.stdout:8/101: write d7/d14/f21 [623428,84168] 0 2023-12-07T16:21:23.215 INFO:tasks.workunit.client.0.smithi063.stdout:8/102: dread d7/ff [0,4194304] 0 2023-12-07T16:21:23.230 INFO:tasks.workunit.client.0.smithi063.stdout:8/103: dwrite f5 [4194304,4194304] 0 2023-12-07T16:21:23.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:23 smithi063 ceph-mon[112095]: pgmap v19: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 12 MiB/s wr, 1.00k op/s 2023-12-07T16:21:23.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:23 smithi152 ceph-mon[121113]: pgmap v19: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 12 MiB/s wr, 1.00k op/s 2023-12-07T16:21:23.998 INFO:tasks.workunit.client.1.smithi152.stdout:2/16: symlink d2/l7 0 2023-12-07T16:21:24.804 INFO:tasks.workunit.client.1.smithi152.stdout:0/31: mknod d0/c3 0 2023-12-07T16:21:24.876 INFO:tasks.workunit.client.1.smithi152.stdout:1/15: creat f5 x:0 0 0 2023-12-07T16:21:25.373 INFO:tasks.workunit.client.1.smithi152.stdout:2/17: creat d2/f8 x:0 0 0 2023-12-07T16:21:25.375 INFO:tasks.workunit.client.1.smithi152.stdout:0/32: creat d0/f4 x:0 0 0 2023-12-07T16:21:25.376 INFO:tasks.workunit.client.1.smithi152.stdout:0/33: rename d0/f1 to d0/f5 0 2023-12-07T16:21:25.377 INFO:tasks.workunit.client.1.smithi152.stdout:0/34: mknod d0/c6 0 2023-12-07T16:21:25.413 INFO:tasks.workunit.client.1.smithi152.stdout:9/23: truncate d1/f5 2464466 0 2023-12-07T16:21:25.415 INFO:tasks.workunit.client.1.smithi152.stdout:9/24: link d1/c2 d1/c7 0 2023-12-07T16:21:25.416 INFO:tasks.workunit.client.1.smithi152.stdout:9/25: mknod d1/c8 0 2023-12-07T16:21:25.416 INFO:tasks.workunit.client.1.smithi152.stdout:9/26: dread - d1/f6 zero size 2023-12-07T16:21:25.417 INFO:tasks.workunit.client.1.smithi152.stdout:9/27: unlink d1/f6 0 2023-12-07T16:21:25.417 INFO:tasks.workunit.client.1.smithi152.stdout:9/28: readlink d1/l3 0 2023-12-07T16:21:25.418 INFO:tasks.workunit.client.1.smithi152.stdout:9/29: mkdir d1/d9 0 2023-12-07T16:21:25.419 INFO:tasks.workunit.client.1.smithi152.stdout:9/30: mknod d1/d9/ca 0 2023-12-07T16:21:25.513 INFO:tasks.workunit.client.1.smithi152.stdout:1/16: fsync f5 0 2023-12-07T16:21:25.519 INFO:tasks.workunit.client.1.smithi152.stdout:1/17: dread f3 [0,4194304] 0 2023-12-07T16:21:25.519 INFO:tasks.workunit.client.1.smithi152.stdout:1/18: rmdir - no directory 2023-12-07T16:21:25.521 INFO:tasks.workunit.client.1.smithi152.stdout:1/19: creat f6 x:0 0 0 2023-12-07T16:21:25.523 INFO:tasks.workunit.client.1.smithi152.stdout:1/20: symlink l7 0 2023-12-07T16:21:25.539 INFO:tasks.workunit.client.1.smithi152.stdout:1/21: dwrite f3 [0,4194304] 0 2023-12-07T16:21:25.539 INFO:tasks.workunit.client.1.smithi152.stdout:1/22: write f2 [1172555,4583] 0 2023-12-07T16:21:25.540 INFO:tasks.workunit.client.1.smithi152.stdout:1/23: dread - f6 zero size 2023-12-07T16:21:25.540 INFO:tasks.workunit.client.1.smithi152.stdout:1/24: rmdir - no directory 2023-12-07T16:21:25.541 INFO:tasks.workunit.client.1.smithi152.stdout:1/25: unlink f5 0 2023-12-07T16:21:25.543 INFO:tasks.workunit.client.1.smithi152.stdout:1/26: unlink f2 0 2023-12-07T16:21:25.543 INFO:tasks.workunit.client.1.smithi152.stdout:1/27: fsync f4 0 2023-12-07T16:21:25.696 INFO:tasks.workunit.client.1.smithi152.stdout:1/28: truncate f4 861771 0 2023-12-07T16:21:25.696 INFO:tasks.workunit.client.1.smithi152.stdout:1/29: chown f6 296419311 1 2023-12-07T16:21:25.705 INFO:tasks.workunit.client.1.smithi152.stdout:9/31: dwrite d1/f5 [0,4194304] 0 2023-12-07T16:21:25.707 INFO:tasks.workunit.client.1.smithi152.stdout:9/32: write d1/f5 [3716244,13795] 0 2023-12-07T16:21:25.707 INFO:tasks.workunit.client.1.smithi152.stdout:9/33: write d1/f4 [31424,21910] 0 2023-12-07T16:21:25.710 INFO:tasks.workunit.client.1.smithi152.stdout:9/34: mkdir d1/d9/db 0 2023-12-07T16:21:25.711 INFO:tasks.workunit.client.1.smithi152.stdout:9/35: symlink d1/d9/db/lc 0 2023-12-07T16:21:25.712 INFO:tasks.workunit.client.1.smithi152.stdout:9/36: mkdir d1/dd 0 2023-12-07T16:21:25.739 INFO:tasks.workunit.client.1.smithi152.stdout:9/37: dwrite d1/f4 [0,4194304] 0 2023-12-07T16:21:25.761 INFO:tasks.workunit.client.1.smithi152.stdout:9/38: dread d1/f4 [0,4194304] 0 2023-12-07T16:21:25.762 INFO:tasks.workunit.client.1.smithi152.stdout:9/39: link d1/c2 d1/dd/ce 0 2023-12-07T16:21:25.763 INFO:tasks.workunit.client.1.smithi152.stdout:9/40: write d1/f4 [4103580,62631] 0 2023-12-07T16:21:25.765 INFO:tasks.workunit.client.1.smithi152.stdout:9/41: fdatasync d1/f5 0 2023-12-07T16:21:25.767 INFO:tasks.workunit.client.1.smithi152.stdout:9/42: write d1/f5 [902095,21662] 0 2023-12-07T16:21:25.768 INFO:tasks.workunit.client.1.smithi152.stdout:9/43: unlink d1/c2 0 2023-12-07T16:21:25.768 INFO:tasks.workunit.client.1.smithi152.stdout:9/44: chown d1/l3 6264199 1 2023-12-07T16:21:25.769 INFO:tasks.workunit.client.1.smithi152.stdout:9/45: mkdir d1/d9/db/df 0 2023-12-07T16:21:25.769 INFO:tasks.workunit.client.1.smithi152.stdout:9/46: chown d1/c8 26253813 1 2023-12-07T16:21:25.770 INFO:tasks.workunit.client.1.smithi152.stdout:9/47: mknod d1/d9/db/c10 0 2023-12-07T16:21:25.771 INFO:tasks.workunit.client.1.smithi152.stdout:9/48: mknod d1/d9/db/c11 0 2023-12-07T16:21:25.772 INFO:tasks.workunit.client.1.smithi152.stdout:9/49: rename d1/f4 to d1/d9/f12 0 2023-12-07T16:21:25.799 INFO:tasks.workunit.client.1.smithi152.stdout:9/50: dwrite d1/d9/f12 [0,4194304] 0 2023-12-07T16:21:25.799 INFO:tasks.workunit.client.1.smithi152.stdout:9/51: write d1/d9/f12 [4763590,96168] 0 2023-12-07T16:21:25.806 INFO:tasks.workunit.client.1.smithi152.stdout:9/52: truncate d1/f5 328507 0 2023-12-07T16:21:25.807 INFO:tasks.workunit.client.1.smithi152.stdout:9/53: symlink d1/dd/l13 0 2023-12-07T16:21:25.812 INFO:tasks.workunit.client.1.smithi152.stdout:9/54: truncate d1/d9/f12 339413 0 2023-12-07T16:21:25.813 INFO:tasks.workunit.client.1.smithi152.stdout:9/55: write d1/f5 [1301160,39785] 0 2023-12-07T16:21:25.814 INFO:tasks.workunit.client.1.smithi152.stdout:9/56: link d1/c8 d1/d9/c14 0 2023-12-07T16:21:25.815 INFO:tasks.workunit.client.1.smithi152.stdout:9/57: unlink d1/dd/l13 0 2023-12-07T16:21:25.820 INFO:tasks.workunit.client.1.smithi152.stdout:9/58: dread d1/d9/f12 [0,4194304] 0 2023-12-07T16:21:25.820 INFO:tasks.workunit.client.1.smithi152.stdout:9/59: rename d1 to d1/d9/db/df/d15 22 2023-12-07T16:21:25.821 INFO:tasks.workunit.client.1.smithi152.stdout:9/60: symlink d1/d9/db/l16 0 2023-12-07T16:21:25.822 INFO:tasks.workunit.client.1.smithi152.stdout:9/61: mkdir d1/d17 0 2023-12-07T16:21:25.822 INFO:tasks.workunit.client.1.smithi152.stdout:9/62: chown d1/d9 940784 1 2023-12-07T16:21:25.823 INFO:tasks.workunit.client.1.smithi152.stdout:9/63: unlink d1/c8 0 2023-12-07T16:21:25.830 INFO:tasks.workunit.client.1.smithi152.stdout:9/64: dread d1/f5 [0,4194304] 0 2023-12-07T16:21:25.831 INFO:tasks.workunit.client.1.smithi152.stdout:9/65: rename d1/d9/db/l16 to d1/d9/db/df/l18 0 2023-12-07T16:21:25.831 INFO:tasks.workunit.client.1.smithi152.stdout:9/66: truncate d1/f5 1775353 0 2023-12-07T16:21:25.832 INFO:tasks.workunit.client.1.smithi152.stdout:9/67: readlink d1/d9/db/lc 0 2023-12-07T16:21:25.854 INFO:tasks.workunit.client.1.smithi152.stdout:9/68: dwrite d1/d9/f12 [0,4194304] 0 2023-12-07T16:21:25.857 INFO:tasks.workunit.client.1.smithi152.stdout:9/69: unlink d1/d9/db/lc 0 2023-12-07T16:21:25.859 INFO:tasks.workunit.client.1.smithi152.stdout:9/70: mkdir d1/d9/d19 0 2023-12-07T16:21:25.860 INFO:tasks.workunit.client.1.smithi152.stdout:9/71: rmdir d1/dd 39 2023-12-07T16:21:25.861 INFO:tasks.workunit.client.1.smithi152.stdout:9/72: creat d1/d9/db/f1a x:0 0 0 2023-12-07T16:21:25.883 INFO:tasks.workunit.client.1.smithi152.stdout:9/73: dwrite d1/d9/db/f1a [0,4194304] 0 2023-12-07T16:21:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.950+0000 7f56e9a14700 1 -- 172.21.15.63:0/2358291759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56e40fbaf0 msgr2=0x7f56e40fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.950+0000 7f56e9a14700 1 --2- 172.21.15.63:0/2358291759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56e40fbaf0 0x7f56e40fbf00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f56d4004940 tx=0x7f56d4009e30 comp rx=0 tx=0).stop 2023-12-07T16:21:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.951+0000 7f56e9a14700 1 -- 172.21.15.63:0/2358291759 shutdown_connections 2023-12-07T16:21:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.951+0000 7f56e9a14700 1 --2- 172.21.15.63:0/2358291759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56e40fcd00 0x7f56e40fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.951+0000 7f56e9a14700 1 --2- 172.21.15.63:0/2358291759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56e40fbaf0 0x7f56e40fbf00 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.951+0000 7f56e9a14700 1 -- 172.21.15.63:0/2358291759 >> 172.21.15.63:0/2358291759 conn(0x7f56e40f71d0 msgr2=0x7f56e40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:21:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.951+0000 7f56e9a14700 1 -- 172.21.15.63:0/2358291759 shutdown_connections 2023-12-07T16:21:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.951+0000 7f56e9a14700 1 -- 172.21.15.63:0/2358291759 wait complete. 2023-12-07T16:21:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.951+0000 7f56e9a14700 1 Processor -- start 2023-12-07T16:21:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.952+0000 7f56e9a14700 1 -- start start 2023-12-07T16:21:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.952+0000 7f56e9a14700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56e40fbaf0 0x7f56e41101f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.952+0000 7f56e9a14700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56e40fcd00 0x7f56e4112740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.952+0000 7f56e9a14700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e40669a0 con 0x7f56e40fbaf0 2023-12-07T16:21:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.952+0000 7f56e9a14700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e4066ae0 con 0x7f56e40fcd00 2023-12-07T16:21:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.952+0000 7f56e2ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56e40fbaf0 0x7f56e41101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.952+0000 7f56e2ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56e40fbaf0 0x7f56e41101f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48110/0 (socket says 172.21.15.63:48110) 2023-12-07T16:21:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.952+0000 7f56e2ffd700 1 -- 172.21.15.63:0/2361908597 learned_addr learned my addr 172.21.15.63:0/2361908597 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:21:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.952+0000 7f56e27fc700 1 --2- 172.21.15.63:0/2361908597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56e40fcd00 0x7f56e4112740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.952+0000 7f56e2ffd700 1 -- 172.21.15.63:0/2361908597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56e40fcd00 msgr2=0x7f56e4112740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.952+0000 7f56e2ffd700 1 --2- 172.21.15.63:0/2361908597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56e40fcd00 0x7f56e4112740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.952+0000 7f56e2ffd700 1 -- 172.21.15.63:0/2361908597 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d4005040 con 0x7f56e40fbaf0 2023-12-07T16:21:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.953+0000 7f56e2ffd700 1 --2- 172.21.15.63:0/2361908597 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56e40fbaf0 0x7f56e41101f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f56d4000c00 tx=0x7f56d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:21:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.953+0000 7f56cb7fe700 1 -- 172.21.15.63:0/2361908597 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56d4021070 con 0x7f56e40fbaf0 2023-12-07T16:21:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.953+0000 7f56cb7fe700 1 -- 172.21.15.63:0/2361908597 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f56d401c400 con 0x7f56e40fbaf0 2023-12-07T16:21:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.953+0000 7f56cb7fe700 1 -- 172.21.15.63:0/2361908597 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56d400e070 con 0x7f56e40fbaf0 2023-12-07T16:21:25.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.953+0000 7f56e9a14700 1 -- 172.21.15.63:0/2361908597 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e4112d40 con 0x7f56e40fbaf0 2023-12-07T16:21:25.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.953+0000 7f56e9a14700 1 -- 172.21.15.63:0/2361908597 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e41131c0 con 0x7f56e40fbaf0 2023-12-07T16:21:25.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.954+0000 7f56e9a14700 1 -- 172.21.15.63:0/2361908597 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e404bb80 con 0x7f56e40fbaf0 2023-12-07T16:21:25.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.955+0000 7f56cb7fe700 1 -- 172.21.15.63:0/2361908597 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f56d401ca00 con 0x7f56e40fbaf0 2023-12-07T16:21:25.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.956+0000 7f56cb7fe700 1 --2- 172.21.15.63:0/2361908597 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f56cc06ae40 0x7f56cc06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:25.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.956+0000 7f56cb7fe700 1 -- 172.21.15.63:0/2361908597 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f56d408ab90 con 0x7f56e40fbaf0 2023-12-07T16:21:25.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.956+0000 7f56e27fc700 1 --2- 172.21.15.63:0/2361908597 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f56cc06ae40 0x7f56cc06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:25.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.957+0000 7f56e27fc700 1 --2- 172.21.15.63:0/2361908597 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f56cc06ae40 0x7f56cc06d2f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009b80 tx=0x7f56d800b040 comp rx=0 tx=0).ready entity=mgr.14614 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:21:25.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:25.959+0000 7f56cb7fe700 1 -- 172.21.15.63:0/2361908597 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f56d4055080 con 0x7f56e40fbaf0 2023-12-07T16:21:26.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.221+0000 7f56e9a14700 1 -- 172.21.15.63:0/2361908597 --> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f56e4101650 con 0x7f56cc06ae40 2023-12-07T16:21:26.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.222+0000 7f56cb7fe700 1 -- 172.21.15.63:0/2361908597 <== mgr.14614 v2:172.21.15.152:6828/1927275654 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f56e4101650 con 0x7f56cc06ae40 2023-12-07T16:21:26.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.224+0000 7f56e9a14700 1 -- 172.21.15.63:0/2361908597 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f56cc06ae40 msgr2=0x7f56cc06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:26.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.224+0000 7f56e9a14700 1 --2- 172.21.15.63:0/2361908597 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f56cc06ae40 0x7f56cc06d2f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009b80 tx=0x7f56d800b040 comp rx=0 tx=0).stop 2023-12-07T16:21:26.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.224+0000 7f56e9a14700 1 -- 172.21.15.63:0/2361908597 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56e40fbaf0 msgr2=0x7f56e41101f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:26.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.224+0000 7f56e9a14700 1 --2- 172.21.15.63:0/2361908597 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56e40fbaf0 0x7f56e41101f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f56d4000c00 tx=0x7f56d4009e30 comp rx=0 tx=0).stop 2023-12-07T16:21:26.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.224+0000 7f56e9a14700 1 -- 172.21.15.63:0/2361908597 shutdown_connections 2023-12-07T16:21:26.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.224+0000 7f56e9a14700 1 --2- 172.21.15.63:0/2361908597 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f56cc06ae40 0x7f56cc06d2f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:26.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.224+0000 7f56e9a14700 1 --2- 172.21.15.63:0/2361908597 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56e40fbaf0 0x7f56e41101f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:26.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.224+0000 7f56e9a14700 1 --2- 172.21.15.63:0/2361908597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f56e40fcd00 0x7f56e4112740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:26.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.224+0000 7f56e9a14700 1 -- 172.21.15.63:0/2361908597 >> 172.21.15.63:0/2361908597 conn(0x7f56e40f71d0 msgr2=0x7f56e40fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:21:26.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.224+0000 7f56e9a14700 1 -- 172.21.15.63:0/2361908597 shutdown_connections 2023-12-07T16:21:26.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.225+0000 7f56e9a14700 1 -- 172.21.15.63:0/2361908597 wait complete. 2023-12-07T16:21:26.232 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-07T16:21:26.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:25 smithi152 ceph-mon[121113]: pgmap v20: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 8.7 MiB/s wr, 599 op/s 2023-12-07T16:21:26.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.332+0000 7ff13b78a700 1 -- 172.21.15.63:0/1842917713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff134066090 msgr2=0x7ff1340ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:26.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.332+0000 7ff13b78a700 1 --2- 172.21.15.63:0/1842917713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff134066090 0x7ff1340ff7a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff130004940 tx=0x7ff130009e30 comp rx=0 tx=0).stop 2023-12-07T16:21:26.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.333+0000 7ff13b78a700 1 -- 172.21.15.63:0/1842917713 shutdown_connections 2023-12-07T16:21:26.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.333+0000 7ff13b78a700 1 --2- 172.21.15.63:0/1842917713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1340ffd70 0x7ff1341021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:26.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.333+0000 7ff13b78a700 1 --2- 172.21.15.63:0/1842917713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff134066090 0x7ff1340ff7a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:26.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.333+0000 7ff13b78a700 1 -- 172.21.15.63:0/1842917713 >> 172.21.15.63:0/1842917713 conn(0x7ff1340f7190 msgr2=0x7ff1340f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:21:26.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.333+0000 7ff13b78a700 1 -- 172.21.15.63:0/1842917713 shutdown_connections 2023-12-07T16:21:26.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.333+0000 7ff13b78a700 1 -- 172.21.15.63:0/1842917713 wait complete. 2023-12-07T16:21:26.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.333+0000 7ff13b78a700 1 Processor -- start 2023-12-07T16:21:26.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.333+0000 7ff13b78a700 1 -- start start 2023-12-07T16:21:26.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.334+0000 7ff13b78a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff134066090 0x7ff13410d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:26.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.334+0000 7ff13b78a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1340ffd70 0x7ff13410da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:26.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.334+0000 7ff13b78a700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13410e010 con 0x7ff134066090 2023-12-07T16:21:26.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.334+0000 7ff13b78a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13410e8b0 con 0x7ff1340ffd70 2023-12-07T16:21:26.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.334+0000 7ff139526700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff134066090 0x7ff13410d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:26.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.334+0000 7ff139526700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff134066090 0x7ff13410d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48136/0 (socket says 172.21.15.63:48136) 2023-12-07T16:21:26.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.334+0000 7ff139526700 1 -- 172.21.15.63:0/3815363004 learned_addr learned my addr 172.21.15.63:0/3815363004 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:21:26.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.334+0000 7ff138d25700 1 --2- 172.21.15.63:0/3815363004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1340ffd70 0x7ff13410da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:26.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.334+0000 7ff139526700 1 -- 172.21.15.63:0/3815363004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1340ffd70 msgr2=0x7ff13410da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:26.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.334+0000 7ff139526700 1 --2- 172.21.15.63:0/3815363004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1340ffd70 0x7ff13410da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:26.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.334+0000 7ff139526700 1 -- 172.21.15.63:0/3815363004 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff130005040 con 0x7ff134066090 2023-12-07T16:21:26.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.334+0000 7ff139526700 1 --2- 172.21.15.63:0/3815363004 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff134066090 0x7ff13410d4d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff130000c00 tx=0x7ff130009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:21:26.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.334+0000 7ff129ffb700 1 -- 172.21.15.63:0/3815363004 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff130021070 con 0x7ff134066090 2023-12-07T16:21:26.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.335+0000 7ff13b78a700 1 -- 172.21.15.63:0/3815363004 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff13410eb30 con 0x7ff134066090 2023-12-07T16:21:26.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.335+0000 7ff13b78a700 1 -- 172.21.15.63:0/3815363004 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13410f010 con 0x7ff134066090 2023-12-07T16:21:26.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.335+0000 7ff129ffb700 1 -- 172.21.15.63:0/3815363004 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff13001c400 con 0x7ff134066090 2023-12-07T16:21:26.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.336+0000 7ff129ffb700 1 -- 172.21.15.63:0/3815363004 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff13000e070 con 0x7ff134066090 2023-12-07T16:21:26.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.337+0000 7ff129ffb700 1 -- 172.21.15.63:0/3815363004 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7ff13000b760 con 0x7ff134066090 2023-12-07T16:21:26.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.337+0000 7ff13b78a700 1 -- 172.21.15.63:0/3815363004 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13404bb80 con 0x7ff134066090 2023-12-07T16:21:26.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.337+0000 7ff129ffb700 1 --2- 172.21.15.63:0/3815363004 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7ff12006ae40 0x7ff12006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:26.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.337+0000 7ff129ffb700 1 -- 172.21.15.63:0/3815363004 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7ff13008ba10 con 0x7ff134066090 2023-12-07T16:21:26.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.337+0000 7ff138d25700 1 --2- 172.21.15.63:0/3815363004 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7ff12006ae40 0x7ff12006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:26.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.338+0000 7ff138d25700 1 --2- 172.21.15.63:0/3815363004 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7ff12006ae40 0x7ff12006d2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff124009b80 tx=0x7ff12400b040 comp rx=0 tx=0).ready entity=mgr.14614 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:21:26.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.342+0000 7ff129ffb700 1 -- 172.21.15.63:0/3815363004 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7ff1300597c0 con 0x7ff134066090 2023-12-07T16:21:26.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:25 smithi063 ceph-mon[112095]: pgmap v20: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 8.7 MiB/s wr, 599 op/s 2023-12-07T16:21:26.560 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.563+0000 7ff13b78a700 1 -- 172.21.15.63:0/3815363004 --> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff13410f450 con 0x7ff12006ae40 2023-12-07T16:21:26.561 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.565+0000 7ff129ffb700 1 -- 172.21.15.63:0/3815363004 <== mgr.14614 v2:172.21.15.152:6828/1927275654 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7ff13410f450 con 0x7ff12006ae40 2023-12-07T16:21:26.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.566+0000 7ff13b78a700 1 -- 172.21.15.63:0/3815363004 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7ff12006ae40 msgr2=0x7ff12006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:26.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.566+0000 7ff13b78a700 1 --2- 172.21.15.63:0/3815363004 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7ff12006ae40 0x7ff12006d2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff124009b80 tx=0x7ff12400b040 comp rx=0 tx=0).stop 2023-12-07T16:21:26.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.566+0000 7ff13b78a700 1 -- 172.21.15.63:0/3815363004 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff134066090 msgr2=0x7ff13410d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:26.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.566+0000 7ff13b78a700 1 --2- 172.21.15.63:0/3815363004 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff134066090 0x7ff13410d4d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff130000c00 tx=0x7ff130009e30 comp rx=0 tx=0).stop 2023-12-07T16:21:26.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.566+0000 7ff13b78a700 1 -- 172.21.15.63:0/3815363004 shutdown_connections 2023-12-07T16:21:26.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.566+0000 7ff13b78a700 1 --2- 172.21.15.63:0/3815363004 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7ff12006ae40 0x7ff12006d2f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:26.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.566+0000 7ff13b78a700 1 --2- 172.21.15.63:0/3815363004 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff134066090 0x7ff13410d4d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:26.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.566+0000 7ff13b78a700 1 --2- 172.21.15.63:0/3815363004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1340ffd70 0x7ff13410da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:26.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.566+0000 7ff13b78a700 1 -- 172.21.15.63:0/3815363004 >> 172.21.15.63:0/3815363004 conn(0x7ff1340f7190 msgr2=0x7ff1340f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:21:26.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.567+0000 7ff13b78a700 1 -- 172.21.15.63:0/3815363004 shutdown_connections 2023-12-07T16:21:26.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.567+0000 7ff13b78a700 1 -- 172.21.15.63:0/3815363004 wait complete. 2023-12-07T16:21:26.667 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.670+0000 7fb96ad84700 1 -- 172.21.15.63:0/3417478629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9640fbaf0 msgr2=0x7fb9640fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:26.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.670+0000 7fb96ad84700 1 --2- 172.21.15.63:0/3417478629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9640fbaf0 0x7fb9640fbf00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb958004940 tx=0x7fb958009e30 comp rx=0 tx=0).stop 2023-12-07T16:21:26.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.670+0000 7fb96ad84700 1 -- 172.21.15.63:0/3417478629 shutdown_connections 2023-12-07T16:21:26.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.670+0000 7fb96ad84700 1 --2- 172.21.15.63:0/3417478629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9640fcd00 0x7fb9640fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:26.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.670+0000 7fb96ad84700 1 --2- 172.21.15.63:0/3417478629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9640fbaf0 0x7fb9640fbf00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:26.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.670+0000 7fb96ad84700 1 -- 172.21.15.63:0/3417478629 >> 172.21.15.63:0/3417478629 conn(0x7fb9640f7190 msgr2=0x7fb9640f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:21:26.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.670+0000 7fb96ad84700 1 -- 172.21.15.63:0/3417478629 shutdown_connections 2023-12-07T16:21:26.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.670+0000 7fb96ad84700 1 -- 172.21.15.63:0/3417478629 wait complete. 2023-12-07T16:21:26.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.671+0000 7fb96ad84700 1 Processor -- start 2023-12-07T16:21:26.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.671+0000 7fb96ad84700 1 -- start start 2023-12-07T16:21:26.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.671+0000 7fb96ad84700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9640fbaf0 0x7fb9641102a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:26.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.671+0000 7fb96ad84700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9640fcd00 0x7fb9641127f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:26.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.671+0000 7fb96ad84700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb964066200 con 0x7fb9640fcd00 2023-12-07T16:21:26.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.671+0000 7fb96ad84700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb964066340 con 0x7fb9640fbaf0 2023-12-07T16:21:26.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.671+0000 7fb963fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9640fcd00 0x7fb9641127f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:26.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.671+0000 7fb963fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9640fcd00 0x7fb9641127f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48152/0 (socket says 172.21.15.63:48152) 2023-12-07T16:21:26.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.671+0000 7fb963fff700 1 -- 172.21.15.63:0/3638375734 learned_addr learned my addr 172.21.15.63:0/3638375734 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:21:26.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.671+0000 7fb968b20700 1 --2- 172.21.15.63:0/3638375734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9640fbaf0 0x7fb9641102a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:26.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.671+0000 7fb963fff700 1 -- 172.21.15.63:0/3638375734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9640fbaf0 msgr2=0x7fb9641102a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:26.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.671+0000 7fb963fff700 1 --2- 172.21.15.63:0/3638375734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9640fbaf0 0x7fb9641102a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:26.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.671+0000 7fb963fff700 1 -- 172.21.15.63:0/3638375734 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb958005040 con 0x7fb9640fcd00 2023-12-07T16:21:26.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.672+0000 7fb963fff700 1 --2- 172.21.15.63:0/3638375734 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9640fcd00 0x7fb9641127f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb95000b790 tx=0x7fb950009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:21:26.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.672+0000 7fb9617fa700 1 -- 172.21.15.63:0/3638375734 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb95000f6f0 con 0x7fb9640fcd00 2023-12-07T16:21:26.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.672+0000 7fb9617fa700 1 -- 172.21.15.63:0/3638375734 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb95000fd00 con 0x7fb9640fcd00 2023-12-07T16:21:26.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.672+0000 7fb96ad84700 1 -- 172.21.15.63:0/3638375734 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb964112ed0 con 0x7fb9640fcd00 2023-12-07T16:21:26.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.672+0000 7fb9617fa700 1 -- 172.21.15.63:0/3638375734 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9500103a0 con 0x7fb9640fcd00 2023-12-07T16:21:26.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.672+0000 7fb96ad84700 1 -- 172.21.15.63:0/3638375734 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9641133e0 con 0x7fb9640fcd00 2023-12-07T16:21:26.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.673+0000 7fb96ad84700 1 -- 172.21.15.63:0/3638375734 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb96404bb80 con 0x7fb9640fcd00 2023-12-07T16:21:26.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.673+0000 7fb9617fa700 1 -- 172.21.15.63:0/3638375734 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7fb95000f850 con 0x7fb9640fcd00 2023-12-07T16:21:26.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.674+0000 7fb9617fa700 1 --2- 172.21.15.63:0/3638375734 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7fb95406ae40 0x7fb95406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:26.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.674+0000 7fb9617fa700 1 -- 172.21.15.63:0/3638375734 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb950089540 con 0x7fb9640fcd00 2023-12-07T16:21:26.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.674+0000 7fb968b20700 1 --2- 172.21.15.63:0/3638375734 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7fb95406ae40 0x7fb95406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:26.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.674+0000 7fb968b20700 1 --2- 172.21.15.63:0/3638375734 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7fb95406ae40 0x7fb95406d2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb95800b7d0 tx=0x7fb958009e30 comp rx=0 tx=0).ready entity=mgr.14614 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:21:26.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.678+0000 7fb9617fa700 1 -- 172.21.15.63:0/3638375734 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fb950053970 con 0x7fb9640fcd00 2023-12-07T16:21:26.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.887+0000 7fb96ad84700 1 -- 172.21.15.63:0/3638375734 --> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb964101650 con 0x7fb95406ae40 2023-12-07T16:21:26.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.897+0000 7fb9617fa700 1 -- 172.21.15.63:0/3638375734 <== mgr.14614 v2:172.21.15.152:6828/1927275654 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7fb964101650 con 0x7fb95406ae40 2023-12-07T16:21:26.895 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-07T16:21:26.895 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 starting - - - - 2023-12-07T16:21:26.895 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (6m) 26s ago 6m 7428k - 17.2.7-115-g4f62d9ad fcdfd00f81c7 80bed1094ab4 2023-12-07T16:21:26.895 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi152 smithi152 running (5m) 27s ago 5m 7499k - 17.2.7-115-g4f62d9ad fcdfd00f81c7 e2cd5532384b 2023-12-07T16:21:26.895 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 starting - - - - 2023-12-07T16:21:26.895 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.gsjgcq smithi063 running (2m) 26s ago 2m 12.9M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 f70e4f098e4c 2023-12-07T16:21:26.895 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.yidolg smithi063 running (2m) 26s ago 2m 611M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5b053ef5fb7f 2023-12-07T16:21:26.895 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.aovwwd smithi152 running (2m) 27s ago 2m 13.8M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 80190948a595 2023-12-07T16:21:26.895 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.mrvngf smithi152 running (2m) 27s ago 2m 19.1M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5f60b893f840 2023-12-07T16:21:26.895 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.yohyyx smithi063 *:9283 running (7m) 26s ago 7m 444M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 e9b3a40f26fd 2023-12-07T16:21:26.895 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi152.sxayfb smithi152 *:8443,9283 running (45s) 27s ago 5m 498M - 19.0.0-13-ge6605fb8 104f332cd0a9 bfc7027421d2 2023-12-07T16:21:26.895 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (7m) 26s ago 7m 84.4M 2048M 17.2.7-115-g4f62d9ad fcdfd00f81c7 736281f5463c 2023-12-07T16:21:26.895 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi152 smithi152 running (5m) 27s ago 5m 55.5M 2048M 17.2.7-115-g4f62d9ad fcdfd00f81c7 ecfe3add39d6 2023-12-07T16:21:26.896 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 starting - - - - 2023-12-07T16:21:26.896 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi152 smithi152 *:9100 running (5m) 27s ago 5m 19.1M - 1.5.0 0da6a335fe13 fb0e82afe6a4 2023-12-07T16:21:26.896 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (4m) 26s ago 4m 127M 1568M 17.2.7-115-g4f62d9ad fcdfd00f81c7 bbdd7f82a7c3 2023-12-07T16:21:26.896 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (4m) 26s ago 4m 134M 1568M 17.2.7-115-g4f62d9ad fcdfd00f81c7 4372601f899e 2023-12-07T16:21:26.896 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (4m) 26s ago 4m 114M 1568M 17.2.7-115-g4f62d9ad fcdfd00f81c7 b0d432bbca05 2023-12-07T16:21:26.896 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi152 running (3m) 27s ago 3m 136M 2592M 17.2.7-115-g4f62d9ad fcdfd00f81c7 94d14402b489 2023-12-07T16:21:26.896 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi152 running (3m) 27s ago 3m 121M 2592M 17.2.7-115-g4f62d9ad fcdfd00f81c7 d3b8b2f12489 2023-12-07T16:21:26.896 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi152 running (3m) 27s ago 3m 125M 2592M 17.2.7-115-g4f62d9ad fcdfd00f81c7 e7f8d9f716bb 2023-12-07T16:21:26.896 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (4m) 26s ago 5m 57.5M - 2.43.0 a07b618ecd1d 32eb5a56be5e 2023-12-07T16:21:26.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.899+0000 7fb96ad84700 1 -- 172.21.15.63:0/3638375734 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7fb95406ae40 msgr2=0x7fb95406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:26.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.899+0000 7fb96ad84700 1 --2- 172.21.15.63:0/3638375734 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7fb95406ae40 0x7fb95406d2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb95800b7d0 tx=0x7fb958009e30 comp rx=0 tx=0).stop 2023-12-07T16:21:26.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.899+0000 7fb96ad84700 1 -- 172.21.15.63:0/3638375734 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9640fcd00 msgr2=0x7fb9641127f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:26.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.899+0000 7fb96ad84700 1 --2- 172.21.15.63:0/3638375734 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9640fcd00 0x7fb9641127f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb95000b790 tx=0x7fb950009250 comp rx=0 tx=0).stop 2023-12-07T16:21:26.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.899+0000 7fb96ad84700 1 -- 172.21.15.63:0/3638375734 shutdown_connections 2023-12-07T16:21:26.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.899+0000 7fb96ad84700 1 --2- 172.21.15.63:0/3638375734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9640fbaf0 0x7fb9641102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:26.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.899+0000 7fb96ad84700 1 --2- 172.21.15.63:0/3638375734 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7fb95406ae40 0x7fb95406d2f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:26.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.899+0000 7fb96ad84700 1 --2- 172.21.15.63:0/3638375734 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9640fcd00 0x7fb9641127f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:26.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.899+0000 7fb96ad84700 1 -- 172.21.15.63:0/3638375734 >> 172.21.15.63:0/3638375734 conn(0x7fb9640f7190 msgr2=0x7fb9640fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:21:26.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.899+0000 7fb96ad84700 1 -- 172.21.15.63:0/3638375734 shutdown_connections 2023-12-07T16:21:26.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:26.900+0000 7fb96ad84700 1 -- 172.21.15.63:0/3638375734 wait complete. 2023-12-07T16:21:27.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.004+0000 7f25229df700 1 -- 172.21.15.63:0/925423117 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f251c0660b0 msgr2=0x7f251c0ff780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:27.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.004+0000 7f25229df700 1 --2- 172.21.15.63:0/925423117 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f251c0660b0 0x7f251c0ff780 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f250c004940 tx=0x7f250c009e30 comp rx=0 tx=0).stop 2023-12-07T16:21:27.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.004+0000 7f25229df700 1 -- 172.21.15.63:0/925423117 shutdown_connections 2023-12-07T16:21:27.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.004+0000 7f25229df700 1 --2- 172.21.15.63:0/925423117 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f251c0ffd50 0x7f251c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:27.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.004+0000 7f25229df700 1 --2- 172.21.15.63:0/925423117 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f251c0660b0 0x7f251c0ff780 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:27.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.004+0000 7f25229df700 1 -- 172.21.15.63:0/925423117 >> 172.21.15.63:0/925423117 conn(0x7f251c0f7190 msgr2=0x7f251c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:21:27.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.004+0000 7f25229df700 1 -- 172.21.15.63:0/925423117 shutdown_connections 2023-12-07T16:21:27.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.004+0000 7f25229df700 1 -- 172.21.15.63:0/925423117 wait complete. 2023-12-07T16:21:27.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.005+0000 7f25229df700 1 Processor -- start 2023-12-07T16:21:27.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.005+0000 7f25229df700 1 -- start start 2023-12-07T16:21:27.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.005+0000 7f25229df700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f251c0660b0 0x7f251c10d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:27.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.005+0000 7f25229df700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f251c0ffd50 0x7f251c10da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:27.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.005+0000 7f25229df700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c10e070 con 0x7f251c0660b0 2023-12-07T16:21:27.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.005+0000 7f25229df700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c10e910 con 0x7f251c0ffd50 2023-12-07T16:21:27.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.005+0000 7f251bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f251c0660b0 0x7f251c10d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:27.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.005+0000 7f251bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f251c0660b0 0x7f251c10d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48168/0 (socket says 172.21.15.63:48168) 2023-12-07T16:21:27.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.005+0000 7f251bfff700 1 -- 172.21.15.63:0/2000303089 learned_addr learned my addr 172.21.15.63:0/2000303089 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:21:27.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.005+0000 7f251b7fe700 1 --2- 172.21.15.63:0/2000303089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f251c0ffd50 0x7f251c10da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:27.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.005+0000 7f251bfff700 1 -- 172.21.15.63:0/2000303089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f251c0ffd50 msgr2=0x7f251c10da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:27.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.005+0000 7f251bfff700 1 --2- 172.21.15.63:0/2000303089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f251c0ffd50 0x7f251c10da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:27.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.005+0000 7f251bfff700 1 -- 172.21.15.63:0/2000303089 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250c005040 con 0x7f251c0660b0 2023-12-07T16:21:27.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.005+0000 7f251b7fe700 1 --2- 172.21.15.63:0/2000303089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f251c0ffd50 0x7f251c10da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T16:21:27.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.006+0000 7f251bfff700 1 --2- 172.21.15.63:0/2000303089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f251c0660b0 0x7f251c10d530 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f250c009fd0 tx=0x7f250c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:21:27.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.006+0000 7f2518ff9700 1 -- 172.21.15.63:0/2000303089 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f250c00e040 con 0x7f251c0660b0 2023-12-07T16:21:27.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.006+0000 7f2518ff9700 1 -- 172.21.15.63:0/2000303089 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f250c004290 con 0x7f251c0660b0 2023-12-07T16:21:27.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.006+0000 7f25229df700 1 -- 172.21.15.63:0/2000303089 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f251c10eb90 con 0x7f251c0660b0 2023-12-07T16:21:27.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.006+0000 7f2518ff9700 1 -- 172.21.15.63:0/2000303089 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f250c01c3f0 con 0x7f251c0660b0 2023-12-07T16:21:27.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.006+0000 7f25229df700 1 -- 172.21.15.63:0/2000303089 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251c10f0d0 con 0x7f251c0660b0 2023-12-07T16:21:27.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.007+0000 7f25229df700 1 -- 172.21.15.63:0/2000303089 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251c1075c0 con 0x7f251c0660b0 2023-12-07T16:21:27.006 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.007+0000 7f2518ff9700 1 -- 172.21.15.63:0/2000303089 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f250c013420 con 0x7f251c0660b0 2023-12-07T16:21:27.006 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.008+0000 7f2518ff9700 1 --2- 172.21.15.63:0/2000303089 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f250406ae40 0x7f250406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:27.006 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.008+0000 7f2518ff9700 1 -- 172.21.15.63:0/2000303089 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f250c08abf0 con 0x7f251c0660b0 2023-12-07T16:21:27.006 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.008+0000 7f251b7fe700 1 --2- 172.21.15.63:0/2000303089 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f250406ae40 0x7f250406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:27.006 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.009+0000 7f251b7fe700 1 --2- 172.21.15.63:0/2000303089 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f250406ae40 0x7f250406d2f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2510007fd0 tx=0x7f2510009040 comp rx=0 tx=0).ready entity=mgr.14614 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:21:27.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.012+0000 7f2518ff9700 1 -- 172.21.15.63:0/2000303089 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f250c091080 con 0x7f251c0660b0 2023-12-07T16:21:27.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.321+0000 7f25229df700 1 -- 172.21.15.63:0/2000303089 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f251c02b0e0 con 0x7f251c0660b0 2023-12-07T16:21:27.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.321+0000 7f2518ff9700 1 -- 172.21.15.63:0/2000303089 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+840 (secure 0 0 0) 0x7f250c0589a0 con 0x7f251c0660b0 2023-12-07T16:21:27.318 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:21:27.318 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-07T16:21:27.318 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 2 2023-12-07T16:21:27.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:21:27.319 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-07T16:21:27.319 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 1, 2023-12-07T16:21:27.319 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 1 2023-12-07T16:21:27.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:21:27.319 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-07T16:21:27.319 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 6 2023-12-07T16:21:27.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:21:27.319 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-07T16:21:27.319 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 4 2023-12-07T16:21:27.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:21:27.319 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-07T16:21:27.319 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 13, 2023-12-07T16:21:27.319 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 1 2023-12-07T16:21:27.319 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-07T16:21:27.319 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:21:27.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.323+0000 7f25229df700 1 -- 172.21.15.63:0/2000303089 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f250406ae40 msgr2=0x7f250406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:27.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.323+0000 7f25229df700 1 --2- 172.21.15.63:0/2000303089 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f250406ae40 0x7f250406d2f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2510007fd0 tx=0x7f2510009040 comp rx=0 tx=0).stop 2023-12-07T16:21:27.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.323+0000 7f25229df700 1 -- 172.21.15.63:0/2000303089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f251c0660b0 msgr2=0x7f251c10d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:27.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.323+0000 7f25229df700 1 --2- 172.21.15.63:0/2000303089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f251c0660b0 0x7f251c10d530 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f250c009fd0 tx=0x7f250c009e30 comp rx=0 tx=0).stop 2023-12-07T16:21:27.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.323+0000 7f25229df700 1 -- 172.21.15.63:0/2000303089 shutdown_connections 2023-12-07T16:21:27.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.323+0000 7f25229df700 1 --2- 172.21.15.63:0/2000303089 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f250406ae40 0x7f250406d2f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:27.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.323+0000 7f25229df700 1 --2- 172.21.15.63:0/2000303089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f251c0660b0 0x7f251c10d530 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:27.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.323+0000 7f25229df700 1 --2- 172.21.15.63:0/2000303089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f251c0ffd50 0x7f251c10da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:27.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.323+0000 7f25229df700 1 -- 172.21.15.63:0/2000303089 >> 172.21.15.63:0/2000303089 conn(0x7f251c0f7190 msgr2=0x7f251c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:21:27.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.323+0000 7f25229df700 1 -- 172.21.15.63:0/2000303089 shutdown_connections 2023-12-07T16:21:27.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.323+0000 7f25229df700 1 -- 172.21.15.63:0/2000303089 wait complete. 2023-12-07T16:21:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.427+0000 7f0092827700 1 -- 172.21.15.63:0/608977815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f008c0fbaf0 msgr2=0x7f008c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.427+0000 7f0092827700 1 --2- 172.21.15.63:0/608977815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f008c0fbaf0 0x7f008c0fbf00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f007c004940 tx=0x7f007c009e30 comp rx=0 tx=0).stop 2023-12-07T16:21:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.427+0000 7f0092827700 1 -- 172.21.15.63:0/608977815 shutdown_connections 2023-12-07T16:21:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.427+0000 7f0092827700 1 --2- 172.21.15.63:0/608977815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f008c0fcd00 0x7f008c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.427+0000 7f0092827700 1 --2- 172.21.15.63:0/608977815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f008c0fbaf0 0x7f008c0fbf00 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:27.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.427+0000 7f0092827700 1 -- 172.21.15.63:0/608977815 >> 172.21.15.63:0/608977815 conn(0x7f008c0f7190 msgr2=0x7f008c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:21:27.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.427+0000 7f0092827700 1 -- 172.21.15.63:0/608977815 shutdown_connections 2023-12-07T16:21:27.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.427+0000 7f0092827700 1 -- 172.21.15.63:0/608977815 wait complete. 2023-12-07T16:21:27.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.427+0000 7f0092827700 1 Processor -- start 2023-12-07T16:21:27.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.428+0000 7f0092827700 1 -- start start 2023-12-07T16:21:27.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.428+0000 7f0092827700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f008c0fbaf0 0x7f008c10c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:27.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.428+0000 7f0092827700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f008c0fcd00 0x7f008c10c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:27.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.428+0000 7f0092827700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c10cfc0 con 0x7f008c0fbaf0 2023-12-07T16:21:27.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.428+0000 7f0092827700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c10d860 con 0x7f008c0fcd00 2023-12-07T16:21:27.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.428+0000 7f008bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f008c0fbaf0 0x7f008c10c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:27.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.428+0000 7f008bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f008c0fbaf0 0x7f008c10c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48184/0 (socket says 172.21.15.63:48184) 2023-12-07T16:21:27.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.428+0000 7f008bfff700 1 -- 172.21.15.63:0/3342878529 learned_addr learned my addr 172.21.15.63:0/3342878529 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:21:27.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.428+0000 7f0083fff700 1 --2- 172.21.15.63:0/3342878529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f008c0fcd00 0x7f008c10c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:27.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.428+0000 7f008bfff700 1 -- 172.21.15.63:0/3342878529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f008c0fcd00 msgr2=0x7f008c10c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:27.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.428+0000 7f008bfff700 1 --2- 172.21.15.63:0/3342878529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f008c0fcd00 0x7f008c10c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:27.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.428+0000 7f008bfff700 1 -- 172.21.15.63:0/3342878529 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007c005040 con 0x7f008c0fbaf0 2023-12-07T16:21:27.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.428+0000 7f008bfff700 1 --2- 172.21.15.63:0/3342878529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f008c0fbaf0 0x7f008c10c480 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f007c009360 tx=0x7f007c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:21:27.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.429+0000 7f00897fa700 1 -- 172.21.15.63:0/3342878529 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f007c00e040 con 0x7f008c0fbaf0 2023-12-07T16:21:27.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.429+0000 7f00897fa700 1 -- 172.21.15.63:0/3342878529 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f007c004290 con 0x7f008c0fbaf0 2023-12-07T16:21:27.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.429+0000 7f0092827700 1 -- 172.21.15.63:0/3342878529 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008c10dae0 con 0x7f008c0fbaf0 2023-12-07T16:21:27.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.429+0000 7f00897fa700 1 -- 172.21.15.63:0/3342878529 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f007c013880 con 0x7f008c0fbaf0 2023-12-07T16:21:27.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.429+0000 7f0092827700 1 -- 172.21.15.63:0/3342878529 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f008c10e020 con 0x7f008c0fbaf0 2023-12-07T16:21:27.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.430+0000 7f00897fa700 1 -- 172.21.15.63:0/3342878529 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f007c013b40 con 0x7f008c0fbaf0 2023-12-07T16:21:27.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.430+0000 7f0092827700 1 -- 172.21.15.63:0/3342878529 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f008c04bb80 con 0x7f008c0fbaf0 2023-12-07T16:21:27.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.430+0000 7f00897fa700 1 --2- 172.21.15.63:0/3342878529 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f007806ae40 0x7f007806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:27.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.430+0000 7f00897fa700 1 -- 172.21.15.63:0/3342878529 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f007c08f460 con 0x7f008c0fbaf0 2023-12-07T16:21:27.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.431+0000 7f0083fff700 1 --2- 172.21.15.63:0/3342878529 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f007806ae40 0x7f007806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:27.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.431+0000 7f0083fff700 1 --2- 172.21.15.63:0/3342878529 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f007806ae40 0x7f007806d2f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0074004f40 tx=0x7f007400b040 comp rx=0 tx=0).ready entity=mgr.14614 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:21:27.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.435+0000 7f00897fa700 1 -- 172.21.15.63:0/3342878529 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f007c05d190 con 0x7f008c0fbaf0 2023-12-07T16:21:27.677 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.680+0000 7f0092827700 1 -- 172.21.15.63:0/3342878529 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f008c10e2c0 con 0x7f008c0fbaf0 2023-12-07T16:21:27.677 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.680+0000 7f00897fa700 1 -- 172.21.15.63:0/3342878529 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1836 (secure 0 0 0) 0x7f007c023740 con 0x7f008c0fbaf0 2023-12-07T16:21:27.678 INFO:teuthology.orchestra.run.smithi063.stdout:e16 2023-12-07T16:21:27.678 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-07T16:21:27.678 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:21:27.678 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-07T16:21:27.678 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:21:27.678 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-07T16:21:27.678 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-07T16:21:27.678 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 16 2023-12-07T16:21:27.678 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-07T16:21:27.678 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-07T16:19:08.352640+0000 2023-12-07T16:21:27.678 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-07T16:21:04.340763+0000 2023-12-07T16:21:27.678 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-07T16:21:27.678 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-07T16:21:27.679 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-07T16:21:27.679 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-07T16:21:27.679 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-07T16:21:27.679 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-07T16:21:27.679 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-07T16:21:27.679 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 45 2023-12-07T16:21:27.679 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:21:27.679 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 2 2023-12-07T16:21:27.679 INFO:teuthology.orchestra.run.smithi063.stdout:in 0,1 2023-12-07T16:21:27.679 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14478,1=24269} 2023-12-07T16:21:27.679 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-07T16:21:27.679 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-07T16:21:27.679 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-07T16:21:27.679 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-07T16:21:27.679 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-07T16:21:27.679 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-07T16:21:27.679 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-07T16:21:27.680 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-07T16:21:27.680 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.yidolg{0:14478} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:21:27.680 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.mrvngf{1:24269} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.152:6824/3157779064,v1:172.21.15.152:6825/3157779064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:21:27.680 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:21:27.680 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:21:27.680 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-07T16:21:27.680 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:21:27.680 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.gsjgcq{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/3063200414,v1:172.21.15.63:6827/3063200414] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:21:27.680 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.aovwwd{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/2906349729,v1:172.21.15.152:6827/2906349729] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:21:27.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.682+0000 7f0092827700 1 -- 172.21.15.63:0/3342878529 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f007806ae40 msgr2=0x7f007806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:27.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.682+0000 7f0092827700 1 --2- 172.21.15.63:0/3342878529 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f007806ae40 0x7f007806d2f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0074004f40 tx=0x7f007400b040 comp rx=0 tx=0).stop 2023-12-07T16:21:27.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.682+0000 7f0092827700 1 -- 172.21.15.63:0/3342878529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f008c0fbaf0 msgr2=0x7f008c10c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:27.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.682+0000 7f0092827700 1 --2- 172.21.15.63:0/3342878529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f008c0fbaf0 0x7f008c10c480 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f007c009360 tx=0x7f007c009e30 comp rx=0 tx=0).stop 2023-12-07T16:21:27.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.683+0000 7f0092827700 1 -- 172.21.15.63:0/3342878529 shutdown_connections 2023-12-07T16:21:27.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.683+0000 7f0092827700 1 --2- 172.21.15.63:0/3342878529 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f007806ae40 0x7f007806d2f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:27.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.683+0000 7f0092827700 1 --2- 172.21.15.63:0/3342878529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f008c0fbaf0 0x7f008c10c480 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:27.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.683+0000 7f0092827700 1 --2- 172.21.15.63:0/3342878529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f008c0fcd00 0x7f008c10c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:27.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.683+0000 7f0092827700 1 -- 172.21.15.63:0/3342878529 >> 172.21.15.63:0/3342878529 conn(0x7f008c0f7190 msgr2=0x7f008c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:21:27.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.683+0000 7f0092827700 1 -- 172.21.15.63:0/3342878529 shutdown_connections 2023-12-07T16:21:27.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.683+0000 7f0092827700 1 -- 172.21.15.63:0/3342878529 wait complete. 2023-12-07T16:21:27.681 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 16 2023-12-07T16:21:27.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.786+0000 7f157215b700 1 -- 172.21.15.63:0/2163958586 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f156c0fcd10 msgr2=0x7f156c0fd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:27.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.786+0000 7f157215b700 1 --2- 172.21.15.63:0/2163958586 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f156c0fcd10 0x7f156c0fd160 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1560004940 tx=0x7f1560009e30 comp rx=0 tx=0).stop 2023-12-07T16:21:27.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.786+0000 7f157215b700 1 -- 172.21.15.63:0/2163958586 shutdown_connections 2023-12-07T16:21:27.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.786+0000 7f157215b700 1 --2- 172.21.15.63:0/2163958586 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f156c0fcd10 0x7f156c0fd160 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:27.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.786+0000 7f157215b700 1 --2- 172.21.15.63:0/2163958586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f156c0fbb00 0x7f156c0fbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:27.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.786+0000 7f157215b700 1 -- 172.21.15.63:0/2163958586 >> 172.21.15.63:0/2163958586 conn(0x7f156c0f71c0 msgr2=0x7f156c0f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:21:27.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.786+0000 7f157215b700 1 -- 172.21.15.63:0/2163958586 shutdown_connections 2023-12-07T16:21:27.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.786+0000 7f157215b700 1 -- 172.21.15.63:0/2163958586 wait complete. 2023-12-07T16:21:27.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.787+0000 7f157215b700 1 Processor -- start 2023-12-07T16:21:27.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.787+0000 7f157215b700 1 -- start start 2023-12-07T16:21:27.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.787+0000 7f157215b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f156c0fbb00 0x7f156c110220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:27.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.787+0000 7f157215b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f156c0fcd10 0x7f156c112770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:27.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.787+0000 7f157215b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c0669a0 con 0x7f156c0fbb00 2023-12-07T16:21:27.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.787+0000 7f157215b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c066ae0 con 0x7f156c0fcd10 2023-12-07T16:21:27.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.787+0000 7f156b7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f156c0fbb00 0x7f156c110220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:27.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.787+0000 7f156b7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f156c0fbb00 0x7f156c110220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48212/0 (socket says 172.21.15.63:48212) 2023-12-07T16:21:27.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.787+0000 7f156b7fe700 1 -- 172.21.15.63:0/75559850 learned_addr learned my addr 172.21.15.63:0/75559850 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:21:27.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.788+0000 7f156affd700 1 --2- 172.21.15.63:0/75559850 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f156c0fcd10 0x7f156c112770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:27.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.788+0000 7f156b7fe700 1 -- 172.21.15.63:0/75559850 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f156c0fcd10 msgr2=0x7f156c112770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:27.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.788+0000 7f156b7fe700 1 --2- 172.21.15.63:0/75559850 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f156c0fcd10 0x7f156c112770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:27.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.788+0000 7f156b7fe700 1 -- 172.21.15.63:0/75559850 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1560005040 con 0x7f156c0fbb00 2023-12-07T16:21:27.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.788+0000 7f156b7fe700 1 --2- 172.21.15.63:0/75559850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f156c0fbb00 0x7f156c110220 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f155c002a80 tx=0x7f155c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:21:27.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.788+0000 7f1553fff700 1 -- 172.21.15.63:0/75559850 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f155c007cc0 con 0x7f156c0fbb00 2023-12-07T16:21:27.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.788+0000 7f1553fff700 1 -- 172.21.15.63:0/75559850 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f155c00f040 con 0x7f156c0fbb00 2023-12-07T16:21:27.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.788+0000 7f157215b700 1 -- 172.21.15.63:0/75559850 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156c112d70 con 0x7f156c0fbb00 2023-12-07T16:21:27.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.788+0000 7f1553fff700 1 -- 172.21.15.63:0/75559850 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f155c00d9c0 con 0x7f156c0fbb00 2023-12-07T16:21:27.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.788+0000 7f157215b700 1 -- 172.21.15.63:0/75559850 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156c1131f0 con 0x7f156c0fbb00 2023-12-07T16:21:27.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.789+0000 7f157215b700 1 -- 172.21.15.63:0/75559850 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156c04bb80 con 0x7f156c0fbb00 2023-12-07T16:21:27.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.790+0000 7f1553fff700 1 -- 172.21.15.63:0/75559850 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f155c00db40 con 0x7f156c0fbb00 2023-12-07T16:21:27.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.790+0000 7f1553fff700 1 --2- 172.21.15.63:0/75559850 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f155406ae40 0x7f155406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:27.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.790+0000 7f1553fff700 1 -- 172.21.15.63:0/75559850 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f155c0894d0 con 0x7f156c0fbb00 2023-12-07T16:21:27.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.791+0000 7f156affd700 1 --2- 172.21.15.63:0/75559850 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f155406ae40 0x7f155406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:27.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.791+0000 7f156affd700 1 --2- 172.21.15.63:0/75559850 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f155406ae40 0x7f155406d2f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1560004890 tx=0x7f1560009e30 comp rx=0 tx=0).ready entity=mgr.14614 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:21:27.792 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:27.795+0000 7f1553fff700 1 -- 172.21.15.63:0/75559850 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f155c0537f0 con 0x7f156c0fbb00 2023-12-07T16:21:28.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.012+0000 7f157215b700 1 -- 172.21.15.63:0/75559850 --> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f156c101660 con 0x7f155406ae40 2023-12-07T16:21:28.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.014+0000 7f1553fff700 1 -- 172.21.15.63:0/75559850 <== mgr.14614 v2:172.21.15.152:6828/1927275654 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f156c101660 con 0x7f155406ae40 2023-12-07T16:21:28.011 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:21:28.011 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-07T16:21:28.011 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-07T16:21:28.011 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-07T16:21:28.011 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [], 2023-12-07T16:21:28.012 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "1/21 daemons upgraded", 2023-12-07T16:21:28.012 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "", 2023-12-07T16:21:28.012 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-07T16:21:28.012 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:21:28.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.016+0000 7f157215b700 1 -- 172.21.15.63:0/75559850 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f155406ae40 msgr2=0x7f155406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:28.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.016+0000 7f157215b700 1 --2- 172.21.15.63:0/75559850 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f155406ae40 0x7f155406d2f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1560004890 tx=0x7f1560009e30 comp rx=0 tx=0).stop 2023-12-07T16:21:28.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.016+0000 7f157215b700 1 -- 172.21.15.63:0/75559850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f156c0fbb00 msgr2=0x7f156c110220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:28.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.016+0000 7f157215b700 1 --2- 172.21.15.63:0/75559850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f156c0fbb00 0x7f156c110220 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f155c002a80 tx=0x7f155c004600 comp rx=0 tx=0).stop 2023-12-07T16:21:28.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.016+0000 7f157215b700 1 -- 172.21.15.63:0/75559850 shutdown_connections 2023-12-07T16:21:28.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.016+0000 7f157215b700 1 --2- 172.21.15.63:0/75559850 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f155406ae40 0x7f155406d2f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:28.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.016+0000 7f157215b700 1 --2- 172.21.15.63:0/75559850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f156c0fbb00 0x7f156c110220 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:28.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.016+0000 7f157215b700 1 --2- 172.21.15.63:0/75559850 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f156c0fcd10 0x7f156c112770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:28.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.016+0000 7f157215b700 1 -- 172.21.15.63:0/75559850 >> 172.21.15.63:0/75559850 conn(0x7f156c0f71c0 msgr2=0x7f156c0fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:21:28.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.016+0000 7f157215b700 1 -- 172.21.15.63:0/75559850 shutdown_connections 2023-12-07T16:21:28.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.016+0000 7f157215b700 1 -- 172.21.15.63:0/75559850 wait complete. 2023-12-07T16:21:28.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.120+0000 7f8bb56cb700 1 -- 172.21.15.63:0/1056924678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bb00fd120 msgr2=0x7f8bb00fd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:28.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.120+0000 7f8bb56cb700 1 --2- 172.21.15.63:0/1056924678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bb00fd120 0x7f8bb00fd530 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0004940 tx=0x7f8ba0009e30 comp rx=0 tx=0).stop 2023-12-07T16:21:28.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.121+0000 7f8bb56cb700 1 -- 172.21.15.63:0/1056924678 shutdown_connections 2023-12-07T16:21:28.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.121+0000 7f8bb56cb700 1 --2- 172.21.15.63:0/1056924678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb00fbe30 0x7f8bb00fc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:28.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.121+0000 7f8bb56cb700 1 --2- 172.21.15.63:0/1056924678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bb00fd120 0x7f8bb00fd530 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:28.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.121+0000 7f8bb56cb700 1 -- 172.21.15.63:0/1056924678 >> 172.21.15.63:0/1056924678 conn(0x7f8bb00f6950 msgr2=0x7f8bb00f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:21:28.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.121+0000 7f8bb56cb700 1 -- 172.21.15.63:0/1056924678 shutdown_connections 2023-12-07T16:21:28.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.121+0000 7f8bb56cb700 1 -- 172.21.15.63:0/1056924678 wait complete. 2023-12-07T16:21:28.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.121+0000 7f8bb56cb700 1 Processor -- start 2023-12-07T16:21:28.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.121+0000 7f8bb56cb700 1 -- start start 2023-12-07T16:21:28.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.122+0000 7f8bb56cb700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bb00fbe30 0x7f8bb010c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:28.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.122+0000 7f8bb56cb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb00fd120 0x7f8bb010ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:28.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.122+0000 7f8bb56cb700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb010d070 con 0x7f8bb00fbe30 2023-12-07T16:21:28.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.122+0000 7f8bb56cb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb010d910 con 0x7f8bb00fd120 2023-12-07T16:21:28.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.122+0000 7f8baeffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bb00fbe30 0x7f8bb010c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:28.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.122+0000 7f8baeffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bb00fbe30 0x7f8bb010c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48234/0 (socket says 172.21.15.63:48234) 2023-12-07T16:21:28.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.122+0000 7f8baeffd700 1 -- 172.21.15.63:0/2839917890 learned_addr learned my addr 172.21.15.63:0/2839917890 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:21:28.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.122+0000 7f8bae7fc700 1 --2- 172.21.15.63:0/2839917890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb00fd120 0x7f8bb010ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:28.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.122+0000 7f8baeffd700 1 -- 172.21.15.63:0/2839917890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb00fd120 msgr2=0x7f8bb010ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:28.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.122+0000 7f8baeffd700 1 --2- 172.21.15.63:0/2839917890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb00fd120 0x7f8bb010ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:28.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.122+0000 7f8baeffd700 1 -- 172.21.15.63:0/2839917890 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba0005040 con 0x7f8bb00fbe30 2023-12-07T16:21:28.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.122+0000 7f8baeffd700 1 --2- 172.21.15.63:0/2839917890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bb00fbe30 0x7f8bb010c530 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0009390 tx=0x7f8ba0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:21:28.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.122+0000 7f8b977fe700 1 -- 172.21.15.63:0/2839917890 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ba000e040 con 0x7f8bb00fbe30 2023-12-07T16:21:28.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.123+0000 7f8b977fe700 1 -- 172.21.15.63:0/2839917890 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8ba0004290 con 0x7f8bb00fbe30 2023-12-07T16:21:28.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.123+0000 7f8bb56cb700 1 -- 172.21.15.63:0/2839917890 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb010db90 con 0x7f8bb00fbe30 2023-12-07T16:21:28.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.123+0000 7f8b977fe700 1 -- 172.21.15.63:0/2839917890 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ba0013660 con 0x7f8bb00fbe30 2023-12-07T16:21:28.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.123+0000 7f8bb56cb700 1 -- 172.21.15.63:0/2839917890 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb010e070 con 0x7f8bb00fbe30 2023-12-07T16:21:28.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.124+0000 7f8bb56cb700 1 -- 172.21.15.63:0/2839917890 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb004bb80 con 0x7f8bb00fbe30 2023-12-07T16:21:28.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.124+0000 7f8b977fe700 1 -- 172.21.15.63:0/2839917890 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f8ba001e9d0 con 0x7f8bb00fbe30 2023-12-07T16:21:28.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.125+0000 7f8b977fe700 1 --2- 172.21.15.63:0/2839917890 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f8b9806ae40 0x7f8b9806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:28.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.125+0000 7f8b977fe700 1 -- 172.21.15.63:0/2839917890 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f8ba008d730 con 0x7f8bb00fbe30 2023-12-07T16:21:28.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.125+0000 7f8bae7fc700 1 --2- 172.21.15.63:0/2839917890 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f8b9806ae40 0x7f8b9806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:28.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.126+0000 7f8bae7fc700 1 --2- 172.21.15.63:0/2839917890 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f8b9806ae40 0x7f8b9806d2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4004f40 tx=0x7f8ba400b040 comp rx=0 tx=0).ready entity=mgr.14614 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:21:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.129+0000 7f8b977fe700 1 -- 172.21.15.63:0/2839917890 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f8ba005b460 con 0x7f8bb00fbe30 2023-12-07T16:21:28.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:27 smithi152 ceph-mon[121113]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:21:28.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:27 smithi152 ceph-mon[121113]: from='client.14674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:21:28.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:27 smithi152 ceph-mon[121113]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:21:28.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:27 smithi152 ceph-mon[121113]: pgmap v21: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 8.7 MiB/s wr, 599 op/s 2023-12-07T16:21:28.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:27 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/2000303089' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:21:28.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:27 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/3342878529' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:21:28.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:27 smithi063 ceph-mon[112095]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:21:28.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:27 smithi063 ceph-mon[112095]: from='client.14674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:21:28.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:27 smithi063 ceph-mon[112095]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:21:28.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:27 smithi063 ceph-mon[112095]: pgmap v21: 65 pgs: 65 active+clean; 223 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 8.7 MiB/s wr, 599 op/s 2023-12-07T16:21:28.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:27 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2000303089' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:21:28.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:27 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/3342878529' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:21:28.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.433+0000 7f8bb56cb700 1 -- 172.21.15.63:0/2839917890 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8bb010e2e0 con 0x7f8bb00fbe30 2023-12-07T16:21:28.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.433+0000 7f8b977fe700 1 -- 172.21.15.63:0/2839917890 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f8ba005aff0 con 0x7f8bb00fbe30 2023-12-07T16:21:28.431 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-07T16:21:28.431 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-07T16:21:28.431 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-07T16:21:28.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.435+0000 7f8bb56cb700 1 -- 172.21.15.63:0/2839917890 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f8b9806ae40 msgr2=0x7f8b9806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:28.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.435+0000 7f8bb56cb700 1 --2- 172.21.15.63:0/2839917890 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f8b9806ae40 0x7f8b9806d2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4004f40 tx=0x7f8ba400b040 comp rx=0 tx=0).stop 2023-12-07T16:21:28.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.435+0000 7f8bb56cb700 1 -- 172.21.15.63:0/2839917890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bb00fbe30 msgr2=0x7f8bb010c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:28.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.435+0000 7f8bb56cb700 1 --2- 172.21.15.63:0/2839917890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bb00fbe30 0x7f8bb010c530 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0009390 tx=0x7f8ba0009e30 comp rx=0 tx=0).stop 2023-12-07T16:21:28.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.435+0000 7f8bb56cb700 1 -- 172.21.15.63:0/2839917890 shutdown_connections 2023-12-07T16:21:28.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.435+0000 7f8bb56cb700 1 --2- 172.21.15.63:0/2839917890 >> [v2:172.21.15.152:6828/1927275654,v1:172.21.15.152:6829/1927275654] conn(0x7f8b9806ae40 0x7f8b9806d2f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:28.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.435+0000 7f8bb56cb700 1 --2- 172.21.15.63:0/2839917890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bb00fbe30 0x7f8bb010c530 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:28.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.435+0000 7f8bb56cb700 1 --2- 172.21.15.63:0/2839917890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bb00fd120 0x7f8bb010ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:28.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.435+0000 7f8bb56cb700 1 -- 172.21.15.63:0/2839917890 >> 172.21.15.63:0/2839917890 conn(0x7f8bb00f6950 msgr2=0x7f8bb00f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:21:28.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.435+0000 7f8bb56cb700 1 -- 172.21.15.63:0/2839917890 shutdown_connections 2023-12-07T16:21:28.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:28.435+0000 7f8bb56cb700 1 -- 172.21.15.63:0/2839917890 wait complete. 2023-12-07T16:21:28.861 INFO:tasks.workunit.client.1.smithi152.stdout:3/5: sync 2023-12-07T16:21:28.861 INFO:tasks.workunit.client.1.smithi152.stdout:3/6: fdatasync - no filename 2023-12-07T16:21:28.861 INFO:tasks.workunit.client.1.smithi152.stdout:3/7: fsync - no filename 2023-12-07T16:21:28.861 INFO:tasks.workunit.client.1.smithi152.stdout:3/8: write - no filename 2023-12-07T16:21:28.863 INFO:tasks.workunit.client.1.smithi152.stdout:3/9: creat f0 x:0 0 0 2023-12-07T16:21:28.863 INFO:tasks.workunit.client.1.smithi152.stdout:3/10: dread - f0 zero size 2023-12-07T16:21:28.863 INFO:tasks.workunit.client.1.smithi152.stdout:3/11: dread - f0 zero size 2023-12-07T16:21:28.863 INFO:tasks.workunit.client.1.smithi152.stdout:3/12: truncate f0 821414 0 2023-12-07T16:21:28.864 INFO:tasks.workunit.client.1.smithi152.stdout:3/13: dread f0 [0,4194304] 0 2023-12-07T16:21:28.865 INFO:tasks.workunit.client.1.smithi152.stdout:3/14: mkdir d1 0 2023-12-07T16:21:28.865 INFO:tasks.workunit.client.1.smithi152.stdout:3/15: chown d1 2511485 1 2023-12-07T16:21:28.865 INFO:tasks.workunit.client.1.smithi152.stdout:3/16: dread f0 [0,4194304] 0 2023-12-07T16:21:28.882 INFO:tasks.workunit.client.1.smithi152.stdout:3/17: dwrite f0 [0,4194304] 0 2023-12-07T16:21:28.885 INFO:tasks.workunit.client.1.smithi152.stdout:3/18: write f0 [2728928,8714] 0 2023-12-07T16:21:28.885 INFO:tasks.workunit.client.1.smithi152.stdout:3/19: write f0 [2793386,93297] 0 2023-12-07T16:21:28.887 INFO:tasks.workunit.client.1.smithi152.stdout:3/20: rmdir d1 0 2023-12-07T16:21:28.905 INFO:tasks.workunit.client.1.smithi152.stdout:3/21: dwrite f0 [0,4194304] 0 2023-12-07T16:21:28.919 INFO:tasks.workunit.client.1.smithi152.stdout:3/22: dwrite f0 [0,4194304] 0 2023-12-07T16:21:28.920 INFO:tasks.workunit.client.1.smithi152.stdout:3/23: write f0 [1836549,70366] 0 2023-12-07T16:21:28.937 INFO:tasks.workunit.client.1.smithi152.stdout:3/24: dwrite f0 [0,4194304] 0 2023-12-07T16:21:28.937 INFO:tasks.workunit.client.1.smithi152.stdout:3/25: fsync f0 0 2023-12-07T16:21:28.939 INFO:tasks.workunit.client.1.smithi152.stdout:3/26: link f0 f2 0 2023-12-07T16:21:28.939 INFO:tasks.workunit.client.1.smithi152.stdout:3/27: write f2 [5213670,21668] 0 2023-12-07T16:21:28.939 INFO:tasks.workunit.client.1.smithi152.stdout:3/28: write f0 [3704075,58973] 0 2023-12-07T16:21:28.948 INFO:tasks.workunit.client.1.smithi152.stdout:3/29: truncate f0 480147 0 2023-12-07T16:21:28.953 INFO:tasks.workunit.client.1.smithi152.stdout:3/30: dread f2 [0,4194304] 0 2023-12-07T16:21:28.966 INFO:tasks.workunit.client.1.smithi152.stdout:3/31: dwrite f0 [0,4194304] 0 2023-12-07T16:21:28.979 INFO:tasks.workunit.client.1.smithi152.stdout:3/32: dwrite f2 [0,4194304] 0 2023-12-07T16:21:28.979 INFO:tasks.workunit.client.1.smithi152.stdout:3/33: truncate f2 4455501 0 2023-12-07T16:21:28.980 INFO:tasks.workunit.client.1.smithi152.stdout:3/34: rename f0 to f3 0 2023-12-07T16:21:28.993 INFO:tasks.workunit.client.1.smithi152.stdout:3/35: dwrite f2 [0,4194304] 0 2023-12-07T16:21:28.998 INFO:tasks.workunit.client.1.smithi152.stdout:3/36: write f3 [4178434,5428] 0 2023-12-07T16:21:28.999 INFO:tasks.workunit.client.1.smithi152.stdout:3/37: mknod c4 0 2023-12-07T16:21:29.000 INFO:tasks.workunit.client.1.smithi152.stdout:3/38: symlink l5 0 2023-12-07T16:21:29.000 INFO:tasks.workunit.client.1.smithi152.stdout:3/39: rmdir - no directory 2023-12-07T16:21:29.015 INFO:tasks.workunit.client.1.smithi152.stdout:3/40: dwrite f2 [0,4194304] 0 2023-12-07T16:21:29.018 INFO:tasks.workunit.client.1.smithi152.stdout:3/41: fsync f2 0 2023-12-07T16:21:29.018 INFO:tasks.workunit.client.1.smithi152.stdout:3/42: stat l5 0 2023-12-07T16:21:29.018 INFO:tasks.workunit.client.1.smithi152.stdout:3/43: chown f2 13553 1 2023-12-07T16:21:29.025 INFO:tasks.workunit.client.1.smithi152.stdout:3/44: dread f3 [0,4194304] 0 2023-12-07T16:21:29.025 INFO:tasks.workunit.client.1.smithi152.stdout:3/45: chown f2 9660 1 2023-12-07T16:21:29.025 INFO:tasks.workunit.client.1.smithi152.stdout:3/46: truncate f3 4052558 0 2023-12-07T16:21:29.026 INFO:tasks.workunit.client.1.smithi152.stdout:3/47: symlink l6 0 2023-12-07T16:21:29.031 INFO:tasks.workunit.client.1.smithi152.stdout:3/48: dread f3 [0,4194304] 0 2023-12-07T16:21:29.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:28 smithi152 ceph-mon[121113]: from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:21:29.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:28 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/2839917890' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:21:29.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:28 smithi063 ceph-mon[112095]: from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:21:29.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:28 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/2839917890' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:21:29.496 INFO:tasks.workunit.client.1.smithi152.stdout:3/49: sync 2023-12-07T16:21:29.496 INFO:tasks.workunit.client.1.smithi152.stdout:7/5: sync 2023-12-07T16:21:29.496 INFO:tasks.workunit.client.1.smithi152.stdout:7/6: write - no filename 2023-12-07T16:21:29.496 INFO:tasks.workunit.client.1.smithi152.stdout:7/7: truncate - no filename 2023-12-07T16:21:29.496 INFO:tasks.workunit.client.1.smithi152.stdout:4/4: sync 2023-12-07T16:21:29.496 INFO:tasks.workunit.client.1.smithi152.stdout:0/35: sync 2023-12-07T16:21:29.497 INFO:tasks.workunit.client.1.smithi152.stdout:4/5: dread - d0/f1 zero size 2023-12-07T16:21:29.497 INFO:tasks.workunit.client.1.smithi152.stdout:5/2: sync 2023-12-07T16:21:29.497 INFO:tasks.workunit.client.1.smithi152.stdout:2/18: sync 2023-12-07T16:21:29.497 INFO:tasks.workunit.client.1.smithi152.stdout:8/5: sync 2023-12-07T16:21:29.497 INFO:tasks.workunit.client.1.smithi152.stdout:2/19: fsync d2/f8 0 2023-12-07T16:21:29.497 INFO:tasks.workunit.client.1.smithi152.stdout:8/6: fdatasync f2 0 2023-12-07T16:21:29.497 INFO:tasks.workunit.client.1.smithi152.stdout:1/30: sync 2023-12-07T16:21:29.497 INFO:tasks.workunit.client.1.smithi152.stdout:6/16: sync 2023-12-07T16:21:29.497 INFO:tasks.workunit.client.1.smithi152.stdout:9/74: sync 2023-12-07T16:21:29.497 INFO:tasks.workunit.client.1.smithi152.stdout:6/17: readlink l0 0 2023-12-07T16:21:29.497 INFO:tasks.workunit.client.1.smithi152.stdout:9/75: chown d1/f5 5 1 2023-12-07T16:21:29.497 INFO:tasks.workunit.client.1.smithi152.stdout:6/18: chown d2 387352 1 2023-12-07T16:21:29.497 INFO:tasks.workunit.client.1.smithi152.stdout:8/7: write f2 [443860,91961] 0 2023-12-07T16:21:29.497 INFO:tasks.workunit.client.1.smithi152.stdout:7/8: creat f1 x:0 0 0 2023-12-07T16:21:29.498 INFO:tasks.workunit.client.1.smithi152.stdout:7/9: read - f1 zero size 2023-12-07T16:21:29.499 INFO:tasks.workunit.client.1.smithi152.stdout:0/36: mknod d0/c7 0 2023-12-07T16:21:29.499 INFO:tasks.workunit.client.1.smithi152.stdout:4/6: mknod d0/c2 0 2023-12-07T16:21:29.499 INFO:tasks.workunit.client.1.smithi152.stdout:2/20: mkdir d2/d9 0 2023-12-07T16:21:29.505 INFO:tasks.workunit.client.1.smithi152.stdout:4/7: mkdir d0/d3 0 2023-12-07T16:21:29.505 INFO:tasks.workunit.client.1.smithi152.stdout:6/19: creat d2/f5 x:0 0 0 2023-12-07T16:21:29.507 INFO:tasks.workunit.client.1.smithi152.stdout:9/76: link d1/d9/ca d1/d17/c1b 0 2023-12-07T16:21:29.507 INFO:tasks.workunit.client.1.smithi152.stdout:0/37: mknod d0/c8 0 2023-12-07T16:21:29.507 INFO:tasks.workunit.client.1.smithi152.stdout:0/38: fdatasync d0/f5 0 2023-12-07T16:21:29.510 INFO:tasks.workunit.client.1.smithi152.stdout:6/20: write d2/f3 [32779,19827] 0 2023-12-07T16:21:29.510 INFO:tasks.workunit.client.1.smithi152.stdout:6/21: stat d2/f5 0 2023-12-07T16:21:29.512 INFO:tasks.workunit.client.1.smithi152.stdout:0/39: creat d0/f9 x:0 0 0 2023-12-07T16:21:29.515 INFO:tasks.workunit.client.1.smithi152.stdout:9/77: write d1/f5 [9824,52985] 0 2023-12-07T16:21:29.518 INFO:tasks.workunit.client.1.smithi152.stdout:0/40: symlink d0/la 0 2023-12-07T16:21:29.518 INFO:tasks.workunit.client.1.smithi152.stdout:0/41: fdatasync d0/f4 0 2023-12-07T16:21:29.536 INFO:tasks.workunit.client.1.smithi152.stdout:1/31: dwrite f3 [0,4194304] 0 2023-12-07T16:21:29.536 INFO:tasks.workunit.client.1.smithi152.stdout:1/32: fsync f4 0 2023-12-07T16:21:29.539 INFO:tasks.workunit.client.1.smithi152.stdout:1/33: rename f3 to f8 0 2023-12-07T16:21:29.539 INFO:tasks.workunit.client.1.smithi152.stdout:1/34: chown f4 53 1 2023-12-07T16:21:29.541 INFO:tasks.workunit.client.1.smithi152.stdout:3/50: dwrite f2 [0,4194304] 0 2023-12-07T16:21:29.542 INFO:tasks.workunit.client.1.smithi152.stdout:5/3: dwrite f0 [0,4194304] 0 2023-12-07T16:21:29.542 INFO:tasks.workunit.client.1.smithi152.stdout:1/35: write f8 [1041902,108176] 0 2023-12-07T16:21:29.543 INFO:tasks.workunit.client.1.smithi152.stdout:3/51: unlink c4 0 2023-12-07T16:21:29.546 INFO:tasks.workunit.client.1.smithi152.stdout:5/4: unlink f0 0 2023-12-07T16:21:29.546 INFO:tasks.workunit.client.1.smithi152.stdout:5/5: write - no filename 2023-12-07T16:21:29.547 INFO:tasks.workunit.client.1.smithi152.stdout:1/36: link f4 f9 0 2023-12-07T16:21:29.548 INFO:tasks.workunit.client.1.smithi152.stdout:5/6: mknod c1 0 2023-12-07T16:21:29.548 INFO:tasks.workunit.client.1.smithi152.stdout:5/7: dwrite - no filename 2023-12-07T16:21:29.549 INFO:tasks.workunit.client.1.smithi152.stdout:1/37: symlink la 0 2023-12-07T16:21:29.550 INFO:tasks.workunit.client.1.smithi152.stdout:2/21: dwrite d2/f8 [0,4194304] 0 2023-12-07T16:21:29.551 INFO:tasks.workunit.client.1.smithi152.stdout:5/8: rename c1 to c2 0 2023-12-07T16:21:29.552 INFO:tasks.workunit.client.1.smithi152.stdout:1/38: symlink lb 0 2023-12-07T16:21:29.554 INFO:tasks.workunit.client.1.smithi152.stdout:2/22: mkdir d2/da 0 2023-12-07T16:21:29.554 INFO:tasks.workunit.client.1.smithi152.stdout:2/23: readlink d2/l5 0 2023-12-07T16:21:29.554 INFO:tasks.workunit.client.1.smithi152.stdout:5/9: symlink l3 0 2023-12-07T16:21:29.555 INFO:tasks.workunit.client.1.smithi152.stdout:5/10: symlink l4 0 2023-12-07T16:21:29.555 INFO:tasks.workunit.client.1.smithi152.stdout:5/11: truncate - no filename 2023-12-07T16:21:29.556 INFO:tasks.workunit.client.1.smithi152.stdout:4/8: dwrite d0/f1 [0,4194304] 0 2023-12-07T16:21:29.563 INFO:tasks.workunit.client.1.smithi152.stdout:7/10: dwrite f1 [0,4194304] 0 2023-12-07T16:21:29.564 INFO:tasks.workunit.client.1.smithi152.stdout:9/78: dwrite d1/d9/db/f1a [0,4194304] 0 2023-12-07T16:21:29.565 INFO:tasks.workunit.client.1.smithi152.stdout:8/8: dwrite f2 [0,4194304] 0 2023-12-07T16:21:29.569 INFO:tasks.workunit.client.1.smithi152.stdout:8/9: mkdir d3 0 2023-12-07T16:21:29.569 INFO:tasks.workunit.client.1.smithi152.stdout:8/10: chown d3 487695 1 2023-12-07T16:21:29.570 INFO:tasks.workunit.client.1.smithi152.stdout:8/11: write f2 [2213974,75421] 0 2023-12-07T16:21:29.586 INFO:tasks.workunit.client.1.smithi152.stdout:2/24: dwrite f1 [0,4194304] 0 2023-12-07T16:21:29.587 INFO:tasks.workunit.client.1.smithi152.stdout:8/12: mkdir d3/d4 0 2023-12-07T16:21:29.589 INFO:tasks.workunit.client.1.smithi152.stdout:2/25: creat d2/fb x:0 0 0 2023-12-07T16:21:29.591 INFO:tasks.workunit.client.1.smithi152.stdout:8/13: mknod d3/c5 0 2023-12-07T16:21:29.592 INFO:tasks.workunit.client.1.smithi152.stdout:2/26: symlink d2/d9/lc 0 2023-12-07T16:21:29.592 INFO:tasks.workunit.client.1.smithi152.stdout:8/14: symlink d3/l6 0 2023-12-07T16:21:29.594 INFO:tasks.workunit.client.1.smithi152.stdout:2/27: mknod d2/d9/cd 0 2023-12-07T16:21:29.594 INFO:tasks.workunit.client.1.smithi152.stdout:9/79: dwrite d1/d9/f12 [0,4194304] 0 2023-12-07T16:21:29.594 INFO:tasks.workunit.client.1.smithi152.stdout:1/39: truncate f9 3557967 0 2023-12-07T16:21:29.594 INFO:tasks.workunit.client.1.smithi152.stdout:1/40: chown la 3500 1 2023-12-07T16:21:29.595 INFO:tasks.workunit.client.1.smithi152.stdout:1/41: read - f6 zero size 2023-12-07T16:21:29.595 INFO:tasks.workunit.client.1.smithi152.stdout:9/80: rmdir d1/d9/db 39 2023-12-07T16:21:29.598 INFO:tasks.workunit.client.1.smithi152.stdout:8/15: write f2 [912335,18831] 0 2023-12-07T16:21:29.598 INFO:tasks.workunit.client.1.smithi152.stdout:8/16: chown d3/c5 6 1 2023-12-07T16:21:29.599 INFO:tasks.workunit.client.1.smithi152.stdout:5/12: rename c2 to c5 0 2023-12-07T16:21:29.599 INFO:tasks.workunit.client.1.smithi152.stdout:5/13: read - no filename 2023-12-07T16:21:29.599 INFO:tasks.workunit.client.1.smithi152.stdout:5/14: write - no filename 2023-12-07T16:21:29.599 INFO:tasks.workunit.client.1.smithi152.stdout:5/15: read - no filename 2023-12-07T16:21:29.599 INFO:tasks.workunit.client.1.smithi152.stdout:5/16: dread - no filename 2023-12-07T16:21:29.599 INFO:tasks.workunit.client.1.smithi152.stdout:5/17: dread - no filename 2023-12-07T16:21:29.602 INFO:tasks.workunit.client.1.smithi152.stdout:5/18: mknod c6 0 2023-12-07T16:21:29.603 INFO:tasks.workunit.client.1.smithi152.stdout:5/19: dwrite - no filename 2023-12-07T16:21:29.604 INFO:tasks.workunit.client.1.smithi152.stdout:5/20: symlink l7 0 2023-12-07T16:21:29.608 INFO:tasks.workunit.client.1.smithi152.stdout:7/11: truncate f1 2520126 0 2023-12-07T16:21:29.608 INFO:tasks.workunit.client.1.smithi152.stdout:4/9: truncate d0/f1 3202970 0 2023-12-07T16:21:29.608 INFO:tasks.workunit.client.1.smithi152.stdout:8/17: dread f2 [0,4194304] 0 2023-12-07T16:21:29.609 INFO:tasks.workunit.client.1.smithi152.stdout:7/12: symlink l2 0 2023-12-07T16:21:29.610 INFO:tasks.workunit.client.1.smithi152.stdout:8/18: dread f2 [0,4194304] 0 2023-12-07T16:21:29.613 INFO:tasks.workunit.client.1.smithi152.stdout:5/21: getdents . 0 2023-12-07T16:21:29.615 INFO:tasks.workunit.client.1.smithi152.stdout:5/22: creat f8 x:0 0 0 2023-12-07T16:21:29.616 INFO:tasks.workunit.client.1.smithi152.stdout:5/23: creat f9 x:0 0 0 2023-12-07T16:21:29.616 INFO:tasks.workunit.client.1.smithi152.stdout:5/24: write f9 [835544,102893] 0 2023-12-07T16:21:29.618 INFO:tasks.workunit.client.1.smithi152.stdout:5/25: stat c6 0 2023-12-07T16:21:29.619 INFO:tasks.workunit.client.1.smithi152.stdout:7/13: write f1 [1867374,81855] 0 2023-12-07T16:21:29.620 INFO:tasks.workunit.client.1.smithi152.stdout:5/26: symlink la 0 2023-12-07T16:21:29.622 INFO:tasks.workunit.client.1.smithi152.stdout:4/10: dread d0/f1 [0,4194304] 0 2023-12-07T16:21:29.623 INFO:tasks.workunit.client.1.smithi152.stdout:5/27: symlink lb 0 2023-12-07T16:21:29.624 INFO:tasks.workunit.client.1.smithi152.stdout:4/11: truncate d0/f1 677014 0 2023-12-07T16:21:29.633 INFO:tasks.workunit.client.1.smithi152.stdout:1/42: truncate f8 1361563 0 2023-12-07T16:21:29.633 INFO:tasks.workunit.client.1.smithi152.stdout:1/43: write f6 [182670,72754] 0 2023-12-07T16:21:29.633 INFO:tasks.workunit.client.1.smithi152.stdout:1/44: stat l7 0 2023-12-07T16:21:29.634 INFO:tasks.workunit.client.1.smithi152.stdout:9/81: dwrite d1/d9/db/f1a [0,4194304] 0 2023-12-07T16:21:29.634 INFO:tasks.workunit.client.1.smithi152.stdout:9/82: chown d1 506 1 2023-12-07T16:21:29.634 INFO:tasks.workunit.client.1.smithi152.stdout:9/83: readlink d1/l3 0 2023-12-07T16:21:29.637 INFO:tasks.workunit.client.1.smithi152.stdout:1/45: mkdir dc 0 2023-12-07T16:21:29.638 INFO:tasks.workunit.client.1.smithi152.stdout:1/46: read f6 [34445,60651] 0 2023-12-07T16:21:29.639 INFO:tasks.workunit.client.1.smithi152.stdout:9/84: getdents d1/dd 0 2023-12-07T16:21:29.639 INFO:tasks.workunit.client.1.smithi152.stdout:8/19: dwrite f2 [0,4194304] 0 2023-12-07T16:21:29.639 INFO:tasks.workunit.client.1.smithi152.stdout:8/20: fdatasync f2 0 2023-12-07T16:21:29.640 INFO:tasks.workunit.client.1.smithi152.stdout:1/47: creat dc/fd x:0 0 0 2023-12-07T16:21:29.640 INFO:tasks.workunit.client.1.smithi152.stdout:1/48: readlink l7 0 2023-12-07T16:21:29.642 INFO:tasks.workunit.client.1.smithi152.stdout:8/21: mknod d3/d4/c7 0 2023-12-07T16:21:29.643 INFO:tasks.workunit.client.1.smithi152.stdout:8/22: unlink d3/l6 0 2023-12-07T16:21:29.645 INFO:tasks.workunit.client.1.smithi152.stdout:9/85: dread d1/f5 [0,4194304] 0 2023-12-07T16:21:29.650 INFO:tasks.workunit.client.1.smithi152.stdout:8/23: write f2 [2602205,81212] 0 2023-12-07T16:21:29.655 INFO:tasks.workunit.client.1.smithi152.stdout:4/12: dread d0/f1 [0,4194304] 0 2023-12-07T16:21:29.656 INFO:tasks.workunit.client.1.smithi152.stdout:4/13: chown d0/f1 27 1 2023-12-07T16:21:29.657 INFO:tasks.workunit.client.1.smithi152.stdout:5/28: dwrite f8 [0,4194304] 0 2023-12-07T16:21:29.657 INFO:tasks.workunit.client.1.smithi152.stdout:7/14: dwrite f1 [0,4194304] 0 2023-12-07T16:21:29.657 INFO:tasks.workunit.client.1.smithi152.stdout:7/15: chown f1 9981 1 2023-12-07T16:21:29.662 INFO:tasks.workunit.client.1.smithi152.stdout:4/14: dread d0/f1 [0,4194304] 0 2023-12-07T16:21:29.663 INFO:tasks.workunit.client.1.smithi152.stdout:9/86: dread d1/d9/f12 [0,4194304] 0 2023-12-07T16:21:29.663 INFO:tasks.workunit.client.1.smithi152.stdout:1/49: dread f4 [0,4194304] 0 2023-12-07T16:21:29.664 INFO:tasks.workunit.client.1.smithi152.stdout:4/15: read d0/f1 [585746,55462] 0 2023-12-07T16:21:29.664 INFO:tasks.workunit.client.1.smithi152.stdout:9/87: creat d1/f1c x:0 0 0 2023-12-07T16:21:29.665 INFO:tasks.workunit.client.1.smithi152.stdout:1/50: truncate f9 799233 0 2023-12-07T16:21:29.665 INFO:tasks.workunit.client.1.smithi152.stdout:1/51: dread - dc/fd zero size 2023-12-07T16:21:29.665 INFO:tasks.workunit.client.1.smithi152.stdout:1/52: stat f4 0 2023-12-07T16:21:29.666 INFO:tasks.workunit.client.1.smithi152.stdout:8/24: dread f2 [0,4194304] 0 2023-12-07T16:21:29.666 INFO:tasks.workunit.client.1.smithi152.stdout:4/16: mknod d0/c4 0 2023-12-07T16:21:29.666 INFO:tasks.workunit.client.1.smithi152.stdout:4/17: write d0/f1 [1284238,22451] 0 2023-12-07T16:21:29.669 INFO:tasks.workunit.client.1.smithi152.stdout:9/88: rmdir d1/d9/d19 0 2023-12-07T16:21:29.671 INFO:tasks.workunit.client.1.smithi152.stdout:1/53: mkdir dc/de 0 2023-12-07T16:21:29.672 INFO:tasks.workunit.client.1.smithi152.stdout:8/25: symlink d3/l8 0 2023-12-07T16:21:29.674 INFO:tasks.workunit.client.1.smithi152.stdout:9/89: dread d1/f5 [0,4194304] 0 2023-12-07T16:21:29.674 INFO:tasks.workunit.client.1.smithi152.stdout:9/90: truncate d1/f1c 88284 0 2023-12-07T16:21:29.675 INFO:tasks.workunit.client.1.smithi152.stdout:8/26: mkdir d3/d4/d9 0 2023-12-07T16:21:29.676 INFO:tasks.workunit.client.1.smithi152.stdout:9/91: link d1/d9/ca d1/c1d 0 2023-12-07T16:21:29.678 INFO:tasks.workunit.client.1.smithi152.stdout:9/92: creat d1/d17/f1e x:0 0 0 2023-12-07T16:21:29.678 INFO:tasks.workunit.client.1.smithi152.stdout:9/93: write d1/f1c [10117,125899] 0 2023-12-07T16:21:29.682 INFO:tasks.workunit.client.1.smithi152.stdout:7/16: dwrite f1 [4194304,4194304] 0 2023-12-07T16:21:29.683 INFO:tasks.workunit.client.1.smithi152.stdout:7/17: getdents . 0 2023-12-07T16:21:29.684 INFO:tasks.workunit.client.1.smithi152.stdout:9/94: write d1/d9/db/f1a [1858938,127147] 0 2023-12-07T16:21:29.685 INFO:tasks.workunit.client.1.smithi152.stdout:5/29: dwrite f8 [0,4194304] 0 2023-12-07T16:21:29.685 INFO:tasks.workunit.client.1.smithi152.stdout:5/30: fdatasync f8 0 2023-12-07T16:21:29.686 INFO:tasks.workunit.client.1.smithi152.stdout:9/95: creat d1/d9/db/df/f1f x:0 0 0 2023-12-07T16:21:29.691 INFO:tasks.workunit.client.1.smithi152.stdout:4/18: dwrite d0/f1 [0,4194304] 0 2023-12-07T16:21:29.695 INFO:tasks.workunit.client.1.smithi152.stdout:9/96: creat d1/d9/f20 x:0 0 0 2023-12-07T16:21:29.698 INFO:tasks.workunit.client.1.smithi152.stdout:9/97: creat d1/d9/db/f21 x:0 0 0 2023-12-07T16:21:29.698 INFO:tasks.workunit.client.1.smithi152.stdout:9/98: dread - d1/d9/db/f21 zero size 2023-12-07T16:21:29.698 INFO:tasks.workunit.client.1.smithi152.stdout:9/99: dread - d1/d9/db/f21 zero size 2023-12-07T16:21:29.700 INFO:tasks.workunit.client.1.smithi152.stdout:8/27: rmdir d3 39 2023-12-07T16:21:29.701 INFO:tasks.workunit.client.1.smithi152.stdout:8/28: mknod d3/d4/ca 0 2023-12-07T16:21:29.701 INFO:tasks.workunit.client.1.smithi152.stdout:8/29: chown d3/d4 571057 1 2023-12-07T16:21:29.701 INFO:tasks.workunit.client.1.smithi152.stdout:8/30: fdatasync f2 0 2023-12-07T16:21:29.707 INFO:tasks.workunit.client.1.smithi152.stdout:1/54: write f4 [276290,105141] 0 2023-12-07T16:21:29.709 INFO:tasks.workunit.client.1.smithi152.stdout:7/18: dwrite f1 [0,4194304] 0 2023-12-07T16:21:29.711 INFO:tasks.workunit.client.1.smithi152.stdout:7/19: rename l2 to l3 0 2023-12-07T16:21:29.712 INFO:tasks.workunit.client.1.smithi152.stdout:7/20: mknod c4 0 2023-12-07T16:21:29.713 INFO:tasks.workunit.client.1.smithi152.stdout:6/22: sync 2023-12-07T16:21:29.713 INFO:tasks.workunit.client.1.smithi152.stdout:6/23: read - d2/f5 zero size 2023-12-07T16:21:29.713 INFO:tasks.workunit.client.1.smithi152.stdout:6/24: write d2/f5 [695991,86358] 0 2023-12-07T16:21:29.713 INFO:tasks.workunit.client.1.smithi152.stdout:6/25: truncate d2/f3 484557 0 2023-12-07T16:21:29.713 INFO:tasks.workunit.client.1.smithi152.stdout:7/21: symlink l5 0 2023-12-07T16:21:29.714 INFO:tasks.workunit.client.1.smithi152.stdout:5/31: dwrite f9 [0,4194304] 0 2023-12-07T16:21:29.715 INFO:tasks.workunit.client.1.smithi152.stdout:7/22: write f1 [4978592,87386] 0 2023-12-07T16:21:29.716 INFO:tasks.workunit.client.1.smithi152.stdout:9/100: dread d1/f1c [0,4194304] 0 2023-12-07T16:21:29.718 INFO:tasks.workunit.client.1.smithi152.stdout:9/101: link d1/c1d d1/d9/db/df/c22 0 2023-12-07T16:21:29.718 INFO:tasks.workunit.client.1.smithi152.stdout:9/102: write d1/d9/db/df/f1f [432343,24710] 0 2023-12-07T16:21:29.719 INFO:tasks.workunit.client.1.smithi152.stdout:9/103: link d1/d9/f12 d1/d9/f23 0 2023-12-07T16:21:29.720 INFO:tasks.workunit.client.1.smithi152.stdout:4/19: dwrite d0/f1 [0,4194304] 0 2023-12-07T16:21:29.724 INFO:tasks.workunit.client.1.smithi152.stdout:4/20: creat d0/f5 x:0 0 0 2023-12-07T16:21:29.725 INFO:tasks.workunit.client.1.smithi152.stdout:4/21: mkdir d0/d3/d6 0 2023-12-07T16:21:29.725 INFO:tasks.workunit.client.1.smithi152.stdout:4/22: fsync d0/f1 0 2023-12-07T16:21:29.726 INFO:tasks.workunit.client.1.smithi152.stdout:4/23: unlink d0/c4 0 2023-12-07T16:21:29.726 INFO:tasks.workunit.client.1.smithi152.stdout:5/32: dread f8 [0,4194304] 0 2023-12-07T16:21:29.727 INFO:tasks.workunit.client.1.smithi152.stdout:4/24: creat d0/d3/f7 x:0 0 0 2023-12-07T16:21:29.728 INFO:tasks.workunit.client.1.smithi152.stdout:5/33: creat fc x:0 0 0 2023-12-07T16:21:29.728 INFO:tasks.workunit.client.1.smithi152.stdout:4/25: write d0/f1 [636939,71841] 0 2023-12-07T16:21:29.728 INFO:tasks.workunit.client.1.smithi152.stdout:4/26: rename d0 to d0/d8 22 2023-12-07T16:21:29.728 INFO:tasks.workunit.client.1.smithi152.stdout:4/27: dread - d0/f5 zero size 2023-12-07T16:21:29.728 INFO:tasks.workunit.client.1.smithi152.stdout:4/28: chown d0/f1 1014 1 2023-12-07T16:21:29.729 INFO:tasks.workunit.client.1.smithi152.stdout:5/34: write f8 [2272790,74908] 0 2023-12-07T16:21:29.729 INFO:tasks.workunit.client.1.smithi152.stdout:8/31: dwrite f2 [0,4194304] 0 2023-12-07T16:21:29.729 INFO:tasks.workunit.client.1.smithi152.stdout:8/32: chown d3/l8 34 1 2023-12-07T16:21:29.729 INFO:tasks.workunit.client.1.smithi152.stdout:5/35: read f8 [2170107,19413] 0 2023-12-07T16:21:29.729 INFO:tasks.workunit.client.1.smithi152.stdout:5/36: write f8 [4254214,130397] 0 2023-12-07T16:21:29.730 INFO:tasks.workunit.client.1.smithi152.stdout:9/104: fsync d1/d9/db/f21 0 2023-12-07T16:21:29.732 INFO:tasks.workunit.client.1.smithi152.stdout:5/37: mkdir dd 0 2023-12-07T16:21:29.735 INFO:tasks.workunit.client.1.smithi152.stdout:5/38: read f9 [452278,70555] 0 2023-12-07T16:21:29.736 INFO:tasks.workunit.client.1.smithi152.stdout:5/39: mkdir dd/de 0 2023-12-07T16:21:29.736 INFO:tasks.workunit.client.1.smithi152.stdout:5/40: read - fc zero size 2023-12-07T16:21:29.737 INFO:tasks.workunit.client.1.smithi152.stdout:3/52: sync 2023-12-07T16:21:29.737 INFO:tasks.workunit.client.1.smithi152.stdout:0/42: sync 2023-12-07T16:21:29.737 INFO:tasks.workunit.client.1.smithi152.stdout:0/43: write d0/f9 [900217,113004] 0 2023-12-07T16:21:29.737 INFO:tasks.workunit.client.1.smithi152.stdout:0/44: read d0/f9 [940849,111647] 0 2023-12-07T16:21:29.737 INFO:tasks.workunit.client.1.smithi152.stdout:5/41: mknod dd/cf 0 2023-12-07T16:21:29.737 INFO:tasks.workunit.client.1.smithi152.stdout:7/23: dread f1 [4194304,4194304] 0 2023-12-07T16:21:29.739 INFO:tasks.workunit.client.1.smithi152.stdout:3/53: write f2 [226397,24313] 0 2023-12-07T16:21:29.739 INFO:tasks.workunit.client.1.smithi152.stdout:8/33: dread f2 [0,4194304] 0 2023-12-07T16:21:29.739 INFO:tasks.workunit.client.1.smithi152.stdout:5/42: read f9 [1968788,58271] 0 2023-12-07T16:21:29.739 INFO:tasks.workunit.client.1.smithi152.stdout:6/26: dread d2/f5 [0,4194304] 0 2023-12-07T16:21:29.739 INFO:tasks.workunit.client.1.smithi152.stdout:5/43: read - fc zero size 2023-12-07T16:21:29.739 INFO:tasks.workunit.client.1.smithi152.stdout:5/44: chown lb 3173992 1 2023-12-07T16:21:29.739 INFO:tasks.workunit.client.1.smithi152.stdout:0/45: mknod d0/cb 0 2023-12-07T16:21:29.740 INFO:tasks.workunit.client.1.smithi152.stdout:4/29: rmdir d0 39 2023-12-07T16:21:29.740 INFO:tasks.workunit.client.1.smithi152.stdout:3/54: fsync f3 0 2023-12-07T16:21:29.742 INFO:tasks.workunit.client.1.smithi152.stdout:7/24: rename f1 to f6 0 2023-12-07T16:21:29.744 INFO:tasks.workunit.client.1.smithi152.stdout:8/34: rename f2 to d3/d4/d9/fb 0 2023-12-07T16:21:29.744 INFO:tasks.workunit.client.1.smithi152.stdout:6/27: mkdir d2/d6 0 2023-12-07T16:21:29.744 INFO:tasks.workunit.client.1.smithi152.stdout:0/46: mkdir d0/dc 0 2023-12-07T16:21:29.745 INFO:tasks.workunit.client.1.smithi152.stdout:5/45: symlink dd/de/l10 0 2023-12-07T16:21:29.745 INFO:tasks.workunit.client.1.smithi152.stdout:4/30: mknod d0/d3/d6/c9 0 2023-12-07T16:21:29.746 INFO:tasks.workunit.client.1.smithi152.stdout:4/31: chown d0/d3/d6/c9 164 1 2023-12-07T16:21:29.746 INFO:tasks.workunit.client.1.smithi152.stdout:4/32: fdatasync d0/f1 0 2023-12-07T16:21:29.746 INFO:tasks.workunit.client.1.smithi152.stdout:4/33: dread - d0/f5 zero size 2023-12-07T16:21:29.747 INFO:tasks.workunit.client.1.smithi152.stdout:7/25: symlink l7 0 2023-12-07T16:21:29.748 INFO:tasks.workunit.client.1.smithi152.stdout:8/35: mkdir d3/d4/d9/dc 0 2023-12-07T16:21:29.748 INFO:tasks.workunit.client.1.smithi152.stdout:6/28: creat d2/f7 x:0 0 0 2023-12-07T16:21:29.749 INFO:tasks.workunit.client.1.smithi152.stdout:6/29: creat d2/d6/f8 x:0 0 0 2023-12-07T16:21:29.749 INFO:tasks.workunit.client.1.smithi152.stdout:6/30: chown d2/d6 13250039 1 2023-12-07T16:21:29.749 INFO:tasks.workunit.client.1.smithi152.stdout:6/31: chown d2/f3 7 1 2023-12-07T16:21:29.750 INFO:tasks.workunit.client.1.smithi152.stdout:7/26: write f6 [1831547,105573] 0 2023-12-07T16:21:29.752 INFO:tasks.workunit.client.1.smithi152.stdout:6/32: mkdir d2/d6/d9 0 2023-12-07T16:21:29.762 INFO:tasks.workunit.client.1.smithi152.stdout:5/46: dread f9 [0,4194304] 0 2023-12-07T16:21:29.765 INFO:tasks.workunit.client.1.smithi152.stdout:5/47: dread f9 [0,4194304] 0 2023-12-07T16:21:29.766 INFO:tasks.workunit.client.1.smithi152.stdout:3/55: dwrite f3 [0,4194304] 0 2023-12-07T16:21:29.767 INFO:tasks.workunit.client.1.smithi152.stdout:5/48: unlink c6 0 2023-12-07T16:21:29.769 INFO:tasks.workunit.client.1.smithi152.stdout:3/56: getdents . 0 2023-12-07T16:21:29.769 INFO:tasks.workunit.client.1.smithi152.stdout:7/27: dread f6 [4194304,4194304] 0 2023-12-07T16:21:29.769 INFO:tasks.workunit.client.1.smithi152.stdout:7/28: chown f6 11061843 1 2023-12-07T16:21:29.769 INFO:tasks.workunit.client.1.smithi152.stdout:5/49: write f9 [1803095,15914] 0 2023-12-07T16:21:29.770 INFO:tasks.workunit.client.1.smithi152.stdout:3/57: mkdir d7 0 2023-12-07T16:21:29.770 INFO:tasks.workunit.client.1.smithi152.stdout:7/29: stat l3 0 2023-12-07T16:21:29.772 INFO:tasks.workunit.client.1.smithi152.stdout:5/50: mkdir dd/d11 0 2023-12-07T16:21:29.774 INFO:tasks.workunit.client.1.smithi152.stdout:3/58: link f2 d7/f8 0 2023-12-07T16:21:29.775 INFO:tasks.workunit.client.1.smithi152.stdout:3/59: readlink l5 0 2023-12-07T16:21:29.775 INFO:tasks.workunit.client.1.smithi152.stdout:4/34: dwrite d0/d3/f7 [0,4194304] 0 2023-12-07T16:21:29.775 INFO:tasks.workunit.client.1.smithi152.stdout:4/35: chown d0/d3 4938 1 2023-12-07T16:21:29.775 INFO:tasks.workunit.client.1.smithi152.stdout:0/47: dwrite d0/f4 [0,4194304] 0 2023-12-07T16:21:29.776 INFO:tasks.workunit.client.1.smithi152.stdout:8/36: dwrite d3/d4/d9/fb [0,4194304] 0 2023-12-07T16:21:29.779 INFO:tasks.workunit.client.1.smithi152.stdout:4/36: mkdir d0/d3/d6/da 0 2023-12-07T16:21:29.784 INFO:tasks.workunit.client.1.smithi152.stdout:8/37: rename d3/c5 to d3/d4/d9/cd 0 2023-12-07T16:21:29.785 INFO:tasks.workunit.client.1.smithi152.stdout:4/37: creat d0/fb x:0 0 0 2023-12-07T16:21:29.788 INFO:tasks.workunit.client.1.smithi152.stdout:8/38: symlink d3/d4/d9/le 0 2023-12-07T16:21:29.788 INFO:tasks.workunit.client.1.smithi152.stdout:8/39: truncate d3/d4/d9/fb 4817179 0 2023-12-07T16:21:29.790 INFO:tasks.workunit.client.1.smithi152.stdout:7/30: dwrite f6 [4194304,4194304] 0 2023-12-07T16:21:29.790 INFO:tasks.workunit.client.1.smithi152.stdout:4/38: mkdir d0/d3/d6/dc 0 2023-12-07T16:21:29.794 INFO:tasks.workunit.client.1.smithi152.stdout:8/40: symlink d3/d4/d9/lf 0 2023-12-07T16:21:29.796 INFO:tasks.workunit.client.1.smithi152.stdout:7/31: creat f8 x:0 0 0 2023-12-07T16:21:29.797 INFO:tasks.workunit.client.1.smithi152.stdout:7/32: creat f9 x:0 0 0 2023-12-07T16:21:29.798 INFO:tasks.workunit.client.1.smithi152.stdout:8/41: read d3/d4/d9/fb [525485,96515] 0 2023-12-07T16:21:29.799 INFO:tasks.workunit.client.1.smithi152.stdout:7/33: symlink la 0 2023-12-07T16:21:29.799 INFO:tasks.workunit.client.1.smithi152.stdout:7/34: dread - f9 zero size 2023-12-07T16:21:29.803 INFO:tasks.workunit.client.1.smithi152.stdout:3/60: dwrite f2 [0,4194304] 0 2023-12-07T16:21:29.803 INFO:tasks.workunit.client.1.smithi152.stdout:4/39: dread d0/d3/f7 [0,4194304] 0 2023-12-07T16:21:29.803 INFO:tasks.workunit.client.1.smithi152.stdout:5/51: dwrite fc [0,4194304] 0 2023-12-07T16:21:29.803 INFO:tasks.workunit.client.1.smithi152.stdout:5/52: chown dd/d11 1 1 2023-12-07T16:21:29.804 INFO:tasks.workunit.client.1.smithi152.stdout:2/28: sync 2023-12-07T16:21:29.806 INFO:tasks.workunit.client.1.smithi152.stdout:0/48: truncate d0/f4 1555624 0 2023-12-07T16:21:29.814 INFO:tasks.workunit.client.1.smithi152.stdout:8/42: dread d3/d4/d9/fb [0,4194304] 0 2023-12-07T16:21:29.815 INFO:tasks.workunit.client.1.smithi152.stdout:2/29: write d2/f8 [695406,17229] 0 2023-12-07T16:21:29.815 INFO:tasks.workunit.client.1.smithi152.stdout:2/30: dread - d2/fb zero size 2023-12-07T16:21:29.821 INFO:tasks.workunit.client.1.smithi152.stdout:8/43: dread d3/d4/d9/fb [0,4194304] 0 2023-12-07T16:21:29.822 INFO:tasks.workunit.client.1.smithi152.stdout:4/40: dwrite d0/f5 [0,4194304] 0 2023-12-07T16:21:29.822 INFO:tasks.workunit.client.1.smithi152.stdout:4/41: fsync d0/f5 0 2023-12-07T16:21:29.823 INFO:tasks.workunit.client.1.smithi152.stdout:8/44: symlink d3/d4/d9/dc/l10 0 2023-12-07T16:21:29.823 INFO:tasks.workunit.client.1.smithi152.stdout:8/45: fsync d3/d4/d9/fb 0 2023-12-07T16:21:29.824 INFO:tasks.workunit.client.1.smithi152.stdout:8/46: dread d3/d4/d9/fb [4194304,4194304] 0 2023-12-07T16:21:29.826 INFO:tasks.workunit.client.1.smithi152.stdout:4/42: rename d0/d3/d6/da to d0/d3/d6/dc/dd 0 2023-12-07T16:21:29.827 INFO:tasks.workunit.client.1.smithi152.stdout:8/47: truncate d3/d4/d9/fb 2768827 0 2023-12-07T16:21:29.828 INFO:tasks.workunit.client.1.smithi152.stdout:8/48: rmdir d3/d4/d9/dc 39 2023-12-07T16:21:29.831 INFO:tasks.workunit.client.1.smithi152.stdout:0/49: dread d0/f4 [0,4194304] 0 2023-12-07T16:21:29.832 INFO:tasks.workunit.client.1.smithi152.stdout:0/50: mkdir d0/dc/dd 0 2023-12-07T16:21:29.833 INFO:tasks.workunit.client.1.smithi152.stdout:0/51: mknod d0/dc/dd/ce 0 2023-12-07T16:21:29.833 INFO:tasks.workunit.client.1.smithi152.stdout:0/52: rmdir d0/dc/dd 39 2023-12-07T16:21:29.834 INFO:tasks.workunit.client.1.smithi152.stdout:0/53: write d0/f9 [1473913,118940] 0 2023-12-07T16:21:29.834 INFO:tasks.workunit.client.1.smithi152.stdout:3/61: dwrite f3 [4194304,4194304] 0 2023-12-07T16:21:29.835 INFO:tasks.workunit.client.1.smithi152.stdout:5/53: dwrite fc [0,4194304] 0 2023-12-07T16:21:29.835 INFO:tasks.workunit.client.1.smithi152.stdout:0/54: dread d0/f5 [0,4194304] 0 2023-12-07T16:21:29.836 INFO:tasks.workunit.client.1.smithi152.stdout:3/62: mknod d7/c9 0 2023-12-07T16:21:29.838 INFO:tasks.workunit.client.1.smithi152.stdout:5/54: readlink l3 0 2023-12-07T16:21:29.840 INFO:tasks.workunit.client.1.smithi152.stdout:4/43: dread d0/f1 [0,4194304] 0 2023-12-07T16:21:29.840 INFO:tasks.workunit.client.1.smithi152.stdout:3/63: creat d7/fa x:0 0 0 2023-12-07T16:21:29.841 INFO:tasks.workunit.client.1.smithi152.stdout:5/55: rename dd/de/l10 to dd/d11/l12 0 2023-12-07T16:21:29.841 INFO:tasks.workunit.client.1.smithi152.stdout:4/44: truncate d0/f5 3922135 0 2023-12-07T16:21:29.843 INFO:tasks.workunit.client.1.smithi152.stdout:5/56: unlink l3 0 2023-12-07T16:21:29.843 INFO:tasks.workunit.client.1.smithi152.stdout:4/45: creat d0/d3/d6/dc/dd/fe x:0 0 0 2023-12-07T16:21:29.843 INFO:tasks.workunit.client.1.smithi152.stdout:8/49: write d3/d4/d9/fb [3513231,11249] 0 2023-12-07T16:21:29.844 INFO:tasks.workunit.client.1.smithi152.stdout:4/46: creat d0/d3/d6/ff x:0 0 0 2023-12-07T16:21:29.845 INFO:tasks.workunit.client.1.smithi152.stdout:5/57: write fc [3049666,47986] 0 2023-12-07T16:21:29.846 INFO:tasks.workunit.client.1.smithi152.stdout:8/50: symlink d3/d4/d9/dc/l11 0 2023-12-07T16:21:29.846 INFO:tasks.workunit.client.1.smithi152.stdout:8/51: readlink d3/d4/d9/lf 0 2023-12-07T16:21:29.846 INFO:tasks.workunit.client.1.smithi152.stdout:2/31: dwrite f1 [0,4194304] 0 2023-12-07T16:21:29.848 INFO:tasks.workunit.client.1.smithi152.stdout:4/47: creat d0/d3/d6/dc/f10 x:0 0 0 2023-12-07T16:21:29.851 INFO:tasks.workunit.client.1.smithi152.stdout:0/55: dwrite d0/f5 [0,4194304] 0 2023-12-07T16:21:29.851 INFO:tasks.workunit.client.1.smithi152.stdout:2/32: symlink d2/d9/le 0 2023-12-07T16:21:29.852 INFO:tasks.workunit.client.1.smithi152.stdout:3/64: rmdir d7 39 2023-12-07T16:21:29.860 INFO:tasks.workunit.client.1.smithi152.stdout:2/33: creat d2/ff x:0 0 0 2023-12-07T16:21:29.861 INFO:tasks.workunit.client.1.smithi152.stdout:3/65: symlink d7/lb 0 2023-12-07T16:21:29.861 INFO:tasks.workunit.client.1.smithi152.stdout:0/56: getdents d0 0 2023-12-07T16:21:29.862 INFO:tasks.workunit.client.1.smithi152.stdout:2/34: symlink d2/d9/l10 0 2023-12-07T16:21:29.862 INFO:tasks.workunit.client.1.smithi152.stdout:2/35: chown d2/l3 7 1 2023-12-07T16:21:29.863 INFO:tasks.workunit.client.1.smithi152.stdout:0/57: dread d0/f4 [0,4194304] 0 2023-12-07T16:21:29.864 INFO:tasks.workunit.client.1.smithi152.stdout:2/36: creat d2/d9/f11 x:0 0 0 2023-12-07T16:21:29.865 INFO:tasks.workunit.client.1.smithi152.stdout:0/58: rmdir d0 39 2023-12-07T16:21:29.866 INFO:tasks.workunit.client.1.smithi152.stdout:0/59: creat d0/dc/dd/ff x:0 0 0 2023-12-07T16:21:29.867 INFO:tasks.workunit.client.1.smithi152.stdout:0/60: chown d0/cb 45 1 2023-12-07T16:21:29.867 INFO:tasks.workunit.client.1.smithi152.stdout:0/61: chown d0/cb 1071367002 1 2023-12-07T16:21:29.868 INFO:tasks.workunit.client.1.smithi152.stdout:0/62: creat d0/dc/dd/f10 x:0 0 0 2023-12-07T16:21:29.869 INFO:tasks.workunit.client.1.smithi152.stdout:5/58: dwrite f9 [0,4194304] 0 2023-12-07T16:21:29.870 INFO:tasks.workunit.client.1.smithi152.stdout:0/63: mkdir d0/dc/dd/d11 0 2023-12-07T16:21:29.870 INFO:tasks.workunit.client.1.smithi152.stdout:0/64: write d0/dc/dd/ff [951492,4528] 0 2023-12-07T16:21:29.876 INFO:tasks.workunit.client.1.smithi152.stdout:6/33: sync 2023-12-07T16:21:29.876 INFO:tasks.workunit.client.1.smithi152.stdout:1/55: sync 2023-12-07T16:21:29.876 INFO:tasks.workunit.client.1.smithi152.stdout:1/56: chown f9 1126 1 2023-12-07T16:21:29.877 INFO:tasks.workunit.client.1.smithi152.stdout:6/34: mknod d2/d6/ca 0 2023-12-07T16:21:29.877 INFO:tasks.workunit.client.1.smithi152.stdout:6/35: stat d2/d6 0 2023-12-07T16:21:29.877 INFO:tasks.workunit.client.1.smithi152.stdout:6/36: chown d2/f5 718 1 2023-12-07T16:21:29.877 INFO:tasks.workunit.client.1.smithi152.stdout:6/37: write d2/f3 [943641,44685] 0 2023-12-07T16:21:29.878 INFO:tasks.workunit.client.1.smithi152.stdout:1/57: creat dc/ff x:0 0 0 2023-12-07T16:21:29.878 INFO:tasks.workunit.client.1.smithi152.stdout:1/58: chown l7 953661158 1 2023-12-07T16:21:29.879 INFO:tasks.workunit.client.1.smithi152.stdout:6/38: rename d2/d6/f8 to d2/d6/d9/fb 0 2023-12-07T16:21:29.879 INFO:tasks.workunit.client.1.smithi152.stdout:6/39: truncate d2/f3 1314067 0 2023-12-07T16:21:29.879 INFO:tasks.workunit.client.1.smithi152.stdout:6/40: dread - d2/d6/d9/fb zero size 2023-12-07T16:21:29.879 INFO:tasks.workunit.client.1.smithi152.stdout:6/41: write d2/f7 [939828,18325] 0 2023-12-07T16:21:29.879 INFO:tasks.workunit.client.1.smithi152.stdout:6/42: write d2/d6/d9/fb [242127,96346] 0 2023-12-07T16:21:29.880 INFO:tasks.workunit.client.1.smithi152.stdout:1/59: unlink dc/ff 0 2023-12-07T16:21:29.882 INFO:tasks.workunit.client.1.smithi152.stdout:4/48: dwrite d0/f5 [0,4194304] 0 2023-12-07T16:21:29.882 INFO:tasks.workunit.client.1.smithi152.stdout:4/49: chown d0/d3/d6/dc 2 1 2023-12-07T16:21:29.882 INFO:tasks.workunit.client.1.smithi152.stdout:8/52: dwrite d3/d4/d9/fb [0,4194304] 0 2023-12-07T16:21:29.882 INFO:tasks.workunit.client.1.smithi152.stdout:9/105: sync 2023-12-07T16:21:29.883 INFO:tasks.workunit.client.1.smithi152.stdout:3/66: getdents d7 0 2023-12-07T16:21:29.884 INFO:tasks.workunit.client.1.smithi152.stdout:1/60: dread f4 [0,4194304] 0 2023-12-07T16:21:29.886 INFO:tasks.workunit.client.1.smithi152.stdout:2/37: rmdir d2/d9 39 2023-12-07T16:21:29.886 INFO:tasks.workunit.client.1.smithi152.stdout:2/38: stat d2/da 0 2023-12-07T16:21:29.888 INFO:tasks.workunit.client.1.smithi152.stdout:9/106: mkdir d1/dd/d24 0 2023-12-07T16:21:29.889 INFO:tasks.workunit.client.1.smithi152.stdout:3/67: mkdir d7/dc 0 2023-12-07T16:21:29.889 INFO:tasks.workunit.client.1.smithi152.stdout:8/53: dread d3/d4/d9/fb [0,4194304] 0 2023-12-07T16:21:29.890 INFO:tasks.workunit.client.1.smithi152.stdout:0/65: getdents d0/dc/dd 0 2023-12-07T16:21:29.890 INFO:tasks.workunit.client.1.smithi152.stdout:8/54: write d3/d4/d9/fb [2685007,120285] 0 2023-12-07T16:21:29.890 INFO:tasks.workunit.client.1.smithi152.stdout:8/55: write d3/d4/d9/fb [4394783,100704] 0 2023-12-07T16:21:29.891 INFO:tasks.workunit.client.1.smithi152.stdout:8/56: write d3/d4/d9/fb [1704657,100380] 0 2023-12-07T16:21:29.891 INFO:tasks.workunit.client.1.smithi152.stdout:1/61: symlink dc/l10 0 2023-12-07T16:21:29.895 INFO:tasks.workunit.client.1.smithi152.stdout:3/68: mknod d7/dc/cd 0 2023-12-07T16:21:29.896 INFO:tasks.workunit.client.1.smithi152.stdout:8/57: getdents d3/d4 0 2023-12-07T16:21:29.896 INFO:tasks.workunit.client.1.smithi152.stdout:3/69: write f2 [3413780,21733] 0 2023-12-07T16:21:29.898 INFO:tasks.workunit.client.1.smithi152.stdout:1/62: mkdir dc/d11 0 2023-12-07T16:21:29.898 INFO:tasks.workunit.client.1.smithi152.stdout:1/63: stat f4 0 2023-12-07T16:21:29.900 INFO:tasks.workunit.client.1.smithi152.stdout:9/107: rename d1/d9/db/f1a to d1/d9/f25 0 2023-12-07T16:21:29.902 INFO:tasks.workunit.client.1.smithi152.stdout:3/70: creat d7/dc/fe x:0 0 0 2023-12-07T16:21:29.902 INFO:tasks.workunit.client.1.smithi152.stdout:3/71: write d7/dc/fe [192847,67601] 0 2023-12-07T16:21:29.903 INFO:tasks.workunit.client.1.smithi152.stdout:7/35: sync 2023-12-07T16:21:29.903 INFO:tasks.workunit.client.1.smithi152.stdout:7/36: read - f8 zero size 2023-12-07T16:21:29.904 INFO:tasks.workunit.client.1.smithi152.stdout:1/64: dread f4 [0,4194304] 0 2023-12-07T16:21:29.905 INFO:tasks.workunit.client.1.smithi152.stdout:1/65: read f4 [352127,102866] 0 2023-12-07T16:21:29.906 INFO:tasks.workunit.client.1.smithi152.stdout:1/66: dread f4 [0,4194304] 0 2023-12-07T16:21:29.908 INFO:tasks.workunit.client.1.smithi152.stdout:1/67: symlink dc/de/l12 0 2023-12-07T16:21:29.909 INFO:tasks.workunit.client.1.smithi152.stdout:1/68: dread f9 [0,4194304] 0 2023-12-07T16:21:29.911 INFO:tasks.workunit.client.1.smithi152.stdout:1/69: rmdir dc/d11 0 2023-12-07T16:21:29.912 INFO:tasks.workunit.client.1.smithi152.stdout:1/70: creat dc/f13 x:0 0 0 2023-12-07T16:21:29.913 INFO:tasks.workunit.client.1.smithi152.stdout:2/39: dwrite d2/ff [0,4194304] 0 2023-12-07T16:21:29.914 INFO:tasks.workunit.client.1.smithi152.stdout:1/71: mkdir dc/d14 0 2023-12-07T16:21:29.914 INFO:tasks.workunit.client.1.smithi152.stdout:1/72: readlink dc/de/l12 0 2023-12-07T16:21:29.914 INFO:tasks.workunit.client.1.smithi152.stdout:3/72: fsync f2 0 2023-12-07T16:21:29.914 INFO:tasks.workunit.client.1.smithi152.stdout:0/66: dwrite d0/f9 [0,4194304] 0 2023-12-07T16:21:29.915 INFO:tasks.workunit.client.1.smithi152.stdout:1/73: dread f9 [0,4194304] 0 2023-12-07T16:21:29.916 INFO:tasks.workunit.client.1.smithi152.stdout:2/40: rename d2/l5 to d2/l12 0 2023-12-07T16:21:29.916 INFO:tasks.workunit.client.1.smithi152.stdout:2/41: chown f1 244 1 2023-12-07T16:21:29.921 INFO:tasks.workunit.client.1.smithi152.stdout:1/74: rename c1 to dc/d14/c15 0 2023-12-07T16:21:29.921 INFO:tasks.workunit.client.1.smithi152.stdout:1/75: chown f8 64075531 1 2023-12-07T16:21:29.922 INFO:tasks.workunit.client.1.smithi152.stdout:2/42: creat d2/d9/f13 x:0 0 0 2023-12-07T16:21:29.923 INFO:tasks.workunit.client.1.smithi152.stdout:2/43: write d2/d9/f13 [354922,41636] 0 2023-12-07T16:21:29.923 INFO:tasks.workunit.client.1.smithi152.stdout:2/44: chown d2/d9/f11 2019 1 2023-12-07T16:21:29.923 INFO:tasks.workunit.client.1.smithi152.stdout:2/45: stat d2/d9/l10 0 2023-12-07T16:21:29.923 INFO:tasks.workunit.client.1.smithi152.stdout:2/46: chown d2/d9/f11 7 1 2023-12-07T16:21:29.923 INFO:tasks.workunit.client.1.smithi152.stdout:2/47: truncate d2/d9/f13 1005492 0 2023-12-07T16:21:29.923 INFO:tasks.workunit.client.1.smithi152.stdout:2/48: chown f1 761 1 2023-12-07T16:21:29.925 INFO:tasks.workunit.client.1.smithi152.stdout:7/37: dwrite f8 [0,4194304] 0 2023-12-07T16:21:29.927 INFO:tasks.workunit.client.1.smithi152.stdout:2/49: link d2/d9/l10 d2/d9/l14 0 2023-12-07T16:21:29.929 INFO:tasks.workunit.client.1.smithi152.stdout:7/38: mkdir db 0 2023-12-07T16:21:29.930 INFO:tasks.workunit.client.1.smithi152.stdout:2/50: symlink d2/l15 0 2023-12-07T16:21:29.945 INFO:tasks.workunit.client.1.smithi152.stdout:1/76: rename dc/d14/c15 to dc/de/c16 0 2023-12-07T16:21:29.945 INFO:tasks.workunit.client.1.smithi152.stdout:1/77: fdatasync f9 0 2023-12-07T16:21:29.946 INFO:tasks.workunit.client.1.smithi152.stdout:7/39: rename f9 to db/fc 0 2023-12-07T16:21:29.951 INFO:tasks.workunit.client.1.smithi152.stdout:2/51: rename d2/d9/l14 to d2/l16 0 2023-12-07T16:21:29.951 INFO:tasks.workunit.client.1.smithi152.stdout:3/73: dwrite d7/fa [0,4194304] 0 2023-12-07T16:21:29.951 INFO:tasks.workunit.client.1.smithi152.stdout:0/67: dwrite d0/f5 [0,4194304] 0 2023-12-07T16:21:29.951 INFO:tasks.workunit.client.1.smithi152.stdout:3/74: chown f2 6391 1 2023-12-07T16:21:29.951 INFO:tasks.workunit.client.1.smithi152.stdout:7/40: mkdir db/dd 0 2023-12-07T16:21:29.951 INFO:tasks.workunit.client.1.smithi152.stdout:7/41: fsync f6 0 2023-12-07T16:21:29.951 INFO:tasks.workunit.client.1.smithi152.stdout:8/58: dwrite d3/d4/d9/fb [0,4194304] 0 2023-12-07T16:21:29.953 INFO:tasks.workunit.client.1.smithi152.stdout:0/68: creat d0/dc/f12 x:0 0 0 2023-12-07T16:21:29.954 INFO:tasks.workunit.client.1.smithi152.stdout:2/52: mknod d2/d9/c17 0 2023-12-07T16:21:29.955 INFO:tasks.workunit.client.1.smithi152.stdout:7/42: rmdir db 39 2023-12-07T16:21:29.955 INFO:tasks.workunit.client.1.smithi152.stdout:3/75: mkdir d7/df 0 2023-12-07T16:21:29.956 INFO:tasks.workunit.client.1.smithi152.stdout:8/59: write d3/d4/d9/fb [3697791,14121] 0 2023-12-07T16:21:29.956 INFO:tasks.workunit.client.1.smithi152.stdout:0/69: mknod d0/dc/dd/d11/c13 0 2023-12-07T16:21:29.957 INFO:tasks.workunit.client.1.smithi152.stdout:3/76: write d7/fa [2019276,55943] 0 2023-12-07T16:21:29.957 INFO:tasks.workunit.client.1.smithi152.stdout:3/77: chown d7/dc/cd 18946 1 2023-12-07T16:21:29.957 INFO:tasks.workunit.client.1.smithi152.stdout:2/53: mkdir d2/da/d18 0 2023-12-07T16:21:29.957 INFO:tasks.workunit.client.1.smithi152.stdout:2/54: getdents d2/da/d18 0 2023-12-07T16:21:29.960 INFO:tasks.workunit.client.1.smithi152.stdout:7/43: read f8 [3485399,77625] 0 2023-12-07T16:21:29.960 INFO:tasks.workunit.client.1.smithi152.stdout:7/44: readlink l3 0 2023-12-07T16:21:29.961 INFO:tasks.workunit.client.1.smithi152.stdout:8/60: unlink d3/d4/d9/dc/l11 0 2023-12-07T16:21:29.961 INFO:tasks.workunit.client.1.smithi152.stdout:1/78: dwrite dc/f13 [0,4194304] 0 2023-12-07T16:21:29.966 INFO:tasks.workunit.client.1.smithi152.stdout:3/78: rmdir d7/df 0 2023-12-07T16:21:29.969 INFO:tasks.workunit.client.1.smithi152.stdout:1/79: unlink dc/l10 0 2023-12-07T16:21:29.969 INFO:tasks.workunit.client.1.smithi152.stdout:1/80: fsync f6 0 2023-12-07T16:21:29.969 INFO:tasks.workunit.client.1.smithi152.stdout:7/45: dread f8 [0,4194304] 0 2023-12-07T16:21:29.970 INFO:tasks.workunit.client.1.smithi152.stdout:3/79: truncate d7/f8 6366528 0 2023-12-07T16:21:29.972 INFO:tasks.workunit.client.1.smithi152.stdout:1/81: write dc/f13 [3466762,116235] 0 2023-12-07T16:21:29.973 INFO:tasks.workunit.client.1.smithi152.stdout:0/70: dwrite d0/dc/f12 [0,4194304] 0 2023-12-07T16:21:29.976 INFO:tasks.workunit.client.1.smithi152.stdout:0/71: truncate d0/f9 3881861 0 2023-12-07T16:21:29.976 INFO:tasks.workunit.client.1.smithi152.stdout:0/72: rename d0 to d0/dc/dd/d14 22 2023-12-07T16:21:29.980 INFO:tasks.workunit.client.1.smithi152.stdout:7/46: dread f6 [4194304,4194304] 0 2023-12-07T16:21:29.984 INFO:tasks.workunit.client.1.smithi152.stdout:8/61: truncate d3/d4/d9/fb 4447346 0 2023-12-07T16:21:29.985 INFO:tasks.workunit.client.1.smithi152.stdout:8/62: mknod d3/d4/d9/dc/c12 0 2023-12-07T16:21:29.986 INFO:tasks.workunit.client.1.smithi152.stdout:0/73: dread d0/f5 [0,4194304] 0 2023-12-07T16:21:29.986 INFO:tasks.workunit.client.1.smithi152.stdout:0/74: fdatasync d0/dc/f12 0 2023-12-07T16:21:29.986 INFO:tasks.workunit.client.1.smithi152.stdout:8/63: creat d3/d4/d9/f13 x:0 0 0 2023-12-07T16:21:29.987 INFO:tasks.workunit.client.1.smithi152.stdout:0/75: mknod d0/c15 0 2023-12-07T16:21:29.987 INFO:tasks.workunit.client.1.smithi152.stdout:0/76: readlink d0/la 0 2023-12-07T16:21:29.988 INFO:tasks.workunit.client.1.smithi152.stdout:8/64: link d3/d4/d9/dc/c12 d3/d4/d9/c14 0 2023-12-07T16:21:29.989 INFO:tasks.workunit.client.1.smithi152.stdout:0/77: mkdir d0/dc/dd/d11/d16 0 2023-12-07T16:21:29.990 INFO:tasks.workunit.client.1.smithi152.stdout:0/78: write d0/f4 [1493364,35984] 0 2023-12-07T16:21:29.991 INFO:tasks.workunit.client.1.smithi152.stdout:3/80: dwrite d7/dc/fe [0,4194304] 0 2023-12-07T16:21:29.991 INFO:tasks.workunit.client.1.smithi152.stdout:1/82: dwrite f9 [0,4194304] 0 2023-12-07T16:21:29.991 INFO:tasks.workunit.client.1.smithi152.stdout:8/65: rename d3/d4/d9/dc/l10 to d3/d4/l15 0 2023-12-07T16:21:30.000 INFO:tasks.workunit.client.1.smithi152.stdout:8/66: rename d3/d4/c7 to d3/c16 0 2023-12-07T16:21:30.000 INFO:tasks.workunit.client.1.smithi152.stdout:3/81: mkdir d7/d10 0 2023-12-07T16:21:30.002 INFO:tasks.workunit.client.1.smithi152.stdout:3/82: mkdir d7/d11 0 2023-12-07T16:21:30.014 INFO:tasks.workunit.client.1.smithi152.stdout:3/83: dread d7/fa [0,4194304] 0 2023-12-07T16:21:30.014 INFO:tasks.workunit.client.1.smithi152.stdout:1/83: dwrite f9 [0,4194304] 0 2023-12-07T16:21:30.015 INFO:tasks.workunit.client.1.smithi152.stdout:0/79: dwrite d0/dc/dd/ff [0,4194304] 0 2023-12-07T16:21:30.018 INFO:tasks.workunit.client.1.smithi152.stdout:0/80: symlink d0/dc/dd/d11/l17 0 2023-12-07T16:21:30.022 INFO:tasks.workunit.client.1.smithi152.stdout:6/43: sync 2023-12-07T16:21:30.022 INFO:tasks.workunit.client.1.smithi152.stdout:4/50: sync 2023-12-07T16:21:30.022 INFO:tasks.workunit.client.1.smithi152.stdout:5/59: sync 2023-12-07T16:21:30.022 INFO:tasks.workunit.client.1.smithi152.stdout:5/60: fsync f8 0 2023-12-07T16:21:30.024 INFO:tasks.workunit.client.1.smithi152.stdout:4/51: write d0/d3/f7 [1583755,39324] 0 2023-12-07T16:21:30.024 INFO:tasks.workunit.client.1.smithi152.stdout:4/52: write d0/fb [688748,77625] 0 2023-12-07T16:21:30.024 INFO:tasks.workunit.client.1.smithi152.stdout:5/61: rmdir dd/d11 39 2023-12-07T16:21:30.024 INFO:tasks.workunit.client.1.smithi152.stdout:5/62: chown dd/de 104 1 2023-12-07T16:21:30.026 INFO:tasks.workunit.client.1.smithi152.stdout:5/63: read f9 [1039253,7363] 0 2023-12-07T16:21:30.028 INFO:tasks.workunit.client.1.smithi152.stdout:0/81: dread d0/f9 [0,4194304] 0 2023-12-07T16:21:30.029 INFO:tasks.workunit.client.1.smithi152.stdout:0/82: stat d0/f4 0 2023-12-07T16:21:30.030 INFO:tasks.workunit.client.1.smithi152.stdout:3/84: dwrite d7/f8 [0,4194304] 0 2023-12-07T16:21:30.031 INFO:tasks.workunit.client.1.smithi152.stdout:3/85: chown d7/lb 364 1 2023-12-07T16:21:30.032 INFO:tasks.workunit.client.1.smithi152.stdout:1/84: truncate f4 160603 0 2023-12-07T16:21:30.034 INFO:tasks.workunit.client.1.smithi152.stdout:1/85: link la dc/de/l17 0 2023-12-07T16:21:30.034 INFO:tasks.workunit.client.1.smithi152.stdout:1/86: truncate dc/f13 772164 0 2023-12-07T16:21:30.038 INFO:tasks.workunit.client.1.smithi152.stdout:3/86: dread d7/f8 [4194304,4194304] 0 2023-12-07T16:21:30.038 INFO:tasks.workunit.client.1.smithi152.stdout:3/87: readlink l5 0 2023-12-07T16:21:30.039 INFO:tasks.workunit.client.1.smithi152.stdout:6/44: dwrite d2/d6/d9/fb [0,4194304] 0 2023-12-07T16:21:30.039 INFO:tasks.workunit.client.1.smithi152.stdout:3/88: link d7/fa d7/dc/f12 0 2023-12-07T16:21:30.040 INFO:tasks.workunit.client.1.smithi152.stdout:1/87: write f4 [886992,42113] 0 2023-12-07T16:21:30.040 INFO:tasks.workunit.client.1.smithi152.stdout:1/88: chown dc 368234309 1 2023-12-07T16:21:30.040 INFO:tasks.workunit.client.1.smithi152.stdout:1/89: readlink l7 0 2023-12-07T16:21:30.040 INFO:tasks.workunit.client.1.smithi152.stdout:3/89: write d7/f8 [2815859,31231] 0 2023-12-07T16:21:30.041 INFO:tasks.workunit.client.1.smithi152.stdout:6/45: dread d2/f7 [0,4194304] 0 2023-12-07T16:21:30.043 INFO:tasks.workunit.client.1.smithi152.stdout:1/90: mkdir dc/d14/d18 0 2023-12-07T16:21:30.043 INFO:tasks.workunit.client.1.smithi152.stdout:1/91: write f4 [958017,48428] 0 2023-12-07T16:21:30.044 INFO:tasks.workunit.client.1.smithi152.stdout:4/53: write d0/d3/f7 [910179,94893] 0 2023-12-07T16:21:30.045 INFO:tasks.workunit.client.1.smithi152.stdout:6/46: creat d2/d6/fc x:0 0 0 2023-12-07T16:21:30.045 INFO:tasks.workunit.client.1.smithi152.stdout:4/54: write d0/fb [472978,115543] 0 2023-12-07T16:21:30.046 INFO:tasks.workunit.client.1.smithi152.stdout:1/92: symlink dc/l19 0 2023-12-07T16:21:30.047 INFO:tasks.workunit.client.1.smithi152.stdout:4/55: read d0/f5 [323142,47601] 0 2023-12-07T16:21:30.048 INFO:tasks.workunit.client.1.smithi152.stdout:1/93: link dc/de/l12 dc/d14/d18/l1a 0 2023-12-07T16:21:30.050 INFO:tasks.workunit.client.1.smithi152.stdout:6/47: dread d2/f4 [0,4194304] 0 2023-12-07T16:21:30.051 INFO:tasks.workunit.client.1.smithi152.stdout:4/56: rmdir d0/d3/d6 39 2023-12-07T16:21:30.052 INFO:tasks.workunit.client.1.smithi152.stdout:3/90: dread f3 [0,4194304] 0 2023-12-07T16:21:30.053 INFO:tasks.workunit.client.1.smithi152.stdout:3/91: write f3 [1973144,56387] 0 2023-12-07T16:21:30.054 INFO:tasks.workunit.client.1.smithi152.stdout:1/94: rename dc/de/l17 to dc/de/l1b 0 2023-12-07T16:21:30.055 INFO:tasks.workunit.client.1.smithi152.stdout:6/48: mknod d2/cd 0 2023-12-07T16:21:30.057 INFO:tasks.workunit.client.1.smithi152.stdout:4/57: link d0/d3/d6/ff d0/d3/d6/dc/dd/f11 0 2023-12-07T16:21:30.060 INFO:tasks.workunit.client.1.smithi152.stdout:1/95: mkdir dc/d14/d18/d1c 0 2023-12-07T16:21:30.060 INFO:tasks.workunit.client.1.smithi152.stdout:1/96: write dc/f13 [1582914,115533] 0 2023-12-07T16:21:30.060 INFO:tasks.workunit.client.1.smithi152.stdout:1/97: fdatasync dc/fd 0 2023-12-07T16:21:30.061 INFO:tasks.workunit.client.1.smithi152.stdout:6/49: mkdir d2/d6/de 0 2023-12-07T16:21:30.063 INFO:tasks.workunit.client.1.smithi152.stdout:4/58: mkdir d0/d3/d12 0 2023-12-07T16:21:30.063 INFO:tasks.workunit.client.1.smithi152.stdout:4/59: chown d0/d3/d6 18 1 2023-12-07T16:21:30.063 INFO:tasks.workunit.client.1.smithi152.stdout:4/60: truncate d0/d3/d6/ff 225125 0 2023-12-07T16:21:30.063 INFO:tasks.workunit.client.1.smithi152.stdout:4/61: write d0/d3/d6/ff [705237,83385] 0 2023-12-07T16:21:30.065 INFO:tasks.workunit.client.1.smithi152.stdout:3/92: rename l6 to d7/dc/l13 0 2023-12-07T16:21:30.066 INFO:tasks.workunit.client.1.smithi152.stdout:1/98: dread dc/f13 [0,4194304] 0 2023-12-07T16:21:30.066 INFO:tasks.workunit.client.1.smithi152.stdout:6/50: symlink d2/d6/lf 0 2023-12-07T16:21:30.067 INFO:tasks.workunit.client.1.smithi152.stdout:4/62: symlink d0/d3/d6/l13 0 2023-12-07T16:21:30.068 INFO:tasks.workunit.client.1.smithi152.stdout:4/63: chown d0/d3/d6/dc/dd 979153 1 2023-12-07T16:21:30.068 INFO:tasks.workunit.client.1.smithi152.stdout:4/64: stat d0/d3/d6 0 2023-12-07T16:21:30.072 INFO:tasks.workunit.client.1.smithi152.stdout:3/93: mkdir d7/dc/d14 0 2023-12-07T16:21:30.072 INFO:tasks.workunit.client.1.smithi152.stdout:1/99: symlink dc/d14/d18/l1d 0 2023-12-07T16:21:30.072 INFO:tasks.workunit.client.1.smithi152.stdout:1/100: fsync f4 0 2023-12-07T16:21:30.073 INFO:tasks.workunit.client.1.smithi152.stdout:3/94: creat d7/dc/d14/f15 x:0 0 0 2023-12-07T16:21:30.074 INFO:tasks.workunit.client.1.smithi152.stdout:1/101: truncate f6 28803 0 2023-12-07T16:21:30.075 INFO:tasks.workunit.client.1.smithi152.stdout:3/95: creat d7/dc/d14/f16 x:0 0 0 2023-12-07T16:21:30.075 INFO:tasks.workunit.client.1.smithi152.stdout:1/102: mknod dc/d14/c1e 0 2023-12-07T16:21:30.082 INFO:tasks.workunit.client.1.smithi152.stdout:4/65: dwrite d0/d3/d6/dc/dd/fe [0,4194304] 0 2023-12-07T16:21:30.085 INFO:tasks.workunit.client.1.smithi152.stdout:3/96: dread d7/dc/f12 [0,4194304] 0 2023-12-07T16:21:30.085 INFO:tasks.workunit.client.1.smithi152.stdout:3/97: read - d7/dc/d14/f16 zero size 2023-12-07T16:21:30.087 INFO:tasks.workunit.client.1.smithi152.stdout:4/66: mknod d0/c14 0 2023-12-07T16:21:30.088 INFO:tasks.workunit.client.1.smithi152.stdout:3/98: creat d7/dc/d14/f17 x:0 0 0 2023-12-07T16:21:30.088 INFO:tasks.workunit.client.1.smithi152.stdout:3/99: write d7/dc/d14/f17 [730807,4190] 0 2023-12-07T16:21:30.090 INFO:tasks.workunit.client.1.smithi152.stdout:3/100: link d7/dc/d14/f17 d7/d11/f18 0 2023-12-07T16:21:30.090 INFO:tasks.workunit.client.1.smithi152.stdout:3/101: fdatasync f3 0 2023-12-07T16:21:30.090 INFO:tasks.workunit.client.1.smithi152.stdout:3/102: mkdir d7/d10/d19 0 2023-12-07T16:21:30.093 INFO:tasks.workunit.client.1.smithi152.stdout:6/51: getdents d2/d6 0 2023-12-07T16:21:30.094 INFO:tasks.workunit.client.1.smithi152.stdout:6/52: write d2/d6/d9/fb [3693689,122338] 0 2023-12-07T16:21:30.094 INFO:tasks.workunit.client.1.smithi152.stdout:6/53: stat d2/d6/d9/fb 0 2023-12-07T16:21:30.095 INFO:tasks.workunit.client.1.smithi152.stdout:9/108: sync 2023-12-07T16:21:30.097 INFO:tasks.workunit.client.1.smithi152.stdout:9/109: creat d1/d9/f26 x:0 0 0 2023-12-07T16:21:30.097 INFO:tasks.workunit.client.1.smithi152.stdout:9/110: stat d1/d9/db/df 0 2023-12-07T16:21:30.097 INFO:tasks.workunit.client.1.smithi152.stdout:9/111: stat d1/f5 0 2023-12-07T16:21:30.119 INFO:tasks.workunit.client.1.smithi152.stdout:3/103: dwrite d7/dc/d14/f15 [0,4194304] 0 2023-12-07T16:21:30.119 INFO:tasks.workunit.client.1.smithi152.stdout:4/67: dwrite d0/d3/d6/dc/dd/fe [0,4194304] 0 2023-12-07T16:21:30.122 INFO:tasks.workunit.client.1.smithi152.stdout:4/68: read d0/f5 [135550,10207] 0 2023-12-07T16:21:30.122 INFO:tasks.workunit.client.1.smithi152.stdout:3/104: mkdir d7/d10/d1a 0 2023-12-07T16:21:30.122 INFO:tasks.workunit.client.1.smithi152.stdout:9/112: dwrite d1/d9/f20 [0,4194304] 0 2023-12-07T16:21:30.122 INFO:tasks.workunit.client.1.smithi152.stdout:9/113: dread - d1/d9/f26 zero size 2023-12-07T16:21:30.122 INFO:tasks.workunit.client.1.smithi152.stdout:4/69: rmdir d0/d3/d6/dc 39 2023-12-07T16:21:30.122 INFO:tasks.workunit.client.1.smithi152.stdout:4/70: fdatasync d0/d3/d6/dc/f10 0 2023-12-07T16:21:30.123 INFO:tasks.workunit.client.1.smithi152.stdout:3/105: unlink d7/fa 0 2023-12-07T16:21:30.124 INFO:tasks.workunit.client.1.smithi152.stdout:4/71: dread d0/d3/d6/dc/dd/f11 [0,4194304] 0 2023-12-07T16:21:30.124 INFO:tasks.workunit.client.1.smithi152.stdout:6/54: dread d2/d6/d9/fb [0,4194304] 0 2023-12-07T16:21:30.125 INFO:tasks.workunit.client.1.smithi152.stdout:4/72: write d0/f1 [1058873,122759] 0 2023-12-07T16:21:30.125 INFO:tasks.workunit.client.1.smithi152.stdout:4/73: fsync d0/d3/d6/ff 0 2023-12-07T16:21:30.126 INFO:tasks.workunit.client.1.smithi152.stdout:9/114: truncate d1/d9/db/df/f1f 367075 0 2023-12-07T16:21:30.127 INFO:tasks.workunit.client.1.smithi152.stdout:3/106: creat d7/dc/f1b x:0 0 0 2023-12-07T16:21:30.128 INFO:tasks.workunit.client.1.smithi152.stdout:6/55: symlink d2/d6/l10 0 2023-12-07T16:21:30.129 INFO:tasks.workunit.client.1.smithi152.stdout:4/74: symlink d0/l15 0 2023-12-07T16:21:30.129 INFO:tasks.workunit.client.1.smithi152.stdout:4/75: chown d0/f5 28043 1 2023-12-07T16:21:30.129 INFO:tasks.workunit.client.1.smithi152.stdout:4/76: chown d0/d3/d6/dc 26 1 2023-12-07T16:21:30.130 INFO:tasks.workunit.client.1.smithi152.stdout:9/115: rename d1/d9/db/f21 to d1/d9/db/df/f27 0 2023-12-07T16:21:30.132 INFO:tasks.workunit.client.1.smithi152.stdout:6/56: unlink l0 0 2023-12-07T16:21:30.135 INFO:tasks.workunit.client.1.smithi152.stdout:3/107: dread d7/dc/f12 [0,4194304] 0 2023-12-07T16:21:30.137 INFO:tasks.workunit.client.1.smithi152.stdout:4/77: link d0/c14 d0/c16 0 2023-12-07T16:21:30.137 INFO:tasks.workunit.client.1.smithi152.stdout:4/78: fdatasync d0/d3/d6/dc/dd/f11 0 2023-12-07T16:21:30.137 INFO:tasks.workunit.client.1.smithi152.stdout:4/79: fsync d0/fb 0 2023-12-07T16:21:30.139 INFO:tasks.workunit.client.1.smithi152.stdout:6/57: creat d2/d6/de/f11 x:0 0 0 2023-12-07T16:21:30.139 INFO:tasks.workunit.client.1.smithi152.stdout:6/58: chown d2/d6/ca 3 1 2023-12-07T16:21:30.142 INFO:tasks.workunit.client.1.smithi152.stdout:3/108: write d7/dc/d14/f17 [1388498,2453] 0 2023-12-07T16:21:30.144 INFO:tasks.workunit.client.1.smithi152.stdout:4/80: rmdir d0/d3/d6/dc 39 2023-12-07T16:21:30.147 INFO:tasks.workunit.client.1.smithi152.stdout:6/59: rename d2/d6/d9/fb to d2/d6/d9/f12 0 2023-12-07T16:21:30.152 INFO:tasks.workunit.client.1.smithi152.stdout:2/55: sync 2023-12-07T16:21:30.152 INFO:tasks.workunit.client.1.smithi152.stdout:7/47: sync 2023-12-07T16:21:30.152 INFO:tasks.workunit.client.1.smithi152.stdout:7/48: stat l7 0 2023-12-07T16:21:30.154 INFO:tasks.workunit.client.1.smithi152.stdout:3/109: mknod d7/d10/d1a/c1c 0 2023-12-07T16:21:30.155 INFO:tasks.workunit.client.1.smithi152.stdout:3/110: fdatasync d7/dc/d14/f17 0 2023-12-07T16:21:30.156 INFO:tasks.workunit.client.1.smithi152.stdout:4/81: rmdir d0/d3/d12 0 2023-12-07T16:21:30.158 INFO:tasks.workunit.client.1.smithi152.stdout:6/60: creat d2/d6/d9/f13 x:0 0 0 2023-12-07T16:21:30.162 INFO:tasks.workunit.client.1.smithi152.stdout:7/49: rename db/fc to db/fe 0 2023-12-07T16:21:30.162 INFO:tasks.workunit.client.1.smithi152.stdout:4/82: dread d0/f5 [0,4194304] 0 2023-12-07T16:21:30.167 INFO:tasks.workunit.client.1.smithi152.stdout:6/61: mkdir d2/d6/d9/d14 0 2023-12-07T16:21:30.169 INFO:tasks.workunit.client.1.smithi152.stdout:4/83: truncate d0/f5 1615217 0 2023-12-07T16:21:30.169 INFO:tasks.workunit.client.1.smithi152.stdout:4/84: chown d0/l15 205576830 1 2023-12-07T16:21:30.173 INFO:tasks.workunit.client.1.smithi152.stdout:2/56: rmdir d2/da/d18 0 2023-12-07T16:21:30.174 INFO:tasks.workunit.client.1.smithi152.stdout:4/85: getdents d0 0 2023-12-07T16:21:30.174 INFO:tasks.workunit.client.1.smithi152.stdout:4/86: dread - d0/d3/d6/dc/f10 zero size 2023-12-07T16:21:30.176 INFO:tasks.workunit.client.1.smithi152.stdout:7/50: dread f6 [0,4194304] 0 2023-12-07T16:21:30.176 INFO:tasks.workunit.client.1.smithi152.stdout:4/87: write d0/d3/f7 [3568281,44937] 0 2023-12-07T16:21:30.176 INFO:tasks.workunit.client.1.smithi152.stdout:7/51: truncate f8 1827427 0 2023-12-07T16:21:30.177 INFO:tasks.workunit.client.1.smithi152.stdout:4/88: mkdir d0/d17 0 2023-12-07T16:21:30.178 INFO:tasks.workunit.client.1.smithi152.stdout:7/52: symlink db/dd/lf 0 2023-12-07T16:21:30.179 INFO:tasks.workunit.client.1.smithi152.stdout:4/89: dread d0/d3/d6/dc/dd/f11 [0,4194304] 0 2023-12-07T16:21:30.179 INFO:tasks.workunit.client.1.smithi152.stdout:3/111: dread d7/dc/fe [0,4194304] 0 2023-12-07T16:21:30.180 INFO:tasks.workunit.client.1.smithi152.stdout:7/53: creat db/dd/f10 x:0 0 0 2023-12-07T16:21:30.181 INFO:tasks.workunit.client.1.smithi152.stdout:6/62: dwrite d2/d6/de/f11 [0,4194304] 0 2023-12-07T16:21:30.181 INFO:tasks.workunit.client.1.smithi152.stdout:6/63: write d2/d6/d9/f13 [932266,128508] 0 2023-12-07T16:21:30.182 INFO:tasks.workunit.client.1.smithi152.stdout:4/90: getdents d0/d3 0 2023-12-07T16:21:30.183 INFO:tasks.workunit.client.1.smithi152.stdout:3/112: read f2 [1050313,88548] 0 2023-12-07T16:21:30.183 INFO:tasks.workunit.client.1.smithi152.stdout:7/54: mkdir db/dd/d11 0 2023-12-07T16:21:30.187 INFO:tasks.workunit.client.1.smithi152.stdout:3/113: link f3 d7/d11/f1d 0 2023-12-07T16:21:30.189 INFO:tasks.workunit.client.1.smithi152.stdout:7/55: rmdir db/dd/d11 0 2023-12-07T16:21:30.190 INFO:tasks.workunit.client.1.smithi152.stdout:7/56: rename la to db/l12 0 2023-12-07T16:21:30.194 INFO:tasks.workunit.client.1.smithi152.stdout:7/57: creat db/f13 x:0 0 0 2023-12-07T16:21:30.194 INFO:tasks.workunit.client.1.smithi152.stdout:7/58: truncate db/dd/f10 638586 0 2023-12-07T16:21:30.194 INFO:tasks.workunit.client.1.smithi152.stdout:7/59: stat db/fe 0 2023-12-07T16:21:30.194 INFO:tasks.workunit.client.1.smithi152.stdout:7/60: fdatasync f8 0 2023-12-07T16:21:30.194 INFO:tasks.workunit.client.1.smithi152.stdout:7/61: fdatasync db/dd/f10 0 2023-12-07T16:21:30.195 INFO:tasks.workunit.client.1.smithi152.stdout:2/57: dwrite d2/d9/f11 [0,4194304] 0 2023-12-07T16:21:30.196 INFO:tasks.workunit.client.1.smithi152.stdout:7/62: link l7 db/dd/l14 0 2023-12-07T16:21:30.200 INFO:tasks.workunit.client.1.smithi152.stdout:2/58: rename d2/d9/cd to d2/d9/c19 0 2023-12-07T16:21:30.201 INFO:tasks.workunit.client.1.smithi152.stdout:4/91: dread d0/d3/f7 [0,4194304] 0 2023-12-07T16:21:30.203 INFO:tasks.workunit.client.1.smithi152.stdout:3/114: dwrite d7/d11/f18 [0,4194304] 0 2023-12-07T16:21:30.203 INFO:tasks.workunit.client.1.smithi152.stdout:3/115: fsync d7/d11/f18 0 2023-12-07T16:21:30.205 INFO:tasks.workunit.client.1.smithi152.stdout:2/59: rmdir d2/da 0 2023-12-07T16:21:30.205 INFO:tasks.workunit.client.1.smithi152.stdout:2/60: chown d2/c6 186113901 1 2023-12-07T16:21:30.211 INFO:tasks.workunit.client.1.smithi152.stdout:3/116: creat d7/dc/d14/f1e x:0 0 0 2023-12-07T16:21:30.213 INFO:tasks.workunit.client.1.smithi152.stdout:2/61: mknod d2/d9/c1a 0 2023-12-07T16:21:30.215 INFO:tasks.workunit.client.1.smithi152.stdout:3/117: mknod d7/d11/c1f 0 2023-12-07T16:21:30.218 INFO:tasks.workunit.client.1.smithi152.stdout:6/64: dwrite d2/d6/de/f11 [4194304,4194304] 0 2023-12-07T16:21:30.219 INFO:tasks.workunit.client.1.smithi152.stdout:3/118: getdents d7/dc 0 2023-12-07T16:21:30.219 INFO:tasks.workunit.client.1.smithi152.stdout:3/119: fdatasync d7/f8 0 2023-12-07T16:21:30.219 INFO:tasks.workunit.client.1.smithi152.stdout:6/65: read d2/f7 [814568,115847] 0 2023-12-07T16:21:30.221 INFO:tasks.workunit.client.1.smithi152.stdout:3/120: creat d7/d11/f20 x:0 0 0 2023-12-07T16:21:30.223 INFO:tasks.workunit.client.1.smithi152.stdout:6/66: mknod d2/c15 0 2023-12-07T16:21:30.223 INFO:tasks.workunit.client.1.smithi152.stdout:6/67: fsync d2/f7 0 2023-12-07T16:21:30.223 INFO:tasks.workunit.client.1.smithi152.stdout:6/68: truncate d2/f5 832841 0 2023-12-07T16:21:30.223 INFO:tasks.workunit.client.1.smithi152.stdout:6/69: chown d2/d6/lf 58 1 2023-12-07T16:21:30.224 INFO:tasks.workunit.client.1.smithi152.stdout:3/121: rmdir d7/d10 39 2023-12-07T16:21:30.227 INFO:tasks.workunit.client.1.smithi152.stdout:6/70: dread d2/f3 [0,4194304] 0 2023-12-07T16:21:30.228 INFO:tasks.workunit.client.1.smithi152.stdout:6/71: symlink d2/d6/l16 0 2023-12-07T16:21:30.228 INFO:tasks.workunit.client.1.smithi152.stdout:6/72: stat d2/d6/lf 0 2023-12-07T16:21:30.229 INFO:tasks.workunit.client.1.smithi152.stdout:6/73: mknod d2/d6/de/c17 0 2023-12-07T16:21:30.230 INFO:tasks.workunit.client.1.smithi152.stdout:6/74: write d2/d6/d9/f13 [323989,8244] 0 2023-12-07T16:21:30.231 INFO:tasks.workunit.client.1.smithi152.stdout:3/122: dread d7/dc/d14/f17 [0,4194304] 0 2023-12-07T16:21:30.235 INFO:tasks.workunit.client.1.smithi152.stdout:7/63: dwrite f8 [0,4194304] 0 2023-12-07T16:21:30.235 INFO:tasks.workunit.client.1.smithi152.stdout:2/62: dwrite d2/d9/f13 [0,4194304] 0 2023-12-07T16:21:30.236 INFO:tasks.workunit.client.1.smithi152.stdout:6/75: getdents d2/d6 0 2023-12-07T16:21:30.236 INFO:tasks.workunit.client.1.smithi152.stdout:6/76: stat d2/d6/de/c17 0 2023-12-07T16:21:30.246 INFO:tasks.workunit.client.1.smithi152.stdout:0/83: sync 2023-12-07T16:21:30.246 INFO:tasks.workunit.client.1.smithi152.stdout:5/64: sync 2023-12-07T16:21:30.246 INFO:tasks.workunit.client.1.smithi152.stdout:8/67: sync 2023-12-07T16:21:30.246 INFO:tasks.workunit.client.1.smithi152.stdout:0/84: getdents d0/dc/dd/d11/d16 0 2023-12-07T16:21:30.247 INFO:tasks.workunit.client.1.smithi152.stdout:8/68: write d3/d4/d9/f13 [1038165,39735] 0 2023-12-07T16:21:30.248 INFO:tasks.workunit.client.1.smithi152.stdout:5/65: unlink dd/d11/l12 0 2023-12-07T16:21:30.250 INFO:tasks.workunit.client.1.smithi152.stdout:0/85: creat d0/f18 x:0 0 0 2023-12-07T16:21:30.250 INFO:tasks.workunit.client.1.smithi152.stdout:8/69: creat d3/d4/d9/f17 x:0 0 0 2023-12-07T16:21:30.251 INFO:tasks.workunit.client.1.smithi152.stdout:0/86: write d0/dc/f12 [2509242,84435] 0 2023-12-07T16:21:30.251 INFO:tasks.workunit.client.1.smithi152.stdout:2/63: dread f1 [0,4194304] 0 2023-12-07T16:21:30.252 INFO:tasks.workunit.client.1.smithi152.stdout:5/66: link fc dd/de/f13 0 2023-12-07T16:21:30.252 INFO:tasks.workunit.client.1.smithi152.stdout:8/70: creat d3/d4/d9/f18 x:0 0 0 2023-12-07T16:21:30.253 INFO:tasks.workunit.client.1.smithi152.stdout:5/67: write f9 [1456311,28071] 0 2023-12-07T16:21:30.253 INFO:tasks.workunit.client.1.smithi152.stdout:5/68: chown dd/d11 56 1 2023-12-07T16:21:30.254 INFO:tasks.workunit.client.1.smithi152.stdout:0/87: mknod d0/c19 0 2023-12-07T16:21:30.258 INFO:tasks.workunit.client.1.smithi152.stdout:2/64: rmdir d2 39 2023-12-07T16:21:30.258 INFO:tasks.workunit.client.1.smithi152.stdout:5/69: mkdir dd/de/d14 0 2023-12-07T16:21:30.260 INFO:tasks.workunit.client.1.smithi152.stdout:0/88: creat d0/f1a x:0 0 0 2023-12-07T16:21:30.260 INFO:tasks.workunit.client.1.smithi152.stdout:2/65: rename d2/fb to d2/d9/f1b 0 2023-12-07T16:21:30.261 INFO:tasks.workunit.client.1.smithi152.stdout:3/123: dwrite d7/dc/f1b [0,4194304] 0 2023-12-07T16:21:30.261 INFO:tasks.workunit.client.1.smithi152.stdout:3/124: read f2 [5818424,32138] 0 2023-12-07T16:21:30.261 INFO:tasks.workunit.client.1.smithi152.stdout:3/125: chown d7/dc/d14/f15 391833 1 2023-12-07T16:21:30.261 INFO:tasks.workunit.client.1.smithi152.stdout:0/89: symlink d0/dc/l1b 0 2023-12-07T16:21:30.261 INFO:tasks.workunit.client.1.smithi152.stdout:0/90: getdents d0/dc/dd/d11/d16 0 2023-12-07T16:21:30.262 INFO:tasks.workunit.client.1.smithi152.stdout:0/91: truncate d0/f5 4873928 0 2023-12-07T16:21:30.263 INFO:tasks.workunit.client.1.smithi152.stdout:5/70: read dd/de/f13 [120361,75863] 0 2023-12-07T16:21:30.264 INFO:tasks.workunit.client.1.smithi152.stdout:2/66: write f1 [55519,73534] 0 2023-12-07T16:21:30.264 INFO:tasks.workunit.client.1.smithi152.stdout:2/67: readlink d2/l16 0 2023-12-07T16:21:30.264 INFO:tasks.workunit.client.1.smithi152.stdout:5/71: unlink lb 0 2023-12-07T16:21:30.266 INFO:tasks.workunit.client.1.smithi152.stdout:2/68: mkdir d2/d1c 0 2023-12-07T16:21:30.266 INFO:tasks.workunit.client.1.smithi152.stdout:2/69: chown d2/f8 0 1 2023-12-07T16:21:30.266 INFO:tasks.workunit.client.1.smithi152.stdout:2/70: stat d2/d9/lc 0 2023-12-07T16:21:30.266 INFO:tasks.workunit.client.1.smithi152.stdout:2/71: readlink l0 0 2023-12-07T16:21:30.269 INFO:tasks.workunit.client.1.smithi152.stdout:2/72: read f1 [1985269,1488] 0 2023-12-07T16:21:30.271 INFO:tasks.workunit.client.1.smithi152.stdout:5/72: write f8 [2199855,9546] 0 2023-12-07T16:21:30.273 INFO:tasks.workunit.client.1.smithi152.stdout:7/64: dwrite db/fe [0,4194304] 0 2023-12-07T16:21:30.273 INFO:tasks.workunit.client.1.smithi152.stdout:0/92: dread d0/dc/dd/ff [0,4194304] 0 2023-12-07T16:21:30.274 INFO:tasks.workunit.client.1.smithi152.stdout:6/77: dwrite d2/f3 [0,4194304] 0 2023-12-07T16:21:30.274 INFO:tasks.workunit.client.1.smithi152.stdout:8/71: dwrite d3/d4/d9/f17 [0,4194304] 0 2023-12-07T16:21:30.274 INFO:tasks.workunit.client.1.smithi152.stdout:6/78: fdatasync d2/f7 0 2023-12-07T16:21:30.278 INFO:tasks.workunit.client.1.smithi152.stdout:0/93: unlink d0/c3 0 2023-12-07T16:21:30.282 INFO:tasks.workunit.client.1.smithi152.stdout:7/65: write db/fe [610997,83501] 0 2023-12-07T16:21:30.284 INFO:tasks.workunit.client.1.smithi152.stdout:8/72: getdents d3/d4/d9/dc 0 2023-12-07T16:21:30.284 INFO:tasks.workunit.client.1.smithi152.stdout:3/126: dwrite d7/dc/d14/f16 [0,4194304] 0 2023-12-07T16:21:30.286 INFO:tasks.workunit.client.1.smithi152.stdout:6/79: mknod d2/d6/d9/d14/c18 0 2023-12-07T16:21:30.287 INFO:tasks.workunit.client.1.smithi152.stdout:8/73: mknod d3/d4/c19 0 2023-12-07T16:21:30.288 INFO:tasks.workunit.client.1.smithi152.stdout:6/80: dread d2/f4 [0,4194304] 0 2023-12-07T16:21:30.288 INFO:tasks.workunit.client.1.smithi152.stdout:6/81: getdents d2/d6 0 2023-12-07T16:21:30.291 INFO:tasks.workunit.client.1.smithi152.stdout:7/66: dread f8 [0,4194304] 0 2023-12-07T16:21:30.291 INFO:tasks.workunit.client.1.smithi152.stdout:8/74: write d3/d4/d9/f13 [602823,35364] 0 2023-12-07T16:21:30.293 INFO:tasks.workunit.client.1.smithi152.stdout:3/127: creat d7/dc/d14/f21 x:0 0 0 2023-12-07T16:21:30.295 INFO:tasks.workunit.client.1.smithi152.stdout:7/67: rename l7 to db/l15 0 2023-12-07T16:21:30.298 INFO:tasks.workunit.client.1.smithi152.stdout:8/75: rename d3/d4/d9/f17 to d3/f1a 0 2023-12-07T16:21:30.298 INFO:tasks.workunit.client.1.smithi152.stdout:8/76: chown d3/d4/ca 17537 1 2023-12-07T16:21:30.299 INFO:tasks.workunit.client.1.smithi152.stdout:7/68: creat db/dd/f16 x:0 0 0 2023-12-07T16:21:30.299 INFO:tasks.workunit.client.1.smithi152.stdout:7/69: write db/fe [4583330,39726] 0 2023-12-07T16:21:30.299 INFO:tasks.workunit.client.1.smithi152.stdout:7/70: truncate db/dd/f16 347555 0 2023-12-07T16:21:30.299 INFO:tasks.workunit.client.1.smithi152.stdout:7/71: fsync f8 0 2023-12-07T16:21:30.299 INFO:tasks.workunit.client.1.smithi152.stdout:7/72: chown db/dd/l14 0 1 2023-12-07T16:21:30.299 INFO:tasks.workunit.client.1.smithi152.stdout:7/73: write db/f13 [939258,75528] 0 2023-12-07T16:21:30.300 INFO:tasks.workunit.client.1.smithi152.stdout:5/73: dwrite f9 [0,4194304] 0 2023-12-07T16:21:30.300 INFO:tasks.workunit.client.1.smithi152.stdout:0/94: dwrite d0/f5 [4194304,4194304] 0 2023-12-07T16:21:30.301 INFO:tasks.workunit.client.1.smithi152.stdout:5/74: read f8 [3119158,87674] 0 2023-12-07T16:21:30.301 INFO:tasks.workunit.client.1.smithi152.stdout:5/75: chown la 1055 1 2023-12-07T16:21:30.302 INFO:tasks.workunit.client.1.smithi152.stdout:7/74: mknod db/c17 0 2023-12-07T16:21:30.306 INFO:tasks.workunit.client.1.smithi152.stdout:0/95: rmdir d0/dc/dd/d11/d16 0 2023-12-07T16:21:30.307 INFO:tasks.workunit.client.1.smithi152.stdout:1/103: sync 2023-12-07T16:21:30.309 INFO:tasks.workunit.client.1.smithi152.stdout:1/104: read f9 [154297,29727] 0 2023-12-07T16:21:30.310 INFO:tasks.workunit.client.1.smithi152.stdout:1/105: read dc/f13 [1468551,74858] 0 2023-12-07T16:21:30.310 INFO:tasks.workunit.client.1.smithi152.stdout:1/106: chown la 147 1 2023-12-07T16:21:30.310 INFO:tasks.workunit.client.1.smithi152.stdout:1/107: truncate dc/fd 862368 0 2023-12-07T16:21:30.310 INFO:tasks.workunit.client.1.smithi152.stdout:1/108: write f6 [739153,15244] 0 2023-12-07T16:21:30.310 INFO:tasks.workunit.client.1.smithi152.stdout:8/77: getdents d3 0 2023-12-07T16:21:30.310 INFO:tasks.workunit.client.1.smithi152.stdout:8/78: write d3/d4/d9/f18 [281573,54149] 0 2023-12-07T16:21:30.312 INFO:tasks.workunit.client.1.smithi152.stdout:6/82: dwrite d2/f5 [0,4194304] 0 2023-12-07T16:21:30.312 INFO:tasks.workunit.client.1.smithi152.stdout:8/79: symlink d3/d4/d9/dc/l1b 0 2023-12-07T16:21:30.312 INFO:tasks.workunit.client.1.smithi152.stdout:7/75: rmdir db/dd 39 2023-12-07T16:21:30.312 INFO:tasks.workunit.client.1.smithi152.stdout:7/76: write db/dd/f16 [241183,70322] 0 2023-12-07T16:21:30.312 INFO:tasks.workunit.client.1.smithi152.stdout:7/77: chown l5 2 1 2023-12-07T16:21:30.316 INFO:tasks.workunit.client.1.smithi152.stdout:6/83: mkdir d2/d6/d19 0 2023-12-07T16:21:30.316 INFO:tasks.workunit.client.1.smithi152.stdout:5/76: dread dd/de/f13 [0,4194304] 0 2023-12-07T16:21:30.317 INFO:tasks.workunit.client.1.smithi152.stdout:8/80: creat d3/d4/d9/f1c x:0 0 0 2023-12-07T16:21:30.317 INFO:tasks.workunit.client.1.smithi152.stdout:8/81: write d3/d4/d9/f13 [1070043,36229] 0 2023-12-07T16:21:30.319 INFO:tasks.workunit.client.1.smithi152.stdout:7/78: creat db/f18 x:0 0 0 2023-12-07T16:21:30.319 INFO:tasks.workunit.client.1.smithi152.stdout:7/79: chown db/l12 7 1 2023-12-07T16:21:30.319 INFO:tasks.workunit.client.1.smithi152.stdout:7/80: stat f6 0 2023-12-07T16:21:30.319 INFO:tasks.workunit.client.1.smithi152.stdout:6/84: creat d2/d6/f1a x:0 0 0 2023-12-07T16:21:30.321 INFO:tasks.workunit.client.1.smithi152.stdout:8/82: creat d3/f1d x:0 0 0 2023-12-07T16:21:30.324 INFO:tasks.workunit.client.1.smithi152.stdout:6/85: creat d2/d6/f1b x:0 0 0 2023-12-07T16:21:30.324 INFO:tasks.workunit.client.1.smithi152.stdout:6/86: fsync d2/f7 0 2023-12-07T16:21:30.325 INFO:tasks.workunit.client.1.smithi152.stdout:8/83: mkdir d3/d1e 0 2023-12-07T16:21:30.328 INFO:tasks.workunit.client.1.smithi152.stdout:6/87: write d2/d6/d9/f12 [1075425,58895] 0 2023-12-07T16:21:30.328 INFO:tasks.workunit.client.1.smithi152.stdout:6/88: write d2/d6/fc [174253,122112] 0 2023-12-07T16:21:30.328 INFO:tasks.workunit.client.1.smithi152.stdout:6/89: dread - d2/d6/f1b zero size 2023-12-07T16:21:30.330 INFO:tasks.workunit.client.1.smithi152.stdout:6/90: mknod d2/d6/de/c1c 0 2023-12-07T16:21:30.332 INFO:tasks.workunit.client.1.smithi152.stdout:6/91: read d2/d6/d9/f13 [807171,65841] 0 2023-12-07T16:21:30.335 INFO:tasks.workunit.client.1.smithi152.stdout:8/84: dread d3/f1a [0,4194304] 0 2023-12-07T16:21:30.335 INFO:tasks.workunit.client.1.smithi152.stdout:8/85: write d3/d4/d9/f18 [340895,82020] 0 2023-12-07T16:21:30.340 INFO:tasks.workunit.client.1.smithi152.stdout:1/109: dwrite f4 [0,4194304] 0 2023-12-07T16:21:30.340 INFO:tasks.workunit.client.1.smithi152.stdout:5/77: dwrite dd/de/f13 [0,4194304] 0 2023-12-07T16:21:30.341 INFO:tasks.workunit.client.1.smithi152.stdout:3/128: dwrite d7/d11/f20 [0,4194304] 0 2023-12-07T16:21:30.342 INFO:tasks.workunit.client.1.smithi152.stdout:5/78: read f9 [4190064,85353] 0 2023-12-07T16:21:30.344 INFO:tasks.workunit.client.1.smithi152.stdout:0/96: dwrite d0/dc/dd/ff [0,4194304] 0 2023-12-07T16:21:30.344 INFO:tasks.workunit.client.1.smithi152.stdout:0/97: chown d0/c7 46 1 2023-12-07T16:21:30.350 INFO:tasks.workunit.client.1.smithi152.stdout:5/79: readlink l7 0 2023-12-07T16:21:30.351 INFO:tasks.workunit.client.1.smithi152.stdout:0/98: truncate d0/dc/f12 2141784 0 2023-12-07T16:21:30.358 INFO:tasks.workunit.client.1.smithi152.stdout:0/99: write d0/dc/dd/ff [2208562,124453] 0 2023-12-07T16:21:30.358 INFO:tasks.workunit.client.1.smithi152.stdout:0/100: chown d0/la 72406569 1 2023-12-07T16:21:30.358 INFO:tasks.workunit.client.1.smithi152.stdout:0/101: readlink d0/dc/l1b 0 2023-12-07T16:21:30.358 INFO:tasks.workunit.client.1.smithi152.stdout:0/102: write d0/f18 [847743,107980] 0 2023-12-07T16:21:30.362 INFO:tasks.workunit.client.1.smithi152.stdout:0/103: dread d0/f9 [0,4194304] 0 2023-12-07T16:21:30.365 INFO:tasks.workunit.client.1.smithi152.stdout:5/80: dread dd/de/f13 [0,4194304] 0 2023-12-07T16:21:30.366 INFO:tasks.workunit.client.1.smithi152.stdout:5/81: rename l4 to dd/de/l15 0 2023-12-07T16:21:30.367 INFO:tasks.workunit.client.1.smithi152.stdout:6/92: dwrite d2/f3 [0,4194304] 0 2023-12-07T16:21:30.367 INFO:tasks.workunit.client.1.smithi152.stdout:5/82: unlink la 0 2023-12-07T16:21:30.368 INFO:tasks.workunit.client.1.smithi152.stdout:3/129: dwrite d7/d11/f18 [0,4194304] 0 2023-12-07T16:21:30.369 INFO:tasks.workunit.client.1.smithi152.stdout:3/130: dread - d7/dc/d14/f1e zero size 2023-12-07T16:21:30.369 INFO:tasks.workunit.client.1.smithi152.stdout:3/131: write d7/dc/d14/f21 [413884,11632] 0 2023-12-07T16:21:30.369 INFO:tasks.workunit.client.1.smithi152.stdout:6/93: link d2/cd d2/d6/d19/c1d 0 2023-12-07T16:21:30.369 INFO:tasks.workunit.client.1.smithi152.stdout:8/86: dwrite d3/f1d [0,4194304] 0 2023-12-07T16:21:30.369 INFO:tasks.workunit.client.1.smithi152.stdout:5/83: read f9 [1205553,17391] 0 2023-12-07T16:21:30.370 INFO:tasks.workunit.client.1.smithi152.stdout:3/132: rename d7/dc/d14/f21 to d7/d11/f22 0 2023-12-07T16:21:30.370 INFO:tasks.workunit.client.1.smithi152.stdout:3/133: fdatasync d7/d11/f1d 0 2023-12-07T16:21:30.371 INFO:tasks.workunit.client.1.smithi152.stdout:6/94: mknod d2/d6/d9/d14/c1e 0 2023-12-07T16:21:30.373 INFO:tasks.workunit.client.1.smithi152.stdout:1/110: dwrite dc/fd [0,4194304] 0 2023-12-07T16:21:30.373 INFO:tasks.workunit.client.1.smithi152.stdout:1/111: fdatasync dc/fd 0 2023-12-07T16:21:30.373 INFO:tasks.workunit.client.1.smithi152.stdout:1/112: readlink dc/d14/d18/l1d 0 2023-12-07T16:21:30.373 INFO:tasks.workunit.client.1.smithi152.stdout:3/134: dread f2 [4194304,4194304] 0 2023-12-07T16:21:30.374 INFO:tasks.workunit.client.1.smithi152.stdout:6/95: dread d2/d6/fc [0,4194304] 0 2023-12-07T16:21:30.374 INFO:tasks.workunit.client.1.smithi152.stdout:6/96: write d2/f5 [5034971,82241] 0 2023-12-07T16:21:30.374 INFO:tasks.workunit.client.1.smithi152.stdout:6/97: readlink d2/d6/lf 0 2023-12-07T16:21:30.377 INFO:tasks.workunit.client.1.smithi152.stdout:1/113: rmdir dc/d14/d18/d1c 0 2023-12-07T16:21:30.377 INFO:tasks.workunit.client.1.smithi152.stdout:3/135: creat d7/d10/d19/f23 x:0 0 0 2023-12-07T16:21:30.378 INFO:tasks.workunit.client.1.smithi152.stdout:5/84: dread dd/de/f13 [0,4194304] 0 2023-12-07T16:21:30.378 INFO:tasks.workunit.client.1.smithi152.stdout:5/85: stat dd/de/f13 0 2023-12-07T16:21:30.379 INFO:tasks.workunit.client.1.smithi152.stdout:6/98: mkdir d2/d6/d19/d1f 0 2023-12-07T16:21:30.379 INFO:tasks.workunit.client.1.smithi152.stdout:1/114: read dc/fd [773981,71140] 0 2023-12-07T16:21:30.379 INFO:tasks.workunit.client.1.smithi152.stdout:1/115: fsync dc/fd 0 2023-12-07T16:21:30.379 INFO:tasks.workunit.client.1.smithi152.stdout:8/87: fsync d3/f1d 0 2023-12-07T16:21:30.380 INFO:tasks.workunit.client.1.smithi152.stdout:3/136: symlink d7/d10/l24 0 2023-12-07T16:21:30.380 INFO:tasks.workunit.client.1.smithi152.stdout:3/137: chown d7/d11/f1d 1 1 2023-12-07T16:21:30.382 INFO:tasks.workunit.client.1.smithi152.stdout:6/99: unlink d2/cd 0 2023-12-07T16:21:30.383 INFO:tasks.workunit.client.1.smithi152.stdout:1/116: creat dc/d14/f1f x:0 0 0 2023-12-07T16:21:30.383 INFO:tasks.workunit.client.1.smithi152.stdout:1/117: write f4 [5074953,28165] 0 2023-12-07T16:21:30.384 INFO:tasks.workunit.client.1.smithi152.stdout:8/88: mkdir d3/d4/d9/dc/d1f 0 2023-12-07T16:21:30.384 INFO:tasks.workunit.client.1.smithi152.stdout:8/89: chown d3/d4 31676 1 2023-12-07T16:21:30.385 INFO:tasks.workunit.client.1.smithi152.stdout:3/138: chown d7/c9 306791441 1 2023-12-07T16:21:30.386 INFO:tasks.workunit.client.1.smithi152.stdout:5/86: unlink c5 0 2023-12-07T16:21:30.387 INFO:tasks.workunit.client.1.smithi152.stdout:6/100: rename d2/d6/d9/f12 to d2/d6/d19/d1f/f20 0 2023-12-07T16:21:30.387 INFO:tasks.workunit.client.1.smithi152.stdout:6/101: write d2/f4 [1345909,82460] 0 2023-12-07T16:21:30.389 INFO:tasks.workunit.client.1.smithi152.stdout:8/90: creat d3/d4/d9/dc/f20 x:0 0 0 2023-12-07T16:21:30.391 INFO:tasks.workunit.client.1.smithi152.stdout:3/139: unlink d7/dc/d14/f17 0 2023-12-07T16:21:30.392 INFO:tasks.workunit.client.1.smithi152.stdout:5/87: link dd/cf dd/de/d14/c16 0 2023-12-07T16:21:30.393 INFO:tasks.workunit.client.1.smithi152.stdout:6/102: unlink d2/f7 0 2023-12-07T16:21:30.393 INFO:tasks.workunit.client.1.smithi152.stdout:6/103: readlink d2/d6/l10 0 2023-12-07T16:21:30.395 INFO:tasks.workunit.client.1.smithi152.stdout:8/91: creat d3/d4/d9/f21 x:0 0 0 2023-12-07T16:21:30.395 INFO:tasks.workunit.client.1.smithi152.stdout:4/92: sync 2023-12-07T16:21:30.395 INFO:tasks.workunit.client.1.smithi152.stdout:9/116: sync 2023-12-07T16:21:30.395 INFO:tasks.workunit.client.1.smithi152.stdout:9/117: dread - d1/d9/db/df/f27 zero size 2023-12-07T16:21:30.396 INFO:tasks.workunit.client.1.smithi152.stdout:6/104: symlink d2/d6/l21 0 2023-12-07T16:21:30.396 INFO:tasks.workunit.client.1.smithi152.stdout:6/105: write d2/f5 [5822620,109415] 0 2023-12-07T16:21:30.397 INFO:tasks.workunit.client.1.smithi152.stdout:4/93: mkdir d0/d3/d6/dc/dd/d18 0 2023-12-07T16:21:30.397 INFO:tasks.workunit.client.1.smithi152.stdout:2/73: sync 2023-12-07T16:21:30.397 INFO:tasks.workunit.client.1.smithi152.stdout:1/118: dread dc/fd [0,4194304] 0 2023-12-07T16:21:30.398 INFO:tasks.workunit.client.1.smithi152.stdout:9/118: mkdir d1/d17/d28 0 2023-12-07T16:21:30.399 INFO:tasks.workunit.client.1.smithi152.stdout:6/106: creat d2/d6/d19/f22 x:0 0 0 2023-12-07T16:21:30.404 INFO:tasks.workunit.client.1.smithi152.stdout:2/74: mknod d2/d1c/c1d 0 2023-12-07T16:21:30.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:29 smithi063 ceph-mon[112095]: pgmap v22: 65 pgs: 65 active+clean; 311 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 5.5 MiB/s rd, 17 MiB/s wr, 970 op/s 2023-12-07T16:21:30.406 INFO:tasks.workunit.client.1.smithi152.stdout:9/119: mkdir d1/d17/d28/d29 0 2023-12-07T16:21:30.407 INFO:tasks.workunit.client.1.smithi152.stdout:6/107: unlink d2/d6/de/f11 0 2023-12-07T16:21:30.407 INFO:tasks.workunit.client.1.smithi152.stdout:6/108: truncate d2/d6/d19/f22 634850 0 2023-12-07T16:21:30.407 INFO:tasks.workunit.client.1.smithi152.stdout:5/88: dread f9 [0,4194304] 0 2023-12-07T16:21:30.407 INFO:tasks.workunit.client.1.smithi152.stdout:5/89: fsync fc 0 2023-12-07T16:21:30.410 INFO:tasks.workunit.client.1.smithi152.stdout:4/94: dread d0/f1 [0,4194304] 0 2023-12-07T16:21:30.411 INFO:tasks.workunit.client.1.smithi152.stdout:4/95: chown d0/d3/d6/ff 148993597 1 2023-12-07T16:21:30.411 INFO:tasks.workunit.client.1.smithi152.stdout:4/96: chown d0/d3/d6/dc/dd/f11 64830933 1 2023-12-07T16:21:30.415 INFO:tasks.workunit.client.1.smithi152.stdout:9/120: symlink d1/dd/l2a 0 2023-12-07T16:21:30.416 INFO:tasks.workunit.client.1.smithi152.stdout:9/121: write d1/f1c [1059592,66175] 0 2023-12-07T16:21:30.416 INFO:tasks.workunit.client.1.smithi152.stdout:6/109: mknod d2/d6/d19/d1f/c23 0 2023-12-07T16:21:30.417 INFO:tasks.workunit.client.1.smithi152.stdout:6/110: dread d2/d6/fc [0,4194304] 0 2023-12-07T16:21:30.418 INFO:tasks.workunit.client.1.smithi152.stdout:4/97: unlink d0/d3/d6/dc/dd/fe 0 2023-12-07T16:21:30.421 INFO:tasks.workunit.client.1.smithi152.stdout:9/122: unlink d1/d9/db/df/l18 0 2023-12-07T16:21:30.422 INFO:tasks.workunit.client.1.smithi152.stdout:4/98: creat d0/f19 x:0 0 0 2023-12-07T16:21:30.424 INFO:tasks.workunit.client.1.smithi152.stdout:9/123: read d1/d9/f23 [21695,13406] 0 2023-12-07T16:21:30.424 INFO:tasks.workunit.client.1.smithi152.stdout:9/124: write d1/d9/f25 [4831946,11927] 0 2023-12-07T16:21:30.425 INFO:tasks.workunit.client.1.smithi152.stdout:9/125: creat d1/d9/f2b x:0 0 0 2023-12-07T16:21:30.425 INFO:tasks.workunit.client.1.smithi152.stdout:9/126: write d1/f1c [1192666,52494] 0 2023-12-07T16:21:30.425 INFO:tasks.workunit.client.1.smithi152.stdout:9/127: write d1/d9/db/df/f27 [429924,33736] 0 2023-12-07T16:21:30.427 INFO:tasks.workunit.client.1.smithi152.stdout:9/128: rename d1/d17/f1e to d1/d9/db/f2c 0 2023-12-07T16:21:30.430 INFO:tasks.workunit.client.1.smithi152.stdout:8/92: dwrite d3/f1a [0,4194304] 0 2023-12-07T16:21:30.430 INFO:tasks.workunit.client.1.smithi152.stdout:8/93: read d3/d4/d9/f13 [1050670,113402] 0 2023-12-07T16:21:30.430 INFO:tasks.workunit.client.1.smithi152.stdout:8/94: fsync d3/d4/d9/fb 0 2023-12-07T16:21:30.435 INFO:tasks.workunit.client.1.smithi152.stdout:8/95: write d3/d4/d9/fb [3802055,35083] 0 2023-12-07T16:21:30.435 INFO:tasks.workunit.client.1.smithi152.stdout:3/140: dwrite d7/dc/d14/f15 [4194304,4194304] 0 2023-12-07T16:21:30.437 INFO:tasks.workunit.client.1.smithi152.stdout:8/96: mknod d3/d4/c22 0 2023-12-07T16:21:30.438 INFO:tasks.workunit.client.1.smithi152.stdout:8/97: mkdir d3/d4/d9/d23 0 2023-12-07T16:21:30.439 INFO:tasks.workunit.client.1.smithi152.stdout:8/98: getdents d3 0 2023-12-07T16:21:30.439 INFO:tasks.workunit.client.1.smithi152.stdout:8/99: chown d3/d4/ca 7732 1 2023-12-07T16:21:30.441 INFO:tasks.workunit.client.1.smithi152.stdout:2/75: dwrite d2/d9/f11 [0,4194304] 0 2023-12-07T16:21:30.442 INFO:tasks.workunit.client.1.smithi152.stdout:1/119: dwrite dc/f13 [0,4194304] 0 2023-12-07T16:21:30.442 INFO:tasks.workunit.client.1.smithi152.stdout:1/120: readlink dc/de/l1b 0 2023-12-07T16:21:30.443 INFO:tasks.workunit.client.1.smithi152.stdout:5/90: dwrite dd/de/f13 [0,4194304] 0 2023-12-07T16:21:30.443 INFO:tasks.workunit.client.1.smithi152.stdout:4/99: dwrite d0/f1 [0,4194304] 0 2023-12-07T16:21:30.443 INFO:tasks.workunit.client.1.smithi152.stdout:4/100: fdatasync d0/f5 0 2023-12-07T16:21:30.443 INFO:tasks.workunit.client.1.smithi152.stdout:4/101: write d0/d3/d6/dc/f10 [119757,7609] 0 2023-12-07T16:21:30.443 INFO:tasks.workunit.client.1.smithi152.stdout:8/100: read d3/f1d [3456217,98691] 0 2023-12-07T16:21:30.449 INFO:tasks.workunit.client.1.smithi152.stdout:9/129: dread d1/f1c [0,4194304] 0 2023-12-07T16:21:30.451 INFO:tasks.workunit.client.1.smithi152.stdout:9/130: write d1/d9/f25 [3850908,85698] 0 2023-12-07T16:21:30.452 INFO:tasks.workunit.client.1.smithi152.stdout:6/111: dread d2/f5 [0,4194304] 0 2023-12-07T16:21:30.453 INFO:tasks.workunit.client.1.smithi152.stdout:3/141: dwrite d7/f8 [4194304,4194304] 0 2023-12-07T16:21:30.455 INFO:tasks.workunit.client.1.smithi152.stdout:4/102: dread d0/d3/d6/dc/f10 [0,4194304] 0 2023-12-07T16:21:30.457 INFO:tasks.workunit.client.1.smithi152.stdout:2/76: mknod d2/d9/c1e 0 2023-12-07T16:21:30.457 INFO:tasks.workunit.client.1.smithi152.stdout:2/77: dread - d2/d9/f1b zero size 2023-12-07T16:21:30.459 INFO:tasks.workunit.client.1.smithi152.stdout:1/121: rmdir dc/de 39 2023-12-07T16:21:30.462 INFO:tasks.workunit.client.1.smithi152.stdout:5/91: getdents dd 0 2023-12-07T16:21:30.466 INFO:tasks.workunit.client.1.smithi152.stdout:8/101: truncate d3/f1d 1476610 0 2023-12-07T16:21:30.476 INFO:tasks.workunit.client.1.smithi152.stdout:1/122: dread dc/f13 [0,4194304] 0 2023-12-07T16:21:30.476 INFO:tasks.workunit.client.1.smithi152.stdout:1/123: read dc/f13 [3279684,29716] 0 2023-12-07T16:21:30.484 INFO:tasks.workunit.client.1.smithi152.stdout:8/102: dread d3/d4/d9/f13 [0,4194304] 0 2023-12-07T16:21:30.484 INFO:tasks.workunit.client.1.smithi152.stdout:9/131: rename d1/d17/d28 to d1/d9/d2d 0 2023-12-07T16:21:30.485 INFO:tasks.workunit.client.1.smithi152.stdout:9/132: fdatasync d1/d9/db/df/f27 0 2023-12-07T16:21:30.485 INFO:tasks.workunit.client.1.smithi152.stdout:3/142: dread d7/dc/f12 [0,4194304] 0 2023-12-07T16:21:30.486 INFO:tasks.workunit.client.1.smithi152.stdout:8/103: creat d3/f24 x:0 0 0 2023-12-07T16:21:30.486 INFO:tasks.workunit.client.1.smithi152.stdout:8/104: fdatasync d3/f1d 0 2023-12-07T16:21:30.487 INFO:tasks.workunit.client.1.smithi152.stdout:9/133: link d1/d9/db/c11 d1/dd/d24/c2e 0 2023-12-07T16:21:30.487 INFO:tasks.workunit.client.1.smithi152.stdout:9/134: fsync d1/d9/f12 0 2023-12-07T16:21:30.488 INFO:tasks.workunit.client.1.smithi152.stdout:8/105: creat d3/d4/d9/d23/f25 x:0 0 0 2023-12-07T16:21:30.489 INFO:tasks.workunit.client.1.smithi152.stdout:9/135: symlink d1/d9/d2d/d29/l2f 0 2023-12-07T16:21:30.489 INFO:tasks.workunit.client.1.smithi152.stdout:9/136: stat d1/d9/db/df/f27 0 2023-12-07T16:21:30.490 INFO:tasks.workunit.client.1.smithi152.stdout:4/103: dwrite d0/d3/d6/dc/f10 [0,4194304] 0 2023-12-07T16:21:30.490 INFO:tasks.workunit.client.1.smithi152.stdout:2/78: dwrite d2/ff [0,4194304] 0 2023-12-07T16:21:30.491 INFO:tasks.workunit.client.1.smithi152.stdout:5/92: dwrite f8 [0,4194304] 0 2023-12-07T16:21:30.492 INFO:tasks.workunit.client.1.smithi152.stdout:8/106: unlink d3/d4/d9/f13 0 2023-12-07T16:21:30.492 INFO:tasks.workunit.client.1.smithi152.stdout:8/107: fsync d3/d4/d9/f1c 0 2023-12-07T16:21:30.492 INFO:tasks.workunit.client.1.smithi152.stdout:8/108: fsync d3/d4/d9/fb 0 2023-12-07T16:21:30.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:29 smithi152 ceph-mon[121113]: pgmap v22: 65 pgs: 65 active+clean; 311 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 5.5 MiB/s rd, 17 MiB/s wr, 970 op/s 2023-12-07T16:21:30.495 INFO:tasks.workunit.client.1.smithi152.stdout:4/104: rename d0/d3/d6/dc/dd/f11 to d0/d3/f1a 0 2023-12-07T16:21:30.495 INFO:tasks.workunit.client.1.smithi152.stdout:2/79: getdents d2/d1c 0 2023-12-07T16:21:30.496 INFO:tasks.workunit.client.1.smithi152.stdout:5/93: mkdir dd/de/d17 0 2023-12-07T16:21:30.497 INFO:tasks.workunit.client.1.smithi152.stdout:3/143: dread d7/f8 [4194304,4194304] 0 2023-12-07T16:21:30.498 INFO:tasks.workunit.client.1.smithi152.stdout:1/124: dwrite f9 [0,4194304] 0 2023-12-07T16:21:30.498 INFO:tasks.workunit.client.1.smithi152.stdout:8/109: unlink d3/d4/c19 0 2023-12-07T16:21:30.502 INFO:tasks.workunit.client.1.smithi152.stdout:3/144: rmdir d7/dc/d14 39 2023-12-07T16:21:30.505 INFO:tasks.workunit.client.1.smithi152.stdout:1/125: symlink dc/d14/d18/l20 0 2023-12-07T16:21:30.507 INFO:tasks.workunit.client.1.smithi152.stdout:7/81: sync 2023-12-07T16:21:30.507 INFO:tasks.workunit.client.1.smithi152.stdout:7/82: chown db/dd 21 1 2023-12-07T16:21:30.508 INFO:tasks.workunit.client.1.smithi152.stdout:1/126: mknod dc/d14/d18/c21 0 2023-12-07T16:21:30.508 INFO:tasks.workunit.client.1.smithi152.stdout:1/127: stat dc/l19 0 2023-12-07T16:21:30.510 INFO:tasks.workunit.client.1.smithi152.stdout:7/83: read db/f13 [722620,79818] 0 2023-12-07T16:21:30.511 INFO:tasks.workunit.client.1.smithi152.stdout:5/94: dread dd/de/f13 [0,4194304] 0 2023-12-07T16:21:30.513 INFO:tasks.workunit.client.1.smithi152.stdout:3/145: dread d7/d11/f22 [0,4194304] 0 2023-12-07T16:21:30.513 INFO:tasks.workunit.client.1.smithi152.stdout:3/146: chown d7/d10/d19/f23 117623 1 2023-12-07T16:21:30.515 INFO:tasks.workunit.client.1.smithi152.stdout:7/84: symlink db/l19 0 2023-12-07T16:21:30.515 INFO:tasks.workunit.client.1.smithi152.stdout:9/137: dwrite d1/d9/f25 [0,4194304] 0 2023-12-07T16:21:30.515 INFO:tasks.workunit.client.1.smithi152.stdout:9/138: readlink d1/d9/d2d/d29/l2f 0 2023-12-07T16:21:30.515 INFO:tasks.workunit.client.1.smithi152.stdout:9/139: write d1/f1c [32432,99929] 0 2023-12-07T16:21:30.517 INFO:tasks.workunit.client.1.smithi152.stdout:3/147: mkdir d7/d10/d1a/d25 0 2023-12-07T16:21:30.517 INFO:tasks.workunit.client.1.smithi152.stdout:3/148: readlink d7/d10/l24 0 2023-12-07T16:21:30.524 INFO:tasks.workunit.client.1.smithi152.stdout:0/104: sync 2023-12-07T16:21:30.525 INFO:tasks.workunit.client.1.smithi152.stdout:7/85: getdents db/dd 0 2023-12-07T16:21:30.525 INFO:tasks.workunit.client.1.smithi152.stdout:7/86: write db/f18 [515251,27052] 0 2023-12-07T16:21:30.525 INFO:tasks.workunit.client.1.smithi152.stdout:5/95: dread f8 [0,4194304] 0 2023-12-07T16:21:30.528 INFO:tasks.workunit.client.1.smithi152.stdout:9/140: symlink d1/dd/l30 0 2023-12-07T16:21:30.531 INFO:tasks.workunit.client.1.smithi152.stdout:3/149: read d7/d11/f18 [861386,93896] 0 2023-12-07T16:21:30.531 INFO:tasks.workunit.client.1.smithi152.stdout:4/105: getdents d0/d3 0 2023-12-07T16:21:30.532 INFO:tasks.workunit.client.1.smithi152.stdout:8/110: dwrite d3/d4/d9/f1c [0,4194304] 0 2023-12-07T16:21:30.532 INFO:tasks.workunit.client.1.smithi152.stdout:8/111: chown d3/d4/d9/fb 176285 1 2023-12-07T16:21:30.534 INFO:tasks.workunit.client.1.smithi152.stdout:0/105: mknod d0/dc/c1c 0 2023-12-07T16:21:30.537 INFO:tasks.workunit.client.1.smithi152.stdout:2/80: dwrite d2/d9/f13 [0,4194304] 0 2023-12-07T16:21:30.540 INFO:tasks.workunit.client.1.smithi152.stdout:9/141: dread d1/d9/f23 [0,4194304] 0 2023-12-07T16:21:30.540 INFO:tasks.workunit.client.1.smithi152.stdout:9/142: read - d1/d9/f26 zero size 2023-12-07T16:21:30.540 INFO:tasks.workunit.client.1.smithi152.stdout:0/106: dread d0/f18 [0,4194304] 0 2023-12-07T16:21:30.541 INFO:tasks.workunit.client.1.smithi152.stdout:7/87: mknod db/dd/c1a 0 2023-12-07T16:21:30.541 INFO:tasks.workunit.client.1.smithi152.stdout:3/150: creat d7/d11/f26 x:0 0 0 2023-12-07T16:21:30.541 INFO:tasks.workunit.client.1.smithi152.stdout:4/106: link d0/d3/d6/c9 d0/d3/d6/c1b 0 2023-12-07T16:21:30.541 INFO:tasks.workunit.client.1.smithi152.stdout:1/128: dwrite f6 [0,4194304] 0 2023-12-07T16:21:30.542 INFO:tasks.workunit.client.1.smithi152.stdout:8/112: mknod d3/d4/d9/dc/d1f/c26 0 2023-12-07T16:21:30.543 INFO:tasks.workunit.client.1.smithi152.stdout:9/143: link d1/d9/f25 d1/f31 0 2023-12-07T16:21:30.544 INFO:tasks.workunit.client.1.smithi152.stdout:0/107: symlink d0/l1d 0 2023-12-07T16:21:30.545 INFO:tasks.workunit.client.1.smithi152.stdout:3/151: dread d7/d11/f22 [0,4194304] 0 2023-12-07T16:21:30.546 INFO:tasks.workunit.client.1.smithi152.stdout:4/107: rmdir d0/d3/d6/dc/dd/d18 0 2023-12-07T16:21:30.546 INFO:tasks.workunit.client.1.smithi152.stdout:4/108: fdatasync d0/f19 0 2023-12-07T16:21:30.548 INFO:tasks.workunit.client.1.smithi152.stdout:0/108: write d0/f9 [3264534,6112] 0 2023-12-07T16:21:30.549 INFO:tasks.workunit.client.1.smithi152.stdout:0/109: chown d0/f1a 284885380 1 2023-12-07T16:21:30.549 INFO:tasks.workunit.client.1.smithi152.stdout:5/96: dwrite f8 [0,4194304] 0 2023-12-07T16:21:30.549 INFO:tasks.workunit.client.1.smithi152.stdout:8/113: symlink d3/d4/d9/dc/l27 0 2023-12-07T16:21:30.551 INFO:tasks.workunit.client.1.smithi152.stdout:9/144: rename d1/d9/db/c11 to d1/d9/d2d/c32 0 2023-12-07T16:21:30.552 INFO:tasks.workunit.client.1.smithi152.stdout:3/152: truncate d7/f8 2461378 0 2023-12-07T16:21:30.553 INFO:tasks.workunit.client.1.smithi152.stdout:7/88: dread db/dd/f10 [0,4194304] 0 2023-12-07T16:21:30.555 INFO:tasks.workunit.client.1.smithi152.stdout:9/145: creat d1/d9/db/f33 x:0 0 0 2023-12-07T16:21:30.555 INFO:tasks.workunit.client.1.smithi152.stdout:9/146: chown d1/d9/d2d/d29 27 1 2023-12-07T16:21:30.555 INFO:tasks.workunit.client.1.smithi152.stdout:8/114: creat d3/d4/d9/dc/d1f/f28 x:0 0 0 2023-12-07T16:21:30.556 INFO:tasks.workunit.client.1.smithi152.stdout:3/153: creat d7/d10/d1a/d25/f27 x:0 0 0 2023-12-07T16:21:30.557 INFO:tasks.workunit.client.1.smithi152.stdout:5/97: write fc [3539232,105943] 0 2023-12-07T16:21:30.558 INFO:tasks.workunit.client.1.smithi152.stdout:7/89: mknod db/dd/c1b 0 2023-12-07T16:21:30.560 INFO:tasks.workunit.client.1.smithi152.stdout:9/147: link d1/dd/d24/c2e d1/c34 0 2023-12-07T16:21:30.563 INFO:tasks.workunit.client.1.smithi152.stdout:8/115: rename d3/d4/d9/dc/l1b to d3/d4/d9/dc/d1f/l29 0 2023-12-07T16:21:30.565 INFO:tasks.workunit.client.1.smithi152.stdout:3/154: creat d7/d10/d1a/f28 x:0 0 0 2023-12-07T16:21:30.565 INFO:tasks.workunit.client.1.smithi152.stdout:3/155: write d7/d11/f26 [905011,14693] 0 2023-12-07T16:21:30.565 INFO:tasks.workunit.client.1.smithi152.stdout:3/156: truncate d7/d10/d19/f23 503746 0 2023-12-07T16:21:30.565 INFO:tasks.workunit.client.1.smithi152.stdout:3/157: fdatasync d7/dc/d14/f15 0 2023-12-07T16:21:30.566 INFO:tasks.workunit.client.1.smithi152.stdout:0/110: dread d0/dc/dd/ff [0,4194304] 0 2023-12-07T16:21:30.569 INFO:tasks.workunit.client.1.smithi152.stdout:8/116: symlink d3/d4/l2a 0 2023-12-07T16:21:30.570 INFO:tasks.workunit.client.1.smithi152.stdout:8/117: write d3/d4/d9/f18 [714396,31761] 0 2023-12-07T16:21:30.571 INFO:tasks.workunit.client.1.smithi152.stdout:0/111: symlink d0/l1e 0 2023-12-07T16:21:30.572 INFO:tasks.workunit.client.1.smithi152.stdout:9/148: link d1/d9/db/f33 d1/d9/f35 0 2023-12-07T16:21:30.572 INFO:tasks.workunit.client.1.smithi152.stdout:9/149: fdatasync d1/d9/db/f2c 0 2023-12-07T16:21:30.572 INFO:tasks.workunit.client.1.smithi152.stdout:9/150: fdatasync d1/d9/f12 0 2023-12-07T16:21:30.574 INFO:tasks.workunit.client.1.smithi152.stdout:0/112: creat d0/dc/dd/f1f x:0 0 0 2023-12-07T16:21:30.576 INFO:tasks.workunit.client.1.smithi152.stdout:9/151: creat d1/d9/db/f36 x:0 0 0 2023-12-07T16:21:30.576 INFO:tasks.workunit.client.1.smithi152.stdout:9/152: fdatasync d1/f31 0 2023-12-07T16:21:30.577 INFO:tasks.workunit.client.1.smithi152.stdout:9/153: symlink d1/d9/d2d/d29/l37 0 2023-12-07T16:21:30.578 INFO:tasks.workunit.client.1.smithi152.stdout:4/109: dwrite d0/d3/d6/ff [0,4194304] 0 2023-12-07T16:21:30.578 INFO:tasks.workunit.client.1.smithi152.stdout:4/110: fdatasync d0/f1 0 2023-12-07T16:21:30.583 INFO:tasks.workunit.client.1.smithi152.stdout:8/118: dread d3/d4/d9/fb [0,4194304] 0 2023-12-07T16:21:30.584 INFO:tasks.workunit.client.1.smithi152.stdout:4/111: unlink d0/f19 0 2023-12-07T16:21:30.584 INFO:tasks.workunit.client.1.smithi152.stdout:4/112: fsync d0/f1 0 2023-12-07T16:21:30.584 INFO:tasks.workunit.client.1.smithi152.stdout:2/81: dwrite f1 [0,4194304] 0 2023-12-07T16:21:30.584 INFO:tasks.workunit.client.1.smithi152.stdout:2/82: chown d2/d1c 46643 1 2023-12-07T16:21:30.585 INFO:tasks.workunit.client.1.smithi152.stdout:5/98: dwrite f9 [4194304,4194304] 0 2023-12-07T16:21:30.587 INFO:tasks.workunit.client.1.smithi152.stdout:4/113: rename d0/d3/d6/ff to d0/d17/f1c 0 2023-12-07T16:21:30.587 INFO:tasks.workunit.client.1.smithi152.stdout:4/114: chown d0/d3/d6/l13 126023 1 2023-12-07T16:21:30.587 INFO:tasks.workunit.client.1.smithi152.stdout:1/129: dwrite dc/fd [4194304,4194304] 0 2023-12-07T16:21:30.587 INFO:tasks.workunit.client.1.smithi152.stdout:8/119: read d3/f1d [1215512,57333] 0 2023-12-07T16:21:30.591 INFO:tasks.workunit.client.1.smithi152.stdout:4/115: dread d0/f5 [0,4194304] 0 2023-12-07T16:21:30.591 INFO:tasks.workunit.client.1.smithi152.stdout:4/116: stat d0/d17 0 2023-12-07T16:21:30.594 INFO:tasks.workunit.client.1.smithi152.stdout:1/130: link dc/f13 dc/de/f22 0 2023-12-07T16:21:30.595 INFO:tasks.workunit.client.1.smithi152.stdout:1/131: write dc/fd [2070783,73921] 0 2023-12-07T16:21:30.595 INFO:tasks.workunit.client.1.smithi152.stdout:1/132: truncate f4 5621160 0 2023-12-07T16:21:30.598 INFO:tasks.workunit.client.1.smithi152.stdout:7/90: rename db/dd to db/d1c 0 2023-12-07T16:21:30.598 INFO:tasks.workunit.client.1.smithi152.stdout:7/91: fdatasync db/d1c/f16 0 2023-12-07T16:21:30.598 INFO:tasks.workunit.client.1.smithi152.stdout:7/92: write db/d1c/f10 [913632,84529] 0 2023-12-07T16:21:30.598 INFO:tasks.workunit.client.1.smithi152.stdout:7/93: read db/f18 [197327,71089] 0 2023-12-07T16:21:30.601 INFO:tasks.workunit.client.1.smithi152.stdout:8/120: rmdir d3/d4/d9 39 2023-12-07T16:21:30.601 INFO:tasks.workunit.client.1.smithi152.stdout:8/121: read - d3/d4/d9/f21 zero size 2023-12-07T16:21:30.601 INFO:tasks.workunit.client.1.smithi152.stdout:3/158: dread d7/f8 [0,4194304] 0 2023-12-07T16:21:30.601 INFO:tasks.workunit.client.1.smithi152.stdout:9/154: dwrite d1/d9/f20 [0,4194304] 0 2023-12-07T16:21:30.601 INFO:tasks.workunit.client.1.smithi152.stdout:1/133: write f9 [2104004,36699] 0 2023-12-07T16:21:30.605 INFO:tasks.workunit.client.1.smithi152.stdout:1/134: dread dc/de/f22 [0,4194304] 0 2023-12-07T16:21:30.608 INFO:tasks.workunit.client.1.smithi152.stdout:4/117: creat d0/d3/d6/f1d x:0 0 0 2023-12-07T16:21:30.608 INFO:tasks.workunit.client.1.smithi152.stdout:4/118: rename d0/d3 to d0/d3/d6/dc/d1e 22 2023-12-07T16:21:30.610 INFO:tasks.workunit.client.1.smithi152.stdout:8/122: creat d3/d4/d9/f2b x:0 0 0 2023-12-07T16:21:30.611 INFO:tasks.workunit.client.1.smithi152.stdout:3/159: symlink d7/d10/d1a/d25/l29 0 2023-12-07T16:21:30.612 INFO:tasks.workunit.client.1.smithi152.stdout:7/94: dread db/fe [0,4194304] 0 2023-12-07T16:21:30.613 INFO:tasks.workunit.client.1.smithi152.stdout:9/155: getdents d1/dd 0 2023-12-07T16:21:30.614 INFO:tasks.workunit.client.1.smithi152.stdout:1/135: link f8 dc/f23 0 2023-12-07T16:21:30.615 INFO:tasks.workunit.client.1.smithi152.stdout:2/83: dwrite d2/d9/f1b [0,4194304] 0 2023-12-07T16:21:30.615 INFO:tasks.workunit.client.1.smithi152.stdout:5/99: dwrite f8 [0,4194304] 0 2023-12-07T16:21:30.615 INFO:tasks.workunit.client.1.smithi152.stdout:8/123: link d3/d4/d9/f2b d3/d4/d9/d23/f2c 0 2023-12-07T16:21:30.617 INFO:tasks.workunit.client.1.smithi152.stdout:1/136: fdatasync f8 0 2023-12-07T16:21:30.619 INFO:tasks.workunit.client.1.smithi152.stdout:7/95: mknod db/d1c/c1d 0 2023-12-07T16:21:30.619 INFO:tasks.workunit.client.1.smithi152.stdout:9/156: mkdir d1/d17/d38 0 2023-12-07T16:21:30.619 INFO:tasks.workunit.client.1.smithi152.stdout:8/124: dread d3/d4/d9/fb [0,4194304] 0 2023-12-07T16:21:30.619 INFO:tasks.workunit.client.1.smithi152.stdout:8/125: dread - d3/d4/d9/d23/f25 zero size 2023-12-07T16:21:30.621 INFO:tasks.workunit.client.1.smithi152.stdout:4/119: dread d0/d3/f7 [0,4194304] 0 2023-12-07T16:21:30.621 INFO:tasks.workunit.client.1.smithi152.stdout:7/96: write db/fe [525870,63712] 0 2023-12-07T16:21:30.624 INFO:tasks.workunit.client.1.smithi152.stdout:4/120: read d0/d3/d6/dc/f10 [1314515,123943] 0 2023-12-07T16:21:30.626 INFO:tasks.workunit.client.1.smithi152.stdout:2/84: truncate d2/d9/f11 1673855 0 2023-12-07T16:21:30.628 INFO:tasks.workunit.client.1.smithi152.stdout:5/100: mknod dd/d11/c18 0 2023-12-07T16:21:30.630 INFO:tasks.workunit.client.1.smithi152.stdout:9/157: getdents d1/d9/db/df 0 2023-12-07T16:21:30.633 INFO:tasks.workunit.client.1.smithi152.stdout:4/121: dread d0/d3/f7 [0,4194304] 0 2023-12-07T16:21:30.634 INFO:tasks.workunit.client.1.smithi152.stdout:8/126: creat d3/d4/d9/dc/f2d x:0 0 0 2023-12-07T16:21:30.634 INFO:tasks.workunit.client.1.smithi152.stdout:7/97: mkdir db/d1e 0 2023-12-07T16:21:30.634 INFO:tasks.workunit.client.1.smithi152.stdout:8/127: fsync d3/d4/d9/dc/f20 0 2023-12-07T16:21:30.634 INFO:tasks.workunit.client.1.smithi152.stdout:8/128: write d3/d4/d9/d23/f25 [874280,68340] 0 2023-12-07T16:21:30.634 INFO:tasks.workunit.client.1.smithi152.stdout:8/129: truncate d3/d4/d9/f21 773131 0 2023-12-07T16:21:30.634 INFO:tasks.workunit.client.1.smithi152.stdout:8/130: chown c0 167690 1 2023-12-07T16:21:30.636 INFO:tasks.workunit.client.1.smithi152.stdout:9/158: write d1/f31 [2110230,99729] 0 2023-12-07T16:21:30.636 INFO:tasks.workunit.client.1.smithi152.stdout:7/98: write f6 [7786692,46072] 0 2023-12-07T16:21:30.636 INFO:tasks.workunit.client.1.smithi152.stdout:2/85: dread d2/f8 [0,4194304] 0 2023-12-07T16:21:30.637 INFO:tasks.workunit.client.1.smithi152.stdout:5/101: mkdir dd/de/d14/d19 0 2023-12-07T16:21:30.641 INFO:tasks.workunit.client.1.smithi152.stdout:8/131: mknod d3/d4/c2e 0 2023-12-07T16:21:30.642 INFO:tasks.workunit.client.1.smithi152.stdout:7/99: symlink db/d1e/l1f 0 2023-12-07T16:21:30.643 INFO:tasks.workunit.client.1.smithi152.stdout:1/137: dwrite dc/d14/f1f [0,4194304] 0 2023-12-07T16:21:30.644 INFO:tasks.workunit.client.1.smithi152.stdout:2/86: symlink d2/l1f 0 2023-12-07T16:21:30.645 INFO:tasks.workunit.client.1.smithi152.stdout:2/87: truncate d2/d9/f13 4523927 0 2023-12-07T16:21:30.649 INFO:tasks.workunit.client.1.smithi152.stdout:6/112: sync 2023-12-07T16:21:30.649 INFO:tasks.workunit.client.1.smithi152.stdout:2/88: truncate d2/f8 3944001 0 2023-12-07T16:21:30.649 INFO:tasks.workunit.client.1.smithi152.stdout:2/89: fsync d2/ff 0 2023-12-07T16:21:30.649 INFO:tasks.workunit.client.1.smithi152.stdout:2/90: chown d2/d9/f1b 66252733 1 2023-12-07T16:21:30.656 INFO:tasks.workunit.client.1.smithi152.stdout:1/138: dread dc/fd [4194304,4194304] 0 2023-12-07T16:21:30.660 INFO:tasks.workunit.client.1.smithi152.stdout:1/139: rename dc/l19 to dc/d14/l24 0 2023-12-07T16:21:30.662 INFO:tasks.workunit.client.1.smithi152.stdout:1/140: truncate dc/de/f22 3002502 0 2023-12-07T16:21:30.662 INFO:tasks.workunit.client.1.smithi152.stdout:1/141: fsync f8 0 2023-12-07T16:21:30.665 INFO:tasks.workunit.client.1.smithi152.stdout:9/159: dwrite d1/f1c [0,4194304] 0 2023-12-07T16:21:30.667 INFO:tasks.workunit.client.1.smithi152.stdout:0/113: sync 2023-12-07T16:21:30.668 INFO:tasks.workunit.client.1.smithi152.stdout:5/102: getdents dd/d11 0 2023-12-07T16:21:30.668 INFO:tasks.workunit.client.1.smithi152.stdout:2/91: write d2/d9/f11 [2359460,3402] 0 2023-12-07T16:21:30.668 INFO:tasks.workunit.client.1.smithi152.stdout:2/92: chown d2/d9/c19 4 1 2023-12-07T16:21:30.668 INFO:tasks.workunit.client.1.smithi152.stdout:2/93: readlink d2/l15 0 2023-12-07T16:21:30.668 INFO:tasks.workunit.client.1.smithi152.stdout:2/94: stat d2/l15 0 2023-12-07T16:21:30.668 INFO:tasks.workunit.client.1.smithi152.stdout:2/95: chown d2/d9/f1b 40171 1 2023-12-07T16:21:30.668 INFO:tasks.workunit.client.1.smithi152.stdout:2/96: chown d2/l12 7346 1 2023-12-07T16:21:30.670 INFO:tasks.workunit.client.1.smithi152.stdout:9/160: mknod d1/d9/db/df/c39 0 2023-12-07T16:21:30.671 INFO:tasks.workunit.client.1.smithi152.stdout:5/103: write fc [3301142,117554] 0 2023-12-07T16:21:30.672 INFO:tasks.workunit.client.1.smithi152.stdout:0/114: getdents d0 0 2023-12-07T16:21:30.674 INFO:tasks.workunit.client.1.smithi152.stdout:7/100: truncate f6 5658472 0 2023-12-07T16:21:30.676 INFO:tasks.workunit.client.1.smithi152.stdout:2/97: mkdir d2/d1c/d20 0 2023-12-07T16:21:30.677 INFO:tasks.workunit.client.1.smithi152.stdout:8/132: dwrite d3/d4/d9/fb [0,4194304] 0 2023-12-07T16:21:30.677 INFO:tasks.workunit.client.1.smithi152.stdout:8/133: write d3/d4/d9/d23/f2c [917630,49674] 0 2023-12-07T16:21:30.678 INFO:tasks.workunit.client.1.smithi152.stdout:9/161: unlink d1/f1c 0 2023-12-07T16:21:30.679 INFO:tasks.workunit.client.1.smithi152.stdout:6/113: dwrite d2/f4 [0,4194304] 0 2023-12-07T16:21:30.679 INFO:tasks.workunit.client.1.smithi152.stdout:3/160: dwrite d7/dc/f12 [0,4194304] 0 2023-12-07T16:21:30.681 INFO:tasks.workunit.client.1.smithi152.stdout:0/115: mknod d0/dc/dd/c20 0 2023-12-07T16:21:30.682 INFO:tasks.workunit.client.1.smithi152.stdout:6/114: dread d2/d6/fc [0,4194304] 0 2023-12-07T16:21:30.683 INFO:tasks.workunit.client.1.smithi152.stdout:2/98: link d2/l15 d2/l21 0 2023-12-07T16:21:30.689 INFO:tasks.workunit.client.1.smithi152.stdout:0/116: read d0/dc/dd/ff [829688,65292] 0 2023-12-07T16:21:30.690 INFO:tasks.workunit.client.1.smithi152.stdout:6/115: creat d2/f24 x:0 0 0 2023-12-07T16:21:30.691 INFO:tasks.workunit.client.1.smithi152.stdout:1/142: read dc/de/f22 [304974,66084] 0 2023-12-07T16:21:30.692 INFO:tasks.workunit.client.1.smithi152.stdout:2/99: dread d2/d9/f1b [0,4194304] 0 2023-12-07T16:21:30.692 INFO:tasks.workunit.client.1.smithi152.stdout:0/117: write d0/dc/dd/ff [1211295,127624] 0 2023-12-07T16:21:30.692 INFO:tasks.workunit.client.1.smithi152.stdout:3/161: link d7/dc/f1b d7/dc/f2a 0 2023-12-07T16:21:30.692 INFO:tasks.workunit.client.1.smithi152.stdout:6/116: creat d2/d6/f25 x:0 0 0 2023-12-07T16:21:30.693 INFO:tasks.workunit.client.1.smithi152.stdout:6/117: fsync d2/f5 0 2023-12-07T16:21:30.693 INFO:tasks.workunit.client.1.smithi152.stdout:2/100: read d2/d9/f1b [3946714,68380] 0 2023-12-07T16:21:30.693 INFO:tasks.workunit.client.1.smithi152.stdout:1/143: write f9 [5339450,27158] 0 2023-12-07T16:21:30.693 INFO:tasks.workunit.client.1.smithi152.stdout:2/101: write d2/d9/f1b [2809953,58971] 0 2023-12-07T16:21:30.694 INFO:tasks.workunit.client.1.smithi152.stdout:7/101: fsync f6 0 2023-12-07T16:21:30.696 INFO:tasks.workunit.client.1.smithi152.stdout:0/118: creat d0/dc/f21 x:0 0 0 2023-12-07T16:21:30.697 INFO:tasks.workunit.client.1.smithi152.stdout:1/144: symlink dc/de/l25 0 2023-12-07T16:21:30.701 INFO:tasks.workunit.client.1.smithi152.stdout:2/102: rename d2/l7 to d2/d9/l22 0 2023-12-07T16:21:30.702 INFO:tasks.workunit.client.1.smithi152.stdout:0/119: truncate d0/f9 595187 0 2023-12-07T16:21:30.703 INFO:tasks.workunit.client.1.smithi152.stdout:6/118: symlink d2/d6/d19/l26 0 2023-12-07T16:21:30.703 INFO:tasks.workunit.client.1.smithi152.stdout:6/119: chown d2/d6/d9 11724514 1 2023-12-07T16:21:30.704 INFO:tasks.workunit.client.1.smithi152.stdout:0/120: dread d0/f18 [0,4194304] 0 2023-12-07T16:21:30.705 INFO:tasks.workunit.client.1.smithi152.stdout:6/120: mknod d2/c27 0 2023-12-07T16:21:30.705 INFO:tasks.workunit.client.1.smithi152.stdout:6/121: truncate d2/d6/f1a 970915 0 2023-12-07T16:21:30.706 INFO:tasks.workunit.client.1.smithi152.stdout:0/121: creat d0/dc/f22 x:0 0 0 2023-12-07T16:21:30.706 INFO:tasks.workunit.client.1.smithi152.stdout:6/122: dread d2/d6/fc [0,4194304] 0 2023-12-07T16:21:30.706 INFO:tasks.workunit.client.1.smithi152.stdout:6/123: readlink d2/d6/l21 0 2023-12-07T16:21:30.707 INFO:tasks.workunit.client.1.smithi152.stdout:6/124: creat d2/d6/d9/f28 x:0 0 0 2023-12-07T16:21:30.707 INFO:tasks.workunit.client.1.smithi152.stdout:6/125: dread - d2/d6/d9/f28 zero size 2023-12-07T16:21:30.713 INFO:tasks.workunit.client.1.smithi152.stdout:1/145: dread f8 [0,4194304] 0 2023-12-07T16:21:30.714 INFO:tasks.workunit.client.1.smithi152.stdout:1/146: link f4 dc/f26 0 2023-12-07T16:21:30.715 INFO:tasks.workunit.client.1.smithi152.stdout:1/147: link dc/f26 dc/de/f27 0 2023-12-07T16:21:30.715 INFO:tasks.workunit.client.1.smithi152.stdout:1/148: chown lb 15037941 1 2023-12-07T16:21:30.716 INFO:tasks.workunit.client.1.smithi152.stdout:1/149: mkdir dc/d28 0 2023-12-07T16:21:30.717 INFO:tasks.workunit.client.1.smithi152.stdout:1/150: mknod dc/d14/c29 0 2023-12-07T16:21:30.717 INFO:tasks.workunit.client.1.smithi152.stdout:1/151: chown dc/d14/d18/l1d 68 1 2023-12-07T16:21:30.718 INFO:tasks.workunit.client.1.smithi152.stdout:1/152: write dc/fd [2232469,45219] 0 2023-12-07T16:21:30.719 INFO:tasks.workunit.client.1.smithi152.stdout:1/153: creat dc/f2a x:0 0 0 2023-12-07T16:21:30.720 INFO:tasks.workunit.client.1.smithi152.stdout:4/122: sync 2023-12-07T16:21:30.721 INFO:tasks.workunit.client.1.smithi152.stdout:6/126: dread d2/f5 [0,4194304] 0 2023-12-07T16:21:30.721 INFO:tasks.workunit.client.1.smithi152.stdout:9/162: dwrite d1/d9/f26 [0,4194304] 0 2023-12-07T16:21:30.721 INFO:tasks.workunit.client.1.smithi152.stdout:3/162: dwrite d7/d11/f20 [0,4194304] 0 2023-12-07T16:21:30.722 INFO:tasks.workunit.client.1.smithi152.stdout:7/102: dwrite db/d1c/f10 [0,4194304] 0 2023-12-07T16:21:30.722 INFO:tasks.workunit.client.1.smithi152.stdout:7/103: chown db/d1e 75123 1 2023-12-07T16:21:30.723 INFO:tasks.workunit.client.1.smithi152.stdout:6/127: getdents d2/d6 0 2023-12-07T16:21:30.725 INFO:tasks.workunit.client.1.smithi152.stdout:7/104: read f8 [2973136,58951] 0 2023-12-07T16:21:30.725 INFO:tasks.workunit.client.1.smithi152.stdout:2/103: getdents d2/d9 0 2023-12-07T16:21:30.725 INFO:tasks.workunit.client.1.smithi152.stdout:3/163: write d7/d11/f20 [2618815,94030] 0 2023-12-07T16:21:30.727 INFO:tasks.workunit.client.1.smithi152.stdout:9/163: creat d1/f3a x:0 0 0 2023-12-07T16:21:30.727 INFO:tasks.workunit.client.1.smithi152.stdout:7/105: write db/fe [412900,91770] 0 2023-12-07T16:21:30.727 INFO:tasks.workunit.client.1.smithi152.stdout:7/106: chown db/d1e/l1f 0 1 2023-12-07T16:21:30.732 INFO:tasks.workunit.client.1.smithi152.stdout:6/128: mknod d2/c29 0 2023-12-07T16:21:30.732 INFO:tasks.workunit.client.1.smithi152.stdout:1/154: dread dc/d14/f1f [0,4194304] 0 2023-12-07T16:21:30.734 INFO:tasks.workunit.client.1.smithi152.stdout:0/122: dread d0/f9 [0,4194304] 0 2023-12-07T16:21:30.734 INFO:tasks.workunit.client.1.smithi152.stdout:0/123: write d0/dc/dd/f1f [942102,89638] 0 2023-12-07T16:21:30.734 INFO:tasks.workunit.client.1.smithi152.stdout:0/124: chown d0/c15 292314416 1 2023-12-07T16:21:30.734 INFO:tasks.workunit.client.1.smithi152.stdout:1/155: rename f8 to dc/d14/f2b 0 2023-12-07T16:21:30.735 INFO:tasks.workunit.client.1.smithi152.stdout:0/125: creat d0/dc/f23 x:0 0 0 2023-12-07T16:21:30.737 INFO:tasks.workunit.client.1.smithi152.stdout:1/156: creat dc/d14/d18/f2c x:0 0 0 2023-12-07T16:21:30.737 INFO:tasks.workunit.client.1.smithi152.stdout:1/157: chown dc/d14/d18/f2c 0 1 2023-12-07T16:21:30.739 INFO:tasks.workunit.client.1.smithi152.stdout:4/123: dwrite d0/f5 [0,4194304] 0 2023-12-07T16:21:30.739 INFO:tasks.workunit.client.1.smithi152.stdout:0/126: rmdir d0/dc/dd 39 2023-12-07T16:21:30.739 INFO:tasks.workunit.client.1.smithi152.stdout:0/127: truncate d0/dc/f23 3601 0 2023-12-07T16:21:30.741 INFO:tasks.workunit.client.1.smithi152.stdout:1/158: mkdir dc/d14/d18/d2d 0 2023-12-07T16:21:30.741 INFO:tasks.workunit.client.1.smithi152.stdout:9/164: dread d1/d9/f23 [0,4194304] 0 2023-12-07T16:21:30.741 INFO:tasks.workunit.client.1.smithi152.stdout:9/165: fsync d1/d9/f2b 0 2023-12-07T16:21:30.744 INFO:tasks.workunit.client.1.smithi152.stdout:6/129: write d2/f3 [4116336,18286] 0 2023-12-07T16:21:30.745 INFO:tasks.workunit.client.1.smithi152.stdout:4/124: write d0/f5 [3266491,65660] 0 2023-12-07T16:21:30.745 INFO:tasks.workunit.client.1.smithi152.stdout:4/125: write d0/d3/d6/f1d [941168,100393] 0 2023-12-07T16:21:30.747 INFO:tasks.workunit.client.1.smithi152.stdout:6/130: creat d2/f2a x:0 0 0 2023-12-07T16:21:30.748 INFO:tasks.workunit.client.1.smithi152.stdout:6/131: symlink d2/d6/d9/l2b 0 2023-12-07T16:21:30.748 INFO:tasks.workunit.client.1.smithi152.stdout:1/159: dread dc/de/f27 [0,4194304] 0 2023-12-07T16:21:30.749 INFO:tasks.workunit.client.1.smithi152.stdout:6/132: write d2/f5 [1370368,46399] 0 2023-12-07T16:21:30.750 INFO:tasks.workunit.client.1.smithi152.stdout:1/160: creat dc/de/f2e x:0 0 0 2023-12-07T16:21:30.752 INFO:tasks.workunit.client.1.smithi152.stdout:1/161: write dc/de/f27 [236199,819] 0 2023-12-07T16:21:30.752 INFO:tasks.workunit.client.1.smithi152.stdout:0/128: fdatasync d0/dc/dd/ff 0 2023-12-07T16:21:30.755 INFO:tasks.workunit.client.1.smithi152.stdout:7/107: dwrite db/d1c/f10 [0,4194304] 0 2023-12-07T16:21:30.755 INFO:tasks.workunit.client.1.smithi152.stdout:7/108: write f6 [6160502,108284] 0 2023-12-07T16:21:30.756 INFO:tasks.workunit.client.1.smithi152.stdout:3/164: dwrite d7/d11/f22 [0,4194304] 0 2023-12-07T16:21:30.756 INFO:tasks.workunit.client.1.smithi152.stdout:3/165: read - d7/d10/d1a/d25/f27 zero size 2023-12-07T16:21:30.756 INFO:tasks.workunit.client.1.smithi152.stdout:7/109: write db/d1c/f10 [3541533,5012] 0 2023-12-07T16:21:30.756 INFO:tasks.workunit.client.1.smithi152.stdout:1/162: symlink dc/d14/d18/d2d/l2f 0 2023-12-07T16:21:30.758 INFO:tasks.workunit.client.1.smithi152.stdout:0/129: symlink d0/dc/l24 0 2023-12-07T16:21:30.759 INFO:tasks.workunit.client.1.smithi152.stdout:0/130: write d0/dc/dd/ff [3007164,59903] 0 2023-12-07T16:21:30.761 INFO:tasks.workunit.client.1.smithi152.stdout:7/110: read f6 [2841165,48766] 0 2023-12-07T16:21:30.763 INFO:tasks.workunit.client.1.smithi152.stdout:3/166: mknod d7/d10/d19/c2b 0 2023-12-07T16:21:30.764 INFO:tasks.workunit.client.1.smithi152.stdout:1/163: rename f6 to dc/d14/d18/f30 0 2023-12-07T16:21:30.765 INFO:tasks.workunit.client.1.smithi152.stdout:2/104: dwrite d2/d9/f11 [0,4194304] 0 2023-12-07T16:21:30.771 INFO:tasks.workunit.client.1.smithi152.stdout:0/131: rename d0/c7 to d0/dc/dd/d11/c25 0 2023-12-07T16:21:30.775 INFO:tasks.workunit.client.1.smithi152.stdout:2/105: creat d2/f23 x:0 0 0 2023-12-07T16:21:30.776 INFO:tasks.workunit.client.1.smithi152.stdout:3/167: symlink d7/d11/l2c 0 2023-12-07T16:21:30.777 INFO:tasks.workunit.client.1.smithi152.stdout:0/132: mkdir d0/dc/d26 0 2023-12-07T16:21:30.777 INFO:tasks.workunit.client.1.smithi152.stdout:0/133: chown d0/dc/dd/c20 3 1 2023-12-07T16:21:30.779 INFO:tasks.workunit.client.1.smithi152.stdout:2/106: symlink d2/d1c/d20/l24 0 2023-12-07T16:21:30.779 INFO:tasks.workunit.client.1.smithi152.stdout:6/133: dwrite d2/f4 [4194304,4194304] 0 2023-12-07T16:21:30.779 INFO:tasks.workunit.client.1.smithi152.stdout:6/134: dread - d2/d6/f25 zero size 2023-12-07T16:21:30.780 INFO:tasks.workunit.client.1.smithi152.stdout:7/111: dwrite db/f18 [0,4194304] 0 2023-12-07T16:21:30.781 INFO:tasks.workunit.client.1.smithi152.stdout:2/107: creat d2/d9/f25 x:0 0 0 2023-12-07T16:21:30.785 INFO:tasks.workunit.client.1.smithi152.stdout:6/135: write d2/f3 [1118769,52757] 0 2023-12-07T16:21:30.785 INFO:tasks.workunit.client.1.smithi152.stdout:1/164: rmdir dc/d14 39 2023-12-07T16:21:30.786 INFO:tasks.workunit.client.1.smithi152.stdout:7/112: link db/d1c/c1b db/c20 0 2023-12-07T16:21:30.786 INFO:tasks.workunit.client.1.smithi152.stdout:7/113: chown db/d1c/f10 122 1 2023-12-07T16:21:30.786 INFO:tasks.workunit.client.1.smithi152.stdout:7/114: stat f6 0 2023-12-07T16:21:30.787 INFO:tasks.workunit.client.1.smithi152.stdout:2/108: mkdir d2/d1c/d26 0 2023-12-07T16:21:30.788 INFO:tasks.workunit.client.1.smithi152.stdout:6/136: symlink d2/d6/d9/d14/l2c 0 2023-12-07T16:21:30.789 INFO:tasks.workunit.client.1.smithi152.stdout:1/165: unlink dc/de/f27 0 2023-12-07T16:21:30.789 INFO:tasks.workunit.client.1.smithi152.stdout:6/137: write d2/f3 [259403,92218] 0 2023-12-07T16:21:30.789 INFO:tasks.workunit.client.1.smithi152.stdout:6/138: readlink d2/d6/d19/l26 0 2023-12-07T16:21:30.790 INFO:tasks.workunit.client.1.smithi152.stdout:7/115: mknod db/c21 0 2023-12-07T16:21:30.791 INFO:tasks.workunit.client.1.smithi152.stdout:7/116: write f6 [5601472,72472] 0 2023-12-07T16:21:30.791 INFO:tasks.workunit.client.1.smithi152.stdout:0/134: rename d0/dc/dd to d0/d27 0 2023-12-07T16:21:30.791 INFO:tasks.workunit.client.1.smithi152.stdout:7/117: read f6 [4842882,65779] 0 2023-12-07T16:21:30.792 INFO:tasks.workunit.client.1.smithi152.stdout:7/118: chown db/d1c/f10 27 1 2023-12-07T16:21:30.792 INFO:tasks.workunit.client.1.smithi152.stdout:2/109: mknod d2/d1c/d26/c27 0 2023-12-07T16:21:30.792 INFO:tasks.workunit.client.1.smithi152.stdout:5/104: sync 2023-12-07T16:21:30.792 INFO:tasks.workunit.client.1.smithi152.stdout:8/134: sync 2023-12-07T16:21:30.793 INFO:tasks.workunit.client.1.smithi152.stdout:5/105: write fc [186003,55361] 0 2023-12-07T16:21:30.794 INFO:tasks.workunit.client.1.smithi152.stdout:6/139: mknod d2/d6/d9/c2d 0 2023-12-07T16:21:30.796 INFO:tasks.workunit.client.1.smithi152.stdout:2/110: creat d2/d1c/f28 x:0 0 0 2023-12-07T16:21:30.796 INFO:tasks.workunit.client.1.smithi152.stdout:8/135: mknod d3/d4/c2f 0 2023-12-07T16:21:30.797 INFO:tasks.workunit.client.1.smithi152.stdout:1/166: write dc/d14/f2b [2797147,87541] 0 2023-12-07T16:21:30.799 INFO:tasks.workunit.client.1.smithi152.stdout:6/140: mkdir d2/d6/de/d2e 0 2023-12-07T16:21:30.801 INFO:tasks.workunit.client.1.smithi152.stdout:2/111: dread d2/d9/f1b [0,4194304] 0 2023-12-07T16:21:30.803 INFO:tasks.workunit.client.1.smithi152.stdout:8/136: link d3/d4/d9/f18 d3/d1e/f30 0 2023-12-07T16:21:30.803 INFO:tasks.workunit.client.1.smithi152.stdout:3/168: dwrite d7/dc/f1b [4194304,4194304] 0 2023-12-07T16:21:30.804 INFO:tasks.workunit.client.1.smithi152.stdout:6/141: symlink d2/l2f 0 2023-12-07T16:21:30.804 INFO:tasks.workunit.client.1.smithi152.stdout:6/142: truncate d2/d6/f1b 631242 0 2023-12-07T16:21:30.806 INFO:tasks.workunit.client.1.smithi152.stdout:8/137: creat d3/d4/d9/dc/d1f/f31 x:0 0 0 2023-12-07T16:21:30.806 INFO:tasks.workunit.client.1.smithi152.stdout:6/143: dread d2/d6/fc [0,4194304] 0 2023-12-07T16:21:30.806 INFO:tasks.workunit.client.1.smithi152.stdout:6/144: truncate d2/d6/f1a 1438309 0 2023-12-07T16:21:30.807 INFO:tasks.workunit.client.1.smithi152.stdout:3/169: symlink d7/dc/d14/l2d 0 2023-12-07T16:21:30.809 INFO:tasks.workunit.client.1.smithi152.stdout:8/138: mknod d3/d4/c32 0 2023-12-07T16:21:30.810 INFO:tasks.workunit.client.1.smithi152.stdout:8/139: creat d3/d4/d9/f33 x:0 0 0 2023-12-07T16:21:30.813 INFO:tasks.workunit.client.1.smithi152.stdout:8/140: mkdir d3/d4/d9/d34 0 2023-12-07T16:21:30.813 INFO:tasks.workunit.client.1.smithi152.stdout:8/141: truncate d3/d1e/f30 1229116 0 2023-12-07T16:21:30.813 INFO:tasks.workunit.client.1.smithi152.stdout:8/142: stat d3/d4/d9/dc/d1f/f31 0 2023-12-07T16:21:30.815 INFO:tasks.workunit.client.1.smithi152.stdout:8/143: creat d3/d4/f35 x:0 0 0 2023-12-07T16:21:30.815 INFO:tasks.workunit.client.1.smithi152.stdout:8/144: stat d3/d4/d9/f33 0 2023-12-07T16:21:30.830 INFO:tasks.workunit.client.1.smithi152.stdout:0/135: dwrite d0/dc/f21 [0,4194304] 0 2023-12-07T16:21:30.830 INFO:tasks.workunit.client.1.smithi152.stdout:0/136: fdatasync d0/f9 0 2023-12-07T16:21:30.830 INFO:tasks.workunit.client.1.smithi152.stdout:0/137: readlink d0/l1e 0 2023-12-07T16:21:30.830 INFO:tasks.workunit.client.1.smithi152.stdout:0/138: chown d0/dc/l1b 68455 1 2023-12-07T16:21:30.839 INFO:tasks.workunit.client.1.smithi152.stdout:1/167: dwrite dc/f2a [0,4194304] 0 2023-12-07T16:21:30.839 INFO:tasks.workunit.client.1.smithi152.stdout:1/168: readlink l7 0 2023-12-07T16:21:30.843 INFO:tasks.workunit.client.1.smithi152.stdout:1/169: rename lb to dc/d14/l31 0 2023-12-07T16:21:30.844 INFO:tasks.workunit.client.1.smithi152.stdout:7/119: dwrite db/f13 [0,4194304] 0 2023-12-07T16:21:30.846 INFO:tasks.workunit.client.1.smithi152.stdout:1/170: link dc/d14/d18/l1d dc/d14/d18/l32 0 2023-12-07T16:21:30.846 INFO:tasks.workunit.client.1.smithi152.stdout:1/171: chown dc/de/f2e 155 1 2023-12-07T16:21:30.846 INFO:tasks.workunit.client.1.smithi152.stdout:2/112: dwrite d2/ff [0,4194304] 0 2023-12-07T16:21:30.847 INFO:tasks.workunit.client.1.smithi152.stdout:6/145: dwrite d2/d6/f1b [0,4194304] 0 2023-12-07T16:21:30.848 INFO:tasks.workunit.client.1.smithi152.stdout:3/170: dwrite d7/d11/f18 [0,4194304] 0 2023-12-07T16:21:30.848 INFO:tasks.workunit.client.1.smithi152.stdout:8/145: dwrite d3/d1e/f30 [0,4194304] 0 2023-12-07T16:21:30.848 INFO:tasks.workunit.client.1.smithi152.stdout:8/146: dread - d3/f24 zero size 2023-12-07T16:21:30.849 INFO:tasks.workunit.client.1.smithi152.stdout:7/120: fdatasync f6 0 2023-12-07T16:21:30.849 INFO:tasks.workunit.client.1.smithi152.stdout:0/139: dwrite d0/f5 [4194304,4194304] 0 2023-12-07T16:21:30.851 INFO:tasks.workunit.client.1.smithi152.stdout:1/172: write dc/fd [7645700,74460] 0 2023-12-07T16:21:30.851 INFO:tasks.workunit.client.1.smithi152.stdout:1/173: truncate dc/d14/d18/f2c 540665 0 2023-12-07T16:21:30.851 INFO:tasks.workunit.client.1.smithi152.stdout:6/146: symlink d2/d6/de/d2e/l30 0 2023-12-07T16:21:30.853 INFO:tasks.workunit.client.1.smithi152.stdout:5/106: truncate dd/de/f13 332308 0 2023-12-07T16:21:30.869 INFO:tasks.workunit.client.1.smithi152.stdout:8/147: write d3/d4/d9/d23/f2c [555801,3274] 0 2023-12-07T16:21:30.869 INFO:tasks.workunit.client.1.smithi152.stdout:0/140: rename d0/d27/d11/c25 to d0/d27/d11/c28 0 2023-12-07T16:21:30.871 INFO:tasks.workunit.client.1.smithi152.stdout:1/174: rename dc/d14/f1f to dc/d14/d18/d2d/f33 0 2023-12-07T16:21:30.872 INFO:tasks.workunit.client.1.smithi152.stdout:3/171: symlink d7/d11/l2e 0 2023-12-07T16:21:30.873 INFO:tasks.workunit.client.1.smithi152.stdout:5/107: mkdir dd/de/d14/d19/d1a 0 2023-12-07T16:21:30.875 INFO:tasks.workunit.client.1.smithi152.stdout:8/148: creat d3/d4/d9/d23/f36 x:0 0 0 2023-12-07T16:21:30.876 INFO:tasks.workunit.client.1.smithi152.stdout:3/172: chown d7/d11/f1d 9213 1 2023-12-07T16:21:30.877 INFO:tasks.workunit.client.1.smithi152.stdout:8/149: creat d3/d4/d9/dc/d1f/f37 x:0 0 0 2023-12-07T16:21:30.880 INFO:tasks.workunit.client.1.smithi152.stdout:8/150: read d3/d4/d9/f1c [3531725,109703] 0 2023-12-07T16:21:30.880 INFO:tasks.workunit.client.1.smithi152.stdout:3/173: getdents d7/d10/d19 0 2023-12-07T16:21:30.880 INFO:tasks.workunit.client.1.smithi152.stdout:2/113: dwrite d2/d9/f13 [0,4194304] 0 2023-12-07T16:21:30.880 INFO:tasks.workunit.client.1.smithi152.stdout:2/114: fsync d2/d1c/f28 0 2023-12-07T16:21:30.880 INFO:tasks.workunit.client.1.smithi152.stdout:7/121: dwrite db/d1c/f10 [0,4194304] 0 2023-12-07T16:21:30.880 INFO:tasks.workunit.client.1.smithi152.stdout:6/147: dwrite d2/f4 [0,4194304] 0 2023-12-07T16:21:30.885 INFO:tasks.workunit.client.1.smithi152.stdout:8/151: creat d3/d4/d9/f38 x:0 0 0 2023-12-07T16:21:30.889 INFO:tasks.workunit.client.1.smithi152.stdout:2/115: creat d2/f29 x:0 0 0 2023-12-07T16:21:30.891 INFO:tasks.workunit.client.1.smithi152.stdout:7/122: truncate db/fe 3663281 0 2023-12-07T16:21:30.892 INFO:tasks.workunit.client.1.smithi152.stdout:8/152: creat d3/d4/d9/dc/f39 x:0 0 0 2023-12-07T16:21:30.892 INFO:tasks.workunit.client.1.smithi152.stdout:8/153: stat d3/d1e 0 2023-12-07T16:21:30.894 INFO:tasks.workunit.client.1.smithi152.stdout:2/116: creat d2/d1c/d26/f2a x:0 0 0 2023-12-07T16:21:30.894 INFO:tasks.workunit.client.1.smithi152.stdout:2/117: dread - d2/d9/f25 zero size 2023-12-07T16:21:30.895 INFO:tasks.workunit.client.1.smithi152.stdout:1/175: dwrite dc/d14/d18/d2d/f33 [0,4194304] 0 2023-12-07T16:21:30.895 INFO:tasks.workunit.client.1.smithi152.stdout:1/176: dread - dc/de/f2e zero size 2023-12-07T16:21:30.895 INFO:tasks.workunit.client.1.smithi152.stdout:7/123: creat db/d1e/f22 x:0 0 0 2023-12-07T16:21:30.895 INFO:tasks.workunit.client.1.smithi152.stdout:7/124: chown db/l12 464965 1 2023-12-07T16:21:30.895 INFO:tasks.workunit.client.1.smithi152.stdout:1/177: write dc/de/f22 [2112948,14631] 0 2023-12-07T16:21:30.895 INFO:tasks.workunit.client.1.smithi152.stdout:1/178: write dc/d14/d18/f30 [4221020,95598] 0 2023-12-07T16:21:30.896 INFO:tasks.workunit.client.1.smithi152.stdout:2/118: rmdir d2/d9 39 2023-12-07T16:21:30.896 INFO:tasks.workunit.client.1.smithi152.stdout:2/119: chown d2/l3 40771 1 2023-12-07T16:21:30.902 INFO:tasks.workunit.client.1.smithi152.stdout:1/179: mknod dc/d14/d18/c34 0 2023-12-07T16:21:30.904 INFO:tasks.workunit.client.1.smithi152.stdout:3/174: rename d7/d11 to d7/d10/d1a/d2f 0 2023-12-07T16:21:30.904 INFO:tasks.workunit.client.1.smithi152.stdout:4/126: sync 2023-12-07T16:21:30.904 INFO:tasks.workunit.client.1.smithi152.stdout:9/166: sync 2023-12-07T16:21:30.905 INFO:tasks.workunit.client.1.smithi152.stdout:1/180: creat dc/d14/d18/f35 x:0 0 0 2023-12-07T16:21:30.909 INFO:tasks.workunit.client.1.smithi152.stdout:3/175: creat d7/d10/d1a/d2f/f30 x:0 0 0 2023-12-07T16:21:30.912 INFO:tasks.workunit.client.1.smithi152.stdout:4/127: mknod d0/d3/d6/c1f 0 2023-12-07T16:21:30.916 INFO:tasks.workunit.client.1.smithi152.stdout:3/176: symlink d7/dc/l31 0 2023-12-07T16:21:30.916 INFO:tasks.workunit.client.1.smithi152.stdout:4/128: read d0/f1 [3365357,11456] 0 2023-12-07T16:21:30.924 INFO:tasks.workunit.client.1.smithi152.stdout:7/125: dread db/f13 [0,4194304] 0 2023-12-07T16:21:30.925 INFO:tasks.workunit.client.1.smithi152.stdout:7/126: chown db/d1c/c1b 1873 1 2023-12-07T16:21:30.932 INFO:tasks.workunit.client.1.smithi152.stdout:6/148: dwrite d2/d6/fc [0,4194304] 0 2023-12-07T16:21:30.934 INFO:tasks.workunit.client.1.smithi152.stdout:6/149: unlink d2/l2f 0 2023-12-07T16:21:30.935 INFO:tasks.workunit.client.1.smithi152.stdout:6/150: creat d2/d6/d9/f31 x:0 0 0 2023-12-07T16:21:30.942 INFO:tasks.workunit.client.1.smithi152.stdout:3/177: dread d7/dc/d14/f15 [4194304,4194304] 0 2023-12-07T16:21:30.944 INFO:tasks.workunit.client.1.smithi152.stdout:3/178: link d7/d10/d1a/d2f/f1d d7/f32 0 2023-12-07T16:21:30.946 INFO:tasks.workunit.client.1.smithi152.stdout:3/179: link d7/d10/d19/f23 d7/dc/f33 0 2023-12-07T16:21:30.950 INFO:tasks.workunit.client.1.smithi152.stdout:3/180: write d7/dc/d14/f16 [3935360,11006] 0 2023-12-07T16:21:30.952 INFO:tasks.workunit.client.1.smithi152.stdout:3/181: dread d7/d10/d1a/d2f/f1d [0,4194304] 0 2023-12-07T16:21:30.954 INFO:tasks.workunit.client.1.smithi152.stdout:3/182: rename d7/d10/d1a/d2f/c1f to d7/d10/c34 0 2023-12-07T16:21:30.956 INFO:tasks.workunit.client.1.smithi152.stdout:3/183: link d7/dc/l13 d7/dc/l35 0 2023-12-07T16:21:30.957 INFO:tasks.workunit.client.1.smithi152.stdout:8/154: dwrite d3/d4/d9/dc/d1f/f28 [0,4194304] 0 2023-12-07T16:21:30.957 INFO:tasks.workunit.client.1.smithi152.stdout:5/108: dwrite fc [0,4194304] 0 2023-12-07T16:21:30.958 INFO:tasks.workunit.client.1.smithi152.stdout:9/167: dwrite d1/d9/db/df/f27 [0,4194304] 0 2023-12-07T16:21:30.958 INFO:tasks.workunit.client.1.smithi152.stdout:9/168: chown d1/d9/f12 1 1 2023-12-07T16:21:30.959 INFO:tasks.workunit.client.1.smithi152.stdout:9/169: chown d1/d9/db/df/f1f 173 1 2023-12-07T16:21:30.959 INFO:tasks.workunit.client.1.smithi152.stdout:4/129: dwrite d0/f1 [0,4194304] 0 2023-12-07T16:21:30.959 INFO:tasks.workunit.client.1.smithi152.stdout:0/141: dwrite d0/d27/ff [0,4194304] 0 2023-12-07T16:21:30.959 INFO:tasks.workunit.client.1.smithi152.stdout:2/120: dwrite d2/d9/f25 [0,4194304] 0 2023-12-07T16:21:30.960 INFO:tasks.workunit.client.1.smithi152.stdout:7/127: dwrite db/d1c/f16 [0,4194304] 0 2023-12-07T16:21:30.960 INFO:tasks.workunit.client.1.smithi152.stdout:0/142: write d0/f18 [38614,43322] 0 2023-12-07T16:21:30.964 INFO:tasks.workunit.client.1.smithi152.stdout:5/109: mkdir dd/de/d14/d19/d1a/d1b 0 2023-12-07T16:21:30.969 INFO:tasks.workunit.client.1.smithi152.stdout:0/143: creat d0/d27/f29 x:0 0 0 2023-12-07T16:21:30.969 INFO:tasks.workunit.client.1.smithi152.stdout:0/144: write d0/dc/f22 [419169,11853] 0 2023-12-07T16:21:30.970 INFO:tasks.workunit.client.1.smithi152.stdout:4/130: write d0/f1 [2284012,124831] 0 2023-12-07T16:21:30.970 INFO:tasks.workunit.client.1.smithi152.stdout:1/181: dread dc/f23 [0,4194304] 0 2023-12-07T16:21:30.970 INFO:tasks.workunit.client.1.smithi152.stdout:0/145: symlink d0/d27/l2a 0 2023-12-07T16:21:30.970 INFO:tasks.workunit.client.1.smithi152.stdout:0/146: stat d0/f5 0 2023-12-07T16:21:30.971 INFO:tasks.workunit.client.1.smithi152.stdout:0/147: chown d0/d27/ce 82351 1 2023-12-07T16:21:30.972 INFO:tasks.workunit.client.1.smithi152.stdout:2/121: dread d2/f8 [0,4194304] 0 2023-12-07T16:21:30.974 INFO:tasks.workunit.client.1.smithi152.stdout:4/131: mknod d0/d3/d6/c20 0 2023-12-07T16:21:30.974 INFO:tasks.workunit.client.1.smithi152.stdout:1/182: creat dc/f36 x:0 0 0 2023-12-07T16:21:30.974 INFO:tasks.workunit.client.1.smithi152.stdout:1/183: truncate dc/de/f2e 168564 0 2023-12-07T16:21:30.974 INFO:tasks.workunit.client.1.smithi152.stdout:0/148: creat d0/d27/f2b x:0 0 0 2023-12-07T16:21:30.974 INFO:tasks.workunit.client.1.smithi152.stdout:0/149: fdatasync d0/f1a 0 2023-12-07T16:21:30.974 INFO:tasks.workunit.client.1.smithi152.stdout:0/150: chown d0/d27 36 1 2023-12-07T16:21:30.975 INFO:tasks.workunit.client.1.smithi152.stdout:9/170: dread d1/d9/db/df/f27 [0,4194304] 0 2023-12-07T16:21:30.975 INFO:tasks.workunit.client.1.smithi152.stdout:9/171: chown d1/dd/d24 1 1 2023-12-07T16:21:30.975 INFO:tasks.workunit.client.1.smithi152.stdout:5/110: dread f9 [0,4194304] 0 2023-12-07T16:21:30.975 INFO:tasks.workunit.client.1.smithi152.stdout:9/172: write d1/f31 [3211653,128564] 0 2023-12-07T16:21:30.976 INFO:tasks.workunit.client.1.smithi152.stdout:9/173: chown d1/dd/l30 2696 1 2023-12-07T16:21:30.976 INFO:tasks.workunit.client.1.smithi152.stdout:9/174: chown d1/d9/db/df 663363 1 2023-12-07T16:21:30.976 INFO:tasks.workunit.client.1.smithi152.stdout:9/175: write d1/d9/f35 [163265,11757] 0 2023-12-07T16:21:30.976 INFO:tasks.workunit.client.1.smithi152.stdout:2/122: unlink d2/l21 0 2023-12-07T16:21:30.976 INFO:tasks.workunit.client.1.smithi152.stdout:2/123: fsync d2/d9/f25 0 2023-12-07T16:21:30.976 INFO:tasks.workunit.client.1.smithi152.stdout:1/184: write dc/d14/f2b [1653247,128458] 0 2023-12-07T16:21:30.976 INFO:tasks.workunit.client.1.smithi152.stdout:1/185: write dc/f36 [350266,89602] 0 2023-12-07T16:21:30.977 INFO:tasks.workunit.client.1.smithi152.stdout:6/151: rmdir d2/d6/d9 39 2023-12-07T16:21:30.979 INFO:tasks.workunit.client.1.smithi152.stdout:1/186: write dc/fd [431064,14520] 0 2023-12-07T16:21:30.980 INFO:tasks.workunit.client.1.smithi152.stdout:8/155: dwrite d3/d4/d9/f18 [4194304,4194304] 0 2023-12-07T16:21:30.980 INFO:tasks.workunit.client.1.smithi152.stdout:8/156: truncate d3/d4/d9/dc/d1f/f28 4616268 0 2023-12-07T16:21:30.983 INFO:tasks.workunit.client.1.smithi152.stdout:4/132: rename d0/c2 to d0/d17/c21 0 2023-12-07T16:21:30.983 INFO:tasks.workunit.client.1.smithi152.stdout:0/151: symlink d0/d27/d11/l2c 0 2023-12-07T16:21:30.983 INFO:tasks.workunit.client.1.smithi152.stdout:0/152: dread - d0/f1a zero size 2023-12-07T16:21:30.984 INFO:tasks.workunit.client.1.smithi152.stdout:5/111: symlink dd/de/d14/d19/d1a/l1c 0 2023-12-07T16:21:30.986 INFO:tasks.workunit.client.1.smithi152.stdout:9/176: symlink d1/d9/db/l3b 0 2023-12-07T16:21:30.987 INFO:tasks.workunit.client.1.smithi152.stdout:6/152: truncate d2/f5 4658851 0 2023-12-07T16:21:30.987 INFO:tasks.workunit.client.1.smithi152.stdout:6/153: chown d2/d6/d9/f31 36772360 1 2023-12-07T16:21:30.989 INFO:tasks.workunit.client.1.smithi152.stdout:6/154: write d2/d6/d9/f13 [381944,14049] 0 2023-12-07T16:21:30.989 INFO:tasks.workunit.client.1.smithi152.stdout:7/128: dwrite f8 [0,4194304] 0 2023-12-07T16:21:30.993 INFO:tasks.workunit.client.1.smithi152.stdout:8/157: mknod d3/d4/d9/d23/c3a 0 2023-12-07T16:21:30.993 INFO:tasks.workunit.client.1.smithi152.stdout:8/158: stat d3/d4/d9/d23/f36 0 2023-12-07T16:21:31.005 INFO:tasks.workunit.client.1.smithi152.stdout:8/159: dread d3/f1a [0,4194304] 0 2023-12-07T16:21:31.005 INFO:tasks.workunit.client.1.smithi152.stdout:8/160: chown d3/d4/c2f 3729576 1 2023-12-07T16:21:31.005 INFO:tasks.workunit.client.1.smithi152.stdout:8/161: read - d3/d4/d9/dc/d1f/f31 zero size 2023-12-07T16:21:31.012 INFO:tasks.workunit.client.1.smithi152.stdout:0/153: symlink d0/d27/d11/l2d 0 2023-12-07T16:21:31.018 INFO:tasks.workunit.client.1.smithi152.stdout:7/129: mkdir db/d1e/d23 0 2023-12-07T16:21:31.020 INFO:tasks.workunit.client.1.smithi152.stdout:8/162: symlink d3/d4/d9/d34/l3b 0 2023-12-07T16:21:31.022 INFO:tasks.workunit.client.1.smithi152.stdout:4/133: dwrite d0/d3/d6/dc/f10 [0,4194304] 0 2023-12-07T16:21:31.022 INFO:tasks.workunit.client.1.smithi152.stdout:4/134: write d0/fb [977192,97048] 0 2023-12-07T16:21:31.022 INFO:tasks.workunit.client.1.smithi152.stdout:4/135: fsync d0/d3/f1a 0 2023-12-07T16:21:31.022 INFO:tasks.workunit.client.1.smithi152.stdout:5/112: dwrite f8 [0,4194304] 0 2023-12-07T16:21:31.022 INFO:tasks.workunit.client.1.smithi152.stdout:0/154: creat d0/f2e x:0 0 0 2023-12-07T16:21:31.022 INFO:tasks.workunit.client.1.smithi152.stdout:2/124: dwrite d2/f8 [0,4194304] 0 2023-12-07T16:21:31.022 INFO:tasks.workunit.client.1.smithi152.stdout:9/177: rmdir d1 39 2023-12-07T16:21:31.023 INFO:tasks.workunit.client.1.smithi152.stdout:6/155: dwrite d2/f4 [4194304,4194304] 0 2023-12-07T16:21:31.023 INFO:tasks.workunit.client.1.smithi152.stdout:7/130: rename c4 to db/d1e/d23/c24 0 2023-12-07T16:21:31.026 INFO:tasks.workunit.client.1.smithi152.stdout:4/136: mkdir d0/d3/d6/dc/d22 0 2023-12-07T16:21:31.027 INFO:tasks.workunit.client.1.smithi152.stdout:5/113: mknod dd/d11/c1d 0 2023-12-07T16:21:31.028 INFO:tasks.workunit.client.1.smithi152.stdout:8/163: dread d3/d4/d9/f1c [0,4194304] 0 2023-12-07T16:21:31.028 INFO:tasks.workunit.client.1.smithi152.stdout:8/164: read - d3/d4/d9/f33 zero size 2023-12-07T16:21:31.028 INFO:tasks.workunit.client.1.smithi152.stdout:8/165: stat d3/d4/d9/dc/d1f/f28 0 2023-12-07T16:21:31.028 INFO:tasks.workunit.client.1.smithi152.stdout:8/166: chown d3/d4/ca 229 1 2023-12-07T16:21:31.028 INFO:tasks.workunit.client.1.smithi152.stdout:8/167: write d3/d4/d9/f21 [130517,113439] 0 2023-12-07T16:21:31.028 INFO:tasks.workunit.client.1.smithi152.stdout:0/155: getdents d0/dc 0 2023-12-07T16:21:31.029 INFO:tasks.workunit.client.1.smithi152.stdout:5/114: read dd/de/f13 [2733764,51107] 0 2023-12-07T16:21:31.029 INFO:tasks.workunit.client.1.smithi152.stdout:2/125: creat d2/d1c/d26/f2b x:0 0 0 2023-12-07T16:21:31.031 INFO:tasks.workunit.client.1.smithi152.stdout:9/178: mkdir d1/d17/d3c 0 2023-12-07T16:21:31.032 INFO:tasks.workunit.client.1.smithi152.stdout:7/131: symlink db/d1e/l25 0 2023-12-07T16:21:31.037 INFO:tasks.workunit.client.1.smithi152.stdout:0/156: mkdir d0/d2f 0 2023-12-07T16:21:31.037 INFO:tasks.workunit.client.1.smithi152.stdout:6/156: dread d2/f3 [0,4194304] 0 2023-12-07T16:21:31.037 INFO:tasks.workunit.client.1.smithi152.stdout:9/179: symlink d1/d9/d2d/l3d 0 2023-12-07T16:21:31.039 INFO:tasks.workunit.client.1.smithi152.stdout:0/157: mkdir d0/d2f/d30 0 2023-12-07T16:21:31.039 INFO:tasks.workunit.client.1.smithi152.stdout:0/158: getdents d0/d2f/d30 0 2023-12-07T16:21:31.040 INFO:tasks.workunit.client.1.smithi152.stdout:5/115: dread f8 [0,4194304] 0 2023-12-07T16:21:31.041 INFO:tasks.workunit.client.1.smithi152.stdout:0/159: creat d0/dc/f31 x:0 0 0 2023-12-07T16:21:31.041 INFO:tasks.workunit.client.1.smithi152.stdout:0/160: chown d0/dc/f21 8133651 1 2023-12-07T16:21:31.043 INFO:tasks.workunit.client.1.smithi152.stdout:2/126: dread d2/ff [0,4194304] 0 2023-12-07T16:21:31.045 INFO:tasks.workunit.client.1.smithi152.stdout:4/137: dwrite d0/d17/f1c [0,4194304] 0 2023-12-07T16:21:31.045 INFO:tasks.workunit.client.1.smithi152.stdout:0/161: dread d0/f9 [0,4194304] 0 2023-12-07T16:21:31.046 INFO:tasks.workunit.client.1.smithi152.stdout:4/138: symlink d0/l23 0 2023-12-07T16:21:31.049 INFO:tasks.workunit.client.1.smithi152.stdout:9/180: dread d1/d9/db/df/f27 [0,4194304] 0 2023-12-07T16:21:31.049 INFO:tasks.workunit.client.1.smithi152.stdout:0/162: link d0/l2 d0/d27/l32 0 2023-12-07T16:21:31.049 INFO:tasks.workunit.client.1.smithi152.stdout:8/168: rmdir d3 39 2023-12-07T16:21:31.049 INFO:tasks.workunit.client.1.smithi152.stdout:8/169: fsync d3/d4/d9/dc/f2d 0 2023-12-07T16:21:31.049 INFO:tasks.workunit.client.1.smithi152.stdout:2/127: write d2/f8 [3904697,130520] 0 2023-12-07T16:21:31.052 INFO:tasks.workunit.client.1.smithi152.stdout:2/128: mknod d2/d1c/d20/c2c 0 2023-12-07T16:21:31.052 INFO:tasks.workunit.client.1.smithi152.stdout:9/181: read d1/d9/f20 [3773247,121582] 0 2023-12-07T16:21:31.052 INFO:tasks.workunit.client.1.smithi152.stdout:9/182: write d1/d9/f35 [206058,115920] 0 2023-12-07T16:21:31.053 INFO:tasks.workunit.client.1.smithi152.stdout:5/116: getdents dd/d11 0 2023-12-07T16:21:31.055 INFO:tasks.workunit.client.1.smithi152.stdout:2/129: creat d2/d1c/d20/f2d x:0 0 0 2023-12-07T16:21:31.056 INFO:tasks.workunit.client.1.smithi152.stdout:9/183: mkdir d1/d3e 0 2023-12-07T16:21:31.056 INFO:tasks.workunit.client.1.smithi152.stdout:9/184: dread - d1/f3a zero size 2023-12-07T16:21:31.057 INFO:tasks.workunit.client.1.smithi152.stdout:9/185: write d1/d9/f23 [1967501,23841] 0 2023-12-07T16:21:31.058 INFO:tasks.workunit.client.1.smithi152.stdout:5/117: creat dd/f1e x:0 0 0 2023-12-07T16:21:31.060 INFO:tasks.workunit.client.1.smithi152.stdout:9/186: link d1/d9/f26 d1/d9/db/f3f 0 2023-12-07T16:21:31.062 INFO:tasks.workunit.client.1.smithi152.stdout:9/187: creat d1/d9/d2d/f40 x:0 0 0 2023-12-07T16:21:31.064 INFO:tasks.workunit.client.1.smithi152.stdout:9/188: mknod d1/d9/d2d/c41 0 2023-12-07T16:21:31.069 INFO:tasks.workunit.client.1.smithi152.stdout:6/157: truncate d2/f5 2075787 0 2023-12-07T16:21:31.070 INFO:tasks.workunit.client.1.smithi152.stdout:6/158: write d2/f3 [1398275,118210] 0 2023-12-07T16:21:31.074 INFO:tasks.workunit.client.1.smithi152.stdout:2/130: write d2/d9/f13 [3837514,44716] 0 2023-12-07T16:21:31.082 INFO:tasks.workunit.client.1.smithi152.stdout:4/139: dwrite d0/fb [0,4194304] 0 2023-12-07T16:21:31.082 INFO:tasks.workunit.client.1.smithi152.stdout:8/170: dwrite d3/d4/d9/f2b [0,4194304] 0 2023-12-07T16:21:31.082 INFO:tasks.workunit.client.1.smithi152.stdout:0/163: dwrite d0/f5 [0,4194304] 0 2023-12-07T16:21:31.082 INFO:tasks.workunit.client.1.smithi152.stdout:2/131: write d2/f8 [567322,3126] 0 2023-12-07T16:21:31.087 INFO:tasks.workunit.client.1.smithi152.stdout:4/140: rename d0/d3/f1a to d0/d3/d6/dc/dd/f24 0 2023-12-07T16:21:31.091 INFO:tasks.workunit.client.1.smithi152.stdout:9/189: fsync d1/d9/d2d/f40 0 2023-12-07T16:21:31.091 INFO:tasks.workunit.client.1.smithi152.stdout:9/190: read d1/d9/db/df/f27 [1754825,10318] 0 2023-12-07T16:21:31.093 INFO:tasks.workunit.client.1.smithi152.stdout:3/184: sync 2023-12-07T16:21:31.093 INFO:tasks.workunit.client.1.smithi152.stdout:3/185: write d7/dc/fe [4420444,119328] 0 2023-12-07T16:21:31.093 INFO:tasks.workunit.client.1.smithi152.stdout:3/186: fsync d7/d10/d1a/d25/f27 0 2023-12-07T16:21:31.095 INFO:tasks.workunit.client.1.smithi152.stdout:0/164: link d0/d27/d11/l17 d0/d2f/l33 0 2023-12-07T16:21:31.097 INFO:tasks.workunit.client.1.smithi152.stdout:9/191: read d1/d9/f26 [3024886,130964] 0 2023-12-07T16:21:31.097 INFO:tasks.workunit.client.1.smithi152.stdout:9/192: chown d1/f3a 98 1 2023-12-07T16:21:31.097 INFO:tasks.workunit.client.1.smithi152.stdout:9/193: dread - d1/d9/db/f36 zero size 2023-12-07T16:21:31.098 INFO:tasks.workunit.client.1.smithi152.stdout:4/141: mknod d0/d3/c25 0 2023-12-07T16:21:31.100 INFO:tasks.workunit.client.1.smithi152.stdout:3/187: symlink d7/d10/l36 0 2023-12-07T16:21:31.100 INFO:tasks.workunit.client.1.smithi152.stdout:3/188: dread - d7/d10/d1a/f28 zero size 2023-12-07T16:21:31.102 INFO:tasks.workunit.client.1.smithi152.stdout:0/165: rename d0/f4 to d0/dc/f34 0 2023-12-07T16:21:31.102 INFO:tasks.workunit.client.1.smithi152.stdout:3/189: dread d7/f8 [0,4194304] 0 2023-12-07T16:21:31.103 INFO:tasks.workunit.client.1.smithi152.stdout:9/194: mkdir d1/d9/db/df/d42 0 2023-12-07T16:21:31.103 INFO:tasks.workunit.client.1.smithi152.stdout:9/195: fsync d1/d9/d2d/f40 0 2023-12-07T16:21:31.104 INFO:tasks.workunit.client.1.smithi152.stdout:4/142: creat d0/d3/d6/f26 x:0 0 0 2023-12-07T16:21:31.106 INFO:tasks.workunit.client.1.smithi152.stdout:0/166: creat d0/d2f/f35 x:0 0 0 2023-12-07T16:21:31.106 INFO:tasks.workunit.client.1.smithi152.stdout:0/167: readlink d0/l1d 0 2023-12-07T16:21:31.108 INFO:tasks.workunit.client.1.smithi152.stdout:9/196: creat d1/d9/db/df/f43 x:0 0 0 2023-12-07T16:21:31.109 INFO:tasks.workunit.client.1.smithi152.stdout:6/159: write d2/f5 [861044,11140] 0 2023-12-07T16:21:31.109 INFO:tasks.workunit.client.1.smithi152.stdout:6/160: write d2/d6/f1a [1664255,35904] 0 2023-12-07T16:21:31.109 INFO:tasks.workunit.client.1.smithi152.stdout:6/161: write d2/f24 [815394,31969] 0 2023-12-07T16:21:31.109 INFO:tasks.workunit.client.1.smithi152.stdout:4/143: unlink d0/fb 0 2023-12-07T16:21:31.110 INFO:tasks.workunit.client.1.smithi152.stdout:4/144: chown d0/d3/d6/dc/d22 1 1 2023-12-07T16:21:31.110 INFO:tasks.workunit.client.1.smithi152.stdout:8/171: dwrite d3/d4/d9/dc/f39 [0,4194304] 0 2023-12-07T16:21:31.111 INFO:tasks.workunit.client.1.smithi152.stdout:2/132: dwrite d2/d9/f1b [4194304,4194304] 0 2023-12-07T16:21:31.111 INFO:tasks.workunit.client.1.smithi152.stdout:9/197: symlink d1/d9/d2d/l44 0 2023-12-07T16:21:31.111 INFO:tasks.workunit.client.1.smithi152.stdout:9/198: write d1/d9/db/f36 [455953,122148] 0 2023-12-07T16:21:31.113 INFO:tasks.workunit.client.1.smithi152.stdout:4/145: creat d0/d3/d6/f27 x:0 0 0 2023-12-07T16:21:31.113 INFO:tasks.workunit.client.1.smithi152.stdout:4/146: fsync d0/d17/f1c 0 2023-12-07T16:21:31.116 INFO:tasks.workunit.client.1.smithi152.stdout:1/187: sync 2023-12-07T16:21:31.116 INFO:tasks.workunit.client.1.smithi152.stdout:1/188: fdatasync dc/f36 0 2023-12-07T16:21:31.118 INFO:tasks.workunit.client.1.smithi152.stdout:2/133: mkdir d2/d1c/d2e 0 2023-12-07T16:21:31.119 INFO:tasks.workunit.client.1.smithi152.stdout:8/172: symlink d3/d4/d9/dc/d1f/l3c 0 2023-12-07T16:21:31.119 INFO:tasks.workunit.client.1.smithi152.stdout:8/173: write d3/d4/d9/f33 [588596,47738] 0 2023-12-07T16:21:31.119 INFO:tasks.workunit.client.1.smithi152.stdout:8/174: write d3/d4/d9/dc/d1f/f37 [945186,121564] 0 2023-12-07T16:21:31.119 INFO:tasks.workunit.client.1.smithi152.stdout:9/199: symlink d1/dd/d24/l45 0 2023-12-07T16:21:31.119 INFO:tasks.workunit.client.1.smithi152.stdout:9/200: write d1/d9/db/df/f27 [4821939,27356] 0 2023-12-07T16:21:31.121 INFO:tasks.workunit.client.1.smithi152.stdout:4/147: creat d0/d3/d6/dc/d22/f28 x:0 0 0 2023-12-07T16:21:31.121 INFO:tasks.workunit.client.1.smithi152.stdout:4/148: dread - d0/d3/d6/f26 zero size 2023-12-07T16:21:31.121 INFO:tasks.workunit.client.1.smithi152.stdout:3/190: dwrite d7/d10/d19/f23 [0,4194304] 0 2023-12-07T16:21:31.121 INFO:tasks.workunit.client.1.smithi152.stdout:1/189: dread dc/d14/f2b [0,4194304] 0 2023-12-07T16:21:31.125 INFO:tasks.workunit.client.1.smithi152.stdout:8/175: unlink d3/d4/d9/dc/f2d 0 2023-12-07T16:21:31.127 INFO:tasks.workunit.client.1.smithi152.stdout:9/201: mkdir d1/d9/d2d/d46 0 2023-12-07T16:21:31.129 INFO:tasks.workunit.client.1.smithi152.stdout:4/149: truncate d0/d3/d6/dc/dd/f24 2759073 0 2023-12-07T16:21:31.129 INFO:tasks.workunit.client.1.smithi152.stdout:4/150: chown d0/d3 47977837 1 2023-12-07T16:21:31.132 INFO:tasks.workunit.client.1.smithi152.stdout:4/151: read d0/f5 [2450687,34680] 0 2023-12-07T16:21:31.132 INFO:tasks.workunit.client.1.smithi152.stdout:1/190: creat dc/d28/f37 x:0 0 0 2023-12-07T16:21:31.132 INFO:tasks.workunit.client.1.smithi152.stdout:1/191: truncate dc/d14/d18/f35 253638 0 2023-12-07T16:21:31.132 INFO:tasks.workunit.client.1.smithi152.stdout:1/192: write dc/f36 [715194,112031] 0 2023-12-07T16:21:31.133 INFO:tasks.workunit.client.1.smithi152.stdout:6/162: write d2/d6/d19/f22 [126123,92322] 0 2023-12-07T16:21:31.133 INFO:tasks.workunit.client.1.smithi152.stdout:6/163: fsync d2/f2a 0 2023-12-07T16:21:31.133 INFO:tasks.workunit.client.1.smithi152.stdout:9/202: creat d1/d9/d2d/d29/f47 x:0 0 0 2023-12-07T16:21:31.134 INFO:tasks.workunit.client.1.smithi152.stdout:0/168: dwrite d0/dc/f23 [0,4194304] 0 2023-12-07T16:21:31.134 INFO:tasks.workunit.client.1.smithi152.stdout:0/169: stat d0/dc/f31 0 2023-12-07T16:21:31.138 INFO:tasks.workunit.client.1.smithi152.stdout:2/134: rmdir d2 39 2023-12-07T16:21:31.138 INFO:tasks.workunit.client.1.smithi152.stdout:2/135: truncate d2/f8 4210731 0 2023-12-07T16:21:31.139 INFO:tasks.workunit.client.1.smithi152.stdout:9/203: mkdir d1/d9/d2d/d29/d48 0 2023-12-07T16:21:31.140 INFO:tasks.workunit.client.1.smithi152.stdout:9/204: stat d1/d9/d2d/c41 0 2023-12-07T16:21:31.142 INFO:tasks.workunit.client.1.smithi152.stdout:4/152: dread d0/f5 [0,4194304] 0 2023-12-07T16:21:31.142 INFO:tasks.workunit.client.1.smithi152.stdout:6/164: dread d2/f4 [0,4194304] 0 2023-12-07T16:21:31.142 INFO:tasks.workunit.client.1.smithi152.stdout:6/165: write d2/f5 [2728122,33582] 0 2023-12-07T16:21:31.147 INFO:tasks.workunit.client.1.smithi152.stdout:8/176: dwrite d3/d4/d9/f33 [0,4194304] 0 2023-12-07T16:21:31.147 INFO:tasks.workunit.client.1.smithi152.stdout:6/166: write d2/d6/f1b [3867564,83142] 0 2023-12-07T16:21:31.152 INFO:tasks.workunit.client.1.smithi152.stdout:0/170: mkdir d0/dc/d36 0 2023-12-07T16:21:31.153 INFO:tasks.workunit.client.1.smithi152.stdout:1/193: dread dc/d14/d18/f35 [0,4194304] 0 2023-12-07T16:21:31.155 INFO:tasks.workunit.client.1.smithi152.stdout:0/171: rename d0/d27/f29 to d0/dc/d36/f37 0 2023-12-07T16:21:31.157 INFO:tasks.workunit.client.1.smithi152.stdout:1/194: creat dc/d28/f38 x:0 0 0 2023-12-07T16:21:31.159 INFO:tasks.workunit.client.1.smithi152.stdout:0/172: link d0/f5 d0/f38 0 2023-12-07T16:21:31.159 INFO:tasks.workunit.client.1.smithi152.stdout:0/173: stat d0/d27/c20 0 2023-12-07T16:21:31.162 INFO:tasks.workunit.client.1.smithi152.stdout:0/174: mknod d0/c39 0 2023-12-07T16:21:31.169 INFO:tasks.workunit.client.1.smithi152.stdout:2/136: dwrite d2/d9/f1b [4194304,4194304] 0 2023-12-07T16:21:31.171 INFO:tasks.workunit.client.1.smithi152.stdout:7/132: sync 2023-12-07T16:21:31.176 INFO:tasks.workunit.client.1.smithi152.stdout:2/137: truncate f1 3614594 0 2023-12-07T16:21:31.176 INFO:tasks.workunit.client.1.smithi152.stdout:2/138: fdatasync d2/d9/f1b 0 2023-12-07T16:21:31.179 INFO:tasks.workunit.client.1.smithi152.stdout:6/167: dread d2/d6/d19/d1f/f20 [0,4194304] 0 2023-12-07T16:21:31.194 INFO:tasks.workunit.client.1.smithi152.stdout:2/139: dread d2/d9/f13 [0,4194304] 0 2023-12-07T16:21:31.194 INFO:tasks.workunit.client.1.smithi152.stdout:4/153: dwrite d0/d3/d6/dc/f10 [0,4194304] 0 2023-12-07T16:21:31.195 INFO:tasks.workunit.client.1.smithi152.stdout:2/140: creat d2/d9/f2f x:0 0 0 2023-12-07T16:21:31.196 INFO:tasks.workunit.client.1.smithi152.stdout:9/205: dwrite d1/d9/f23 [0,4194304] 0 2023-12-07T16:21:31.196 INFO:tasks.workunit.client.1.smithi152.stdout:9/206: fdatasync d1/d9/f23 0 2023-12-07T16:21:31.196 INFO:tasks.workunit.client.1.smithi152.stdout:9/207: chown d1/d17/c1b 0 1 2023-12-07T16:21:31.196 INFO:tasks.workunit.client.1.smithi152.stdout:4/154: mkdir d0/d3/d29 0 2023-12-07T16:21:31.196 INFO:tasks.workunit.client.1.smithi152.stdout:4/155: readlink d0/l15 0 2023-12-07T16:21:31.196 INFO:tasks.workunit.client.1.smithi152.stdout:4/156: fsync d0/d3/d6/f26 0 2023-12-07T16:21:31.197 INFO:tasks.workunit.client.1.smithi152.stdout:9/208: creat d1/f49 x:0 0 0 2023-12-07T16:21:31.197 INFO:tasks.workunit.client.1.smithi152.stdout:9/209: truncate d1/f3a 88028 0 2023-12-07T16:21:31.197 INFO:tasks.workunit.client.1.smithi152.stdout:9/210: fdatasync d1/d9/db/f36 0 2023-12-07T16:21:31.197 INFO:tasks.workunit.client.1.smithi152.stdout:9/211: fsync d1/d9/f12 0 2023-12-07T16:21:31.200 INFO:tasks.workunit.client.1.smithi152.stdout:9/212: rename d1/d9/d2d/d29 to d1/d17/d3c/d4a 0 2023-12-07T16:21:31.201 INFO:tasks.workunit.client.1.smithi152.stdout:9/213: mknod d1/d17/d3c/d4a/d48/c4b 0 2023-12-07T16:21:31.201 INFO:tasks.workunit.client.1.smithi152.stdout:9/214: dread - d1/d9/db/df/f43 zero size 2023-12-07T16:21:31.202 INFO:tasks.workunit.client.1.smithi152.stdout:9/215: symlink d1/d9/d2d/l4c 0 2023-12-07T16:21:31.202 INFO:tasks.workunit.client.1.smithi152.stdout:9/216: chown d1/d9/d2d/c32 747 1 2023-12-07T16:21:31.203 INFO:tasks.workunit.client.1.smithi152.stdout:9/217: readlink d1/d9/d2d/l44 0 2023-12-07T16:21:31.203 INFO:tasks.workunit.client.1.smithi152.stdout:9/218: chown d1/d9/db/df/c39 11 1 2023-12-07T16:21:31.203 INFO:tasks.workunit.client.1.smithi152.stdout:9/219: write d1/f49 [1002634,33078] 0 2023-12-07T16:21:31.203 INFO:tasks.workunit.client.1.smithi152.stdout:0/175: dwrite d0/f5 [4194304,4194304] 0 2023-12-07T16:21:31.203 INFO:tasks.workunit.client.1.smithi152.stdout:0/176: chown d0/d27/d11/l17 3067 1 2023-12-07T16:21:31.204 INFO:tasks.workunit.client.1.smithi152.stdout:7/133: dwrite f8 [0,4194304] 0 2023-12-07T16:21:31.204 INFO:tasks.workunit.client.1.smithi152.stdout:1/195: dwrite f9 [4194304,4194304] 0 2023-12-07T16:21:31.204 INFO:tasks.workunit.client.1.smithi152.stdout:8/177: dwrite d3/d4/d9/f18 [0,4194304] 0 2023-12-07T16:21:31.205 INFO:tasks.workunit.client.1.smithi152.stdout:9/220: rename d1/d9/db/f3f to d1/dd/d24/f4d 0 2023-12-07T16:21:31.205 INFO:tasks.workunit.client.1.smithi152.stdout:9/221: chown d1/f49 6422956 1 2023-12-07T16:21:31.214 INFO:tasks.workunit.client.1.smithi152.stdout:9/222: mkdir d1/d17/d4e 0 2023-12-07T16:21:31.215 INFO:tasks.workunit.client.1.smithi152.stdout:6/168: truncate d2/d6/f1b 757936 0 2023-12-07T16:21:31.217 INFO:tasks.workunit.client.1.smithi152.stdout:2/141: getdents d2/d9 0 2023-12-07T16:21:31.217 INFO:tasks.workunit.client.1.smithi152.stdout:2/142: dread - d2/d9/f2f zero size 2023-12-07T16:21:31.218 INFO:tasks.workunit.client.1.smithi152.stdout:4/157: rmdir d0 39 2023-12-07T16:21:31.218 INFO:tasks.workunit.client.1.smithi152.stdout:7/134: dread db/fe [0,4194304] 0 2023-12-07T16:21:31.219 INFO:tasks.workunit.client.1.smithi152.stdout:6/169: symlink d2/d6/l32 0 2023-12-07T16:21:31.221 INFO:tasks.workunit.client.1.smithi152.stdout:2/143: mkdir d2/d1c/d2e/d30 0 2023-12-07T16:21:31.221 INFO:tasks.workunit.client.1.smithi152.stdout:2/144: dread - d2/f29 zero size 2023-12-07T16:21:31.221 INFO:tasks.workunit.client.1.smithi152.stdout:2/145: write d2/d1c/d26/f2a [687133,36306] 0 2023-12-07T16:21:31.221 INFO:tasks.workunit.client.1.smithi152.stdout:7/135: link db/l12 db/d1c/l26 0 2023-12-07T16:21:31.222 INFO:tasks.workunit.client.1.smithi152.stdout:7/136: fdatasync db/d1c/f16 0 2023-12-07T16:21:31.222 INFO:tasks.workunit.client.1.smithi152.stdout:8/178: dread d3/d4/d9/dc/f39 [0,4194304] 0 2023-12-07T16:21:31.224 INFO:tasks.workunit.client.1.smithi152.stdout:9/223: write d1/dd/d24/f4d [96501,35687] 0 2023-12-07T16:21:31.224 INFO:tasks.workunit.client.1.smithi152.stdout:7/137: write f6 [1445137,2684] 0 2023-12-07T16:21:31.225 INFO:tasks.workunit.client.1.smithi152.stdout:9/224: read d1/d9/f35 [8543,82897] 0 2023-12-07T16:21:31.225 INFO:tasks.workunit.client.1.smithi152.stdout:9/225: write d1/d9/f26 [5121993,32745] 0 2023-12-07T16:21:31.225 INFO:tasks.workunit.client.1.smithi152.stdout:4/158: write d0/d3/d6/dc/f10 [3505636,64884] 0 2023-12-07T16:21:31.226 INFO:tasks.workunit.client.1.smithi152.stdout:8/179: symlink d3/l3d 0 2023-12-07T16:21:31.227 INFO:tasks.workunit.client.1.smithi152.stdout:0/177: dwrite d0/f9 [0,4194304] 0 2023-12-07T16:21:31.232 INFO:tasks.workunit.client.1.smithi152.stdout:4/159: creat d0/d3/f2a x:0 0 0 2023-12-07T16:21:31.233 INFO:tasks.workunit.client.1.smithi152.stdout:0/178: mkdir d0/dc/d36/d3a 0 2023-12-07T16:21:31.233 INFO:tasks.workunit.client.1.smithi152.stdout:0/179: stat d0/d27/f2b 0 2023-12-07T16:21:31.233 INFO:tasks.workunit.client.1.smithi152.stdout:1/196: dwrite f9 [4194304,4194304] 0 2023-12-07T16:21:31.234 INFO:tasks.workunit.client.1.smithi152.stdout:0/180: mknod d0/d27/d11/c3b 0 2023-12-07T16:21:31.234 INFO:tasks.workunit.client.1.smithi152.stdout:0/181: read - d0/dc/f31 zero size 2023-12-07T16:21:31.236 INFO:tasks.workunit.client.1.smithi152.stdout:5/118: sync 2023-12-07T16:21:31.239 INFO:tasks.workunit.client.1.smithi152.stdout:0/182: dread d0/dc/f12 [0,4194304] 0 2023-12-07T16:21:31.239 INFO:tasks.workunit.client.1.smithi152.stdout:6/170: rename d2/d6/f1b to d2/d6/d19/f33 0 2023-12-07T16:21:31.239 INFO:tasks.workunit.client.1.smithi152.stdout:6/171: truncate d2/d6/d9/f13 1375222 0 2023-12-07T16:21:31.239 INFO:tasks.workunit.client.1.smithi152.stdout:6/172: write d2/d6/d19/f22 [941620,63801] 0 2023-12-07T16:21:31.240 INFO:tasks.workunit.client.1.smithi152.stdout:7/138: rmdir db 39 2023-12-07T16:21:31.241 INFO:tasks.workunit.client.1.smithi152.stdout:0/183: creat d0/dc/f3c x:0 0 0 2023-12-07T16:21:31.245 INFO:tasks.workunit.client.1.smithi152.stdout:2/146: dwrite d2/f23 [0,4194304] 0 2023-12-07T16:21:31.246 INFO:tasks.workunit.client.1.smithi152.stdout:6/173: creat d2/d6/f34 x:0 0 0 2023-12-07T16:21:31.246 INFO:tasks.workunit.client.1.smithi152.stdout:6/174: write d2/d6/fc [5166349,51708] 0 2023-12-07T16:21:31.247 INFO:tasks.workunit.client.1.smithi152.stdout:2/147: write f1 [1659349,5647] 0 2023-12-07T16:21:31.252 INFO:tasks.workunit.client.1.smithi152.stdout:0/184: mkdir d0/dc/d3d 0 2023-12-07T16:21:31.252 INFO:tasks.workunit.client.1.smithi152.stdout:9/226: rename d1/d3e to d1/d9/d4f 0 2023-12-07T16:21:31.253 INFO:tasks.workunit.client.1.smithi152.stdout:1/197: truncate dc/f23 6114691 0 2023-12-07T16:21:31.253 INFO:tasks.workunit.client.1.smithi152.stdout:1/198: fdatasync dc/f23 0 2023-12-07T16:21:31.254 INFO:tasks.workunit.client.1.smithi152.stdout:1/199: write dc/f36 [605534,48652] 0 2023-12-07T16:21:31.256 INFO:tasks.workunit.client.1.smithi152.stdout:6/175: creat d2/d6/d9/f35 x:0 0 0 2023-12-07T16:21:31.256 INFO:tasks.workunit.client.1.smithi152.stdout:6/176: fdatasync d2/f24 0 2023-12-07T16:21:31.256 INFO:tasks.workunit.client.1.smithi152.stdout:6/177: fsync d2/d6/d9/f31 0 2023-12-07T16:21:31.258 INFO:tasks.workunit.client.1.smithi152.stdout:4/160: rename d0/d3/d29 to d0/d3/d6/d2b 0 2023-12-07T16:21:31.259 INFO:tasks.workunit.client.1.smithi152.stdout:9/227: creat d1/d9/db/df/f50 x:0 0 0 2023-12-07T16:21:31.266 INFO:tasks.workunit.client.1.smithi152.stdout:5/119: dwrite f9 [4194304,4194304] 0 2023-12-07T16:21:31.266 INFO:tasks.workunit.client.1.smithi152.stdout:5/120: truncate dd/f1e 885919 0 2023-12-07T16:21:31.268 INFO:tasks.workunit.client.1.smithi152.stdout:6/178: symlink d2/d6/d19/l36 0 2023-12-07T16:21:31.268 INFO:tasks.workunit.client.1.smithi152.stdout:6/179: dread - d2/d6/d9/f31 zero size 2023-12-07T16:21:31.268 INFO:tasks.workunit.client.1.smithi152.stdout:6/180: readlink d2/d6/d9/l2b 0 2023-12-07T16:21:31.268 INFO:tasks.workunit.client.1.smithi152.stdout:8/180: dwrite d3/d4/f35 [0,4194304] 0 2023-12-07T16:21:31.268 INFO:tasks.workunit.client.1.smithi152.stdout:9/228: creat d1/f51 x:0 0 0 2023-12-07T16:21:31.268 INFO:tasks.workunit.client.1.smithi152.stdout:9/229: chown d1/d17/c1b 0 1 2023-12-07T16:21:31.277 INFO:tasks.workunit.client.1.smithi152.stdout:8/181: unlink d3/f24 0 2023-12-07T16:21:31.277 INFO:tasks.workunit.client.1.smithi152.stdout:6/181: creat d2/d6/d19/d1f/f37 x:0 0 0 2023-12-07T16:21:31.278 INFO:tasks.workunit.client.1.smithi152.stdout:9/230: creat d1/d17/d3c/d4a/d48/f52 x:0 0 0 2023-12-07T16:21:31.279 INFO:tasks.workunit.client.1.smithi152.stdout:8/182: rename d3/d4/d9/fb to d3/d4/d9/dc/f3e 0 2023-12-07T16:21:31.281 INFO:tasks.workunit.client.1.smithi152.stdout:9/231: mkdir d1/d17/d38/d53 0 2023-12-07T16:21:31.281 INFO:tasks.workunit.client.1.smithi152.stdout:9/232: read d1/f3a [70188,74675] 0 2023-12-07T16:21:31.286 INFO:tasks.workunit.client.1.smithi152.stdout:9/233: symlink d1/d9/db/df/l54 0 2023-12-07T16:21:31.286 INFO:tasks.workunit.client.1.smithi152.stdout:7/139: dwrite db/fe [0,4194304] 0 2023-12-07T16:21:31.290 INFO:tasks.workunit.client.1.smithi152.stdout:0/185: dwrite d0/dc/f3c [0,4194304] 0 2023-12-07T16:21:31.290 INFO:tasks.workunit.client.1.smithi152.stdout:0/186: write d0/dc/f34 [123486,30398] 0 2023-12-07T16:21:31.291 INFO:tasks.workunit.client.1.smithi152.stdout:4/161: dwrite d0/d3/f2a [0,4194304] 0 2023-12-07T16:21:31.292 INFO:tasks.workunit.client.1.smithi152.stdout:9/234: write d1/d9/f12 [3222325,64980] 0 2023-12-07T16:21:31.292 INFO:tasks.workunit.client.1.smithi152.stdout:9/235: chown d1/d9/d2d/l44 622012 1 2023-12-07T16:21:31.293 INFO:tasks.workunit.client.1.smithi152.stdout:0/187: symlink d0/l3e 0 2023-12-07T16:21:31.293 INFO:tasks.workunit.client.1.smithi152.stdout:0/188: read - d0/dc/f31 zero size 2023-12-07T16:21:31.296 INFO:tasks.workunit.client.1.smithi152.stdout:4/162: creat d0/d3/d6/dc/f2c x:0 0 0 2023-12-07T16:21:31.300 INFO:tasks.workunit.client.1.smithi152.stdout:7/140: dread db/f13 [0,4194304] 0 2023-12-07T16:21:31.300 INFO:tasks.workunit.client.1.smithi152.stdout:7/141: chown db/d1c 120 1 2023-12-07T16:21:31.302 INFO:tasks.workunit.client.1.smithi152.stdout:1/200: dwrite dc/d14/f2b [0,4194304] 0 2023-12-07T16:21:31.303 INFO:tasks.workunit.client.1.smithi152.stdout:6/182: getdents d2/d6/d9 0 2023-12-07T16:21:31.310 INFO:tasks.workunit.client.1.smithi152.stdout:6/183: write d2/d6/d19/f22 [357520,31574] 0 2023-12-07T16:21:31.314 INFO:tasks.workunit.client.1.smithi152.stdout:6/184: mkdir d2/d6/de/d2e/d38 0 2023-12-07T16:21:31.314 INFO:tasks.workunit.client.1.smithi152.stdout:6/185: chown d2/d6/d19/d1f/c23 0 1 2023-12-07T16:21:31.314 INFO:tasks.workunit.client.1.smithi152.stdout:8/183: dwrite d3/f1a [4194304,4194304] 0 2023-12-07T16:21:31.317 INFO:tasks.workunit.client.1.smithi152.stdout:5/121: dwrite fc [4194304,4194304] 0 2023-12-07T16:21:31.318 INFO:tasks.workunit.client.1.smithi152.stdout:4/163: dwrite d0/d3/d6/dc/d22/f28 [0,4194304] 0 2023-12-07T16:21:31.318 INFO:tasks.workunit.client.1.smithi152.stdout:6/186: mknod d2/d6/de/c39 0 2023-12-07T16:21:31.322 INFO:tasks.workunit.client.1.smithi152.stdout:9/236: rmdir d1/d9/db/df 39 2023-12-07T16:21:31.328 INFO:tasks.workunit.client.1.smithi152.stdout:5/122: rename dd/d11 to dd/de/d14/d1f 0 2023-12-07T16:21:31.331 INFO:tasks.workunit.client.1.smithi152.stdout:8/184: dread d3/d4/d9/dc/d1f/f28 [0,4194304] 0 2023-12-07T16:21:31.331 INFO:tasks.workunit.client.1.smithi152.stdout:8/185: truncate d3/d4/d9/d23/f36 108261 0 2023-12-07T16:21:31.331 INFO:tasks.workunit.client.1.smithi152.stdout:9/237: mknod d1/d17/d38/c55 0 2023-12-07T16:21:31.332 INFO:tasks.workunit.client.1.smithi152.stdout:4/164: rename d0/d3/d6/dc/f2c to d0/d3/f2d 0 2023-12-07T16:21:31.335 INFO:tasks.workunit.client.1.smithi152.stdout:5/123: unlink dd/de/d14/d1f/c18 0 2023-12-07T16:21:31.337 INFO:tasks.workunit.client.1.smithi152.stdout:5/124: creat dd/de/d14/d1f/f20 x:0 0 0 2023-12-07T16:21:31.337 INFO:tasks.workunit.client.1.smithi152.stdout:5/125: chown dd 116 1 2023-12-07T16:21:31.339 INFO:tasks.workunit.client.1.smithi152.stdout:5/126: rename dd/de/d14/c16 to dd/c21 0 2023-12-07T16:21:31.340 INFO:tasks.workunit.client.1.smithi152.stdout:9/238: write d1/d9/f26 [1556962,71402] 0 2023-12-07T16:21:31.340 INFO:tasks.workunit.client.1.smithi152.stdout:5/127: symlink dd/de/l22 0 2023-12-07T16:21:31.342 INFO:tasks.workunit.client.1.smithi152.stdout:1/201: dwrite f9 [4194304,4194304] 0 2023-12-07T16:21:31.342 INFO:tasks.workunit.client.1.smithi152.stdout:1/202: readlink dc/d14/l24 0 2023-12-07T16:21:31.342 INFO:tasks.workunit.client.1.smithi152.stdout:9/239: unlink d1/d9/db/l3b 0 2023-12-07T16:21:31.344 INFO:tasks.workunit.client.1.smithi152.stdout:5/128: creat dd/de/d14/d19/f23 x:0 0 0 2023-12-07T16:21:31.345 INFO:tasks.workunit.client.1.smithi152.stdout:7/142: dwrite db/fe [0,4194304] 0 2023-12-07T16:21:31.345 INFO:tasks.workunit.client.1.smithi152.stdout:9/240: rmdir d1/d9 39 2023-12-07T16:21:31.345 INFO:tasks.workunit.client.1.smithi152.stdout:9/241: write d1/f5 [2465790,85377] 0 2023-12-07T16:21:31.346 INFO:tasks.workunit.client.1.smithi152.stdout:5/129: mknod dd/de/d14/d19/d1a/d1b/c24 0 2023-12-07T16:21:31.346 INFO:tasks.workunit.client.1.smithi152.stdout:5/130: readlink dd/de/d14/d19/d1a/l1c 0 2023-12-07T16:21:31.347 INFO:tasks.workunit.client.1.smithi152.stdout:7/143: mkdir db/d27 0 2023-12-07T16:21:31.348 INFO:tasks.workunit.client.1.smithi152.stdout:9/242: creat d1/d17/d3c/d4a/d48/f56 x:0 0 0 2023-12-07T16:21:31.348 INFO:tasks.workunit.client.1.smithi152.stdout:9/243: fsync d1/d9/f20 0 2023-12-07T16:21:31.349 INFO:tasks.workunit.client.1.smithi152.stdout:7/144: creat db/d1c/f28 x:0 0 0 2023-12-07T16:21:31.353 INFO:tasks.workunit.client.1.smithi152.stdout:5/131: write dd/de/f13 [4696259,125600] 0 2023-12-07T16:21:31.353 INFO:tasks.workunit.client.1.smithi152.stdout:1/203: dread dc/d14/d18/d2d/f33 [0,4194304] 0 2023-12-07T16:21:31.354 INFO:tasks.workunit.client.1.smithi152.stdout:5/132: creat dd/de/d14/d19/f25 x:0 0 0 2023-12-07T16:21:31.354 INFO:tasks.workunit.client.1.smithi152.stdout:3/191: sync 2023-12-07T16:21:31.354 INFO:tasks.workunit.client.1.smithi152.stdout:3/192: stat d7/lb 0 2023-12-07T16:21:31.355 INFO:tasks.workunit.client.1.smithi152.stdout:1/204: creat dc/d28/f39 x:0 0 0 2023-12-07T16:21:31.355 INFO:tasks.workunit.client.1.smithi152.stdout:6/187: dwrite d2/d6/d19/d1f/f20 [0,4194304] 0 2023-12-07T16:21:31.357 INFO:tasks.workunit.client.1.smithi152.stdout:1/205: symlink dc/d14/d18/d2d/l3a 0 2023-12-07T16:21:31.357 INFO:tasks.workunit.client.1.smithi152.stdout:3/193: creat d7/d10/d1a/d25/f37 x:0 0 0 2023-12-07T16:21:31.357 INFO:tasks.workunit.client.1.smithi152.stdout:1/206: fdatasync dc/d28/f39 0 2023-12-07T16:21:31.358 INFO:tasks.workunit.client.1.smithi152.stdout:1/207: chown dc/d14/d18/c34 11230 1 2023-12-07T16:21:31.358 INFO:tasks.workunit.client.1.smithi152.stdout:1/208: chown dc/d14/f2b 218 1 2023-12-07T16:21:31.358 INFO:tasks.workunit.client.1.smithi152.stdout:1/209: chown dc/d14/f2b 0 1 2023-12-07T16:21:31.358 INFO:tasks.workunit.client.1.smithi152.stdout:1/210: write dc/de/f2e [570052,18915] 0 2023-12-07T16:21:31.358 INFO:tasks.workunit.client.1.smithi152.stdout:6/188: symlink d2/l3a 0 2023-12-07T16:21:31.359 INFO:tasks.workunit.client.1.smithi152.stdout:7/145: write db/d1c/f16 [1815688,75708] 0 2023-12-07T16:21:31.359 INFO:tasks.workunit.client.1.smithi152.stdout:7/146: write db/f13 [4324846,74934] 0 2023-12-07T16:21:31.359 INFO:tasks.workunit.client.1.smithi152.stdout:1/211: mknod dc/d28/c3b 0 2023-12-07T16:21:31.360 INFO:tasks.workunit.client.1.smithi152.stdout:6/189: rename d2/d6/lf to d2/d6/d9/l3b 0 2023-12-07T16:21:31.361 INFO:tasks.workunit.client.1.smithi152.stdout:3/194: symlink d7/l38 0 2023-12-07T16:21:31.361 INFO:tasks.workunit.client.1.smithi152.stdout:7/147: mkdir db/d1e/d29 0 2023-12-07T16:21:31.364 INFO:tasks.workunit.client.1.smithi152.stdout:6/190: link d2/d6/l32 d2/l3c 0 2023-12-07T16:21:31.364 INFO:tasks.workunit.client.1.smithi152.stdout:1/212: dread dc/f13 [0,4194304] 0 2023-12-07T16:21:31.364 INFO:tasks.workunit.client.1.smithi152.stdout:3/195: link d7/d10/d1a/d25/f37 d7/dc/d14/f39 0 2023-12-07T16:21:31.366 INFO:tasks.workunit.client.1.smithi152.stdout:3/196: creat d7/dc/d14/f3a x:0 0 0 2023-12-07T16:21:31.366 INFO:tasks.workunit.client.1.smithi152.stdout:4/165: dwrite d0/d3/d6/dc/d22/f28 [0,4194304] 0 2023-12-07T16:21:31.366 INFO:tasks.workunit.client.1.smithi152.stdout:3/197: truncate d7/f32 2119029 0 2023-12-07T16:21:31.368 INFO:tasks.workunit.client.1.smithi152.stdout:4/166: unlink d0/d17/c21 0 2023-12-07T16:21:31.368 INFO:tasks.workunit.client.1.smithi152.stdout:8/186: dwrite d3/d4/d9/dc/f3e [4194304,4194304] 0 2023-12-07T16:21:31.377 INFO:tasks.workunit.client.1.smithi152.stdout:7/148: dread db/d1c/f10 [0,4194304] 0 2023-12-07T16:21:31.377 INFO:tasks.workunit.client.1.smithi152.stdout:3/198: mknod d7/d10/d1a/d2f/c3b 0 2023-12-07T16:21:31.380 INFO:tasks.workunit.client.1.smithi152.stdout:3/199: getdents d7/d10/d1a 0 2023-12-07T16:21:31.381 INFO:tasks.workunit.client.1.smithi152.stdout:3/200: mknod d7/dc/c3c 0 2023-12-07T16:21:31.382 INFO:tasks.workunit.client.1.smithi152.stdout:9/244: dwrite d1/f31 [4194304,4194304] 0 2023-12-07T16:21:31.382 INFO:tasks.workunit.client.1.smithi152.stdout:3/201: creat d7/f3d x:0 0 0 2023-12-07T16:21:31.383 INFO:tasks.workunit.client.1.smithi152.stdout:9/245: symlink d1/dd/d24/l57 0 2023-12-07T16:21:31.390 INFO:tasks.workunit.client.1.smithi152.stdout:7/149: dread f6 [0,4194304] 0 2023-12-07T16:21:31.391 INFO:tasks.workunit.client.1.smithi152.stdout:7/150: truncate db/d1c/f10 3356245 0 2023-12-07T16:21:31.393 INFO:tasks.workunit.client.1.smithi152.stdout:5/133: dwrite dd/f1e [0,4194304] 0 2023-12-07T16:21:31.393 INFO:tasks.workunit.client.1.smithi152.stdout:5/134: write dd/de/f13 [9054693,118633] 0 2023-12-07T16:21:31.393 INFO:tasks.workunit.client.1.smithi152.stdout:7/151: rmdir db/d1e/d29 0 2023-12-07T16:21:31.396 INFO:tasks.workunit.client.1.smithi152.stdout:8/187: dwrite d3/d4/d9/f38 [0,4194304] 0 2023-12-07T16:21:31.396 INFO:tasks.workunit.client.1.smithi152.stdout:1/213: dwrite dc/de/f22 [0,4194304] 0 2023-12-07T16:21:31.399 INFO:tasks.workunit.client.1.smithi152.stdout:7/152: getdents db/d1e/d23 0 2023-12-07T16:21:31.401 INFO:tasks.workunit.client.1.smithi152.stdout:7/153: write f8 [4140797,83244] 0 2023-12-07T16:21:31.405 INFO:tasks.workunit.client.1.smithi152.stdout:8/188: creat d3/d4/d9/d34/f3f x:0 0 0 2023-12-07T16:21:31.406 INFO:tasks.workunit.client.1.smithi152.stdout:1/214: symlink dc/d14/d18/l3c 0 2023-12-07T16:21:31.407 INFO:tasks.workunit.client.1.smithi152.stdout:1/215: chown dc/de/l25 58594 1 2023-12-07T16:21:31.409 INFO:tasks.workunit.client.1.smithi152.stdout:1/216: creat dc/f3d x:0 0 0 2023-12-07T16:21:31.409 INFO:tasks.workunit.client.1.smithi152.stdout:1/217: truncate dc/f3d 461653 0 2023-12-07T16:21:31.410 INFO:tasks.workunit.client.1.smithi152.stdout:9/246: dread d1/dd/d24/f4d [0,4194304] 0 2023-12-07T16:21:31.413 INFO:tasks.workunit.client.1.smithi152.stdout:9/247: mkdir d1/d17/d58 0 2023-12-07T16:21:31.413 INFO:tasks.workunit.client.1.smithi152.stdout:9/248: write d1/d9/db/df/f1f [1306845,3651] 0 2023-12-07T16:21:31.416 INFO:tasks.workunit.client.1.smithi152.stdout:6/191: dwrite d2/d6/d19/f22 [0,4194304] 0 2023-12-07T16:21:31.419 INFO:tasks.workunit.client.1.smithi152.stdout:6/192: symlink d2/d6/de/d2e/l3d 0 2023-12-07T16:21:31.422 INFO:tasks.workunit.client.1.smithi152.stdout:1/218: dread dc/f26 [4194304,4194304] 0 2023-12-07T16:21:31.424 INFO:tasks.workunit.client.1.smithi152.stdout:3/202: fsync d7/dc/d14/f3a 0 2023-12-07T16:21:31.430 INFO:tasks.workunit.client.1.smithi152.stdout:1/219: write dc/f23 [941634,105952] 0 2023-12-07T16:21:31.430 INFO:tasks.workunit.client.1.smithi152.stdout:5/135: truncate dd/f1e 829122 0 2023-12-07T16:21:31.430 INFO:tasks.workunit.client.1.smithi152.stdout:2/148: sync 2023-12-07T16:21:31.430 INFO:tasks.workunit.client.1.smithi152.stdout:0/189: sync 2023-12-07T16:21:31.433 INFO:tasks.workunit.client.1.smithi152.stdout:8/189: dwrite d3/d4/d9/f33 [0,4194304] 0 2023-12-07T16:21:31.434 INFO:tasks.workunit.client.1.smithi152.stdout:7/154: dwrite db/f18 [0,4194304] 0 2023-12-07T16:21:31.435 INFO:tasks.workunit.client.1.smithi152.stdout:0/190: creat d0/d2f/f3f x:0 0 0 2023-12-07T16:21:31.435 INFO:tasks.workunit.client.1.smithi152.stdout:1/220: fsync dc/f3d 0 2023-12-07T16:21:31.437 INFO:tasks.workunit.client.1.smithi152.stdout:6/193: rmdir d2/d6 39 2023-12-07T16:21:31.437 INFO:tasks.workunit.client.1.smithi152.stdout:9/249: dwrite d1/f49 [0,4194304] 0 2023-12-07T16:21:31.437 INFO:tasks.workunit.client.1.smithi152.stdout:7/155: symlink db/d1e/l2a 0 2023-12-07T16:21:31.437 INFO:tasks.workunit.client.1.smithi152.stdout:7/156: chown db/d1c/l26 0 1 2023-12-07T16:21:31.439 INFO:tasks.workunit.client.1.smithi152.stdout:7/157: read db/fe [309796,91789] 0 2023-12-07T16:21:31.440 INFO:tasks.workunit.client.1.smithi152.stdout:1/221: mknod dc/c3e 0 2023-12-07T16:21:31.442 INFO:tasks.workunit.client.1.smithi152.stdout:3/203: dread d7/dc/d14/f15 [0,4194304] 0 2023-12-07T16:21:31.442 INFO:tasks.workunit.client.1.smithi152.stdout:3/204: stat d7/dc/d14/f3a 0 2023-12-07T16:21:31.442 INFO:tasks.workunit.client.1.smithi152.stdout:6/194: symlink d2/d6/d9/l3e 0 2023-12-07T16:21:31.444 INFO:tasks.workunit.client.1.smithi152.stdout:9/250: creat d1/d17/d3c/d4a/d48/f59 x:0 0 0 2023-12-07T16:21:31.445 INFO:tasks.workunit.client.1.smithi152.stdout:7/158: rename db/l15 to db/l2b 0 2023-12-07T16:21:31.447 INFO:tasks.workunit.client.1.smithi152.stdout:0/191: write d0/dc/f23 [2940128,22721] 0 2023-12-07T16:21:31.448 INFO:tasks.workunit.client.1.smithi152.stdout:6/195: mkdir d2/d6/de/d3f 0 2023-12-07T16:21:31.448 INFO:tasks.workunit.client.1.smithi152.stdout:9/251: truncate d1/d9/f25 4246695 0 2023-12-07T16:21:31.449 INFO:tasks.workunit.client.1.smithi152.stdout:7/159: symlink db/d1c/l2c 0 2023-12-07T16:21:31.450 INFO:tasks.workunit.client.1.smithi152.stdout:3/205: mkdir d7/dc/d3e 0 2023-12-07T16:21:31.452 INFO:tasks.workunit.client.1.smithi152.stdout:0/192: link d0/d27/ff d0/d27/d11/f40 0 2023-12-07T16:21:31.453 INFO:tasks.workunit.client.1.smithi152.stdout:6/196: creat d2/d6/de/d3f/f40 x:0 0 0 2023-12-07T16:21:31.453 INFO:tasks.workunit.client.1.smithi152.stdout:6/197: chown d2/f5 1072639 1 2023-12-07T16:21:31.453 INFO:tasks.workunit.client.1.smithi152.stdout:2/149: dwrite d2/f29 [0,4194304] 0 2023-12-07T16:21:31.453 INFO:tasks.workunit.client.1.smithi152.stdout:9/252: mkdir d1/d17/d4e/d5a 0 2023-12-07T16:21:31.455 INFO:tasks.workunit.client.1.smithi152.stdout:7/160: symlink db/d1c/l2d 0 2023-12-07T16:21:31.455 INFO:tasks.workunit.client.1.smithi152.stdout:1/222: fdatasync f4 0 2023-12-07T16:21:31.458 INFO:tasks.workunit.client.1.smithi152.stdout:6/198: creat d2/d6/de/d2e/f41 x:0 0 0 2023-12-07T16:21:31.459 INFO:tasks.workunit.client.1.smithi152.stdout:2/150: truncate d2/d9/f13 3807643 0 2023-12-07T16:21:31.459 INFO:tasks.workunit.client.1.smithi152.stdout:8/190: dwrite d3/d4/f35 [0,4194304] 0 2023-12-07T16:21:31.460 INFO:tasks.workunit.client.1.smithi152.stdout:9/253: mknod d1/d17/d38/c5b 0 2023-12-07T16:21:31.460 INFO:tasks.workunit.client.1.smithi152.stdout:9/254: readlink d1/dd/l2a 0 2023-12-07T16:21:31.461 INFO:tasks.workunit.client.1.smithi152.stdout:9/255: chown d1/d17/d4e/d5a 1151 1 2023-12-07T16:21:31.462 INFO:tasks.workunit.client.1.smithi152.stdout:5/136: dwrite dd/f1e [0,4194304] 0 2023-12-07T16:21:31.462 INFO:tasks.workunit.client.1.smithi152.stdout:1/223: rename dc/d28/f37 to dc/d14/d18/f3f 0 2023-12-07T16:21:31.464 INFO:tasks.workunit.client.1.smithi152.stdout:3/206: write d7/dc/f1b [6192064,46126] 0 2023-12-07T16:21:31.464 INFO:tasks.workunit.client.1.smithi152.stdout:2/151: mknod d2/d1c/d2e/c31 0 2023-12-07T16:21:31.464 INFO:tasks.workunit.client.1.smithi152.stdout:3/207: write d7/f32 [1085873,74920] 0 2023-12-07T16:21:31.468 INFO:tasks.workunit.client.1.smithi152.stdout:4/167: sync 2023-12-07T16:21:31.468 INFO:tasks.workunit.client.1.smithi152.stdout:9/256: creat d1/dd/f5c x:0 0 0 2023-12-07T16:21:31.468 INFO:tasks.workunit.client.1.smithi152.stdout:9/257: dread - d1/d17/d3c/d4a/d48/f59 zero size 2023-12-07T16:21:31.468 INFO:tasks.workunit.client.1.smithi152.stdout:9/258: fdatasync d1/f51 0 2023-12-07T16:21:31.469 INFO:tasks.workunit.client.1.smithi152.stdout:9/259: read d1/f3a [27159,27926] 0 2023-12-07T16:21:31.469 INFO:tasks.workunit.client.1.smithi152.stdout:9/260: truncate d1/d9/f35 445906 0 2023-12-07T16:21:31.469 INFO:tasks.workunit.client.1.smithi152.stdout:5/137: symlink dd/de/d17/l26 0 2023-12-07T16:21:31.469 INFO:tasks.workunit.client.1.smithi152.stdout:2/152: mknod d2/d1c/d20/c32 0 2023-12-07T16:21:31.470 INFO:tasks.workunit.client.1.smithi152.stdout:3/208: rmdir d7/d10/d1a/d2f 39 2023-12-07T16:21:31.471 INFO:tasks.workunit.client.1.smithi152.stdout:3/209: dread - d7/d10/d1a/f28 zero size 2023-12-07T16:21:31.471 INFO:tasks.workunit.client.1.smithi152.stdout:3/210: chown d7/d10/d19/f23 1 1 2023-12-07T16:21:31.471 INFO:tasks.workunit.client.1.smithi152.stdout:3/211: write d7/d10/d1a/d2f/f30 [824087,100053] 0 2023-12-07T16:21:31.473 INFO:tasks.workunit.client.1.smithi152.stdout:4/168: truncate d0/d3/f7 771236 0 2023-12-07T16:21:31.475 INFO:tasks.workunit.client.1.smithi152.stdout:9/261: creat d1/d9/d2d/d46/f5d x:0 0 0 2023-12-07T16:21:31.479 INFO:tasks.workunit.client.1.smithi152.stdout:5/138: creat dd/de/d14/d19/d1a/f27 x:0 0 0 2023-12-07T16:21:31.479 INFO:tasks.workunit.client.1.smithi152.stdout:3/212: mkdir d7/d10/d1a/d25/d3f 0 2023-12-07T16:21:31.481 INFO:tasks.workunit.client.1.smithi152.stdout:4/169: unlink d0/d3/d6/l13 0 2023-12-07T16:21:31.481 INFO:tasks.workunit.client.1.smithi152.stdout:4/170: write d0/f5 [2589407,113161] 0 2023-12-07T16:21:31.483 INFO:tasks.workunit.client.1.smithi152.stdout:9/262: creat d1/d9/db/f5e x:0 0 0 2023-12-07T16:21:31.484 INFO:tasks.workunit.client.1.smithi152.stdout:5/139: truncate f8 2329886 0 2023-12-07T16:21:31.486 INFO:tasks.workunit.client.1.smithi152.stdout:4/171: creat d0/d3/d6/f2e x:0 0 0 2023-12-07T16:21:31.488 INFO:tasks.workunit.client.1.smithi152.stdout:0/193: dwrite d0/f2e [0,4194304] 0 2023-12-07T16:21:31.488 INFO:tasks.workunit.client.1.smithi152.stdout:0/194: dread - d0/d27/f2b zero size 2023-12-07T16:21:31.488 INFO:tasks.workunit.client.1.smithi152.stdout:0/195: write d0/d27/f10 [413064,7928] 0 2023-12-07T16:21:31.488 INFO:tasks.workunit.client.1.smithi152.stdout:0/196: write d0/d27/f10 [280528,77231] 0 2023-12-07T16:21:31.489 INFO:tasks.workunit.client.1.smithi152.stdout:4/172: mknod d0/d3/c2f 0 2023-12-07T16:21:31.489 INFO:tasks.workunit.client.1.smithi152.stdout:4/173: fsync d0/f1 0 2023-12-07T16:21:31.494 INFO:tasks.workunit.client.1.smithi152.stdout:7/161: dwrite db/d1c/f28 [0,4194304] 0 2023-12-07T16:21:31.495 INFO:tasks.workunit.client.1.smithi152.stdout:5/140: truncate dd/de/f13 4307063 0 2023-12-07T16:21:31.497 INFO:tasks.workunit.client.1.smithi152.stdout:3/213: dread d7/d10/d1a/d2f/f30 [0,4194304] 0 2023-12-07T16:21:31.501 INFO:tasks.workunit.client.1.smithi152.stdout:6/199: dwrite d2/d6/d9/f35 [0,4194304] 0 2023-12-07T16:21:31.501 INFO:tasks.workunit.client.1.smithi152.stdout:1/224: dwrite dc/d14/f2b [8388608,4194304] 0 2023-12-07T16:21:31.501 INFO:tasks.workunit.client.1.smithi152.stdout:1/225: truncate dc/d28/f39 292068 0 2023-12-07T16:21:31.502 INFO:tasks.workunit.client.1.smithi152.stdout:5/141: getdents dd/de 0 2023-12-07T16:21:31.503 INFO:tasks.workunit.client.1.smithi152.stdout:3/214: truncate d7/d10/d19/f23 270354 0 2023-12-07T16:21:31.505 INFO:tasks.workunit.client.1.smithi152.stdout:6/200: mknod d2/d6/de/d2e/d38/c42 0 2023-12-07T16:21:31.505 INFO:tasks.workunit.client.1.smithi152.stdout:6/201: chown d2/f3 62 1 2023-12-07T16:21:31.505 INFO:tasks.workunit.client.1.smithi152.stdout:1/226: creat dc/f40 x:0 0 0 2023-12-07T16:21:31.505 INFO:tasks.workunit.client.1.smithi152.stdout:1/227: dread - dc/f40 zero size 2023-12-07T16:21:31.506 INFO:tasks.workunit.client.1.smithi152.stdout:5/142: mkdir dd/de/d14/d1f/d28 0 2023-12-07T16:21:31.510 INFO:tasks.workunit.client.1.smithi152.stdout:3/215: mknod d7/dc/c40 0 2023-12-07T16:21:31.510 INFO:tasks.workunit.client.1.smithi152.stdout:4/174: write d0/d3/f7 [960228,59491] 0 2023-12-07T16:21:31.513 INFO:tasks.workunit.client.1.smithi152.stdout:3/216: write d7/dc/d14/f16 [2851761,1748] 0 2023-12-07T16:21:31.513 INFO:tasks.workunit.client.1.smithi152.stdout:9/263: dwrite d1/d17/d3c/d4a/d48/f52 [0,4194304] 0 2023-12-07T16:21:31.513 INFO:tasks.workunit.client.1.smithi152.stdout:0/197: dwrite d0/dc/f21 [0,4194304] 0 2023-12-07T16:21:31.515 INFO:tasks.workunit.client.1.smithi152.stdout:4/175: rename d0/d3/d6/dc/d22/f28 to d0/d17/f30 0 2023-12-07T16:21:31.518 INFO:tasks.workunit.client.1.smithi152.stdout:9/264: dread d1/dd/d24/f4d [4194304,4194304] 0 2023-12-07T16:21:31.518 INFO:tasks.workunit.client.1.smithi152.stdout:9/265: fdatasync d1/d17/d3c/d4a/d48/f56 0 2023-12-07T16:21:31.519 INFO:tasks.workunit.client.1.smithi152.stdout:9/266: write d1/d9/f35 [188318,39535] 0 2023-12-07T16:21:31.519 INFO:tasks.workunit.client.1.smithi152.stdout:3/217: mkdir d7/d10/d41 0 2023-12-07T16:21:31.520 INFO:tasks.workunit.client.1.smithi152.stdout:0/198: creat d0/dc/d26/f41 x:0 0 0 2023-12-07T16:21:31.522 INFO:tasks.workunit.client.1.smithi152.stdout:4/176: symlink d0/d3/d6/l31 0 2023-12-07T16:21:31.523 INFO:tasks.workunit.client.1.smithi152.stdout:4/177: stat d0/d17 0 2023-12-07T16:21:31.523 INFO:tasks.workunit.client.1.smithi152.stdout:4/178: read - d0/d3/f2d zero size 2023-12-07T16:21:31.523 INFO:tasks.workunit.client.1.smithi152.stdout:9/267: rmdir d1/d17 39 2023-12-07T16:21:31.525 INFO:tasks.workunit.client.1.smithi152.stdout:3/218: mknod d7/dc/d3e/c42 0 2023-12-07T16:21:31.525 INFO:tasks.workunit.client.1.smithi152.stdout:3/219: chown d7/d10/d1a/d2f/f1d 716815348 1 2023-12-07T16:21:31.526 INFO:tasks.workunit.client.1.smithi152.stdout:3/220: write d7/d10/d1a/d2f/f30 [1433596,66240] 0 2023-12-07T16:21:31.528 INFO:tasks.workunit.client.1.smithi152.stdout:0/199: link d0/dc/f22 d0/dc/d26/f42 0 2023-12-07T16:21:31.529 INFO:tasks.workunit.client.1.smithi152.stdout:0/200: getdents d0/dc/d3d 0 2023-12-07T16:21:31.530 INFO:tasks.workunit.client.1.smithi152.stdout:4/179: creat d0/d3/d6/dc/d22/f32 x:0 0 0 2023-12-07T16:21:31.531 INFO:tasks.workunit.client.1.smithi152.stdout:7/162: dwrite db/fe [0,4194304] 0 2023-12-07T16:21:31.531 INFO:tasks.workunit.client.1.smithi152.stdout:3/221: link d7/d10/d1a/d2f/f1d d7/d10/d1a/f43 0 2023-12-07T16:21:31.532 INFO:tasks.workunit.client.1.smithi152.stdout:0/201: getdents d0/dc/d36 0 2023-12-07T16:21:31.532 INFO:tasks.workunit.client.1.smithi152.stdout:0/202: stat d0/c39 0 2023-12-07T16:21:31.534 INFO:tasks.workunit.client.1.smithi152.stdout:0/203: mknod d0/dc/d26/c43 0 2023-12-07T16:21:31.534 INFO:tasks.workunit.client.1.smithi152.stdout:0/204: chown d0/d27 440663 1 2023-12-07T16:21:31.536 INFO:tasks.workunit.client.1.smithi152.stdout:7/163: read db/fe [3200283,82884] 0 2023-12-07T16:21:31.538 INFO:tasks.workunit.client.1.smithi152.stdout:7/164: rename db/d1c/l2c to db/d27/l2e 0 2023-12-07T16:21:31.544 INFO:tasks.workunit.client.1.smithi152.stdout:4/180: dread d0/d3/f2a [0,4194304] 0 2023-12-07T16:21:31.544 INFO:tasks.workunit.client.1.smithi152.stdout:4/181: fsync d0/d3/d6/f27 0 2023-12-07T16:21:31.548 INFO:tasks.workunit.client.1.smithi152.stdout:5/143: dwrite dd/f1e [0,4194304] 0 2023-12-07T16:21:31.551 INFO:tasks.workunit.client.1.smithi152.stdout:7/165: dread f6 [0,4194304] 0 2023-12-07T16:21:31.554 INFO:tasks.workunit.client.1.smithi152.stdout:6/202: dwrite d2/f5 [0,4194304] 0 2023-12-07T16:21:31.569 INFO:tasks.workunit.client.1.smithi152.stdout:1/228: dwrite dc/fd [0,4194304] 0 2023-12-07T16:21:31.573 INFO:tasks.workunit.client.1.smithi152.stdout:9/268: dwrite d1/d9/f20 [4194304,4194304] 0 2023-12-07T16:21:31.578 INFO:tasks.workunit.client.1.smithi152.stdout:3/222: dwrite d7/d10/d1a/d2f/f26 [0,4194304] 0 2023-12-07T16:21:31.578 INFO:tasks.workunit.client.1.smithi152.stdout:3/223: write d7/d10/d1a/d2f/f18 [5162356,82195] 0 2023-12-07T16:21:31.578 INFO:tasks.workunit.client.1.smithi152.stdout:3/224: write d7/dc/fe [5466217,110196] 0 2023-12-07T16:21:31.584 INFO:tasks.workunit.client.1.smithi152.stdout:9/269: truncate d1/d9/db/df/f27 3390530 0 2023-12-07T16:21:31.588 INFO:tasks.workunit.client.1.smithi152.stdout:3/225: creat d7/d10/d1a/d2f/f44 x:0 0 0 2023-12-07T16:21:31.588 INFO:tasks.workunit.client.1.smithi152.stdout:3/226: read d7/dc/fe [5305143,41337] 0 2023-12-07T16:21:31.588 INFO:tasks.workunit.client.1.smithi152.stdout:3/227: chown d7/d10/l24 1379 1 2023-12-07T16:21:31.588 INFO:tasks.workunit.client.1.smithi152.stdout:3/228: chown d7/d10/d1a/d25/f37 2362 1 2023-12-07T16:21:31.588 INFO:tasks.workunit.client.1.smithi152.stdout:9/270: creat d1/d17/d3c/f5f x:0 0 0 2023-12-07T16:21:31.596 INFO:tasks.workunit.client.1.smithi152.stdout:6/203: dwrite d2/d6/d9/f13 [0,4194304] 0 2023-12-07T16:21:31.596 INFO:tasks.workunit.client.1.smithi152.stdout:6/204: fdatasync d2/f24 0 2023-12-07T16:21:31.596 INFO:tasks.workunit.client.1.smithi152.stdout:1/229: dwrite dc/de/f22 [0,4194304] 0 2023-12-07T16:21:31.600 INFO:tasks.workunit.client.1.smithi152.stdout:3/229: dread d7/d10/d1a/d2f/f20 [0,4194304] 0 2023-12-07T16:21:31.603 INFO:tasks.workunit.client.1.smithi152.stdout:8/191: sync 2023-12-07T16:21:31.603 INFO:tasks.workunit.client.1.smithi152.stdout:8/192: rmdir d3/d4/d9 39 2023-12-07T16:21:31.605 INFO:tasks.workunit.client.1.smithi152.stdout:3/230: fsync d7/d10/d1a/d2f/f44 0 2023-12-07T16:21:31.606 INFO:tasks.workunit.client.1.smithi152.stdout:3/231: creat d7/d10/d19/f45 x:0 0 0 2023-12-07T16:21:31.607 INFO:tasks.workunit.client.1.smithi152.stdout:3/232: read d7/f32 [460326,121672] 0 2023-12-07T16:21:31.622 INFO:tasks.workunit.client.1.smithi152.stdout:8/193: dwrite d3/d4/f35 [0,4194304] 0 2023-12-07T16:21:31.623 INFO:tasks.workunit.client.1.smithi152.stdout:8/194: getdents d3/d4 0 2023-12-07T16:21:31.624 INFO:tasks.workunit.client.1.smithi152.stdout:8/195: dread - d3/d4/d9/dc/d1f/f31 zero size 2023-12-07T16:21:31.624 INFO:tasks.workunit.client.1.smithi152.stdout:3/233: dread d7/d10/d1a/d2f/f22 [0,4194304] 0 2023-12-07T16:21:31.624 INFO:tasks.workunit.client.1.smithi152.stdout:8/196: mkdir d3/d1e/d40 0 2023-12-07T16:21:31.625 INFO:tasks.workunit.client.1.smithi152.stdout:3/234: unlink d7/d10/d1a/c1c 0 2023-12-07T16:21:31.626 INFO:tasks.workunit.client.1.smithi152.stdout:3/235: creat d7/d10/d1a/d25/d3f/f46 x:0 0 0 2023-12-07T16:21:31.627 INFO:tasks.workunit.client.1.smithi152.stdout:3/236: symlink d7/dc/l47 0 2023-12-07T16:21:31.631 INFO:tasks.workunit.client.1.smithi152.stdout:8/197: dread d3/d4/d9/f38 [0,4194304] 0 2023-12-07T16:21:31.661 INFO:tasks.workunit.client.1.smithi152.stdout:0/205: fdatasync d0/d27/f10 0 2023-12-07T16:21:31.661 INFO:tasks.workunit.client.1.smithi152.stdout:0/206: chown d0/d2f/f3f 1 1 2023-12-07T16:21:31.661 INFO:tasks.workunit.client.1.smithi152.stdout:0/207: stat d0/d2f/f3f 0 2023-12-07T16:21:31.661 INFO:tasks.workunit.client.1.smithi152.stdout:0/208: stat d0/d27/l2a 0 2023-12-07T16:21:31.663 INFO:tasks.workunit.client.1.smithi152.stdout:0/209: symlink d0/d27/d11/l44 0 2023-12-07T16:21:31.666 INFO:tasks.workunit.client.1.smithi152.stdout:0/210: link d0/d27/d11/c28 d0/dc/d36/c45 0 2023-12-07T16:21:31.668 INFO:tasks.workunit.client.1.smithi152.stdout:0/211: rename d0/dc/d26/f42 to d0/dc/d26/f46 0 2023-12-07T16:21:31.668 INFO:tasks.workunit.client.1.smithi152.stdout:0/212: truncate d0/f18 1239286 0 2023-12-07T16:21:31.672 INFO:tasks.workunit.client.1.smithi152.stdout:2/153: sync 2023-12-07T16:21:31.672 INFO:tasks.workunit.client.1.smithi152.stdout:4/182: dwrite d0/d17/f1c [0,4194304] 0 2023-12-07T16:21:31.672 INFO:tasks.workunit.client.1.smithi152.stdout:4/183: truncate d0/d3/d6/dc/d22/f32 922173 0 2023-12-07T16:21:31.673 INFO:tasks.workunit.client.1.smithi152.stdout:4/184: chown d0/d3/c2f 6748831 1 2023-12-07T16:21:31.674 INFO:tasks.workunit.client.1.smithi152.stdout:4/185: getdents d0/d3/d6/dc/dd 0 2023-12-07T16:21:31.675 INFO:tasks.workunit.client.1.smithi152.stdout:4/186: creat d0/d3/d6/dc/dd/f33 x:0 0 0 2023-12-07T16:21:31.681 INFO:tasks.workunit.client.1.smithi152.stdout:2/154: dread d2/d9/f1b [0,4194304] 0 2023-12-07T16:21:31.681 INFO:tasks.workunit.client.1.smithi152.stdout:2/155: truncate f1 4580214 0 2023-12-07T16:21:31.681 INFO:tasks.workunit.client.1.smithi152.stdout:8/198: dread d3/d4/d9/d23/f25 [0,4194304] 0 2023-12-07T16:21:31.682 INFO:tasks.workunit.client.1.smithi152.stdout:8/199: chown d3/d1e 1124728296 1 2023-12-07T16:21:31.682 INFO:tasks.workunit.client.1.smithi152.stdout:4/187: write d0/d3/d6/f1d [805085,42346] 0 2023-12-07T16:21:31.683 INFO:tasks.workunit.client.1.smithi152.stdout:7/166: dwrite db/f13 [0,4194304] 0 2023-12-07T16:21:31.683 INFO:tasks.workunit.client.1.smithi152.stdout:8/200: truncate d3/d4/d9/dc/d1f/f37 834693 0 2023-12-07T16:21:31.685 INFO:tasks.workunit.client.1.smithi152.stdout:7/167: creat db/d1e/f2f x:0 0 0 2023-12-07T16:21:31.686 INFO:tasks.workunit.client.1.smithi152.stdout:4/188: mkdir d0/d3/d6/dc/dd/d34 0 2023-12-07T16:21:31.686 INFO:tasks.workunit.client.1.smithi152.stdout:2/156: dread d2/d1c/d26/f2a [0,4194304] 0 2023-12-07T16:21:31.686 INFO:tasks.workunit.client.1.smithi152.stdout:7/168: write db/d1c/f10 [2557299,127354] 0 2023-12-07T16:21:31.687 INFO:tasks.workunit.client.1.smithi152.stdout:4/189: creat d0/d3/d6/f35 x:0 0 0 2023-12-07T16:21:31.687 INFO:tasks.workunit.client.1.smithi152.stdout:4/190: fdatasync d0/f5 0 2023-12-07T16:21:31.689 INFO:tasks.workunit.client.1.smithi152.stdout:2/157: rename d2/d1c/d20 to d2/d1c/d2e/d30/d33 0 2023-12-07T16:21:31.690 INFO:tasks.workunit.client.1.smithi152.stdout:4/191: mkdir d0/d3/d6/d36 0 2023-12-07T16:21:31.693 INFO:tasks.workunit.client.1.smithi152.stdout:9/271: dwrite d1/d9/f26 [0,4194304] 0 2023-12-07T16:21:31.693 INFO:tasks.workunit.client.1.smithi152.stdout:9/272: truncate d1/d17/d3c/d4a/f47 358334 0 2023-12-07T16:21:31.693 INFO:tasks.workunit.client.1.smithi152.stdout:2/158: write d2/f8 [3545392,116809] 0 2023-12-07T16:21:31.695 INFO:tasks.workunit.client.1.smithi152.stdout:5/144: dwrite dd/de/d14/d1f/f20 [0,4194304] 0 2023-12-07T16:21:31.695 INFO:tasks.workunit.client.1.smithi152.stdout:2/159: creat d2/f34 x:0 0 0 2023-12-07T16:21:31.699 INFO:tasks.workunit.client.1.smithi152.stdout:5/145: creat dd/de/d14/f29 x:0 0 0 2023-12-07T16:21:31.699 INFO:tasks.workunit.client.1.smithi152.stdout:5/146: truncate dd/de/d14/f29 245181 0 2023-12-07T16:21:31.699 INFO:tasks.workunit.client.1.smithi152.stdout:6/205: dwrite d2/d6/f34 [0,4194304] 0 2023-12-07T16:21:31.699 INFO:tasks.workunit.client.1.smithi152.stdout:6/206: write d2/d6/d19/d1f/f37 [575395,78963] 0 2023-12-07T16:21:31.699 INFO:tasks.workunit.client.1.smithi152.stdout:0/213: dwrite d0/dc/d36/f37 [0,4194304] 0 2023-12-07T16:21:31.712 INFO:tasks.workunit.client.1.smithi152.stdout:5/147: dread dd/de/d14/d1f/f20 [0,4194304] 0 2023-12-07T16:21:31.713 INFO:tasks.workunit.client.1.smithi152.stdout:0/214: unlink d0/dc/l1b 0 2023-12-07T16:21:31.714 INFO:tasks.workunit.client.1.smithi152.stdout:5/148: symlink dd/l2a 0 2023-12-07T16:21:31.715 INFO:tasks.workunit.client.1.smithi152.stdout:9/273: dread d1/f49 [0,4194304] 0 2023-12-07T16:21:31.715 INFO:tasks.workunit.client.1.smithi152.stdout:1/230: dwrite dc/d28/f39 [0,4194304] 0 2023-12-07T16:21:31.715 INFO:tasks.workunit.client.1.smithi152.stdout:9/274: dread - d1/d9/db/df/f50 zero size 2023-12-07T16:21:31.716 INFO:tasks.workunit.client.1.smithi152.stdout:8/201: dwrite d3/d4/d9/f2b [0,4194304] 0 2023-12-07T16:21:31.716 INFO:tasks.workunit.client.1.smithi152.stdout:8/202: fsync d3/d4/d9/f2b 0 2023-12-07T16:21:31.716 INFO:tasks.workunit.client.1.smithi152.stdout:5/149: creat dd/f2b x:0 0 0 2023-12-07T16:21:31.716 INFO:tasks.workunit.client.1.smithi152.stdout:4/192: getdents d0/d3/d6/dc/dd 0 2023-12-07T16:21:31.718 INFO:tasks.workunit.client.1.smithi152.stdout:0/215: write d0/dc/f3c [3294261,10104] 0 2023-12-07T16:21:31.719 INFO:tasks.workunit.client.1.smithi152.stdout:9/275: read d1/d9/f20 [3894295,45087] 0 2023-12-07T16:21:31.720 INFO:tasks.workunit.client.1.smithi152.stdout:1/231: creat dc/de/f41 x:0 0 0 2023-12-07T16:21:31.720 INFO:tasks.workunit.client.1.smithi152.stdout:1/232: chown dc/d14/d18/l1d 259107418 1 2023-12-07T16:21:31.722 INFO:tasks.workunit.client.1.smithi152.stdout:8/203: symlink d3/d4/d9/l41 0 2023-12-07T16:21:31.724 INFO:tasks.workunit.client.1.smithi152.stdout:4/193: creat d0/d3/f37 x:0 0 0 2023-12-07T16:21:31.727 INFO:tasks.workunit.client.1.smithi152.stdout:0/216: mknod d0/c47 0 2023-12-07T16:21:31.727 INFO:tasks.workunit.client.1.smithi152.stdout:9/276: rename d1/d17/d3c/d4a/l37 to d1/d17/d38/d53/l60 0 2023-12-07T16:21:31.728 INFO:tasks.workunit.client.1.smithi152.stdout:4/194: dread d0/d3/f2a [0,4194304] 0 2023-12-07T16:21:31.728 INFO:tasks.workunit.client.1.smithi152.stdout:0/217: chown d0/dc/d36/c45 17958 1 2023-12-07T16:21:31.728 INFO:tasks.workunit.client.1.smithi152.stdout:1/233: link dc/f36 dc/de/f42 0 2023-12-07T16:21:31.729 INFO:tasks.workunit.client.1.smithi152.stdout:1/234: rename dc/f26 to dc/d28/f43 0 2023-12-07T16:21:31.729 INFO:tasks.workunit.client.1.smithi152.stdout:7/169: dwrite db/d1c/f28 [0,4194304] 0 2023-12-07T16:21:31.729 INFO:tasks.workunit.client.1.smithi152.stdout:6/207: dwrite d2/d6/de/d3f/f40 [0,4194304] 0 2023-12-07T16:21:31.729 INFO:tasks.workunit.client.1.smithi152.stdout:6/208: fdatasync d2/d6/d19/f22 0 2023-12-07T16:21:31.729 INFO:tasks.workunit.client.1.smithi152.stdout:6/209: fdatasync d2/d6/fc 0 2023-12-07T16:21:31.730 INFO:tasks.workunit.client.1.smithi152.stdout:6/210: truncate d2/d6/d9/f31 659489 0 2023-12-07T16:21:31.730 INFO:tasks.workunit.client.1.smithi152.stdout:5/150: dread f9 [4194304,4194304] 0 2023-12-07T16:21:31.732 INFO:tasks.workunit.client.1.smithi152.stdout:1/235: link l7 dc/l44 0 2023-12-07T16:21:31.732 INFO:tasks.workunit.client.1.smithi152.stdout:2/160: dwrite f1 [0,4194304] 0 2023-12-07T16:21:31.732 INFO:tasks.workunit.client.1.smithi152.stdout:2/161: readlink d2/d1c/d2e/d30/d33/l24 0 2023-12-07T16:21:31.732 INFO:tasks.workunit.client.1.smithi152.stdout:5/151: mknod dd/de/d17/c2c 0 2023-12-07T16:21:31.733 INFO:tasks.workunit.client.1.smithi152.stdout:1/236: mkdir dc/d14/d18/d45 0 2023-12-07T16:21:31.733 INFO:tasks.workunit.client.1.smithi152.stdout:1/237: chown dc/de 169 1 2023-12-07T16:21:31.733 INFO:tasks.workunit.client.1.smithi152.stdout:7/170: read f8 [2010920,111893] 0 2023-12-07T16:21:31.737 INFO:tasks.workunit.client.1.smithi152.stdout:9/277: dread d1/f5 [0,4194304] 0 2023-12-07T16:21:31.737 INFO:tasks.workunit.client.1.smithi152.stdout:9/278: truncate d1/d9/db/df/f43 222145 0 2023-12-07T16:21:31.737 INFO:tasks.workunit.client.1.smithi152.stdout:9/279: chown d1/d17 4235 1 2023-12-07T16:21:31.738 INFO:tasks.workunit.client.1.smithi152.stdout:2/162: unlink d2/f34 0 2023-12-07T16:21:31.738 INFO:tasks.workunit.client.1.smithi152.stdout:5/152: truncate f8 2105471 0 2023-12-07T16:21:31.739 INFO:tasks.workunit.client.1.smithi152.stdout:4/195: dread d0/d17/f1c [0,4194304] 0 2023-12-07T16:21:31.741 INFO:tasks.workunit.client.1.smithi152.stdout:0/218: dread d0/d27/ff [0,4194304] 0 2023-12-07T16:21:31.741 INFO:tasks.workunit.client.1.smithi152.stdout:0/219: write d0/dc/f22 [491887,848] 0 2023-12-07T16:21:31.741 INFO:tasks.workunit.client.1.smithi152.stdout:2/163: symlink d2/l35 0 2023-12-07T16:21:31.742 INFO:tasks.workunit.client.1.smithi152.stdout:5/153: rename f9 to dd/de/d14/d1f/d28/f2d 0 2023-12-07T16:21:31.742 INFO:tasks.workunit.client.1.smithi152.stdout:5/154: readlink dd/de/d17/l26 0 2023-12-07T16:21:31.745 INFO:tasks.workunit.client.1.smithi152.stdout:6/211: dwrite d2/f5 [4194304,4194304] 0 2023-12-07T16:21:31.746 INFO:tasks.workunit.client.1.smithi152.stdout:4/196: creat d0/d3/d6/dc/dd/f38 x:0 0 0 2023-12-07T16:21:31.746 INFO:tasks.workunit.client.1.smithi152.stdout:4/197: truncate d0/d3/d6/dc/dd/f38 231104 0 2023-12-07T16:21:31.747 INFO:tasks.workunit.client.1.smithi152.stdout:9/280: dread d1/d9/db/df/f43 [0,4194304] 0 2023-12-07T16:21:31.747 INFO:tasks.workunit.client.1.smithi152.stdout:9/281: dread - d1/f51 zero size 2023-12-07T16:21:31.749 INFO:tasks.workunit.client.1.smithi152.stdout:5/155: link fc dd/de/d14/d1f/f2e 0 2023-12-07T16:21:31.749 INFO:tasks.workunit.client.1.smithi152.stdout:0/220: stat d0/dc/d36/c45 0 2023-12-07T16:21:31.749 INFO:tasks.workunit.client.1.smithi152.stdout:9/282: dread d1/f3a [0,4194304] 0 2023-12-07T16:21:31.751 INFO:tasks.workunit.client.1.smithi152.stdout:0/221: mknod d0/d27/c48 0 2023-12-07T16:21:31.752 INFO:tasks.workunit.client.1.smithi152.stdout:5/156: creat dd/de/d14/d1f/d28/f2f x:0 0 0 2023-12-07T16:21:31.752 INFO:tasks.workunit.client.1.smithi152.stdout:5/157: readlink dd/de/d17/l26 0 2023-12-07T16:21:31.753 INFO:tasks.workunit.client.1.smithi152.stdout:5/158: creat dd/de/d14/d1f/d28/f30 x:0 0 0 2023-12-07T16:21:31.755 INFO:tasks.workunit.client.1.smithi152.stdout:5/159: creat dd/de/f31 x:0 0 0 2023-12-07T16:21:31.755 INFO:tasks.workunit.client.1.smithi152.stdout:5/160: fdatasync dd/de/d14/f29 0 2023-12-07T16:21:31.755 INFO:tasks.workunit.client.1.smithi152.stdout:0/222: write d0/f38 [5867475,51382] 0 2023-12-07T16:21:31.757 INFO:tasks.workunit.client.1.smithi152.stdout:5/161: rename dd/de/d14/d19/d1a/f27 to dd/de/f32 0 2023-12-07T16:21:31.757 INFO:tasks.workunit.client.1.smithi152.stdout:5/162: dread - dd/de/f31 zero size 2023-12-07T16:21:31.757 INFO:tasks.workunit.client.1.smithi152.stdout:5/163: dread - dd/de/d14/d1f/d28/f30 zero size 2023-12-07T16:21:31.758 INFO:tasks.workunit.client.1.smithi152.stdout:0/223: creat d0/f49 x:0 0 0 2023-12-07T16:21:31.760 INFO:tasks.workunit.client.1.smithi152.stdout:5/164: creat dd/de/d17/f33 x:0 0 0 2023-12-07T16:21:31.761 INFO:tasks.workunit.client.1.smithi152.stdout:2/164: dwrite d2/d9/f25 [0,4194304] 0 2023-12-07T16:21:31.761 INFO:tasks.workunit.client.1.smithi152.stdout:2/165: fdatasync d2/f8 0 2023-12-07T16:21:31.761 INFO:tasks.workunit.client.1.smithi152.stdout:2/166: write d2/d1c/d26/f2b [652677,53011] 0 2023-12-07T16:21:31.761 INFO:tasks.workunit.client.1.smithi152.stdout:2/167: fsync d2/d1c/f28 0 2023-12-07T16:21:31.764 INFO:tasks.workunit.client.1.smithi152.stdout:2/168: creat d2/d1c/d26/f36 x:0 0 0 2023-12-07T16:21:31.766 INFO:tasks.workunit.client.1.smithi152.stdout:2/169: mknod d2/d1c/d26/c37 0 2023-12-07T16:21:31.767 INFO:tasks.workunit.client.1.smithi152.stdout:2/170: write d2/d1c/d26/f2b [490389,92678] 0 2023-12-07T16:21:31.767 INFO:tasks.workunit.client.1.smithi152.stdout:0/224: read d0/dc/f22 [287431,120148] 0 2023-12-07T16:21:31.767 INFO:tasks.workunit.client.1.smithi152.stdout:0/225: truncate d0/f49 614109 0 2023-12-07T16:21:31.769 INFO:tasks.workunit.client.1.smithi152.stdout:2/171: read d2/d9/f1b [6900157,81465] 0 2023-12-07T16:21:31.772 INFO:tasks.workunit.client.1.smithi152.stdout:5/165: dread dd/de/d14/d1f/d28/f2d [4194304,4194304] 0 2023-12-07T16:21:31.773 INFO:tasks.workunit.client.1.smithi152.stdout:7/171: truncate db/d1c/f28 852506 0 2023-12-07T16:21:31.773 INFO:tasks.workunit.client.1.smithi152.stdout:5/166: mknod dd/de/d14/d1f/c34 0 2023-12-07T16:21:31.774 INFO:tasks.workunit.client.1.smithi152.stdout:3/237: sync 2023-12-07T16:21:31.775 INFO:tasks.workunit.client.1.smithi152.stdout:7/172: creat db/d27/f30 x:0 0 0 2023-12-07T16:21:31.778 INFO:tasks.workunit.client.1.smithi152.stdout:0/226: dread d0/d27/d11/f40 [0,4194304] 0 2023-12-07T16:21:31.780 INFO:tasks.workunit.client.1.smithi152.stdout:3/238: rmdir d7/d10/d1a/d25/d3f 39 2023-12-07T16:21:31.780 INFO:tasks.workunit.client.1.smithi152.stdout:6/212: dwrite d2/d6/d9/f35 [0,4194304] 0 2023-12-07T16:21:31.780 INFO:tasks.workunit.client.1.smithi152.stdout:6/213: chown d2/d6/d19/d1f/f37 295 1 2023-12-07T16:21:31.780 INFO:tasks.workunit.client.1.smithi152.stdout:0/227: write d0/dc/f21 [82116,58852] 0 2023-12-07T16:21:31.781 INFO:tasks.workunit.client.1.smithi152.stdout:4/198: dwrite d0/d3/d6/dc/f10 [0,4194304] 0 2023-12-07T16:21:31.781 INFO:tasks.workunit.client.1.smithi152.stdout:4/199: fsync d0/d3/d6/dc/d22/f32 0 2023-12-07T16:21:31.781 INFO:tasks.workunit.client.1.smithi152.stdout:4/200: write d0/d3/d6/f27 [356775,114556] 0 2023-12-07T16:21:31.782 INFO:tasks.workunit.client.1.smithi152.stdout:9/283: dwrite d1/dd/f5c [0,4194304] 0 2023-12-07T16:21:31.783 INFO:tasks.workunit.client.1.smithi152.stdout:9/284: chown d1/c34 168 1 2023-12-07T16:21:31.783 INFO:tasks.workunit.client.1.smithi152.stdout:3/239: mkdir d7/dc/d3e/d48 0 2023-12-07T16:21:31.783 INFO:tasks.workunit.client.1.smithi152.stdout:0/228: rmdir d0/d2f 39 2023-12-07T16:21:31.786 INFO:tasks.workunit.client.1.smithi152.stdout:3/240: dread d7/d10/d1a/d2f/f1d [0,4194304] 0 2023-12-07T16:21:31.786 INFO:tasks.workunit.client.1.smithi152.stdout:3/241: chown d7/dc/d3e 99779550 1 2023-12-07T16:21:31.786 INFO:tasks.workunit.client.1.smithi152.stdout:4/201: mkdir d0/d3/d6/dc/d39 0 2023-12-07T16:21:31.786 INFO:tasks.workunit.client.1.smithi152.stdout:4/202: fdatasync d0/d3/f37 0 2023-12-07T16:21:31.786 INFO:tasks.workunit.client.1.smithi152.stdout:4/203: write d0/d3/d6/f27 [1159758,2799] 0 2023-12-07T16:21:31.787 INFO:tasks.workunit.client.1.smithi152.stdout:9/285: creat d1/d17/d58/f61 x:0 0 0 2023-12-07T16:21:31.789 INFO:tasks.workunit.client.1.smithi152.stdout:3/242: symlink d7/d10/d41/l49 0 2023-12-07T16:21:31.789 INFO:tasks.workunit.client.1.smithi152.stdout:3/243: chown d7/dc/l47 2 1 2023-12-07T16:21:31.789 INFO:tasks.workunit.client.1.smithi152.stdout:4/204: mkdir d0/d3/d6/dc/d3a 0 2023-12-07T16:21:31.792 INFO:tasks.workunit.client.1.smithi152.stdout:9/286: mkdir d1/d17/d3c/d4a/d48/d62 0 2023-12-07T16:21:31.793 INFO:tasks.workunit.client.1.smithi152.stdout:3/244: creat d7/d10/d19/f4a x:0 0 0 2023-12-07T16:21:31.794 INFO:tasks.workunit.client.1.smithi152.stdout:5/167: rmdir dd/de/d17 39 2023-12-07T16:21:31.794 INFO:tasks.workunit.client.1.smithi152.stdout:2/172: dwrite d2/d9/f1b [4194304,4194304] 0 2023-12-07T16:21:31.794 INFO:tasks.workunit.client.1.smithi152.stdout:6/214: dread d2/f3 [0,4194304] 0 2023-12-07T16:21:31.796 INFO:tasks.workunit.client.1.smithi152.stdout:4/205: dread d0/d3/d6/dc/dd/f38 [0,4194304] 0 2023-12-07T16:21:31.796 INFO:tasks.workunit.client.1.smithi152.stdout:4/206: chown d0/d3/d6/f26 273 1 2023-12-07T16:21:31.797 INFO:tasks.workunit.client.1.smithi152.stdout:4/207: chown d0/f1 4173 1 2023-12-07T16:21:31.798 INFO:tasks.workunit.client.1.smithi152.stdout:9/287: rmdir d1/d17/d3c/d4a/d48/d62 0 2023-12-07T16:21:31.798 INFO:tasks.workunit.client.1.smithi152.stdout:9/288: fsync d1/d9/db/f5e 0 2023-12-07T16:21:31.800 INFO:tasks.workunit.client.1.smithi152.stdout:5/168: symlink dd/de/d14/d19/d1a/l35 0 2023-12-07T16:21:31.800 INFO:tasks.workunit.client.1.smithi152.stdout:5/169: write dd/de/f31 [581974,96425] 0 2023-12-07T16:21:31.802 INFO:tasks.workunit.client.1.smithi152.stdout:4/208: dread d0/d3/f7 [0,4194304] 0 2023-12-07T16:21:31.803 INFO:tasks.workunit.client.1.smithi152.stdout:4/209: read d0/d17/f1c [3176249,51032] 0 2023-12-07T16:21:31.806 INFO:tasks.workunit.client.1.smithi152.stdout:6/215: dread d2/d6/d9/f13 [0,4194304] 0 2023-12-07T16:21:31.806 INFO:tasks.workunit.client.1.smithi152.stdout:6/216: chown d2/d6/d19/d1f/f37 20174946 1 2023-12-07T16:21:31.808 INFO:tasks.workunit.client.1.smithi152.stdout:7/173: dread db/d1c/f28 [0,4194304] 0 2023-12-07T16:21:31.808 INFO:tasks.workunit.client.1.smithi152.stdout:4/210: dread d0/d3/d6/f1d [0,4194304] 0 2023-12-07T16:21:31.810 INFO:tasks.workunit.client.1.smithi152.stdout:0/229: dwrite d0/dc/f21 [0,4194304] 0 2023-12-07T16:21:31.813 INFO:tasks.workunit.client.1.smithi152.stdout:2/173: mkdir d2/d1c/d2e/d38 0 2023-12-07T16:21:31.813 INFO:tasks.workunit.client.1.smithi152.stdout:5/170: mknod dd/de/d14/d1f/d28/c36 0 2023-12-07T16:21:31.815 INFO:tasks.workunit.client.1.smithi152.stdout:4/211: symlink d0/d3/d6/dc/d39/l3b 0 2023-12-07T16:21:31.815 INFO:tasks.workunit.client.1.smithi152.stdout:4/212: write d0/d3/d6/dc/d22/f32 [348464,58450] 0 2023-12-07T16:21:31.816 INFO:tasks.workunit.client.1.smithi152.stdout:4/213: fdatasync d0/d3/d6/dc/f10 0 2023-12-07T16:21:31.816 INFO:tasks.workunit.client.1.smithi152.stdout:0/230: creat d0/d2f/d30/f4a x:0 0 0 2023-12-07T16:21:31.817 INFO:tasks.workunit.client.1.smithi152.stdout:2/174: creat d2/d1c/d26/f39 x:0 0 0 2023-12-07T16:21:31.817 INFO:tasks.workunit.client.1.smithi152.stdout:2/175: readlink d2/d9/l22 0 2023-12-07T16:21:31.819 INFO:tasks.workunit.client.1.smithi152.stdout:0/231: mknod d0/dc/d3d/c4b 0 2023-12-07T16:21:31.819 INFO:tasks.workunit.client.1.smithi152.stdout:0/232: write d0/d27/f1f [1461937,32350] 0 2023-12-07T16:21:31.819 INFO:tasks.workunit.client.1.smithi152.stdout:0/233: chown d0/dc/d36/d3a 1 1 2023-12-07T16:21:31.819 INFO:tasks.workunit.client.1.smithi152.stdout:0/234: stat d0/d27/d11/c13 0 2023-12-07T16:21:31.819 INFO:tasks.workunit.client.1.smithi152.stdout:2/176: creat d2/d1c/d2e/f3a x:0 0 0 2023-12-07T16:21:31.821 INFO:tasks.workunit.client.1.smithi152.stdout:2/177: creat d2/d1c/d2e/d38/f3b x:0 0 0 2023-12-07T16:21:31.821 INFO:tasks.workunit.client.1.smithi152.stdout:4/214: write d0/d3/d6/dc/f10 [606877,24585] 0 2023-12-07T16:21:31.822 INFO:tasks.workunit.client.1.smithi152.stdout:6/217: dread d2/d6/f34 [0,4194304] 0 2023-12-07T16:21:31.822 INFO:tasks.workunit.client.1.smithi152.stdout:6/218: chown d2/c15 28250 1 2023-12-07T16:21:31.823 INFO:tasks.workunit.client.1.smithi152.stdout:4/215: write d0/d3/f7 [53292,40109] 0 2023-12-07T16:21:31.823 INFO:tasks.workunit.client.1.smithi152.stdout:4/216: read - d0/d3/f37 zero size 2023-12-07T16:21:31.824 INFO:tasks.workunit.client.1.smithi152.stdout:2/178: link d2/f8 d2/d1c/d2e/d30/f3c 0 2023-12-07T16:21:31.825 INFO:tasks.workunit.client.1.smithi152.stdout:9/289: dwrite d1/d9/db/f33 [0,4194304] 0 2023-12-07T16:21:31.825 INFO:tasks.workunit.client.1.smithi152.stdout:9/290: chown d1/d9/d2d/c41 30284 1 2023-12-07T16:21:31.825 INFO:tasks.workunit.client.1.smithi152.stdout:6/219: rmdir d2/d6/d19 39 2023-12-07T16:21:31.826 INFO:tasks.workunit.client.1.smithi152.stdout:6/220: dread - d2/f2a zero size 2023-12-07T16:21:31.826 INFO:tasks.workunit.client.1.smithi152.stdout:7/174: dwrite db/d27/f30 [0,4194304] 0 2023-12-07T16:21:31.827 INFO:tasks.workunit.client.1.smithi152.stdout:5/171: fdatasync dd/de/f31 0 2023-12-07T16:21:31.827 INFO:tasks.workunit.client.1.smithi152.stdout:5/172: write dd/de/d14/d1f/d28/f2f [314137,31817] 0 2023-12-07T16:21:31.827 INFO:tasks.workunit.client.1.smithi152.stdout:4/217: creat d0/d3/f3c x:0 0 0 2023-12-07T16:21:31.830 INFO:tasks.workunit.client.1.smithi152.stdout:2/179: rmdir d2/d1c/d2e/d30 39 2023-12-07T16:21:31.830 INFO:tasks.workunit.client.1.smithi152.stdout:2/180: stat d2/l35 0 2023-12-07T16:21:31.830 INFO:tasks.workunit.client.1.smithi152.stdout:2/181: chown d2/d9/f13 5250 1 2023-12-07T16:21:31.834 INFO:tasks.workunit.client.1.smithi152.stdout:9/291: symlink d1/d9/db/l63 0 2023-12-07T16:21:31.835 INFO:tasks.workunit.client.1.smithi152.stdout:9/292: dread - d1/d17/d3c/f5f zero size 2023-12-07T16:21:31.835 INFO:tasks.workunit.client.1.smithi152.stdout:9/293: write d1/d17/d3c/d4a/d48/f56 [248911,42688] 0 2023-12-07T16:21:31.836 INFO:tasks.workunit.client.1.smithi152.stdout:7/175: creat db/d27/f31 x:0 0 0 2023-12-07T16:21:31.837 INFO:tasks.workunit.client.1.smithi152.stdout:2/182: write d2/ff [1925824,17973] 0 2023-12-07T16:21:31.838 INFO:tasks.workunit.client.1.smithi152.stdout:5/173: rename dd/de/d14/f29 to dd/de/d14/d19/d1a/f37 0 2023-12-07T16:21:31.840 INFO:tasks.workunit.client.1.smithi152.stdout:9/294: creat d1/d17/d38/d53/f64 x:0 0 0 2023-12-07T16:21:31.845 INFO:tasks.workunit.client.1.smithi152.stdout:5/174: mkdir dd/de/d38 0 2023-12-07T16:21:31.845 INFO:tasks.workunit.client.1.smithi152.stdout:9/295: dread d1/d17/d3c/d4a/f47 [0,4194304] 0 2023-12-07T16:21:31.846 INFO:tasks.workunit.client.1.smithi152.stdout:5/175: mkdir dd/de/d14/d39 0 2023-12-07T16:21:31.847 INFO:tasks.workunit.client.1.smithi152.stdout:0/235: dwrite d0/f9 [0,4194304] 0 2023-12-07T16:21:31.847 INFO:tasks.workunit.client.1.smithi152.stdout:0/236: chown d0/d27/ce 121650658 1 2023-12-07T16:21:31.847 INFO:tasks.workunit.client.1.smithi152.stdout:0/237: fsync d0/dc/d26/f41 0 2023-12-07T16:21:31.847 INFO:tasks.workunit.client.1.smithi152.stdout:0/238: chown d0/dc/d3d/c4b 19232 1 2023-12-07T16:21:31.847 INFO:tasks.workunit.client.1.smithi152.stdout:9/296: rmdir d1/dd 39 2023-12-07T16:21:31.849 INFO:tasks.workunit.client.1.smithi152.stdout:9/297: mkdir d1/d9/d2d/d65 0 2023-12-07T16:21:31.849 INFO:tasks.workunit.client.1.smithi152.stdout:9/298: write d1/d17/d38/d53/f64 [470685,36301] 0 2023-12-07T16:21:31.849 INFO:tasks.workunit.client.1.smithi152.stdout:0/239: read d0/dc/f34 [321978,103324] 0 2023-12-07T16:21:31.851 INFO:tasks.workunit.client.1.smithi152.stdout:0/240: mkdir d0/dc/d3d/d4c 0 2023-12-07T16:21:31.851 INFO:tasks.workunit.client.1.smithi152.stdout:2/183: dread d2/f8 [0,4194304] 0 2023-12-07T16:21:31.851 INFO:tasks.workunit.client.1.smithi152.stdout:2/184: chown d2/l3 1 1 2023-12-07T16:21:31.853 INFO:tasks.workunit.client.1.smithi152.stdout:0/241: rename d0/dc/d36/f37 to d0/d2f/f4d 0 2023-12-07T16:21:31.855 INFO:tasks.workunit.client.1.smithi152.stdout:2/185: creat d2/d1c/d2e/d30/d33/f3d x:0 0 0 2023-12-07T16:21:31.856 INFO:tasks.workunit.client.1.smithi152.stdout:8/204: sync 2023-12-07T16:21:31.856 INFO:tasks.workunit.client.1.smithi152.stdout:1/238: sync 2023-12-07T16:21:31.858 INFO:tasks.workunit.client.1.smithi152.stdout:2/186: link d2/d1c/d26/f2a d2/d1c/d2e/f3e 0 2023-12-07T16:21:31.858 INFO:tasks.workunit.client.1.smithi152.stdout:2/187: truncate d2/d1c/f28 583008 0 2023-12-07T16:21:31.859 INFO:tasks.workunit.client.1.smithi152.stdout:6/221: dwrite d2/d6/de/d3f/f40 [0,4194304] 0 2023-12-07T16:21:31.860 INFO:tasks.workunit.client.1.smithi152.stdout:1/239: truncate f4 209800 0 2023-12-07T16:21:31.860 INFO:tasks.workunit.client.1.smithi152.stdout:7/176: dwrite f6 [4194304,4194304] 0 2023-12-07T16:21:31.860 INFO:tasks.workunit.client.1.smithi152.stdout:8/205: creat d3/d4/d9/d34/f42 x:0 0 0 2023-12-07T16:21:31.861 INFO:tasks.workunit.client.1.smithi152.stdout:8/206: fsync d3/d4/d9/f18 0 2023-12-07T16:21:31.861 INFO:tasks.workunit.client.1.smithi152.stdout:4/218: dwrite d0/d3/d6/dc/dd/f38 [0,4194304] 0 2023-12-07T16:21:31.861 INFO:tasks.workunit.client.1.smithi152.stdout:2/188: symlink d2/d1c/l3f 0 2023-12-07T16:21:31.862 INFO:tasks.workunit.client.1.smithi152.stdout:0/242: rmdir d0/d2f/d30 39 2023-12-07T16:21:31.863 INFO:tasks.workunit.client.1.smithi152.stdout:0/243: readlink d0/l3e 0 2023-12-07T16:21:31.864 INFO:tasks.workunit.client.1.smithi152.stdout:6/222: rename d2/d6/d19/l26 to d2/l43 0 2023-12-07T16:21:31.864 INFO:tasks.workunit.client.1.smithi152.stdout:6/223: fdatasync d2/d6/fc 0 2023-12-07T16:21:31.865 INFO:tasks.workunit.client.1.smithi152.stdout:7/177: truncate db/d1c/f10 1259286 0 2023-12-07T16:21:31.866 INFO:tasks.workunit.client.1.smithi152.stdout:8/207: write d3/d1e/f30 [2797706,20598] 0 2023-12-07T16:21:31.876 INFO:tasks.workunit.client.1.smithi152.stdout:5/176: dwrite dd/de/d14/d1f/f2e [0,4194304] 0 2023-12-07T16:21:31.876 INFO:tasks.workunit.client.1.smithi152.stdout:5/177: fdatasync dd/f1e 0 2023-12-07T16:21:31.876 INFO:tasks.workunit.client.1.smithi152.stdout:5/178: read - dd/de/d17/f33 zero size 2023-12-07T16:21:31.876 INFO:tasks.workunit.client.1.smithi152.stdout:9/299: dwrite d1/d9/db/df/f43 [0,4194304] 0 2023-12-07T16:21:31.877 INFO:tasks.workunit.client.1.smithi152.stdout:4/219: truncate d0/f1 2580068 0 2023-12-07T16:21:31.877 INFO:tasks.workunit.client.1.smithi152.stdout:4/220: write d0/d3/f37 [168257,36944] 0 2023-12-07T16:21:31.877 INFO:tasks.workunit.client.1.smithi152.stdout:2/189: creat d2/d1c/d2e/d30/d33/f40 x:0 0 0 2023-12-07T16:21:31.878 INFO:tasks.workunit.client.1.smithi152.stdout:7/178: dread db/f18 [0,4194304] 0 2023-12-07T16:21:31.878 INFO:tasks.workunit.client.1.smithi152.stdout:7/179: readlink db/l2b 0 2023-12-07T16:21:31.878 INFO:tasks.workunit.client.1.smithi152.stdout:0/244: symlink d0/dc/d3d/d4c/l4e 0 2023-12-07T16:21:31.879 INFO:tasks.workunit.client.1.smithi152.stdout:6/224: mkdir d2/d44 0 2023-12-07T16:21:31.881 INFO:tasks.workunit.client.1.smithi152.stdout:8/208: mkdir d3/d1e/d43 0 2023-12-07T16:21:31.882 INFO:tasks.workunit.client.1.smithi152.stdout:5/179: creat dd/de/d14/f3a x:0 0 0 2023-12-07T16:21:31.882 INFO:tasks.workunit.client.1.smithi152.stdout:5/180: write dd/de/d14/d19/f23 [867289,23750] 0 2023-12-07T16:21:31.882 INFO:tasks.workunit.client.1.smithi152.stdout:5/181: readlink dd/de/l22 0 2023-12-07T16:21:31.887 INFO:tasks.workunit.client.1.smithi152.stdout:9/300: dread d1/dd/f5c [0,4194304] 0 2023-12-07T16:21:31.887 INFO:tasks.workunit.client.1.smithi152.stdout:9/301: fsync d1/f31 0 2023-12-07T16:21:31.888 INFO:tasks.workunit.client.1.smithi152.stdout:9/302: write d1/d9/db/f5e [220325,45251] 0 2023-12-07T16:21:31.888 INFO:tasks.workunit.client.1.smithi152.stdout:2/190: unlink d2/d1c/f28 0 2023-12-07T16:21:31.891 INFO:tasks.workunit.client.1.smithi152.stdout:0/245: creat d0/dc/d36/d3a/f4f x:0 0 0 2023-12-07T16:21:31.892 INFO:tasks.workunit.client.1.smithi152.stdout:7/180: truncate db/f18 1105808 0 2023-12-07T16:21:31.892 INFO:tasks.workunit.client.1.smithi152.stdout:7/181: write db/d1c/f10 [1918796,44950] 0 2023-12-07T16:21:31.894 INFO:tasks.workunit.client.1.smithi152.stdout:8/209: creat d3/d1e/f44 x:0 0 0 2023-12-07T16:21:31.894 INFO:tasks.workunit.client.1.smithi152.stdout:8/210: chown d3/d1e/f30 39966526 1 2023-12-07T16:21:31.894 INFO:tasks.workunit.client.1.smithi152.stdout:8/211: readlink d3/d4/l15 0 2023-12-07T16:21:31.895 INFO:tasks.workunit.client.1.smithi152.stdout:5/182: mknod dd/de/d14/d1f/d28/c3b 0 2023-12-07T16:21:31.895 INFO:tasks.workunit.client.1.smithi152.stdout:5/183: write dd/de/d17/f33 [788282,74944] 0 2023-12-07T16:21:31.895 INFO:tasks.workunit.client.1.smithi152.stdout:5/184: chown dd/de/d17/l26 19095 1 2023-12-07T16:21:31.895 INFO:tasks.workunit.client.1.smithi152.stdout:5/185: dread - dd/de/d14/f3a zero size 2023-12-07T16:21:31.895 INFO:tasks.workunit.client.1.smithi152.stdout:5/186: dread - dd/f2b zero size 2023-12-07T16:21:31.896 INFO:tasks.workunit.client.1.smithi152.stdout:5/187: chown dd/de/d14/d39 287933 1 2023-12-07T16:21:31.897 INFO:tasks.workunit.client.1.smithi152.stdout:9/303: symlink d1/d9/d2d/l66 0 2023-12-07T16:21:31.898 INFO:tasks.workunit.client.1.smithi152.stdout:2/191: rename d2/d1c/d2e/f3a to d2/d1c/f41 0 2023-12-07T16:21:31.902 INFO:tasks.workunit.client.1.smithi152.stdout:8/212: link d3/d4/f35 d3/d4/d9/d23/f45 0 2023-12-07T16:21:31.904 INFO:tasks.workunit.client.1.smithi152.stdout:5/188: link dd/de/f31 dd/de/d14/d19/f3c 0 2023-12-07T16:21:31.906 INFO:tasks.workunit.client.1.smithi152.stdout:2/192: mkdir d2/d1c/d2e/d30/d42 0 2023-12-07T16:21:31.907 INFO:tasks.workunit.client.1.smithi152.stdout:8/213: symlink d3/d4/l46 0 2023-12-07T16:21:31.908 INFO:tasks.workunit.client.1.smithi152.stdout:9/304: mkdir d1/d9/d67 0 2023-12-07T16:21:31.909 INFO:tasks.workunit.client.1.smithi152.stdout:3/245: sync 2023-12-07T16:21:31.909 INFO:tasks.workunit.client.1.smithi152.stdout:2/193: creat d2/d1c/d2e/d30/d42/f43 x:0 0 0 2023-12-07T16:21:31.911 INFO:tasks.workunit.client.1.smithi152.stdout:1/240: dwrite dc/f23 [0,4194304] 0 2023-12-07T16:21:31.911 INFO:tasks.workunit.client.1.smithi152.stdout:6/225: dwrite d2/d6/d19/d1f/f20 [0,4194304] 0 2023-12-07T16:21:31.912 INFO:tasks.workunit.client.1.smithi152.stdout:3/246: dread d7/d10/d1a/f43 [0,4194304] 0 2023-12-07T16:21:31.912 INFO:tasks.workunit.client.1.smithi152.stdout:3/247: truncate d7/d10/d19/f23 635245 0 2023-12-07T16:21:31.912 INFO:tasks.workunit.client.1.smithi152.stdout:9/305: rename d1/d17/d3c/d4a/d48/c4b to d1/d9/d2d/c68 0 2023-12-07T16:21:31.914 INFO:tasks.workunit.client.1.smithi152.stdout:1/241: rename dc/d14/d18/d2d/l2f to dc/d14/d18/d2d/l46 0 2023-12-07T16:21:31.918 INFO:tasks.workunit.client.1.smithi152.stdout:9/306: symlink d1/d9/d2d/l69 0 2023-12-07T16:21:31.921 INFO:tasks.workunit.client.1.smithi152.stdout:1/242: link dc/d28/f39 dc/d14/d18/d45/f47 0 2023-12-07T16:21:31.925 INFO:tasks.workunit.client.1.smithi152.stdout:7/182: dwrite db/d1e/f2f [0,4194304] 0 2023-12-07T16:21:31.925 INFO:tasks.workunit.client.1.smithi152.stdout:7/183: write db/d27/f31 [532470,46940] 0 2023-12-07T16:21:31.925 INFO:tasks.workunit.client.1.smithi152.stdout:9/307: unlink d1/f51 0 2023-12-07T16:21:31.928 INFO:tasks.workunit.client.1.smithi152.stdout:2/194: dread d2/d9/f11 [0,4194304] 0 2023-12-07T16:21:31.929 INFO:tasks.workunit.client.1.smithi152.stdout:0/246: dwrite d0/dc/f3c [0,4194304] 0 2023-12-07T16:21:31.929 INFO:tasks.workunit.client.1.smithi152.stdout:0/247: chown d0/c47 1188040889 1 2023-12-07T16:21:31.929 INFO:tasks.workunit.client.1.smithi152.stdout:0/248: truncate d0/f1a 1039671 0 2023-12-07T16:21:31.930 INFO:tasks.workunit.client.1.smithi152.stdout:7/184: creat db/d1e/f32 x:0 0 0 2023-12-07T16:21:31.932 INFO:tasks.workunit.client.1.smithi152.stdout:3/248: read d7/dc/d14/f16 [175580,88854] 0 2023-12-07T16:21:31.932 INFO:tasks.workunit.client.1.smithi152.stdout:2/195: truncate d2/f29 3951497 0 2023-12-07T16:21:31.932 INFO:tasks.workunit.client.1.smithi152.stdout:2/196: fsync d2/d9/f13 0 2023-12-07T16:21:31.936 INFO:tasks.workunit.client.1.smithi152.stdout:0/249: mknod d0/dc/d36/c50 0 2023-12-07T16:21:31.936 INFO:tasks.workunit.client.1.smithi152.stdout:0/250: chown d0/dc/d3d 87 1 2023-12-07T16:21:31.936 INFO:tasks.workunit.client.1.smithi152.stdout:3/249: mkdir d7/d10/d1a/d25/d4b 0 2023-12-07T16:21:31.936 INFO:tasks.workunit.client.1.smithi152.stdout:7/185: write db/f13 [2427127,110637] 0 2023-12-07T16:21:31.939 INFO:tasks.workunit.client.1.smithi152.stdout:2/197: link d2/f8 d2/d1c/d2e/f44 0 2023-12-07T16:21:31.939 INFO:tasks.workunit.client.1.smithi152.stdout:3/250: unlink d7/dc/c40 0 2023-12-07T16:21:31.939 INFO:tasks.workunit.client.1.smithi152.stdout:3/251: fdatasync d7/dc/d14/f39 0 2023-12-07T16:21:31.939 INFO:tasks.workunit.client.1.smithi152.stdout:3/252: chown d7 5159 1 2023-12-07T16:21:31.939 INFO:tasks.workunit.client.1.smithi152.stdout:3/253: fsync d7/dc/d14/f1e 0 2023-12-07T16:21:31.939 INFO:tasks.workunit.client.1.smithi152.stdout:3/254: stat d7/d10/d19/f23 0 2023-12-07T16:21:31.941 INFO:tasks.workunit.client.1.smithi152.stdout:2/198: dread d2/d1c/d26/f2a [0,4194304] 0 2023-12-07T16:21:31.941 INFO:tasks.workunit.client.1.smithi152.stdout:2/199: chown d2/d9/f11 414 1 2023-12-07T16:21:31.941 INFO:tasks.workunit.client.1.smithi152.stdout:2/200: write d2/d1c/f41 [8878,126240] 0 2023-12-07T16:21:31.942 INFO:tasks.workunit.client.1.smithi152.stdout:0/251: mkdir d0/dc/d36/d3a/d51 0 2023-12-07T16:21:31.944 INFO:tasks.workunit.client.1.smithi152.stdout:3/255: truncate d7/dc/d14/f16 3039316 0 2023-12-07T16:21:31.944 INFO:tasks.workunit.client.1.smithi152.stdout:3/256: truncate d7/dc/d14/f1e 696166 0 2023-12-07T16:21:31.946 INFO:tasks.workunit.client.1.smithi152.stdout:0/252: link d0/d27/f10 d0/d2f/f52 0 2023-12-07T16:21:31.948 INFO:tasks.workunit.client.1.smithi152.stdout:5/189: dwrite dd/de/d14/d19/f3c [0,4194304] 0 2023-12-07T16:21:31.948 INFO:tasks.workunit.client.1.smithi152.stdout:3/257: mknod d7/d10/d1a/c4c 0 2023-12-07T16:21:31.950 INFO:tasks.workunit.client.1.smithi152.stdout:6/226: dwrite d2/d6/d9/f13 [4194304,4194304] 0 2023-12-07T16:21:31.950 INFO:tasks.workunit.client.1.smithi152.stdout:6/227: fdatasync d2/d6/d9/f35 0 2023-12-07T16:21:31.950 INFO:tasks.workunit.client.1.smithi152.stdout:6/228: dread - d2/f2a zero size 2023-12-07T16:21:31.960 INFO:tasks.workunit.client.1.smithi152.stdout:4/221: dwrite d0/f1 [0,4194304] 0 2023-12-07T16:21:31.960 INFO:tasks.workunit.client.1.smithi152.stdout:4/222: chown d0 22 1 2023-12-07T16:21:31.960 INFO:tasks.workunit.client.1.smithi152.stdout:4/223: stat d0/d3/d6/dc/dd/d34 0 2023-12-07T16:21:31.960 INFO:tasks.workunit.client.1.smithi152.stdout:1/243: dwrite dc/d28/f38 [0,4194304] 0 2023-12-07T16:21:31.960 INFO:tasks.workunit.client.1.smithi152.stdout:8/214: dwrite d3/d4/d9/dc/d1f/f28 [0,4194304] 0 2023-12-07T16:21:31.960 INFO:tasks.workunit.client.1.smithi152.stdout:8/215: write d3/d4/d9/d34/f3f [522978,3068] 0 2023-12-07T16:21:31.962 INFO:tasks.workunit.client.1.smithi152.stdout:5/190: dread fc [0,4194304] 0 2023-12-07T16:21:31.963 INFO:tasks.workunit.client.1.smithi152.stdout:9/308: dwrite d1/d9/f35 [0,4194304] 0 2023-12-07T16:21:31.965 INFO:tasks.workunit.client.1.smithi152.stdout:5/191: write fc [3067299,4233] 0 2023-12-07T16:21:31.965 INFO:tasks.workunit.client.1.smithi152.stdout:5/192: chown dd/de/d14/d1f/c34 3198560 1 2023-12-07T16:21:31.965 INFO:tasks.workunit.client.1.smithi152.stdout:4/224: symlink d0/d3/d6/dc/d22/l3d 0 2023-12-07T16:21:31.966 INFO:tasks.workunit.client.1.smithi152.stdout:4/225: write d0/d17/f1c [3320579,9795] 0 2023-12-07T16:21:31.966 INFO:tasks.workunit.client.1.smithi152.stdout:1/244: mkdir dc/d14/d18/d2d/d48 0 2023-12-07T16:21:31.967 INFO:tasks.workunit.client.1.smithi152.stdout:8/216: truncate d3/d4/d9/d23/f45 1470084 0 2023-12-07T16:21:31.969 INFO:tasks.workunit.client.1.smithi152.stdout:9/309: dread d1/d9/db/df/f1f [0,4194304] 0 2023-12-07T16:21:31.970 INFO:tasks.workunit.client.1.smithi152.stdout:1/245: read f4 [2906105,101683] 0 2023-12-07T16:21:31.972 INFO:tasks.workunit.client.1.smithi152.stdout:3/258: dwrite d7/dc/fe [0,4194304] 0 2023-12-07T16:21:31.973 INFO:tasks.workunit.client.1.smithi152.stdout:6/229: dwrite d2/f5 [4194304,4194304] 0 2023-12-07T16:21:31.986 INFO:tasks.workunit.client.1.smithi152.stdout:5/193: rmdir dd/de/d14/d39 0 2023-12-07T16:21:31.988 INFO:tasks.workunit.client.1.smithi152.stdout:4/226: link d0/d3/d6/dc/d22/f32 d0/d3/d6/dc/d3a/f3e 0 2023-12-07T16:21:31.988 INFO:tasks.workunit.client.1.smithi152.stdout:4/227: chown d0/d3/d6/dc/d22 1 1 2023-12-07T16:21:31.989 INFO:tasks.workunit.client.1.smithi152.stdout:8/217: symlink d3/d4/d9/d23/l47 0 2023-12-07T16:21:31.990 INFO:tasks.workunit.client.1.smithi152.stdout:5/194: dread dd/de/d14/d19/f23 [0,4194304] 0 2023-12-07T16:21:31.990 INFO:tasks.workunit.client.1.smithi152.stdout:1/246: truncate dc/f13 710432 0 2023-12-07T16:21:31.991 INFO:tasks.workunit.client.1.smithi152.stdout:3/259: creat d7/d10/d1a/d25/d4b/f4d x:0 0 0 2023-12-07T16:21:31.993 INFO:tasks.workunit.client.1.smithi152.stdout:6/230: rename d2/d44 to d2/d6/de/d45 0 2023-12-07T16:21:31.993 INFO:tasks.workunit.client.1.smithi152.stdout:1/247: write dc/f2a [1517643,8426] 0 2023-12-07T16:21:31.994 INFO:tasks.workunit.client.1.smithi152.stdout:4/228: creat d0/d17/f3f x:0 0 0 2023-12-07T16:21:31.995 INFO:tasks.workunit.client.1.smithi152.stdout:8/218: mknod d3/d4/d9/c48 0 2023-12-07T16:21:31.996 INFO:tasks.workunit.client.1.smithi152.stdout:5/195: mkdir dd/de/d38/d3d 0 2023-12-07T16:21:31.997 INFO:tasks.workunit.client.1.smithi152.stdout:3/260: creat d7/d10/d41/f4e x:0 0 0 2023-12-07T16:21:31.997 INFO:tasks.workunit.client.1.smithi152.stdout:3/261: write d7/d10/d41/f4e [966579,92089] 0 2023-12-07T16:21:31.997 INFO:tasks.workunit.client.1.smithi152.stdout:3/262: truncate d7/d10/d1a/d2f/f44 923342 0 2023-12-07T16:21:31.998 INFO:tasks.workunit.client.1.smithi152.stdout:6/231: creat d2/d6/d19/f46 x:0 0 0 2023-12-07T16:21:31.998 INFO:tasks.workunit.client.1.smithi152.stdout:5/196: read dd/f1e [1918699,53147] 0 2023-12-07T16:21:31.999 INFO:tasks.workunit.client.1.smithi152.stdout:1/248: symlink dc/d14/d18/d45/l49 0 2023-12-07T16:21:31.999 INFO:tasks.workunit.client.1.smithi152.stdout:8/219: creat d3/d4/d9/d34/f49 x:0 0 0 2023-12-07T16:21:32.001 INFO:tasks.workunit.client.1.smithi152.stdout:2/201: dwrite d2/f29 [0,4194304] 0 2023-12-07T16:21:32.001 INFO:tasks.workunit.client.1.smithi152.stdout:4/229: dread d0/f5 [0,4194304] 0 2023-12-07T16:21:32.001 INFO:tasks.workunit.client.1.smithi152.stdout:6/232: unlink d2/d6/de/c1c 0 2023-12-07T16:21:32.001 INFO:tasks.workunit.client.1.smithi152.stdout:9/310: dwrite d1/d9/f26 [0,4194304] 0 2023-12-07T16:21:32.001 INFO:tasks.workunit.client.1.smithi152.stdout:6/233: write d2/d6/f1a [2696881,50882] 0 2023-12-07T16:21:32.001 INFO:tasks.workunit.client.1.smithi152.stdout:5/197: rmdir dd/de/d17 39 2023-12-07T16:21:32.003 INFO:tasks.workunit.client.1.smithi152.stdout:1/249: mkdir dc/d14/d18/d2d/d4a 0 2023-12-07T16:21:32.006 INFO:tasks.workunit.client.1.smithi152.stdout:8/220: rename d3/d4/d9/le to d3/d1e/d40/l4a 0 2023-12-07T16:21:32.008 INFO:tasks.workunit.client.1.smithi152.stdout:2/202: creat d2/d1c/d2e/d30/d42/f45 x:0 0 0 2023-12-07T16:21:32.009 INFO:tasks.workunit.client.1.smithi152.stdout:9/311: mknod d1/d17/d3c/d4a/c6a 0 2023-12-07T16:21:32.009 INFO:tasks.workunit.client.1.smithi152.stdout:9/312: getdents d1/d9/d67 0 2023-12-07T16:21:32.009 INFO:tasks.workunit.client.1.smithi152.stdout:9/313: chown c0 3823 1 2023-12-07T16:21:32.009 INFO:tasks.workunit.client.1.smithi152.stdout:9/314: chown d1/d9/d2d/d65 624 1 2023-12-07T16:21:32.011 INFO:tasks.workunit.client.1.smithi152.stdout:6/234: unlink d2/d6/d9/f31 0 2023-12-07T16:21:32.012 INFO:tasks.workunit.client.1.smithi152.stdout:9/315: write d1/d9/db/df/f27 [2558762,101655] 0 2023-12-07T16:21:32.012 INFO:tasks.workunit.client.1.smithi152.stdout:5/198: rmdir dd/de/d14/d1f/d28 39 2023-12-07T16:21:32.014 INFO:tasks.workunit.client.1.smithi152.stdout:1/250: getdents dc 0 2023-12-07T16:21:32.016 INFO:tasks.workunit.client.1.smithi152.stdout:3/263: dwrite d7/dc/d14/f3a [0,4194304] 0 2023-12-07T16:21:32.017 INFO:tasks.workunit.client.1.smithi152.stdout:4/230: rename d0/d17/f1c to d0/d3/d6/dc/dd/f40 0 2023-12-07T16:21:32.018 INFO:tasks.workunit.client.1.smithi152.stdout:8/221: mkdir d3/d4/d4b 0 2023-12-07T16:21:32.023 INFO:tasks.workunit.client.1.smithi152.stdout:9/316: creat d1/d17/d4e/f6b x:0 0 0 2023-12-07T16:21:32.023 INFO:tasks.workunit.client.1.smithi152.stdout:9/317: fsync d1/dd/f5c 0 2023-12-07T16:21:32.025 INFO:tasks.workunit.client.1.smithi152.stdout:1/251: unlink dc/d14/l31 0 2023-12-07T16:21:32.026 INFO:tasks.workunit.client.1.smithi152.stdout:5/199: dread dd/de/d14/d1f/f2e [0,4194304] 0 2023-12-07T16:21:32.028 INFO:tasks.workunit.client.1.smithi152.stdout:4/231: rename d0/d17/f30 to d0/d3/d6/dc/d39/f41 0 2023-12-07T16:21:32.028 INFO:tasks.workunit.client.1.smithi152.stdout:8/222: dread d3/d4/d9/f33 [0,4194304] 0 2023-12-07T16:21:32.028 INFO:tasks.workunit.client.1.smithi152.stdout:1/252: symlink dc/d14/d18/d2d/d48/l4b 0 2023-12-07T16:21:32.030 INFO:tasks.workunit.client.1.smithi152.stdout:8/223: getdents d3/d1e 0 2023-12-07T16:21:32.031 INFO:tasks.workunit.client.1.smithi152.stdout:9/318: fsync d1/d9/db/df/f27 0 2023-12-07T16:21:32.033 INFO:tasks.workunit.client.1.smithi152.stdout:1/253: symlink dc/l4c 0 2023-12-07T16:21:32.033 INFO:tasks.workunit.client.1.smithi152.stdout:1/254: chown dc/d28/f38 116588424 1 2023-12-07T16:21:32.034 INFO:tasks.workunit.client.1.smithi152.stdout:3/264: dwrite d7/d10/d1a/d2f/f30 [0,4194304] 0 2023-12-07T16:21:32.034 INFO:tasks.workunit.client.1.smithi152.stdout:3/265: dread - d7/f3d zero size 2023-12-07T16:21:32.034 INFO:tasks.workunit.client.1.smithi152.stdout:3/266: truncate d7/d10/d1a/d2f/f44 948346 0 2023-12-07T16:21:32.035 INFO:tasks.workunit.client.1.smithi152.stdout:2/203: dwrite d2/ff [0,4194304] 0 2023-12-07T16:21:32.038 INFO:tasks.workunit.client.1.smithi152.stdout:9/319: rename d1/d9/d2d/c41 to d1/d17/d3c/c6c 0 2023-12-07T16:21:32.038 INFO:tasks.workunit.client.1.smithi152.stdout:9/320: write d1/d9/db/f36 [1148783,10084] 0 2023-12-07T16:21:32.038 INFO:tasks.workunit.client.1.smithi152.stdout:9/321: read - d1/d9/db/f2c zero size 2023-12-07T16:21:32.045 INFO:tasks.workunit.client.1.smithi152.stdout:5/200: dread dd/de/d14/d1f/f2e [0,4194304] 0 2023-12-07T16:21:32.045 INFO:tasks.workunit.client.1.smithi152.stdout:3/267: symlink d7/d10/d1a/d25/l4f 0 2023-12-07T16:21:32.052 INFO:tasks.workunit.client.1.smithi152.stdout:2/204: creat d2/d1c/d2e/f46 x:0 0 0 2023-12-07T16:21:32.054 INFO:tasks.workunit.client.1.smithi152.stdout:9/322: rename d1/dd/d24/l57 to d1/d9/db/l6d 0 2023-12-07T16:21:32.054 INFO:tasks.workunit.client.1.smithi152.stdout:9/323: chown d1/c7 3039567 1 2023-12-07T16:21:32.054 INFO:tasks.workunit.client.1.smithi152.stdout:9/324: readlink d1/d9/db/l63 0 2023-12-07T16:21:32.054 INFO:tasks.workunit.client.1.smithi152.stdout:5/201: symlink dd/de/d17/l3e 0 2023-12-07T16:21:32.056 INFO:tasks.workunit.client.1.smithi152.stdout:5/202: getdents dd/de 0 2023-12-07T16:21:32.056 INFO:tasks.workunit.client.1.smithi152.stdout:5/203: write dd/f2b [227992,30883] 0 2023-12-07T16:21:32.056 INFO:tasks.workunit.client.1.smithi152.stdout:5/204: write dd/de/d14/d1f/d28/f30 [875196,26876] 0 2023-12-07T16:21:32.057 INFO:tasks.workunit.client.1.smithi152.stdout:9/325: read d1/d9/f35 [2650887,127222] 0 2023-12-07T16:21:32.057 INFO:tasks.workunit.client.1.smithi152.stdout:5/205: creat dd/de/d14/f3f x:0 0 0 2023-12-07T16:21:32.058 INFO:tasks.workunit.client.1.smithi152.stdout:5/206: creat dd/f40 x:0 0 0 2023-12-07T16:21:32.059 INFO:tasks.workunit.client.1.smithi152.stdout:9/326: write d1/d9/f23 [3458125,29956] 0 2023-12-07T16:21:32.060 INFO:tasks.workunit.client.1.smithi152.stdout:5/207: creat dd/de/d38/d3d/f41 x:0 0 0 2023-12-07T16:21:32.063 INFO:tasks.workunit.client.1.smithi152.stdout:9/327: link d1/d9/ca d1/c6e 0 2023-12-07T16:21:32.064 INFO:tasks.workunit.client.1.smithi152.stdout:6/235: getdents d2/d6/d9 0 2023-12-07T16:21:32.066 INFO:tasks.workunit.client.1.smithi152.stdout:6/236: creat d2/d6/d19/d1f/f47 x:0 0 0 2023-12-07T16:21:32.066 INFO:tasks.workunit.client.1.smithi152.stdout:1/255: dwrite dc/de/f22 [0,4194304] 0 2023-12-07T16:21:32.067 INFO:tasks.workunit.client.1.smithi152.stdout:6/237: mkdir d2/d6/d9/d14/d48 0 2023-12-07T16:21:32.067 INFO:tasks.workunit.client.1.smithi152.stdout:6/238: chown d2/d6/d19/d1f/c23 0 1 2023-12-07T16:21:32.067 INFO:tasks.workunit.client.1.smithi152.stdout:6/239: dread - d2/d6/d19/f46 zero size 2023-12-07T16:21:32.067 INFO:tasks.workunit.client.1.smithi152.stdout:6/240: write d2/d6/d19/d1f/f20 [4628253,76170] 0 2023-12-07T16:21:32.068 INFO:tasks.workunit.client.1.smithi152.stdout:6/241: write d2/d6/de/d3f/f40 [3001106,87741] 0 2023-12-07T16:21:32.068 INFO:tasks.workunit.client.1.smithi152.stdout:1/256: creat dc/f4d x:0 0 0 2023-12-07T16:21:32.068 INFO:tasks.workunit.client.1.smithi152.stdout:4/232: dwrite d0/d3/d6/dc/dd/f38 [0,4194304] 0 2023-12-07T16:21:32.069 INFO:tasks.workunit.client.1.smithi152.stdout:8/224: dwrite d3/d4/d9/d23/f25 [0,4194304] 0 2023-12-07T16:21:32.069 INFO:tasks.workunit.client.1.smithi152.stdout:2/205: dread d2/d9/f1b [4194304,4194304] 0 2023-12-07T16:21:32.071 INFO:tasks.workunit.client.1.smithi152.stdout:6/242: rmdir d2/d6/de/d2e 39 2023-12-07T16:21:32.079 INFO:tasks.workunit.client.1.smithi152.stdout:4/233: truncate d0/d3/d6/dc/d3a/f3e 126744 0 2023-12-07T16:21:32.085 INFO:tasks.workunit.client.1.smithi152.stdout:2/206: rename d2/d1c/d26 to d2/d47 0 2023-12-07T16:21:32.086 INFO:tasks.workunit.client.1.smithi152.stdout:6/243: mkdir d2/d6/d19/d1f/d49 0 2023-12-07T16:21:32.086 INFO:tasks.workunit.client.1.smithi152.stdout:6/244: truncate d2/d6/d9/f28 633583 0 2023-12-07T16:21:32.087 INFO:tasks.workunit.client.1.smithi152.stdout:2/207: rmdir d2/d9 39 2023-12-07T16:21:32.087 INFO:tasks.workunit.client.1.smithi152.stdout:2/208: readlink l0 0 2023-12-07T16:21:32.087 INFO:tasks.workunit.client.1.smithi152.stdout:2/209: write d2/d1c/d2e/d30/d42/f43 [518264,65179] 0 2023-12-07T16:21:32.087 INFO:tasks.workunit.client.1.smithi152.stdout:5/208: dwrite dd/de/d14/d1f/d28/f2f [0,4194304] 0 2023-12-07T16:21:32.088 INFO:tasks.workunit.client.1.smithi152.stdout:6/245: link d2/d6/d9/f35 d2/d6/d19/d1f/d49/f4a 0 2023-12-07T16:21:32.088 INFO:tasks.workunit.client.1.smithi152.stdout:6/246: rename d2/d6/d19/d1f to d2/d6/d19/d1f/d4b 22 2023-12-07T16:21:32.088 INFO:tasks.workunit.client.1.smithi152.stdout:6/247: dread - d2/d6/d19/d1f/f47 zero size 2023-12-07T16:21:32.089 INFO:tasks.workunit.client.1.smithi152.stdout:6/248: getdents d2/d6/de/d45 0 2023-12-07T16:21:32.089 INFO:tasks.workunit.client.1.smithi152.stdout:2/210: creat d2/d9/f48 x:0 0 0 2023-12-07T16:21:32.092 INFO:tasks.workunit.client.1.smithi152.stdout:5/209: creat dd/de/d14/f42 x:0 0 0 2023-12-07T16:21:32.092 INFO:tasks.workunit.client.1.smithi152.stdout:5/210: dread - dd/de/d14/f42 zero size 2023-12-07T16:21:32.093 INFO:tasks.workunit.client.1.smithi152.stdout:5/211: write dd/de/f13 [2445492,110444] 0 2023-12-07T16:21:32.094 INFO:tasks.workunit.client.1.smithi152.stdout:7/186: sync 2023-12-07T16:21:32.094 INFO:tasks.workunit.client.1.smithi152.stdout:0/253: sync 2023-12-07T16:21:32.094 INFO:tasks.workunit.client.1.smithi152.stdout:0/254: write d0/d27/f10 [412759,128260] 0 2023-12-07T16:21:32.094 INFO:tasks.workunit.client.1.smithi152.stdout:0/255: readlink d0/l3e 0 2023-12-07T16:21:32.094 INFO:tasks.workunit.client.1.smithi152.stdout:2/211: symlink d2/d47/l49 0 2023-12-07T16:21:32.098 INFO:tasks.workunit.client.1.smithi152.stdout:0/256: truncate d0/f2e 1200231 0 2023-12-07T16:21:32.100 INFO:tasks.workunit.client.1.smithi152.stdout:2/212: rename d2/d9/f11 to d2/d1c/d2e/d30/d42/f4a 0 2023-12-07T16:21:32.100 INFO:tasks.workunit.client.1.smithi152.stdout:2/213: chown d2/d1c/d2e/c31 60314602 1 2023-12-07T16:21:32.101 INFO:tasks.workunit.client.1.smithi152.stdout:4/234: dwrite d0/d3/f2a [0,4194304] 0 2023-12-07T16:21:32.102 INFO:tasks.workunit.client.1.smithi152.stdout:2/214: unlink d2/d47/f2b 0 2023-12-07T16:21:32.102 INFO:tasks.workunit.client.1.smithi152.stdout:9/328: dwrite d1/d9/db/f33 [0,4194304] 0 2023-12-07T16:21:32.106 INFO:tasks.workunit.client.1.smithi152.stdout:5/212: dread dd/de/d14/d1f/f20 [0,4194304] 0 2023-12-07T16:21:32.107 INFO:tasks.workunit.client.1.smithi152.stdout:4/235: creat d0/d3/d6/dc/dd/d34/f42 x:0 0 0 2023-12-07T16:21:32.107 INFO:tasks.workunit.client.1.smithi152.stdout:4/236: chown d0/d3/d6/dc/d39/l3b 58070 1 2023-12-07T16:21:32.107 INFO:tasks.workunit.client.1.smithi152.stdout:4/237: fsync d0/d3/d6/f2e 0 2023-12-07T16:21:32.107 INFO:tasks.workunit.client.1.smithi152.stdout:4/238: write d0/d17/f3f [616161,22379] 0 2023-12-07T16:21:32.107 INFO:tasks.workunit.client.1.smithi152.stdout:4/239: fdatasync d0/d3/d6/f26 0 2023-12-07T16:21:32.108 INFO:tasks.workunit.client.1.smithi152.stdout:6/249: dwrite d2/d6/d9/f28 [0,4194304] 0 2023-12-07T16:21:32.110 INFO:tasks.workunit.client.1.smithi152.stdout:9/329: creat d1/d9/d2d/d65/f6f x:0 0 0 2023-12-07T16:21:32.114 INFO:tasks.workunit.client.1.smithi152.stdout:5/213: unlink dd/de/d14/d19/d1a/d1b/c24 0 2023-12-07T16:21:32.114 INFO:tasks.workunit.client.1.smithi152.stdout:5/214: write dd/de/d14/f3a [680792,117651] 0 2023-12-07T16:21:32.117 INFO:tasks.workunit.client.1.smithi152.stdout:6/250: unlink d2/d6/d19/d1f/d49/f4a 0 2023-12-07T16:21:32.119 INFO:tasks.workunit.client.1.smithi152.stdout:9/330: mkdir d1/d9/db/d70 0 2023-12-07T16:21:32.119 INFO:tasks.workunit.client.1.smithi152.stdout:9/331: chown d1/dd/d24/f4d 836455 1 2023-12-07T16:21:32.120 INFO:tasks.workunit.client.1.smithi152.stdout:5/215: dread dd/de/d14/d19/d1a/f37 [0,4194304] 0 2023-12-07T16:21:32.121 INFO:tasks.workunit.client.1.smithi152.stdout:6/251: mkdir d2/d6/de/d2e/d4c 0 2023-12-07T16:21:32.121 INFO:tasks.workunit.client.1.smithi152.stdout:6/252: fsync d2/f4 0 2023-12-07T16:21:32.121 INFO:tasks.workunit.client.1.smithi152.stdout:6/253: readlink d2/d6/de/d2e/l30 0 2023-12-07T16:21:32.121 INFO:tasks.workunit.client.1.smithi152.stdout:6/254: stat c1 0 2023-12-07T16:21:32.121 INFO:tasks.workunit.client.1.smithi152.stdout:6/255: dread - d2/f2a zero size 2023-12-07T16:21:32.123 INFO:tasks.workunit.client.1.smithi152.stdout:7/187: dwrite db/d1c/f16 [4194304,4194304] 0 2023-12-07T16:21:32.123 INFO:tasks.workunit.client.1.smithi152.stdout:9/332: mknod d1/d9/db/c71 0 2023-12-07T16:21:32.123 INFO:tasks.workunit.client.1.smithi152.stdout:7/188: fdatasync db/d27/f30 0 2023-12-07T16:21:32.123 INFO:tasks.workunit.client.1.smithi152.stdout:9/333: read - d1/d17/d58/f61 zero size 2023-12-07T16:21:32.123 INFO:tasks.workunit.client.1.smithi152.stdout:9/334: fsync d1/d9/db/df/f43 0 2023-12-07T16:21:32.123 INFO:tasks.workunit.client.1.smithi152.stdout:7/189: truncate db/d1e/f2f 4430810 0 2023-12-07T16:21:32.123 INFO:tasks.workunit.client.1.smithi152.stdout:7/190: chown db/f13 10972 1 2023-12-07T16:21:32.123 INFO:tasks.workunit.client.1.smithi152.stdout:2/215: dwrite d2/d1c/d2e/d30/d33/f2d [0,4194304] 0 2023-12-07T16:21:32.123 INFO:tasks.workunit.client.1.smithi152.stdout:2/216: fsync d2/f23 0 2023-12-07T16:21:32.124 INFO:tasks.workunit.client.1.smithi152.stdout:2/217: dread d2/d47/f2a [0,4194304] 0 2023-12-07T16:21:32.125 INFO:tasks.workunit.client.1.smithi152.stdout:5/216: creat dd/de/d38/f43 x:0 0 0 2023-12-07T16:21:32.126 INFO:tasks.workunit.client.1.smithi152.stdout:6/256: creat d2/d6/f4d x:0 0 0 2023-12-07T16:21:32.128 INFO:tasks.workunit.client.1.smithi152.stdout:9/335: mkdir d1/d9/d2d/d72 0 2023-12-07T16:21:32.128 INFO:tasks.workunit.client.1.smithi152.stdout:9/336: readlink d1/d9/db/df/l54 0 2023-12-07T16:21:32.128 INFO:tasks.workunit.client.1.smithi152.stdout:7/191: creat db/d1e/f33 x:0 0 0 2023-12-07T16:21:32.133 INFO:tasks.workunit.client.1.smithi152.stdout:5/217: creat dd/de/d14/d19/d1a/d1b/f44 x:0 0 0 2023-12-07T16:21:32.134 INFO:tasks.workunit.client.1.smithi152.stdout:5/218: chown dd/de/d14/d1f/c1d 136991340 1 2023-12-07T16:21:32.135 INFO:tasks.workunit.client.1.smithi152.stdout:2/218: rename d2/d1c/d2e/d30/d42/f4a to d2/d47/f4b 0 2023-12-07T16:21:32.138 INFO:tasks.workunit.client.1.smithi152.stdout:0/257: truncate d0/d27/f10 146097 0 2023-12-07T16:21:32.139 INFO:tasks.workunit.client.1.smithi152.stdout:7/192: dread db/d1c/f16 [4194304,4194304] 0 2023-12-07T16:21:32.139 INFO:tasks.workunit.client.1.smithi152.stdout:7/193: chown db/d1c/lf 48655 1 2023-12-07T16:21:32.140 INFO:tasks.workunit.client.1.smithi152.stdout:5/219: rename dd/de/l15 to dd/de/d14/d19/d1a/l45 0 2023-12-07T16:21:32.140 INFO:tasks.workunit.client.1.smithi152.stdout:5/220: truncate dd/de/d14/d19/f23 1792153 0 2023-12-07T16:21:32.140 INFO:tasks.workunit.client.1.smithi152.stdout:5/221: fsync dd/de/d14/d1f/d28/f30 0 2023-12-07T16:21:32.142 INFO:tasks.workunit.client.1.smithi152.stdout:0/258: creat d0/dc/d3d/f53 x:0 0 0 2023-12-07T16:21:32.145 INFO:tasks.workunit.client.1.smithi152.stdout:7/194: symlink db/d1c/l34 0 2023-12-07T16:21:32.147 INFO:tasks.workunit.client.1.smithi152.stdout:5/222: rename dd/de/d14/d19/f3c to dd/de/d38/d3d/f46 0 2023-12-07T16:21:32.147 INFO:tasks.workunit.client.1.smithi152.stdout:5/223: chown dd/de/d17/c2c 46388 1 2023-12-07T16:21:32.147 INFO:tasks.workunit.client.1.smithi152.stdout:5/224: truncate dd/de/d38/f43 574406 0 2023-12-07T16:21:32.147 INFO:tasks.workunit.client.1.smithi152.stdout:5/225: fsync dd/f40 0 2023-12-07T16:21:32.149 INFO:tasks.workunit.client.1.smithi152.stdout:9/337: rmdir d1/d9/d67 0 2023-12-07T16:21:32.149 INFO:tasks.workunit.client.1.smithi152.stdout:0/259: mknod d0/dc/c54 0 2023-12-07T16:21:32.151 INFO:tasks.workunit.client.1.smithi152.stdout:9/338: creat d1/d9/d2d/d65/f73 x:0 0 0 2023-12-07T16:21:32.152 INFO:tasks.workunit.client.1.smithi152.stdout:0/260: unlink d0/dc/f21 0 2023-12-07T16:21:32.154 INFO:tasks.workunit.client.1.smithi152.stdout:9/339: write d1/f49 [1211822,34420] 0 2023-12-07T16:21:32.157 INFO:tasks.workunit.client.1.smithi152.stdout:9/340: mkdir d1/d9/d4f/d74 0 2023-12-07T16:21:32.157 INFO:tasks.workunit.client.1.smithi152.stdout:2/219: dwrite d2/d1c/d2e/d38/f3b [0,4194304] 0 2023-12-07T16:21:32.159 INFO:tasks.workunit.client.1.smithi152.stdout:9/341: symlink d1/d17/d4e/d5a/l75 0 2023-12-07T16:21:32.160 INFO:tasks.workunit.client.1.smithi152.stdout:5/226: dread dd/de/f13 [0,4194304] 0 2023-12-07T16:21:32.161 INFO:tasks.workunit.client.1.smithi152.stdout:2/220: symlink d2/d1c/d2e/d30/d42/l4c 0 2023-12-07T16:21:32.161 INFO:tasks.workunit.client.1.smithi152.stdout:2/221: chown d2/d9/lc 230857465 1 2023-12-07T16:21:32.163 INFO:tasks.workunit.client.1.smithi152.stdout:5/227: mknod dd/de/d14/d19/d1a/d1b/c47 0 2023-12-07T16:21:32.163 INFO:tasks.workunit.client.1.smithi152.stdout:5/228: write dd/de/d14/d19/f23 [2796616,2688] 0 2023-12-07T16:21:32.165 INFO:tasks.workunit.client.1.smithi152.stdout:2/222: mknod d2/d1c/d2e/d30/d33/c4d 0 2023-12-07T16:21:32.166 INFO:tasks.workunit.client.1.smithi152.stdout:5/229: creat dd/de/d14/d19/d1a/d1b/f48 x:0 0 0 2023-12-07T16:21:32.166 INFO:tasks.workunit.client.1.smithi152.stdout:5/230: write f8 [2190655,74121] 0 2023-12-07T16:21:32.166 INFO:tasks.workunit.client.1.smithi152.stdout:5/231: readlink dd/de/d14/d19/d1a/l1c 0 2023-12-07T16:21:32.168 INFO:tasks.workunit.client.1.smithi152.stdout:2/223: rename d2/f23 to d2/d9/f4e 0 2023-12-07T16:21:32.170 INFO:tasks.workunit.client.1.smithi152.stdout:5/232: mkdir dd/de/d14/d1f/d49 0 2023-12-07T16:21:32.170 INFO:tasks.workunit.client.1.smithi152.stdout:5/233: dread - dd/de/d14/f42 zero size 2023-12-07T16:21:32.173 INFO:tasks.workunit.client.1.smithi152.stdout:0/261: dwrite d0/f5 [0,4194304] 0 2023-12-07T16:21:32.176 INFO:tasks.workunit.client.1.smithi152.stdout:7/195: dwrite db/d1c/f10 [0,4194304] 0 2023-12-07T16:21:32.177 INFO:tasks.workunit.client.1.smithi152.stdout:9/342: dread d1/d9/f20 [4194304,4194304] 0 2023-12-07T16:21:32.177 INFO:tasks.workunit.client.1.smithi152.stdout:9/343: chown d1/d9/f20 3 1 2023-12-07T16:21:32.178 INFO:tasks.workunit.client.1.smithi152.stdout:0/262: link d0/la d0/d2f/l55 0 2023-12-07T16:21:32.181 INFO:tasks.workunit.client.1.smithi152.stdout:2/224: dread d2/d1c/d2e/d38/f3b [0,4194304] 0 2023-12-07T16:21:32.183 INFO:tasks.workunit.client.1.smithi152.stdout:7/196: rename db/d27/l2e to db/d1e/d23/l35 0 2023-12-07T16:21:32.183 INFO:tasks.workunit.client.1.smithi152.stdout:7/197: readlink db/d1e/d23/l35 0 2023-12-07T16:21:32.183 INFO:tasks.workunit.client.1.smithi152.stdout:7/198: dread - db/d1e/f33 zero size 2023-12-07T16:21:32.184 INFO:tasks.workunit.client.1.smithi152.stdout:9/344: creat d1/f76 x:0 0 0 2023-12-07T16:21:32.185 INFO:tasks.workunit.client.1.smithi152.stdout:5/234: dwrite dd/de/d17/f33 [0,4194304] 0 2023-12-07T16:21:32.187 INFO:tasks.workunit.client.1.smithi152.stdout:2/225: symlink d2/d1c/d2e/d30/d33/l4f 0 2023-12-07T16:21:32.189 INFO:tasks.workunit.client.1.smithi152.stdout:7/199: rename db/d1c/l14 to db/l36 0 2023-12-07T16:21:32.189 INFO:tasks.workunit.client.1.smithi152.stdout:7/200: truncate db/d1e/f22 608919 0 2023-12-07T16:21:32.193 INFO:tasks.workunit.client.1.smithi152.stdout:2/226: symlink d2/d1c/d2e/d30/l50 0 2023-12-07T16:21:32.195 INFO:tasks.workunit.client.1.smithi152.stdout:0/263: dread d0/d27/d11/f40 [0,4194304] 0 2023-12-07T16:21:32.195 INFO:tasks.workunit.client.1.smithi152.stdout:9/345: rename d1/d17/d3c/d4a/l2f to d1/d17/l77 0 2023-12-07T16:21:32.195 INFO:tasks.workunit.client.1.smithi152.stdout:9/346: fdatasync d1/d9/d2d/f40 0 2023-12-07T16:21:32.198 INFO:tasks.workunit.client.1.smithi152.stdout:0/264: link d0/c47 d0/dc/c56 0 2023-12-07T16:21:32.198 INFO:tasks.workunit.client.1.smithi152.stdout:0/265: getdents d0/dc/d36/d3a/d51 0 2023-12-07T16:21:32.198 INFO:tasks.workunit.client.1.smithi152.stdout:0/266: write d0/dc/f22 [1340141,8681] 0 2023-12-07T16:21:32.199 INFO:tasks.workunit.client.1.smithi152.stdout:9/347: unlink d1/d17/d3c/d4a/f47 0 2023-12-07T16:21:32.199 INFO:tasks.workunit.client.1.smithi152.stdout:7/201: dread db/d1c/f16 [0,4194304] 0 2023-12-07T16:21:32.200 INFO:tasks.workunit.client.1.smithi152.stdout:2/227: getdents d2/d1c/d2e/d30/d33 0 2023-12-07T16:21:32.200 INFO:tasks.workunit.client.1.smithi152.stdout:2/228: readlink d2/l12 0 2023-12-07T16:21:32.201 INFO:tasks.workunit.client.1.smithi152.stdout:0/267: getdents d0/d2f/d30 0 2023-12-07T16:21:32.204 INFO:tasks.workunit.client.1.smithi152.stdout:9/348: creat d1/dd/f78 x:0 0 0 2023-12-07T16:21:32.207 INFO:tasks.workunit.client.1.smithi152.stdout:5/235: dwrite dd/de/f32 [0,4194304] 0 2023-12-07T16:21:32.207 INFO:tasks.workunit.client.1.smithi152.stdout:7/202: dread db/f18 [0,4194304] 0 2023-12-07T16:21:32.208 INFO:tasks.workunit.client.1.smithi152.stdout:2/229: mkdir d2/d9/d51 0 2023-12-07T16:21:32.209 INFO:tasks.workunit.client.1.smithi152.stdout:9/349: unlink d1/d17/d4e/f6b 0 2023-12-07T16:21:32.215 INFO:tasks.workunit.client.1.smithi152.stdout:2/230: write d2/d47/f2a [86965,73623] 0 2023-12-07T16:21:32.215 INFO:tasks.workunit.client.1.smithi152.stdout:2/231: truncate d2/f8 4823006 0 2023-12-07T16:21:32.216 INFO:tasks.workunit.client.1.smithi152.stdout:9/350: dread d1/d9/db/f36 [0,4194304] 0 2023-12-07T16:21:32.217 INFO:tasks.workunit.client.1.smithi152.stdout:7/203: truncate db/d27/f30 2389046 0 2023-12-07T16:21:32.217 INFO:tasks.workunit.client.1.smithi152.stdout:7/204: write db/f18 [1713122,92294] 0 2023-12-07T16:21:32.217 INFO:tasks.workunit.client.1.smithi152.stdout:7/205: readlink l3 0 2023-12-07T16:21:32.218 INFO:tasks.workunit.client.1.smithi152.stdout:7/206: fsync db/f13 0 2023-12-07T16:21:32.218 INFO:tasks.workunit.client.1.smithi152.stdout:2/232: mkdir d2/d1c/d52 0 2023-12-07T16:21:32.218 INFO:tasks.workunit.client.1.smithi152.stdout:9/351: getdents d1/d17/d38 0 2023-12-07T16:21:32.221 INFO:tasks.workunit.client.1.smithi152.stdout:7/207: mkdir db/d1e/d23/d37 0 2023-12-07T16:21:32.221 INFO:tasks.workunit.client.1.smithi152.stdout:7/208: write db/d1c/f16 [1843791,35514] 0 2023-12-07T16:21:32.222 INFO:tasks.workunit.client.1.smithi152.stdout:7/209: write db/d1c/f10 [240857,118670] 0 2023-12-07T16:21:32.222 INFO:tasks.workunit.client.1.smithi152.stdout:2/233: mkdir d2/d1c/d2e/d30/d53 0 2023-12-07T16:21:32.223 INFO:tasks.workunit.client.1.smithi152.stdout:9/352: creat d1/d9/db/f79 x:0 0 0 2023-12-07T16:21:32.223 INFO:tasks.workunit.client.1.smithi152.stdout:0/268: dwrite d0/d2f/f3f [0,4194304] 0 2023-12-07T16:21:32.224 INFO:tasks.workunit.client.1.smithi152.stdout:7/210: creat db/d1e/d23/d37/f38 x:0 0 0 2023-12-07T16:21:32.224 INFO:tasks.workunit.client.1.smithi152.stdout:7/211: chown f6 0 1 2023-12-07T16:21:32.225 INFO:tasks.workunit.client.1.smithi152.stdout:2/234: mkdir d2/d9/d51/d54 0 2023-12-07T16:21:32.226 INFO:tasks.workunit.client.1.smithi152.stdout:9/353: stat d1/d9/db/l6d 0 2023-12-07T16:21:32.226 INFO:tasks.workunit.client.1.smithi152.stdout:9/354: write d1/dd/d24/f4d [5837280,11627] 0 2023-12-07T16:21:32.226 INFO:tasks.workunit.client.1.smithi152.stdout:9/355: write d1/f3a [585559,33635] 0 2023-12-07T16:21:32.227 INFO:tasks.workunit.client.1.smithi152.stdout:5/236: dwrite dd/de/d38/d3d/f46 [0,4194304] 0 2023-12-07T16:21:32.229 INFO:tasks.workunit.client.1.smithi152.stdout:0/269: link d0/cb d0/dc/d36/d3a/d51/c57 0 2023-12-07T16:21:32.231 INFO:tasks.workunit.client.1.smithi152.stdout:3/268: sync 2023-12-07T16:21:32.233 INFO:tasks.workunit.client.1.smithi152.stdout:2/235: creat d2/d1c/d2e/d30/d53/f55 x:0 0 0 2023-12-07T16:21:32.233 INFO:tasks.workunit.client.1.smithi152.stdout:2/236: write d2/d1c/d2e/d30/d42/f45 [123197,68225] 0 2023-12-07T16:21:32.235 INFO:tasks.workunit.client.1.smithi152.stdout:5/237: rename dd/de/d14/f3a to dd/de/d14/f4a 0 2023-12-07T16:21:32.237 INFO:tasks.workunit.client.1.smithi152.stdout:0/270: symlink d0/dc/d36/d3a/d51/l58 0 2023-12-07T16:21:32.238 INFO:tasks.workunit.client.1.smithi152.stdout:7/212: rename db/d1e to db/d27/d39 0 2023-12-07T16:21:32.239 INFO:tasks.workunit.client.1.smithi152.stdout:2/237: truncate d2/d9/f13 2543924 0 2023-12-07T16:21:32.241 INFO:tasks.workunit.client.1.smithi152.stdout:5/238: symlink dd/de/l4b 0 2023-12-07T16:21:32.243 INFO:tasks.workunit.client.1.smithi152.stdout:3/269: symlink d7/dc/l50 0 2023-12-07T16:21:32.246 INFO:tasks.workunit.client.1.smithi152.stdout:9/356: rename d1/d9/f25 to d1/d17/d38/d53/f7a 0 2023-12-07T16:21:32.247 INFO:tasks.workunit.client.1.smithi152.stdout:5/239: mknod dd/c4c 0 2023-12-07T16:21:32.247 INFO:tasks.workunit.client.1.smithi152.stdout:5/240: write dd/de/d14/f4a [1458238,93005] 0 2023-12-07T16:21:32.247 INFO:tasks.workunit.client.1.smithi152.stdout:5/241: write dd/de/d14/f42 [468592,91028] 0 2023-12-07T16:21:32.248 INFO:tasks.workunit.client.1.smithi152.stdout:0/271: dread d0/d2f/f4d [0,4194304] 0 2023-12-07T16:21:32.248 INFO:tasks.workunit.client.1.smithi152.stdout:3/270: creat d7/d10/d1a/d25/d3f/f51 x:0 0 0 2023-12-07T16:21:32.248 INFO:tasks.workunit.client.1.smithi152.stdout:3/271: dread - d7/d10/d1a/d25/d3f/f51 zero size 2023-12-07T16:21:32.251 INFO:tasks.workunit.client.1.smithi152.stdout:9/357: rmdir d1/d17/d3c/d4a/d48 39 2023-12-07T16:21:32.251 INFO:tasks.workunit.client.1.smithi152.stdout:2/238: dread d2/d9/f1b [4194304,4194304] 0 2023-12-07T16:21:32.252 INFO:tasks.workunit.client.1.smithi152.stdout:2/239: dread - d2/d47/f39 zero size 2023-12-07T16:21:32.252 INFO:tasks.workunit.client.1.smithi152.stdout:5/242: symlink dd/de/d14/d1f/l4d 0 2023-12-07T16:21:32.252 INFO:tasks.workunit.client.1.smithi152.stdout:0/272: creat d0/d27/f59 x:0 0 0 2023-12-07T16:21:32.253 INFO:tasks.workunit.client.1.smithi152.stdout:0/273: write d0/dc/f34 [916695,60101] 0 2023-12-07T16:21:32.254 INFO:tasks.workunit.client.1.smithi152.stdout:0/274: write d0/dc/f12 [1003378,14518] 0 2023-12-07T16:21:32.254 INFO:tasks.workunit.client.1.smithi152.stdout:0/275: fdatasync d0/d27/f10 0 2023-12-07T16:21:32.254 INFO:tasks.workunit.client.1.smithi152.stdout:0/276: chown d0/dc/d36/d3a/d51/l58 5024491 1 2023-12-07T16:21:32.255 INFO:tasks.workunit.client.1.smithi152.stdout:9/358: symlink d1/d9/db/df/d42/l7b 0 2023-12-07T16:21:32.255 INFO:tasks.workunit.client.1.smithi152.stdout:9/359: readlink d1/d9/d2d/l66 0 2023-12-07T16:21:32.255 INFO:tasks.workunit.client.1.smithi152.stdout:7/213: dwrite f6 [4194304,4194304] 0 2023-12-07T16:21:32.256 INFO:tasks.workunit.client.1.smithi152.stdout:2/240: mkdir d2/d56 0 2023-12-07T16:21:32.256 INFO:tasks.workunit.client.1.smithi152.stdout:2/241: truncate d2/d9/f2f 359042 0 2023-12-07T16:21:32.257 INFO:tasks.workunit.client.1.smithi152.stdout:5/243: symlink dd/de/d38/d3d/l4e 0 2023-12-07T16:21:32.259 INFO:tasks.workunit.client.1.smithi152.stdout:2/242: write d2/ff [3183052,119724] 0 2023-12-07T16:21:32.259 INFO:tasks.workunit.client.1.smithi152.stdout:3/272: link d7/d10/d41/f4e d7/f52 0 2023-12-07T16:21:32.262 INFO:tasks.workunit.client.1.smithi152.stdout:0/277: creat d0/d2f/d30/f5a x:0 0 0 2023-12-07T16:21:32.262 INFO:tasks.workunit.client.1.smithi152.stdout:0/278: fsync d0/d27/f1f 0 2023-12-07T16:21:32.262 INFO:tasks.workunit.client.1.smithi152.stdout:0/279: chown d0/l1d 4 1 2023-12-07T16:21:32.263 INFO:tasks.workunit.client.1.smithi152.stdout:9/360: mknod d1/d9/db/d70/c7c 0 2023-12-07T16:21:32.264 INFO:tasks.workunit.client.1.smithi152.stdout:7/214: rmdir db/d27/d39 39 2023-12-07T16:21:32.264 INFO:tasks.workunit.client.1.smithi152.stdout:2/243: mkdir d2/d1c/d2e/d57 0 2023-12-07T16:21:32.264 INFO:tasks.workunit.client.1.smithi152.stdout:2/244: chown d2/l15 63 1 2023-12-07T16:21:32.265 INFO:tasks.workunit.client.1.smithi152.stdout:2/245: read d2/d1c/f41 [128296,33070] 0 2023-12-07T16:21:32.266 INFO:tasks.workunit.client.1.smithi152.stdout:3/273: link d7/dc/d14/f15 d7/dc/d3e/f53 0 2023-12-07T16:21:32.266 INFO:tasks.workunit.client.1.smithi152.stdout:3/274: read d7/d10/d19/f23 [595961,111128] 0 2023-12-07T16:21:32.270 INFO:tasks.workunit.client.1.smithi152.stdout:7/215: rename db/d27/d39/l25 to db/d27/d39/d23/l3a 0 2023-12-07T16:21:32.272 INFO:tasks.workunit.client.1.smithi152.stdout:2/246: creat d2/d56/f58 x:0 0 0 2023-12-07T16:21:32.272 INFO:tasks.workunit.client.1.smithi152.stdout:2/247: truncate d2/d1c/d2e/d30/d42/f45 193683 0 2023-12-07T16:21:32.273 INFO:tasks.workunit.client.1.smithi152.stdout:7/216: creat db/d27/f3b x:0 0 0 2023-12-07T16:21:32.275 INFO:tasks.workunit.client.1.smithi152.stdout:5/244: dwrite dd/de/d14/d1f/f20 [4194304,4194304] 0 2023-12-07T16:21:32.278 INFO:tasks.workunit.client.1.smithi152.stdout:9/361: dread d1/dd/f5c [0,4194304] 0 2023-12-07T16:21:32.278 INFO:tasks.workunit.client.1.smithi152.stdout:9/362: write d1/d9/d2d/f40 [399302,10971] 0 2023-12-07T16:21:32.278 INFO:tasks.workunit.client.1.smithi152.stdout:2/248: symlink d2/d1c/d2e/d30/d53/l59 0 2023-12-07T16:21:32.278 INFO:tasks.workunit.client.1.smithi152.stdout:2/249: write d2/d1c/d2e/d30/d53/f55 [50642,87185] 0 2023-12-07T16:21:32.283 INFO:tasks.workunit.client.1.smithi152.stdout:7/217: creat db/d27/d39/d23/f3c x:0 0 0 2023-12-07T16:21:32.285 INFO:tasks.workunit.client.1.smithi152.stdout:3/275: dwrite f3 [0,4194304] 0 2023-12-07T16:21:32.285 INFO:tasks.workunit.client.1.smithi152.stdout:9/363: symlink d1/d17/d3c/d4a/l7d 0 2023-12-07T16:21:32.287 INFO:tasks.workunit.client.1.smithi152.stdout:3/276: write d7/d10/d41/f4e [459904,100345] 0 2023-12-07T16:21:32.287 INFO:tasks.workunit.client.1.smithi152.stdout:0/280: dwrite d0/dc/d3d/f53 [0,4194304] 0 2023-12-07T16:21:32.289 INFO:tasks.workunit.client.1.smithi152.stdout:3/277: write d7/dc/f12 [1359600,69860] 0 2023-12-07T16:21:32.291 INFO:tasks.workunit.client.1.smithi152.stdout:0/281: rename d0/dc/f23 to d0/dc/d3d/f5b 0 2023-12-07T16:21:32.291 INFO:tasks.workunit.client.1.smithi152.stdout:0/282: write d0/d27/f2b [54388,1244] 0 2023-12-07T16:21:32.293 INFO:tasks.workunit.client.1.smithi152.stdout:3/278: read d7/dc/f33 [1894,124848] 0 2023-12-07T16:21:32.293 INFO:tasks.workunit.client.1.smithi152.stdout:3/279: readlink d7/d10/d1a/d2f/l2c 0 2023-12-07T16:21:32.293 INFO:tasks.workunit.client.1.smithi152.stdout:3/280: readlink d7/lb 0 2023-12-07T16:21:32.293 INFO:tasks.workunit.client.1.smithi152.stdout:3/281: write d7/f52 [1651755,84235] 0 2023-12-07T16:21:32.294 INFO:tasks.workunit.client.1.smithi152.stdout:0/283: unlink d0/d27/d11/l17 0 2023-12-07T16:21:32.296 INFO:tasks.workunit.client.1.smithi152.stdout:0/284: write d0/dc/f22 [404821,118218] 0 2023-12-07T16:21:32.302 INFO:tasks.workunit.client.1.smithi152.stdout:0/285: write d0/d2f/f3f [1642240,55320] 0 2023-12-07T16:21:32.303 INFO:tasks.workunit.client.1.smithi152.stdout:0/286: symlink d0/dc/l5c 0 2023-12-07T16:21:32.305 INFO:tasks.workunit.client.1.smithi152.stdout:0/287: rename d0/dc/c56 to d0/d27/c5d 0 2023-12-07T16:21:32.305 INFO:tasks.workunit.client.1.smithi152.stdout:0/288: chown d0/f9 40816728 1 2023-12-07T16:21:32.312 INFO:tasks.workunit.client.1.smithi152.stdout:5/245: dwrite fc [0,4194304] 0 2023-12-07T16:21:32.312 INFO:tasks.workunit.client.1.smithi152.stdout:5/246: write dd/f2b [211516,53154] 0 2023-12-07T16:21:32.312 INFO:tasks.workunit.client.1.smithi152.stdout:5/247: readlink dd/l2a 0 2023-12-07T16:21:32.312 INFO:tasks.workunit.client.1.smithi152.stdout:5/248: write dd/de/d14/d19/f25 [525459,94214] 0 2023-12-07T16:21:32.315 INFO:tasks.workunit.client.1.smithi152.stdout:1/257: sync 2023-12-07T16:21:32.315 INFO:tasks.workunit.client.1.smithi152.stdout:4/240: sync 2023-12-07T16:21:32.315 INFO:tasks.workunit.client.1.smithi152.stdout:2/250: dwrite d2/d9/f25 [0,4194304] 0 2023-12-07T16:21:32.315 INFO:tasks.workunit.client.1.smithi152.stdout:2/251: fdatasync d2/d9/f13 0 2023-12-07T16:21:32.316 INFO:tasks.workunit.client.1.smithi152.stdout:7/218: dwrite db/d27/d39/f22 [0,4194304] 0 2023-12-07T16:21:32.317 INFO:tasks.workunit.client.1.smithi152.stdout:5/249: mknod dd/de/d14/c4f 0 2023-12-07T16:21:32.318 INFO:tasks.workunit.client.1.smithi152.stdout:1/258: mkdir dc/d28/d4e 0 2023-12-07T16:21:32.319 INFO:tasks.workunit.client.1.smithi152.stdout:8/225: sync 2023-12-07T16:21:32.319 INFO:tasks.workunit.client.1.smithi152.stdout:4/241: creat d0/d17/f43 x:0 0 0 2023-12-07T16:21:32.319 INFO:tasks.workunit.client.1.smithi152.stdout:4/242: chown d0/d3/d6/dc/dd/f24 270 1 2023-12-07T16:21:32.320 INFO:tasks.workunit.client.1.smithi152.stdout:3/282: dwrite d7/dc/f1b [0,4194304] 0 2023-12-07T16:21:32.321 INFO:tasks.workunit.client.1.smithi152.stdout:2/252: creat d2/f5a x:0 0 0 2023-12-07T16:21:32.321 INFO:tasks.workunit.client.1.smithi152.stdout:2/253: truncate d2/d9/f13 3429035 0 2023-12-07T16:21:32.323 INFO:tasks.workunit.client.1.smithi152.stdout:9/364: dwrite d1/d9/f12 [0,4194304] 0 2023-12-07T16:21:32.323 INFO:tasks.workunit.client.1.smithi152.stdout:7/219: rename db/d27/f30 to db/d27/f3d 0 2023-12-07T16:21:32.324 INFO:tasks.workunit.client.1.smithi152.stdout:5/250: getdents dd 0 2023-12-07T16:21:32.327 INFO:tasks.workunit.client.1.smithi152.stdout:1/259: symlink dc/d14/l4f 0 2023-12-07T16:21:32.327 INFO:tasks.workunit.client.1.smithi152.stdout:3/283: creat d7/d10/d1a/d2f/f54 x:0 0 0 2023-12-07T16:21:32.327 INFO:tasks.workunit.client.1.smithi152.stdout:3/284: chown d7/dc/l50 12 1 2023-12-07T16:21:32.329 INFO:tasks.workunit.client.1.smithi152.stdout:8/226: dread d3/d1e/f30 [4194304,4194304] 0 2023-12-07T16:21:32.329 INFO:tasks.workunit.client.1.smithi152.stdout:9/365: mkdir d1/d17/d3c/d4a/d7e 0 2023-12-07T16:21:32.330 INFO:tasks.workunit.client.1.smithi152.stdout:9/366: write d1/d9/d2d/d65/f6f [91076,125496] 0 2023-12-07T16:21:32.331 INFO:tasks.workunit.client.1.smithi152.stdout:7/220: mkdir db/d27/d39/d3e 0 2023-12-07T16:21:32.331 INFO:tasks.workunit.client.1.smithi152.stdout:7/221: chown db/d1c/c1a 163168159 1 2023-12-07T16:21:32.331 INFO:tasks.workunit.client.1.smithi152.stdout:7/222: chown db/fe 61620 1 2023-12-07T16:21:32.331 INFO:tasks.workunit.client.1.smithi152.stdout:7/223: write db/d27/d39/d23/f3c [982525,73412] 0 2023-12-07T16:21:32.332 INFO:tasks.workunit.client.1.smithi152.stdout:7/224: readlink db/l12 0 2023-12-07T16:21:32.335 INFO:tasks.workunit.client.1.smithi152.stdout:5/251: unlink l7 0 2023-12-07T16:21:32.335 INFO:tasks.workunit.client.1.smithi152.stdout:6/257: sync 2023-12-07T16:21:32.336 INFO:tasks.workunit.client.1.smithi152.stdout:1/260: mkdir dc/d14/d18/d2d/d50 0 2023-12-07T16:21:32.336 INFO:tasks.workunit.client.1.smithi152.stdout:1/261: chown dc/d28/d4e 491652 1 2023-12-07T16:21:32.338 INFO:tasks.workunit.client.1.smithi152.stdout:3/285: rename d7/lb to d7/dc/d3e/d48/l55 0 2023-12-07T16:21:32.342 INFO:tasks.workunit.client.1.smithi152.stdout:4/243: dwrite d0/d3/f37 [0,4194304] 0 2023-12-07T16:21:32.344 INFO:tasks.workunit.client.1.smithi152.stdout:8/227: mkdir d3/d4/d9/d23/d4c 0 2023-12-07T16:21:32.349 INFO:tasks.workunit.client.1.smithi152.stdout:5/252: symlink dd/l50 0 2023-12-07T16:21:32.349 INFO:tasks.workunit.client.1.smithi152.stdout:6/258: creat d2/d6/de/d2e/f4e x:0 0 0 2023-12-07T16:21:32.349 INFO:tasks.workunit.client.1.smithi152.stdout:6/259: dread - d2/d6/d19/f46 zero size 2023-12-07T16:21:32.349 INFO:tasks.workunit.client.1.smithi152.stdout:6/260: write d2/d6/de/d2e/f41 [151600,17431] 0 2023-12-07T16:21:32.352 INFO:tasks.workunit.client.1.smithi152.stdout:8/228: creat d3/d4/d9/dc/f4d x:0 0 0 2023-12-07T16:21:32.352 INFO:tasks.workunit.client.1.smithi152.stdout:8/229: chown d3/d4/d9/d23/f25 3 1 2023-12-07T16:21:32.352 INFO:tasks.workunit.client.1.smithi152.stdout:8/230: fdatasync d3/d4/d9/dc/f4d 0 2023-12-07T16:21:32.353 INFO:tasks.workunit.client.1.smithi152.stdout:5/253: symlink dd/de/d38/l51 0 2023-12-07T16:21:32.354 INFO:tasks.workunit.client.1.smithi152.stdout:3/286: mkdir d7/d10/d1a/d2f/d56 0 2023-12-07T16:21:32.355 INFO:tasks.workunit.client.1.smithi152.stdout:5/254: creat dd/de/d17/f52 x:0 0 0 2023-12-07T16:21:32.356 INFO:tasks.workunit.client.1.smithi152.stdout:8/231: write d3/d4/f35 [146503,76744] 0 2023-12-07T16:21:32.356 INFO:tasks.workunit.client.1.smithi152.stdout:3/287: mkdir d7/d10/d1a/d2f/d56/d57 0 2023-12-07T16:21:32.357 INFO:tasks.workunit.client.1.smithi152.stdout:5/255: truncate dd/de/f31 185391 0 2023-12-07T16:21:32.358 INFO:tasks.workunit.client.1.smithi152.stdout:7/225: dwrite db/d27/f31 [0,4194304] 0 2023-12-07T16:21:32.361 INFO:tasks.workunit.client.1.smithi152.stdout:8/232: mknod d3/d4/d4b/c4e 0 2023-12-07T16:21:32.362 INFO:tasks.workunit.client.1.smithi152.stdout:3/288: getdents d7/dc 0 2023-12-07T16:21:32.363 INFO:tasks.workunit.client.1.smithi152.stdout:5/256: symlink dd/de/d14/l53 0 2023-12-07T16:21:32.365 INFO:tasks.workunit.client.1.smithi152.stdout:8/233: creat d3/d4/d4b/f4f x:0 0 0 2023-12-07T16:21:32.365 INFO:tasks.workunit.client.1.smithi152.stdout:8/234: readlink d3/d1e/d40/l4a 0 2023-12-07T16:21:32.366 INFO:tasks.workunit.client.1.smithi152.stdout:5/257: mkdir dd/de/d17/d54 0 2023-12-07T16:21:32.366 INFO:tasks.workunit.client.1.smithi152.stdout:5/258: readlink dd/de/d14/d19/d1a/l35 0 2023-12-07T16:21:32.366 INFO:tasks.workunit.client.1.smithi152.stdout:5/259: read - dd/de/d17/f52 zero size 2023-12-07T16:21:32.367 INFO:tasks.workunit.client.1.smithi152.stdout:5/260: creat dd/de/d14/d19/d1a/f55 x:0 0 0 2023-12-07T16:21:32.367 INFO:tasks.workunit.client.1.smithi152.stdout:5/261: dread - dd/de/d14/d19/d1a/f55 zero size 2023-12-07T16:21:32.369 INFO:tasks.workunit.client.1.smithi152.stdout:5/262: symlink dd/de/d14/d1f/l56 0 2023-12-07T16:21:32.371 INFO:tasks.workunit.client.1.smithi152.stdout:5/263: link dd/de/d14/d1f/d28/f30 dd/de/d14/d1f/f57 0 2023-12-07T16:21:32.375 INFO:tasks.workunit.client.1.smithi152.stdout:5/264: write dd/de/d14/d1f/d28/f2d [1131582,18609] 0 2023-12-07T16:21:32.375 INFO:tasks.workunit.client.1.smithi152.stdout:5/265: write dd/de/d14/d1f/f2e [5302410,117449] 0 2023-12-07T16:21:32.375 INFO:tasks.workunit.client.1.smithi152.stdout:5/266: write dd/de/d14/d1f/f2e [4512285,7460] 0 2023-12-07T16:21:32.375 INFO:tasks.workunit.client.1.smithi152.stdout:5/267: getdents dd/de/d17/d54 0 2023-12-07T16:21:32.376 INFO:tasks.workunit.client.1.smithi152.stdout:5/268: dread - dd/de/d38/d3d/f41 zero size 2023-12-07T16:21:32.376 INFO:tasks.workunit.client.1.smithi152.stdout:5/269: dread dd/de/d38/f43 [0,4194304] 0 2023-12-07T16:21:32.380 INFO:tasks.workunit.client.1.smithi152.stdout:5/270: rmdir dd/de/d14/d1f/d28 39 2023-12-07T16:21:32.380 INFO:tasks.workunit.client.1.smithi152.stdout:5/271: fdatasync dd/de/d14/d1f/f20 0 2023-12-07T16:21:32.382 INFO:tasks.workunit.client.1.smithi152.stdout:5/272: rename dd/de/d17/c2c to dd/de/d14/d1f/d28/c58 0 2023-12-07T16:21:32.402 INFO:tasks.workunit.client.1.smithi152.stdout:9/367: dwrite d1/f31 [0,4194304] 0 2023-12-07T16:21:32.403 INFO:tasks.workunit.client.1.smithi152.stdout:9/368: link d1/d17/d3c/d4a/d48/f52 d1/d17/d58/f7f 0 2023-12-07T16:21:32.403 INFO:tasks.workunit.client.1.smithi152.stdout:9/369: readlink d1/d9/d2d/l44 0 2023-12-07T16:21:32.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:32 smithi063 ceph-mon[112095]: pgmap v23: 65 pgs: 65 active+clean; 311 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 5.1 MiB/s rd, 13 MiB/s wr, 453 op/s 2023-12-07T16:21:32.407 INFO:tasks.workunit.client.1.smithi152.stdout:4/244: dwrite d0/d17/f3f [0,4194304] 0 2023-12-07T16:21:32.407 INFO:tasks.workunit.client.1.smithi152.stdout:1/262: dwrite dc/d14/f2b [0,4194304] 0 2023-12-07T16:21:32.407 INFO:tasks.workunit.client.1.smithi152.stdout:2/254: dwrite d2/d1c/d2e/d30/f3c [4194304,4194304] 0 2023-12-07T16:21:32.408 INFO:tasks.workunit.client.1.smithi152.stdout:6/261: dwrite d2/f3 [4194304,4194304] 0 2023-12-07T16:21:32.409 INFO:tasks.workunit.client.1.smithi152.stdout:9/370: dread d1/f5 [0,4194304] 0 2023-12-07T16:21:32.410 INFO:tasks.workunit.client.1.smithi152.stdout:8/235: dwrite d3/d4/d9/d34/f49 [0,4194304] 0 2023-12-07T16:21:32.410 INFO:tasks.workunit.client.1.smithi152.stdout:3/289: dwrite d7/dc/f2a [0,4194304] 0 2023-12-07T16:21:32.417 INFO:tasks.workunit.client.1.smithi152.stdout:6/262: mkdir d2/d4f 0 2023-12-07T16:21:32.420 INFO:tasks.workunit.client.1.smithi152.stdout:9/371: mkdir d1/d9/d2d/d72/d80 0 2023-12-07T16:21:32.420 INFO:tasks.workunit.client.1.smithi152.stdout:9/372: write d1/d17/d3c/f5f [54741,72329] 0 2023-12-07T16:21:32.429 INFO:tasks.workunit.client.1.smithi152.stdout:6/263: dread d2/d6/f34 [0,4194304] 0 2023-12-07T16:21:32.431 INFO:tasks.workunit.client.1.smithi152.stdout:9/373: creat d1/d17/d3c/d4a/d48/f81 x:0 0 0 2023-12-07T16:21:32.433 INFO:tasks.workunit.client.1.smithi152.stdout:9/374: mknod d1/d17/c82 0 2023-12-07T16:21:32.433 INFO:tasks.workunit.client.1.smithi152.stdout:9/375: truncate d1/d17/d58/f61 879926 0 2023-12-07T16:21:32.433 INFO:tasks.workunit.client.1.smithi152.stdout:9/376: chown d1/d9/d4f/d74 403331778 1 2023-12-07T16:21:32.435 INFO:tasks.workunit.client.1.smithi152.stdout:2/255: write d2/d47/f2a [5515,60040] 0 2023-12-07T16:21:32.439 INFO:tasks.workunit.client.1.smithi152.stdout:2/256: mkdir d2/d1c/d2e/d57/d5b 0 2023-12-07T16:21:32.443 INFO:tasks.workunit.client.1.smithi152.stdout:2/257: mkdir d2/d9/d51/d54/d5c 0 2023-12-07T16:21:32.443 INFO:tasks.workunit.client.1.smithi152.stdout:2/258: dread - d2/d56/f58 zero size 2023-12-07T16:21:32.450 INFO:tasks.workunit.client.1.smithi152.stdout:8/236: dwrite d3/d1e/f44 [0,4194304] 0 2023-12-07T16:21:32.451 INFO:tasks.workunit.client.1.smithi152.stdout:4/245: dwrite d0/d3/d6/dc/dd/d34/f42 [0,4194304] 0 2023-12-07T16:21:32.452 INFO:tasks.workunit.client.1.smithi152.stdout:8/237: rmdir d3/d4/d9/dc/d1f 39 2023-12-07T16:21:32.454 INFO:tasks.workunit.client.1.smithi152.stdout:2/259: dread d2/d1c/d2e/d30/d33/f2d [0,4194304] 0 2023-12-07T16:21:32.455 INFO:tasks.workunit.client.1.smithi152.stdout:1/263: dwrite dc/f40 [0,4194304] 0 2023-12-07T16:21:32.456 INFO:tasks.workunit.client.1.smithi152.stdout:4/246: creat d0/d3/d6/d36/f44 x:0 0 0 2023-12-07T16:21:32.456 INFO:tasks.workunit.client.1.smithi152.stdout:4/247: chown d0/d3/d6/dc/dd/f38 486181695 1 2023-12-07T16:21:32.456 INFO:tasks.workunit.client.1.smithi152.stdout:8/238: symlink d3/d4/d9/dc/l50 0 2023-12-07T16:21:32.457 INFO:tasks.workunit.client.1.smithi152.stdout:4/248: dread d0/d3/d6/f1d [0,4194304] 0 2023-12-07T16:21:32.461 INFO:tasks.workunit.client.1.smithi152.stdout:8/239: rename d3/d4/c22 to d3/d1e/d43/c51 0 2023-12-07T16:21:32.463 INFO:tasks.workunit.client.1.smithi152.stdout:8/240: symlink d3/d4/l52 0 2023-12-07T16:21:32.465 INFO:tasks.workunit.client.1.smithi152.stdout:2/260: dread d2/d9/f25 [0,4194304] 0 2023-12-07T16:21:32.473 INFO:tasks.workunit.client.1.smithi152.stdout:2/261: read d2/d1c/d2e/d38/f3b [1501790,118449] 0 2023-12-07T16:21:32.473 INFO:tasks.workunit.client.1.smithi152.stdout:6/264: dwrite d2/f3 [4194304,4194304] 0 2023-12-07T16:21:32.473 INFO:tasks.workunit.client.1.smithi152.stdout:6/265: write d2/d6/d19/d1f/f47 [132557,12414] 0 2023-12-07T16:21:32.474 INFO:tasks.workunit.client.1.smithi152.stdout:2/262: mkdir d2/d1c/d2e/d5d 0 2023-12-07T16:21:32.476 INFO:tasks.workunit.client.1.smithi152.stdout:5/273: dwrite dd/de/f13 [4194304,4194304] 0 2023-12-07T16:21:32.476 INFO:tasks.workunit.client.1.smithi152.stdout:6/266: dread d2/d6/f1a [0,4194304] 0 2023-12-07T16:21:32.477 INFO:tasks.workunit.client.1.smithi152.stdout:2/263: mknod d2/d1c/d2e/d57/c5e 0 2023-12-07T16:21:32.477 INFO:tasks.workunit.client.1.smithi152.stdout:2/264: truncate d2/d9/f4e 4909747 0 2023-12-07T16:21:32.479 INFO:tasks.workunit.client.1.smithi152.stdout:8/241: dread d3/d4/d9/dc/d1f/f28 [0,4194304] 0 2023-12-07T16:21:32.479 INFO:tasks.workunit.client.1.smithi152.stdout:8/242: readlink d3/d4/d9/d34/l3b 0 2023-12-07T16:21:32.480 INFO:tasks.workunit.client.1.smithi152.stdout:5/274: rename dd/de/d14/d19/d1a/l35 to dd/l59 0 2023-12-07T16:21:32.480 INFO:tasks.workunit.client.1.smithi152.stdout:2/265: dread d2/d1c/d2e/f44 [0,4194304] 0 2023-12-07T16:21:32.481 INFO:tasks.workunit.client.1.smithi152.stdout:8/243: mknod d3/d4/d9/d34/c53 0 2023-12-07T16:21:32.481 INFO:tasks.workunit.client.1.smithi152.stdout:8/244: readlink d3/l3d 0 2023-12-07T16:21:32.483 INFO:tasks.workunit.client.1.smithi152.stdout:5/275: creat dd/f5a x:0 0 0 2023-12-07T16:21:32.483 INFO:tasks.workunit.client.1.smithi152.stdout:5/276: write dd/de/d14/d19/d1a/f37 [618348,13792] 0 2023-12-07T16:21:32.483 INFO:tasks.workunit.client.1.smithi152.stdout:5/277: getdents dd/de/d17/d54 0 2023-12-07T16:21:32.483 INFO:tasks.workunit.client.1.smithi152.stdout:8/245: mknod d3/d1e/d40/c54 0 2023-12-07T16:21:32.484 INFO:tasks.workunit.client.1.smithi152.stdout:5/278: creat dd/de/d17/f5b x:0 0 0 2023-12-07T16:21:32.485 INFO:tasks.workunit.client.1.smithi152.stdout:8/246: mkdir d3/d1e/d55 0 2023-12-07T16:21:32.486 INFO:tasks.workunit.client.1.smithi152.stdout:5/279: dread dd/f2b [0,4194304] 0 2023-12-07T16:21:32.486 INFO:tasks.workunit.client.1.smithi152.stdout:5/280: chown fc 4296 1 2023-12-07T16:21:32.486 INFO:tasks.workunit.client.1.smithi152.stdout:5/281: stat dd/de/d38/d3d/f46 0 2023-12-07T16:21:32.486 INFO:tasks.workunit.client.1.smithi152.stdout:8/247: write d3/d4/d9/f1c [2304610,24490] 0 2023-12-07T16:21:32.491 INFO:tasks.workunit.client.1.smithi152.stdout:1/264: dwrite dc/f4d [0,4194304] 0 2023-12-07T16:21:32.492 INFO:tasks.workunit.client.1.smithi152.stdout:4/249: dwrite d0/d3/f2d [0,4194304] 0 2023-12-07T16:21:32.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:32 smithi152 ceph-mon[121113]: pgmap v23: 65 pgs: 65 active+clean; 311 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 5.1 MiB/s rd, 13 MiB/s wr, 453 op/s 2023-12-07T16:21:32.493 INFO:tasks.workunit.client.1.smithi152.stdout:4/250: chown d0/d3/d6/l31 58760 1 2023-12-07T16:21:32.493 INFO:tasks.workunit.client.1.smithi152.stdout:0/289: sync 2023-12-07T16:21:32.495 INFO:tasks.workunit.client.1.smithi152.stdout:1/265: creat dc/d28/d4e/f51 x:0 0 0 2023-12-07T16:21:32.497 INFO:tasks.workunit.client.1.smithi152.stdout:0/290: read d0/d27/ff [1675998,114743] 0 2023-12-07T16:21:32.497 INFO:tasks.workunit.client.1.smithi152.stdout:4/251: symlink d0/d3/d6/dc/l45 0 2023-12-07T16:21:32.497 INFO:tasks.workunit.client.1.smithi152.stdout:0/291: fdatasync d0/dc/d26/f41 0 2023-12-07T16:21:32.497 INFO:tasks.workunit.client.1.smithi152.stdout:4/252: stat d0/d3/d6/d36/f44 0 2023-12-07T16:21:32.499 INFO:tasks.workunit.client.1.smithi152.stdout:0/292: symlink d0/dc/d3d/d4c/l5e 0 2023-12-07T16:21:32.499 INFO:tasks.workunit.client.1.smithi152.stdout:0/293: chown d0/dc/d36/d3a/f4f 359597576 1 2023-12-07T16:21:32.505 INFO:tasks.workunit.client.1.smithi152.stdout:6/267: dwrite d2/d6/d9/f35 [0,4194304] 0 2023-12-07T16:21:32.506 INFO:tasks.workunit.client.1.smithi152.stdout:5/282: dwrite dd/de/d17/f5b [0,4194304] 0 2023-12-07T16:21:32.507 INFO:tasks.workunit.client.1.smithi152.stdout:6/268: getdents d2/d6/d19/d1f/d49 0 2023-12-07T16:21:32.507 INFO:tasks.workunit.client.1.smithi152.stdout:1/266: dread f9 [0,4194304] 0 2023-12-07T16:21:32.511 INFO:tasks.workunit.client.1.smithi152.stdout:5/283: rename dd/de/d14/d1f/l4d to dd/l5c 0 2023-12-07T16:21:32.512 INFO:tasks.workunit.client.1.smithi152.stdout:5/284: fdatasync dd/de/d17/f5b 0 2023-12-07T16:21:32.514 INFO:tasks.workunit.client.1.smithi152.stdout:1/267: dread dc/d28/f38 [0,4194304] 0 2023-12-07T16:21:32.515 INFO:tasks.workunit.client.1.smithi152.stdout:6/269: creat d2/d6/de/d2e/d38/f50 x:0 0 0 2023-12-07T16:21:32.515 INFO:tasks.workunit.client.1.smithi152.stdout:5/285: symlink dd/de/d17/d54/l5d 0 2023-12-07T16:21:32.516 INFO:tasks.workunit.client.1.smithi152.stdout:4/253: getdents d0/d3/d6/dc 0 2023-12-07T16:21:32.519 INFO:tasks.workunit.client.1.smithi152.stdout:5/286: symlink dd/de/d17/d54/l5e 0 2023-12-07T16:21:32.523 INFO:tasks.workunit.client.1.smithi152.stdout:5/287: dread dd/de/d14/d19/f25 [0,4194304] 0 2023-12-07T16:21:32.529 INFO:tasks.workunit.client.1.smithi152.stdout:0/294: dwrite d0/d27/f59 [0,4194304] 0 2023-12-07T16:21:32.529 INFO:tasks.workunit.client.1.smithi152.stdout:0/295: write d0/dc/f34 [1378426,352] 0 2023-12-07T16:21:32.532 INFO:tasks.workunit.client.1.smithi152.stdout:6/270: rmdir d2/d6/de/d2e 39 2023-12-07T16:21:32.534 INFO:tasks.workunit.client.1.smithi152.stdout:6/271: symlink d2/d6/d19/l51 0 2023-12-07T16:21:32.535 INFO:tasks.workunit.client.1.smithi152.stdout:6/272: link d2/d6/d19/d1f/c23 d2/d6/de/d2e/d4c/c52 0 2023-12-07T16:21:32.535 INFO:tasks.workunit.client.1.smithi152.stdout:6/273: read d2/d6/d19/d1f/f37 [139047,51878] 0 2023-12-07T16:21:32.546 INFO:tasks.workunit.client.1.smithi152.stdout:0/296: dread d0/d27/ff [0,4194304] 0 2023-12-07T16:21:32.546 INFO:tasks.workunit.client.1.smithi152.stdout:4/254: dwrite d0/d3/f7 [0,4194304] 0 2023-12-07T16:21:32.546 INFO:tasks.workunit.client.1.smithi152.stdout:1/268: dwrite dc/d14/d18/f2c [0,4194304] 0 2023-12-07T16:21:32.547 INFO:tasks.workunit.client.1.smithi152.stdout:1/269: readlink dc/d14/d18/l3c 0 2023-12-07T16:21:32.547 INFO:tasks.workunit.client.1.smithi152.stdout:5/288: dwrite dd/f5a [0,4194304] 0 2023-12-07T16:21:32.551 INFO:tasks.workunit.client.1.smithi152.stdout:1/270: mkdir dc/d14/d18/d2d/d4a/d52 0 2023-12-07T16:21:32.554 INFO:tasks.workunit.client.1.smithi152.stdout:0/297: dread d0/f38 [4194304,4194304] 0 2023-12-07T16:21:32.555 INFO:tasks.workunit.client.1.smithi152.stdout:0/298: mknod d0/dc/d26/c5f 0 2023-12-07T16:21:32.555 INFO:tasks.workunit.client.1.smithi152.stdout:0/299: dread - d0/d2f/d30/f4a zero size 2023-12-07T16:21:32.556 INFO:tasks.workunit.client.1.smithi152.stdout:7/226: sync 2023-12-07T16:21:32.557 INFO:tasks.workunit.client.1.smithi152.stdout:6/274: dwrite d2/f5 [0,4194304] 0 2023-12-07T16:21:32.562 INFO:tasks.workunit.client.1.smithi152.stdout:7/227: rename db/d27/d39/f32 to db/d27/d39/d23/d37/f3f 0 2023-12-07T16:21:32.564 INFO:tasks.workunit.client.1.smithi152.stdout:1/271: rmdir dc 39 2023-12-07T16:21:32.567 INFO:tasks.workunit.client.1.smithi152.stdout:6/275: link d2/d6/d19/d1f/f20 d2/d6/d9/d14/d48/f53 0 2023-12-07T16:21:32.568 INFO:tasks.workunit.client.1.smithi152.stdout:7/228: mknod db/c40 0 2023-12-07T16:21:32.568 INFO:tasks.workunit.client.1.smithi152.stdout:7/229: dread - db/d27/f3b zero size 2023-12-07T16:21:32.568 INFO:tasks.workunit.client.1.smithi152.stdout:7/230: chown db/d1c/c1a 15686297 1 2023-12-07T16:21:32.568 INFO:tasks.workunit.client.1.smithi152.stdout:7/231: chown db/d1c 72131984 1 2023-12-07T16:21:32.568 INFO:tasks.workunit.client.1.smithi152.stdout:7/232: truncate db/d27/d39/f33 783939 0 2023-12-07T16:21:32.569 INFO:tasks.workunit.client.1.smithi152.stdout:1/272: creat dc/d28/f53 x:0 0 0 2023-12-07T16:21:32.569 INFO:tasks.workunit.client.1.smithi152.stdout:1/273: write dc/d28/f39 [4367840,62789] 0 2023-12-07T16:21:32.571 INFO:tasks.workunit.client.1.smithi152.stdout:1/274: rename dc/de/f41 to dc/d14/d18/d2d/f54 0 2023-12-07T16:21:32.575 INFO:tasks.workunit.client.1.smithi152.stdout:1/275: read dc/f13 [1856053,100556] 0 2023-12-07T16:21:32.577 INFO:tasks.workunit.client.1.smithi152.stdout:6/276: dread d2/f5 [4194304,4194304] 0 2023-12-07T16:21:32.577 INFO:tasks.workunit.client.1.smithi152.stdout:1/276: creat dc/d28/f55 x:0 0 0 2023-12-07T16:21:32.577 INFO:tasks.workunit.client.1.smithi152.stdout:1/277: stat f4 0 2023-12-07T16:21:32.577 INFO:tasks.workunit.client.1.smithi152.stdout:1/278: fdatasync dc/d14/d18/d2d/f54 0 2023-12-07T16:21:32.578 INFO:tasks.workunit.client.1.smithi152.stdout:1/279: rmdir dc/d28/d4e 39 2023-12-07T16:21:32.580 INFO:tasks.workunit.client.1.smithi152.stdout:5/289: dwrite dd/de/d38/d3d/f46 [0,4194304] 0 2023-12-07T16:21:32.580 INFO:tasks.workunit.client.1.smithi152.stdout:4/255: dwrite d0/d3/f3c [0,4194304] 0 2023-12-07T16:21:32.581 INFO:tasks.workunit.client.1.smithi152.stdout:4/256: fdatasync d0/d3/d6/dc/dd/f40 0 2023-12-07T16:21:32.581 INFO:tasks.workunit.client.1.smithi152.stdout:1/280: rename dc/d14/d18/l1a to dc/d14/d18/d45/l56 0 2023-12-07T16:21:32.581 INFO:tasks.workunit.client.1.smithi152.stdout:1/281: chown dc/fd 1220378 1 2023-12-07T16:21:32.581 INFO:tasks.workunit.client.1.smithi152.stdout:1/282: read f4 [1937996,41748] 0 2023-12-07T16:21:32.581 INFO:tasks.workunit.client.1.smithi152.stdout:1/283: write dc/de/f2e [660008,78077] 0 2023-12-07T16:21:32.581 INFO:tasks.workunit.client.1.smithi152.stdout:0/300: dwrite d0/f5 [4194304,4194304] 0 2023-12-07T16:21:32.582 INFO:tasks.workunit.client.1.smithi152.stdout:7/233: rename db/d27/d39/d23 to db/d27/d39/d41 0 2023-12-07T16:21:32.583 INFO:tasks.workunit.client.1.smithi152.stdout:5/290: write dd/f5a [164068,108179] 0 2023-12-07T16:21:32.584 INFO:tasks.workunit.client.1.smithi152.stdout:4/257: mkdir d0/d3/d6/dc/d3a/d46 0 2023-12-07T16:21:32.586 INFO:tasks.workunit.client.1.smithi152.stdout:1/284: mknod dc/d28/c57 0 2023-12-07T16:21:32.586 INFO:tasks.workunit.client.1.smithi152.stdout:1/285: readlink dc/d14/d18/d2d/l46 0 2023-12-07T16:21:32.586 INFO:tasks.workunit.client.1.smithi152.stdout:1/286: read dc/d14/f2b [549358,93781] 0 2023-12-07T16:21:32.587 INFO:tasks.workunit.client.1.smithi152.stdout:0/301: truncate d0/f9 2246461 0 2023-12-07T16:21:32.591 INFO:tasks.workunit.client.1.smithi152.stdout:5/291: creat dd/de/d14/d1f/d49/f5f x:0 0 0 2023-12-07T16:21:32.592 INFO:tasks.workunit.client.1.smithi152.stdout:4/258: creat d0/d3/d6/dc/dd/d34/f47 x:0 0 0 2023-12-07T16:21:32.593 INFO:tasks.workunit.client.1.smithi152.stdout:4/259: fsync d0/d3/d6/dc/dd/f38 0 2023-12-07T16:21:32.593 INFO:tasks.workunit.client.1.smithi152.stdout:4/260: write d0/d3/d6/f27 [124302,80386] 0 2023-12-07T16:21:32.594 INFO:tasks.workunit.client.1.smithi152.stdout:1/287: truncate dc/f2a 937518 0 2023-12-07T16:21:32.596 INFO:tasks.workunit.client.1.smithi152.stdout:0/302: creat d0/dc/d3d/d4c/f60 x:0 0 0 2023-12-07T16:21:32.599 INFO:tasks.workunit.client.1.smithi152.stdout:1/288: mkdir dc/de/d58 0 2023-12-07T16:21:32.599 INFO:tasks.workunit.client.1.smithi152.stdout:1/289: fsync f4 0 2023-12-07T16:21:32.601 INFO:tasks.workunit.client.1.smithi152.stdout:0/303: creat d0/dc/d36/d3a/d51/f61 x:0 0 0 2023-12-07T16:21:32.602 INFO:tasks.workunit.client.1.smithi152.stdout:1/290: rename dc/d14/d18/c21 to dc/d14/d18/d2d/d4a/c59 0 2023-12-07T16:21:32.603 INFO:tasks.workunit.client.1.smithi152.stdout:1/291: creat dc/d14/f5a x:0 0 0 2023-12-07T16:21:32.606 INFO:tasks.workunit.client.1.smithi152.stdout:4/261: dread d0/d3/d6/dc/dd/f38 [0,4194304] 0 2023-12-07T16:21:32.607 INFO:tasks.workunit.client.1.smithi152.stdout:7/234: dwrite db/d1c/f28 [0,4194304] 0 2023-12-07T16:21:32.607 INFO:tasks.workunit.client.1.smithi152.stdout:7/235: dread - db/d27/d39/d41/d37/f3f zero size 2023-12-07T16:21:32.607 INFO:tasks.workunit.client.1.smithi152.stdout:7/236: chown db 79 1 2023-12-07T16:21:32.608 INFO:tasks.workunit.client.1.smithi152.stdout:4/262: mkdir d0/d3/d6/dc/d3a/d48 0 2023-12-07T16:21:32.609 INFO:tasks.workunit.client.1.smithi152.stdout:0/304: dread d0/f18 [0,4194304] 0 2023-12-07T16:21:32.609 INFO:tasks.workunit.client.1.smithi152.stdout:0/305: dread - d0/dc/d36/d3a/d51/f61 zero size 2023-12-07T16:21:32.610 INFO:tasks.workunit.client.1.smithi152.stdout:0/306: write d0/d2f/f52 [464314,8943] 0 2023-12-07T16:21:32.610 INFO:tasks.workunit.client.1.smithi152.stdout:4/263: dread d0/d3/d6/f1d [0,4194304] 0 2023-12-07T16:21:32.611 INFO:tasks.workunit.client.1.smithi152.stdout:4/264: write d0/d3/d6/f27 [636582,55489] 0 2023-12-07T16:21:32.611 INFO:tasks.workunit.client.1.smithi152.stdout:5/292: dwrite dd/de/d14/f3f [0,4194304] 0 2023-12-07T16:21:32.611 INFO:tasks.workunit.client.1.smithi152.stdout:5/293: chown dd/de/d17 588860 1 2023-12-07T16:21:32.614 INFO:tasks.workunit.client.1.smithi152.stdout:4/265: symlink d0/l49 0 2023-12-07T16:21:32.614 INFO:tasks.workunit.client.1.smithi152.stdout:4/266: chown d0/d3/d6/dc 893 1 2023-12-07T16:21:32.614 INFO:tasks.workunit.client.1.smithi152.stdout:4/267: dread - d0/d3/d6/dc/dd/f33 zero size 2023-12-07T16:21:32.616 INFO:tasks.workunit.client.1.smithi152.stdout:5/294: symlink dd/de/d14/d19/d1a/l60 0 2023-12-07T16:21:32.617 INFO:tasks.workunit.client.1.smithi152.stdout:0/307: symlink d0/d2f/l62 0 2023-12-07T16:21:32.617 INFO:tasks.workunit.client.1.smithi152.stdout:0/308: fdatasync d0/dc/f31 0 2023-12-07T16:21:32.617 INFO:tasks.workunit.client.1.smithi152.stdout:0/309: dread - d0/dc/d3d/d4c/f60 zero size 2023-12-07T16:21:32.619 INFO:tasks.workunit.client.1.smithi152.stdout:4/268: mknod d0/d3/d6/dc/dd/c4a 0 2023-12-07T16:21:32.619 INFO:tasks.workunit.client.1.smithi152.stdout:4/269: readlink d0/l23 0 2023-12-07T16:21:32.620 INFO:tasks.workunit.client.1.smithi152.stdout:5/295: creat dd/de/d17/f61 x:0 0 0 2023-12-07T16:21:32.620 INFO:tasks.workunit.client.1.smithi152.stdout:0/310: creat d0/dc/d26/f63 x:0 0 0 2023-12-07T16:21:32.622 INFO:tasks.workunit.client.1.smithi152.stdout:4/270: mknod d0/d3/d6/dc/dd/c4b 0 2023-12-07T16:21:32.622 INFO:tasks.workunit.client.1.smithi152.stdout:4/271: fdatasync d0/d3/d6/dc/d22/f32 0 2023-12-07T16:21:32.622 INFO:tasks.workunit.client.1.smithi152.stdout:4/272: fdatasync d0/d3/d6/dc/dd/d34/f42 0 2023-12-07T16:21:32.638 INFO:tasks.workunit.client.1.smithi152.stdout:1/292: dwrite f4 [0,4194304] 0 2023-12-07T16:21:32.638 INFO:tasks.workunit.client.1.smithi152.stdout:1/293: stat dc/d14/d18 0 2023-12-07T16:21:32.638 INFO:tasks.workunit.client.1.smithi152.stdout:1/294: stat dc/d14 0 2023-12-07T16:21:32.641 INFO:tasks.workunit.client.1.smithi152.stdout:1/295: symlink dc/de/d58/l5b 0 2023-12-07T16:21:32.641 INFO:tasks.workunit.client.1.smithi152.stdout:1/296: dread - dc/d14/d18/f3f zero size 2023-12-07T16:21:32.648 INFO:tasks.workunit.client.1.smithi152.stdout:0/311: dwrite d0/dc/f22 [0,4194304] 0 2023-12-07T16:21:32.648 INFO:tasks.workunit.client.1.smithi152.stdout:0/312: write d0/d27/ff [4470936,17968] 0 2023-12-07T16:21:32.648 INFO:tasks.workunit.client.1.smithi152.stdout:4/273: dwrite d0/d3/f7 [0,4194304] 0 2023-12-07T16:21:32.650 INFO:tasks.workunit.client.1.smithi152.stdout:0/313: write d0/d2f/f35 [778109,9906] 0 2023-12-07T16:21:32.651 INFO:tasks.workunit.client.1.smithi152.stdout:4/274: mkdir d0/d3/d6/dc/d3a/d48/d4c 0 2023-12-07T16:21:32.652 INFO:tasks.workunit.client.1.smithi152.stdout:4/275: creat d0/d3/d6/dc/d22/f4d x:0 0 0 2023-12-07T16:21:32.652 INFO:tasks.workunit.client.1.smithi152.stdout:4/276: stat d0 0 2023-12-07T16:21:32.657 INFO:tasks.workunit.client.1.smithi152.stdout:1/297: dwrite dc/d14/f2b [0,4194304] 0 2023-12-07T16:21:32.657 INFO:tasks.workunit.client.1.smithi152.stdout:1/298: write dc/d28/f53 [582802,93590] 0 2023-12-07T16:21:32.673 INFO:tasks.workunit.client.1.smithi152.stdout:1/299: dwrite dc/d14/d18/d45/f47 [4194304,4194304] 0 2023-12-07T16:21:32.689 INFO:tasks.workunit.client.1.smithi152.stdout:1/300: dwrite dc/f13 [0,4194304] 0 2023-12-07T16:21:32.690 INFO:tasks.workunit.client.1.smithi152.stdout:1/301: mknod dc/de/d58/c5c 0 2023-12-07T16:21:32.690 INFO:tasks.workunit.client.1.smithi152.stdout:1/302: chown dc/f2a 10356711 1 2023-12-07T16:21:32.690 INFO:tasks.workunit.client.1.smithi152.stdout:1/303: mknod dc/d14/d18/c5d 0 2023-12-07T16:21:32.691 INFO:tasks.workunit.client.1.smithi152.stdout:1/304: creat dc/d28/f5e x:0 0 0 2023-12-07T16:21:32.691 INFO:tasks.workunit.client.1.smithi152.stdout:1/305: chown dc/fd 29 1 2023-12-07T16:21:32.698 INFO:tasks.workunit.client.1.smithi152.stdout:1/306: dread dc/d14/f2b [0,4194304] 0 2023-12-07T16:21:32.698 INFO:tasks.workunit.client.1.smithi152.stdout:1/307: write dc/d28/f43 [4366294,59575] 0 2023-12-07T16:21:32.699 INFO:tasks.workunit.client.1.smithi152.stdout:1/308: symlink dc/d14/l5f 0 2023-12-07T16:21:32.700 INFO:tasks.workunit.client.1.smithi152.stdout:1/309: rmdir dc/d14/d18 39 2023-12-07T16:21:32.700 INFO:tasks.workunit.client.1.smithi152.stdout:1/310: dread - dc/d14/f5a zero size 2023-12-07T16:21:32.700 INFO:tasks.workunit.client.1.smithi152.stdout:1/311: write dc/d28/f5e [981457,20189] 0 2023-12-07T16:21:32.701 INFO:tasks.workunit.client.1.smithi152.stdout:1/312: mknod dc/de/c60 0 2023-12-07T16:21:32.701 INFO:tasks.workunit.client.1.smithi152.stdout:1/313: truncate dc/d28/f53 793345 0 2023-12-07T16:21:32.702 INFO:tasks.workunit.client.1.smithi152.stdout:1/314: unlink dc/d14/d18/d2d/d48/l4b 0 2023-12-07T16:21:32.702 INFO:tasks.workunit.client.1.smithi152.stdout:1/315: chown dc/d28/c3b 28498189 1 2023-12-07T16:21:32.703 INFO:tasks.workunit.client.1.smithi152.stdout:1/316: unlink dc/d14/d18/d2d/l46 0 2023-12-07T16:21:32.704 INFO:tasks.workunit.client.1.smithi152.stdout:1/317: stat dc/f40 0 2023-12-07T16:21:32.707 INFO:tasks.workunit.client.1.smithi152.stdout:5/296: rmdir dd/de/d14 39 2023-12-07T16:21:32.708 INFO:tasks.workunit.client.1.smithi152.stdout:5/297: dread - dd/f40 zero size 2023-12-07T16:21:32.708 INFO:tasks.workunit.client.1.smithi152.stdout:7/237: dwrite db/f13 [0,4194304] 0 2023-12-07T16:21:32.708 INFO:tasks.workunit.client.1.smithi152.stdout:7/238: getdents db/d27/d39/d3e 0 2023-12-07T16:21:32.708 INFO:tasks.workunit.client.1.smithi152.stdout:7/239: truncate f8 5269770 0 2023-12-07T16:21:32.708 INFO:tasks.workunit.client.1.smithi152.stdout:7/240: fdatasync db/f13 0 2023-12-07T16:21:32.713 INFO:tasks.workunit.client.1.smithi152.stdout:0/314: dwrite d0/f38 [4194304,4194304] 0 2023-12-07T16:21:32.716 INFO:tasks.workunit.client.1.smithi152.stdout:5/298: symlink dd/de/d38/d3d/l62 0 2023-12-07T16:21:32.718 INFO:tasks.workunit.client.1.smithi152.stdout:7/241: mknod db/d27/d39/d41/d37/c42 0 2023-12-07T16:21:32.720 INFO:tasks.workunit.client.1.smithi152.stdout:0/315: rmdir d0/dc/d3d 39 2023-12-07T16:21:32.722 INFO:tasks.workunit.client.1.smithi152.stdout:5/299: creat dd/de/d14/f63 x:0 0 0 2023-12-07T16:21:32.722 INFO:tasks.workunit.client.1.smithi152.stdout:5/300: chown dd/de/d38/d3d/l4e 30381 1 2023-12-07T16:21:32.722 INFO:tasks.workunit.client.1.smithi152.stdout:5/301: truncate dd/de/d14/d19/f23 3240484 0 2023-12-07T16:21:32.723 INFO:tasks.workunit.client.1.smithi152.stdout:5/302: write dd/de/d14/d1f/f2e [1652671,91191] 0 2023-12-07T16:21:32.723 INFO:tasks.workunit.client.1.smithi152.stdout:5/303: chown dd/de/d14/d19/d1a/d1b/c47 3 1 2023-12-07T16:21:32.723 INFO:tasks.workunit.client.1.smithi152.stdout:7/242: creat db/d27/d39/d3e/f43 x:0 0 0 2023-12-07T16:21:32.726 INFO:tasks.workunit.client.1.smithi152.stdout:5/304: creat dd/de/d14/d19/f64 x:0 0 0 2023-12-07T16:21:32.728 INFO:tasks.workunit.client.1.smithi152.stdout:7/243: rmdir db/d27/d39 39 2023-12-07T16:21:32.728 INFO:tasks.workunit.client.1.smithi152.stdout:7/244: fdatasync db/d27/d39/f2f 0 2023-12-07T16:21:32.729 INFO:tasks.workunit.client.1.smithi152.stdout:1/318: getdents dc/d14/d18 0 2023-12-07T16:21:32.731 INFO:tasks.workunit.client.1.smithi152.stdout:1/319: creat dc/d28/d4e/f61 x:0 0 0 2023-12-07T16:21:32.737 INFO:tasks.workunit.client.1.smithi152.stdout:1/320: mkdir dc/d14/d18/d2d/d48/d62 0 2023-12-07T16:21:32.741 INFO:tasks.workunit.client.1.smithi152.stdout:2/266: sync 2023-12-07T16:21:32.741 INFO:tasks.workunit.client.1.smithi152.stdout:9/377: sync 2023-12-07T16:21:32.742 INFO:tasks.workunit.client.1.smithi152.stdout:3/290: sync 2023-12-07T16:21:32.742 INFO:tasks.workunit.client.1.smithi152.stdout:5/305: dread dd/de/f13 [0,4194304] 0 2023-12-07T16:21:32.742 INFO:tasks.workunit.client.1.smithi152.stdout:5/306: truncate dd/f40 365274 0 2023-12-07T16:21:32.743 INFO:tasks.workunit.client.1.smithi152.stdout:5/307: fsync dd/de/d14/d19/d1a/d1b/f48 0 2023-12-07T16:21:32.744 INFO:tasks.workunit.client.1.smithi152.stdout:9/378: mkdir d1/d9/d4f/d83 0 2023-12-07T16:21:32.745 INFO:tasks.workunit.client.1.smithi152.stdout:7/245: dwrite db/d27/f3b [0,4194304] 0 2023-12-07T16:21:32.747 INFO:tasks.workunit.client.1.smithi152.stdout:3/291: rename d7/dc/l31 to d7/d10/d1a/l58 0 2023-12-07T16:21:32.752 INFO:tasks.workunit.client.1.smithi152.stdout:7/246: rename db/c17 to db/c44 0 2023-12-07T16:21:32.753 INFO:tasks.workunit.client.1.smithi152.stdout:5/308: dread dd/f40 [0,4194304] 0 2023-12-07T16:21:32.753 INFO:tasks.workunit.client.1.smithi152.stdout:5/309: chown dd/de/d17/d54 1768 1 2023-12-07T16:21:32.753 INFO:tasks.workunit.client.1.smithi152.stdout:5/310: dread - dd/de/d14/d19/f64 zero size 2023-12-07T16:21:32.754 INFO:tasks.workunit.client.1.smithi152.stdout:7/247: mkdir db/d27/d39/d3e/d45 0 2023-12-07T16:21:32.754 INFO:tasks.workunit.client.1.smithi152.stdout:7/248: readlink db/d27/d39/l2a 0 2023-12-07T16:21:32.757 INFO:tasks.workunit.client.1.smithi152.stdout:1/321: dwrite dc/d14/d18/d2d/f54 [0,4194304] 0 2023-12-07T16:21:32.765 INFO:tasks.workunit.client.1.smithi152.stdout:3/292: link d7/d10/d19/c2b d7/d10/d1a/d2f/c59 0 2023-12-07T16:21:32.765 INFO:tasks.workunit.client.1.smithi152.stdout:3/293: readlink d7/dc/l35 0 2023-12-07T16:21:32.766 INFO:tasks.workunit.client.1.smithi152.stdout:5/311: mknod dd/de/d14/d19/d1a/d1b/c65 0 2023-12-07T16:21:32.767 INFO:tasks.workunit.client.1.smithi152.stdout:5/312: chown dd/de/d14/f63 14525 1 2023-12-07T16:21:32.767 INFO:tasks.workunit.client.1.smithi152.stdout:5/313: fsync dd/de/d14/d1f/d28/f30 0 2023-12-07T16:21:32.767 INFO:tasks.workunit.client.1.smithi152.stdout:8/248: sync 2023-12-07T16:21:32.767 INFO:tasks.workunit.client.1.smithi152.stdout:7/249: unlink db/f13 0 2023-12-07T16:21:32.768 INFO:tasks.workunit.client.1.smithi152.stdout:9/379: dwrite d1/d17/d58/f61 [0,4194304] 0 2023-12-07T16:21:32.788 INFO:tasks.workunit.client.1.smithi152.stdout:7/250: dwrite f6 [8388608,4194304] 0 2023-12-07T16:21:32.789 INFO:tasks.workunit.client.1.smithi152.stdout:1/322: dwrite dc/fd [0,4194304] 0 2023-12-07T16:21:32.794 INFO:tasks.workunit.client.1.smithi152.stdout:3/294: creat d7/f5a x:0 0 0 2023-12-07T16:21:32.795 INFO:tasks.workunit.client.1.smithi152.stdout:5/314: mkdir dd/de/d38/d3d/d66 0 2023-12-07T16:21:32.796 INFO:tasks.workunit.client.1.smithi152.stdout:8/249: unlink d3/l3d 0 2023-12-07T16:21:32.801 INFO:tasks.workunit.client.1.smithi152.stdout:9/380: creat d1/d9/d2d/f84 x:0 0 0 2023-12-07T16:21:32.802 INFO:tasks.workunit.client.1.smithi152.stdout:7/251: rename db/d27/d39/d41/l35 to db/d1c/l46 0 2023-12-07T16:21:32.804 INFO:tasks.workunit.client.1.smithi152.stdout:1/323: unlink dc/d14/f5a 0 2023-12-07T16:21:32.806 INFO:tasks.workunit.client.1.smithi152.stdout:3/295: link d7/d10/d1a/d2f/f26 d7/d10/d19/f5b 0 2023-12-07T16:21:32.807 INFO:tasks.workunit.client.1.smithi152.stdout:5/315: truncate dd/f5a 739286 0 2023-12-07T16:21:32.807 INFO:tasks.workunit.client.1.smithi152.stdout:8/250: dread d3/d4/d9/f38 [0,4194304] 0 2023-12-07T16:21:32.807 INFO:tasks.workunit.client.1.smithi152.stdout:1/324: write dc/d28/f39 [7938763,60210] 0 2023-12-07T16:21:32.807 INFO:tasks.workunit.client.1.smithi152.stdout:1/325: dread - dc/d28/f55 zero size 2023-12-07T16:21:32.807 INFO:tasks.workunit.client.1.smithi152.stdout:9/381: truncate d1/dd/f5c 4046743 0 2023-12-07T16:21:32.809 INFO:tasks.workunit.client.1.smithi152.stdout:7/252: rename db/d27/f31 to db/f47 0 2023-12-07T16:21:32.809 INFO:tasks.workunit.client.1.smithi152.stdout:7/253: stat db/d1c 0 2023-12-07T16:21:32.809 INFO:tasks.workunit.client.1.smithi152.stdout:3/296: unlink d7/d10/d1a/d25/f37 0 2023-12-07T16:21:32.812 INFO:tasks.workunit.client.1.smithi152.stdout:8/251: link d3/d1e/d43/c51 d3/d1e/d43/c56 0 2023-12-07T16:21:32.812 INFO:tasks.workunit.client.1.smithi152.stdout:8/252: fsync d3/d4/d9/d23/f45 0 2023-12-07T16:21:32.814 INFO:tasks.workunit.client.1.smithi152.stdout:1/326: creat dc/f63 x:0 0 0 2023-12-07T16:21:32.814 INFO:tasks.workunit.client.1.smithi152.stdout:7/254: rmdir db/d27/d39/d3e 39 2023-12-07T16:21:32.817 INFO:tasks.workunit.client.1.smithi152.stdout:9/382: dread d1/d9/f20 [0,4194304] 0 2023-12-07T16:21:32.818 INFO:tasks.workunit.client.1.smithi152.stdout:8/253: link d3/d4/d4b/c4e d3/d4/d4b/c57 0 2023-12-07T16:21:32.818 INFO:tasks.workunit.client.1.smithi152.stdout:7/255: link db/f18 db/d27/d39/d3e/f48 0 2023-12-07T16:21:32.818 INFO:tasks.workunit.client.1.smithi152.stdout:8/254: fsync d3/d1e/f44 0 2023-12-07T16:21:32.819 INFO:tasks.workunit.client.1.smithi152.stdout:9/383: mkdir d1/d17/d3c/d4a/d48/d85 0 2023-12-07T16:21:32.819 INFO:tasks.workunit.client.1.smithi152.stdout:9/384: truncate d1/d17/d3c/d4a/d48/f59 186735 0 2023-12-07T16:21:32.820 INFO:tasks.workunit.client.1.smithi152.stdout:3/297: dread f2 [0,4194304] 0 2023-12-07T16:21:32.820 INFO:tasks.workunit.client.1.smithi152.stdout:7/256: creat db/d27/f49 x:0 0 0 2023-12-07T16:21:32.820 INFO:tasks.workunit.client.1.smithi152.stdout:7/257: chown db/l36 47333084 1 2023-12-07T16:21:32.820 INFO:tasks.workunit.client.1.smithi152.stdout:7/258: write db/d27/d39/f33 [1686181,27273] 0 2023-12-07T16:21:32.821 INFO:tasks.workunit.client.1.smithi152.stdout:9/385: mkdir d1/d17/d58/d86 0 2023-12-07T16:21:32.822 INFO:tasks.workunit.client.1.smithi152.stdout:8/255: write d3/f1a [4489832,63283] 0 2023-12-07T16:21:32.822 INFO:tasks.workunit.client.1.smithi152.stdout:8/256: chown d3/d4/d9/d23/d4c 598983407 1 2023-12-07T16:21:32.823 INFO:tasks.workunit.client.1.smithi152.stdout:5/316: dwrite dd/de/d17/f5b [0,4194304] 0 2023-12-07T16:21:32.823 INFO:tasks.workunit.client.1.smithi152.stdout:7/259: rename db/d27/d39/d41/f3c to db/f4a 0 2023-12-07T16:21:32.827 INFO:tasks.workunit.client.1.smithi152.stdout:3/298: mkdir d7/d10/d1a/d2f/d5c 0 2023-12-07T16:21:32.834 INFO:tasks.workunit.client.1.smithi152.stdout:5/317: mkdir dd/de/d14/d67 0 2023-12-07T16:21:32.834 INFO:tasks.workunit.client.1.smithi152.stdout:5/318: write fc [9062073,50683] 0 2023-12-07T16:21:32.835 INFO:tasks.workunit.client.1.smithi152.stdout:7/260: rmdir db/d27/d39 39 2023-12-07T16:21:32.837 INFO:tasks.workunit.client.1.smithi152.stdout:9/386: dread d1/d17/d3c/d4a/d48/f59 [0,4194304] 0 2023-12-07T16:21:32.840 INFO:tasks.workunit.client.1.smithi152.stdout:3/299: rmdir d7/dc/d3e/d48 39 2023-12-07T16:21:32.841 INFO:tasks.workunit.client.1.smithi152.stdout:5/319: dread dd/de/d38/f43 [0,4194304] 0 2023-12-07T16:21:32.844 INFO:tasks.workunit.client.1.smithi152.stdout:5/320: read dd/de/d14/f42 [50028,121176] 0 2023-12-07T16:21:32.844 INFO:tasks.workunit.client.1.smithi152.stdout:5/321: fsync dd/de/d14/d1f/f57 0 2023-12-07T16:21:32.849 INFO:tasks.workunit.client.1.smithi152.stdout:6/277: sync 2023-12-07T16:21:32.851 INFO:tasks.workunit.client.1.smithi152.stdout:6/278: unlink d2/d6/d9/l3b 0 2023-12-07T16:21:32.851 INFO:tasks.workunit.client.1.smithi152.stdout:6/279: chown d2/d6/d19 472929 1 2023-12-07T16:21:32.852 INFO:tasks.workunit.client.1.smithi152.stdout:8/257: dwrite d3/d1e/f30 [4194304,4194304] 0 2023-12-07T16:21:32.852 INFO:tasks.workunit.client.1.smithi152.stdout:9/387: dread d1/f49 [0,4194304] 0 2023-12-07T16:21:32.852 INFO:tasks.workunit.client.1.smithi152.stdout:9/388: chown d1/d17/d3c 4756292 1 2023-12-07T16:21:32.859 INFO:tasks.workunit.client.1.smithi152.stdout:1/327: dwrite dc/d14/d18/d45/f47 [0,4194304] 0 2023-12-07T16:21:32.861 INFO:tasks.workunit.client.1.smithi152.stdout:8/258: dread d3/d4/d9/dc/f3e [0,4194304] 0 2023-12-07T16:21:32.862 INFO:tasks.workunit.client.1.smithi152.stdout:8/259: write d3/d4/d9/f21 [172510,124044] 0 2023-12-07T16:21:32.862 INFO:tasks.workunit.client.1.smithi152.stdout:1/328: mkdir dc/d14/d18/d64 0 2023-12-07T16:21:32.862 INFO:tasks.workunit.client.1.smithi152.stdout:1/329: getdents dc/d14/d18/d2d/d50 0 2023-12-07T16:21:32.863 INFO:tasks.workunit.client.1.smithi152.stdout:8/260: creat d3/d4/d9/dc/d1f/f58 x:0 0 0 2023-12-07T16:21:32.863 INFO:tasks.workunit.client.1.smithi152.stdout:8/261: chown d3/d4/d9/dc/f39 317793 1 2023-12-07T16:21:32.868 INFO:tasks.workunit.client.1.smithi152.stdout:3/300: dwrite d7/d10/d1a/f43 [0,4194304] 0 2023-12-07T16:21:32.869 INFO:tasks.workunit.client.1.smithi152.stdout:5/322: dwrite f8 [0,4194304] 0 2023-12-07T16:21:32.872 INFO:tasks.workunit.client.1.smithi152.stdout:3/301: creat d7/f5d x:0 0 0 2023-12-07T16:21:32.872 INFO:tasks.workunit.client.1.smithi152.stdout:1/330: dread dc/f13 [0,4194304] 0 2023-12-07T16:21:32.873 INFO:tasks.workunit.client.1.smithi152.stdout:7/261: dwrite db/d27/d39/d3e/f48 [0,4194304] 0 2023-12-07T16:21:32.874 INFO:tasks.workunit.client.1.smithi152.stdout:5/323: mknod dd/de/d14/d1f/c68 0 2023-12-07T16:21:32.875 INFO:tasks.workunit.client.1.smithi152.stdout:6/280: getdents d2/d6/d9 0 2023-12-07T16:21:32.875 INFO:tasks.workunit.client.1.smithi152.stdout:3/302: read d7/d10/d1a/d2f/f18 [3203536,62962] 0 2023-12-07T16:21:32.875 INFO:tasks.workunit.client.1.smithi152.stdout:4/277: sync 2023-12-07T16:21:32.875 INFO:tasks.workunit.client.1.smithi152.stdout:0/316: sync 2023-12-07T16:21:32.875 INFO:tasks.workunit.client.1.smithi152.stdout:2/267: sync 2023-12-07T16:21:32.875 INFO:tasks.workunit.client.1.smithi152.stdout:4/278: chown d0/d3 39740219 1 2023-12-07T16:21:32.876 INFO:tasks.workunit.client.1.smithi152.stdout:7/262: mknod db/d27/d39/d3e/d45/c4b 0 2023-12-07T16:21:32.876 INFO:tasks.workunit.client.1.smithi152.stdout:7/263: chown db/d1c/l34 84 1 2023-12-07T16:21:32.879 INFO:tasks.workunit.client.1.smithi152.stdout:8/262: dread d3/d4/d9/d23/f2c [0,4194304] 0 2023-12-07T16:21:32.879 INFO:tasks.workunit.client.1.smithi152.stdout:5/324: creat dd/de/d14/d1f/d28/f69 x:0 0 0 2023-12-07T16:21:32.879 INFO:tasks.workunit.client.1.smithi152.stdout:8/263: write d3/d4/d9/dc/f4d [444777,117157] 0 2023-12-07T16:21:32.882 INFO:tasks.workunit.client.1.smithi152.stdout:3/303: truncate d7/dc/fe 1236232 0 2023-12-07T16:21:32.882 INFO:tasks.workunit.client.1.smithi152.stdout:6/281: rmdir d2/d6/d19 39 2023-12-07T16:21:32.885 INFO:tasks.workunit.client.1.smithi152.stdout:4/279: getdents d0/d3/d6/dc/dd/d34 0 2023-12-07T16:21:32.885 INFO:tasks.workunit.client.1.smithi152.stdout:4/280: chown d0/d3/d6/dc/d3a/d46 51 1 2023-12-07T16:21:32.885 INFO:tasks.workunit.client.1.smithi152.stdout:2/268: rename d2/d47/l49 to d2/d9/d51/l5f 0 2023-12-07T16:21:32.885 INFO:tasks.workunit.client.1.smithi152.stdout:7/264: link db/d1c/f10 db/d27/d39/d3e/d45/f4c 0 2023-12-07T16:21:32.888 INFO:tasks.workunit.client.1.smithi152.stdout:7/265: write db/fe [287544,21338] 0 2023-12-07T16:21:32.888 INFO:tasks.workunit.client.1.smithi152.stdout:7/266: write db/d27/f3d [2821517,101946] 0 2023-12-07T16:21:32.888 INFO:tasks.workunit.client.1.smithi152.stdout:7/267: stat db/d27/d39/d41/d37/c42 0 2023-12-07T16:21:32.890 INFO:tasks.workunit.client.1.smithi152.stdout:0/317: dread d0/dc/f3c [0,4194304] 0 2023-12-07T16:21:32.891 INFO:tasks.workunit.client.1.smithi152.stdout:4/281: mkdir d0/d3/d6/dc/d3a/d46/d4e 0 2023-12-07T16:21:32.892 INFO:tasks.workunit.client.1.smithi152.stdout:4/282: chown d0/l49 4500908 1 2023-12-07T16:21:32.892 INFO:tasks.workunit.client.1.smithi152.stdout:2/269: link d2/d9/c17 d2/d1c/d2e/d5d/c60 0 2023-12-07T16:21:32.892 INFO:tasks.workunit.client.1.smithi152.stdout:6/282: rmdir d2/d6/d9/d14/d48 39 2023-12-07T16:21:32.892 INFO:tasks.workunit.client.1.smithi152.stdout:8/264: creat d3/d4/d9/dc/d1f/f59 x:0 0 0 2023-12-07T16:21:32.892 INFO:tasks.workunit.client.1.smithi152.stdout:8/265: stat d3/d4/d9/d23/d4c 0 2023-12-07T16:21:32.892 INFO:tasks.workunit.client.1.smithi152.stdout:8/266: stat d3/d4/d9/f38 0 2023-12-07T16:21:32.892 INFO:tasks.workunit.client.1.smithi152.stdout:7/268: mkdir db/d27/d4d 0 2023-12-07T16:21:32.894 INFO:tasks.workunit.client.1.smithi152.stdout:2/270: rename d2/d1c/d2e/c31 to d2/d9/d51/d54/d5c/c61 0 2023-12-07T16:21:32.894 INFO:tasks.workunit.client.1.smithi152.stdout:0/318: dread d0/d27/f10 [0,4194304] 0 2023-12-07T16:21:32.894 INFO:tasks.workunit.client.1.smithi152.stdout:0/319: read - d0/dc/f31 zero size 2023-12-07T16:21:32.895 INFO:tasks.workunit.client.1.smithi152.stdout:6/283: creat d2/d6/d9/d14/d48/f54 x:0 0 0 2023-12-07T16:21:32.895 INFO:tasks.workunit.client.1.smithi152.stdout:8/267: symlink d3/d1e/d40/l5a 0 2023-12-07T16:21:32.896 INFO:tasks.workunit.client.1.smithi152.stdout:7/269: mkdir db/d27/d39/d41/d37/d4e 0 2023-12-07T16:21:32.898 INFO:tasks.workunit.client.1.smithi152.stdout:0/320: creat d0/dc/d3d/d4c/f64 x:0 0 0 2023-12-07T16:21:32.898 INFO:tasks.workunit.client.1.smithi152.stdout:6/284: mkdir d2/d6/de/d45/d55 0 2023-12-07T16:21:32.899 INFO:tasks.workunit.client.1.smithi152.stdout:8/268: mknod d3/d4/d9/d34/c5b 0 2023-12-07T16:21:32.901 INFO:tasks.workunit.client.1.smithi152.stdout:0/321: link d0/l2 d0/dc/d3d/l65 0 2023-12-07T16:21:32.902 INFO:tasks.workunit.client.1.smithi152.stdout:0/322: fsync d0/dc/d36/d3a/f4f 0 2023-12-07T16:21:32.902 INFO:tasks.workunit.client.1.smithi152.stdout:0/323: fdatasync d0/d27/f10 0 2023-12-07T16:21:32.905 INFO:tasks.workunit.client.1.smithi152.stdout:0/324: mknod d0/dc/d3d/c66 0 2023-12-07T16:21:32.905 INFO:tasks.workunit.client.1.smithi152.stdout:0/325: fsync d0/dc/f22 0 2023-12-07T16:21:32.905 INFO:tasks.workunit.client.1.smithi152.stdout:0/326: write d0/f1a [60989,73420] 0 2023-12-07T16:21:32.905 INFO:tasks.workunit.client.1.smithi152.stdout:4/283: dread d0/d3/f7 [0,4194304] 0 2023-12-07T16:21:32.905 INFO:tasks.workunit.client.1.smithi152.stdout:8/269: rename d3/d4/d9/f2b to d3/d4/f5c 0 2023-12-07T16:21:32.905 INFO:tasks.workunit.client.1.smithi152.stdout:0/327: creat d0/dc/d26/f67 x:0 0 0 2023-12-07T16:21:32.905 INFO:tasks.workunit.client.1.smithi152.stdout:0/328: truncate d0/d2f/f52 1130134 0 2023-12-07T16:21:32.906 INFO:tasks.workunit.client.1.smithi152.stdout:4/284: rename d0/d3/d6/dc/dd/f38 to d0/d3/d6/dc/d22/f4f 0 2023-12-07T16:21:32.909 INFO:tasks.workunit.client.1.smithi152.stdout:4/285: symlink d0/d3/d6/dc/d22/l50 0 2023-12-07T16:21:32.910 INFO:tasks.workunit.client.1.smithi152.stdout:1/331: dwrite dc/de/f22 [4194304,4194304] 0 2023-12-07T16:21:32.911 INFO:tasks.workunit.client.1.smithi152.stdout:2/271: dread d2/f8 [4194304,4194304] 0 2023-12-07T16:21:32.911 INFO:tasks.workunit.client.1.smithi152.stdout:2/272: write d2/d9/f48 [296592,87856] 0 2023-12-07T16:21:32.911 INFO:tasks.workunit.client.1.smithi152.stdout:2/273: dread - d2/d1c/d2e/d30/d33/f3d zero size 2023-12-07T16:21:32.913 INFO:tasks.workunit.client.1.smithi152.stdout:8/270: dread d3/d4/d9/d23/f45 [0,4194304] 0 2023-12-07T16:21:32.913 INFO:tasks.workunit.client.1.smithi152.stdout:8/271: readlink d3/d4/d9/l41 0 2023-12-07T16:21:32.914 INFO:tasks.workunit.client.1.smithi152.stdout:1/332: rmdir dc/d14/d18/d2d/d50 0 2023-12-07T16:21:32.915 INFO:tasks.workunit.client.1.smithi152.stdout:1/333: unlink dc/de/f42 0 2023-12-07T16:21:32.917 INFO:tasks.workunit.client.1.smithi152.stdout:1/334: dread dc/d14/d18/f35 [0,4194304] 0 2023-12-07T16:21:32.918 INFO:tasks.workunit.client.1.smithi152.stdout:2/274: dread d2/d1c/d2e/d30/d42/f43 [0,4194304] 0 2023-12-07T16:21:32.920 INFO:tasks.workunit.client.1.smithi152.stdout:7/270: dread db/d27/d39/f22 [0,4194304] 0 2023-12-07T16:21:32.920 INFO:tasks.workunit.client.1.smithi152.stdout:1/335: rename dc/d14/l4f to dc/d14/d18/d2d/l65 0 2023-12-07T16:21:32.920 INFO:tasks.workunit.client.1.smithi152.stdout:2/275: mknod d2/d1c/d2e/d30/c62 0 2023-12-07T16:21:32.920 INFO:tasks.workunit.client.1.smithi152.stdout:2/276: chown d2/l12 463809 1 2023-12-07T16:21:32.920 INFO:tasks.workunit.client.1.smithi152.stdout:2/277: chown d2/d9/c1e 49787975 1 2023-12-07T16:21:32.923 INFO:tasks.workunit.client.1.smithi152.stdout:3/304: dwrite d7/f5d [0,4194304] 0 2023-12-07T16:21:32.923 INFO:tasks.workunit.client.1.smithi152.stdout:3/305: chown f3 1 1 2023-12-07T16:21:32.924 INFO:tasks.workunit.client.1.smithi152.stdout:7/271: creat db/d27/d39/d41/f4f x:0 0 0 2023-12-07T16:21:32.924 INFO:tasks.workunit.client.1.smithi152.stdout:4/286: dread d0/d3/f2a [0,4194304] 0 2023-12-07T16:21:32.924 INFO:tasks.workunit.client.1.smithi152.stdout:1/336: rmdir dc/d28 39 2023-12-07T16:21:32.924 INFO:tasks.workunit.client.1.smithi152.stdout:1/337: write dc/d28/f55 [680044,95497] 0 2023-12-07T16:21:32.924 INFO:tasks.workunit.client.1.smithi152.stdout:5/325: dwrite dd/de/d14/f63 [0,4194304] 0 2023-12-07T16:21:32.924 INFO:tasks.workunit.client.1.smithi152.stdout:2/278: truncate d2/f8 4134250 0 2023-12-07T16:21:32.926 INFO:tasks.workunit.client.1.smithi152.stdout:3/306: creat d7/dc/d3e/f5e x:0 0 0 2023-12-07T16:21:32.929 INFO:tasks.workunit.client.1.smithi152.stdout:7/272: getdents db/d27/d39/d3e/d45 0 2023-12-07T16:21:32.930 INFO:tasks.workunit.client.1.smithi152.stdout:4/287: symlink d0/d3/d6/l51 0 2023-12-07T16:21:32.930 INFO:tasks.workunit.client.1.smithi152.stdout:4/288: write d0/d3/d6/d36/f44 [810877,19709] 0 2023-12-07T16:21:32.932 INFO:tasks.workunit.client.1.smithi152.stdout:6/285: dwrite d2/d6/f4d [0,4194304] 0 2023-12-07T16:21:32.932 INFO:tasks.workunit.client.1.smithi152.stdout:8/272: dwrite d3/d4/d9/d34/f49 [0,4194304] 0 2023-12-07T16:21:32.933 INFO:tasks.workunit.client.1.smithi152.stdout:8/273: truncate d3/d4/d4b/f4f 372065 0 2023-12-07T16:21:32.933 INFO:tasks.workunit.client.1.smithi152.stdout:1/338: unlink dc/d14/d18/l3c 0 2023-12-07T16:21:32.936 INFO:tasks.workunit.client.1.smithi152.stdout:3/307: dread d7/dc/fe [0,4194304] 0 2023-12-07T16:21:32.936 INFO:tasks.workunit.client.1.smithi152.stdout:3/308: truncate d7/d10/d1a/d25/d3f/f46 700792 0 2023-12-07T16:21:32.936 INFO:tasks.workunit.client.1.smithi152.stdout:3/309: truncate d7/d10/d1a/d2f/f20 5073329 0 2023-12-07T16:21:32.939 INFO:tasks.workunit.client.1.smithi152.stdout:3/310: read d7/dc/d3e/f53 [5272893,12039] 0 2023-12-07T16:21:32.939 INFO:tasks.workunit.client.1.smithi152.stdout:3/311: dread - d7/d10/d1a/d25/d3f/f51 zero size 2023-12-07T16:21:32.945 INFO:tasks.workunit.client.1.smithi152.stdout:0/329: rmdir d0/dc 39 2023-12-07T16:21:32.946 INFO:tasks.workunit.client.1.smithi152.stdout:6/286: rename d2/c15 to d2/c56 0 2023-12-07T16:21:32.946 INFO:tasks.workunit.client.1.smithi152.stdout:6/287: readlink d2/l3c 0 2023-12-07T16:21:32.949 INFO:tasks.workunit.client.1.smithi152.stdout:8/274: rename d3/l8 to d3/d4/d9/d34/l5d 0 2023-12-07T16:21:32.949 INFO:tasks.workunit.client.1.smithi152.stdout:0/330: dread d0/d27/f1f [0,4194304] 0 2023-12-07T16:21:32.952 INFO:tasks.workunit.client.1.smithi152.stdout:6/288: link d2/d6/f4d d2/d6/d9/f57 0 2023-12-07T16:21:32.953 INFO:tasks.workunit.client.1.smithi152.stdout:8/275: creat d3/d4/d4b/f5e x:0 0 0 2023-12-07T16:21:32.954 INFO:tasks.workunit.client.1.smithi152.stdout:8/276: write d3/d4/d9/dc/f4d [55738,105735] 0 2023-12-07T16:21:32.954 INFO:tasks.workunit.client.1.smithi152.stdout:8/277: write d3/d4/d9/dc/d1f/f31 [551,12333] 0 2023-12-07T16:21:32.954 INFO:tasks.workunit.client.1.smithi152.stdout:0/331: mkdir d0/d27/d11/d68 0 2023-12-07T16:21:32.955 INFO:tasks.workunit.client.1.smithi152.stdout:6/289: write d2/d6/fc [1139260,29297] 0 2023-12-07T16:21:32.956 INFO:tasks.workunit.client.1.smithi152.stdout:8/278: mkdir d3/d4/d9/d34/d5f 0 2023-12-07T16:21:32.956 INFO:tasks.workunit.client.1.smithi152.stdout:8/279: chown d3/d1e/f44 6 1 2023-12-07T16:21:32.958 INFO:tasks.workunit.client.1.smithi152.stdout:0/332: mkdir d0/dc/d36/d3a/d69 0 2023-12-07T16:21:32.958 INFO:tasks.workunit.client.1.smithi152.stdout:8/280: symlink d3/d4/d9/dc/l60 0 2023-12-07T16:21:32.960 INFO:tasks.workunit.client.1.smithi152.stdout:8/281: stat d3/d4/d4b/c4e 0 2023-12-07T16:21:32.960 INFO:tasks.workunit.client.1.smithi152.stdout:8/282: fsync d3/d4/d9/f18 0 2023-12-07T16:21:32.960 INFO:tasks.workunit.client.1.smithi152.stdout:8/283: write d3/d4/d9/dc/f4d [838220,1061] 0 2023-12-07T16:21:32.961 INFO:tasks.workunit.client.1.smithi152.stdout:8/284: creat d3/d4/d9/dc/d1f/f61 x:0 0 0 2023-12-07T16:21:32.963 INFO:tasks.workunit.client.1.smithi152.stdout:8/285: unlink d3/d4/l46 0 2023-12-07T16:21:32.963 INFO:tasks.workunit.client.1.smithi152.stdout:1/339: dwrite dc/f4d [4194304,4194304] 0 2023-12-07T16:21:32.963 INFO:tasks.workunit.client.1.smithi152.stdout:1/340: chown dc/d14/d18/l20 858 1 2023-12-07T16:21:32.966 INFO:tasks.workunit.client.1.smithi152.stdout:3/312: dwrite d7/d10/d19/f45 [0,4194304] 0 2023-12-07T16:21:32.966 INFO:tasks.workunit.client.1.smithi152.stdout:8/286: dread d3/d4/d9/d23/f36 [0,4194304] 0 2023-12-07T16:21:32.971 INFO:tasks.workunit.client.1.smithi152.stdout:3/313: link d7/d10/d1a/l58 d7/d10/d41/l5f 0 2023-12-07T16:21:32.974 INFO:tasks.workunit.client.1.smithi152.stdout:3/314: mkdir d7/d10/d1a/d2f/d60 0 2023-12-07T16:21:32.975 INFO:tasks.workunit.client.1.smithi152.stdout:6/290: dwrite d2/d6/d19/d1f/f47 [0,4194304] 0 2023-12-07T16:21:32.975 INFO:tasks.workunit.client.1.smithi152.stdout:6/291: fsync d2/d6/f1a 0 2023-12-07T16:21:32.976 INFO:tasks.workunit.client.1.smithi152.stdout:2/279: dread d2/d1c/d2e/d30/f3c [0,4194304] 0 2023-12-07T16:21:32.976 INFO:tasks.workunit.client.1.smithi152.stdout:2/280: chown d2/d9/le 15241173 1 2023-12-07T16:21:32.977 INFO:tasks.workunit.client.1.smithi152.stdout:3/315: mkdir d7/d10/d41/d61 0 2023-12-07T16:21:32.979 INFO:tasks.workunit.client.1.smithi152.stdout:6/292: write d2/f4 [3834694,83130] 0 2023-12-07T16:21:32.980 INFO:tasks.workunit.client.1.smithi152.stdout:2/281: link d2/d9/f2f d2/d9/d51/f63 0 2023-12-07T16:21:32.981 INFO:tasks.workunit.client.1.smithi152.stdout:3/316: mkdir d7/dc/d3e/d62 0 2023-12-07T16:21:32.983 INFO:tasks.workunit.client.1.smithi152.stdout:6/293: mkdir d2/d6/d9/d14/d58 0 2023-12-07T16:21:32.984 INFO:tasks.workunit.client.1.smithi152.stdout:3/317: unlink l5 0 2023-12-07T16:21:32.985 INFO:tasks.workunit.client.1.smithi152.stdout:3/318: chown d7/d10/d1a/d2f/d56 5135 1 2023-12-07T16:21:32.986 INFO:tasks.workunit.client.1.smithi152.stdout:6/294: creat d2/d6/de/d3f/f59 x:0 0 0 2023-12-07T16:21:32.986 INFO:tasks.workunit.client.1.smithi152.stdout:6/295: truncate d2/f24 1370522 0 2023-12-07T16:21:32.986 INFO:tasks.workunit.client.1.smithi152.stdout:6/296: readlink d2/d6/de/d2e/l3d 0 2023-12-07T16:21:32.988 INFO:tasks.workunit.client.1.smithi152.stdout:0/333: dwrite d0/d27/ff [0,4194304] 0 2023-12-07T16:21:32.988 INFO:tasks.workunit.client.1.smithi152.stdout:3/319: unlink d7/d10/d1a/d2f/c3b 0 2023-12-07T16:21:32.990 INFO:tasks.workunit.client.1.smithi152.stdout:6/297: symlink d2/d4f/l5a 0 2023-12-07T16:21:32.991 INFO:tasks.workunit.client.1.smithi152.stdout:0/334: creat d0/dc/d3d/d4c/f6a x:0 0 0 2023-12-07T16:21:32.994 INFO:tasks.workunit.client.1.smithi152.stdout:3/320: write d7/dc/d14/f15 [410860,61311] 0 2023-12-07T16:21:32.996 INFO:tasks.workunit.client.1.smithi152.stdout:3/321: dread - d7/dc/d14/f39 zero size 2023-12-07T16:21:32.996 INFO:tasks.workunit.client.1.smithi152.stdout:3/322: fdatasync d7/d10/d19/f4a 0 2023-12-07T16:21:32.997 INFO:tasks.workunit.client.1.smithi152.stdout:8/287: dwrite d3/d4/d9/dc/d1f/f37 [0,4194304] 0 2023-12-07T16:21:32.997 INFO:tasks.workunit.client.1.smithi152.stdout:8/288: chown d3/d4/d9/dc 2042733 1 2023-12-07T16:21:32.998 INFO:tasks.workunit.client.1.smithi152.stdout:3/323: mknod d7/c63 0 2023-12-07T16:21:32.998 INFO:tasks.workunit.client.1.smithi152.stdout:3/324: dread - d7/d10/d1a/d25/f27 zero size 2023-12-07T16:21:32.998 INFO:tasks.workunit.client.1.smithi152.stdout:6/298: dread d2/d6/d19/d1f/f47 [0,4194304] 0 2023-12-07T16:21:32.998 INFO:tasks.workunit.client.1.smithi152.stdout:2/282: dwrite d2/d1c/d2e/d38/f3b [0,4194304] 0 2023-12-07T16:21:32.999 INFO:tasks.workunit.client.1.smithi152.stdout:2/283: chown d2/d9 44213918 1 2023-12-07T16:21:32.999 INFO:tasks.workunit.client.1.smithi152.stdout:2/284: fdatasync d2/d1c/d2e/d30/d42/f45 0 2023-12-07T16:21:33.001 INFO:tasks.workunit.client.1.smithi152.stdout:8/289: creat d3/d4/d9/dc/d1f/f62 x:0 0 0 2023-12-07T16:21:33.005 INFO:tasks.workunit.client.1.smithi152.stdout:2/285: creat d2/d1c/d2e/f64 x:0 0 0 2023-12-07T16:21:33.005 INFO:tasks.workunit.client.1.smithi152.stdout:8/290: mkdir d3/d4/d9/dc/d1f/d63 0 2023-12-07T16:21:33.006 INFO:tasks.workunit.client.1.smithi152.stdout:8/291: chown d3/d4/c32 23034447 1 2023-12-07T16:21:33.007 INFO:tasks.workunit.client.1.smithi152.stdout:3/325: mknod d7/c64 0 2023-12-07T16:21:33.007 INFO:tasks.workunit.client.1.smithi152.stdout:3/326: write d7/d10/d1a/d25/d4b/f4d [719673,59960] 0 2023-12-07T16:21:33.007 INFO:tasks.workunit.client.1.smithi152.stdout:3/327: write d7/dc/d14/f39 [733033,27153] 0 2023-12-07T16:21:33.008 INFO:tasks.workunit.client.1.smithi152.stdout:2/286: mknod d2/d9/c65 0 2023-12-07T16:21:33.008 INFO:tasks.workunit.client.1.smithi152.stdout:2/287: chown d2/d1c/d2e/f64 0 1 2023-12-07T16:21:33.008 INFO:tasks.workunit.client.1.smithi152.stdout:2/288: fsync d2/d1c/d2e/d30/d33/f40 0 2023-12-07T16:21:33.008 INFO:tasks.workunit.client.1.smithi152.stdout:2/289: write d2/f8 [1789140,126255] 0 2023-12-07T16:21:33.009 INFO:tasks.workunit.client.1.smithi152.stdout:8/292: creat d3/d1e/d55/f64 x:0 0 0 2023-12-07T16:21:33.011 INFO:tasks.workunit.client.1.smithi152.stdout:2/290: symlink d2/d1c/d52/l66 0 2023-12-07T16:21:33.011 INFO:tasks.workunit.client.0.smithi063.stdout:3/11: sync 2023-12-07T16:21:33.011 INFO:tasks.workunit.client.0.smithi063.stdout:5/9: sync 2023-12-07T16:21:33.011 INFO:tasks.workunit.client.0.smithi063.stdout:3/12: fdatasync - no filename 2023-12-07T16:21:33.011 INFO:tasks.workunit.client.0.smithi063.stdout:9/22: sync 2023-12-07T16:21:33.011 INFO:tasks.workunit.client.0.smithi063.stdout:9/23: fsync d0/f3 0 2023-12-07T16:21:33.011 INFO:tasks.workunit.client.0.smithi063.stdout:5/10: truncate d1/f2 90027 0 2023-12-07T16:21:33.011 INFO:tasks.workunit.client.0.smithi063.stdout:4/3: sync 2023-12-07T16:21:33.012 INFO:tasks.workunit.client.0.smithi063.stdout:4/4: readlink - no filename 2023-12-07T16:21:33.012 INFO:tasks.workunit.client.0.smithi063.stdout:4/5: write - no filename 2023-12-07T16:21:33.012 INFO:tasks.workunit.client.0.smithi063.stdout:4/6: unlink - no file 2023-12-07T16:21:33.012 INFO:tasks.workunit.client.0.smithi063.stdout:2/17: sync 2023-12-07T16:21:33.012 INFO:tasks.workunit.client.0.smithi063.stdout:4/7: dread - no filename 2023-12-07T16:21:33.012 INFO:tasks.workunit.client.0.smithi063.stdout:4/8: link - no file 2023-12-07T16:21:33.012 INFO:tasks.workunit.client.0.smithi063.stdout:4/9: dread - no filename 2023-12-07T16:21:33.012 INFO:tasks.workunit.client.0.smithi063.stdout:7/17: sync 2023-12-07T16:21:33.012 INFO:tasks.workunit.client.0.smithi063.stdout:3/13: readlink l0 0 2023-12-07T16:21:33.012 INFO:tasks.workunit.client.0.smithi063.stdout:3/14: dread - no filename 2023-12-07T16:21:33.012 INFO:tasks.workunit.client.0.smithi063.stdout:3/15: write - no filename 2023-12-07T16:21:33.012 INFO:tasks.workunit.client.0.smithi063.stdout:3/16: dwrite - no filename 2023-12-07T16:21:33.013 INFO:tasks.workunit.client.0.smithi063.stdout:1/23: sync 2023-12-07T16:21:33.013 INFO:tasks.workunit.client.0.smithi063.stdout:6/11: sync 2023-12-07T16:21:33.013 INFO:tasks.workunit.client.0.smithi063.stdout:0/78: sync 2023-12-07T16:21:33.013 INFO:tasks.workunit.client.0.smithi063.stdout:8/104: sync 2023-12-07T16:21:33.013 INFO:tasks.workunit.client.0.smithi063.stdout:6/12: chown d0 3832872 1 2023-12-07T16:21:33.013 INFO:tasks.workunit.client.0.smithi063.stdout:1/24: fsync d0/f3 0 2023-12-07T16:21:33.014 INFO:tasks.workunit.client.1.smithi152.stdout:8/293: mknod d3/d1e/d55/c65 0 2023-12-07T16:21:33.014 INFO:tasks.workunit.client.1.smithi152.stdout:3/328: dread d7/d10/d19/f5b [0,4194304] 0 2023-12-07T16:21:33.014 INFO:tasks.workunit.client.0.smithi063.stdout:9/24: mkdir d0/d7 0 2023-12-07T16:21:33.014 INFO:tasks.workunit.client.0.smithi063.stdout:5/11: mkdir d1/d3 0 2023-12-07T16:21:33.017 INFO:tasks.workunit.client.0.smithi063.stdout:2/18: rename d0/c4 to d0/c5 0 2023-12-07T16:21:33.017 INFO:tasks.workunit.client.0.smithi063.stdout:4/10: creat f0 x:0 0 0 2023-12-07T16:21:33.018 INFO:tasks.workunit.client.0.smithi063.stdout:3/17: symlink l3 0 2023-12-07T16:21:33.019 INFO:tasks.workunit.client.0.smithi063.stdout:0/79: symlink d4/l1a 0 2023-12-07T16:21:33.020 INFO:tasks.workunit.client.0.smithi063.stdout:9/25: dread d0/f2 [4194304,4194304] 0 2023-12-07T16:21:33.021 INFO:tasks.workunit.client.1.smithi152.stdout:2/291: rename d2/d9/d51/l5f to d2/d9/l67 0 2023-12-07T16:21:33.021 INFO:tasks.workunit.client.1.smithi152.stdout:2/292: chown d2/d9/f2f 4788411 1 2023-12-07T16:21:33.021 INFO:tasks.workunit.client.1.smithi152.stdout:2/293: chown d2/d9/d51/f63 30837 1 2023-12-07T16:21:33.021 INFO:tasks.workunit.client.1.smithi152.stdout:8/294: mkdir d3/d4/d9/dc/d1f/d66 0 2023-12-07T16:21:33.022 INFO:tasks.workunit.client.0.smithi063.stdout:6/13: link d0/l2 d0/l3 0 2023-12-07T16:21:33.022 INFO:tasks.workunit.client.0.smithi063.stdout:1/25: creat d0/f7 x:0 0 0 2023-12-07T16:21:33.022 INFO:tasks.workunit.client.0.smithi063.stdout:6/14: dread - no filename 2023-12-07T16:21:33.023 INFO:tasks.workunit.client.0.smithi063.stdout:6/15: dread - no filename 2023-12-07T16:21:33.023 INFO:tasks.workunit.client.0.smithi063.stdout:1/26: write d0/f4 [73146,55051] 0 2023-12-07T16:21:33.023 INFO:tasks.workunit.client.0.smithi063.stdout:5/12: creat d1/d3/f4 x:0 0 0 2023-12-07T16:21:33.024 INFO:tasks.workunit.client.1.smithi152.stdout:2/294: creat d2/d1c/d2e/d57/f68 x:0 0 0 2023-12-07T16:21:33.026 INFO:tasks.workunit.client.0.smithi063.stdout:9/26: write d0/f2 [2909764,115781] 0 2023-12-07T16:21:33.026 INFO:tasks.workunit.client.0.smithi063.stdout:9/27: rename d0 to d0/d8 22 2023-12-07T16:21:33.026 INFO:tasks.workunit.client.0.smithi063.stdout:4/11: mkdir d1 0 2023-12-07T16:21:33.026 INFO:tasks.workunit.client.0.smithi063.stdout:4/12: rename d1 to d1/d2 22 2023-12-07T16:21:33.026 INFO:tasks.workunit.client.0.smithi063.stdout:4/13: readlink - no filename 2023-12-07T16:21:33.027 INFO:tasks.workunit.client.1.smithi152.stdout:3/329: rename d7/d10/c34 to d7/dc/d3e/c65 0 2023-12-07T16:21:33.027 INFO:tasks.workunit.client.0.smithi063.stdout:3/18: link l2 l4 0 2023-12-07T16:21:33.027 INFO:tasks.workunit.client.0.smithi063.stdout:3/19: fsync - no filename 2023-12-07T16:21:33.027 INFO:tasks.workunit.client.0.smithi063.stdout:3/20: write - no filename 2023-12-07T16:21:33.027 INFO:tasks.workunit.client.0.smithi063.stdout:3/21: dwrite - no filename 2023-12-07T16:21:33.027 INFO:tasks.workunit.client.0.smithi063.stdout:3/22: dwrite - no filename 2023-12-07T16:21:33.027 INFO:tasks.workunit.client.0.smithi063.stdout:3/23: read - no filename 2023-12-07T16:21:33.027 INFO:tasks.workunit.client.0.smithi063.stdout:3/24: dread - no filename 2023-12-07T16:21:33.027 INFO:tasks.workunit.client.0.smithi063.stdout:3/25: dread - no filename 2023-12-07T16:21:33.028 INFO:tasks.workunit.client.0.smithi063.stdout:3/26: dread - no filename 2023-12-07T16:21:33.028 INFO:tasks.workunit.client.0.smithi063.stdout:6/16: symlink d0/l4 0 2023-12-07T16:21:33.028 INFO:tasks.workunit.client.0.smithi063.stdout:2/19: creat d0/f6 x:0 0 0 2023-12-07T16:21:33.028 INFO:tasks.workunit.client.0.smithi063.stdout:2/20: truncate d0/f6 166871 0 2023-12-07T16:21:33.028 INFO:tasks.workunit.client.0.smithi063.stdout:5/13: mknod d1/c5 0 2023-12-07T16:21:33.028 INFO:tasks.workunit.client.0.smithi063.stdout:5/14: chown d1/c5 214514120 1 2023-12-07T16:21:33.029 INFO:tasks.workunit.client.0.smithi063.stdout:5/15: truncate d1/d3/f4 663628 0 2023-12-07T16:21:33.029 INFO:tasks.workunit.client.0.smithi063.stdout:5/16: chown d1/d3 433698576 1 2023-12-07T16:21:33.030 INFO:tasks.workunit.client.0.smithi063.stdout:4/14: mkdir d1/d3 0 2023-12-07T16:21:33.031 INFO:tasks.workunit.client.0.smithi063.stdout:6/17: symlink d0/l5 0 2023-12-07T16:21:33.031 INFO:tasks.workunit.client.0.smithi063.stdout:6/18: write - no filename 2023-12-07T16:21:33.031 INFO:tasks.workunit.client.0.smithi063.stdout:6/19: write - no filename 2023-12-07T16:21:33.031 INFO:tasks.workunit.client.0.smithi063.stdout:3/27: creat f5 x:0 0 0 2023-12-07T16:21:33.031 INFO:tasks.workunit.client.0.smithi063.stdout:5/17: creat d1/d3/f6 x:0 0 0 2023-12-07T16:21:33.033 INFO:tasks.workunit.client.1.smithi152.stdout:3/330: getdents d7/d10/d1a 0 2023-12-07T16:21:33.034 INFO:tasks.workunit.client.0.smithi063.stdout:6/20: unlink d0/l2 0 2023-12-07T16:21:33.034 INFO:tasks.workunit.client.0.smithi063.stdout:6/21: write - no filename 2023-12-07T16:21:33.034 INFO:tasks.workunit.client.0.smithi063.stdout:6/22: truncate - no filename 2023-12-07T16:21:33.034 INFO:tasks.workunit.client.0.smithi063.stdout:8/105: dwrite d7/f23 [4194304,4194304] 0 2023-12-07T16:21:33.034 INFO:tasks.workunit.client.0.smithi063.stdout:8/106: dread - d7/d14/d1a/f22 zero size 2023-12-07T16:21:33.034 INFO:tasks.workunit.client.0.smithi063.stdout:8/107: truncate d7/f24 526121 0 2023-12-07T16:21:33.034 INFO:tasks.workunit.client.0.smithi063.stdout:8/108: fdatasync f5 0 2023-12-07T16:21:33.035 INFO:tasks.workunit.client.0.smithi063.stdout:3/28: creat f6 x:0 0 0 2023-12-07T16:21:33.035 INFO:tasks.workunit.client.0.smithi063.stdout:3/29: write f5 [509902,128085] 0 2023-12-07T16:21:33.036 INFO:tasks.workunit.client.0.smithi063.stdout:5/18: read d1/f2 [40274,74376] 0 2023-12-07T16:21:33.036 INFO:tasks.workunit.client.0.smithi063.stdout:7/18: dwrite d2/f6 [0,4194304] 0 2023-12-07T16:21:33.036 INFO:tasks.workunit.client.0.smithi063.stdout:7/19: chown d2/f6 1844456 1 2023-12-07T16:21:33.036 INFO:tasks.workunit.client.0.smithi063.stdout:6/23: unlink d0/l5 0 2023-12-07T16:21:33.036 INFO:tasks.workunit.client.0.smithi063.stdout:6/24: dread - no filename 2023-12-07T16:21:33.036 INFO:tasks.workunit.client.0.smithi063.stdout:6/25: chown d0/l4 189620238 1 2023-12-07T16:21:33.040 INFO:tasks.workunit.client.0.smithi063.stdout:5/19: unlink d1/f2 0 2023-12-07T16:21:33.041 INFO:tasks.workunit.client.0.smithi063.stdout:6/26: link d0/l4 d0/l6 0 2023-12-07T16:21:33.041 INFO:tasks.workunit.client.0.smithi063.stdout:6/27: rename d0 to d0/d7 22 2023-12-07T16:21:33.041 INFO:tasks.workunit.client.0.smithi063.stdout:6/28: truncate - no filename 2023-12-07T16:21:33.042 INFO:tasks.workunit.client.1.smithi152.stdout:2/295: dread d2/d1c/d2e/d30/f3c [0,4194304] 0 2023-12-07T16:21:33.042 INFO:tasks.workunit.client.0.smithi063.stdout:7/20: creat d2/fa x:0 0 0 2023-12-07T16:21:33.042 INFO:tasks.workunit.client.0.smithi063.stdout:5/20: read d1/d3/f4 [635834,67724] 0 2023-12-07T16:21:33.044 INFO:tasks.workunit.client.0.smithi063.stdout:6/29: creat d0/f8 x:0 0 0 2023-12-07T16:21:33.044 INFO:tasks.workunit.client.0.smithi063.stdout:6/30: write d0/f8 [734909,67355] 0 2023-12-07T16:21:33.044 INFO:tasks.workunit.client.0.smithi063.stdout:0/80: dread d4/f17 [0,4194304] 0 2023-12-07T16:21:33.048 INFO:tasks.workunit.client.0.smithi063.stdout:0/81: link d4/l1a d4/dd/l1b 0 2023-12-07T16:21:33.048 INFO:tasks.workunit.client.0.smithi063.stdout:6/31: symlink d0/l9 0 2023-12-07T16:21:33.048 INFO:tasks.workunit.client.0.smithi063.stdout:5/21: creat d1/f7 x:0 0 0 2023-12-07T16:21:33.048 INFO:tasks.workunit.client.0.smithi063.stdout:5/22: write d1/d3/f6 [244095,21058] 0 2023-12-07T16:21:33.050 INFO:tasks.workunit.client.0.smithi063.stdout:6/32: stat d0/l3 0 2023-12-07T16:21:33.051 INFO:tasks.workunit.client.0.smithi063.stdout:6/33: write d0/f8 [1608147,56602] 0 2023-12-07T16:21:33.055 INFO:tasks.workunit.client.0.smithi063.stdout:6/34: creat d0/fa x:0 0 0 2023-12-07T16:21:33.060 INFO:tasks.workunit.client.0.smithi063.stdout:6/35: mkdir d0/db 0 2023-12-07T16:21:33.064 INFO:tasks.workunit.client.0.smithi063.stdout:2/21: dwrite d0/f6 [0,4194304] 0 2023-12-07T16:21:33.064 INFO:tasks.workunit.client.0.smithi063.stdout:2/22: readlink d0/l3 0 2023-12-07T16:21:33.064 INFO:tasks.workunit.client.0.smithi063.stdout:2/23: chown d0/c5 260319 1 2023-12-07T16:21:33.067 INFO:tasks.workunit.client.1.smithi152.stdout:2/296: dread d2/d47/f4b [0,4194304] 0 2023-12-07T16:21:33.067 INFO:tasks.workunit.client.1.smithi152.stdout:2/297: write f1 [5036718,11624] 0 2023-12-07T16:21:33.069 INFO:tasks.workunit.client.0.smithi063.stdout:6/36: write d0/f8 [1013960,84032] 0 2023-12-07T16:21:33.077 INFO:tasks.workunit.client.0.smithi063.stdout:8/109: dwrite d7/f23 [8388608,4194304] 0 2023-12-07T16:21:33.077 INFO:tasks.workunit.client.0.smithi063.stdout:8/110: chown f5 90420264 1 2023-12-07T16:21:33.077 INFO:tasks.workunit.client.0.smithi063.stdout:8/111: truncate d7/ff 4397492 0 2023-12-07T16:21:33.082 INFO:tasks.workunit.client.0.smithi063.stdout:7/21: dwrite f1 [4194304,4194304] 0 2023-12-07T16:21:33.087 INFO:tasks.workunit.client.0.smithi063.stdout:7/22: dread d2/f9 [0,4194304] 0 2023-12-07T16:21:33.089 INFO:tasks.workunit.client.0.smithi063.stdout:7/23: symlink d2/lb 0 2023-12-07T16:21:33.089 INFO:tasks.workunit.client.0.smithi063.stdout:7/24: chown d2/f7 1720506 1 2023-12-07T16:21:33.089 INFO:tasks.workunit.client.0.smithi063.stdout:7/25: chown f1 131026 1 2023-12-07T16:21:33.093 INFO:tasks.workunit.client.0.smithi063.stdout:9/28: dwrite d0/f2 [4194304,4194304] 0 2023-12-07T16:21:33.093 INFO:tasks.workunit.client.0.smithi063.stdout:0/82: dwrite d4/dd/de/f19 [0,4194304] 0 2023-12-07T16:21:33.093 INFO:tasks.workunit.client.0.smithi063.stdout:5/23: dwrite d1/f7 [0,4194304] 0 2023-12-07T16:21:33.093 INFO:tasks.workunit.client.0.smithi063.stdout:5/24: chown d1/c5 31030 1 2023-12-07T16:21:33.093 INFO:tasks.workunit.client.0.smithi063.stdout:4/15: dwrite f0 [0,4194304] 0 2023-12-07T16:21:33.093 INFO:tasks.workunit.client.0.smithi063.stdout:4/16: chown d1 115106 1 2023-12-07T16:21:33.094 INFO:tasks.workunit.client.0.smithi063.stdout:4/17: fsync f0 0 2023-12-07T16:21:33.094 INFO:tasks.workunit.client.0.smithi063.stdout:5/25: read d1/f7 [241358,110513] 0 2023-12-07T16:21:33.096 INFO:tasks.workunit.client.0.smithi063.stdout:8/112: dwrite d7/d14/d1a/f22 [0,4194304] 0 2023-12-07T16:21:33.097 INFO:tasks.workunit.client.0.smithi063.stdout:0/83: mknod d4/dd/de/c1c 0 2023-12-07T16:21:33.099 INFO:tasks.workunit.client.0.smithi063.stdout:9/29: write d0/f2 [1871838,85322] 0 2023-12-07T16:21:33.100 INFO:tasks.workunit.client.0.smithi063.stdout:5/26: creat d1/d3/f8 x:0 0 0 2023-12-07T16:21:33.106 INFO:tasks.workunit.client.0.smithi063.stdout:6/37: write d0/fa [57887,39277] 0 2023-12-07T16:21:33.108 INFO:tasks.workunit.client.0.smithi063.stdout:0/84: link d4/dd/de/f19 d4/dd/f1d 0 2023-12-07T16:21:33.109 INFO:tasks.workunit.client.0.smithi063.stdout:9/30: link d0/l5 d0/l9 0 2023-12-07T16:21:33.110 INFO:tasks.workunit.client.0.smithi063.stdout:2/24: truncate d0/f6 3144449 0 2023-12-07T16:21:33.112 INFO:tasks.workunit.client.0.smithi063.stdout:5/27: mknod d1/c9 0 2023-12-07T16:21:33.112 INFO:tasks.workunit.client.0.smithi063.stdout:5/28: write d1/d3/f8 [59887,70522] 0 2023-12-07T16:21:33.112 INFO:tasks.workunit.client.0.smithi063.stdout:9/31: read d0/f3 [2485374,16968] 0 2023-12-07T16:21:33.113 INFO:tasks.workunit.client.0.smithi063.stdout:8/113: mknod d7/d14/c26 0 2023-12-07T16:21:33.114 INFO:tasks.workunit.client.0.smithi063.stdout:7/26: getdents d2 0 2023-12-07T16:21:33.116 INFO:tasks.workunit.client.0.smithi063.stdout:0/85: unlink d4/dd/f1d 0 2023-12-07T16:21:33.116 INFO:tasks.workunit.client.0.smithi063.stdout:0/86: chown d4/f17 171976974 1 2023-12-07T16:21:33.116 INFO:tasks.workunit.client.0.smithi063.stdout:5/29: creat d1/d3/fa x:0 0 0 2023-12-07T16:21:33.117 INFO:tasks.workunit.client.0.smithi063.stdout:9/32: mknod d0/ca 0 2023-12-07T16:21:33.119 INFO:tasks.workunit.client.0.smithi063.stdout:8/114: dread - d7/d14/d15/f18 zero size 2023-12-07T16:21:33.119 INFO:tasks.workunit.client.0.smithi063.stdout:8/115: readlink d7/l25 0 2023-12-07T16:21:33.122 INFO:tasks.workunit.client.0.smithi063.stdout:6/38: mknod d0/db/cc 0 2023-12-07T16:21:33.122 INFO:tasks.workunit.client.0.smithi063.stdout:7/27: rename d2/lb to d2/lc 0 2023-12-07T16:21:33.125 INFO:tasks.workunit.client.0.smithi063.stdout:0/87: getdents d4 0 2023-12-07T16:21:33.131 INFO:tasks.workunit.client.0.smithi063.stdout:6/39: read d0/f8 [1054303,58861] 0 2023-12-07T16:21:33.131 INFO:tasks.workunit.client.0.smithi063.stdout:0/88: creat d4/dd/f1e x:0 0 0 2023-12-07T16:21:33.135 INFO:tasks.workunit.client.0.smithi063.stdout:7/28: rename f1 to d2/fd 0 2023-12-07T16:21:33.136 INFO:tasks.workunit.client.0.smithi063.stdout:0/89: write d4/fc [3189906,21724] 0 2023-12-07T16:21:33.136 INFO:tasks.workunit.client.0.smithi063.stdout:0/90: stat c1 0 2023-12-07T16:21:33.137 INFO:tasks.workunit.client.0.smithi063.stdout:0/91: mkdir d4/dd/de/d15/d1f 0 2023-12-07T16:21:33.137 INFO:tasks.workunit.client.0.smithi063.stdout:0/92: write d4/dd/de/d15/f18 [4904005,17640] 0 2023-12-07T16:21:33.138 INFO:tasks.workunit.client.0.smithi063.stdout:7/29: mkdir d2/de 0 2023-12-07T16:21:33.139 INFO:tasks.workunit.client.0.smithi063.stdout:7/30: creat d2/ff x:0 0 0 2023-12-07T16:21:33.149 INFO:tasks.workunit.client.0.smithi063.stdout:4/18: dwrite f0 [0,4194304] 0 2023-12-07T16:21:33.150 INFO:tasks.workunit.client.0.smithi063.stdout:4/19: write f0 [371146,103633] 0 2023-12-07T16:21:33.151 INFO:tasks.workunit.client.0.smithi063.stdout:4/20: creat d1/d3/f4 x:0 0 0 2023-12-07T16:21:33.152 INFO:tasks.workunit.client.0.smithi063.stdout:4/21: write f0 [1415341,21225] 0 2023-12-07T16:21:33.152 INFO:tasks.workunit.client.0.smithi063.stdout:4/22: write d1/d3/f4 [737551,124556] 0 2023-12-07T16:21:33.152 INFO:tasks.workunit.client.0.smithi063.stdout:4/23: write d1/d3/f4 [1555039,44614] 0 2023-12-07T16:21:33.153 INFO:tasks.workunit.client.0.smithi063.stdout:4/24: creat d1/d3/f5 x:0 0 0 2023-12-07T16:21:33.153 INFO:tasks.workunit.client.0.smithi063.stdout:4/25: write d1/d3/f4 [2509678,32807] 0 2023-12-07T16:21:33.154 INFO:tasks.workunit.client.0.smithi063.stdout:4/26: write f0 [3990012,73500] 0 2023-12-07T16:21:33.157 INFO:tasks.workunit.client.0.smithi063.stdout:9/33: dwrite d0/f2 [8388608,4194304] 0 2023-12-07T16:21:33.158 INFO:tasks.workunit.client.0.smithi063.stdout:5/30: dwrite d1/d3/f6 [0,4194304] 0 2023-12-07T16:21:33.158 INFO:tasks.workunit.client.0.smithi063.stdout:9/34: symlink d0/lb 0 2023-12-07T16:21:33.159 INFO:tasks.workunit.client.0.smithi063.stdout:8/116: dwrite d7/d14/d15/f18 [0,4194304] 0 2023-12-07T16:21:33.159 INFO:tasks.workunit.client.0.smithi063.stdout:0/93: fdatasync d4/dd/f14 0 2023-12-07T16:21:33.160 INFO:tasks.workunit.client.0.smithi063.stdout:5/31: symlink d1/d3/lb 0 2023-12-07T16:21:33.160 INFO:tasks.workunit.client.0.smithi063.stdout:9/35: creat d0/fc x:0 0 0 2023-12-07T16:21:33.162 INFO:tasks.workunit.client.0.smithi063.stdout:4/27: dread d1/d3/f4 [0,4194304] 0 2023-12-07T16:21:33.162 INFO:tasks.workunit.client.0.smithi063.stdout:4/28: stat d1/d3/f4 0 2023-12-07T16:21:33.163 INFO:tasks.workunit.client.0.smithi063.stdout:4/29: truncate d1/d3/f5 819286 0 2023-12-07T16:21:33.171 INFO:tasks.workunit.client.0.smithi063.stdout:5/32: mknod d1/d3/cc 0 2023-12-07T16:21:33.171 INFO:tasks.workunit.client.0.smithi063.stdout:8/117: creat d7/d14/f27 x:0 0 0 2023-12-07T16:21:33.171 INFO:tasks.workunit.client.0.smithi063.stdout:9/36: creat d0/fd x:0 0 0 2023-12-07T16:21:33.172 INFO:tasks.workunit.client.0.smithi063.stdout:6/40: getdents d0/db 0 2023-12-07T16:21:33.172 INFO:tasks.workunit.client.0.smithi063.stdout:9/37: chown d0/ca 0 1 2023-12-07T16:21:33.172 INFO:tasks.workunit.client.0.smithi063.stdout:7/31: truncate d2/f3 5140153 0 2023-12-07T16:21:33.172 INFO:tasks.workunit.client.0.smithi063.stdout:6/41: read d0/f8 [414605,4651] 0 2023-12-07T16:21:33.176 INFO:tasks.workunit.client.0.smithi063.stdout:0/94: dwrite d4/dd/de/f13 [0,4194304] 0 2023-12-07T16:21:33.182 INFO:tasks.workunit.client.0.smithi063.stdout:8/118: dread - d7/d14/f17 zero size 2023-12-07T16:21:33.182 INFO:tasks.workunit.client.0.smithi063.stdout:8/119: chown d7/d14/d1a 15351751 1 2023-12-07T16:21:33.182 INFO:tasks.workunit.client.0.smithi063.stdout:5/33: creat d1/fd x:0 0 0 2023-12-07T16:21:33.182 INFO:tasks.workunit.client.0.smithi063.stdout:5/34: chown d1/d3/f8 222 1 2023-12-07T16:21:33.183 INFO:tasks.workunit.client.0.smithi063.stdout:6/42: symlink d0/db/ld 0 2023-12-07T16:21:33.186 INFO:tasks.workunit.client.0.smithi063.stdout:0/95: link d4/f16 d4/dd/de/f20 0 2023-12-07T16:21:33.186 INFO:tasks.workunit.client.0.smithi063.stdout:0/96: getdents d4 0 2023-12-07T16:21:33.186 INFO:tasks.workunit.client.0.smithi063.stdout:0/97: chown d4/dd/l12 634 1 2023-12-07T16:21:33.187 INFO:tasks.workunit.client.0.smithi063.stdout:9/38: rename d0/fc to d0/d7/fe 0 2023-12-07T16:21:33.189 INFO:tasks.workunit.client.0.smithi063.stdout:5/35: mkdir d1/d3/de 0 2023-12-07T16:21:33.190 INFO:tasks.workunit.client.0.smithi063.stdout:6/43: readlink d0/l6 0 2023-12-07T16:21:33.192 INFO:tasks.workunit.client.0.smithi063.stdout:6/44: creat d0/fe x:0 0 0 2023-12-07T16:21:33.193 INFO:tasks.workunit.client.1.smithi152.stdout:3/331: link d7/d10/d1a/d25/d3f/f46 d7/d10/d1a/d2f/d60/f66 0 2023-12-07T16:21:33.193 INFO:tasks.workunit.client.0.smithi063.stdout:4/30: truncate f0 308722 0 2023-12-07T16:21:33.195 INFO:tasks.workunit.client.0.smithi063.stdout:0/98: dread d4/fb [0,4194304] 0 2023-12-07T16:21:33.196 INFO:tasks.workunit.client.1.smithi152.stdout:2/298: unlink d2/d9/l10 0 2023-12-07T16:21:33.196 INFO:tasks.workunit.client.1.smithi152.stdout:2/299: truncate d2/d1c/d2e/f3e 1037175 0 2023-12-07T16:21:33.196 INFO:tasks.workunit.client.0.smithi063.stdout:0/99: creat d4/dd/de/d15/f21 x:0 0 0 2023-12-07T16:21:33.196 INFO:tasks.workunit.client.0.smithi063.stdout:0/100: chown d4/dd/f1e 1 1 2023-12-07T16:21:33.198 INFO:tasks.workunit.client.0.smithi063.stdout:0/101: getdents d4/dd/de 0 2023-12-07T16:21:33.199 INFO:tasks.workunit.client.0.smithi063.stdout:5/36: dread d1/d3/f6 [0,4194304] 0 2023-12-07T16:21:33.200 INFO:tasks.workunit.client.0.smithi063.stdout:8/120: dwrite d7/f1b [0,4194304] 0 2023-12-07T16:21:33.200 INFO:tasks.workunit.client.0.smithi063.stdout:4/31: dread d1/d3/f4 [0,4194304] 0 2023-12-07T16:21:33.203 INFO:tasks.workunit.client.0.smithi063.stdout:5/37: mknod d1/d3/de/cf 0 2023-12-07T16:21:33.203 INFO:tasks.workunit.client.0.smithi063.stdout:5/38: chown d1/c9 450913 1 2023-12-07T16:21:33.206 INFO:tasks.workunit.client.0.smithi063.stdout:8/121: write d7/f1b [2047834,46144] 0 2023-12-07T16:21:33.206 INFO:tasks.workunit.client.0.smithi063.stdout:4/32: creat d1/f6 x:0 0 0 2023-12-07T16:21:33.208 INFO:tasks.workunit.client.0.smithi063.stdout:6/45: dread d0/f8 [0,4194304] 0 2023-12-07T16:21:33.208 INFO:tasks.workunit.client.0.smithi063.stdout:6/46: fdatasync d0/fe 0 2023-12-07T16:21:33.208 INFO:tasks.workunit.client.0.smithi063.stdout:6/47: truncate d0/f8 2292100 0 2023-12-07T16:21:33.208 INFO:tasks.workunit.client.0.smithi063.stdout:5/39: rename d1/d3/f8 to d1/d3/de/f10 0 2023-12-07T16:21:33.208 INFO:tasks.workunit.client.0.smithi063.stdout:8/122: creat d7/d14/f28 x:0 0 0 2023-12-07T16:21:33.208 INFO:tasks.workunit.client.0.smithi063.stdout:8/123: chown d7/l25 0 1 2023-12-07T16:21:33.209 INFO:tasks.workunit.client.0.smithi063.stdout:6/48: getdents d0/db 0 2023-12-07T16:21:33.209 INFO:tasks.workunit.client.0.smithi063.stdout:6/49: getdents d0/db 0 2023-12-07T16:21:33.209 INFO:tasks.workunit.client.0.smithi063.stdout:4/33: write d1/d3/f4 [1377750,35335] 0 2023-12-07T16:21:33.210 INFO:tasks.workunit.client.1.smithi152.stdout:3/332: mknod d7/d10/d1a/d2f/d5c/c67 0 2023-12-07T16:21:33.210 INFO:tasks.workunit.client.1.smithi152.stdout:8/295: rmdir d3 39 2023-12-07T16:21:33.212 INFO:tasks.workunit.client.0.smithi063.stdout:0/102: truncate d4/dd/de/d15/f18 39351 0 2023-12-07T16:21:33.212 INFO:tasks.workunit.client.0.smithi063.stdout:6/50: creat d0/ff x:0 0 0 2023-12-07T16:21:33.214 INFO:tasks.workunit.client.0.smithi063.stdout:4/34: unlink d1/f6 0 2023-12-07T16:21:33.214 INFO:tasks.workunit.client.0.smithi063.stdout:6/51: dread d0/fa [0,4194304] 0 2023-12-07T16:21:33.214 INFO:tasks.workunit.client.0.smithi063.stdout:6/52: read - d0/fe zero size 2023-12-07T16:21:33.215 INFO:tasks.workunit.client.0.smithi063.stdout:6/53: getdents d0/db 0 2023-12-07T16:21:33.215 INFO:tasks.workunit.client.0.smithi063.stdout:6/54: write d0/fa [998726,60502] 0 2023-12-07T16:21:33.216 INFO:tasks.workunit.client.1.smithi152.stdout:8/296: mkdir d3/d4/d9/dc/d1f/d63/d67 0 2023-12-07T16:21:33.216 INFO:tasks.workunit.client.1.smithi152.stdout:8/297: fsync d3/d4/d9/dc/f4d 0 2023-12-07T16:21:33.216 INFO:tasks.workunit.client.0.smithi063.stdout:0/103: mkdir d4/dd/de/d15/d1f/d22 0 2023-12-07T16:21:33.216 INFO:tasks.workunit.client.0.smithi063.stdout:0/104: dread - d4/dd/f1e zero size 2023-12-07T16:21:33.218 INFO:tasks.workunit.client.1.smithi152.stdout:8/298: mknod d3/d4/d9/dc/d1f/d63/c68 0 2023-12-07T16:21:33.218 INFO:tasks.workunit.client.1.smithi152.stdout:8/299: fdatasync d3/d1e/d55/f64 0 2023-12-07T16:21:33.218 INFO:tasks.workunit.client.0.smithi063.stdout:6/55: mknod d0/db/c10 0 2023-12-07T16:21:33.219 INFO:tasks.workunit.client.0.smithi063.stdout:8/124: dread d7/d14/d1a/f22 [0,4194304] 0 2023-12-07T16:21:33.219 INFO:tasks.workunit.client.0.smithi063.stdout:8/125: write d7/f24 [433408,130130] 0 2023-12-07T16:21:33.219 INFO:tasks.workunit.client.0.smithi063.stdout:0/105: link d4/f17 d4/dd/de/d15/d1f/d22/f23 0 2023-12-07T16:21:33.220 INFO:tasks.workunit.client.1.smithi152.stdout:8/300: write d3/d4/f35 [1203127,16458] 0 2023-12-07T16:21:33.221 INFO:tasks.workunit.client.0.smithi063.stdout:8/126: creat d7/d14/d1a/f29 x:0 0 0 2023-12-07T16:21:33.223 INFO:tasks.workunit.client.0.smithi063.stdout:0/106: unlink d4/dd/de/l11 0 2023-12-07T16:21:33.223 INFO:tasks.workunit.client.0.smithi063.stdout:8/127: mknod d7/d14/d15/c2a 0 2023-12-07T16:21:33.224 INFO:tasks.workunit.client.1.smithi152.stdout:9/389: sync 2023-12-07T16:21:33.224 INFO:tasks.workunit.client.0.smithi063.stdout:4/35: fsync d1/d3/f4 0 2023-12-07T16:21:33.224 INFO:tasks.workunit.client.0.smithi063.stdout:4/36: fdatasync f0 0 2023-12-07T16:21:33.225 INFO:tasks.workunit.client.0.smithi063.stdout:0/107: creat d4/dd/de/f24 x:0 0 0 2023-12-07T16:21:33.225 INFO:tasks.workunit.client.1.smithi152.stdout:2/300: dwrite d2/d1c/d2e/f46 [0,4194304] 0 2023-12-07T16:21:33.227 INFO:tasks.workunit.client.0.smithi063.stdout:8/128: unlink d7/f23 0 2023-12-07T16:21:33.228 INFO:tasks.workunit.client.0.smithi063.stdout:9/39: dwrite d0/d7/fe [0,4194304] 0 2023-12-07T16:21:33.230 INFO:tasks.workunit.client.0.smithi063.stdout:4/37: mknod d1/c7 0 2023-12-07T16:21:33.233 INFO:tasks.workunit.client.1.smithi152.stdout:2/301: rename d2/d9/f4e to d2/d1c/f69 0 2023-12-07T16:21:33.233 INFO:tasks.workunit.client.0.smithi063.stdout:0/108: mkdir d4/d25 0 2023-12-07T16:21:33.233 INFO:tasks.workunit.client.0.smithi063.stdout:5/40: rmdir d1/d3 39 2023-12-07T16:21:33.234 INFO:tasks.workunit.client.0.smithi063.stdout:8/129: mkdir d7/d14/d15/d2b 0 2023-12-07T16:21:33.234 INFO:tasks.workunit.client.1.smithi152.stdout:2/302: symlink d2/d1c/d2e/d30/l6a 0 2023-12-07T16:21:33.236 INFO:tasks.workunit.client.1.smithi152.stdout:2/303: creat d2/d1c/d52/f6b x:0 0 0 2023-12-07T16:21:33.238 INFO:tasks.workunit.client.0.smithi063.stdout:9/40: link d0/f2 d0/d7/ff 0 2023-12-07T16:21:33.241 INFO:tasks.workunit.client.1.smithi152.stdout:2/304: symlink d2/d1c/d2e/d30/l6c 0 2023-12-07T16:21:33.241 INFO:tasks.workunit.client.1.smithi152.stdout:2/305: chown d2/d1c/l3f 0 1 2023-12-07T16:21:33.245 INFO:tasks.workunit.client.0.smithi063.stdout:8/130: mknod d7/d14/d15/d2b/c2c 0 2023-12-07T16:21:33.245 INFO:tasks.workunit.client.1.smithi152.stdout:2/306: link d2/d47/f39 d2/d1c/d2e/d30/d42/f6d 0 2023-12-07T16:21:33.247 INFO:tasks.workunit.client.0.smithi063.stdout:8/131: creat d7/d14/d15/f2d x:0 0 0 2023-12-07T16:21:33.247 INFO:tasks.workunit.client.0.smithi063.stdout:8/132: truncate d7/d14/f17 232183 0 2023-12-07T16:21:33.248 INFO:tasks.workunit.client.0.smithi063.stdout:8/133: read f5 [3171202,82132] 0 2023-12-07T16:21:33.248 INFO:tasks.workunit.client.1.smithi152.stdout:2/307: creat d2/d1c/d2e/d57/f6e x:0 0 0 2023-12-07T16:21:33.249 INFO:tasks.workunit.client.0.smithi063.stdout:5/41: dread d1/d3/f6 [0,4194304] 0 2023-12-07T16:21:33.249 INFO:tasks.workunit.client.0.smithi063.stdout:5/42: dread - d1/d3/fa zero size 2023-12-07T16:21:33.251 INFO:tasks.workunit.client.0.smithi063.stdout:8/134: write d7/f9 [1779270,14336] 0 2023-12-07T16:21:33.251 INFO:tasks.workunit.client.0.smithi063.stdout:8/135: stat d7/c1e 0 2023-12-07T16:21:33.251 INFO:tasks.workunit.client.0.smithi063.stdout:8/136: write d7/d14/d15/f2d [199695,11835] 0 2023-12-07T16:21:33.251 INFO:tasks.workunit.client.0.smithi063.stdout:8/137: dread - d7/d14/f27 zero size 2023-12-07T16:21:33.251 INFO:tasks.workunit.client.0.smithi063.stdout:5/43: rmdir d1/d3 39 2023-12-07T16:21:33.252 INFO:tasks.workunit.client.1.smithi152.stdout:2/308: creat d2/d9/f6f x:0 0 0 2023-12-07T16:21:33.252 INFO:tasks.workunit.client.1.smithi152.stdout:2/309: chown d2/d1c/d2e 246300 1 2023-12-07T16:21:33.252 INFO:tasks.workunit.client.1.smithi152.stdout:3/333: dwrite d7/dc/d14/f16 [0,4194304] 0 2023-12-07T16:21:33.252 INFO:tasks.workunit.client.1.smithi152.stdout:3/334: stat d7/d10/d1a/d25/l29 0 2023-12-07T16:21:33.252 INFO:tasks.workunit.client.1.smithi152.stdout:3/335: stat d7/dc/c3c 0 2023-12-07T16:21:33.252 INFO:tasks.workunit.client.1.smithi152.stdout:3/336: fsync d7/d10/d1a/d2f/f22 0 2023-12-07T16:21:33.252 INFO:tasks.workunit.client.1.smithi152.stdout:3/337: mkdir d7/d10/d1a/d25/d4b/d68 0 2023-12-07T16:21:33.253 INFO:tasks.workunit.client.0.smithi063.stdout:8/138: mknod d7/d14/d15/d2b/c2e 0 2023-12-07T16:21:33.254 INFO:tasks.workunit.client.1.smithi152.stdout:9/390: dwrite d1/d9/db/f79 [0,4194304] 0 2023-12-07T16:21:33.254 INFO:tasks.workunit.client.1.smithi152.stdout:2/310: rename d2/d1c/d2e/d30/d42/f45 to d2/f70 0 2023-12-07T16:21:33.256 INFO:tasks.workunit.client.0.smithi063.stdout:6/56: rename d0/db to d0/d11 0 2023-12-07T16:21:33.256 INFO:tasks.workunit.client.0.smithi063.stdout:6/57: chown d0/fa 211806388 1 2023-12-07T16:21:33.257 INFO:tasks.workunit.client.0.smithi063.stdout:5/44: getdents d1 0 2023-12-07T16:21:33.257 INFO:tasks.workunit.client.0.smithi063.stdout:5/45: write d1/f7 [4937986,24224] 0 2023-12-07T16:21:33.258 INFO:tasks.workunit.client.1.smithi152.stdout:9/391: creat d1/d17/d58/d86/f87 x:0 0 0 2023-12-07T16:21:33.258 INFO:tasks.workunit.client.1.smithi152.stdout:9/392: chown d1/d9/db 1129305 1 2023-12-07T16:21:33.262 INFO:tasks.workunit.client.1.smithi152.stdout:8/301: dwrite d3/d4/d9/dc/d1f/f37 [0,4194304] 0 2023-12-07T16:21:33.262 INFO:tasks.workunit.client.0.smithi063.stdout:8/139: dread d7/d14/d15/f18 [0,4194304] 0 2023-12-07T16:21:33.265 INFO:tasks.workunit.client.1.smithi152.stdout:8/302: creat d3/d1e/d40/f69 x:0 0 0 2023-12-07T16:21:33.265 INFO:tasks.workunit.client.1.smithi152.stdout:8/303: fsync d3/d4/d9/dc/d1f/f59 0 2023-12-07T16:21:33.265 INFO:tasks.workunit.client.1.smithi152.stdout:8/304: write d3/f1d [2336405,112543] 0 2023-12-07T16:21:33.265 INFO:tasks.workunit.client.1.smithi152.stdout:8/305: write d3/d4/d9/d23/f25 [5089806,77894] 0 2023-12-07T16:21:33.265 INFO:tasks.workunit.client.1.smithi152.stdout:8/306: readlink d3/d4/l52 0 2023-12-07T16:21:33.265 INFO:tasks.workunit.client.1.smithi152.stdout:8/307: chown d3/d4/d9/dc/d1f/f59 83017600 1 2023-12-07T16:21:33.266 INFO:tasks.workunit.client.0.smithi063.stdout:5/46: rename d1/d3/f6 to d1/f11 0 2023-12-07T16:21:33.266 INFO:tasks.workunit.client.0.smithi063.stdout:8/140: read d7/d14/d1a/f22 [3243007,52931] 0 2023-12-07T16:21:33.267 INFO:tasks.workunit.client.1.smithi152.stdout:3/338: dread d7/f8 [0,4194304] 0 2023-12-07T16:21:33.268 INFO:tasks.workunit.client.0.smithi063.stdout:5/47: dread - d1/fd zero size 2023-12-07T16:21:33.268 INFO:tasks.workunit.client.1.smithi152.stdout:8/308: mknod d3/d1e/d43/c6a 0 2023-12-07T16:21:33.269 INFO:tasks.workunit.client.0.smithi063.stdout:4/38: dwrite d1/d3/f5 [0,4194304] 0 2023-12-07T16:21:33.269 INFO:tasks.workunit.client.1.smithi152.stdout:3/339: creat d7/dc/d14/f69 x:0 0 0 2023-12-07T16:21:33.270 INFO:tasks.workunit.client.0.smithi063.stdout:8/141: creat d7/d14/d15/f2f x:0 0 0 2023-12-07T16:21:33.271 INFO:tasks.workunit.client.1.smithi152.stdout:3/340: creat d7/d10/d1a/d25/f6a x:0 0 0 2023-12-07T16:21:33.271 INFO:tasks.workunit.client.1.smithi152.stdout:3/341: readlink d7/dc/l13 0 2023-12-07T16:21:33.271 INFO:tasks.workunit.client.1.smithi152.stdout:3/342: read - d7/f5a zero size 2023-12-07T16:21:33.272 INFO:tasks.workunit.client.0.smithi063.stdout:9/41: dwrite d0/f2 [0,4194304] 0 2023-12-07T16:21:33.275 INFO:tasks.workunit.client.0.smithi063.stdout:0/109: fsync d4/dd/de/f24 0 2023-12-07T16:21:33.278 INFO:tasks.workunit.client.0.smithi063.stdout:4/39: link d1/d3/f4 d1/d3/f8 0 2023-12-07T16:21:33.279 INFO:tasks.workunit.client.0.smithi063.stdout:0/110: truncate d4/dd/de/f19 5030406 0 2023-12-07T16:21:33.281 INFO:tasks.workunit.client.0.smithi063.stdout:4/40: unlink f0 0 2023-12-07T16:21:33.283 INFO:tasks.workunit.client.0.smithi063.stdout:0/111: mkdir d4/dd/d26 0 2023-12-07T16:21:33.283 INFO:tasks.workunit.client.0.smithi063.stdout:8/142: write d7/f1b [3102539,48889] 0 2023-12-07T16:21:33.284 INFO:tasks.workunit.client.0.smithi063.stdout:4/41: symlink d1/d3/l9 0 2023-12-07T16:21:33.284 INFO:tasks.workunit.client.0.smithi063.stdout:9/42: write d0/f3 [2961590,59283] 0 2023-12-07T16:21:33.285 INFO:tasks.workunit.client.0.smithi063.stdout:0/112: mknod d4/dd/d26/c27 0 2023-12-07T16:21:33.285 INFO:tasks.workunit.client.0.smithi063.stdout:0/113: dread - d4/dd/de/f24 zero size 2023-12-07T16:21:33.286 INFO:tasks.workunit.client.0.smithi063.stdout:8/143: mknod d7/c30 0 2023-12-07T16:21:33.287 INFO:tasks.workunit.client.1.smithi152.stdout:2/311: dwrite d2/d1c/d2e/d30/f3c [0,4194304] 0 2023-12-07T16:21:33.287 INFO:tasks.workunit.client.1.smithi152.stdout:2/312: chown d2/d1c/d2e/d57/f6e 14117709 1 2023-12-07T16:21:33.291 INFO:tasks.workunit.client.0.smithi063.stdout:8/144: creat d7/d14/d1a/f31 x:0 0 0 2023-12-07T16:21:33.291 INFO:tasks.workunit.client.0.smithi063.stdout:8/145: chown d7/c11 84045 1 2023-12-07T16:21:33.291 INFO:tasks.workunit.client.0.smithi063.stdout:9/43: mknod d0/d7/c10 0 2023-12-07T16:21:33.292 INFO:tasks.workunit.client.0.smithi063.stdout:4/42: dread d1/d3/f8 [0,4194304] 0 2023-12-07T16:21:33.293 INFO:tasks.workunit.client.1.smithi152.stdout:5/326: sync 2023-12-07T16:21:33.293 INFO:tasks.workunit.client.1.smithi152.stdout:5/327: write dd/de/d14/f63 [5113223,121131] 0 2023-12-07T16:21:33.293 INFO:tasks.workunit.client.1.smithi152.stdout:5/328: chown dd/de/f32 296757 1 2023-12-07T16:21:33.294 INFO:tasks.workunit.client.1.smithi152.stdout:9/393: dwrite d1/d9/db/f36 [0,4194304] 0 2023-12-07T16:21:33.294 INFO:tasks.workunit.client.0.smithi063.stdout:8/146: write d7/d14/d15/f18 [1465068,42943] 0 2023-12-07T16:21:33.295 INFO:tasks.workunit.client.1.smithi152.stdout:8/309: dwrite d3/d4/d9/f1c [0,4194304] 0 2023-12-07T16:21:33.295 INFO:tasks.workunit.client.1.smithi152.stdout:8/310: fsync d3/d4/d9/dc/d1f/f58 0 2023-12-07T16:21:33.295 INFO:tasks.workunit.client.1.smithi152.stdout:3/343: dwrite d7/f3d [0,4194304] 0 2023-12-07T16:21:33.296 INFO:tasks.workunit.client.0.smithi063.stdout:4/43: dread d1/d3/f8 [0,4194304] 0 2023-12-07T16:21:33.296 INFO:tasks.workunit.client.1.smithi152.stdout:5/329: rmdir dd/de/d38/d3d/d66 0 2023-12-07T16:21:33.297 INFO:tasks.workunit.client.0.smithi063.stdout:6/58: getdents d0 0 2023-12-07T16:21:33.300 INFO:tasks.workunit.client.1.smithi152.stdout:8/311: symlink d3/d4/d9/d34/l6b 0 2023-12-07T16:21:33.301 INFO:tasks.workunit.client.0.smithi063.stdout:8/147: mknod d7/d14/d15/d2b/c32 0 2023-12-07T16:21:33.301 INFO:tasks.workunit.client.0.smithi063.stdout:6/59: creat d0/d11/f12 x:0 0 0 2023-12-07T16:21:33.302 INFO:tasks.workunit.client.1.smithi152.stdout:3/344: mkdir d7/dc/d3e/d6b 0 2023-12-07T16:21:33.302 INFO:tasks.workunit.client.1.smithi152.stdout:3/345: readlink d7/dc/d3e/d48/l55 0 2023-12-07T16:21:33.302 INFO:tasks.workunit.client.1.smithi152.stdout:5/330: mknod dd/de/d14/d1f/c6a 0 2023-12-07T16:21:33.304 INFO:tasks.workunit.client.1.smithi152.stdout:8/312: creat d3/d4/d9/dc/d1f/f6c x:0 0 0 2023-12-07T16:21:33.306 INFO:tasks.workunit.client.1.smithi152.stdout:3/346: mkdir d7/dc/d3e/d6c 0 2023-12-07T16:21:33.306 INFO:tasks.workunit.client.1.smithi152.stdout:3/347: chown d7/dc/l47 1777285428 1 2023-12-07T16:21:33.307 INFO:tasks.workunit.client.1.smithi152.stdout:5/331: mknod dd/de/d14/d67/c6b 0 2023-12-07T16:21:33.308 INFO:tasks.workunit.client.1.smithi152.stdout:3/348: write d7/f52 [1059225,57904] 0 2023-12-07T16:21:33.309 INFO:tasks.workunit.client.0.smithi063.stdout:6/60: symlink d0/l13 0 2023-12-07T16:21:33.309 INFO:tasks.workunit.client.1.smithi152.stdout:8/313: rename d3/d4/d9/dc/d1f/f58 to d3/d4/d9/d34/d5f/f6d 0 2023-12-07T16:21:33.310 INFO:tasks.workunit.client.1.smithi152.stdout:5/332: creat dd/de/d14/d19/f6c x:0 0 0 2023-12-07T16:21:33.311 INFO:tasks.workunit.client.0.smithi063.stdout:0/114: dwrite d4/dd/f1e [0,4194304] 0 2023-12-07T16:21:33.311 INFO:tasks.workunit.client.0.smithi063.stdout:6/61: symlink d0/l14 0 2023-12-07T16:21:33.311 INFO:tasks.workunit.client.1.smithi152.stdout:3/349: mkdir d7/dc/d3e/d62/d6d 0 2023-12-07T16:21:33.312 INFO:tasks.workunit.client.1.smithi152.stdout:8/314: creat d3/d1e/d40/f6e x:0 0 0 2023-12-07T16:21:33.312 INFO:tasks.workunit.client.1.smithi152.stdout:8/315: chown d3/d4/d9/dc/d1f/d63/c68 0 1 2023-12-07T16:21:33.312 INFO:tasks.workunit.client.1.smithi152.stdout:8/316: read d3/d4/d9/f38 [1434975,125095] 0 2023-12-07T16:21:33.313 INFO:tasks.workunit.client.0.smithi063.stdout:0/115: mknod d4/c28 0 2023-12-07T16:21:33.314 INFO:tasks.workunit.client.1.smithi152.stdout:5/333: mkdir dd/de/d38/d3d/d6d 0 2023-12-07T16:21:33.314 INFO:tasks.workunit.client.1.smithi152.stdout:5/334: chown dd/l50 2535106 1 2023-12-07T16:21:33.314 INFO:tasks.workunit.client.1.smithi152.stdout:3/350: creat d7/d10/d41/f6e x:0 0 0 2023-12-07T16:21:33.316 INFO:tasks.workunit.client.0.smithi063.stdout:6/62: creat d0/f15 x:0 0 0 2023-12-07T16:21:33.316 INFO:tasks.workunit.client.1.smithi152.stdout:7/273: sync 2023-12-07T16:21:33.316 INFO:tasks.workunit.client.1.smithi152.stdout:7/274: read - db/d27/d39/d41/f4f zero size 2023-12-07T16:21:33.316 INFO:tasks.workunit.client.1.smithi152.stdout:8/317: mkdir d3/d4/d9/dc/d6f 0 2023-12-07T16:21:33.316 INFO:tasks.workunit.client.1.smithi152.stdout:0/335: sync 2023-12-07T16:21:33.316 INFO:tasks.workunit.client.1.smithi152.stdout:7/275: readlink db/d27/d39/l1f 0 2023-12-07T16:21:33.316 INFO:tasks.workunit.client.1.smithi152.stdout:3/351: creat d7/d10/d1a/d25/d3f/f6f x:0 0 0 2023-12-07T16:21:33.316 INFO:tasks.workunit.client.1.smithi152.stdout:3/352: stat d7/d10/l24 0 2023-12-07T16:21:33.317 INFO:tasks.workunit.client.0.smithi063.stdout:6/63: mkdir d0/d16 0 2023-12-07T16:21:33.317 INFO:tasks.workunit.client.1.smithi152.stdout:0/336: symlink d0/dc/d36/d3a/d51/l6b 0 2023-12-07T16:21:33.318 INFO:tasks.workunit.client.1.smithi152.stdout:8/318: symlink d3/d1e/d43/l70 0 2023-12-07T16:21:33.319 INFO:tasks.workunit.client.1.smithi152.stdout:4/289: sync 2023-12-07T16:21:33.319 INFO:tasks.workunit.client.1.smithi152.stdout:6/299: sync 2023-12-07T16:21:33.319 INFO:tasks.workunit.client.1.smithi152.stdout:6/300: write d2/d6/fc [5610350,103896] 0 2023-12-07T16:21:33.319 INFO:tasks.workunit.client.1.smithi152.stdout:6/301: readlink d2/d6/d9/l2b 0 2023-12-07T16:21:33.319 INFO:tasks.workunit.client.1.smithi152.stdout:1/341: sync 2023-12-07T16:21:33.319 INFO:tasks.workunit.client.0.smithi063.stdout:5/48: dwrite d1/f7 [0,4194304] 0 2023-12-07T16:21:33.320 INFO:tasks.workunit.client.1.smithi152.stdout:3/353: mkdir d7/d10/d41/d70 0 2023-12-07T16:21:33.320 INFO:tasks.workunit.client.0.smithi063.stdout:6/64: rename d0/d16 to d0/d17 0 2023-12-07T16:21:33.320 INFO:tasks.workunit.client.0.smithi063.stdout:6/65: read - d0/f15 zero size 2023-12-07T16:21:33.321 INFO:tasks.workunit.client.1.smithi152.stdout:7/276: write db/d1c/f28 [3387426,83258] 0 2023-12-07T16:21:33.321 INFO:tasks.workunit.client.1.smithi152.stdout:0/337: mkdir d0/dc/d3d/d6c 0 2023-12-07T16:21:33.321 INFO:tasks.workunit.client.1.smithi152.stdout:0/338: write d0/d27/f59 [4281369,123384] 0 2023-12-07T16:21:33.322 INFO:tasks.workunit.client.1.smithi152.stdout:0/339: read d0/d27/f59 [1213911,76263] 0 2023-12-07T16:21:33.322 INFO:tasks.workunit.client.1.smithi152.stdout:0/340: chown d0/f38 0 1 2023-12-07T16:21:33.323 INFO:tasks.workunit.client.1.smithi152.stdout:9/394: dwrite d1/d9/d2d/d65/f73 [0,4194304] 0 2023-12-07T16:21:33.323 INFO:tasks.workunit.client.1.smithi152.stdout:6/302: symlink d2/d6/d9/d14/d58/l5b 0 2023-12-07T16:21:33.324 INFO:tasks.workunit.client.1.smithi152.stdout:1/342: symlink dc/d14/d18/d64/l66 0 2023-12-07T16:21:33.324 INFO:tasks.workunit.client.1.smithi152.stdout:4/290: creat d0/d3/d6/dc/d3a/d48/d4c/f52 x:0 0 0 2023-12-07T16:21:33.325 INFO:tasks.workunit.client.1.smithi152.stdout:5/335: dread dd/de/d17/f33 [0,4194304] 0 2023-12-07T16:21:33.325 INFO:tasks.workunit.client.0.smithi063.stdout:5/49: truncate d1/d3/de/f10 1075490 0 2023-12-07T16:21:33.325 INFO:tasks.workunit.client.0.smithi063.stdout:5/50: truncate d1/fd 606196 0 2023-12-07T16:21:33.325 INFO:tasks.workunit.client.0.smithi063.stdout:5/51: write d1/f11 [4091301,24748] 0 2023-12-07T16:21:33.325 INFO:tasks.workunit.client.0.smithi063.stdout:5/52: chown d1/d3/de/f10 10 1 2023-12-07T16:21:33.326 INFO:tasks.workunit.client.0.smithi063.stdout:5/53: read d1/f7 [57347,78068] 0 2023-12-07T16:21:33.326 INFO:tasks.workunit.client.0.smithi063.stdout:5/54: stat d1/d3/de 0 2023-12-07T16:21:33.326 INFO:tasks.workunit.client.0.smithi063.stdout:6/66: creat d0/d17/f18 x:0 0 0 2023-12-07T16:21:33.326 INFO:tasks.workunit.client.0.smithi063.stdout:6/67: fdatasync d0/fe 0 2023-12-07T16:21:33.326 INFO:tasks.workunit.client.0.smithi063.stdout:6/68: write d0/ff [828280,20632] 0 2023-12-07T16:21:33.327 INFO:tasks.workunit.client.1.smithi152.stdout:7/277: link db/d27/f3d db/d27/d39/d3e/d45/f50 0 2023-12-07T16:21:33.327 INFO:tasks.workunit.client.1.smithi152.stdout:7/278: fsync db/f4a 0 2023-12-07T16:21:33.327 INFO:tasks.workunit.client.0.smithi063.stdout:5/55: write d1/f7 [3168283,6945] 0 2023-12-07T16:21:33.327 INFO:tasks.workunit.client.0.smithi063.stdout:5/56: write d1/d3/fa [734754,54437] 0 2023-12-07T16:21:33.327 INFO:tasks.workunit.client.0.smithi063.stdout:6/69: creat d0/f19 x:0 0 0 2023-12-07T16:21:33.328 INFO:tasks.workunit.client.0.smithi063.stdout:8/148: getdents d7 0 2023-12-07T16:21:33.328 INFO:tasks.workunit.client.0.smithi063.stdout:8/149: chown d7/f1b 33497727 1 2023-12-07T16:21:33.328 INFO:tasks.workunit.client.0.smithi063.stdout:8/150: truncate d7/d14/d15/f2f 447135 0 2023-12-07T16:21:33.329 INFO:tasks.workunit.client.0.smithi063.stdout:8/151: chown d7/d14/d15/l19 66 1 2023-12-07T16:21:33.329 INFO:tasks.workunit.client.0.smithi063.stdout:5/57: fsync d1/d3/fa 0 2023-12-07T16:21:33.329 INFO:tasks.workunit.client.0.smithi063.stdout:5/58: chown d1/d3/de/cf 141414742 1 2023-12-07T16:21:33.329 INFO:tasks.workunit.client.1.smithi152.stdout:0/341: creat d0/d27/f6d x:0 0 0 2023-12-07T16:21:33.330 INFO:tasks.workunit.client.0.smithi063.stdout:6/70: mkdir d0/d17/d1a 0 2023-12-07T16:21:33.331 INFO:tasks.workunit.client.0.smithi063.stdout:8/152: creat d7/d14/d1a/f33 x:0 0 0 2023-12-07T16:21:33.331 INFO:tasks.workunit.client.0.smithi063.stdout:8/153: truncate d7/d14/d1a/f33 113329 0 2023-12-07T16:21:33.332 INFO:tasks.workunit.client.1.smithi152.stdout:3/354: dread d7/dc/d14/f3a [0,4194304] 0 2023-12-07T16:21:33.332 INFO:tasks.workunit.client.1.smithi152.stdout:6/303: rmdir d2/d4f 39 2023-12-07T16:21:33.334 INFO:tasks.workunit.client.0.smithi063.stdout:9/44: truncate d0/f2 8019990 0 2023-12-07T16:21:33.334 INFO:tasks.workunit.client.0.smithi063.stdout:9/45: fdatasync d0/f2 0 2023-12-07T16:21:33.334 INFO:tasks.workunit.client.1.smithi152.stdout:1/343: rename dc/d14/d18/d2d/f54 to dc/d14/d18/d2d/f67 0 2023-12-07T16:21:33.336 INFO:tasks.workunit.client.0.smithi063.stdout:6/71: creat d0/f1b x:0 0 0 2023-12-07T16:21:33.336 INFO:tasks.workunit.client.0.smithi063.stdout:6/72: stat d0/d17 0 2023-12-07T16:21:33.336 INFO:tasks.workunit.client.0.smithi063.stdout:6/73: readlink d0/l13 0 2023-12-07T16:21:33.337 INFO:tasks.workunit.client.1.smithi152.stdout:4/291: creat d0/d17/f53 x:0 0 0 2023-12-07T16:21:33.338 INFO:tasks.workunit.client.0.smithi063.stdout:8/154: rmdir d7/d14/d15/d2b 39 2023-12-07T16:21:33.340 INFO:tasks.workunit.client.1.smithi152.stdout:5/336: creat dd/de/d14/d1f/f6e x:0 0 0 2023-12-07T16:21:33.341 INFO:tasks.workunit.client.0.smithi063.stdout:6/74: creat d0/d17/d1a/f1c x:0 0 0 2023-12-07T16:21:33.341 INFO:tasks.workunit.client.1.smithi152.stdout:7/279: creat db/d1c/f51 x:0 0 0 2023-12-07T16:21:33.343 INFO:tasks.workunit.client.0.smithi063.stdout:8/155: rename d7/d14/d15/d2b/c2c to d7/d14/d15/c34 0 2023-12-07T16:21:33.344 INFO:tasks.workunit.client.1.smithi152.stdout:0/342: mkdir d0/d2f/d30/d6e 0 2023-12-07T16:21:33.346 INFO:tasks.workunit.client.0.smithi063.stdout:6/75: mkdir d0/d11/d1d 0 2023-12-07T16:21:33.346 INFO:tasks.workunit.client.0.smithi063.stdout:6/76: dread - d0/f1b zero size 2023-12-07T16:21:33.346 INFO:tasks.workunit.client.1.smithi152.stdout:1/344: mkdir dc/d14/d68 0 2023-12-07T16:21:33.351 INFO:tasks.workunit.client.0.smithi063.stdout:8/156: unlink d7/d14/f17 0 2023-12-07T16:21:33.352 INFO:tasks.workunit.client.1.smithi152.stdout:5/337: truncate dd/de/d14/d1f/d28/f2f 1057729 0 2023-12-07T16:21:33.352 INFO:tasks.workunit.client.1.smithi152.stdout:0/343: write d0/d2f/f52 [644610,79932] 0 2023-12-07T16:21:33.354 INFO:tasks.workunit.client.1.smithi152.stdout:7/280: rename db/d1c/f16 to db/f52 0 2023-12-07T16:21:33.355 INFO:tasks.workunit.client.0.smithi063.stdout:6/77: fsync d0/f19 0 2023-12-07T16:21:33.355 INFO:tasks.workunit.client.0.smithi063.stdout:6/78: fdatasync d0/d17/f18 0 2023-12-07T16:21:33.355 INFO:tasks.workunit.client.1.smithi152.stdout:1/345: rmdir dc/d14/d18/d64 39 2023-12-07T16:21:33.355 INFO:tasks.workunit.client.1.smithi152.stdout:1/346: stat dc/d28/f39 0 2023-12-07T16:21:33.355 INFO:tasks.workunit.client.1.smithi152.stdout:1/347: truncate f4 5427938 0 2023-12-07T16:21:33.357 INFO:tasks.workunit.client.0.smithi063.stdout:8/157: getdents d7/d14/d1a 0 2023-12-07T16:21:33.359 INFO:tasks.workunit.client.1.smithi152.stdout:0/344: getdents d0 0 2023-12-07T16:21:33.359 INFO:tasks.workunit.client.1.smithi152.stdout:0/345: fdatasync d0/dc/d3d/d4c/f6a 0 2023-12-07T16:21:33.359 INFO:tasks.workunit.client.1.smithi152.stdout:5/338: write dd/de/f13 [5123009,107080] 0 2023-12-07T16:21:33.361 INFO:tasks.workunit.client.1.smithi152.stdout:0/346: symlink d0/dc/d3d/d4c/l6f 0 2023-12-07T16:21:33.363 INFO:tasks.workunit.client.1.smithi152.stdout:1/348: write dc/f23 [2850025,36473] 0 2023-12-07T16:21:33.363 INFO:tasks.workunit.client.1.smithi152.stdout:1/349: write dc/d14/d18/f2c [4198033,19965] 0 2023-12-07T16:21:33.363 INFO:tasks.workunit.client.1.smithi152.stdout:7/281: mknod db/d27/d39/d41/d37/d4e/c53 0 2023-12-07T16:21:33.363 INFO:tasks.workunit.client.1.smithi152.stdout:7/282: truncate db/d27/d39/f33 2264849 0 2023-12-07T16:21:33.363 INFO:tasks.workunit.client.1.smithi152.stdout:7/283: read - db/d1c/f51 zero size 2023-12-07T16:21:33.363 INFO:tasks.workunit.client.1.smithi152.stdout:7/284: fdatasync db/fe 0 2023-12-07T16:21:33.366 INFO:tasks.workunit.client.1.smithi152.stdout:5/339: write dd/de/d17/f33 [2775810,1938] 0 2023-12-07T16:21:33.366 INFO:tasks.workunit.client.1.smithi152.stdout:5/340: rename dd/de/d14 to dd/de/d14/d1f/d28/d6f 22 2023-12-07T16:21:33.366 INFO:tasks.workunit.client.1.smithi152.stdout:5/341: truncate dd/de/d14/d1f/d28/f69 940267 0 2023-12-07T16:21:33.368 INFO:tasks.workunit.client.1.smithi152.stdout:1/350: creat dc/d14/d18/d2d/d4a/d52/f69 x:0 0 0 2023-12-07T16:21:33.371 INFO:tasks.workunit.client.1.smithi152.stdout:7/285: truncate db/d27/d39/d3e/d45/f4c 2077367 0 2023-12-07T16:21:33.371 INFO:tasks.workunit.client.1.smithi152.stdout:7/286: chown db/c40 161 1 2023-12-07T16:21:33.372 INFO:tasks.workunit.client.0.smithi063.stdout:5/59: truncate d1/f7 550149 0 2023-12-07T16:21:33.376 INFO:tasks.workunit.client.1.smithi152.stdout:1/351: mknod dc/d14/c6a 0 2023-12-07T16:21:33.377 INFO:tasks.workunit.client.0.smithi063.stdout:6/79: dread d0/ff [0,4194304] 0 2023-12-07T16:21:33.377 INFO:tasks.workunit.client.1.smithi152.stdout:7/287: getdents db/d27/d39/d3e/d45 0 2023-12-07T16:21:33.377 INFO:tasks.workunit.client.1.smithi152.stdout:7/288: stat c0 0 2023-12-07T16:21:33.378 INFO:tasks.workunit.client.0.smithi063.stdout:9/46: dwrite d0/d7/fe [4194304,4194304] 0 2023-12-07T16:21:33.378 INFO:tasks.workunit.client.1.smithi152.stdout:7/289: creat db/d27/d39/d3e/f54 x:0 0 0 2023-12-07T16:21:33.378 INFO:tasks.workunit.client.1.smithi152.stdout:7/290: chown db/f47 0 1 2023-12-07T16:21:33.382 INFO:tasks.workunit.client.0.smithi063.stdout:6/80: rename d0/d11 to d0/d1e 0 2023-12-07T16:21:33.384 INFO:tasks.workunit.client.0.smithi063.stdout:6/81: mkdir d0/d1e/d1d/d1f 0 2023-12-07T16:21:33.386 INFO:tasks.workunit.client.0.smithi063.stdout:6/82: mkdir d0/d1e/d20 0 2023-12-07T16:21:33.388 INFO:tasks.workunit.client.0.smithi063.stdout:6/83: unlink d0/d17/f18 0 2023-12-07T16:21:33.388 INFO:tasks.workunit.client.0.smithi063.stdout:6/84: write d0/fe [362799,111470] 0 2023-12-07T16:21:33.388 INFO:tasks.workunit.client.0.smithi063.stdout:6/85: stat d0/f8 0 2023-12-07T16:21:33.388 INFO:tasks.workunit.client.1.smithi152.stdout:7/291: write f6 [10176761,42970] 0 2023-12-07T16:21:33.389 INFO:tasks.workunit.client.0.smithi063.stdout:6/86: creat d0/d1e/d1d/d1f/f21 x:0 0 0 2023-12-07T16:21:33.389 INFO:tasks.workunit.client.0.smithi063.stdout:6/87: truncate d0/f1b 235636 0 2023-12-07T16:21:33.390 INFO:tasks.workunit.client.1.smithi152.stdout:7/292: creat db/d27/d39/d41/d37/d4e/f55 x:0 0 0 2023-12-07T16:21:33.390 INFO:tasks.workunit.client.1.smithi152.stdout:7/293: truncate db/d27/d39/d41/f4f 523305 0 2023-12-07T16:21:33.390 INFO:tasks.workunit.client.1.smithi152.stdout:7/294: stat db/d27/d39/f2f 0 2023-12-07T16:21:33.391 INFO:tasks.workunit.client.0.smithi063.stdout:6/88: mknod d0/c22 0 2023-12-07T16:21:33.394 INFO:tasks.workunit.client.1.smithi152.stdout:3/355: dwrite d7/dc/f2a [4194304,4194304] 0 2023-12-07T16:21:33.394 INFO:tasks.workunit.client.1.smithi152.stdout:3/356: chown d7/d10/d19/f4a 0 1 2023-12-07T16:21:33.395 INFO:tasks.workunit.client.0.smithi063.stdout:9/47: dread d0/d7/fe [4194304,4194304] 0 2023-12-07T16:21:33.395 INFO:tasks.workunit.client.0.smithi063.stdout:9/48: readlink d0/l5 0 2023-12-07T16:21:33.400 INFO:tasks.workunit.client.1.smithi152.stdout:4/292: dwrite d0/d3/d6/d36/f44 [0,4194304] 0 2023-12-07T16:21:33.400 INFO:tasks.workunit.client.1.smithi152.stdout:4/293: stat d0/d17/f3f 0 2023-12-07T16:21:33.400 INFO:tasks.workunit.client.1.smithi152.stdout:6/304: dwrite d2/f3 [8388608,4194304] 0 2023-12-07T16:21:33.400 INFO:tasks.workunit.client.1.smithi152.stdout:6/305: chown d2/c27 506 1 2023-12-07T16:21:33.402 INFO:tasks.workunit.client.0.smithi063.stdout:8/158: dwrite d7/fd [0,4194304] 0 2023-12-07T16:21:33.402 INFO:tasks.workunit.client.0.smithi063.stdout:8/159: fdatasync d7/f9 0 2023-12-07T16:21:33.406 INFO:tasks.workunit.client.0.smithi063.stdout:9/49: dread d0/f2 [4194304,4194304] 0 2023-12-07T16:21:33.406 INFO:tasks.workunit.client.0.smithi063.stdout:9/50: read - d0/fd zero size 2023-12-07T16:21:33.407 INFO:tasks.workunit.client.1.smithi152.stdout:3/357: dread d7/d10/d1a/d2f/f18 [0,4194304] 0 2023-12-07T16:21:33.407 INFO:tasks.workunit.client.1.smithi152.stdout:4/294: rename d0/d17/f3f to d0/d3/d6/dc/d22/f54 0 2023-12-07T16:21:33.407 INFO:tasks.workunit.client.1.smithi152.stdout:0/347: dwrite d0/dc/d26/f67 [0,4194304] 0 2023-12-07T16:21:33.407 INFO:tasks.workunit.client.1.smithi152.stdout:6/306: symlink d2/d6/l5c 0 2023-12-07T16:21:33.407 INFO:tasks.workunit.client.1.smithi152.stdout:6/307: write d2/d6/de/d2e/f4e [674033,77718] 0 2023-12-07T16:21:33.407 INFO:tasks.workunit.client.1.smithi152.stdout:6/308: chown d2/d6/d9/l3e 79807 1 2023-12-07T16:21:33.407 INFO:tasks.workunit.client.1.smithi152.stdout:5/342: dwrite dd/de/d38/f43 [0,4194304] 0 2023-12-07T16:21:33.407 INFO:tasks.workunit.client.0.smithi063.stdout:8/160: unlink d7/f1b 0 2023-12-07T16:21:33.408 INFO:tasks.workunit.client.0.smithi063.stdout:8/161: write d7/d14/f28 [117881,24794] 0 2023-12-07T16:21:33.408 INFO:tasks.workunit.client.0.smithi063.stdout:8/162: chown d7/d14/d1a/f31 8 1 2023-12-07T16:21:33.408 INFO:tasks.workunit.client.1.smithi152.stdout:9/395: dwrite d1/d9/d2d/d65/f73 [4194304,4194304] 0 2023-12-07T16:21:33.409 INFO:tasks.workunit.client.0.smithi063.stdout:6/89: fdatasync d0/fe 0 2023-12-07T16:21:33.409 INFO:tasks.workunit.client.0.smithi063.stdout:8/163: creat d7/d14/f35 x:0 0 0 2023-12-07T16:21:33.411 INFO:tasks.workunit.client.1.smithi152.stdout:3/358: mkdir d7/d10/d1a/d71 0 2023-12-07T16:21:33.411 INFO:tasks.workunit.client.1.smithi152.stdout:3/359: getdents d7/d10/d41/d70 0 2023-12-07T16:21:33.419 INFO:tasks.workunit.client.1.smithi152.stdout:1/352: dread dc/d14/f2b [0,4194304] 0 2023-12-07T16:21:33.420 INFO:tasks.workunit.client.0.smithi063.stdout:8/164: symlink d7/d14/l36 0 2023-12-07T16:21:33.420 INFO:tasks.workunit.client.0.smithi063.stdout:8/165: truncate d7/d14/f28 236540 0 2023-12-07T16:21:33.424 INFO:tasks.workunit.client.1.smithi152.stdout:4/295: rmdir d0/d3/d6/d36 39 2023-12-07T16:21:33.424 INFO:tasks.workunit.client.1.smithi152.stdout:0/348: mknod d0/d2f/d30/d6e/c70 0 2023-12-07T16:21:33.424 INFO:tasks.workunit.client.1.smithi152.stdout:6/309: mkdir d2/d6/de/d2e/d4c/d5d 0 2023-12-07T16:21:33.434 INFO:tasks.workunit.client.0.smithi063.stdout:9/51: dread d0/f2 [0,4194304] 0 2023-12-07T16:21:33.435 INFO:tasks.workunit.client.1.smithi152.stdout:5/343: rmdir dd/de/d14/d19/d1a/d1b 39 2023-12-07T16:21:33.435 INFO:tasks.workunit.client.1.smithi152.stdout:5/344: chown dd/de/d17/l3e 800 1 2023-12-07T16:21:33.435 INFO:tasks.workunit.client.1.smithi152.stdout:5/345: readlink dd/de/d14/d1f/l56 0 2023-12-07T16:21:33.435 INFO:tasks.workunit.client.1.smithi152.stdout:1/353: creat dc/d14/d68/f6b x:0 0 0 2023-12-07T16:21:33.435 INFO:tasks.workunit.client.1.smithi152.stdout:7/295: rmdir db/d27/d39/d41/d37/d4e 39 2023-12-07T16:21:33.436 INFO:tasks.workunit.client.1.smithi152.stdout:0/349: mknod d0/dc/c71 0 2023-12-07T16:21:33.437 INFO:tasks.workunit.client.1.smithi152.stdout:0/350: rename d0/dc/f31 to d0/d27/d11/f72 0 2023-12-07T16:21:33.438 INFO:tasks.workunit.client.0.smithi063.stdout:9/52: rename d0/l5 to d0/l11 0 2023-12-07T16:21:33.438 INFO:tasks.workunit.client.1.smithi152.stdout:5/346: dread dd/de/d14/d1f/d28/f69 [0,4194304] 0 2023-12-07T16:21:33.439 INFO:tasks.workunit.client.1.smithi152.stdout:0/351: mkdir d0/dc/d3d/d73 0 2023-12-07T16:21:33.439 INFO:tasks.workunit.client.1.smithi152.stdout:0/352: dread - d0/d2f/d30/f4a zero size 2023-12-07T16:21:33.439 INFO:tasks.workunit.client.1.smithi152.stdout:4/296: dread d0/d3/d6/dc/d22/f54 [0,4194304] 0 2023-12-07T16:21:33.439 INFO:tasks.workunit.client.0.smithi063.stdout:9/53: creat d0/d7/f12 x:0 0 0 2023-12-07T16:21:33.440 INFO:tasks.workunit.client.1.smithi152.stdout:0/353: rmdir d0/d2f/d30/d6e 39 2023-12-07T16:21:33.440 INFO:tasks.workunit.client.1.smithi152.stdout:0/354: truncate d0/dc/d26/f63 183853 0 2023-12-07T16:21:33.440 INFO:tasks.workunit.client.1.smithi152.stdout:0/355: readlink d0/l1d 0 2023-12-07T16:21:33.440 INFO:tasks.workunit.client.1.smithi152.stdout:0/356: truncate d0/dc/d36/d3a/d51/f61 599796 0 2023-12-07T16:21:33.440 INFO:tasks.workunit.client.1.smithi152.stdout:0/357: readlink d0/dc/l24 0 2023-12-07T16:21:33.441 INFO:tasks.workunit.client.0.smithi063.stdout:9/54: write d0/d7/fe [5459451,40894] 0 2023-12-07T16:21:33.441 INFO:tasks.workunit.client.1.smithi152.stdout:0/358: creat d0/d2f/f74 x:0 0 0 2023-12-07T16:21:33.442 INFO:tasks.workunit.client.1.smithi152.stdout:0/359: stat d0/dc/d26/f46 0 2023-12-07T16:21:33.442 INFO:tasks.workunit.client.1.smithi152.stdout:0/360: rmdir d0 39 2023-12-07T16:21:33.443 INFO:tasks.workunit.client.0.smithi063.stdout:1/27: sync 2023-12-07T16:21:33.444 INFO:tasks.workunit.client.1.smithi152.stdout:0/361: mknod d0/dc/d3d/d73/c75 0 2023-12-07T16:21:33.445 INFO:tasks.workunit.client.0.smithi063.stdout:1/28: unlink d0/f3 0 2023-12-07T16:21:33.446 INFO:tasks.workunit.client.1.smithi152.stdout:9/396: dwrite d1/d9/db/f33 [0,4194304] 0 2023-12-07T16:21:33.446 INFO:tasks.workunit.client.1.smithi152.stdout:9/397: truncate d1/d17/d3c/f5f 384448 0 2023-12-07T16:21:33.447 INFO:tasks.workunit.client.1.smithi152.stdout:0/362: rename d0/d27/d11/l44 to d0/dc/d36/d3a/l76 0 2023-12-07T16:21:33.447 INFO:tasks.workunit.client.1.smithi152.stdout:0/363: fdatasync d0/dc/d26/f41 0 2023-12-07T16:21:33.448 INFO:tasks.workunit.client.0.smithi063.stdout:8/166: dwrite d7/f24 [0,4194304] 0 2023-12-07T16:21:33.449 INFO:tasks.workunit.client.1.smithi152.stdout:0/364: readlink d0/d2f/l33 0 2023-12-07T16:21:33.450 INFO:tasks.workunit.client.1.smithi152.stdout:9/398: write d1/d9/db/df/f27 [2242230,77067] 0 2023-12-07T16:21:33.450 INFO:tasks.workunit.client.1.smithi152.stdout:9/399: chown d1/d17/d3c/d4a/c6a 69435 1 2023-12-07T16:21:33.450 INFO:tasks.workunit.client.0.smithi063.stdout:8/167: mkdir d7/d37 0 2023-12-07T16:21:33.450 INFO:tasks.workunit.client.0.smithi063.stdout:8/168: chown d7 26058 1 2023-12-07T16:21:33.451 INFO:tasks.workunit.client.1.smithi152.stdout:0/365: mkdir d0/d2f/d30/d6e/d77 0 2023-12-07T16:21:33.453 INFO:tasks.workunit.client.0.smithi063.stdout:8/169: read d7/ff [853243,123004] 0 2023-12-07T16:21:33.453 INFO:tasks.workunit.client.1.smithi152.stdout:9/400: creat d1/d9/d4f/d74/f88 x:0 0 0 2023-12-07T16:21:33.455 INFO:tasks.workunit.client.1.smithi152.stdout:6/310: dwrite d2/d6/d9/f28 [4194304,4194304] 0 2023-12-07T16:21:33.455 INFO:tasks.workunit.client.0.smithi063.stdout:6/90: dwrite d0/f8 [0,4194304] 0 2023-12-07T16:21:33.455 INFO:tasks.workunit.client.0.smithi063.stdout:6/91: truncate d0/f15 967232 0 2023-12-07T16:21:33.459 INFO:tasks.workunit.client.1.smithi152.stdout:9/401: mknod d1/d17/d3c/c89 0 2023-12-07T16:21:33.459 INFO:tasks.workunit.client.1.smithi152.stdout:0/366: mknod d0/d2f/d30/d6e/c78 0 2023-12-07T16:21:33.459 INFO:tasks.workunit.client.1.smithi152.stdout:9/402: chown d1/f76 18861 1 2023-12-07T16:21:33.459 INFO:tasks.workunit.client.1.smithi152.stdout:1/354: dread dc/f40 [0,4194304] 0 2023-12-07T16:21:33.459 INFO:tasks.workunit.client.1.smithi152.stdout:1/355: fsync dc/f13 0 2023-12-07T16:21:33.460 INFO:tasks.workunit.client.1.smithi152.stdout:6/311: unlink d2/d6/f34 0 2023-12-07T16:21:33.460 INFO:tasks.workunit.client.1.smithi152.stdout:7/296: dread db/d27/d39/d3e/d45/f4c [0,4194304] 0 2023-12-07T16:21:33.460 INFO:tasks.workunit.client.1.smithi152.stdout:6/312: fdatasync d2/d6/f1a 0 2023-12-07T16:21:33.460 INFO:tasks.workunit.client.1.smithi152.stdout:0/367: creat d0/dc/f79 x:0 0 0 2023-12-07T16:21:33.462 INFO:tasks.workunit.client.1.smithi152.stdout:1/356: symlink dc/d14/d18/d2d/d48/l6c 0 2023-12-07T16:21:33.463 INFO:tasks.workunit.client.1.smithi152.stdout:1/357: fdatasync dc/d14/d18/d2d/f67 0 2023-12-07T16:21:33.465 INFO:tasks.workunit.client.1.smithi152.stdout:1/358: write dc/f40 [383822,23200] 0 2023-12-07T16:21:33.466 INFO:tasks.workunit.client.1.smithi152.stdout:1/359: read dc/d28/f55 [359446,113611] 0 2023-12-07T16:21:33.466 INFO:tasks.workunit.client.1.smithi152.stdout:6/313: creat d2/d6/de/d45/d55/f5e x:0 0 0 2023-12-07T16:21:33.466 INFO:tasks.workunit.client.1.smithi152.stdout:0/368: unlink d0/dc/d26/f46 0 2023-12-07T16:21:33.466 INFO:tasks.workunit.client.1.smithi152.stdout:7/297: rename db/d27/d39/d3e/f43 to db/d27/f56 0 2023-12-07T16:21:33.467 INFO:tasks.workunit.client.1.smithi152.stdout:7/298: fdatasync db/d1c/f10 0 2023-12-07T16:21:33.467 INFO:tasks.workunit.client.1.smithi152.stdout:1/360: symlink dc/de/d58/l6d 0 2023-12-07T16:21:33.468 INFO:tasks.workunit.client.0.smithi063.stdout:1/29: getdents d0 0 2023-12-07T16:21:33.469 INFO:tasks.workunit.client.1.smithi152.stdout:6/314: creat d2/d6/de/d2e/d4c/d5d/f5f x:0 0 0 2023-12-07T16:21:33.469 INFO:tasks.workunit.client.1.smithi152.stdout:6/315: fdatasync d2/d6/d19/d1f/f20 0 2023-12-07T16:21:33.469 INFO:tasks.workunit.client.1.smithi152.stdout:7/299: symlink db/d27/l57 0 2023-12-07T16:21:33.470 INFO:tasks.workunit.client.1.smithi152.stdout:7/300: chown db/d27/d4d 1544 1 2023-12-07T16:21:33.470 INFO:tasks.workunit.client.1.smithi152.stdout:6/316: write d2/d6/f1a [2549789,36414] 0 2023-12-07T16:21:33.470 INFO:tasks.workunit.client.1.smithi152.stdout:1/361: mknod dc/de/c6e 0 2023-12-07T16:21:33.471 INFO:tasks.workunit.client.1.smithi152.stdout:7/301: rename db/d27/d39/d41/d37/d4e to db/d27/d39/d41/d58 0 2023-12-07T16:21:33.473 INFO:tasks.workunit.client.1.smithi152.stdout:6/317: mkdir d2/d6/d19/d1f/d60 0 2023-12-07T16:21:33.474 INFO:tasks.workunit.client.1.smithi152.stdout:1/362: rename dc/d14/d18/l32 to dc/d14/d18/d2d/d48/l6f 0 2023-12-07T16:21:33.474 INFO:tasks.workunit.client.1.smithi152.stdout:1/363: write dc/d28/d4e/f61 [59167,30366] 0 2023-12-07T16:21:33.476 INFO:tasks.workunit.client.1.smithi152.stdout:6/318: creat d2/d6/de/f61 x:0 0 0 2023-12-07T16:21:33.476 INFO:tasks.workunit.client.1.smithi152.stdout:7/302: dread db/d27/d39/d41/f4f [0,4194304] 0 2023-12-07T16:21:33.476 INFO:tasks.workunit.client.1.smithi152.stdout:0/369: dread d0/f18 [0,4194304] 0 2023-12-07T16:21:33.476 INFO:tasks.workunit.client.1.smithi152.stdout:0/370: truncate d0/dc/d3d/d4c/f64 902300 0 2023-12-07T16:21:33.476 INFO:tasks.workunit.client.1.smithi152.stdout:7/303: truncate db/d27/d39/d3e/f54 937386 0 2023-12-07T16:21:33.476 INFO:tasks.workunit.client.1.smithi152.stdout:7/304: readlink db/l12 0 2023-12-07T16:21:33.489 INFO:tasks.workunit.client.1.smithi152.stdout:1/364: dread dc/d14/d18/d2d/f67 [0,4194304] 0 2023-12-07T16:21:33.492 INFO:tasks.workunit.client.1.smithi152.stdout:7/305: dread db/d27/f3b [0,4194304] 0 2023-12-07T16:21:33.492 INFO:tasks.workunit.client.1.smithi152.stdout:7/306: fdatasync f6 0 2023-12-07T16:21:33.493 INFO:tasks.workunit.client.1.smithi152.stdout:1/365: link dc/d28/d4e/f61 dc/d14/d18/f70 0 2023-12-07T16:21:33.493 INFO:tasks.workunit.client.1.smithi152.stdout:1/366: fsync dc/d28/f43 0 2023-12-07T16:21:33.494 INFO:tasks.workunit.client.1.smithi152.stdout:1/367: write dc/d28/f55 [537800,40794] 0 2023-12-07T16:21:33.494 INFO:tasks.workunit.client.1.smithi152.stdout:1/368: write dc/d14/d18/f35 [1160439,93840] 0 2023-12-07T16:21:33.496 INFO:tasks.workunit.client.1.smithi152.stdout:1/369: creat dc/d14/d18/d2d/d4a/f71 x:0 0 0 2023-12-07T16:21:33.511 INFO:tasks.workunit.client.0.smithi063.stdout:1/30: dwrite d0/f7 [0,4194304] 0 2023-12-07T16:21:33.531 INFO:tasks.workunit.client.0.smithi063.stdout:1/31: dwrite d0/f7 [0,4194304] 0 2023-12-07T16:21:33.531 INFO:tasks.workunit.client.0.smithi063.stdout:1/32: write d0/f1 [472886,124327] 0 2023-12-07T16:21:33.531 INFO:tasks.workunit.client.0.smithi063.stdout:1/33: chown d0/f4 56 1 2023-12-07T16:21:33.531 INFO:tasks.workunit.client.0.smithi063.stdout:1/34: creat d0/f8 x:0 0 0 2023-12-07T16:21:33.544 INFO:tasks.workunit.client.1.smithi152.stdout:5/347: dwrite dd/de/d14/d1f/d28/f2f [0,4194304] 0 2023-12-07T16:21:33.545 INFO:tasks.workunit.client.1.smithi152.stdout:7/307: read db/fe [1890797,80680] 0 2023-12-07T16:21:33.545 INFO:tasks.workunit.client.1.smithi152.stdout:7/308: chown f8 0 1 2023-12-07T16:21:33.545 INFO:tasks.workunit.client.0.smithi063.stdout:9/55: dwrite d0/fd [0,4194304] 0 2023-12-07T16:21:33.546 INFO:tasks.workunit.client.1.smithi152.stdout:5/348: creat dd/de/d14/d19/d1a/d1b/f70 x:0 0 0 2023-12-07T16:21:33.549 INFO:tasks.workunit.client.0.smithi063.stdout:9/56: unlink d0/fd 0 2023-12-07T16:21:33.549 INFO:tasks.workunit.client.0.smithi063.stdout:9/57: chown d0/ca 15 1 2023-12-07T16:21:33.550 INFO:tasks.workunit.client.0.smithi063.stdout:9/58: chown d0/d7/ff 210 1 2023-12-07T16:21:33.550 INFO:tasks.workunit.client.0.smithi063.stdout:9/59: chown d0/l11 58 1 2023-12-07T16:21:33.550 INFO:tasks.workunit.client.0.smithi063.stdout:9/60: dread - d0/d7/f12 zero size 2023-12-07T16:21:33.551 INFO:tasks.workunit.client.1.smithi152.stdout:5/349: dread dd/de/d14/d1f/f57 [0,4194304] 0 2023-12-07T16:21:33.552 INFO:tasks.workunit.client.1.smithi152.stdout:5/350: mknod dd/de/d14/d19/d1a/c71 0 2023-12-07T16:21:33.553 INFO:tasks.workunit.client.1.smithi152.stdout:5/351: write dd/de/d14/d19/d1a/f37 [488126,975] 0 2023-12-07T16:21:33.553 INFO:tasks.workunit.client.1.smithi152.stdout:5/352: write dd/de/d17/f33 [5162372,45382] 0 2023-12-07T16:21:33.553 INFO:tasks.workunit.client.1.smithi152.stdout:5/353: read dd/de/d14/f63 [4201439,4775] 0 2023-12-07T16:21:33.553 INFO:tasks.workunit.client.1.smithi152.stdout:5/354: truncate dd/de/d14/d1f/d49/f5f 403944 0 2023-12-07T16:21:33.555 INFO:tasks.workunit.client.1.smithi152.stdout:5/355: symlink dd/de/d14/d1f/d28/l72 0 2023-12-07T16:21:33.557 INFO:tasks.workunit.client.0.smithi063.stdout:6/92: dwrite d0/fe [0,4194304] 0 2023-12-07T16:21:33.557 INFO:tasks.workunit.client.1.smithi152.stdout:5/356: unlink dd/de/d14/d19/d1a/l60 0 2023-12-07T16:21:33.557 INFO:tasks.workunit.client.1.smithi152.stdout:5/357: chown dd/de/d14/d1f/l56 8215883 1 2023-12-07T16:21:33.557 INFO:tasks.workunit.client.1.smithi152.stdout:5/358: chown dd/de/d14/d19/d1a/l1c 51083 1 2023-12-07T16:21:33.560 INFO:tasks.workunit.client.0.smithi063.stdout:6/93: rename d0/d1e/ld to d0/d17/l23 0 2023-12-07T16:21:33.561 INFO:tasks.workunit.client.1.smithi152.stdout:9/403: dwrite d1/d9/db/df/f43 [4194304,4194304] 0 2023-12-07T16:21:33.561 INFO:tasks.workunit.client.1.smithi152.stdout:6/319: dwrite d2/f5 [4194304,4194304] 0 2023-12-07T16:21:33.561 INFO:tasks.workunit.client.1.smithi152.stdout:0/371: dwrite d0/d2f/d30/f5a [0,4194304] 0 2023-12-07T16:21:33.561 INFO:tasks.workunit.client.0.smithi063.stdout:1/35: fsync d0/f1 0 2023-12-07T16:21:33.563 INFO:tasks.workunit.client.0.smithi063.stdout:1/36: mkdir d0/d9 0 2023-12-07T16:21:33.563 INFO:tasks.workunit.client.1.smithi152.stdout:9/404: write d1/f5 [1017584,110504] 0 2023-12-07T16:21:33.563 INFO:tasks.workunit.client.1.smithi152.stdout:9/405: truncate d1/d9/db/f2c 200021 0 2023-12-07T16:21:33.564 INFO:tasks.workunit.client.1.smithi152.stdout:9/406: write d1/f3a [356689,1754] 0 2023-12-07T16:21:33.564 INFO:tasks.workunit.client.1.smithi152.stdout:9/407: chown d1 420550165 1 2023-12-07T16:21:33.564 INFO:tasks.workunit.client.1.smithi152.stdout:9/408: chown d1/d9/db/df/l54 52806 1 2023-12-07T16:21:33.564 INFO:tasks.workunit.client.1.smithi152.stdout:9/409: stat d1/d9/d4f/d74 0 2023-12-07T16:21:33.567 INFO:tasks.workunit.client.0.smithi063.stdout:1/37: dread d0/f1 [0,4194304] 0 2023-12-07T16:21:33.568 INFO:tasks.workunit.client.0.smithi063.stdout:9/61: dwrite d0/d7/f12 [0,4194304] 0 2023-12-07T16:21:33.568 INFO:tasks.workunit.client.0.smithi063.stdout:1/38: write d0/f7 [2619513,80566] 0 2023-12-07T16:21:33.568 INFO:tasks.workunit.client.0.smithi063.stdout:1/39: stat d0/f1 0 2023-12-07T16:21:33.570 INFO:tasks.workunit.client.0.smithi063.stdout:9/62: mkdir d0/d13 0 2023-12-07T16:21:33.571 INFO:tasks.workunit.client.0.smithi063.stdout:9/63: fsync d0/d7/f12 0 2023-12-07T16:21:33.571 INFO:tasks.workunit.client.1.smithi152.stdout:7/309: link db/d27/f56 db/d27/d39/d41/d58/f59 0 2023-12-07T16:21:33.571 INFO:tasks.workunit.client.1.smithi152.stdout:6/320: creat d2/d6/de/f62 x:0 0 0 2023-12-07T16:21:33.571 INFO:tasks.workunit.client.1.smithi152.stdout:6/321: write d2/d6/d19/d1f/f47 [4719540,77073] 0 2023-12-07T16:21:33.571 INFO:tasks.workunit.client.1.smithi152.stdout:6/322: chown d2/d6/d9/d14 3997 1 2023-12-07T16:21:33.572 INFO:tasks.workunit.client.0.smithi063.stdout:1/40: fdatasync d0/f7 0 2023-12-07T16:21:33.574 INFO:tasks.workunit.client.1.smithi152.stdout:9/410: dread d1/f5 [0,4194304] 0 2023-12-07T16:21:33.575 INFO:tasks.workunit.client.1.smithi152.stdout:9/411: truncate d1/d9/f23 4632683 0 2023-12-07T16:21:33.575 INFO:tasks.workunit.client.1.smithi152.stdout:9/412: chown d1/d17/d38/d53/f7a 18 1 2023-12-07T16:21:33.583 INFO:tasks.workunit.client.1.smithi152.stdout:7/310: symlink db/d27/d39/d3e/l5a 0 2023-12-07T16:21:33.586 INFO:tasks.workunit.client.1.smithi152.stdout:6/323: creat d2/d6/f63 x:0 0 0 2023-12-07T16:21:33.587 INFO:tasks.workunit.client.1.smithi152.stdout:9/413: unlink d1/d17/d3c/d4a/c6a 0 2023-12-07T16:21:33.587 INFO:tasks.workunit.client.1.smithi152.stdout:9/414: fsync d1/d9/d2d/d65/f73 0 2023-12-07T16:21:33.587 INFO:tasks.workunit.client.1.smithi152.stdout:9/415: getdents d1/d9/d4f/d83 0 2023-12-07T16:21:33.588 INFO:tasks.workunit.client.1.smithi152.stdout:7/311: rename db/d27/d39/d3e/l5a to db/d27/d39/l5b 0 2023-12-07T16:21:33.589 INFO:tasks.workunit.client.1.smithi152.stdout:9/416: mknod d1/d17/d38/c8a 0 2023-12-07T16:21:33.591 INFO:tasks.workunit.client.1.smithi152.stdout:9/417: link d1/d9/db/c10 d1/d9/db/c8b 0 2023-12-07T16:21:33.591 INFO:tasks.workunit.client.1.smithi152.stdout:9/418: chown d1 1127529 1 2023-12-07T16:21:33.592 INFO:tasks.workunit.client.1.smithi152.stdout:0/372: dwrite d0/d2f/f3f [0,4194304] 0 2023-12-07T16:21:33.594 INFO:tasks.workunit.client.1.smithi152.stdout:9/419: mkdir d1/d17/d3c/d4a/d48/d8c 0 2023-12-07T16:21:33.599 INFO:tasks.workunit.client.1.smithi152.stdout:9/420: mknod d1/dd/d24/c8d 0 2023-12-07T16:21:33.601 INFO:tasks.workunit.client.1.smithi152.stdout:9/421: creat d1/d9/d2d/d72/f8e x:0 0 0 2023-12-07T16:21:33.601 INFO:tasks.workunit.client.1.smithi152.stdout:2/313: sync 2023-12-07T16:21:33.602 INFO:tasks.workunit.client.1.smithi152.stdout:9/422: creat d1/d9/d2d/f8f x:0 0 0 2023-12-07T16:21:33.603 INFO:tasks.workunit.client.1.smithi152.stdout:2/314: mknod d2/d1c/d2e/d57/d5b/c71 0 2023-12-07T16:21:33.604 INFO:tasks.workunit.client.1.smithi152.stdout:6/324: dwrite d2/d6/d19/d1f/f37 [0,4194304] 0 2023-12-07T16:21:33.604 INFO:tasks.workunit.client.0.smithi063.stdout:9/64: dwrite d0/f3 [0,4194304] 0 2023-12-07T16:21:33.604 INFO:tasks.workunit.client.0.smithi063.stdout:1/41: dwrite d0/f4 [0,4194304] 0 2023-12-07T16:21:33.604 INFO:tasks.workunit.client.0.smithi063.stdout:1/42: rename d0 to d0/d9/da 22 2023-12-07T16:21:33.604 INFO:tasks.workunit.client.0.smithi063.stdout:1/43: chown d0 3006 1 2023-12-07T16:21:33.605 INFO:tasks.workunit.client.1.smithi152.stdout:2/315: link d2/d9/l67 d2/d1c/d2e/d38/l72 0 2023-12-07T16:21:33.605 INFO:tasks.workunit.client.1.smithi152.stdout:2/316: truncate d2/d9/f6f 772115 0 2023-12-07T16:21:33.605 INFO:tasks.workunit.client.1.smithi152.stdout:2/317: read - d2/d47/f36 zero size 2023-12-07T16:21:33.606 INFO:tasks.workunit.client.0.smithi063.stdout:1/44: symlink d0/lb 0 2023-12-07T16:21:33.607 INFO:tasks.workunit.client.1.smithi152.stdout:6/325: mknod d2/d6/de/d2e/c64 0 2023-12-07T16:21:33.607 INFO:tasks.workunit.client.1.smithi152.stdout:6/326: fdatasync d2/f3 0 2023-12-07T16:21:33.609 INFO:tasks.workunit.client.1.smithi152.stdout:2/318: unlink d2/d56/f58 0 2023-12-07T16:21:33.609 INFO:tasks.workunit.client.1.smithi152.stdout:2/319: chown d2/d1c/d2e/f64 15 1 2023-12-07T16:21:33.609 INFO:tasks.workunit.client.0.smithi063.stdout:9/65: write d0/d7/f12 [2422977,110197] 0 2023-12-07T16:21:33.610 INFO:tasks.workunit.client.1.smithi152.stdout:2/320: mknod d2/d1c/d2e/d57/c73 0 2023-12-07T16:21:33.610 INFO:tasks.workunit.client.1.smithi152.stdout:7/312: dread db/f52 [4194304,4194304] 0 2023-12-07T16:21:33.610 INFO:tasks.workunit.client.1.smithi152.stdout:9/423: read d1/d17/d38/d53/f7a [1379020,64452] 0 2023-12-07T16:21:33.612 INFO:tasks.workunit.client.1.smithi152.stdout:9/424: creat d1/d17/d3c/f90 x:0 0 0 2023-12-07T16:21:33.612 INFO:tasks.workunit.client.1.smithi152.stdout:9/425: fsync d1/d9/db/df/f50 0 2023-12-07T16:21:33.614 INFO:tasks.workunit.client.1.smithi152.stdout:6/327: dread d2/d6/d9/d14/d48/f53 [4194304,4194304] 0 2023-12-07T16:21:33.616 INFO:tasks.workunit.client.0.smithi063.stdout:9/66: write d0/d7/fe [7595402,44218] 0 2023-12-07T16:21:33.620 INFO:tasks.workunit.client.1.smithi152.stdout:7/313: dread db/d1c/f10 [0,4194304] 0 2023-12-07T16:21:33.624 INFO:tasks.workunit.client.1.smithi152.stdout:7/314: write db/f47 [2685939,26388] 0 2023-12-07T16:21:33.624 INFO:tasks.workunit.client.1.smithi152.stdout:7/315: dread - db/d27/d39/d41/d37/f3f zero size 2023-12-07T16:21:33.627 INFO:tasks.workunit.client.0.smithi063.stdout:2/25: sync 2023-12-07T16:21:33.627 INFO:tasks.workunit.client.0.smithi063.stdout:7/32: sync 2023-12-07T16:21:33.627 INFO:tasks.workunit.client.0.smithi063.stdout:3/30: sync 2023-12-07T16:21:33.627 INFO:tasks.workunit.client.0.smithi063.stdout:3/31: stat l3 0 2023-12-07T16:21:33.627 INFO:tasks.workunit.client.0.smithi063.stdout:3/32: write f6 [98558,128404] 0 2023-12-07T16:21:33.627 INFO:tasks.workunit.client.0.smithi063.stdout:1/45: dread d0/f7 [0,4194304] 0 2023-12-07T16:21:33.628 INFO:tasks.workunit.client.1.smithi152.stdout:0/373: dwrite d0/dc/f22 [4194304,4194304] 0 2023-12-07T16:21:33.628 INFO:tasks.workunit.client.1.smithi152.stdout:0/374: readlink d0/l2 0 2023-12-07T16:21:33.628 INFO:tasks.workunit.client.1.smithi152.stdout:0/375: stat d0/dc/d3d/c66 0 2023-12-07T16:21:33.628 INFO:tasks.workunit.client.1.smithi152.stdout:0/376: chown d0/dc/d3d 468187459 1 2023-12-07T16:21:33.628 INFO:tasks.workunit.client.1.smithi152.stdout:7/316: mknod db/d27/d39/d41/d37/c5c 0 2023-12-07T16:21:33.628 INFO:tasks.workunit.client.1.smithi152.stdout:6/328: dread d2/d6/d9/d14/d48/f53 [0,4194304] 0 2023-12-07T16:21:33.630 INFO:tasks.workunit.client.1.smithi152.stdout:0/377: creat d0/dc/d36/d3a/d51/f7a x:0 0 0 2023-12-07T16:21:33.630 INFO:tasks.workunit.client.0.smithi063.stdout:1/46: creat d0/d9/fc x:0 0 0 2023-12-07T16:21:33.631 INFO:tasks.workunit.client.1.smithi152.stdout:7/317: creat db/f5d x:0 0 0 2023-12-07T16:21:33.632 INFO:tasks.workunit.client.1.smithi152.stdout:0/378: creat d0/d2f/d30/f7b x:0 0 0 2023-12-07T16:21:33.632 INFO:tasks.workunit.client.0.smithi063.stdout:7/33: link d2/f6 d2/f10 0 2023-12-07T16:21:33.633 INFO:tasks.workunit.client.1.smithi152.stdout:7/318: dread db/d27/d39/d41/f4f [0,4194304] 0 2023-12-07T16:21:33.633 INFO:tasks.workunit.client.1.smithi152.stdout:7/319: chown f8 7807 1 2023-12-07T16:21:33.634 INFO:tasks.workunit.client.0.smithi063.stdout:7/34: mkdir d2/de/d11 0 2023-12-07T16:21:33.635 INFO:tasks.workunit.client.1.smithi152.stdout:0/379: read d0/dc/d36/d3a/d51/f61 [555574,98798] 0 2023-12-07T16:21:33.635 INFO:tasks.workunit.client.1.smithi152.stdout:0/380: stat d0/dc/c71 0 2023-12-07T16:21:33.636 INFO:tasks.workunit.client.1.smithi152.stdout:7/320: rename db/d27/d39/d3e to db/d27/d5e 0 2023-12-07T16:21:33.638 INFO:tasks.workunit.client.0.smithi063.stdout:2/26: dread d0/f6 [0,4194304] 0 2023-12-07T16:21:33.639 INFO:tasks.workunit.client.1.smithi152.stdout:2/321: dwrite d2/d1c/d2e/f44 [0,4194304] 0 2023-12-07T16:21:33.639 INFO:tasks.workunit.client.1.smithi152.stdout:2/322: write d2/d1c/d2e/d30/d33/f3d [983439,102828] 0 2023-12-07T16:21:33.640 INFO:tasks.workunit.client.1.smithi152.stdout:0/381: rename d0/c19 to d0/dc/d36/d3a/d51/c7c 0 2023-12-07T16:21:33.640 INFO:tasks.workunit.client.0.smithi063.stdout:2/27: creat d0/f7 x:0 0 0 2023-12-07T16:21:33.641 INFO:tasks.workunit.client.0.smithi063.stdout:2/28: write d0/f6 [2894980,112106] 0 2023-12-07T16:21:33.641 INFO:tasks.workunit.client.0.smithi063.stdout:2/29: rename d0 to d0/d8 22 2023-12-07T16:21:33.641 INFO:tasks.workunit.client.0.smithi063.stdout:2/30: chown d0/l2 72184 1 2023-12-07T16:21:33.643 INFO:tasks.workunit.client.1.smithi152.stdout:0/382: mkdir d0/dc/d36/d7d 0 2023-12-07T16:21:33.643 INFO:tasks.workunit.client.1.smithi152.stdout:0/383: write d0/dc/d3d/f53 [5237660,99272] 0 2023-12-07T16:21:33.648 INFO:tasks.workunit.client.1.smithi152.stdout:9/426: dwrite d1/d9/db/f5e [0,4194304] 0 2023-12-07T16:21:33.652 INFO:tasks.workunit.client.1.smithi152.stdout:9/427: unlink d1/d9/d2d/l69 0 2023-12-07T16:21:33.655 INFO:tasks.workunit.client.1.smithi152.stdout:9/428: getdents d1/d17/d58/d86 0 2023-12-07T16:21:33.655 INFO:tasks.workunit.client.1.smithi152.stdout:9/429: write d1/dd/f78 [801514,127471] 0 2023-12-07T16:21:33.657 INFO:tasks.workunit.client.0.smithi063.stdout:9/67: dread d0/d7/fe [4194304,4194304] 0 2023-12-07T16:21:33.658 INFO:tasks.workunit.client.1.smithi152.stdout:9/430: creat d1/d17/d3c/d4a/d48/f91 x:0 0 0 2023-12-07T16:21:33.659 INFO:tasks.workunit.client.0.smithi063.stdout:7/35: getdents d2/de 0 2023-12-07T16:21:33.662 INFO:tasks.workunit.client.1.smithi152.stdout:9/431: unlink d1/dd/d24/c8d 0 2023-12-07T16:21:33.670 INFO:tasks.workunit.client.0.smithi063.stdout:9/68: write d0/d7/ff [1097246,113548] 0 2023-12-07T16:21:33.673 INFO:tasks.workunit.client.0.smithi063.stdout:9/69: symlink d0/l14 0 2023-12-07T16:21:33.673 INFO:tasks.workunit.client.0.smithi063.stdout:9/70: chown d0/l14 0 1 2023-12-07T16:21:33.675 INFO:tasks.workunit.client.0.smithi063.stdout:9/71: link d0/l11 d0/l15 0 2023-12-07T16:21:33.676 INFO:tasks.workunit.client.0.smithi063.stdout:9/72: creat d0/d7/f16 x:0 0 0 2023-12-07T16:21:33.681 INFO:tasks.workunit.client.0.smithi063.stdout:9/73: creat d0/d13/f17 x:0 0 0 2023-12-07T16:21:33.683 INFO:tasks.workunit.client.0.smithi063.stdout:1/47: dwrite d0/f4 [4194304,4194304] 0 2023-12-07T16:21:33.684 INFO:tasks.workunit.client.0.smithi063.stdout:7/36: dread d2/f3 [0,4194304] 0 2023-12-07T16:21:33.686 INFO:tasks.workunit.client.0.smithi063.stdout:7/37: rmdir d2/de/d11 0 2023-12-07T16:21:33.692 INFO:tasks.workunit.client.1.smithi152.stdout:0/384: dwrite d0/d2f/d30/f4a [0,4194304] 0 2023-12-07T16:21:33.692 INFO:tasks.workunit.client.1.smithi152.stdout:0/385: readlink d0/l3e 0 2023-12-07T16:21:33.692 INFO:tasks.workunit.client.1.smithi152.stdout:0/386: dread - d0/d27/f6d zero size 2023-12-07T16:21:33.695 INFO:tasks.workunit.client.1.smithi152.stdout:0/387: mknod d0/d2f/d30/c7e 0 2023-12-07T16:21:33.700 INFO:tasks.workunit.client.1.smithi152.stdout:0/388: symlink d0/dc/d3d/l7f 0 2023-12-07T16:21:33.700 INFO:tasks.workunit.client.1.smithi152.stdout:0/389: chown d0/dc/d3d/d4c 2317060 1 2023-12-07T16:21:33.701 INFO:tasks.workunit.client.1.smithi152.stdout:6/329: dwrite d2/d6/de/d2e/f41 [0,4194304] 0 2023-12-07T16:21:33.701 INFO:tasks.workunit.client.1.smithi152.stdout:7/321: dwrite db/f52 [0,4194304] 0 2023-12-07T16:21:33.701 INFO:tasks.workunit.client.1.smithi152.stdout:0/390: rmdir d0/d27/d11 39 2023-12-07T16:21:33.702 INFO:tasks.workunit.client.0.smithi063.stdout:2/31: dwrite d0/f7 [0,4194304] 0 2023-12-07T16:21:33.706 INFO:tasks.workunit.client.0.smithi063.stdout:2/32: mknod d0/c9 0 2023-12-07T16:21:33.707 INFO:tasks.workunit.client.1.smithi152.stdout:6/330: unlink d2/d6/d9/f13 0 2023-12-07T16:21:33.707 INFO:tasks.workunit.client.1.smithi152.stdout:6/331: chown d2/d6/de/d45 5 1 2023-12-07T16:21:33.713 INFO:tasks.workunit.client.1.smithi152.stdout:0/391: dread d0/f2e [0,4194304] 0 2023-12-07T16:21:33.715 INFO:tasks.workunit.client.1.smithi152.stdout:0/392: link d0/d2f/d30/d6e/c70 d0/d2f/d30/c80 0 2023-12-07T16:21:33.716 INFO:tasks.workunit.client.1.smithi152.stdout:9/432: dwrite d1/d17/d38/d53/f7a [0,4194304] 0 2023-12-07T16:21:33.716 INFO:tasks.workunit.client.1.smithi152.stdout:2/323: dwrite d2/d9/f6f [0,4194304] 0 2023-12-07T16:21:33.717 INFO:tasks.workunit.client.0.smithi063.stdout:3/33: dwrite f6 [0,4194304] 0 2023-12-07T16:21:33.717 INFO:tasks.workunit.client.0.smithi063.stdout:3/34: write f5 [1123894,119806] 0 2023-12-07T16:21:33.718 INFO:tasks.workunit.client.1.smithi152.stdout:9/433: symlink d1/d17/l92 0 2023-12-07T16:21:33.718 INFO:tasks.workunit.client.1.smithi152.stdout:0/393: read d0/d2f/f4d [2114505,86689] 0 2023-12-07T16:21:33.720 INFO:tasks.workunit.client.1.smithi152.stdout:2/324: symlink d2/d1c/d52/l74 0 2023-12-07T16:21:33.720 INFO:tasks.workunit.client.1.smithi152.stdout:2/325: write d2/d1c/d2e/d30/d42/f6d [593696,92317] 0 2023-12-07T16:21:33.721 INFO:tasks.workunit.client.1.smithi152.stdout:9/434: rename d1/d9/db/f5e to d1/d9/db/df/d42/f93 0 2023-12-07T16:21:33.722 INFO:tasks.workunit.client.1.smithi152.stdout:9/435: symlink d1/d17/d38/d53/l94 0 2023-12-07T16:21:33.722 INFO:tasks.workunit.client.1.smithi152.stdout:9/436: readlink d1/d17/d3c/d4a/l7d 0 2023-12-07T16:21:33.723 INFO:tasks.workunit.client.1.smithi152.stdout:9/437: stat c0 0 2023-12-07T16:21:33.725 INFO:tasks.workunit.client.1.smithi152.stdout:2/326: write d2/f29 [2347696,112803] 0 2023-12-07T16:21:33.727 INFO:tasks.workunit.client.1.smithi152.stdout:9/438: read d1/d17/d58/f61 [1223986,73462] 0 2023-12-07T16:21:33.727 INFO:tasks.workunit.client.1.smithi152.stdout:9/439: write d1/d17/d38/d53/f64 [1114967,50301] 0 2023-12-07T16:21:33.727 INFO:tasks.workunit.client.1.smithi152.stdout:9/440: chown d1/d9/d2d/f8f 27 1 2023-12-07T16:21:33.729 INFO:tasks.workunit.client.0.smithi063.stdout:7/38: dwrite d2/f10 [0,4194304] 0 2023-12-07T16:21:33.729 INFO:tasks.workunit.client.1.smithi152.stdout:6/332: dwrite d2/f24 [0,4194304] 0 2023-12-07T16:21:33.731 INFO:tasks.workunit.client.1.smithi152.stdout:2/327: rename d2/l35 to d2/d1c/d2e/d5d/l75 0 2023-12-07T16:21:33.731 INFO:tasks.workunit.client.1.smithi152.stdout:9/441: symlink d1/d17/d3c/d4a/l95 0 2023-12-07T16:21:33.731 INFO:tasks.workunit.client.0.smithi063.stdout:1/48: dwrite d0/d9/fc [0,4194304] 0 2023-12-07T16:21:33.731 INFO:tasks.workunit.client.0.smithi063.stdout:9/74: dread d0/f2 [0,4194304] 0 2023-12-07T16:21:33.732 INFO:tasks.workunit.client.1.smithi152.stdout:7/322: dwrite db/d27/d5e/f48 [0,4194304] 0 2023-12-07T16:21:33.732 INFO:tasks.workunit.client.1.smithi152.stdout:7/323: chown db/d27/d39/d41/d37/f38 34588 1 2023-12-07T16:21:33.732 INFO:tasks.workunit.client.1.smithi152.stdout:7/324: getdents db/d27/d5e/d45 0 2023-12-07T16:21:33.733 INFO:tasks.workunit.client.1.smithi152.stdout:9/442: write d1/f31 [1054741,28253] 0 2023-12-07T16:21:33.735 INFO:tasks.workunit.client.1.smithi152.stdout:6/333: mkdir d2/d6/d65 0 2023-12-07T16:21:33.736 INFO:tasks.workunit.client.0.smithi063.stdout:7/39: creat d2/f12 x:0 0 0 2023-12-07T16:21:33.736 INFO:tasks.workunit.client.0.smithi063.stdout:2/33: getdents d0 0 2023-12-07T16:21:33.737 INFO:tasks.workunit.client.1.smithi152.stdout:2/328: symlink d2/d1c/d2e/d30/d53/l76 0 2023-12-07T16:21:33.740 INFO:tasks.workunit.client.1.smithi152.stdout:7/325: rmdir db/d27/d39 39 2023-12-07T16:21:33.740 INFO:tasks.workunit.client.0.smithi063.stdout:1/49: mkdir d0/dd 0 2023-12-07T16:21:33.740 INFO:tasks.workunit.client.0.smithi063.stdout:1/50: chown d0/c6 28417 1 2023-12-07T16:21:33.740 INFO:tasks.workunit.client.0.smithi063.stdout:7/40: dread - d2/f7 zero size 2023-12-07T16:21:33.742 INFO:tasks.workunit.client.1.smithi152.stdout:0/394: dwrite d0/dc/f12 [0,4194304] 0 2023-12-07T16:21:33.742 INFO:tasks.workunit.client.1.smithi152.stdout:9/443: rename d1/d17/d38/d53/f64 to d1/d9/d2d/f96 0 2023-12-07T16:21:33.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:33 smithi152 ceph-mon[121113]: pgmap v24: 65 pgs: 65 active+clean; 775 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 51 MiB/s rd, 100 MiB/s wr, 589 op/s 2023-12-07T16:21:33.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:33 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:33.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:33 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:33.743 INFO:tasks.workunit.client.1.smithi152.stdout:6/334: symlink d2/d6/d65/l66 0 2023-12-07T16:21:33.744 INFO:tasks.workunit.client.0.smithi063.stdout:0/116: sync 2023-12-07T16:21:33.744 INFO:tasks.workunit.client.0.smithi063.stdout:4/44: sync 2023-12-07T16:21:33.744 INFO:tasks.workunit.client.0.smithi063.stdout:5/60: sync 2023-12-07T16:21:33.744 INFO:tasks.workunit.client.0.smithi063.stdout:0/117: truncate d4/dd/f1e 1592451 0 2023-12-07T16:21:33.745 INFO:tasks.workunit.client.0.smithi063.stdout:2/34: dread d0/f6 [0,4194304] 0 2023-12-07T16:21:33.746 INFO:tasks.workunit.client.0.smithi063.stdout:0/118: truncate d4/fc 1247448 0 2023-12-07T16:21:33.746 INFO:tasks.workunit.client.0.smithi063.stdout:0/119: fdatasync d4/dd/de/f19 0 2023-12-07T16:21:33.746 INFO:tasks.workunit.client.1.smithi152.stdout:2/329: creat d2/d47/f77 x:0 0 0 2023-12-07T16:21:33.747 INFO:tasks.workunit.client.0.smithi063.stdout:5/61: dread d1/f7 [0,4194304] 0 2023-12-07T16:21:33.749 INFO:tasks.workunit.client.1.smithi152.stdout:7/326: link db/l19 db/d27/d39/d41/l5f 0 2023-12-07T16:21:33.749 INFO:tasks.workunit.client.1.smithi152.stdout:7/327: write db/d27/d39/d41/d37/f3f [239974,75031] 0 2023-12-07T16:21:33.750 INFO:tasks.workunit.client.1.smithi152.stdout:9/444: creat d1/d9/db/df/f97 x:0 0 0 2023-12-07T16:21:33.752 INFO:tasks.workunit.client.0.smithi063.stdout:2/35: dread d0/f6 [0,4194304] 0 2023-12-07T16:21:33.752 INFO:tasks.workunit.client.1.smithi152.stdout:8/319: sync 2023-12-07T16:21:33.752 INFO:tasks.workunit.client.1.smithi152.stdout:8/320: stat d3/d4/f35 0 2023-12-07T16:21:33.753 INFO:tasks.workunit.client.0.smithi063.stdout:0/120: read d4/dd/f1e [1281196,123790] 0 2023-12-07T16:21:33.753 INFO:tasks.workunit.client.0.smithi063.stdout:0/121: dread - d4/f16 zero size 2023-12-07T16:21:33.753 INFO:tasks.workunit.client.0.smithi063.stdout:0/122: write d4/dd/de/f24 [863345,55696] 0 2023-12-07T16:21:33.753 INFO:tasks.workunit.client.0.smithi063.stdout:0/123: write d4/dd/f14 [1046265,117154] 0 2023-12-07T16:21:33.755 INFO:tasks.workunit.client.1.smithi152.stdout:0/395: dread d0/dc/d3d/f5b [0,4194304] 0 2023-12-07T16:21:33.756 INFO:tasks.workunit.client.0.smithi063.stdout:2/36: creat d0/fa x:0 0 0 2023-12-07T16:21:33.758 INFO:tasks.workunit.client.0.smithi063.stdout:2/37: write d0/f6 [2792338,99033] 0 2023-12-07T16:21:33.758 INFO:tasks.workunit.client.1.smithi152.stdout:9/445: creat d1/d9/db/d70/f98 x:0 0 0 2023-12-07T16:21:33.762 INFO:tasks.workunit.client.0.smithi063.stdout:3/35: dwrite f5 [0,4194304] 0 2023-12-07T16:21:33.764 INFO:tasks.workunit.client.1.smithi152.stdout:4/297: sync 2023-12-07T16:21:33.764 INFO:tasks.workunit.client.1.smithi152.stdout:4/298: readlink d0/d3/d6/dc/d22/l3d 0 2023-12-07T16:21:33.764 INFO:tasks.workunit.client.1.smithi152.stdout:1/370: sync 2023-12-07T16:21:33.764 INFO:tasks.workunit.client.1.smithi152.stdout:1/371: write dc/f4d [8633940,38891] 0 2023-12-07T16:21:33.764 INFO:tasks.workunit.client.1.smithi152.stdout:1/372: chown dc/d28/f39 1 1 2023-12-07T16:21:33.764 INFO:tasks.workunit.client.1.smithi152.stdout:1/373: fsync f9 0 2023-12-07T16:21:33.764 INFO:tasks.workunit.client.1.smithi152.stdout:3/360: sync 2023-12-07T16:21:33.764 INFO:tasks.workunit.client.1.smithi152.stdout:8/321: symlink d3/d4/d9/dc/d1f/d63/d67/l71 0 2023-12-07T16:21:33.764 INFO:tasks.workunit.client.1.smithi152.stdout:2/330: rename d2/l1f to d2/d1c/d2e/d30/d33/l78 0 2023-12-07T16:21:33.764 INFO:tasks.workunit.client.1.smithi152.stdout:4/299: rename d0 to d0/d3/d6/dc/dd/d34/d55 22 2023-12-07T16:21:33.767 INFO:tasks.workunit.client.1.smithi152.stdout:1/374: creat dc/d14/d18/d64/f72 x:0 0 0 2023-12-07T16:21:33.767 INFO:tasks.workunit.client.1.smithi152.stdout:7/328: dread f6 [0,4194304] 0 2023-12-07T16:21:33.768 INFO:tasks.workunit.client.1.smithi152.stdout:3/361: creat d7/d10/d1a/f72 x:0 0 0 2023-12-07T16:21:33.770 INFO:tasks.workunit.client.1.smithi152.stdout:1/375: creat dc/d14/d18/d2d/d4a/d52/f73 x:0 0 0 2023-12-07T16:21:33.770 INFO:tasks.workunit.client.1.smithi152.stdout:1/376: chown dc/d28/d4e 7308 1 2023-12-07T16:21:33.770 INFO:tasks.workunit.client.1.smithi152.stdout:7/329: truncate db/d27/f3b 2845265 0 2023-12-07T16:21:33.772 INFO:tasks.workunit.client.0.smithi063.stdout:3/36: mkdir d7 0 2023-12-07T16:21:33.772 INFO:tasks.workunit.client.0.smithi063.stdout:3/37: fdatasync f6 0 2023-12-07T16:21:33.772 INFO:tasks.workunit.client.1.smithi152.stdout:7/330: write db/d27/d39/d41/f4f [631100,128481] 0 2023-12-07T16:21:33.772 INFO:tasks.workunit.client.1.smithi152.stdout:0/396: dread d0/f38 [0,4194304] 0 2023-12-07T16:21:33.773 INFO:tasks.workunit.client.1.smithi152.stdout:1/377: rename dc/d14/d18/d2d/d48/d62 to dc/d14/d18/d45/d74 0 2023-12-07T16:21:33.774 INFO:tasks.workunit.client.1.smithi152.stdout:3/362: dread f3 [0,4194304] 0 2023-12-07T16:21:33.774 INFO:tasks.workunit.client.1.smithi152.stdout:2/331: dread d2/f70 [0,4194304] 0 2023-12-07T16:21:33.775 INFO:tasks.workunit.client.1.smithi152.stdout:2/332: readlink d2/d1c/d2e/d5d/l75 0 2023-12-07T16:21:33.775 INFO:tasks.workunit.client.0.smithi063.stdout:1/51: dwrite d0/f8 [0,4194304] 0 2023-12-07T16:21:33.777 INFO:tasks.workunit.client.1.smithi152.stdout:7/331: dread db/f4a [0,4194304] 0 2023-12-07T16:21:33.779 INFO:tasks.workunit.client.1.smithi152.stdout:8/322: dread d3/d4/f35 [0,4194304] 0 2023-12-07T16:21:33.780 INFO:tasks.workunit.client.0.smithi063.stdout:4/45: dwrite d1/d3/f8 [0,4194304] 0 2023-12-07T16:21:33.782 INFO:tasks.workunit.client.0.smithi063.stdout:4/46: mkdir d1/d3/da 0 2023-12-07T16:21:33.782 INFO:tasks.workunit.client.0.smithi063.stdout:0/124: dread d4/fc [0,4194304] 0 2023-12-07T16:21:33.783 INFO:tasks.workunit.client.1.smithi152.stdout:1/378: mknod dc/d14/d18/d2d/d4a/d52/c75 0 2023-12-07T16:21:33.783 INFO:tasks.workunit.client.1.smithi152.stdout:1/379: chown dc/d14/d18/d2d/d4a/f71 597940 1 2023-12-07T16:21:33.783 INFO:tasks.workunit.client.1.smithi152.stdout:3/363: unlink d7/dc/l47 0 2023-12-07T16:21:33.783 INFO:tasks.workunit.client.1.smithi152.stdout:5/359: sync 2023-12-07T16:21:33.784 INFO:tasks.workunit.client.1.smithi152.stdout:2/333: write d2/f5a [767300,42254] 0 2023-12-07T16:21:33.784 INFO:tasks.workunit.client.1.smithi152.stdout:0/397: creat d0/d27/d11/d68/f81 x:0 0 0 2023-12-07T16:21:33.785 INFO:tasks.workunit.client.0.smithi063.stdout:2/38: truncate d0/f6 2819202 0 2023-12-07T16:21:33.787 INFO:tasks.workunit.client.1.smithi152.stdout:7/332: rename db/f52 to db/d27/d39/d41/f60 0 2023-12-07T16:21:33.791 INFO:tasks.workunit.client.1.smithi152.stdout:7/333: dread db/d27/d39/d41/d37/f3f [0,4194304] 0 2023-12-07T16:21:33.791 INFO:tasks.workunit.client.1.smithi152.stdout:6/335: rmdir d2/d6 39 2023-12-07T16:21:33.792 INFO:tasks.workunit.client.1.smithi152.stdout:8/323: mknod d3/d4/d9/dc/d1f/d66/c72 0 2023-12-07T16:21:33.796 INFO:tasks.workunit.client.1.smithi152.stdout:5/360: creat dd/de/d14/d1f/d49/f73 x:0 0 0 2023-12-07T16:21:33.796 INFO:tasks.workunit.client.1.smithi152.stdout:5/361: write dd/de/d14/d19/d1a/d1b/f70 [626965,8145] 0 2023-12-07T16:21:33.798 INFO:tasks.workunit.client.1.smithi152.stdout:0/398: mkdir d0/dc/d36/d3a/d51/d82 0 2023-12-07T16:21:33.798 INFO:tasks.workunit.client.1.smithi152.stdout:0/399: write d0/dc/d3d/f53 [5893575,16025] 0 2023-12-07T16:21:33.799 INFO:tasks.workunit.client.1.smithi152.stdout:2/334: getdents d2/d1c/d2e/d30/d33 0 2023-12-07T16:21:33.802 INFO:tasks.workunit.client.1.smithi152.stdout:4/300: dwrite d0/d3/f37 [4194304,4194304] 0 2023-12-07T16:21:33.802 INFO:tasks.workunit.client.1.smithi152.stdout:3/364: dread d7/f52 [0,4194304] 0 2023-12-07T16:21:33.802 INFO:tasks.workunit.client.1.smithi152.stdout:1/380: rename dc/l4c to dc/d28/d4e/l76 0 2023-12-07T16:21:33.802 INFO:tasks.workunit.client.0.smithi063.stdout:2/39: rmdir d0 39 2023-12-07T16:21:33.805 INFO:tasks.workunit.client.0.smithi063.stdout:2/40: creat d0/fb x:0 0 0 2023-12-07T16:21:33.805 INFO:tasks.workunit.client.0.smithi063.stdout:2/41: fdatasync d0/fb 0 2023-12-07T16:21:33.805 INFO:tasks.workunit.client.0.smithi063.stdout:2/42: chown d0/l3 640 1 2023-12-07T16:21:33.805 INFO:tasks.workunit.client.0.smithi063.stdout:1/52: dread d0/d9/fc [0,4194304] 0 2023-12-07T16:21:33.806 INFO:tasks.workunit.client.0.smithi063.stdout:2/43: symlink d0/lc 0 2023-12-07T16:21:33.806 INFO:tasks.workunit.client.0.smithi063.stdout:2/44: rename d0 to d0/dd 22 2023-12-07T16:21:33.807 INFO:tasks.workunit.client.1.smithi152.stdout:6/336: symlink d2/d6/de/l67 0 2023-12-07T16:21:33.807 INFO:tasks.workunit.client.0.smithi063.stdout:6/94: sync 2023-12-07T16:21:33.807 INFO:tasks.workunit.client.0.smithi063.stdout:6/95: chown d0/f15 914425180 1 2023-12-07T16:21:33.807 INFO:tasks.workunit.client.0.smithi063.stdout:6/96: stat d0/d17 0 2023-12-07T16:21:33.807 INFO:tasks.workunit.client.0.smithi063.stdout:8/170: sync 2023-12-07T16:21:33.809 INFO:tasks.workunit.client.1.smithi152.stdout:8/324: mknod d3/d4/d9/dc/d1f/c73 0 2023-12-07T16:21:33.810 INFO:tasks.workunit.client.0.smithi063.stdout:6/97: truncate d0/f15 729978 0 2023-12-07T16:21:33.810 INFO:tasks.workunit.client.0.smithi063.stdout:6/98: fsync d0/f8 0 2023-12-07T16:21:33.810 INFO:tasks.workunit.client.0.smithi063.stdout:1/53: getdents d0 0 2023-12-07T16:21:33.811 INFO:tasks.workunit.client.0.smithi063.stdout:8/171: rmdir d7 39 2023-12-07T16:21:33.811 INFO:tasks.workunit.client.0.smithi063.stdout:8/172: readlink d7/d14/d15/l19 0 2023-12-07T16:21:33.813 INFO:tasks.workunit.client.0.smithi063.stdout:6/99: creat d0/d1e/f24 x:0 0 0 2023-12-07T16:21:33.813 INFO:tasks.workunit.client.1.smithi152.stdout:4/301: mkdir d0/d3/d6/d2b/d56 0 2023-12-07T16:21:33.813 INFO:tasks.workunit.client.1.smithi152.stdout:4/302: chown d0/d3/d6/d36 5 1 2023-12-07T16:21:33.814 INFO:tasks.workunit.client.0.smithi063.stdout:0/125: dwrite d4/dd/f14 [0,4194304] 0 2023-12-07T16:21:33.814 INFO:tasks.workunit.client.0.smithi063.stdout:0/126: chown d4/dd/de/c1c 224397 1 2023-12-07T16:21:33.814 INFO:tasks.workunit.client.0.smithi063.stdout:1/54: mkdir d0/dd/de 0 2023-12-07T16:21:33.814 INFO:tasks.workunit.client.1.smithi152.stdout:5/362: mkdir dd/de/d14/d19/d74 0 2023-12-07T16:21:33.815 INFO:tasks.workunit.client.1.smithi152.stdout:5/363: stat dd/de 0 2023-12-07T16:21:33.815 INFO:tasks.workunit.client.1.smithi152.stdout:5/364: chown dd/de/d14/d1f/f20 11305 1 2023-12-07T16:21:33.815 INFO:tasks.workunit.client.1.smithi152.stdout:5/365: chown dd/de/d14/d1f/f6e 36339423 1 2023-12-07T16:21:33.815 INFO:tasks.workunit.client.1.smithi152.stdout:5/366: chown dd/de/d14/d1f/d28/f30 365547 1 2023-12-07T16:21:33.815 INFO:tasks.workunit.client.0.smithi063.stdout:8/173: dread d7/d14/d1a/f33 [0,4194304] 0 2023-12-07T16:21:33.815 INFO:tasks.workunit.client.0.smithi063.stdout:8/174: chown d7/l25 245051 1 2023-12-07T16:21:33.815 INFO:tasks.workunit.client.0.smithi063.stdout:8/175: readlink l2 0 2023-12-07T16:21:33.815 INFO:tasks.workunit.client.0.smithi063.stdout:8/176: truncate d7/d14/d1a/f29 92591 0 2023-12-07T16:21:33.817 INFO:tasks.workunit.client.1.smithi152.stdout:3/365: rmdir d7/d10/d1a/d71 0 2023-12-07T16:21:33.817 INFO:tasks.workunit.client.1.smithi152.stdout:6/337: rmdir d2/d6/d9/d14/d48 39 2023-12-07T16:21:33.817 INFO:tasks.workunit.client.1.smithi152.stdout:1/381: rename dc/d28/f53 to dc/de/f77 0 2023-12-07T16:21:33.817 INFO:tasks.workunit.client.1.smithi152.stdout:3/366: unlink d7/f3d 0 2023-12-07T16:21:33.817 INFO:tasks.workunit.client.1.smithi152.stdout:4/303: dread d0/d3/d6/dc/d3a/f3e [0,4194304] 0 2023-12-07T16:21:33.817 INFO:tasks.workunit.client.1.smithi152.stdout:6/338: symlink d2/d6/d19/d1f/l68 0 2023-12-07T16:21:33.818 INFO:tasks.workunit.client.0.smithi063.stdout:5/62: dwrite d1/d3/fa [0,4194304] 0 2023-12-07T16:21:33.820 INFO:tasks.workunit.client.1.smithi152.stdout:4/304: rmdir d0 39 2023-12-07T16:21:33.821 INFO:tasks.workunit.client.1.smithi152.stdout:1/382: mknod dc/d14/d18/d2d/c78 0 2023-12-07T16:21:33.821 INFO:tasks.workunit.client.0.smithi063.stdout:6/100: creat d0/d17/f25 x:0 0 0 2023-12-07T16:21:33.821 INFO:tasks.workunit.client.0.smithi063.stdout:0/127: rename d4/fb to d4/dd/d26/f29 0 2023-12-07T16:21:33.822 INFO:tasks.workunit.client.0.smithi063.stdout:8/177: mkdir d7/d38 0 2023-12-07T16:21:33.824 INFO:tasks.workunit.client.0.smithi063.stdout:6/101: rmdir d0/d17/d1a 39 2023-12-07T16:21:33.826 INFO:tasks.workunit.client.0.smithi063.stdout:8/178: symlink d7/d38/l39 0 2023-12-07T16:21:33.827 INFO:tasks.workunit.client.1.smithi152.stdout:4/305: creat d0/d3/d6/dc/d3a/d46/d4e/f57 x:0 0 0 2023-12-07T16:21:33.827 INFO:tasks.workunit.client.1.smithi152.stdout:1/383: mkdir dc/d14/d18/d79 0 2023-12-07T16:21:33.827 INFO:tasks.workunit.client.0.smithi063.stdout:6/102: creat d0/d1e/f26 x:0 0 0 2023-12-07T16:21:33.827 INFO:tasks.workunit.client.0.smithi063.stdout:6/103: write d0/d17/d1a/f1c [523819,26860] 0 2023-12-07T16:21:33.829 INFO:tasks.workunit.client.0.smithi063.stdout:3/38: dwrite f6 [0,4194304] 0 2023-12-07T16:21:33.837 INFO:tasks.workunit.client.0.smithi063.stdout:4/47: dwrite d1/d3/f4 [0,4194304] 0 2023-12-07T16:21:33.837 INFO:tasks.workunit.client.0.smithi063.stdout:4/48: chown d1/d3 1874605 1 2023-12-07T16:21:33.839 INFO:tasks.workunit.client.1.smithi152.stdout:7/334: dwrite db/d1c/f28 [0,4194304] 0 2023-12-07T16:21:33.839 INFO:tasks.workunit.client.1.smithi152.stdout:7/335: chown db/d27/d39/d41/d37/f38 116 1 2023-12-07T16:21:33.840 INFO:tasks.workunit.client.0.smithi063.stdout:4/49: rename d1/d3/da to d1/d3/db 0 2023-12-07T16:21:33.840 INFO:tasks.workunit.client.0.smithi063.stdout:3/39: read f6 [125658,29922] 0 2023-12-07T16:21:33.849 INFO:tasks.workunit.client.0.smithi063.stdout:4/50: write d1/d3/f5 [3519479,56755] 0 2023-12-07T16:21:33.849 INFO:tasks.workunit.client.0.smithi063.stdout:4/51: chown d1/d3/f5 318497 1 2023-12-07T16:21:33.855 INFO:tasks.workunit.client.0.smithi063.stdout:3/40: dread f6 [0,4194304] 0 2023-12-07T16:21:33.855 INFO:tasks.workunit.client.0.smithi063.stdout:3/41: truncate f5 4539223 0 2023-12-07T16:21:33.863 INFO:tasks.workunit.client.0.smithi063.stdout:4/52: dread d1/d3/f8 [0,4194304] 0 2023-12-07T16:21:33.866 INFO:tasks.workunit.client.0.smithi063.stdout:4/53: write d1/d3/f5 [1710381,73165] 0 2023-12-07T16:21:33.866 INFO:tasks.workunit.client.0.smithi063.stdout:2/45: dwrite d0/f7 [4194304,4194304] 0 2023-12-07T16:21:33.868 INFO:tasks.workunit.client.0.smithi063.stdout:2/46: read d0/f7 [1519219,128139] 0 2023-12-07T16:21:33.868 INFO:tasks.workunit.client.0.smithi063.stdout:2/47: fsync d0/f6 0 2023-12-07T16:21:33.868 INFO:tasks.workunit.client.0.smithi063.stdout:2/48: write d0/f6 [734735,19030] 0 2023-12-07T16:21:33.868 INFO:tasks.workunit.client.0.smithi063.stdout:4/54: rename d1/d3/l9 to d1/d3/db/lc 0 2023-12-07T16:21:33.869 INFO:tasks.workunit.client.0.smithi063.stdout:2/49: write d0/f7 [6064935,62793] 0 2023-12-07T16:21:33.870 INFO:tasks.workunit.client.0.smithi063.stdout:2/50: write d0/fb [1025731,120404] 0 2023-12-07T16:21:33.870 INFO:tasks.workunit.client.0.smithi063.stdout:2/51: chown d0/fb 4002539 1 2023-12-07T16:21:33.873 INFO:tasks.workunit.client.1.smithi152.stdout:4/306: dwrite d0/d3/d6/dc/d22/f32 [0,4194304] 0 2023-12-07T16:21:33.873 INFO:tasks.workunit.client.1.smithi152.stdout:4/307: write d0/d3/d6/dc/dd/d34/f47 [735145,2212] 0 2023-12-07T16:21:33.873 INFO:tasks.workunit.client.1.smithi152.stdout:4/308: fdatasync d0/d3/d6/dc/d3a/f3e 0 2023-12-07T16:21:33.873 INFO:tasks.workunit.client.1.smithi152.stdout:5/367: dwrite dd/de/d14/d19/d1a/d1b/f48 [0,4194304] 0 2023-12-07T16:21:33.876 INFO:tasks.workunit.client.1.smithi152.stdout:4/309: creat d0/d3/d6/dc/d3a/f58 x:0 0 0 2023-12-07T16:21:33.877 INFO:tasks.workunit.client.1.smithi152.stdout:4/310: write d0/d3/d6/dc/d22/f54 [49802,66481] 0 2023-12-07T16:21:33.879 INFO:tasks.workunit.client.1.smithi152.stdout:5/368: rename dd/de/d17/l3e to dd/de/d14/d19/d74/l75 0 2023-12-07T16:21:33.881 INFO:tasks.workunit.client.1.smithi152.stdout:4/311: mknod d0/d3/d6/dc/c59 0 2023-12-07T16:21:33.882 INFO:tasks.workunit.client.1.smithi152.stdout:5/369: link dd/de/d14/d19/f64 dd/f76 0 2023-12-07T16:21:33.883 INFO:tasks.workunit.client.1.smithi152.stdout:4/312: symlink d0/d3/l5a 0 2023-12-07T16:21:33.883 INFO:tasks.workunit.client.1.smithi152.stdout:5/370: creat dd/de/d14/d19/d1a/d1b/f77 x:0 0 0 2023-12-07T16:21:33.885 INFO:tasks.workunit.client.1.smithi152.stdout:4/313: getdents d0/d3/d6 0 2023-12-07T16:21:33.885 INFO:tasks.workunit.client.1.smithi152.stdout:4/314: chown d0/d3/d6/dc 0 1 2023-12-07T16:21:33.885 INFO:tasks.workunit.client.1.smithi152.stdout:5/371: creat dd/de/d14/d67/f78 x:0 0 0 2023-12-07T16:21:33.885 INFO:tasks.workunit.client.1.smithi152.stdout:5/372: chown dd/de/d14/d1f/d28/c3b 3149 1 2023-12-07T16:21:33.886 INFO:tasks.workunit.client.1.smithi152.stdout:4/315: link d0/d3/d6/dc/dd/c4a d0/d3/c5b 0 2023-12-07T16:21:33.887 INFO:tasks.workunit.client.1.smithi152.stdout:4/316: stat d0/d3/d6/f26 0 2023-12-07T16:21:33.887 INFO:tasks.workunit.client.1.smithi152.stdout:4/317: chown d0/l23 13897 1 2023-12-07T16:21:33.887 INFO:tasks.workunit.client.1.smithi152.stdout:4/318: chown d0/d3/d6/d36/f44 452461058 1 2023-12-07T16:21:33.887 INFO:tasks.workunit.client.1.smithi152.stdout:4/319: write d0/d3/d6/dc/dd/d34/f42 [3796556,93371] 0 2023-12-07T16:21:33.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:33 smithi063 ceph-mon[112095]: pgmap v24: 65 pgs: 65 active+clean; 775 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 51 MiB/s rd, 100 MiB/s wr, 589 op/s 2023-12-07T16:21:33.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:33 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:33.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:33 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:33.942 INFO:tasks.workunit.client.0.smithi063.stdout:6/104: dread d0/fe [0,4194304] 0 2023-12-07T16:21:33.944 INFO:tasks.workunit.client.1.smithi152.stdout:8/325: dwrite d3/d4/d9/f1c [0,4194304] 0 2023-12-07T16:21:33.946 INFO:tasks.workunit.client.1.smithi152.stdout:8/326: mkdir d3/d1e/d40/d74 0 2023-12-07T16:21:33.946 INFO:tasks.workunit.client.0.smithi063.stdout:0/128: truncate d4/f5 3966061 0 2023-12-07T16:21:33.948 INFO:tasks.workunit.client.1.smithi152.stdout:8/327: rename d3/d4/d9/d23/c3a to d3/d4/d9/d23/d4c/c75 0 2023-12-07T16:21:33.950 INFO:tasks.workunit.client.0.smithi063.stdout:3/42: truncate f5 3579779 0 2023-12-07T16:21:33.950 INFO:tasks.workunit.client.1.smithi152.stdout:8/328: unlink d3/d4/d9/c14 0 2023-12-07T16:21:33.953 INFO:tasks.workunit.client.1.smithi152.stdout:8/329: rename d3/d4/d9/d34/c53 to d3/c76 0 2023-12-07T16:21:33.957 INFO:tasks.workunit.client.1.smithi152.stdout:8/330: dread d3/d4/d9/d23/f45 [0,4194304] 0 2023-12-07T16:21:33.959 INFO:tasks.workunit.client.1.smithi152.stdout:3/367: dwrite d7/d10/d1a/d25/f6a [0,4194304] 0 2023-12-07T16:21:33.959 INFO:tasks.workunit.client.0.smithi063.stdout:5/63: dwrite d1/f7 [0,4194304] 0 2023-12-07T16:21:33.963 INFO:tasks.workunit.client.1.smithi152.stdout:3/368: creat d7/dc/d3e/d62/d6d/f73 x:0 0 0 2023-12-07T16:21:33.966 INFO:tasks.workunit.client.0.smithi063.stdout:5/64: dread d1/f11 [0,4194304] 0 2023-12-07T16:21:33.966 INFO:tasks.workunit.client.1.smithi152.stdout:3/369: rename d7/d10/d41/l49 to d7/d10/d1a/d25/d3f/l74 0 2023-12-07T16:21:33.966 INFO:tasks.workunit.client.1.smithi152.stdout:3/370: write d7/d10/d19/f4a [741056,20819] 0 2023-12-07T16:21:33.966 INFO:tasks.workunit.client.1.smithi152.stdout:3/371: fdatasync d7/dc/f12 0 2023-12-07T16:21:33.967 INFO:tasks.workunit.client.0.smithi063.stdout:5/65: rmdir d1 39 2023-12-07T16:21:33.967 INFO:tasks.workunit.client.0.smithi063.stdout:5/66: mknod d1/d3/c12 0 2023-12-07T16:21:33.968 INFO:tasks.workunit.client.1.smithi152.stdout:3/372: creat d7/dc/d14/f75 x:0 0 0 2023-12-07T16:21:33.968 INFO:tasks.workunit.client.1.smithi152.stdout:3/373: creat d7/d10/d1a/d25/f76 x:0 0 0 2023-12-07T16:21:33.968 INFO:tasks.workunit.client.0.smithi063.stdout:5/67: creat d1/f13 x:0 0 0 2023-12-07T16:21:33.969 INFO:tasks.workunit.client.1.smithi152.stdout:3/374: symlink d7/dc/d3e/d6b/l77 0 2023-12-07T16:21:33.969 INFO:tasks.workunit.client.0.smithi063.stdout:5/68: creat d1/d3/de/f14 x:0 0 0 2023-12-07T16:21:33.969 INFO:tasks.workunit.client.1.smithi152.stdout:3/375: mkdir d7/d10/d1a/d25/d78 0 2023-12-07T16:21:33.971 INFO:tasks.workunit.client.1.smithi152.stdout:3/376: rename d7/d10/d1a/l58 to d7/dc/d3e/d48/l79 0 2023-12-07T16:21:33.972 INFO:tasks.workunit.client.1.smithi152.stdout:3/377: mknod d7/dc/d3e/c7a 0 2023-12-07T16:21:33.974 INFO:tasks.workunit.client.0.smithi063.stdout:6/105: dwrite d0/d1e/f26 [0,4194304] 0 2023-12-07T16:21:33.974 INFO:tasks.workunit.client.0.smithi063.stdout:1/55: dwrite d0/d9/fc [0,4194304] 0 2023-12-07T16:21:33.974 INFO:tasks.workunit.client.1.smithi152.stdout:1/384: dwrite dc/f4d [4194304,4194304] 0 2023-12-07T16:21:33.975 INFO:tasks.workunit.client.0.smithi063.stdout:8/179: dwrite d7/d14/d1a/f31 [0,4194304] 0 2023-12-07T16:21:33.975 INFO:tasks.workunit.client.0.smithi063.stdout:2/52: dwrite d0/f7 [0,4194304] 0 2023-12-07T16:21:33.975 INFO:tasks.workunit.client.0.smithi063.stdout:8/180: chown d7/d14/d15/l19 9 1 2023-12-07T16:21:33.975 INFO:tasks.workunit.client.1.smithi152.stdout:8/331: dwrite d3/d1e/d55/f64 [0,4194304] 0 2023-12-07T16:21:33.976 INFO:tasks.workunit.client.0.smithi063.stdout:4/55: truncate d1/d3/f8 2338175 0 2023-12-07T16:21:33.976 INFO:tasks.workunit.client.0.smithi063.stdout:4/56: fdatasync d1/d3/f4 0 2023-12-07T16:21:33.978 INFO:tasks.workunit.client.1.smithi152.stdout:1/385: mknod dc/d14/d18/d2d/c7a 0 2023-12-07T16:21:33.978 INFO:tasks.workunit.client.1.smithi152.stdout:3/378: write d7/dc/f12 [3131917,10318] 0 2023-12-07T16:21:33.978 INFO:tasks.workunit.client.1.smithi152.stdout:3/379: dread - d7/dc/d14/f69 zero size 2023-12-07T16:21:33.979 INFO:tasks.workunit.client.1.smithi152.stdout:3/380: write d7/d10/d1a/d25/d3f/f46 [672765,3983] 0 2023-12-07T16:21:33.979 INFO:tasks.workunit.client.0.smithi063.stdout:3/43: fsync f5 0 2023-12-07T16:21:33.979 INFO:tasks.workunit.client.0.smithi063.stdout:3/44: fdatasync f5 0 2023-12-07T16:21:33.982 INFO:tasks.workunit.client.0.smithi063.stdout:6/106: link d0/d17/d1a/f1c d0/d1e/d1d/f27 0 2023-12-07T16:21:33.982 INFO:tasks.workunit.client.0.smithi063.stdout:6/107: dread - d0/d1e/d1d/d1f/f21 zero size 2023-12-07T16:21:33.982 INFO:tasks.workunit.client.0.smithi063.stdout:6/108: write d0/fa [1469229,89766] 0 2023-12-07T16:21:33.983 INFO:tasks.workunit.client.1.smithi152.stdout:8/332: mknod d3/d1e/d43/c77 0 2023-12-07T16:21:33.984 INFO:tasks.workunit.client.1.smithi152.stdout:8/333: fdatasync d3/d4/d9/f18 0 2023-12-07T16:21:33.984 INFO:tasks.workunit.client.0.smithi063.stdout:6/109: dread d0/ff [0,4194304] 0 2023-12-07T16:21:33.984 INFO:tasks.workunit.client.0.smithi063.stdout:6/110: dread - d0/f19 zero size 2023-12-07T16:21:33.985 INFO:tasks.workunit.client.1.smithi152.stdout:1/386: mknod dc/d14/d18/d2d/c7b 0 2023-12-07T16:21:33.985 INFO:tasks.workunit.client.1.smithi152.stdout:1/387: chown dc/d14/d18/l1d 3 1 2023-12-07T16:21:33.987 INFO:tasks.workunit.client.1.smithi152.stdout:3/381: creat d7/dc/d3e/d6b/f7b x:0 0 0 2023-12-07T16:21:33.987 INFO:tasks.workunit.client.1.smithi152.stdout:3/382: truncate d7/dc/d3e/d62/d6d/f73 771444 0 2023-12-07T16:21:33.988 INFO:tasks.workunit.client.1.smithi152.stdout:8/334: rename d3/d4/d4b/f5e to d3/d4/d4b/f78 0 2023-12-07T16:21:33.989 INFO:tasks.workunit.client.0.smithi063.stdout:2/53: creat d0/fe x:0 0 0 2023-12-07T16:21:33.989 INFO:tasks.workunit.client.0.smithi063.stdout:8/181: unlink d7/c1e 0 2023-12-07T16:21:33.992 INFO:tasks.workunit.client.1.smithi152.stdout:3/383: mknod d7/d10/d41/d61/c7c 0 2023-12-07T16:21:33.992 INFO:tasks.workunit.client.1.smithi152.stdout:3/384: stat d7/d10/d1a 0 2023-12-07T16:21:33.992 INFO:tasks.workunit.client.1.smithi152.stdout:3/385: chown d7/dc/d3e/f53 64130950 1 2023-12-07T16:21:33.992 INFO:tasks.workunit.client.1.smithi152.stdout:3/386: write d7/dc/d14/f75 [871714,15450] 0 2023-12-07T16:21:33.992 INFO:tasks.workunit.client.1.smithi152.stdout:1/388: dread dc/d28/f43 [0,4194304] 0 2023-12-07T16:21:33.992 INFO:tasks.workunit.client.1.smithi152.stdout:3/387: truncate d7/d10/d41/f4e 2287744 0 2023-12-07T16:21:33.993 INFO:tasks.workunit.client.1.smithi152.stdout:8/335: write d3/d4/d9/f38 [1610419,28040] 0 2023-12-07T16:21:33.993 INFO:tasks.workunit.client.1.smithi152.stdout:8/336: chown d3/d4/c32 99994 1 2023-12-07T16:21:33.994 INFO:tasks.workunit.client.0.smithi063.stdout:3/45: truncate f5 1029608 0 2023-12-07T16:21:33.994 INFO:tasks.workunit.client.0.smithi063.stdout:3/46: getdents d7 0 2023-12-07T16:21:33.995 INFO:tasks.workunit.client.0.smithi063.stdout:2/54: mkdir d0/df 0 2023-12-07T16:21:33.996 INFO:tasks.workunit.client.1.smithi152.stdout:3/388: mkdir d7/dc/d3e/d7d 0 2023-12-07T16:21:33.996 INFO:tasks.workunit.client.1.smithi152.stdout:1/389: write dc/d14/d18/d2d/f67 [3325903,121214] 0 2023-12-07T16:21:33.996 INFO:tasks.workunit.client.1.smithi152.stdout:1/390: write dc/d14/d18/d2d/d4a/d52/f73 [1020359,75442] 0 2023-12-07T16:21:33.996 INFO:tasks.workunit.client.1.smithi152.stdout:1/391: stat dc/d14/f2b 0 2023-12-07T16:21:33.997 INFO:tasks.workunit.client.0.smithi063.stdout:3/47: symlink d7/l8 0 2023-12-07T16:21:33.997 INFO:tasks.workunit.client.1.smithi152.stdout:5/373: rmdir dd/de/d14/d19/d1a/d1b 39 2023-12-07T16:21:33.999 INFO:tasks.workunit.client.0.smithi063.stdout:6/111: dread d0/f1b [0,4194304] 0 2023-12-07T16:21:34.000 INFO:tasks.workunit.client.0.smithi063.stdout:4/57: rmdir d1 39 2023-12-07T16:21:34.000 INFO:tasks.workunit.client.0.smithi063.stdout:4/58: readlink d1/d3/db/lc 0 2023-12-07T16:21:34.001 INFO:tasks.workunit.client.1.smithi152.stdout:1/392: mkdir dc/d14/d18/d79/d7c 0 2023-12-07T16:21:34.001 INFO:tasks.workunit.client.1.smithi152.stdout:1/393: chown dc/de/f77 8741452 1 2023-12-07T16:21:34.001 INFO:tasks.workunit.client.1.smithi152.stdout:1/394: fsync dc/d28/f55 0 2023-12-07T16:21:34.002 INFO:tasks.workunit.client.1.smithi152.stdout:3/389: dread d7/f32 [0,4194304] 0 2023-12-07T16:21:34.004 INFO:tasks.workunit.client.0.smithi063.stdout:6/112: creat d0/d1e/d1d/d1f/f28 x:0 0 0 2023-12-07T16:21:34.004 INFO:tasks.workunit.client.0.smithi063.stdout:1/56: dwrite d0/d9/fc [0,4194304] 0 2023-12-07T16:21:34.005 INFO:tasks.workunit.client.1.smithi152.stdout:1/395: mkdir dc/d28/d7d 0 2023-12-07T16:21:34.005 INFO:tasks.workunit.client.0.smithi063.stdout:4/59: creat d1/d3/db/fd x:0 0 0 2023-12-07T16:21:34.006 INFO:tasks.workunit.client.0.smithi063.stdout:4/60: chown d1/c7 151643 1 2023-12-07T16:21:34.006 INFO:tasks.workunit.client.0.smithi063.stdout:4/61: readlink d1/d3/db/lc 0 2023-12-07T16:21:34.006 INFO:tasks.workunit.client.0.smithi063.stdout:4/62: chown d1/d3/db/fd 1703 1 2023-12-07T16:21:34.006 INFO:tasks.workunit.client.1.smithi152.stdout:5/374: truncate dd/de/d14/d1f/f20 6562890 0 2023-12-07T16:21:34.009 INFO:tasks.workunit.client.0.smithi063.stdout:1/57: symlink d0/d9/lf 0 2023-12-07T16:21:34.010 INFO:tasks.workunit.client.0.smithi063.stdout:7/41: sync 2023-12-07T16:21:34.010 INFO:tasks.workunit.client.0.smithi063.stdout:4/63: mknod d1/d3/db/ce 0 2023-12-07T16:21:34.010 INFO:tasks.workunit.client.0.smithi063.stdout:4/64: write d1/d3/f8 [3207064,26189] 0 2023-12-07T16:21:34.012 INFO:tasks.workunit.client.0.smithi063.stdout:9/75: sync 2023-12-07T16:21:34.012 INFO:tasks.workunit.client.0.smithi063.stdout:9/76: chown d0/l9 163958769 1 2023-12-07T16:21:34.012 INFO:tasks.workunit.client.0.smithi063.stdout:9/77: truncate d0/d13/f17 280504 0 2023-12-07T16:21:34.013 INFO:tasks.workunit.client.0.smithi063.stdout:1/58: mkdir d0/dd/d10 0 2023-12-07T16:21:34.013 INFO:tasks.workunit.client.1.smithi152.stdout:5/375: creat dd/de/d38/f79 x:0 0 0 2023-12-07T16:21:34.015 INFO:tasks.workunit.client.0.smithi063.stdout:5/69: dwrite d1/d3/fa [0,4194304] 0 2023-12-07T16:21:34.017 INFO:tasks.workunit.client.1.smithi152.stdout:1/396: write dc/f13 [6506696,67629] 0 2023-12-07T16:21:34.017 INFO:tasks.workunit.client.1.smithi152.stdout:9/446: sync 2023-12-07T16:21:34.018 INFO:tasks.workunit.client.0.smithi063.stdout:4/65: mknod d1/d3/db/cf 0 2023-12-07T16:21:34.019 INFO:tasks.workunit.client.1.smithi152.stdout:1/397: mknod dc/de/c7e 0 2023-12-07T16:21:34.021 INFO:tasks.workunit.client.0.smithi063.stdout:9/78: symlink d0/l18 0 2023-12-07T16:21:34.021 INFO:tasks.workunit.client.0.smithi063.stdout:7/42: symlink d2/l13 0 2023-12-07T16:21:34.023 INFO:tasks.workunit.client.1.smithi152.stdout:9/447: creat d1/d17/d4e/f99 x:0 0 0 2023-12-07T16:21:34.023 INFO:tasks.workunit.client.1.smithi152.stdout:9/448: dread - d1/d9/d2d/f8f zero size 2023-12-07T16:21:34.023 INFO:tasks.workunit.client.1.smithi152.stdout:9/449: chown d1/d17/d38/d53 801 1 2023-12-07T16:21:34.023 INFO:tasks.workunit.client.0.smithi063.stdout:1/59: rename d0/f8 to d0/dd/d10/f11 0 2023-12-07T16:21:34.023 INFO:tasks.workunit.client.0.smithi063.stdout:1/60: getdents d0/dd/de 0 2023-12-07T16:21:34.024 INFO:tasks.workunit.client.0.smithi063.stdout:1/61: fsync d0/f1 0 2023-12-07T16:21:34.025 INFO:tasks.workunit.client.1.smithi152.stdout:9/450: mkdir d1/d9/d2d/d46/d9a 0 2023-12-07T16:21:34.026 INFO:tasks.workunit.client.0.smithi063.stdout:7/43: mknod d2/de/c14 0 2023-12-07T16:21:34.027 INFO:tasks.workunit.client.0.smithi063.stdout:4/66: rename d1/d3/f4 to d1/f10 0 2023-12-07T16:21:34.027 INFO:tasks.workunit.client.0.smithi063.stdout:1/62: rename d0/dd to d0/dd/de/d12 22 2023-12-07T16:21:34.029 INFO:tasks.workunit.client.0.smithi063.stdout:7/44: creat d2/de/f15 x:0 0 0 2023-12-07T16:21:34.033 INFO:tasks.workunit.client.0.smithi063.stdout:7/45: rename d2/f9 to d2/de/f16 0 2023-12-07T16:21:34.036 INFO:tasks.workunit.client.0.smithi063.stdout:7/46: unlink c0 0 2023-12-07T16:21:34.036 INFO:tasks.workunit.client.0.smithi063.stdout:8/182: dwrite d7/fd [0,4194304] 0 2023-12-07T16:21:34.036 INFO:tasks.workunit.client.0.smithi063.stdout:8/183: chown d7/d14/d15/d2b/c2e 116697 1 2023-12-07T16:21:34.037 INFO:tasks.workunit.client.0.smithi063.stdout:7/47: creat d2/f17 x:0 0 0 2023-12-07T16:21:34.039 INFO:tasks.workunit.client.0.smithi063.stdout:8/184: link d7/d14/d15/l19 d7/d37/l3a 0 2023-12-07T16:21:34.039 INFO:tasks.workunit.client.0.smithi063.stdout:7/48: dread - d2/f8 zero size 2023-12-07T16:21:34.039 INFO:tasks.workunit.client.0.smithi063.stdout:7/49: chown d2/fd 64717 1 2023-12-07T16:21:34.040 INFO:tasks.workunit.client.0.smithi063.stdout:8/185: rmdir d7/d37 39 2023-12-07T16:21:34.041 INFO:tasks.workunit.client.0.smithi063.stdout:7/50: creat d2/de/f18 x:0 0 0 2023-12-07T16:21:34.043 INFO:tasks.workunit.client.0.smithi063.stdout:8/186: write d7/f24 [4152674,3319] 0 2023-12-07T16:21:34.046 INFO:tasks.workunit.client.0.smithi063.stdout:8/187: link d7/d14/f35 d7/d38/f3b 0 2023-12-07T16:21:34.048 INFO:tasks.workunit.client.0.smithi063.stdout:8/188: rename d7/d14/f21 to d7/d14/d15/d2b/f3c 0 2023-12-07T16:21:34.051 INFO:tasks.workunit.client.0.smithi063.stdout:8/189: rename l2 to d7/d14/d1a/l3d 0 2023-12-07T16:21:34.053 INFO:tasks.workunit.client.1.smithi152.stdout:1/398: dread dc/f40 [0,4194304] 0 2023-12-07T16:21:34.053 INFO:tasks.workunit.client.0.smithi063.stdout:8/190: symlink d7/d38/l3e 0 2023-12-07T16:21:34.055 INFO:tasks.workunit.client.0.smithi063.stdout:8/191: symlink d7/d38/l3f 0 2023-12-07T16:21:34.055 INFO:tasks.workunit.client.0.smithi063.stdout:8/192: write d7/d14/f35 [83411,26630] 0 2023-12-07T16:21:34.055 INFO:tasks.workunit.client.0.smithi063.stdout:8/193: read d7/d38/f3b [98724,47173] 0 2023-12-07T16:21:34.055 INFO:tasks.workunit.client.0.smithi063.stdout:3/48: dwrite f6 [4194304,4194304] 0 2023-12-07T16:21:34.055 INFO:tasks.workunit.client.0.smithi063.stdout:2/55: dwrite d0/fb [0,4194304] 0 2023-12-07T16:21:34.056 INFO:tasks.workunit.client.1.smithi152.stdout:8/337: dwrite d3/d4/d9/d34/f3f [0,4194304] 0 2023-12-07T16:21:34.056 INFO:tasks.workunit.client.0.smithi063.stdout:8/194: getdents d7 0 2023-12-07T16:21:34.059 INFO:tasks.workunit.client.0.smithi063.stdout:3/49: mkdir d7/d9 0 2023-12-07T16:21:34.062 INFO:tasks.workunit.client.1.smithi152.stdout:8/338: mknod d3/d4/d9/d34/d5f/c79 0 2023-12-07T16:21:34.062 INFO:tasks.workunit.client.1.smithi152.stdout:8/339: write d3/d4/f35 [2206089,24162] 0 2023-12-07T16:21:34.062 INFO:tasks.workunit.client.1.smithi152.stdout:8/340: fdatasync d3/d1e/d40/f69 0 2023-12-07T16:21:34.062 INFO:tasks.workunit.client.1.smithi152.stdout:8/341: chown d3/d4/d9/c48 0 1 2023-12-07T16:21:34.062 INFO:tasks.workunit.client.1.smithi152.stdout:8/342: readlink d3/d1e/d40/l4a 0 2023-12-07T16:21:34.062 INFO:tasks.workunit.client.1.smithi152.stdout:8/343: read - d3/d4/d9/dc/d1f/f62 zero size 2023-12-07T16:21:34.064 INFO:tasks.workunit.client.1.smithi152.stdout:8/344: mkdir d3/d4/d9/dc/d6f/d7a 0 2023-12-07T16:21:34.065 INFO:tasks.workunit.client.1.smithi152.stdout:8/345: getdents d3/d4/d9/dc/d1f/d63 0 2023-12-07T16:21:34.075 INFO:tasks.workunit.client.0.smithi063.stdout:2/56: dread d0/f7 [4194304,4194304] 0 2023-12-07T16:21:34.076 INFO:tasks.workunit.client.0.smithi063.stdout:2/57: truncate d0/f6 1693819 0 2023-12-07T16:21:34.080 INFO:tasks.workunit.client.0.smithi063.stdout:9/79: dwrite d0/d7/ff [4194304,4194304] 0 2023-12-07T16:21:34.080 INFO:tasks.workunit.client.0.smithi063.stdout:9/80: stat d0/d7/f16 0 2023-12-07T16:21:34.081 INFO:tasks.workunit.client.1.smithi152.stdout:3/390: dwrite d7/dc/d14/f1e [0,4194304] 0 2023-12-07T16:21:34.081 INFO:tasks.workunit.client.1.smithi152.stdout:3/391: chown d7/f8 2634584 1 2023-12-07T16:21:34.082 INFO:tasks.workunit.client.1.smithi152.stdout:3/392: dread - d7/d10/d1a/d25/f76 zero size 2023-12-07T16:21:34.082 INFO:tasks.workunit.client.0.smithi063.stdout:5/70: dwrite d1/d3/de/f14 [0,4194304] 0 2023-12-07T16:21:34.082 INFO:tasks.workunit.client.0.smithi063.stdout:6/113: dwrite d0/f19 [0,4194304] 0 2023-12-07T16:21:34.084 INFO:tasks.workunit.client.0.smithi063.stdout:6/114: dread d0/ff [0,4194304] 0 2023-12-07T16:21:34.085 INFO:tasks.workunit.client.1.smithi152.stdout:3/393: rename d7/d10/d1a/d2f/l2e to d7/dc/d3e/d48/l7e 0 2023-12-07T16:21:34.085 INFO:tasks.workunit.client.0.smithi063.stdout:9/81: symlink d0/d13/l19 0 2023-12-07T16:21:34.085 INFO:tasks.workunit.client.0.smithi063.stdout:9/82: truncate d0/f2 8418187 0 2023-12-07T16:21:34.094 INFO:tasks.workunit.client.1.smithi152.stdout:3/394: write d7/dc/d14/f15 [4846393,67402] 0 2023-12-07T16:21:34.099 INFO:tasks.workunit.client.0.smithi063.stdout:1/63: unlink d0/dd/d10/f11 0 2023-12-07T16:21:34.101 INFO:tasks.workunit.client.0.smithi063.stdout:6/115: mkdir d0/d1e/d29 0 2023-12-07T16:21:34.102 INFO:tasks.workunit.client.0.smithi063.stdout:6/116: mkdir d0/d1e/d2a 0 2023-12-07T16:21:34.104 INFO:tasks.workunit.client.0.smithi063.stdout:6/117: symlink d0/d1e/d1d/l2b 0 2023-12-07T16:21:34.104 INFO:tasks.workunit.client.0.smithi063.stdout:9/83: dread d0/f3 [0,4194304] 0 2023-12-07T16:21:34.105 INFO:tasks.workunit.client.0.smithi063.stdout:6/118: stat d0/l9 0 2023-12-07T16:21:34.105 INFO:tasks.workunit.client.0.smithi063.stdout:6/119: truncate d0/d1e/f12 881849 0 2023-12-07T16:21:34.105 INFO:tasks.workunit.client.0.smithi063.stdout:6/120: dread - d0/d1e/d1d/d1f/f21 zero size 2023-12-07T16:21:34.105 INFO:tasks.workunit.client.0.smithi063.stdout:6/121: chown d0/d1e/d1d/d1f 10 1 2023-12-07T16:21:34.105 INFO:tasks.workunit.client.0.smithi063.stdout:6/122: chown d0/d1e/d1d 1 1 2023-12-07T16:21:34.106 INFO:tasks.workunit.client.0.smithi063.stdout:9/84: creat d0/f1a x:0 0 0 2023-12-07T16:21:34.106 INFO:tasks.workunit.client.0.smithi063.stdout:6/123: creat d0/f2c x:0 0 0 2023-12-07T16:21:34.109 INFO:tasks.workunit.client.0.smithi063.stdout:6/124: mknod d0/d17/c2d 0 2023-12-07T16:21:34.112 INFO:tasks.workunit.client.0.smithi063.stdout:9/85: dread d0/f3 [0,4194304] 0 2023-12-07T16:21:34.113 INFO:tasks.workunit.client.0.smithi063.stdout:6/125: unlink d0/l3 0 2023-12-07T16:21:34.113 INFO:tasks.workunit.client.0.smithi063.stdout:6/126: write d0/f15 [289411,97388] 0 2023-12-07T16:21:34.113 INFO:tasks.workunit.client.0.smithi063.stdout:6/127: truncate d0/d1e/d1d/d1f/f28 146382 0 2023-12-07T16:21:34.114 INFO:tasks.workunit.client.0.smithi063.stdout:9/86: rename d0/l15 to d0/l1b 0 2023-12-07T16:21:34.114 INFO:tasks.workunit.client.0.smithi063.stdout:9/87: write d0/f1a [496812,119351] 0 2023-12-07T16:21:34.116 INFO:tasks.workunit.client.1.smithi152.stdout:9/451: dwrite d1/dd/f5c [0,4194304] 0 2023-12-07T16:21:34.117 INFO:tasks.workunit.client.0.smithi063.stdout:7/51: dwrite d2/fd [0,4194304] 0 2023-12-07T16:21:34.117 INFO:tasks.workunit.client.0.smithi063.stdout:1/64: dread d0/f7 [0,4194304] 0 2023-12-07T16:21:34.117 INFO:tasks.workunit.client.0.smithi063.stdout:1/65: chown d0 21531 1 2023-12-07T16:21:34.117 INFO:tasks.workunit.client.1.smithi152.stdout:5/376: dwrite dd/de/d14/d19/d1a/d1b/f77 [0,4194304] 0 2023-12-07T16:21:34.117 INFO:tasks.workunit.client.0.smithi063.stdout:9/88: rename d0/l18 to d0/l1c 0 2023-12-07T16:21:34.117 INFO:tasks.workunit.client.0.smithi063.stdout:9/89: fsync d0/d7/fe 0 2023-12-07T16:21:34.118 INFO:tasks.workunit.client.0.smithi063.stdout:4/67: fsync d1/f10 0 2023-12-07T16:21:34.120 INFO:tasks.workunit.client.0.smithi063.stdout:7/52: mknod d2/de/c19 0 2023-12-07T16:21:34.124 INFO:tasks.workunit.client.1.smithi152.stdout:5/377: unlink dd/de/d14/d19/d1a/d1b/c47 0 2023-12-07T16:21:34.125 INFO:tasks.workunit.client.0.smithi063.stdout:3/50: dwrite f6 [4194304,4194304] 0 2023-12-07T16:21:34.125 INFO:tasks.workunit.client.0.smithi063.stdout:8/195: dwrite d7/d14/f27 [0,4194304] 0 2023-12-07T16:21:34.125 INFO:tasks.workunit.client.0.smithi063.stdout:5/71: dwrite d1/f13 [0,4194304] 0 2023-12-07T16:21:34.125 INFO:tasks.workunit.client.0.smithi063.stdout:5/72: read d1/d3/f4 [58493,128671] 0 2023-12-07T16:21:34.126 INFO:tasks.workunit.client.0.smithi063.stdout:2/58: dwrite d0/fe [0,4194304] 0 2023-12-07T16:21:34.126 INFO:tasks.workunit.client.0.smithi063.stdout:9/90: symlink d0/l1d 0 2023-12-07T16:21:34.126 INFO:tasks.workunit.client.0.smithi063.stdout:3/51: read f6 [6080256,17986] 0 2023-12-07T16:21:34.126 INFO:tasks.workunit.client.1.smithi152.stdout:5/378: getdents dd/de/d14/d1f/d49 0 2023-12-07T16:21:34.129 INFO:tasks.workunit.client.1.smithi152.stdout:3/395: dwrite d7/d10/d1a/d25/d3f/f46 [0,4194304] 0 2023-12-07T16:21:34.129 INFO:tasks.workunit.client.1.smithi152.stdout:5/379: dread dd/de/d14/d19/d1a/f37 [0,4194304] 0 2023-12-07T16:21:34.135 INFO:tasks.workunit.client.1.smithi152.stdout:5/380: mkdir dd/de/d14/d19/d7a 0 2023-12-07T16:21:34.136 INFO:tasks.workunit.client.1.smithi152.stdout:0/400: sync 2023-12-07T16:21:34.136 INFO:tasks.workunit.client.1.smithi152.stdout:6/339: sync 2023-12-07T16:21:34.136 INFO:tasks.workunit.client.1.smithi152.stdout:6/340: getdents d2/d6/d19/d1f/d60 0 2023-12-07T16:21:34.136 INFO:tasks.workunit.client.1.smithi152.stdout:2/335: sync 2023-12-07T16:21:34.136 INFO:tasks.workunit.client.1.smithi152.stdout:7/336: sync 2023-12-07T16:21:34.136 INFO:tasks.workunit.client.1.smithi152.stdout:7/337: fdatasync db/fe 0 2023-12-07T16:21:34.136 INFO:tasks.workunit.client.0.smithi063.stdout:8/196: mkdir d7/d14/d15/d2b/d40 0 2023-12-07T16:21:34.137 INFO:tasks.workunit.client.1.smithi152.stdout:5/381: mkdir dd/d7b 0 2023-12-07T16:21:34.138 INFO:tasks.workunit.client.1.smithi152.stdout:7/338: write db/fe [211471,97274] 0 2023-12-07T16:21:34.139 INFO:tasks.workunit.client.1.smithi152.stdout:0/401: link d0/d2f/l62 d0/dc/d3d/l83 0 2023-12-07T16:21:34.141 INFO:tasks.workunit.client.1.smithi152.stdout:6/341: mknod d2/d6/c69 0 2023-12-07T16:21:34.141 INFO:tasks.workunit.client.1.smithi152.stdout:2/336: stat d2/l16 0 2023-12-07T16:21:34.141 INFO:tasks.workunit.client.1.smithi152.stdout:2/337: write d2/f5a [795568,70573] 0 2023-12-07T16:21:34.142 INFO:tasks.workunit.client.1.smithi152.stdout:2/338: read d2/d9/f48 [132961,121100] 0 2023-12-07T16:21:34.143 INFO:tasks.workunit.client.1.smithi152.stdout:5/382: mkdir dd/de/d17/d54/d7c 0 2023-12-07T16:21:34.143 INFO:tasks.workunit.client.1.smithi152.stdout:5/383: chown dd/de/d14/d1f/d28/c58 1 1 2023-12-07T16:21:34.143 INFO:tasks.workunit.client.1.smithi152.stdout:5/384: truncate dd/f76 40576 0 2023-12-07T16:21:34.145 INFO:tasks.workunit.client.1.smithi152.stdout:6/342: read d2/d6/d9/f35 [2925783,111643] 0 2023-12-07T16:21:34.145 INFO:tasks.workunit.client.1.smithi152.stdout:0/402: creat d0/dc/d3d/d4c/f84 x:0 0 0 2023-12-07T16:21:34.145 INFO:tasks.workunit.client.1.smithi152.stdout:1/399: dwrite dc/f13 [8388608,4194304] 0 2023-12-07T16:21:34.146 INFO:tasks.workunit.client.0.smithi063.stdout:5/73: mknod d1/d3/de/c15 0 2023-12-07T16:21:34.146 INFO:tasks.workunit.client.0.smithi063.stdout:9/91: rename d0/d7/f12 to d0/d7/f1e 0 2023-12-07T16:21:34.146 INFO:tasks.workunit.client.0.smithi063.stdout:9/92: readlink d0/l9 0 2023-12-07T16:21:34.146 INFO:tasks.workunit.client.1.smithi152.stdout:2/339: rename d2/l16 to d2/d1c/l79 0 2023-12-07T16:21:34.146 INFO:tasks.workunit.client.1.smithi152.stdout:2/340: read - d2/d1c/d2e/f64 zero size 2023-12-07T16:21:34.148 INFO:tasks.workunit.client.1.smithi152.stdout:5/385: creat dd/d7b/f7d x:0 0 0 2023-12-07T16:21:34.148 INFO:tasks.workunit.client.1.smithi152.stdout:5/386: fdatasync dd/de/d14/d1f/f6e 0 2023-12-07T16:21:34.149 INFO:tasks.workunit.client.0.smithi063.stdout:5/74: read d1/d3/fa [1540124,16876] 0 2023-12-07T16:21:34.149 INFO:tasks.workunit.client.1.smithi152.stdout:6/343: creat d2/d6/f6a x:0 0 0 2023-12-07T16:21:34.149 INFO:tasks.workunit.client.0.smithi063.stdout:7/53: link d2/f7 d2/f1a 0 2023-12-07T16:21:34.152 INFO:tasks.workunit.client.1.smithi152.stdout:1/400: getdents dc 0 2023-12-07T16:21:34.152 INFO:tasks.workunit.client.1.smithi152.stdout:2/341: rmdir d2/d9/d51 39 2023-12-07T16:21:34.152 INFO:tasks.workunit.client.1.smithi152.stdout:2/342: fsync d2/d9/f1b 0 2023-12-07T16:21:34.152 INFO:tasks.workunit.client.1.smithi152.stdout:5/387: creat dd/de/d38/f7e x:0 0 0 2023-12-07T16:21:34.153 INFO:tasks.workunit.client.1.smithi152.stdout:6/344: truncate d2/d6/d19/d1f/f20 2645562 0 2023-12-07T16:21:34.153 INFO:tasks.workunit.client.1.smithi152.stdout:6/345: fsync d2/d6/d9/f35 0 2023-12-07T16:21:34.155 INFO:tasks.workunit.client.1.smithi152.stdout:1/401: dread dc/f3d [0,4194304] 0 2023-12-07T16:21:34.157 INFO:tasks.workunit.client.0.smithi063.stdout:7/54: dread d2/fd [4194304,4194304] 0 2023-12-07T16:21:34.157 INFO:tasks.workunit.client.0.smithi063.stdout:1/66: rmdir d0/dd/de 0 2023-12-07T16:21:34.157 INFO:tasks.workunit.client.0.smithi063.stdout:8/197: creat d7/d14/d15/d2b/f41 x:0 0 0 2023-12-07T16:21:34.157 INFO:tasks.workunit.client.0.smithi063.stdout:8/198: fdatasync d7/d14/f35 0 2023-12-07T16:21:34.160 INFO:tasks.workunit.client.1.smithi152.stdout:6/346: rmdir d2/d6/de/d2e 39 2023-12-07T16:21:34.160 INFO:tasks.workunit.client.1.smithi152.stdout:2/343: creat d2/d1c/f7a x:0 0 0 2023-12-07T16:21:34.160 INFO:tasks.workunit.client.1.smithi152.stdout:5/388: creat dd/de/d17/f7f x:0 0 0 2023-12-07T16:21:34.160 INFO:tasks.workunit.client.1.smithi152.stdout:5/389: stat dd/de/d14/f42 0 2023-12-07T16:21:34.161 INFO:tasks.workunit.client.1.smithi152.stdout:1/402: rmdir dc/d14/d18 39 2023-12-07T16:21:34.161 INFO:tasks.workunit.client.0.smithi063.stdout:5/75: read d1/fd [191952,3265] 0 2023-12-07T16:21:34.162 INFO:tasks.workunit.client.1.smithi152.stdout:1/403: read dc/de/f77 [765126,88523] 0 2023-12-07T16:21:34.162 INFO:tasks.workunit.client.0.smithi063.stdout:7/55: creat d2/de/f1b x:0 0 0 2023-12-07T16:21:34.162 INFO:tasks.workunit.client.0.smithi063.stdout:7/56: stat d2/f17 0 2023-12-07T16:21:34.162 INFO:tasks.workunit.client.1.smithi152.stdout:2/344: rmdir d2/d1c/d2e/d38 39 2023-12-07T16:21:34.162 INFO:tasks.workunit.client.1.smithi152.stdout:2/345: chown d2/d47/f77 13 1 2023-12-07T16:21:34.163 INFO:tasks.workunit.client.0.smithi063.stdout:8/199: mknod d7/d38/c42 0 2023-12-07T16:21:34.164 INFO:tasks.workunit.client.0.smithi063.stdout:8/200: write d7/d14/d15/f18 [1977133,52042] 0 2023-12-07T16:21:34.165 INFO:tasks.workunit.client.1.smithi152.stdout:5/390: creat dd/de/d14/d67/f80 x:0 0 0 2023-12-07T16:21:34.165 INFO:tasks.workunit.client.1.smithi152.stdout:2/346: creat d2/d1c/d2e/d57/f7b x:0 0 0 2023-12-07T16:21:34.165 INFO:tasks.workunit.client.1.smithi152.stdout:3/396: dwrite d7/d10/d1a/f28 [0,4194304] 0 2023-12-07T16:21:34.167 INFO:tasks.workunit.client.1.smithi152.stdout:1/404: dread dc/d14/d18/f70 [0,4194304] 0 2023-12-07T16:21:34.167 INFO:tasks.workunit.client.1.smithi152.stdout:1/405: chown dc/d14/d18/d45/d74 0 1 2023-12-07T16:21:34.168 INFO:tasks.workunit.client.0.smithi063.stdout:0/129: sync 2023-12-07T16:21:34.169 INFO:tasks.workunit.client.0.smithi063.stdout:8/201: symlink d7/d14/d1a/l43 0 2023-12-07T16:21:34.170 INFO:tasks.workunit.client.0.smithi063.stdout:7/57: symlink d2/l1c 0 2023-12-07T16:21:34.170 INFO:tasks.workunit.client.0.smithi063.stdout:7/58: read - d2/de/f15 zero size 2023-12-07T16:21:34.171 INFO:tasks.workunit.client.1.smithi152.stdout:5/391: symlink dd/de/d14/d67/l81 0 2023-12-07T16:21:34.171 INFO:tasks.workunit.client.1.smithi152.stdout:5/392: write dd/de/d14/d19/f6c [721926,91909] 0 2023-12-07T16:21:34.171 INFO:tasks.workunit.client.1.smithi152.stdout:5/393: fdatasync dd/de/d14/d1f/d28/f2f 0 2023-12-07T16:21:34.172 INFO:tasks.workunit.client.0.smithi063.stdout:6/128: truncate d0/f19 336593 0 2023-12-07T16:21:34.176 INFO:tasks.workunit.client.1.smithi152.stdout:2/347: rename d2/d1c/d2e/d30/d42/f43 to d2/d1c/d2e/d5d/f7c 0 2023-12-07T16:21:34.176 INFO:tasks.workunit.client.1.smithi152.stdout:2/348: fsync d2/d1c/d2e/f3e 0 2023-12-07T16:21:34.176 INFO:tasks.workunit.client.1.smithi152.stdout:6/347: dread d2/f5 [0,4194304] 0 2023-12-07T16:21:34.176 INFO:tasks.workunit.client.1.smithi152.stdout:6/348: chown d2/d6/f25 91326615 1 2023-12-07T16:21:34.176 INFO:tasks.workunit.client.1.smithi152.stdout:6/349: chown d2/c29 1 1 2023-12-07T16:21:34.177 INFO:tasks.workunit.client.0.smithi063.stdout:0/130: mkdir d4/d2a 0 2023-12-07T16:21:34.178 INFO:tasks.workunit.client.0.smithi063.stdout:6/129: mknod d0/d1e/d1d/d1f/c2e 0 2023-12-07T16:21:34.185 INFO:tasks.workunit.client.0.smithi063.stdout:6/130: creat d0/d1e/d20/f2f x:0 0 0 2023-12-07T16:21:34.185 INFO:tasks.workunit.client.0.smithi063.stdout:0/131: mkdir d4/dd/d26/d2b 0 2023-12-07T16:21:34.188 INFO:tasks.workunit.client.0.smithi063.stdout:3/52: dwrite f5 [0,4194304] 0 2023-12-07T16:21:34.188 INFO:tasks.workunit.client.0.smithi063.stdout:2/59: write d0/f6 [1303385,38437] 0 2023-12-07T16:21:34.188 INFO:tasks.workunit.client.0.smithi063.stdout:2/60: read d0/f6 [467893,63367] 0 2023-12-07T16:21:34.189 INFO:tasks.workunit.client.1.smithi152.stdout:9/452: dwrite d1/d9/db/f33 [0,4194304] 0 2023-12-07T16:21:34.189 INFO:tasks.workunit.client.0.smithi063.stdout:8/202: dread d7/d14/d1a/f31 [0,4194304] 0 2023-12-07T16:21:34.189 INFO:tasks.workunit.client.0.smithi063.stdout:8/203: chown d7/le 19921 1 2023-12-07T16:21:34.189 INFO:tasks.workunit.client.0.smithi063.stdout:8/204: chown d7/d37 3378036 1 2023-12-07T16:21:34.189 INFO:tasks.workunit.client.0.smithi063.stdout:8/205: fdatasync d7/f9 0 2023-12-07T16:21:34.191 INFO:tasks.workunit.client.0.smithi063.stdout:0/132: rename d4/c28 to d4/d2a/c2c 0 2023-12-07T16:21:34.192 INFO:tasks.workunit.client.0.smithi063.stdout:6/131: write d0/f8 [2505836,124497] 0 2023-12-07T16:21:34.193 INFO:tasks.workunit.client.0.smithi063.stdout:3/53: creat d7/fa x:0 0 0 2023-12-07T16:21:34.193 INFO:tasks.workunit.client.1.smithi152.stdout:9/453: dread d1/f3a [0,4194304] 0 2023-12-07T16:21:34.193 INFO:tasks.workunit.client.1.smithi152.stdout:9/454: chown c0 9 1 2023-12-07T16:21:34.195 INFO:tasks.workunit.client.1.smithi152.stdout:1/406: creat dc/d14/d18/d45/d74/f7f x:0 0 0 2023-12-07T16:21:34.195 INFO:tasks.workunit.client.0.smithi063.stdout:2/61: creat d0/f10 x:0 0 0 2023-12-07T16:21:34.197 INFO:tasks.workunit.client.1.smithi152.stdout:5/394: link dd/f5a dd/de/d14/d1f/f82 0 2023-12-07T16:21:34.197 INFO:tasks.workunit.client.0.smithi063.stdout:0/133: mkdir d4/dd/de/d2d 0 2023-12-07T16:21:34.199 INFO:tasks.workunit.client.0.smithi063.stdout:6/132: dread d0/f1b [0,4194304] 0 2023-12-07T16:21:34.199 INFO:tasks.workunit.client.1.smithi152.stdout:6/350: creat d2/d6/de/d2e/d4c/d5d/f6b x:0 0 0 2023-12-07T16:21:34.200 INFO:tasks.workunit.client.0.smithi063.stdout:3/54: link l2 d7/d9/lb 0 2023-12-07T16:21:34.201 INFO:tasks.workunit.client.0.smithi063.stdout:8/206: dread d7/d14/d1a/f22 [0,4194304] 0 2023-12-07T16:21:34.201 INFO:tasks.workunit.client.0.smithi063.stdout:2/62: mkdir d0/df/d11 0 2023-12-07T16:21:34.201 INFO:tasks.workunit.client.0.smithi063.stdout:6/133: dread d0/ff [0,4194304] 0 2023-12-07T16:21:34.203 INFO:tasks.workunit.client.1.smithi152.stdout:0/403: dwrite d0/d27/d11/f40 [4194304,4194304] 0 2023-12-07T16:21:34.203 INFO:tasks.workunit.client.1.smithi152.stdout:9/455: rmdir d1/d17/d3c/d4a/d48/d85 0 2023-12-07T16:21:34.203 INFO:tasks.workunit.client.1.smithi152.stdout:9/456: fdatasync d1/d9/f26 0 2023-12-07T16:21:34.203 INFO:tasks.workunit.client.1.smithi152.stdout:9/457: readlink d1/d17/d38/d53/l94 0 2023-12-07T16:21:34.203 INFO:tasks.workunit.client.1.smithi152.stdout:9/458: stat d1/d9/d2d/f8f 0 2023-12-07T16:21:34.203 INFO:tasks.workunit.client.1.smithi152.stdout:9/459: write d1/d9/d2d/d65/f6f [162975,115239] 0 2023-12-07T16:21:34.204 INFO:tasks.workunit.client.1.smithi152.stdout:1/407: link dc/d14/d18/f70 dc/d28/d4e/f80 0 2023-12-07T16:21:34.205 INFO:tasks.workunit.client.0.smithi063.stdout:6/134: mknod d0/d1e/c30 0 2023-12-07T16:21:34.206 INFO:tasks.workunit.client.1.smithi152.stdout:5/395: mknod dd/de/d17/d54/d7c/c83 0 2023-12-07T16:21:34.207 INFO:tasks.workunit.client.1.smithi152.stdout:6/351: link d2/d6/d9/c2d d2/d6/d19/d1f/d49/c6c 0 2023-12-07T16:21:34.209 INFO:tasks.workunit.client.1.smithi152.stdout:3/397: dwrite d7/d10/d1a/f43 [0,4194304] 0 2023-12-07T16:21:34.210 INFO:tasks.workunit.client.1.smithi152.stdout:2/349: dwrite d2/d1c/f7a [0,4194304] 0 2023-12-07T16:21:34.211 INFO:tasks.workunit.client.1.smithi152.stdout:0/404: unlink d0/d2f/d30/f7b 0 2023-12-07T16:21:34.211 INFO:tasks.workunit.client.1.smithi152.stdout:0/405: chown d0/dc/f79 3 1 2023-12-07T16:21:34.211 INFO:tasks.workunit.client.1.smithi152.stdout:0/406: readlink d0/d2f/l62 0 2023-12-07T16:21:34.211 INFO:tasks.workunit.client.1.smithi152.stdout:9/460: creat d1/d17/d3c/d4a/d7e/f9b x:0 0 0 2023-12-07T16:21:34.211 INFO:tasks.workunit.client.1.smithi152.stdout:9/461: fsync d1/f76 0 2023-12-07T16:21:34.212 INFO:tasks.workunit.client.0.smithi063.stdout:9/93: dwrite d0/d7/f1e [0,4194304] 0 2023-12-07T16:21:34.212 INFO:tasks.workunit.client.0.smithi063.stdout:7/59: dwrite d2/f8 [0,4194304] 0 2023-12-07T16:21:34.212 INFO:tasks.workunit.client.0.smithi063.stdout:1/67: dwrite d0/f1 [0,4194304] 0 2023-12-07T16:21:34.212 INFO:tasks.workunit.client.0.smithi063.stdout:5/76: dwrite d1/f11 [0,4194304] 0 2023-12-07T16:21:34.212 INFO:tasks.workunit.client.0.smithi063.stdout:2/63: rename d0/c9 to d0/c12 0 2023-12-07T16:21:34.212 INFO:tasks.workunit.client.0.smithi063.stdout:9/94: mknod d0/d13/c1f 0 2023-12-07T16:21:34.212 INFO:tasks.workunit.client.0.smithi063.stdout:0/134: dread d4/f5 [0,4194304] 0 2023-12-07T16:21:34.213 INFO:tasks.workunit.client.0.smithi063.stdout:0/135: chown d4/dd/de/d15/f21 377306047 1 2023-12-07T16:21:34.215 INFO:tasks.workunit.client.1.smithi152.stdout:1/408: link dc/d14/d18/c5d dc/d14/d18/d45/c81 0 2023-12-07T16:21:34.215 INFO:tasks.workunit.client.1.smithi152.stdout:1/409: readlink dc/de/d58/l5b 0 2023-12-07T16:21:34.215 INFO:tasks.workunit.client.1.smithi152.stdout:1/410: write dc/de/f2e [1432707,82907] 0 2023-12-07T16:21:34.217 INFO:tasks.workunit.client.0.smithi063.stdout:7/60: rename d2/f7 to d2/de/f1d 0 2023-12-07T16:21:34.217 INFO:tasks.workunit.client.0.smithi063.stdout:7/61: chown d2/de/f18 406967 1 2023-12-07T16:21:34.217 INFO:tasks.workunit.client.0.smithi063.stdout:7/62: chown d2/de/c19 383085 1 2023-12-07T16:21:34.217 INFO:tasks.workunit.client.0.smithi063.stdout:7/63: dread - d2/de/f1b zero size 2023-12-07T16:21:34.217 INFO:tasks.workunit.client.1.smithi152.stdout:5/396: creat dd/d7b/f84 x:0 0 0 2023-12-07T16:21:34.219 INFO:tasks.workunit.client.0.smithi063.stdout:1/68: write d0/d9/fc [1626596,59109] 0 2023-12-07T16:21:34.219 INFO:tasks.workunit.client.0.smithi063.stdout:5/77: unlink d1/d3/fa 0 2023-12-07T16:21:34.221 INFO:tasks.workunit.client.1.smithi152.stdout:6/352: mknod d2/d6/d9/d14/d48/c6d 0 2023-12-07T16:21:34.221 INFO:tasks.workunit.client.1.smithi152.stdout:6/353: chown d2/d6/d19/f46 35444568 1 2023-12-07T16:21:34.223 INFO:tasks.workunit.client.0.smithi063.stdout:5/78: creat d1/d3/de/f16 x:0 0 0 2023-12-07T16:21:34.223 INFO:tasks.workunit.client.1.smithi152.stdout:3/398: creat d7/d10/d1a/d2f/d5c/f7f x:0 0 0 2023-12-07T16:21:34.223 INFO:tasks.workunit.client.0.smithi063.stdout:2/64: rename d0/l3 to d0/df/l13 0 2023-12-07T16:21:34.223 INFO:tasks.workunit.client.0.smithi063.stdout:2/65: read - d0/f10 zero size 2023-12-07T16:21:34.227 INFO:tasks.workunit.client.0.smithi063.stdout:5/79: truncate d1/f13 1497863 0 2023-12-07T16:21:34.234 INFO:tasks.workunit.client.0.smithi063.stdout:9/95: rename d0/l14 to d0/d7/l20 0 2023-12-07T16:21:34.234 INFO:tasks.workunit.client.0.smithi063.stdout:9/96: chown d0/l11 11810297 1 2023-12-07T16:21:34.235 INFO:tasks.workunit.client.0.smithi063.stdout:9/97: read d0/f1a [416312,31799] 0 2023-12-07T16:21:34.235 INFO:tasks.workunit.client.1.smithi152.stdout:2/350: rmdir d2/d1c/d2e/d30/d53 39 2023-12-07T16:21:34.237 INFO:tasks.workunit.client.1.smithi152.stdout:0/407: creat d0/dc/d36/d3a/f85 x:0 0 0 2023-12-07T16:21:34.238 INFO:tasks.workunit.client.1.smithi152.stdout:0/408: getdents d0/dc/d3d/d6c 0 2023-12-07T16:21:34.238 INFO:tasks.workunit.client.1.smithi152.stdout:0/409: write d0/dc/d3d/d4c/f84 [24592,112668] 0 2023-12-07T16:21:34.238 INFO:tasks.workunit.client.0.smithi063.stdout:5/80: creat d1/d3/f17 x:0 0 0 2023-12-07T16:21:34.238 INFO:tasks.workunit.client.1.smithi152.stdout:5/397: dread dd/de/f31 [0,4194304] 0 2023-12-07T16:21:34.239 INFO:tasks.workunit.client.0.smithi063.stdout:2/66: rename d0/f6 to d0/f14 0 2023-12-07T16:21:34.240 INFO:tasks.workunit.client.0.smithi063.stdout:9/98: unlink d0/lb 0 2023-12-07T16:21:34.240 INFO:tasks.workunit.client.0.smithi063.stdout:9/99: fdatasync d0/d13/f17 0 2023-12-07T16:21:34.240 INFO:tasks.workunit.client.0.smithi063.stdout:9/100: chown d0/d7/ff 1617247 1 2023-12-07T16:21:34.240 INFO:tasks.workunit.client.1.smithi152.stdout:9/462: creat d1/d9/d2d/d46/f9c x:0 0 0 2023-12-07T16:21:34.241 INFO:tasks.workunit.client.0.smithi063.stdout:8/207: dwrite d7/d14/d1a/f22 [4194304,4194304] 0 2023-12-07T16:21:34.241 INFO:tasks.workunit.client.0.smithi063.stdout:8/208: chown d7/l13 23 1 2023-12-07T16:21:34.241 INFO:tasks.workunit.client.0.smithi063.stdout:8/209: chown d7/fd 4033249 1 2023-12-07T16:21:34.241 INFO:tasks.workunit.client.0.smithi063.stdout:5/81: creat d1/f18 x:0 0 0 2023-12-07T16:21:34.241 INFO:tasks.workunit.client.1.smithi152.stdout:1/411: link dc/f3d dc/d14/d68/f82 0 2023-12-07T16:21:34.241 INFO:tasks.workunit.client.1.smithi152.stdout:1/412: chown dc/d14 133512 1 2023-12-07T16:21:34.242 INFO:tasks.workunit.client.1.smithi152.stdout:1/413: chown dc/d14/d18/f70 176 1 2023-12-07T16:21:34.243 INFO:tasks.workunit.client.0.smithi063.stdout:9/101: truncate d0/d7/fe 7582548 0 2023-12-07T16:21:34.245 INFO:tasks.workunit.client.1.smithi152.stdout:0/410: symlink d0/l86 0 2023-12-07T16:21:34.245 INFO:tasks.workunit.client.1.smithi152.stdout:0/411: truncate d0/dc/d36/d3a/d51/f7a 283096 0 2023-12-07T16:21:34.246 INFO:tasks.workunit.client.0.smithi063.stdout:8/210: rename d7/d14/l36 to d7/d14/d15/d2b/l44 0 2023-12-07T16:21:34.248 INFO:tasks.workunit.client.0.smithi063.stdout:9/102: mkdir d0/d21 0 2023-12-07T16:21:34.248 INFO:tasks.workunit.client.1.smithi152.stdout:5/398: mknod dd/de/d38/d3d/c85 0 2023-12-07T16:21:34.249 INFO:tasks.workunit.client.1.smithi152.stdout:9/463: link d1/f3a d1/d17/f9d 0 2023-12-07T16:21:34.249 INFO:tasks.workunit.client.1.smithi152.stdout:9/464: fdatasync d1/d9/db/df/d42/f93 0 2023-12-07T16:21:34.249 INFO:tasks.workunit.client.1.smithi152.stdout:9/465: chown d1/d17/d3c/d4a/l7d 235605584 1 2023-12-07T16:21:34.250 INFO:tasks.workunit.client.0.smithi063.stdout:8/211: rename d7/d37/l3a to d7/d37/l45 0 2023-12-07T16:21:34.250 INFO:tasks.workunit.client.0.smithi063.stdout:8/212: truncate d7/d14/d1a/f33 190927 0 2023-12-07T16:21:34.250 INFO:tasks.workunit.client.1.smithi152.stdout:5/399: dread dd/de/d14/d1f/d28/f30 [0,4194304] 0 2023-12-07T16:21:34.251 INFO:tasks.workunit.client.1.smithi152.stdout:1/414: mknod dc/d14/d18/d79/c83 0 2023-12-07T16:21:34.251 INFO:tasks.workunit.client.1.smithi152.stdout:1/415: fsync dc/f36 0 2023-12-07T16:21:34.251 INFO:tasks.workunit.client.1.smithi152.stdout:1/416: write dc/de/f77 [1542889,121694] 0 2023-12-07T16:21:34.252 INFO:tasks.workunit.client.1.smithi152.stdout:0/412: mknod d0/d2f/d30/c87 0 2023-12-07T16:21:34.252 INFO:tasks.workunit.client.0.smithi063.stdout:9/103: write d0/d7/ff [7127540,7067] 0 2023-12-07T16:21:34.253 INFO:tasks.workunit.client.0.smithi063.stdout:8/213: creat d7/d14/d15/f46 x:0 0 0 2023-12-07T16:21:34.254 INFO:tasks.workunit.client.1.smithi152.stdout:2/351: getdents d2/d1c/d2e/d5d 0 2023-12-07T16:21:34.254 INFO:tasks.workunit.client.1.smithi152.stdout:2/352: getdents d2/d1c/d2e/d5d 0 2023-12-07T16:21:34.254 INFO:tasks.workunit.client.0.smithi063.stdout:9/104: symlink d0/d13/l22 0 2023-12-07T16:21:34.255 INFO:tasks.workunit.client.1.smithi152.stdout:9/466: creat d1/d9/d2d/d46/d9a/f9e x:0 0 0 2023-12-07T16:21:34.256 INFO:tasks.workunit.client.0.smithi063.stdout:3/55: dwrite f6 [4194304,4194304] 0 2023-12-07T16:21:34.256 INFO:tasks.workunit.client.0.smithi063.stdout:3/56: fdatasync d7/fa 0 2023-12-07T16:21:34.257 INFO:tasks.workunit.client.1.smithi152.stdout:5/400: creat dd/de/f86 x:0 0 0 2023-12-07T16:21:34.257 INFO:tasks.workunit.client.1.smithi152.stdout:5/401: fdatasync dd/de/d14/d1f/d28/f2d 0 2023-12-07T16:21:34.258 INFO:tasks.workunit.client.0.smithi063.stdout:0/136: dwrite d4/dd/de/d15/f18 [0,4194304] 0 2023-12-07T16:21:34.258 INFO:tasks.workunit.client.0.smithi063.stdout:3/57: creat d7/fc x:0 0 0 2023-12-07T16:21:34.261 INFO:tasks.workunit.client.0.smithi063.stdout:3/58: mkdir d7/d9/dd 0 2023-12-07T16:21:34.261 INFO:tasks.workunit.client.1.smithi152.stdout:6/354: dwrite d2/d6/de/d2e/d38/f50 [0,4194304] 0 2023-12-07T16:21:34.264 INFO:tasks.workunit.client.0.smithi063.stdout:3/59: link f6 d7/fe 0 2023-12-07T16:21:34.264 INFO:tasks.workunit.client.0.smithi063.stdout:1/69: dwrite d0/f4 [0,4194304] 0 2023-12-07T16:21:34.264 INFO:tasks.workunit.client.0.smithi063.stdout:6/135: dwrite d0/d1e/d20/f2f [0,4194304] 0 2023-12-07T16:21:34.264 INFO:tasks.workunit.client.1.smithi152.stdout:0/413: creat d0/d2f/d30/d6e/d77/f88 x:0 0 0 2023-12-07T16:21:34.264 INFO:tasks.workunit.client.1.smithi152.stdout:0/414: fdatasync d0/dc/d26/f41 0 2023-12-07T16:21:34.265 INFO:tasks.workunit.client.1.smithi152.stdout:3/399: dwrite d7/f8 [0,4194304] 0 2023-12-07T16:21:34.267 INFO:tasks.workunit.client.0.smithi063.stdout:1/70: rename d0/d9 to d0/dd/d10/d13 0 2023-12-07T16:21:34.269 INFO:tasks.workunit.client.1.smithi152.stdout:9/467: creat d1/d17/d3c/d4a/d7e/f9f x:0 0 0 2023-12-07T16:21:34.269 INFO:tasks.workunit.client.1.smithi152.stdout:2/353: mknod d2/d47/c7d 0 2023-12-07T16:21:34.274 INFO:tasks.workunit.client.1.smithi152.stdout:3/400: dread d7/d10/d1a/d2f/f18 [0,4194304] 0 2023-12-07T16:21:34.274 INFO:tasks.workunit.client.1.smithi152.stdout:6/355: rename d2/d6/d9/f57 to d2/d6/de/d45/f6e 0 2023-12-07T16:21:34.274 INFO:tasks.workunit.client.1.smithi152.stdout:6/356: write d2/d6/de/d3f/f59 [71539,8184] 0 2023-12-07T16:21:34.274 INFO:tasks.workunit.client.1.smithi152.stdout:6/357: stat d2/d6/de/d2e/l3d 0 2023-12-07T16:21:34.274 INFO:tasks.workunit.client.1.smithi152.stdout:6/358: chown d2/d6/de/d2e/d38 5232 1 2023-12-07T16:21:34.274 INFO:tasks.workunit.client.1.smithi152.stdout:5/402: write dd/de/d14/d1f/d28/f2f [3185852,89507] 0 2023-12-07T16:21:34.275 INFO:tasks.workunit.client.1.smithi152.stdout:0/415: mknod d0/d27/d11/c89 0 2023-12-07T16:21:34.275 INFO:tasks.workunit.client.0.smithi063.stdout:5/82: dwrite d1/d3/de/f14 [0,4194304] 0 2023-12-07T16:21:34.276 INFO:tasks.workunit.client.0.smithi063.stdout:5/83: write d1/d3/de/f10 [1303370,129321] 0 2023-12-07T16:21:34.276 INFO:tasks.workunit.client.0.smithi063.stdout:5/84: dread - d1/d3/de/f16 zero size 2023-12-07T16:21:34.278 INFO:tasks.workunit.client.1.smithi152.stdout:3/401: dread d7/d10/d19/f4a [0,4194304] 0 2023-12-07T16:21:34.278 INFO:tasks.workunit.client.1.smithi152.stdout:3/402: write d7/f5a [70697,121388] 0 2023-12-07T16:21:34.278 INFO:tasks.workunit.client.1.smithi152.stdout:3/403: stat d7 0 2023-12-07T16:21:34.278 INFO:tasks.workunit.client.1.smithi152.stdout:3/404: chown d7/d10/d19/f45 201569815 1 2023-12-07T16:21:34.278 INFO:tasks.workunit.client.1.smithi152.stdout:3/405: chown d7/dc/d3e/d7d 62611 1 2023-12-07T16:21:34.278 INFO:tasks.workunit.client.1.smithi152.stdout:3/406: chown d7/d10/d41/d70 213670992 1 2023-12-07T16:21:34.278 INFO:tasks.workunit.client.1.smithi152.stdout:3/407: chown d7/d10/d1a/d2f/f1d 36 1 2023-12-07T16:21:34.279 INFO:tasks.workunit.client.1.smithi152.stdout:9/468: creat d1/d17/d3c/fa0 x:0 0 0 2023-12-07T16:21:34.280 INFO:tasks.workunit.client.1.smithi152.stdout:2/354: mknod d2/d1c/c7e 0 2023-12-07T16:21:34.282 INFO:tasks.workunit.client.1.smithi152.stdout:6/359: unlink d2/d6/d19/f33 0 2023-12-07T16:21:34.282 INFO:tasks.workunit.client.1.smithi152.stdout:6/360: chown d2/d6/d19/d1f/d60 1211831173 1 2023-12-07T16:21:34.282 INFO:tasks.workunit.client.1.smithi152.stdout:6/361: readlink d2/d6/l5c 0 2023-12-07T16:21:34.282 INFO:tasks.workunit.client.1.smithi152.stdout:6/362: truncate d2/d6/de/f62 668169 0 2023-12-07T16:21:34.285 INFO:tasks.workunit.client.1.smithi152.stdout:5/403: rename dd/de/d14/f4a to dd/de/d17/d54/d7c/f87 0 2023-12-07T16:21:34.287 INFO:tasks.workunit.client.1.smithi152.stdout:0/416: creat d0/dc/d36/d7d/f8a x:0 0 0 2023-12-07T16:21:34.287 INFO:tasks.workunit.client.1.smithi152.stdout:2/355: dread d2/d1c/f41 [0,4194304] 0 2023-12-07T16:21:34.287 INFO:tasks.workunit.client.1.smithi152.stdout:2/356: chown d2/f70 9640796 1 2023-12-07T16:21:34.287 INFO:tasks.workunit.client.1.smithi152.stdout:2/357: stat d2/d1c/d2e/d5d/l75 0 2023-12-07T16:21:34.287 INFO:tasks.workunit.client.1.smithi152.stdout:9/469: symlink d1/dd/la1 0 2023-12-07T16:21:34.288 INFO:tasks.workunit.client.0.smithi063.stdout:6/136: link d0/l9 d0/d1e/d29/l31 0 2023-12-07T16:21:34.288 INFO:tasks.workunit.client.0.smithi063.stdout:6/137: truncate d0/d1e/d1d/d1f/f21 302976 0 2023-12-07T16:21:34.288 INFO:tasks.workunit.client.0.smithi063.stdout:0/137: dwrite d4/dd/de/f19 [0,4194304] 0 2023-12-07T16:21:34.289 INFO:tasks.workunit.client.1.smithi152.stdout:5/404: truncate dd/de/d14/f3f 2748867 0 2023-12-07T16:21:34.289 INFO:tasks.workunit.client.1.smithi152.stdout:5/405: fsync dd/de/d14/d67/f78 0 2023-12-07T16:21:34.291 INFO:tasks.workunit.client.0.smithi063.stdout:2/67: getdents d0 0 2023-12-07T16:21:34.291 INFO:tasks.workunit.client.0.smithi063.stdout:8/214: dwrite d7/d14/d15/f46 [0,4194304] 0 2023-12-07T16:21:34.291 INFO:tasks.workunit.client.1.smithi152.stdout:0/417: getdents d0/dc/d36 0 2023-12-07T16:21:34.294 INFO:tasks.workunit.client.1.smithi152.stdout:9/470: mkdir d1/dd/d24/da2 0 2023-12-07T16:21:34.294 INFO:tasks.workunit.client.1.smithi152.stdout:2/358: rename d2/d1c/d2e/d30/f3c to d2/d1c/d2e/f7f 0 2023-12-07T16:21:34.295 INFO:tasks.workunit.client.1.smithi152.stdout:5/406: mknod dd/de/c88 0 2023-12-07T16:21:34.296 INFO:tasks.workunit.client.0.smithi063.stdout:5/85: creat d1/d3/de/f19 x:0 0 0 2023-12-07T16:21:34.297 INFO:tasks.workunit.client.1.smithi152.stdout:0/418: mknod d0/c8b 0 2023-12-07T16:21:34.297 INFO:tasks.workunit.client.0.smithi063.stdout:6/138: creat d0/d1e/d1d/d1f/f32 x:0 0 0 2023-12-07T16:21:34.299 INFO:tasks.workunit.client.0.smithi063.stdout:0/138: mknod d4/dd/de/d15/d1f/c2e 0 2023-12-07T16:21:34.299 INFO:tasks.workunit.client.0.smithi063.stdout:1/71: dread d0/f1 [0,4194304] 0 2023-12-07T16:21:34.300 INFO:tasks.workunit.client.1.smithi152.stdout:9/471: symlink d1/dd/d24/la3 0 2023-12-07T16:21:34.300 INFO:tasks.workunit.client.1.smithi152.stdout:9/472: dread - d1/d17/d3c/d4a/d7e/f9f zero size 2023-12-07T16:21:34.302 INFO:tasks.workunit.client.0.smithi063.stdout:2/68: mknod d0/c15 0 2023-12-07T16:21:34.302 INFO:tasks.workunit.client.0.smithi063.stdout:2/69: readlink d0/l2 0 2023-12-07T16:21:34.302 INFO:tasks.workunit.client.1.smithi152.stdout:2/359: creat d2/d1c/f80 x:0 0 0 2023-12-07T16:21:34.304 INFO:tasks.workunit.client.0.smithi063.stdout:8/215: creat d7/d14/d15/f47 x:0 0 0 2023-12-07T16:21:34.304 INFO:tasks.workunit.client.1.smithi152.stdout:5/407: truncate dd/de/d14/d19/d1a/f37 198173 0 2023-12-07T16:21:34.308 INFO:tasks.workunit.client.0.smithi063.stdout:5/86: mkdir d1/d3/de/d1a 0 2023-12-07T16:21:34.308 INFO:tasks.workunit.client.0.smithi063.stdout:0/139: rename d4/dd/d26/f29 to d4/d25/f2f 0 2023-12-07T16:21:34.308 INFO:tasks.workunit.client.0.smithi063.stdout:6/139: symlink d0/d1e/d1d/l33 0 2023-12-07T16:21:34.308 INFO:tasks.workunit.client.0.smithi063.stdout:0/140: truncate d4/dd/de/d15/f21 745257 0 2023-12-07T16:21:34.308 INFO:tasks.workunit.client.1.smithi152.stdout:5/408: getdents dd 0 2023-12-07T16:21:34.310 INFO:tasks.workunit.client.0.smithi063.stdout:5/87: creat d1/d3/de/d1a/f1b x:0 0 0 2023-12-07T16:21:34.311 INFO:tasks.workunit.client.0.smithi063.stdout:2/70: dread d0/fb [0,4194304] 0 2023-12-07T16:21:34.311 INFO:tasks.workunit.client.0.smithi063.stdout:2/71: write d0/fa [65685,83152] 0 2023-12-07T16:21:34.311 INFO:tasks.workunit.client.0.smithi063.stdout:6/140: mknod d0/d1e/d20/c34 0 2023-12-07T16:21:34.311 INFO:tasks.workunit.client.0.smithi063.stdout:6/141: readlink d0/d1e/d29/l31 0 2023-12-07T16:21:34.312 INFO:tasks.workunit.client.1.smithi152.stdout:5/409: creat dd/de/d14/d19/f89 x:0 0 0 2023-12-07T16:21:34.312 INFO:tasks.workunit.client.1.smithi152.stdout:5/410: write dd/de/d17/f52 [946811,88818] 0 2023-12-07T16:21:34.312 INFO:tasks.workunit.client.1.smithi152.stdout:5/411: readlink dd/l59 0 2023-12-07T16:21:34.314 INFO:tasks.workunit.client.0.smithi063.stdout:0/141: mkdir d4/dd/de/d15/d1f/d30 0 2023-12-07T16:21:34.316 INFO:tasks.workunit.client.0.smithi063.stdout:2/72: dread d0/f14 [0,4194304] 0 2023-12-07T16:21:34.316 INFO:tasks.workunit.client.0.smithi063.stdout:2/73: chown d0/f14 230539 1 2023-12-07T16:21:34.317 INFO:tasks.workunit.client.0.smithi063.stdout:0/142: symlink d4/dd/de/d15/d1f/l31 0 2023-12-07T16:21:34.318 INFO:tasks.workunit.client.0.smithi063.stdout:6/142: creat d0/d17/d1a/f35 x:0 0 0 2023-12-07T16:21:34.318 INFO:tasks.workunit.client.0.smithi063.stdout:0/143: write d4/dd/de/f24 [1231182,83339] 0 2023-12-07T16:21:34.320 INFO:tasks.workunit.client.0.smithi063.stdout:6/143: creat d0/d1e/d29/f36 x:0 0 0 2023-12-07T16:21:34.320 INFO:tasks.workunit.client.0.smithi063.stdout:6/144: fdatasync d0/d1e/d1d/d1f/f32 0 2023-12-07T16:21:34.320 INFO:tasks.workunit.client.0.smithi063.stdout:2/74: creat d0/f16 x:0 0 0 2023-12-07T16:21:34.322 INFO:tasks.workunit.client.0.smithi063.stdout:6/145: symlink d0/d1e/d1d/l37 0 2023-12-07T16:21:34.323 INFO:tasks.workunit.client.0.smithi063.stdout:2/75: truncate d0/f7 6312420 0 2023-12-07T16:21:34.323 INFO:tasks.workunit.client.0.smithi063.stdout:2/76: dread - d0/f16 zero size 2023-12-07T16:21:34.324 INFO:tasks.workunit.client.0.smithi063.stdout:6/146: mkdir d0/d17/d1a/d38 0 2023-12-07T16:21:34.324 INFO:tasks.workunit.client.0.smithi063.stdout:6/147: chown d0/d1e/d20/c34 45601 1 2023-12-07T16:21:34.324 INFO:tasks.workunit.client.1.smithi152.stdout:5/412: dread dd/de/d14/d1f/d28/f2d [4194304,4194304] 0 2023-12-07T16:21:34.324 INFO:tasks.workunit.client.1.smithi152.stdout:6/363: dwrite d2/d6/d19/f46 [0,4194304] 0 2023-12-07T16:21:34.325 INFO:tasks.workunit.client.0.smithi063.stdout:6/148: read d0/fa [688811,130875] 0 2023-12-07T16:21:34.325 INFO:tasks.workunit.client.0.smithi063.stdout:2/77: creat d0/df/f17 x:0 0 0 2023-12-07T16:21:34.325 INFO:tasks.workunit.client.0.smithi063.stdout:2/78: write d0/fa [494998,70490] 0 2023-12-07T16:21:34.325 INFO:tasks.workunit.client.0.smithi063.stdout:6/149: stat d0/d1e/d29/l31 0 2023-12-07T16:21:34.328 INFO:tasks.workunit.client.1.smithi152.stdout:6/364: truncate d2/d6/de/d2e/f41 2342653 0 2023-12-07T16:21:34.328 INFO:tasks.workunit.client.1.smithi152.stdout:4/320: sync 2023-12-07T16:21:34.329 INFO:tasks.workunit.client.1.smithi152.stdout:9/473: dwrite d1/d17/d3c/f5f [0,4194304] 0 2023-12-07T16:21:34.329 INFO:tasks.workunit.client.0.smithi063.stdout:3/60: dwrite f5 [4194304,4194304] 0 2023-12-07T16:21:34.329 INFO:tasks.workunit.client.0.smithi063.stdout:3/61: fdatasync f6 0 2023-12-07T16:21:34.329 INFO:tasks.workunit.client.0.smithi063.stdout:3/62: chown l2 98 1 2023-12-07T16:21:34.329 INFO:tasks.workunit.client.1.smithi152.stdout:5/413: dread dd/de/d14/d19/f64 [0,4194304] 0 2023-12-07T16:21:34.330 INFO:tasks.workunit.client.1.smithi152.stdout:5/414: dread - dd/de/d14/d67/f80 zero size 2023-12-07T16:21:34.330 INFO:tasks.workunit.client.1.smithi152.stdout:0/419: dwrite d0/d2f/d30/f5a [0,4194304] 0 2023-12-07T16:21:34.330 INFO:tasks.workunit.client.1.smithi152.stdout:0/420: dread - d0/d2f/f74 zero size 2023-12-07T16:21:34.330 INFO:tasks.workunit.client.1.smithi152.stdout:0/421: dread - d0/dc/d3d/d4c/f6a zero size 2023-12-07T16:21:34.330 INFO:tasks.workunit.client.1.smithi152.stdout:0/422: chown d0/dc/d36/c50 0 1 2023-12-07T16:21:34.330 INFO:tasks.workunit.client.1.smithi152.stdout:1/417: dwrite dc/d28/d4e/f61 [0,4194304] 0 2023-12-07T16:21:34.330 INFO:tasks.workunit.client.1.smithi152.stdout:6/365: symlink d2/d6/d9/d14/d48/l6f 0 2023-12-07T16:21:34.334 INFO:tasks.workunit.client.1.smithi152.stdout:9/474: mkdir d1/d9/d2d/d72/d80/da4 0 2023-12-07T16:21:34.334 INFO:tasks.workunit.client.0.smithi063.stdout:1/72: dwrite d0/f1 [0,4194304] 0 2023-12-07T16:21:34.335 INFO:tasks.workunit.client.1.smithi152.stdout:5/415: symlink dd/de/d14/d19/d1a/d1b/l8a 0 2023-12-07T16:21:34.336 INFO:tasks.workunit.client.1.smithi152.stdout:9/475: write d1/d9/db/f79 [1217023,76915] 0 2023-12-07T16:21:34.336 INFO:tasks.workunit.client.0.smithi063.stdout:1/73: write d0/f7 [2424407,127006] 0 2023-12-07T16:21:34.336 INFO:tasks.workunit.client.1.smithi152.stdout:0/423: mkdir d0/d27/d8c 0 2023-12-07T16:21:34.336 INFO:tasks.workunit.client.1.smithi152.stdout:0/424: stat d0/dc/d3d/f53 0 2023-12-07T16:21:34.337 INFO:tasks.workunit.client.0.smithi063.stdout:8/216: rename d7/d37 to d7/d14/d15/d48 0 2023-12-07T16:21:34.340 INFO:tasks.workunit.client.0.smithi063.stdout:1/74: link d0/c6 d0/dd/c14 0 2023-12-07T16:21:34.340 INFO:tasks.workunit.client.1.smithi152.stdout:4/321: dread d0/d3/d6/dc/dd/f40 [0,4194304] 0 2023-12-07T16:21:34.343 INFO:tasks.workunit.client.0.smithi063.stdout:5/88: rename d1/d3/de/cf to d1/d3/de/d1a/c1c 0 2023-12-07T16:21:34.346 INFO:tasks.workunit.client.1.smithi152.stdout:1/418: creat dc/d14/f84 x:0 0 0 2023-12-07T16:21:34.346 INFO:tasks.workunit.client.1.smithi152.stdout:1/419: readlink la 0 2023-12-07T16:21:34.346 INFO:tasks.workunit.client.1.smithi152.stdout:1/420: write dc/d14/d18/d2d/f67 [5053866,58580] 0 2023-12-07T16:21:34.347 INFO:tasks.workunit.client.0.smithi063.stdout:1/75: link d0/lb d0/dd/d10/l15 0 2023-12-07T16:21:34.351 INFO:tasks.workunit.client.1.smithi152.stdout:5/416: creat dd/de/d14/d19/d1a/d1b/f8b x:0 0 0 2023-12-07T16:21:34.353 INFO:tasks.workunit.client.1.smithi152.stdout:9/476: truncate d1/dd/d24/f4d 1371566 0 2023-12-07T16:21:34.353 INFO:tasks.workunit.client.1.smithi152.stdout:0/425: creat d0/d27/d8c/f8d x:0 0 0 2023-12-07T16:21:34.353 INFO:tasks.workunit.client.0.smithi063.stdout:6/150: dwrite d0/d1e/d29/f36 [0,4194304] 0 2023-12-07T16:21:34.353 INFO:tasks.workunit.client.0.smithi063.stdout:6/151: chown d0/d1e/d1d/f27 6 1 2023-12-07T16:21:34.353 INFO:tasks.workunit.client.0.smithi063.stdout:5/89: link d1/f13 d1/d3/de/d1a/f1d 0 2023-12-07T16:21:34.354 INFO:tasks.workunit.client.0.smithi063.stdout:0/144: truncate d4/dd/f14 3760964 0 2023-12-07T16:21:34.356 INFO:tasks.workunit.client.1.smithi152.stdout:1/421: unlink dc/de/l1b 0 2023-12-07T16:21:34.357 INFO:tasks.workunit.client.0.smithi063.stdout:6/152: rename d0/d1e/c10 to d0/d1e/d20/c39 0 2023-12-07T16:21:34.357 INFO:tasks.workunit.client.0.smithi063.stdout:6/153: fsync d0/f8 0 2023-12-07T16:21:34.357 INFO:tasks.workunit.client.0.smithi063.stdout:6/154: write d0/d1e/d20/f2f [4813839,1516] 0 2023-12-07T16:21:34.358 INFO:tasks.workunit.client.1.smithi152.stdout:5/417: link dd/de/d14/d1f/d49/f73 dd/de/d14/d19/f8c 0 2023-12-07T16:21:34.358 INFO:tasks.workunit.client.1.smithi152.stdout:5/418: write dd/de/f32 [4984141,32342] 0 2023-12-07T16:21:34.358 INFO:tasks.workunit.client.0.smithi063.stdout:5/90: stat d1/c9 0 2023-12-07T16:21:34.359 INFO:tasks.workunit.client.1.smithi152.stdout:9/477: write d1/d17/d3c/d4a/d48/f52 [2808895,107465] 0 2023-12-07T16:21:34.359 INFO:tasks.workunit.client.1.smithi152.stdout:9/478: write d1/d9/d2d/d65/f73 [8798145,26585] 0 2023-12-07T16:21:34.360 INFO:tasks.workunit.client.0.smithi063.stdout:6/155: dread d0/d1e/d1d/f27 [0,4194304] 0 2023-12-07T16:21:34.360 INFO:tasks.workunit.client.0.smithi063.stdout:6/156: write d0/f1b [788997,88] 0 2023-12-07T16:21:34.360 INFO:tasks.workunit.client.0.smithi063.stdout:4/68: sync 2023-12-07T16:21:34.360 INFO:tasks.workunit.client.0.smithi063.stdout:4/69: chown d1/d3/db/fd 412097601 1 2023-12-07T16:21:34.361 INFO:tasks.workunit.client.1.smithi152.stdout:1/422: creat dc/d14/d18/d79/f85 x:0 0 0 2023-12-07T16:21:34.361 INFO:tasks.workunit.client.1.smithi152.stdout:5/419: creat dd/de/d14/d19/d1a/d1b/f8d x:0 0 0 2023-12-07T16:21:34.363 INFO:tasks.workunit.client.1.smithi152.stdout:0/426: dread d0/f9 [0,4194304] 0 2023-12-07T16:21:34.363 INFO:tasks.workunit.client.1.smithi152.stdout:5/420: write dd/de/d14/d1f/d28/f30 [235758,7892] 0 2023-12-07T16:21:34.363 INFO:tasks.workunit.client.1.smithi152.stdout:5/421: chown dd/de/d38/d3d/d6d 1462 1 2023-12-07T16:21:34.364 INFO:tasks.workunit.client.1.smithi152.stdout:1/423: mkdir dc/d14/d18/d79/d86 0 2023-12-07T16:21:34.365 INFO:tasks.workunit.client.0.smithi063.stdout:4/70: mknod d1/d3/db/c11 0 2023-12-07T16:21:34.365 INFO:tasks.workunit.client.0.smithi063.stdout:6/157: read d0/f8 [3728717,129700] 0 2023-12-07T16:21:34.366 INFO:tasks.workunit.client.0.smithi063.stdout:6/158: read d0/d1e/f26 [1937051,29499] 0 2023-12-07T16:21:34.366 INFO:tasks.workunit.client.1.smithi152.stdout:0/427: creat d0/dc/d3d/d4c/f8e x:0 0 0 2023-12-07T16:21:34.367 INFO:tasks.workunit.client.0.smithi063.stdout:4/71: write d1/d3/f8 [329049,26053] 0 2023-12-07T16:21:34.367 INFO:tasks.workunit.client.1.smithi152.stdout:9/479: creat d1/d9/d2d/d72/d80/da4/fa5 x:0 0 0 2023-12-07T16:21:34.367 INFO:tasks.workunit.client.1.smithi152.stdout:6/366: getdents d2/d6/d9 0 2023-12-07T16:21:34.367 INFO:tasks.workunit.client.1.smithi152.stdout:6/367: truncate d2/d6/de/d45/d55/f5e 527082 0 2023-12-07T16:21:34.368 INFO:tasks.workunit.client.0.smithi063.stdout:6/159: creat d0/d1e/d1d/f3a x:0 0 0 2023-12-07T16:21:34.368 INFO:tasks.workunit.client.0.smithi063.stdout:6/160: dread - d0/d17/f25 zero size 2023-12-07T16:21:34.369 INFO:tasks.workunit.client.0.smithi063.stdout:4/72: rmdir d1/d3 39 2023-12-07T16:21:34.371 INFO:tasks.workunit.client.1.smithi152.stdout:1/424: unlink dc/d14/d18/d45/d74/f7f 0 2023-12-07T16:21:34.372 INFO:tasks.workunit.client.1.smithi152.stdout:0/428: mknod d0/d27/d11/d68/c8f 0 2023-12-07T16:21:34.372 INFO:tasks.workunit.client.1.smithi152.stdout:0/429: write d0/dc/d3d/d4c/f6a [251182,88612] 0 2023-12-07T16:21:34.372 INFO:tasks.workunit.client.0.smithi063.stdout:6/161: dread d0/f15 [0,4194304] 0 2023-12-07T16:21:34.375 INFO:tasks.workunit.client.1.smithi152.stdout:1/425: dread dc/d28/f5e [0,4194304] 0 2023-12-07T16:21:34.375 INFO:tasks.workunit.client.1.smithi152.stdout:6/368: mkdir d2/d6/d9/d14/d48/d70 0 2023-12-07T16:21:34.375 INFO:tasks.workunit.client.1.smithi152.stdout:8/346: sync 2023-12-07T16:21:34.377 INFO:tasks.workunit.client.1.smithi152.stdout:0/430: mknod d0/dc/d3d/d4c/c90 0 2023-12-07T16:21:34.378 INFO:tasks.workunit.client.1.smithi152.stdout:6/369: dread d2/d6/de/d45/d55/f5e [0,4194304] 0 2023-12-07T16:21:34.379 INFO:tasks.workunit.client.0.smithi063.stdout:2/79: getdents d0/df 0 2023-12-07T16:21:34.380 INFO:tasks.workunit.client.0.smithi063.stdout:2/80: mknod d0/df/d11/c18 0 2023-12-07T16:21:34.382 INFO:tasks.workunit.client.0.smithi063.stdout:2/81: mknod d0/df/c19 0 2023-12-07T16:21:34.383 INFO:tasks.workunit.client.0.smithi063.stdout:2/82: write d0/f14 [1043379,39899] 0 2023-12-07T16:21:34.383 INFO:tasks.workunit.client.0.smithi063.stdout:2/83: write d0/f10 [490009,122324] 0 2023-12-07T16:21:34.384 INFO:tasks.workunit.client.1.smithi152.stdout:9/480: rename d1/dd/d24 to d1/d9/db/df/da6 0 2023-12-07T16:21:34.384 INFO:tasks.workunit.client.1.smithi152.stdout:2/360: fsync d2/d1c/d2e/f7f 0 2023-12-07T16:21:34.388 INFO:tasks.workunit.client.1.smithi152.stdout:9/481: write d1/d9/f23 [4392147,9894] 0 2023-12-07T16:21:34.390 INFO:tasks.workunit.client.1.smithi152.stdout:0/431: dread d0/dc/f3c [0,4194304] 0 2023-12-07T16:21:34.390 INFO:tasks.workunit.client.1.smithi152.stdout:6/370: rename d2/l3c to d2/d6/d19/l71 0 2023-12-07T16:21:34.390 INFO:tasks.workunit.client.1.smithi152.stdout:6/371: stat d2/d6/f63 0 2023-12-07T16:21:34.391 INFO:tasks.workunit.client.1.smithi152.stdout:9/482: creat d1/d17/d3c/fa7 x:0 0 0 2023-12-07T16:21:34.391 INFO:tasks.workunit.client.1.smithi152.stdout:9/483: write d1/d9/d2d/f84 [598758,72075] 0 2023-12-07T16:21:34.392 INFO:tasks.workunit.client.1.smithi152.stdout:8/347: write d3/d1e/f44 [1396327,38193] 0 2023-12-07T16:21:34.392 INFO:tasks.workunit.client.1.smithi152.stdout:1/426: dread dc/de/f22 [0,4194304] 0 2023-12-07T16:21:34.393 INFO:tasks.workunit.client.1.smithi152.stdout:2/361: rename d2/d9/f6f to d2/d1c/d52/f81 0 2023-12-07T16:21:34.395 INFO:tasks.workunit.client.1.smithi152.stdout:6/372: truncate d2/d6/d19/f22 96686 0 2023-12-07T16:21:34.396 INFO:tasks.workunit.client.1.smithi152.stdout:9/484: creat d1/d17/d4e/fa8 x:0 0 0 2023-12-07T16:21:34.399 INFO:tasks.workunit.client.1.smithi152.stdout:2/362: creat d2/d1c/d2e/f82 x:0 0 0 2023-12-07T16:21:34.399 INFO:tasks.workunit.client.1.smithi152.stdout:2/363: stat d2/d9/f13 0 2023-12-07T16:21:34.399 INFO:tasks.workunit.client.1.smithi152.stdout:2/364: chown d2/d1c/d2e/d30/d33/l78 0 1 2023-12-07T16:21:34.399 INFO:tasks.workunit.client.1.smithi152.stdout:2/365: chown d2/d47/f36 2995 1 2023-12-07T16:21:34.399 INFO:tasks.workunit.client.1.smithi152.stdout:6/373: mknod d2/d6/de/d2e/d38/c72 0 2023-12-07T16:21:34.401 INFO:tasks.workunit.client.1.smithi152.stdout:9/485: symlink d1/d9/d4f/la9 0 2023-12-07T16:21:34.401 INFO:tasks.workunit.client.1.smithi152.stdout:9/486: chown d1/f76 710750 1 2023-12-07T16:21:34.404 INFO:tasks.workunit.client.1.smithi152.stdout:8/348: dread d3/f1d [0,4194304] 0 2023-12-07T16:21:34.404 INFO:tasks.workunit.client.1.smithi152.stdout:6/374: mknod d2/d6/d9/d14/d48/c73 0 2023-12-07T16:21:34.406 INFO:tasks.workunit.client.1.smithi152.stdout:2/366: rename d2/c6 to d2/d1c/d2e/c83 0 2023-12-07T16:21:34.406 INFO:tasks.workunit.client.1.smithi152.stdout:2/367: stat d2/d1c/d2e/d30/d33/l24 0 2023-12-07T16:21:34.407 INFO:tasks.workunit.client.1.smithi152.stdout:2/368: mkdir d2/d1c/d2e/d30/d42/d84 0 2023-12-07T16:21:34.408 INFO:tasks.workunit.client.1.smithi152.stdout:2/369: symlink d2/d1c/d2e/d30/d42/l85 0 2023-12-07T16:21:34.409 INFO:tasks.workunit.client.0.smithi063.stdout:3/63: dwrite d7/fe [4194304,4194304] 0 2023-12-07T16:21:34.411 INFO:tasks.workunit.client.1.smithi152.stdout:2/370: mkdir d2/d1c/d2e/d30/d33/d86 0 2023-12-07T16:21:34.411 INFO:tasks.workunit.client.1.smithi152.stdout:2/371: dread - d2/d47/f77 zero size 2023-12-07T16:21:34.411 INFO:tasks.workunit.client.1.smithi152.stdout:2/372: getdents d2/d1c/d2e/d30/d33/d86 0 2023-12-07T16:21:34.418 INFO:tasks.workunit.client.1.smithi152.stdout:2/373: mknod d2/c87 0 2023-12-07T16:21:34.418 INFO:tasks.workunit.client.1.smithi152.stdout:7/339: sync 2023-12-07T16:21:34.418 INFO:tasks.workunit.client.1.smithi152.stdout:7/340: getdents db/d1c 0 2023-12-07T16:21:34.419 INFO:tasks.workunit.client.1.smithi152.stdout:7/341: link f8 db/f61 0 2023-12-07T16:21:34.420 INFO:tasks.workunit.client.0.smithi063.stdout:5/91: rename d1/d3/de/d1a to d1/d3/de/d1e 0 2023-12-07T16:21:34.425 INFO:tasks.workunit.client.1.smithi152.stdout:8/349: dread d3/d4/d9/f38 [0,4194304] 0 2023-12-07T16:21:34.425 INFO:tasks.workunit.client.0.smithi063.stdout:3/64: creat d7/ff x:0 0 0 2023-12-07T16:21:34.426 INFO:tasks.workunit.client.0.smithi063.stdout:3/65: getdents d7/d9/dd 0 2023-12-07T16:21:34.428 INFO:tasks.workunit.client.1.smithi152.stdout:8/350: mkdir d3/d4/d9/dc/d6f/d7b 0 2023-12-07T16:21:34.428 INFO:tasks.workunit.client.1.smithi152.stdout:8/351: stat d3/d4/d9/f18 0 2023-12-07T16:21:34.428 INFO:tasks.workunit.client.1.smithi152.stdout:8/352: readlink d3/d4/l2a 0 2023-12-07T16:21:34.430 INFO:tasks.workunit.client.1.smithi152.stdout:8/353: mkdir d3/d4/d9/dc/d1f/d63/d7c 0 2023-12-07T16:21:34.430 INFO:tasks.workunit.client.0.smithi063.stdout:5/92: link d1/f7 d1/d3/de/f1f 0 2023-12-07T16:21:34.431 INFO:tasks.workunit.client.0.smithi063.stdout:3/66: mknod d7/c10 0 2023-12-07T16:21:34.431 INFO:tasks.workunit.client.1.smithi152.stdout:4/322: dwrite d0/d3/d6/f2e [0,4194304] 0 2023-12-07T16:21:34.431 INFO:tasks.workunit.client.1.smithi152.stdout:8/354: getdents d3/d4/d9 0 2023-12-07T16:21:34.432 INFO:tasks.workunit.client.1.smithi152.stdout:8/355: readlink d3/d4/d9/dc/l27 0 2023-12-07T16:21:34.432 INFO:tasks.workunit.client.0.smithi063.stdout:8/217: dwrite d7/d14/d1a/f31 [0,4194304] 0 2023-12-07T16:21:34.432 INFO:tasks.workunit.client.0.smithi063.stdout:8/218: chown d7/c11 10599 1 2023-12-07T16:21:34.435 INFO:tasks.workunit.client.1.smithi152.stdout:4/323: mkdir d0/d3/d6/d5c 0 2023-12-07T16:21:34.437 INFO:tasks.workunit.client.1.smithi152.stdout:8/356: mkdir d3/d4/d9/dc/d1f/d63/d67/d7d 0 2023-12-07T16:21:34.438 INFO:tasks.workunit.client.0.smithi063.stdout:8/219: read d7/ff [1517534,106866] 0 2023-12-07T16:21:34.438 INFO:tasks.workunit.client.0.smithi063.stdout:8/220: write d7/d14/d15/f2f [620262,118712] 0 2023-12-07T16:21:34.438 INFO:tasks.workunit.client.0.smithi063.stdout:8/221: truncate d7/d38/f3b 1004186 0 2023-12-07T16:21:34.438 INFO:tasks.workunit.client.1.smithi152.stdout:4/324: creat d0/d3/d6/dc/d3a/d48/f5d x:0 0 0 2023-12-07T16:21:34.440 INFO:tasks.workunit.client.0.smithi063.stdout:5/93: dread d1/d3/de/f10 [0,4194304] 0 2023-12-07T16:21:34.440 INFO:tasks.workunit.client.0.smithi063.stdout:5/94: dread - d1/d3/de/d1e/f1b zero size 2023-12-07T16:21:34.440 INFO:tasks.workunit.client.0.smithi063.stdout:5/95: stat d1/d3/de/d1e 0 2023-12-07T16:21:34.441 INFO:tasks.workunit.client.1.smithi152.stdout:4/325: creat d0/d3/d6/dc/d39/f5e x:0 0 0 2023-12-07T16:21:34.441 INFO:tasks.workunit.client.1.smithi152.stdout:4/326: write d0/d3/d6/dc/d3a/d46/d4e/f57 [92460,65416] 0 2023-12-07T16:21:34.441 INFO:tasks.workunit.client.1.smithi152.stdout:4/327: dread - d0/d3/d6/dc/dd/f33 zero size 2023-12-07T16:21:34.441 INFO:tasks.workunit.client.1.smithi152.stdout:4/328: write d0/d3/d6/dc/d3a/f58 [789637,92618] 0 2023-12-07T16:21:34.441 INFO:tasks.workunit.client.1.smithi152.stdout:4/329: fsync d0/d3/f37 0 2023-12-07T16:21:34.442 INFO:tasks.workunit.client.1.smithi152.stdout:4/330: creat d0/d17/f5f x:0 0 0 2023-12-07T16:21:34.442 INFO:tasks.workunit.client.1.smithi152.stdout:8/357: write d3/d4/d9/f33 [2851495,106085] 0 2023-12-07T16:21:34.446 INFO:tasks.workunit.client.1.smithi152.stdout:8/358: mkdir d3/d4/d9/dc/d6f/d7b/d7e 0 2023-12-07T16:21:34.447 INFO:tasks.workunit.client.0.smithi063.stdout:3/67: dread d7/fe [0,4194304] 0 2023-12-07T16:21:34.457 INFO:tasks.workunit.client.0.smithi063.stdout:0/145: dwrite d4/dd/de/f20 [0,4194304] 0 2023-12-07T16:21:34.457 INFO:tasks.workunit.client.0.smithi063.stdout:6/162: dwrite d0/d1e/f12 [0,4194304] 0 2023-12-07T16:21:34.457 INFO:tasks.workunit.client.0.smithi063.stdout:6/163: fdatasync d0/d1e/d1d/f3a 0 2023-12-07T16:21:34.458 INFO:tasks.workunit.client.0.smithi063.stdout:3/68: write f6 [5914909,92471] 0 2023-12-07T16:21:34.458 INFO:tasks.workunit.client.0.smithi063.stdout:3/69: dread - d7/fc zero size 2023-12-07T16:21:34.458 INFO:tasks.workunit.client.0.smithi063.stdout:3/70: chown f6 0 1 2023-12-07T16:21:34.459 INFO:tasks.workunit.client.1.smithi152.stdout:1/427: dwrite dc/d14/d18/d2d/d4a/d52/f73 [0,4194304] 0 2023-12-07T16:21:34.460 INFO:tasks.workunit.client.1.smithi152.stdout:5/422: dwrite dd/de/d14/d1f/d28/f69 [0,4194304] 0 2023-12-07T16:21:34.462 INFO:tasks.workunit.client.1.smithi152.stdout:1/428: rename dc/d14/d18/d45/c81 to dc/d28/c87 0 2023-12-07T16:21:34.462 INFO:tasks.workunit.client.0.smithi063.stdout:4/73: dwrite d1/d3/f5 [0,4194304] 0 2023-12-07T16:21:34.462 INFO:tasks.workunit.client.0.smithi063.stdout:0/146: symlink d4/dd/de/d15/d1f/d22/l32 0 2023-12-07T16:21:34.462 INFO:tasks.workunit.client.0.smithi063.stdout:0/147: chown d4/dd/de/d15 27622 1 2023-12-07T16:21:34.462 INFO:tasks.workunit.client.0.smithi063.stdout:4/74: chown d1/d3/db/cf 28373 1 2023-12-07T16:21:34.462 INFO:tasks.workunit.client.0.smithi063.stdout:4/75: truncate d1/f10 4071228 0 2023-12-07T16:21:34.462 INFO:tasks.workunit.client.0.smithi063.stdout:0/148: getdents d4/dd/d26/d2b 0 2023-12-07T16:21:34.462 INFO:tasks.workunit.client.0.smithi063.stdout:0/149: chown c1 306 1 2023-12-07T16:21:34.464 INFO:tasks.workunit.client.0.smithi063.stdout:6/164: symlink d0/d1e/d2a/l3b 0 2023-12-07T16:21:34.464 INFO:tasks.workunit.client.1.smithi152.stdout:5/423: symlink dd/de/d38/d3d/l8e 0 2023-12-07T16:21:34.466 INFO:tasks.workunit.client.0.smithi063.stdout:3/71: rmdir d7/d9 39 2023-12-07T16:21:34.466 INFO:tasks.workunit.client.0.smithi063.stdout:3/72: truncate d7/fa 25095 0 2023-12-07T16:21:34.466 INFO:tasks.workunit.client.1.smithi152.stdout:1/429: mknod dc/d14/d18/c88 0 2023-12-07T16:21:34.468 INFO:tasks.workunit.client.1.smithi152.stdout:5/424: mkdir dd/de/d8f 0 2023-12-07T16:21:34.468 INFO:tasks.workunit.client.1.smithi152.stdout:5/425: read - dd/de/d14/d1f/f6e zero size 2023-12-07T16:21:34.469 INFO:tasks.workunit.client.0.smithi063.stdout:0/150: rename d4/dd/f1e to d4/dd/d26/d2b/f33 0 2023-12-07T16:21:34.470 INFO:tasks.workunit.client.0.smithi063.stdout:0/151: chown d4/dd 1120709 1 2023-12-07T16:21:34.470 INFO:tasks.workunit.client.1.smithi152.stdout:5/426: creat dd/de/d38/d3d/d6d/f90 x:0 0 0 2023-12-07T16:21:34.470 INFO:tasks.workunit.client.1.smithi152.stdout:5/427: read - dd/de/d14/d19/d1a/f55 zero size 2023-12-07T16:21:34.470 INFO:tasks.workunit.client.0.smithi063.stdout:6/165: truncate d0/f8 4191202 0 2023-12-07T16:21:34.470 INFO:tasks.workunit.client.0.smithi063.stdout:6/166: write d0/ff [1710615,104601] 0 2023-12-07T16:21:34.472 INFO:tasks.workunit.client.1.smithi152.stdout:5/428: mkdir dd/d91 0 2023-12-07T16:21:34.472 INFO:tasks.workunit.client.1.smithi152.stdout:5/429: dread - dd/de/d17/f61 zero size 2023-12-07T16:21:34.474 INFO:tasks.workunit.client.1.smithi152.stdout:5/430: creat dd/de/d14/d19/d1a/f92 x:0 0 0 2023-12-07T16:21:34.474 INFO:tasks.workunit.client.1.smithi152.stdout:5/431: stat dd/de/d14/d1f/d49 0 2023-12-07T16:21:34.474 INFO:tasks.workunit.client.1.smithi152.stdout:5/432: chown dd/de/d14/d19 1 1 2023-12-07T16:21:34.475 INFO:tasks.workunit.client.1.smithi152.stdout:5/433: creat dd/de/d8f/f93 x:0 0 0 2023-12-07T16:21:34.475 INFO:tasks.workunit.client.1.smithi152.stdout:5/434: fdatasync dd/de/d17/f61 0 2023-12-07T16:21:34.476 INFO:tasks.workunit.client.0.smithi063.stdout:2/84: dwrite d0/fa [0,4194304] 0 2023-12-07T16:21:34.476 INFO:tasks.workunit.client.0.smithi063.stdout:2/85: chown d0 50799241 1 2023-12-07T16:21:34.477 INFO:tasks.workunit.client.1.smithi152.stdout:0/432: dwrite d0/dc/d36/d7d/f8a [0,4194304] 0 2023-12-07T16:21:34.479 INFO:tasks.workunit.client.0.smithi063.stdout:0/152: write d4/f16 [1477826,20016] 0 2023-12-07T16:21:34.479 INFO:tasks.workunit.client.0.smithi063.stdout:0/153: chown d4/l1a 34742617 1 2023-12-07T16:21:34.480 INFO:tasks.workunit.client.1.smithi152.stdout:5/435: rename dd/de/d17/d54/l5d to dd/de/d14/d19/d1a/l94 0 2023-12-07T16:21:34.480 INFO:tasks.workunit.client.1.smithi152.stdout:5/436: fsync dd/de/d14/d1f/d49/f73 0 2023-12-07T16:21:34.483 INFO:tasks.workunit.client.1.smithi152.stdout:9/487: dread d1/d9/d2d/f84 [0,4194304] 0 2023-12-07T16:21:34.483 INFO:tasks.workunit.client.1.smithi152.stdout:2/374: dwrite d2/d47/f36 [0,4194304] 0 2023-12-07T16:21:34.483 INFO:tasks.workunit.client.1.smithi152.stdout:0/433: mknod d0/dc/d36/d3a/d51/d82/c91 0 2023-12-07T16:21:34.483 INFO:tasks.workunit.client.1.smithi152.stdout:5/437: rename dd/de/d14/d1f/f82 to dd/de/d14/d19/f95 0 2023-12-07T16:21:34.483 INFO:tasks.workunit.client.1.smithi152.stdout:7/342: dwrite db/f47 [0,4194304] 0 2023-12-07T16:21:34.484 INFO:tasks.workunit.client.1.smithi152.stdout:1/430: dread dc/d14/d18/f2c [0,4194304] 0 2023-12-07T16:21:34.484 INFO:tasks.workunit.client.1.smithi152.stdout:1/431: chown dc/d14/d18/d79/d7c 45 1 2023-12-07T16:21:34.484 INFO:tasks.workunit.client.1.smithi152.stdout:4/331: dwrite d0/d3/d6/dc/d22/f4d [0,4194304] 0 2023-12-07T16:21:34.485 INFO:tasks.workunit.client.1.smithi152.stdout:8/359: dwrite d3/d4/d9/dc/d1f/f31 [0,4194304] 0 2023-12-07T16:21:34.485 INFO:tasks.workunit.client.0.smithi063.stdout:8/222: dwrite f5 [0,4194304] 0 2023-12-07T16:21:34.487 INFO:tasks.workunit.client.1.smithi152.stdout:6/375: dwrite d2/d6/de/f61 [0,4194304] 0 2023-12-07T16:21:34.488 INFO:tasks.workunit.client.0.smithi063.stdout:8/223: getdents d7/d14/d15 0 2023-12-07T16:21:34.488 INFO:tasks.workunit.client.1.smithi152.stdout:7/343: symlink db/d27/l62 0 2023-12-07T16:21:34.489 INFO:tasks.workunit.client.0.smithi063.stdout:8/224: mknod d7/c49 0 2023-12-07T16:21:34.490 INFO:tasks.workunit.client.1.smithi152.stdout:2/375: rename d2/f70 to d2/d1c/d2e/d30/d53/f88 0 2023-12-07T16:21:34.494 INFO:tasks.workunit.client.1.smithi152.stdout:1/432: creat dc/d14/d18/d64/f89 x:0 0 0 2023-12-07T16:21:34.494 INFO:tasks.workunit.client.1.smithi152.stdout:1/433: chown dc/d14 43876846 1 2023-12-07T16:21:34.497 INFO:tasks.workunit.client.0.smithi063.stdout:7/64: sync 2023-12-07T16:21:34.498 INFO:tasks.workunit.client.0.smithi063.stdout:9/105: sync 2023-12-07T16:21:34.499 INFO:tasks.workunit.client.0.smithi063.stdout:7/65: creat d2/f1e x:0 0 0 2023-12-07T16:21:34.501 INFO:tasks.workunit.client.0.smithi063.stdout:9/106: creat d0/d21/f23 x:0 0 0 2023-12-07T16:21:34.502 INFO:tasks.workunit.client.1.smithi152.stdout:4/332: creat d0/d3/d6/dc/d22/f60 x:0 0 0 2023-12-07T16:21:34.504 INFO:tasks.workunit.client.0.smithi063.stdout:7/66: symlink d2/de/l1f 0 2023-12-07T16:21:34.505 INFO:tasks.workunit.client.0.smithi063.stdout:0/154: dread d4/dd/de/f19 [0,4194304] 0 2023-12-07T16:21:34.505 INFO:tasks.workunit.client.0.smithi063.stdout:6/167: dwrite d0/f19 [0,4194304] 0 2023-12-07T16:21:34.509 INFO:tasks.workunit.client.0.smithi063.stdout:9/107: truncate d0/d7/f1e 3603882 0 2023-12-07T16:21:34.510 INFO:tasks.workunit.client.0.smithi063.stdout:7/67: creat d2/de/f20 x:0 0 0 2023-12-07T16:21:34.510 INFO:tasks.workunit.client.1.smithi152.stdout:8/360: getdents d3/d4 0 2023-12-07T16:21:34.512 INFO:tasks.workunit.client.0.smithi063.stdout:6/168: symlink d0/d17/d1a/d38/l3c 0 2023-12-07T16:21:34.515 INFO:tasks.workunit.client.0.smithi063.stdout:7/68: unlink d2/f10 0 2023-12-07T16:21:34.517 INFO:tasks.workunit.client.0.smithi063.stdout:6/169: creat d0/d1e/d1d/f3d x:0 0 0 2023-12-07T16:21:34.518 INFO:tasks.workunit.client.0.smithi063.stdout:6/170: dread d0/d1e/d1d/d1f/f21 [0,4194304] 0 2023-12-07T16:21:34.519 INFO:tasks.workunit.client.1.smithi152.stdout:7/344: mkdir db/d27/d39/d63 0 2023-12-07T16:21:34.519 INFO:tasks.workunit.client.1.smithi152.stdout:7/345: chown db/f18 21 1 2023-12-07T16:21:34.521 INFO:tasks.workunit.client.1.smithi152.stdout:2/376: mknod d2/d1c/d2e/d30/d33/d86/c89 0 2023-12-07T16:21:34.521 INFO:tasks.workunit.client.1.smithi152.stdout:2/377: chown d2/d1c/d2e/f46 287724139 1 2023-12-07T16:21:34.521 INFO:tasks.workunit.client.1.smithi152.stdout:2/378: chown d2/d1c/f80 70351 1 2023-12-07T16:21:34.521 INFO:tasks.workunit.client.0.smithi063.stdout:6/171: creat d0/d1e/f3e x:0 0 0 2023-12-07T16:21:34.523 INFO:tasks.workunit.client.0.smithi063.stdout:6/172: dread d0/d1e/d1d/f27 [0,4194304] 0 2023-12-07T16:21:34.523 INFO:tasks.workunit.client.1.smithi152.stdout:0/434: rename d0/dc/d3d/d6c to d0/dc/d36/d7d/d92 0 2023-12-07T16:21:34.526 INFO:tasks.workunit.client.1.smithi152.stdout:1/434: mkdir dc/d14/d18/d64/d8a 0 2023-12-07T16:21:34.526 INFO:tasks.workunit.client.1.smithi152.stdout:1/435: truncate dc/d14/d68/f6b 424478 0 2023-12-07T16:21:34.526 INFO:tasks.workunit.client.1.smithi152.stdout:1/436: write dc/d14/d18/f2c [4296207,57588] 0 2023-12-07T16:21:34.528 INFO:tasks.workunit.client.1.smithi152.stdout:8/361: mkdir d3/d4/d4b/d7f 0 2023-12-07T16:21:34.528 INFO:tasks.workunit.client.1.smithi152.stdout:8/362: readlink d3/d4/d9/d34/l3b 0 2023-12-07T16:21:34.529 INFO:tasks.workunit.client.1.smithi152.stdout:2/379: mkdir d2/d1c/d2e/d30/d53/d8a 0 2023-12-07T16:21:34.530 INFO:tasks.workunit.client.1.smithi152.stdout:0/435: mknod d0/c93 0 2023-12-07T16:21:34.533 INFO:tasks.workunit.client.1.smithi152.stdout:1/437: mknod dc/de/d58/c8b 0 2023-12-07T16:21:34.533 INFO:tasks.workunit.client.1.smithi152.stdout:1/438: dread - dc/d14/d18/d64/f89 zero size 2023-12-07T16:21:34.534 INFO:tasks.workunit.client.1.smithi152.stdout:8/363: mknod d3/d4/d9/d23/c80 0 2023-12-07T16:21:34.535 INFO:tasks.workunit.client.1.smithi152.stdout:2/380: mknod d2/d9/c8b 0 2023-12-07T16:21:34.537 INFO:tasks.workunit.client.1.smithi152.stdout:7/346: dread db/f18 [0,4194304] 0 2023-12-07T16:21:34.538 INFO:tasks.workunit.client.1.smithi152.stdout:1/439: rename dc/l44 to dc/d14/d68/l8c 0 2023-12-07T16:21:34.538 INFO:tasks.workunit.client.1.smithi152.stdout:1/440: readlink dc/d14/d18/d64/l66 0 2023-12-07T16:21:34.539 INFO:tasks.workunit.client.1.smithi152.stdout:8/364: mknod d3/d4/d9/dc/d1f/d63/d67/c81 0 2023-12-07T16:21:34.541 INFO:tasks.workunit.client.1.smithi152.stdout:7/347: truncate db/fe 3337356 0 2023-12-07T16:21:34.543 INFO:tasks.workunit.client.0.smithi063.stdout:8/225: dwrite d7/d14/d15/f18 [0,4194304] 0 2023-12-07T16:21:34.543 INFO:tasks.workunit.client.1.smithi152.stdout:1/441: write dc/d14/f2b [3208414,83578] 0 2023-12-07T16:21:34.543 INFO:tasks.workunit.client.1.smithi152.stdout:8/365: write d3/d4/d9/f38 [3342230,67068] 0 2023-12-07T16:21:34.544 INFO:tasks.workunit.client.1.smithi152.stdout:4/333: dwrite d0/d3/d6/dc/d3a/d46/d4e/f57 [0,4194304] 0 2023-12-07T16:21:34.545 INFO:tasks.workunit.client.1.smithi152.stdout:6/376: dwrite d2/f5 [0,4194304] 0 2023-12-07T16:21:34.545 INFO:tasks.workunit.client.1.smithi152.stdout:5/438: dwrite dd/d7b/f7d [0,4194304] 0 2023-12-07T16:21:34.545 INFO:tasks.workunit.client.1.smithi152.stdout:2/381: rename d2/d1c/d2e/d57/d5b/c71 to d2/d1c/d2e/d30/d53/d8a/c8c 0 2023-12-07T16:21:34.545 INFO:tasks.workunit.client.1.smithi152.stdout:1/442: creat dc/d14/d18/d79/f8d x:0 0 0 2023-12-07T16:21:34.545 INFO:tasks.workunit.client.1.smithi152.stdout:9/488: dwrite d1/d17/d3c/d4a/d7e/f9f [0,4194304] 0 2023-12-07T16:21:34.548 INFO:tasks.workunit.client.0.smithi063.stdout:0/155: write d4/f16 [1718214,70852] 0 2023-12-07T16:21:34.548 INFO:tasks.workunit.client.1.smithi152.stdout:4/334: mkdir d0/d3/d6/d2b/d56/d61 0 2023-12-07T16:21:34.548 INFO:tasks.workunit.client.1.smithi152.stdout:6/377: creat d2/d6/f74 x:0 0 0 2023-12-07T16:21:34.550 INFO:tasks.workunit.client.0.smithi063.stdout:8/226: creat d7/f4a x:0 0 0 2023-12-07T16:21:34.550 INFO:tasks.workunit.client.1.smithi152.stdout:1/443: dread dc/f2a [0,4194304] 0 2023-12-07T16:21:34.551 INFO:tasks.workunit.client.0.smithi063.stdout:8/227: write d7/d14/d15/f2d [188348,105033] 0 2023-12-07T16:21:34.551 INFO:tasks.workunit.client.0.smithi063.stdout:8/228: read - d7/f4a zero size 2023-12-07T16:21:34.551 INFO:tasks.workunit.client.0.smithi063.stdout:3/73: dwrite f6 [4194304,4194304] 0 2023-12-07T16:21:34.553 INFO:tasks.workunit.client.0.smithi063.stdout:2/86: dwrite d0/fa [4194304,4194304] 0 2023-12-07T16:21:34.553 INFO:tasks.workunit.client.0.smithi063.stdout:7/69: dwrite d2/f1e [0,4194304] 0 2023-12-07T16:21:34.554 INFO:tasks.workunit.client.0.smithi063.stdout:3/74: link l4 d7/d9/l11 0 2023-12-07T16:21:34.555 INFO:tasks.workunit.client.0.smithi063.stdout:0/156: truncate d4/d25/f2f 222548 0 2023-12-07T16:21:34.557 INFO:tasks.workunit.client.1.smithi152.stdout:8/366: rename d3/d4/d4b/d7f to d3/d4/d9/dc/d1f/d66/d82 0 2023-12-07T16:21:34.557 INFO:tasks.workunit.client.1.smithi152.stdout:2/382: mknod d2/d1c/d2e/d38/c8d 0 2023-12-07T16:21:34.558 INFO:tasks.workunit.client.1.smithi152.stdout:0/436: dwrite d0/d27/ff [0,4194304] 0 2023-12-07T16:21:34.564 INFO:tasks.workunit.client.0.smithi063.stdout:8/229: dread f5 [0,4194304] 0 2023-12-07T16:21:34.568 INFO:tasks.workunit.client.1.smithi152.stdout:2/383: dread d2/d47/f2a [0,4194304] 0 2023-12-07T16:21:34.571 INFO:tasks.workunit.client.1.smithi152.stdout:4/335: mknod d0/d3/c62 0 2023-12-07T16:21:34.571 INFO:tasks.workunit.client.1.smithi152.stdout:4/336: chown d0/l49 2370037 1 2023-12-07T16:21:34.571 INFO:tasks.workunit.client.1.smithi152.stdout:4/337: write d0/d3/d6/dc/d22/f60 [1040105,91322] 0 2023-12-07T16:21:34.571 INFO:tasks.workunit.client.1.smithi152.stdout:6/378: symlink d2/d6/d19/d1f/d49/l75 0 2023-12-07T16:21:34.571 INFO:tasks.workunit.client.1.smithi152.stdout:1/444: creat dc/d14/d18/d79/d86/f8e x:0 0 0 2023-12-07T16:21:34.574 INFO:tasks.workunit.client.1.smithi152.stdout:8/367: mkdir d3/d1e/d55/d83 0 2023-12-07T16:21:34.576 INFO:tasks.workunit.client.1.smithi152.stdout:0/437: symlink d0/dc/d36/d3a/d51/l94 0 2023-12-07T16:21:34.577 INFO:tasks.workunit.client.1.smithi152.stdout:0/438: readlink d0/dc/d36/d3a/d51/l94 0 2023-12-07T16:21:34.577 INFO:tasks.workunit.client.1.smithi152.stdout:0/439: read d0/d27/f1f [236968,34580] 0 2023-12-07T16:21:34.578 INFO:tasks.workunit.client.1.smithi152.stdout:6/379: truncate d2/d6/d9/f28 5439475 0 2023-12-07T16:21:34.578 INFO:tasks.workunit.client.1.smithi152.stdout:6/380: write d2/d6/d9/d14/d48/f54 [384149,97076] 0 2023-12-07T16:21:34.579 INFO:tasks.workunit.client.1.smithi152.stdout:1/445: creat dc/d14/d18/d64/f8f x:0 0 0 2023-12-07T16:21:34.580 INFO:tasks.workunit.client.1.smithi152.stdout:8/368: mknod d3/d4/c84 0 2023-12-07T16:21:34.581 INFO:tasks.workunit.client.1.smithi152.stdout:0/440: symlink d0/dc/l95 0 2023-12-07T16:21:34.581 INFO:tasks.workunit.client.1.smithi152.stdout:0/441: truncate d0/dc/f79 629422 0 2023-12-07T16:21:34.581 INFO:tasks.workunit.client.1.smithi152.stdout:0/442: stat d0/l3e 0 2023-12-07T16:21:34.581 INFO:tasks.workunit.client.1.smithi152.stdout:0/443: chown d0/dc/d36/d3a/d51/l6b 80406305 1 2023-12-07T16:21:34.583 INFO:tasks.workunit.client.1.smithi152.stdout:7/348: dwrite db/d27/d39/d41/f60 [4194304,4194304] 0 2023-12-07T16:21:34.583 INFO:tasks.workunit.client.1.smithi152.stdout:1/446: mkdir dc/d14/d90 0 2023-12-07T16:21:34.585 INFO:tasks.workunit.client.1.smithi152.stdout:6/381: symlink d2/d6/d19/l76 0 2023-12-07T16:21:34.585 INFO:tasks.workunit.client.1.smithi152.stdout:7/349: stat db/l2b 0 2023-12-07T16:21:34.585 INFO:tasks.workunit.client.1.smithi152.stdout:7/350: write db/d1c/f51 [182669,58660] 0 2023-12-07T16:21:34.586 INFO:tasks.workunit.client.1.smithi152.stdout:1/447: mkdir dc/d14/d18/d2d/d91 0 2023-12-07T16:21:34.587 INFO:tasks.workunit.client.1.smithi152.stdout:0/444: dread d0/d2f/f35 [0,4194304] 0 2023-12-07T16:21:34.587 INFO:tasks.workunit.client.1.smithi152.stdout:5/439: dwrite dd/de/d38/d3d/d6d/f90 [0,4194304] 0 2023-12-07T16:21:34.587 INFO:tasks.workunit.client.1.smithi152.stdout:5/440: fdatasync dd/de/d14/d67/f78 0 2023-12-07T16:21:34.587 INFO:tasks.workunit.client.1.smithi152.stdout:0/445: write d0/d27/f6d [988558,70459] 0 2023-12-07T16:21:34.587 INFO:tasks.workunit.client.1.smithi152.stdout:7/351: truncate db/d27/d39/f2f 2931993 0 2023-12-07T16:21:34.588 INFO:tasks.workunit.client.1.smithi152.stdout:1/448: creat dc/de/f92 x:0 0 0 2023-12-07T16:21:34.588 INFO:tasks.workunit.client.1.smithi152.stdout:1/449: write dc/d14/f84 [339694,44750] 0 2023-12-07T16:21:34.590 INFO:tasks.workunit.client.1.smithi152.stdout:0/446: write d0/d2f/f35 [176556,114398] 0 2023-12-07T16:21:34.592 INFO:tasks.workunit.client.1.smithi152.stdout:5/441: truncate dd/de/d17/d54/d7c/f87 464042 0 2023-12-07T16:21:34.594 INFO:tasks.workunit.client.1.smithi152.stdout:0/447: creat d0/d2f/d30/d6e/d77/f96 x:0 0 0 2023-12-07T16:21:34.594 INFO:tasks.workunit.client.1.smithi152.stdout:0/448: readlink d0/d27/d11/l2d 0 2023-12-07T16:21:34.597 INFO:tasks.workunit.client.1.smithi152.stdout:8/369: dread d3/d4/d9/d23/f2c [0,4194304] 0 2023-12-07T16:21:34.597 INFO:tasks.workunit.client.1.smithi152.stdout:0/449: mknod d0/d27/d8c/c97 0 2023-12-07T16:21:34.599 INFO:tasks.workunit.client.1.smithi152.stdout:8/370: mkdir d3/d4/d9/dc/d6f/d7b/d7e/d85 0 2023-12-07T16:21:34.599 INFO:tasks.workunit.client.1.smithi152.stdout:2/384: dwrite d2/d1c/f69 [0,4194304] 0 2023-12-07T16:21:34.600 INFO:tasks.workunit.client.0.smithi063.stdout:7/70: dwrite d2/de/f15 [0,4194304] 0 2023-12-07T16:21:34.600 INFO:tasks.workunit.client.0.smithi063.stdout:7/71: dread - d2/f1a zero size 2023-12-07T16:21:34.600 INFO:tasks.workunit.client.0.smithi063.stdout:7/72: chown d2/de/f18 121 1 2023-12-07T16:21:34.600 INFO:tasks.workunit.client.0.smithi063.stdout:7/73: chown d2/lc 46144 1 2023-12-07T16:21:34.600 INFO:tasks.workunit.client.0.smithi063.stdout:2/87: creat d0/df/d11/f1a x:0 0 0 2023-12-07T16:21:34.600 INFO:tasks.workunit.client.0.smithi063.stdout:2/88: readlink d0/lc 0 2023-12-07T16:21:34.600 INFO:tasks.workunit.client.1.smithi152.stdout:5/442: write dd/de/d17/f5b [3997379,28389] 0 2023-12-07T16:21:34.601 INFO:tasks.workunit.client.1.smithi152.stdout:0/450: creat d0/dc/d3d/d73/f98 x:0 0 0 2023-12-07T16:21:34.603 INFO:tasks.workunit.client.1.smithi152.stdout:2/385: write d2/d47/f4b [3166197,126359] 0 2023-12-07T16:21:34.603 INFO:tasks.workunit.client.0.smithi063.stdout:9/108: rmdir d0/d7 39 2023-12-07T16:21:34.603 INFO:tasks.workunit.client.0.smithi063.stdout:9/109: write d0/d7/f1e [4427418,37789] 0 2023-12-07T16:21:34.603 INFO:tasks.workunit.client.0.smithi063.stdout:2/89: write d0/f14 [1369040,23503] 0 2023-12-07T16:21:34.606 INFO:tasks.workunit.client.1.smithi152.stdout:8/371: truncate d3/d4/f5c 453497 0 2023-12-07T16:21:34.607 INFO:tasks.workunit.client.0.smithi063.stdout:3/75: creat d7/d9/f12 x:0 0 0 2023-12-07T16:21:34.607 INFO:tasks.workunit.client.0.smithi063.stdout:3/76: chown d7/l8 57555 1 2023-12-07T16:21:34.607 INFO:tasks.workunit.client.0.smithi063.stdout:3/77: fdatasync d7/fa 0 2023-12-07T16:21:34.608 INFO:tasks.workunit.client.0.smithi063.stdout:3/78: truncate d7/d9/f12 96051 0 2023-12-07T16:21:34.611 INFO:tasks.workunit.client.1.smithi152.stdout:5/443: symlink dd/de/d17/d54/d7c/l96 0 2023-12-07T16:21:34.611 INFO:tasks.workunit.client.1.smithi152.stdout:8/372: creat d3/d1e/d40/d74/f86 x:0 0 0 2023-12-07T16:21:34.611 INFO:tasks.workunit.client.1.smithi152.stdout:8/373: truncate d3/d4/d9/dc/f20 67231 0 2023-12-07T16:21:34.611 INFO:tasks.workunit.client.0.smithi063.stdout:0/157: unlink d4/d2a/c2c 0 2023-12-07T16:21:34.611 INFO:tasks.workunit.client.0.smithi063.stdout:0/158: write d4/dd/de/f20 [4996683,112178] 0 2023-12-07T16:21:34.612 INFO:tasks.workunit.client.1.smithi152.stdout:6/382: dwrite d2/d6/f4d [0,4194304] 0 2023-12-07T16:21:34.612 INFO:tasks.workunit.client.1.smithi152.stdout:6/383: chown d2/d6/de/d45 3 1 2023-12-07T16:21:34.612 INFO:tasks.workunit.client.1.smithi152.stdout:6/384: truncate d2/d6/f63 894624 0 2023-12-07T16:21:34.613 INFO:tasks.workunit.client.0.smithi063.stdout:6/173: getdents d0/d1e/d1d 0 2023-12-07T16:21:34.613 INFO:tasks.workunit.client.1.smithi152.stdout:5/444: rmdir dd/de/d14/d19/d1a/d1b 39 2023-12-07T16:21:34.614 INFO:tasks.workunit.client.0.smithi063.stdout:2/90: dread d0/f14 [0,4194304] 0 2023-12-07T16:21:34.616 INFO:tasks.workunit.client.0.smithi063.stdout:9/110: mknod d0/d7/c24 0 2023-12-07T16:21:34.616 INFO:tasks.workunit.client.1.smithi152.stdout:8/374: creat d3/d4/d9/dc/d1f/d63/d67/d7d/f87 x:0 0 0 2023-12-07T16:21:34.617 INFO:tasks.workunit.client.1.smithi152.stdout:7/352: dwrite db/d27/d5e/d45/f50 [0,4194304] 0 2023-12-07T16:21:34.619 INFO:tasks.workunit.client.0.smithi063.stdout:0/159: truncate d4/dd/de/d15/d1f/d22/f23 5114060 0 2023-12-07T16:21:34.620 INFO:tasks.workunit.client.0.smithi063.stdout:6/174: mknod d0/d1e/d2a/c3f 0 2023-12-07T16:21:34.622 INFO:tasks.workunit.client.1.smithi152.stdout:8/375: symlink d3/l88 0 2023-12-07T16:21:34.623 INFO:tasks.workunit.client.0.smithi063.stdout:3/79: dread f5 [4194304,4194304] 0 2023-12-07T16:21:34.623 INFO:tasks.workunit.client.1.smithi152.stdout:6/385: symlink d2/d6/d19/l77 0 2023-12-07T16:21:34.623 INFO:tasks.workunit.client.1.smithi152.stdout:3/408: sync 2023-12-07T16:21:34.623 INFO:tasks.workunit.client.1.smithi152.stdout:3/409: dread - d7/d10/d41/f6e zero size 2023-12-07T16:21:34.627 INFO:tasks.workunit.client.1.smithi152.stdout:8/376: truncate d3/f1a 7037413 0 2023-12-07T16:21:34.628 INFO:tasks.workunit.client.1.smithi152.stdout:6/386: mknod d2/d6/d9/d14/d58/c78 0 2023-12-07T16:21:34.628 INFO:tasks.workunit.client.0.smithi063.stdout:7/74: mkdir d2/d21 0 2023-12-07T16:21:34.628 INFO:tasks.workunit.client.0.smithi063.stdout:2/91: rename d0/f7 to d0/df/d11/f1b 0 2023-12-07T16:21:34.628 INFO:tasks.workunit.client.0.smithi063.stdout:9/111: creat d0/d13/f25 x:0 0 0 2023-12-07T16:21:34.629 INFO:tasks.workunit.client.1.smithi152.stdout:6/387: symlink d2/d6/d19/d1f/l79 0 2023-12-07T16:21:34.629 INFO:tasks.workunit.client.0.smithi063.stdout:0/160: creat d4/d2a/f34 x:0 0 0 2023-12-07T16:21:34.631 INFO:tasks.workunit.client.0.smithi063.stdout:3/80: creat d7/d9/dd/f13 x:0 0 0 2023-12-07T16:21:34.637 INFO:tasks.workunit.client.0.smithi063.stdout:2/92: rename d0/fb to d0/df/f1c 0 2023-12-07T16:21:34.639 INFO:tasks.workunit.client.1.smithi152.stdout:0/451: dwrite d0/dc/d36/d3a/f4f [0,4194304] 0 2023-12-07T16:21:34.639 INFO:tasks.workunit.client.0.smithi063.stdout:9/112: rmdir d0/d21 39 2023-12-07T16:21:34.639 INFO:tasks.workunit.client.0.smithi063.stdout:9/113: chown d0/d7/fe 1 1 2023-12-07T16:21:34.639 INFO:tasks.workunit.client.0.smithi063.stdout:1/76: sync 2023-12-07T16:21:34.641 INFO:tasks.workunit.client.1.smithi152.stdout:8/377: dread d3/d1e/d55/f64 [0,4194304] 0 2023-12-07T16:21:34.641 INFO:tasks.workunit.client.1.smithi152.stdout:8/378: readlink d3/d4/d9/dc/d1f/l3c 0 2023-12-07T16:21:34.641 INFO:tasks.workunit.client.0.smithi063.stdout:0/161: symlink d4/dd/de/d15/l35 0 2023-12-07T16:21:34.641 INFO:tasks.workunit.client.1.smithi152.stdout:5/445: getdents dd/de/d17/d54/d7c 0 2023-12-07T16:21:34.642 INFO:tasks.workunit.client.0.smithi063.stdout:5/96: sync 2023-12-07T16:21:34.643 INFO:tasks.workunit.client.1.smithi152.stdout:6/388: dread d2/d6/d19/d1f/f47 [0,4194304] 0 2023-12-07T16:21:34.643 INFO:tasks.workunit.client.1.smithi152.stdout:2/386: dwrite d2/d1c/d2e/d57/f6e [0,4194304] 0 2023-12-07T16:21:34.643 INFO:tasks.workunit.client.1.smithi152.stdout:0/452: creat d0/dc/d36/d3a/d69/f99 x:0 0 0 2023-12-07T16:21:34.643 INFO:tasks.workunit.client.1.smithi152.stdout:0/453: readlink d0/dc/d3d/d4c/l4e 0 2023-12-07T16:21:34.643 INFO:tasks.workunit.client.1.smithi152.stdout:0/454: dread - d0/d2f/d30/d6e/d77/f96 zero size 2023-12-07T16:21:34.644 INFO:tasks.workunit.client.0.smithi063.stdout:2/93: symlink d0/l1d 0 2023-12-07T16:21:34.645 INFO:tasks.workunit.client.1.smithi152.stdout:8/379: getdents d3/d4/d9/dc/d1f 0 2023-12-07T16:21:34.645 INFO:tasks.workunit.client.0.smithi063.stdout:9/114: mknod d0/d21/c26 0 2023-12-07T16:21:34.645 INFO:tasks.workunit.client.0.smithi063.stdout:9/115: write d0/f1a [1003371,63659] 0 2023-12-07T16:21:34.646 INFO:tasks.workunit.client.0.smithi063.stdout:1/77: creat d0/dd/f16 x:0 0 0 2023-12-07T16:21:34.647 INFO:tasks.workunit.client.1.smithi152.stdout:5/446: unlink dd/de/d14/d19/f89 0 2023-12-07T16:21:34.647 INFO:tasks.workunit.client.1.smithi152.stdout:5/447: write dd/de/d38/f79 [549954,116644] 0 2023-12-07T16:21:34.647 INFO:tasks.workunit.client.1.smithi152.stdout:5/448: write dd/de/d14/d19/d1a/d1b/f8b [572672,13489] 0 2023-12-07T16:21:34.647 INFO:tasks.workunit.client.1.smithi152.stdout:5/449: chown dd/de/d14/d19/f8c 1557 1 2023-12-07T16:21:34.648 INFO:tasks.workunit.client.0.smithi063.stdout:6/175: dwrite d0/d17/d1a/f1c [0,4194304] 0 2023-12-07T16:21:34.648 INFO:tasks.workunit.client.0.smithi063.stdout:2/94: mkdir d0/d1e 0 2023-12-07T16:21:34.649 INFO:tasks.workunit.client.0.smithi063.stdout:9/116: symlink d0/l27 0 2023-12-07T16:21:34.651 INFO:tasks.workunit.client.1.smithi152.stdout:6/389: link d2/d6/de/c39 d2/d6/d19/d1f/d49/c7a 0 2023-12-07T16:21:34.653 INFO:tasks.workunit.client.1.smithi152.stdout:2/387: rename d2/d47/f77 to d2/d1c/d2e/d30/d53/f8e 0 2023-12-07T16:21:34.654 INFO:tasks.workunit.client.0.smithi063.stdout:6/176: dread d0/d1e/d1d/d1f/f21 [0,4194304] 0 2023-12-07T16:21:34.654 INFO:tasks.workunit.client.0.smithi063.stdout:6/177: readlink d0/l9 0 2023-12-07T16:21:34.654 INFO:tasks.workunit.client.0.smithi063.stdout:7/75: rmdir d2 39 2023-12-07T16:21:34.655 INFO:tasks.workunit.client.1.smithi152.stdout:0/455: unlink d0/cb 0 2023-12-07T16:21:34.656 INFO:tasks.workunit.client.0.smithi063.stdout:2/95: link d0/fa d0/f1f 0 2023-12-07T16:21:34.656 INFO:tasks.workunit.client.1.smithi152.stdout:2/388: dread d2/d1c/d2e/d30/d33/f3d [0,4194304] 0 2023-12-07T16:21:34.656 INFO:tasks.workunit.client.1.smithi152.stdout:8/380: creat d3/d4/d9/dc/d6f/d7a/f89 x:0 0 0 2023-12-07T16:21:34.657 INFO:tasks.workunit.client.1.smithi152.stdout:5/450: mknod dd/de/d14/d67/c97 0 2023-12-07T16:21:34.658 INFO:tasks.workunit.client.0.smithi063.stdout:3/81: rmdir d7/d9/dd 39 2023-12-07T16:21:34.658 INFO:tasks.workunit.client.1.smithi152.stdout:0/456: symlink d0/d27/d8c/l9a 0 2023-12-07T16:21:34.659 INFO:tasks.workunit.client.1.smithi152.stdout:2/389: chown d2/l12 65 1 2023-12-07T16:21:34.659 INFO:tasks.workunit.client.0.smithi063.stdout:6/178: creat d0/d1e/d1d/f40 x:0 0 0 2023-12-07T16:21:34.659 INFO:tasks.workunit.client.0.smithi063.stdout:2/96: rename d0/df/f1c to d0/df/f20 0 2023-12-07T16:21:34.662 INFO:tasks.workunit.client.1.smithi152.stdout:8/381: rename d3/d4/d9/dc/d1f to d3/d4/d9/dc/d6f/d7a/d8a 0 2023-12-07T16:21:34.663 INFO:tasks.workunit.client.1.smithi152.stdout:5/451: link dd/l50 dd/de/d38/d3d/l98 0 2023-12-07T16:21:34.663 INFO:tasks.workunit.client.0.smithi063.stdout:3/82: mknod d7/c14 0 2023-12-07T16:21:34.663 INFO:tasks.workunit.client.0.smithi063.stdout:6/179: mknod d0/d17/c41 0 2023-12-07T16:21:34.664 INFO:tasks.workunit.client.0.smithi063.stdout:2/97: mkdir d0/d21 0 2023-12-07T16:21:34.664 INFO:tasks.workunit.client.1.smithi152.stdout:8/382: symlink d3/d4/d9/dc/d6f/l8b 0 2023-12-07T16:21:34.665 INFO:tasks.workunit.client.1.smithi152.stdout:0/457: write d0/dc/d36/d7d/f8a [1971116,84103] 0 2023-12-07T16:21:34.665 INFO:tasks.workunit.client.1.smithi152.stdout:5/452: mknod dd/de/d38/c99 0 2023-12-07T16:21:34.665 INFO:tasks.workunit.client.1.smithi152.stdout:5/453: write dd/de/d14/d19/d1a/f55 [958506,115930] 0 2023-12-07T16:21:34.666 INFO:tasks.workunit.client.1.smithi152.stdout:6/390: dread d2/d6/d9/f35 [0,4194304] 0 2023-12-07T16:21:34.666 INFO:tasks.workunit.client.0.smithi063.stdout:1/78: fsync d0/dd/f16 0 2023-12-07T16:21:34.666 INFO:tasks.workunit.client.0.smithi063.stdout:0/162: write d4/f17 [5415639,53902] 0 2023-12-07T16:21:34.666 INFO:tasks.workunit.client.0.smithi063.stdout:0/163: readlink d4/dd/de/d15/d1f/d22/l32 0 2023-12-07T16:21:34.668 INFO:tasks.workunit.client.1.smithi152.stdout:0/458: creat d0/d27/f9b x:0 0 0 2023-12-07T16:21:34.668 INFO:tasks.workunit.client.1.smithi152.stdout:0/459: stat d0/l1e 0 2023-12-07T16:21:34.668 INFO:tasks.workunit.client.1.smithi152.stdout:5/454: mknod dd/de/d8f/c9a 0 2023-12-07T16:21:34.668 INFO:tasks.workunit.client.1.smithi152.stdout:5/455: truncate dd/de/d14/d19/d1a/d1b/f8d 184076 0 2023-12-07T16:21:34.668 INFO:tasks.workunit.client.1.smithi152.stdout:5/456: chown dd/de/d14/c4f 5976910 1 2023-12-07T16:21:34.669 INFO:tasks.workunit.client.0.smithi063.stdout:1/79: truncate d0/f1 696144 0 2023-12-07T16:21:34.669 INFO:tasks.workunit.client.0.smithi063.stdout:1/80: chown d0/dd/d10/d13/lf 85 1 2023-12-07T16:21:34.669 INFO:tasks.workunit.client.1.smithi152.stdout:5/457: mknod dd/de/d14/d1f/d28/c9b 0 2023-12-07T16:21:34.670 INFO:tasks.workunit.client.1.smithi152.stdout:5/458: chown dd 32593 1 2023-12-07T16:21:34.670 INFO:tasks.workunit.client.1.smithi152.stdout:5/459: readlink dd/de/d17/d54/d7c/l96 0 2023-12-07T16:21:34.680 INFO:tasks.workunit.client.0.smithi063.stdout:7/76: dwrite d2/f8 [0,4194304] 0 2023-12-07T16:21:34.680 INFO:tasks.workunit.client.1.smithi152.stdout:0/460: write d0/dc/f3c [1451278,31396] 0 2023-12-07T16:21:34.682 INFO:tasks.workunit.client.0.smithi063.stdout:7/77: symlink d2/l22 0 2023-12-07T16:21:34.683 INFO:tasks.workunit.client.1.smithi152.stdout:0/461: creat d0/dc/d36/f9c x:0 0 0 2023-12-07T16:21:34.685 INFO:tasks.workunit.client.1.smithi152.stdout:0/462: truncate d0/f9 259757 0 2023-12-07T16:21:34.687 INFO:tasks.workunit.client.1.smithi152.stdout:0/463: rename d0/dc/f12 to d0/d27/d11/d68/f9d 0 2023-12-07T16:21:34.688 INFO:tasks.workunit.client.1.smithi152.stdout:0/464: symlink d0/dc/d36/d3a/d51/d82/l9e 0 2023-12-07T16:21:34.688 INFO:tasks.workunit.client.1.smithi152.stdout:0/465: readlink d0/d27/d11/l2d 0 2023-12-07T16:21:34.690 INFO:tasks.workunit.client.1.smithi152.stdout:0/466: unlink d0/dc/d26/c5f 0 2023-12-07T16:21:34.691 INFO:tasks.workunit.client.1.smithi152.stdout:0/467: mkdir d0/d2f/d30/d6e/d77/d9f 0 2023-12-07T16:21:34.691 INFO:tasks.workunit.client.1.smithi152.stdout:0/468: stat d0/d2f/d30/f5a 0 2023-12-07T16:21:34.711 INFO:tasks.workunit.client.0.smithi063.stdout:3/83: dwrite d7/d9/dd/f13 [0,4194304] 0 2023-12-07T16:21:34.712 INFO:tasks.workunit.client.0.smithi063.stdout:2/98: dwrite d0/f10 [0,4194304] 0 2023-12-07T16:21:34.712 INFO:tasks.workunit.client.0.smithi063.stdout:6/180: dwrite d0/d1e/f24 [0,4194304] 0 2023-12-07T16:21:34.712 INFO:tasks.workunit.client.1.smithi152.stdout:2/390: dwrite d2/d47/f4b [0,4194304] 0 2023-12-07T16:21:34.712 INFO:tasks.workunit.client.1.smithi152.stdout:2/391: write d2/d9/f2f [1231755,117378] 0 2023-12-07T16:21:34.713 INFO:tasks.workunit.client.1.smithi152.stdout:2/392: getdents d2/d1c/d2e/d30/d53/d8a 0 2023-12-07T16:21:34.713 INFO:tasks.workunit.client.0.smithi063.stdout:7/78: dwrite d2/de/f1d [0,4194304] 0 2023-12-07T16:21:34.715 INFO:tasks.workunit.client.1.smithi152.stdout:2/393: symlink d2/l8f 0 2023-12-07T16:21:34.716 INFO:tasks.workunit.client.0.smithi063.stdout:3/84: mknod d7/d9/dd/c15 0 2023-12-07T16:21:34.717 INFO:tasks.workunit.client.0.smithi063.stdout:3/85: fsync d7/fc 0 2023-12-07T16:21:34.717 INFO:tasks.workunit.client.0.smithi063.stdout:2/99: symlink d0/df/d11/l22 0 2023-12-07T16:21:34.717 INFO:tasks.workunit.client.0.smithi063.stdout:2/100: read d0/f14 [648649,123640] 0 2023-12-07T16:21:34.718 INFO:tasks.workunit.client.1.smithi152.stdout:7/353: dwrite db/d27/f3d [0,4194304] 0 2023-12-07T16:21:34.721 INFO:tasks.workunit.client.1.smithi152.stdout:7/354: creat db/d27/d39/d41/d37/f64 x:0 0 0 2023-12-07T16:21:34.721 INFO:tasks.workunit.client.1.smithi152.stdout:7/355: fsync db/d27/d5e/f54 0 2023-12-07T16:21:34.722 INFO:tasks.workunit.client.0.smithi063.stdout:6/181: symlink d0/d17/d1a/l42 0 2023-12-07T16:21:34.722 INFO:tasks.workunit.client.0.smithi063.stdout:5/97: dread d1/f13 [0,4194304] 0 2023-12-07T16:21:34.722 INFO:tasks.workunit.client.0.smithi063.stdout:5/98: fsync d1/d3/de/f19 0 2023-12-07T16:21:34.722 INFO:tasks.workunit.client.0.smithi063.stdout:5/99: truncate d1/d3/de/f16 586165 0 2023-12-07T16:21:34.722 INFO:tasks.workunit.client.0.smithi063.stdout:5/100: readlink d1/d3/lb 0 2023-12-07T16:21:34.725 INFO:tasks.workunit.client.0.smithi063.stdout:7/79: stat d2/lc 0 2023-12-07T16:21:34.728 INFO:tasks.workunit.client.1.smithi152.stdout:8/383: dread d3/d4/d9/f38 [0,4194304] 0 2023-12-07T16:21:34.728 INFO:tasks.workunit.client.0.smithi063.stdout:3/86: unlink d7/d9/lb 0 2023-12-07T16:21:34.728 INFO:tasks.workunit.client.0.smithi063.stdout:3/87: truncate d7/ff 831305 0 2023-12-07T16:21:34.729 INFO:tasks.workunit.client.1.smithi152.stdout:0/469: dread d0/d27/f1f [0,4194304] 0 2023-12-07T16:21:34.729 INFO:tasks.workunit.client.0.smithi063.stdout:5/101: dread d1/fd [0,4194304] 0 2023-12-07T16:21:34.731 INFO:tasks.workunit.client.0.smithi063.stdout:7/80: creat d2/f23 x:0 0 0 2023-12-07T16:21:34.731 INFO:tasks.workunit.client.0.smithi063.stdout:3/88: truncate d7/fe 727617 0 2023-12-07T16:21:34.733 INFO:tasks.workunit.client.1.smithi152.stdout:0/470: creat d0/d2f/d30/d6e/d77/d9f/fa0 x:0 0 0 2023-12-07T16:21:34.733 INFO:tasks.workunit.client.1.smithi152.stdout:8/384: creat d3/d4/d9/dc/d6f/d7b/d7e/d85/f8c x:0 0 0 2023-12-07T16:21:34.734 INFO:tasks.workunit.client.0.smithi063.stdout:5/102: unlink d1/fd 0 2023-12-07T16:21:34.736 INFO:tasks.workunit.client.0.smithi063.stdout:7/81: write d2/f1a [667004,88834] 0 2023-12-07T16:21:34.737 INFO:tasks.workunit.client.0.smithi063.stdout:2/101: dread d0/df/d11/f1b [4194304,4194304] 0 2023-12-07T16:21:34.739 INFO:tasks.workunit.client.0.smithi063.stdout:3/89: symlink d7/d9/dd/l16 0 2023-12-07T16:21:34.740 INFO:tasks.workunit.client.0.smithi063.stdout:5/103: rename d1/d3/c12 to d1/d3/c20 0 2023-12-07T16:21:34.741 INFO:tasks.workunit.client.1.smithi152.stdout:5/460: getdents dd/de/d14/d19 0 2023-12-07T16:21:34.741 INFO:tasks.workunit.client.1.smithi152.stdout:5/461: write dd/f1e [4401006,84181] 0 2023-12-07T16:21:34.741 INFO:tasks.workunit.client.0.smithi063.stdout:7/82: dread - d2/f5 zero size 2023-12-07T16:21:34.742 INFO:tasks.workunit.client.1.smithi152.stdout:5/462: mknod dd/de/d14/d19/d1a/d1b/c9c 0 2023-12-07T16:21:34.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:34 smithi152 ceph-mon[121113]: Reconfiguring node-exporter.smithi152 (dependencies changed)... 2023-12-07T16:21:34.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:34 smithi152 ceph-mon[121113]: Reconfiguring daemon node-exporter.smithi152 on smithi152 2023-12-07T16:21:34.745 INFO:tasks.workunit.client.1.smithi152.stdout:2/394: rename d2/d47 to d2/d1c/d2e/d38/d90 0 2023-12-07T16:21:34.745 INFO:tasks.workunit.client.0.smithi063.stdout:7/83: read d2/f1e [4118012,59308] 0 2023-12-07T16:21:34.747 INFO:tasks.workunit.client.0.smithi063.stdout:3/90: dread d7/ff [0,4194304] 0 2023-12-07T16:21:34.749 INFO:tasks.workunit.client.1.smithi152.stdout:5/463: dread dd/de/d14/d19/f95 [0,4194304] 0 2023-12-07T16:21:34.750 INFO:tasks.workunit.client.1.smithi152.stdout:5/464: readlink dd/de/d14/l53 0 2023-12-07T16:21:34.750 INFO:tasks.workunit.client.1.smithi152.stdout:5/465: chown dd/de/d14/d1f/d28/c3b 0 1 2023-12-07T16:21:34.750 INFO:tasks.workunit.client.1.smithi152.stdout:5/466: fsync dd/de/d38/f43 0 2023-12-07T16:21:34.758 INFO:tasks.workunit.client.0.smithi063.stdout:3/91: write f5 [6890816,126973] 0 2023-12-07T16:21:34.764 INFO:tasks.workunit.client.1.smithi152.stdout:2/395: dread d2/d1c/d52/f81 [0,4194304] 0 2023-12-07T16:21:34.764 INFO:tasks.workunit.client.1.smithi152.stdout:2/396: read d2/d1c/d2e/d30/d53/f55 [24240,88648] 0 2023-12-07T16:21:34.766 INFO:tasks.workunit.client.1.smithi152.stdout:2/397: mkdir d2/d1c/d2e/d30/d42/d91 0 2023-12-07T16:21:34.767 INFO:tasks.workunit.client.1.smithi152.stdout:5/467: dread dd/de/d14/d1f/f2e [0,4194304] 0 2023-12-07T16:21:34.769 INFO:tasks.workunit.client.1.smithi152.stdout:2/398: rename d2/d1c/d52/f81 to d2/d1c/d2e/d30/d42/f92 0 2023-12-07T16:21:34.772 INFO:tasks.workunit.client.1.smithi152.stdout:5/468: rename dd/de/d17/d54/d7c/l96 to dd/de/d14/d19/d1a/l9d 0 2023-12-07T16:21:34.772 INFO:tasks.workunit.client.1.smithi152.stdout:5/469: chown dd/l59 53524 1 2023-12-07T16:21:34.772 INFO:tasks.workunit.client.1.smithi152.stdout:5/470: truncate dd/de/d14/d19/d1a/d1b/f8d 687699 0 2023-12-07T16:21:34.774 INFO:tasks.workunit.client.0.smithi063.stdout:9/117: dwrite d0/f3 [0,4194304] 0 2023-12-07T16:21:34.774 INFO:tasks.workunit.client.0.smithi063.stdout:9/118: fdatasync d0/d7/f16 0 2023-12-07T16:21:34.775 INFO:tasks.workunit.client.0.smithi063.stdout:9/119: mknod d0/d13/c28 0 2023-12-07T16:21:34.775 INFO:tasks.workunit.client.0.smithi063.stdout:9/120: chown d0/d7/c10 33298133 1 2023-12-07T16:21:34.775 INFO:tasks.workunit.client.0.smithi063.stdout:9/121: chown d0/c6 1 1 2023-12-07T16:21:34.775 INFO:tasks.workunit.client.0.smithi063.stdout:9/122: mknod d0/d21/c29 0 2023-12-07T16:21:34.777 INFO:tasks.workunit.client.0.smithi063.stdout:6/182: dwrite d0/d1e/d1d/d1f/f21 [0,4194304] 0 2023-12-07T16:21:34.777 INFO:tasks.workunit.client.0.smithi063.stdout:9/123: write d0/d7/fe [4670259,1553] 0 2023-12-07T16:21:34.782 INFO:tasks.workunit.client.1.smithi152.stdout:7/356: dwrite db/d27/d5e/f48 [0,4194304] 0 2023-12-07T16:21:34.783 INFO:tasks.workunit.client.0.smithi063.stdout:1/81: dwrite d0/f1 [0,4194304] 0 2023-12-07T16:21:34.783 INFO:tasks.workunit.client.0.smithi063.stdout:1/82: fdatasync d0/dd/d10/d13/fc 0 2023-12-07T16:21:34.783 INFO:tasks.workunit.client.0.smithi063.stdout:9/124: rename d0/f2 to d0/d7/f2a 0 2023-12-07T16:21:34.783 INFO:tasks.workunit.client.0.smithi063.stdout:2/102: dwrite d0/f14 [0,4194304] 0 2023-12-07T16:21:34.783 INFO:tasks.workunit.client.0.smithi063.stdout:7/84: dwrite d2/de/f15 [4194304,4194304] 0 2023-12-07T16:21:34.784 INFO:tasks.workunit.client.0.smithi063.stdout:5/104: dwrite d1/d3/de/f10 [0,4194304] 0 2023-12-07T16:21:34.785 INFO:tasks.workunit.client.1.smithi152.stdout:7/357: mknod db/d27/d5e/d45/c65 0 2023-12-07T16:21:34.787 INFO:tasks.workunit.client.0.smithi063.stdout:1/83: getdents d0/dd/d10 0 2023-12-07T16:21:34.787 INFO:tasks.workunit.client.1.smithi152.stdout:5/471: dread dd/de/d38/d3d/f46 [0,4194304] 0 2023-12-07T16:21:34.787 INFO:tasks.workunit.client.1.smithi152.stdout:5/472: write dd/de/d14/d1f/d49/f73 [851962,22340] 0 2023-12-07T16:21:34.792 INFO:tasks.workunit.client.1.smithi152.stdout:7/358: write db/d27/d5e/f48 [3183211,24619] 0 2023-12-07T16:21:34.800 INFO:tasks.workunit.client.0.smithi063.stdout:5/105: creat d1/d3/de/d1e/f21 x:0 0 0 2023-12-07T16:21:34.804 INFO:tasks.workunit.client.0.smithi063.stdout:6/183: dwrite d0/d1e/d1d/d1f/f21 [0,4194304] 0 2023-12-07T16:21:34.807 INFO:tasks.workunit.client.0.smithi063.stdout:7/85: link d2/ff d2/f24 0 2023-12-07T16:21:34.807 INFO:tasks.workunit.client.0.smithi063.stdout:7/86: chown d2/de/f20 2078673 1 2023-12-07T16:21:34.809 INFO:tasks.workunit.client.0.smithi063.stdout:1/84: dread d0/dd/d10/d13/fc [0,4194304] 0 2023-12-07T16:21:34.809 INFO:tasks.workunit.client.0.smithi063.stdout:4/76: sync 2023-12-07T16:21:34.810 INFO:tasks.workunit.client.0.smithi063.stdout:9/125: dread d0/f3 [0,4194304] 0 2023-12-07T16:21:34.810 INFO:tasks.workunit.client.0.smithi063.stdout:7/87: creat d2/f25 x:0 0 0 2023-12-07T16:21:34.810 INFO:tasks.workunit.client.0.smithi063.stdout:7/88: chown d2/l22 4102781 1 2023-12-07T16:21:34.810 INFO:tasks.workunit.client.0.smithi063.stdout:7/89: write d2/f12 [570074,68855] 0 2023-12-07T16:21:34.813 INFO:tasks.workunit.client.0.smithi063.stdout:4/77: link d1/f10 d1/f12 0 2023-12-07T16:21:34.813 INFO:tasks.workunit.client.0.smithi063.stdout:1/85: creat d0/dd/d10/f17 x:0 0 0 2023-12-07T16:21:34.814 INFO:tasks.workunit.client.0.smithi063.stdout:1/86: write d0/dd/f16 [379560,106887] 0 2023-12-07T16:21:34.814 INFO:tasks.workunit.client.0.smithi063.stdout:1/87: fdatasync d0/f7 0 2023-12-07T16:21:34.816 INFO:tasks.workunit.client.0.smithi063.stdout:9/126: rmdir d0 39 2023-12-07T16:21:34.816 INFO:tasks.workunit.client.0.smithi063.stdout:5/106: dread d1/d3/de/f14 [0,4194304] 0 2023-12-07T16:21:34.816 INFO:tasks.workunit.client.0.smithi063.stdout:5/107: write d1/d3/de/d1e/f21 [632607,12176] 0 2023-12-07T16:21:34.817 INFO:tasks.workunit.client.0.smithi063.stdout:4/78: mkdir d1/d3/db/d13 0 2023-12-07T16:21:34.817 INFO:tasks.workunit.client.0.smithi063.stdout:4/79: fdatasync d1/f10 0 2023-12-07T16:21:34.817 INFO:tasks.workunit.client.0.smithi063.stdout:4/80: chown d1/d3/db/ce 0 1 2023-12-07T16:21:34.818 INFO:tasks.workunit.client.0.smithi063.stdout:7/90: rename d2/f25 to d2/f26 0 2023-12-07T16:21:34.818 INFO:tasks.workunit.client.0.smithi063.stdout:7/91: write d2/f26 [1028523,18963] 0 2023-12-07T16:21:34.820 INFO:tasks.workunit.client.0.smithi063.stdout:9/127: creat d0/d13/f2b x:0 0 0 2023-12-07T16:21:34.820 INFO:tasks.workunit.client.0.smithi063.stdout:4/81: write d1/d3/f8 [740882,54947] 0 2023-12-07T16:21:34.821 INFO:tasks.workunit.client.0.smithi063.stdout:5/108: rename d1/d3/f4 to d1/d3/f22 0 2023-12-07T16:21:34.822 INFO:tasks.workunit.client.0.smithi063.stdout:7/92: creat d2/de/f27 x:0 0 0 2023-12-07T16:21:34.822 INFO:tasks.workunit.client.1.smithi152.stdout:7/359: dwrite db/d27/d5e/f54 [0,4194304] 0 2023-12-07T16:21:34.822 INFO:tasks.workunit.client.1.smithi152.stdout:5/473: dwrite fc [0,4194304] 0 2023-12-07T16:21:34.824 INFO:tasks.workunit.client.0.smithi063.stdout:9/128: creat d0/d21/f2c x:0 0 0 2023-12-07T16:21:34.824 INFO:tasks.workunit.client.0.smithi063.stdout:9/129: chown d0/l9 734915 1 2023-12-07T16:21:34.824 INFO:tasks.workunit.client.0.smithi063.stdout:9/130: write d0/d21/f23 [904096,128162] 0 2023-12-07T16:21:34.824 INFO:tasks.workunit.client.0.smithi063.stdout:2/103: dwrite d0/fa [0,4194304] 0 2023-12-07T16:21:34.824 INFO:tasks.workunit.client.0.smithi063.stdout:4/82: mknod d1/c14 0 2023-12-07T16:21:34.825 INFO:tasks.workunit.client.1.smithi152.stdout:7/360: write f8 [954798,1227] 0 2023-12-07T16:21:34.826 INFO:tasks.workunit.client.0.smithi063.stdout:2/104: creat d0/df/d11/f23 x:0 0 0 2023-12-07T16:21:34.826 INFO:tasks.workunit.client.0.smithi063.stdout:2/105: write d0/df/d11/f1a [1044780,119281] 0 2023-12-07T16:21:34.826 INFO:tasks.workunit.client.0.smithi063.stdout:4/83: symlink d1/l15 0 2023-12-07T16:21:34.827 INFO:tasks.workunit.client.1.smithi152.stdout:5/474: creat dd/de/d14/d1f/d49/f9e x:0 0 0 2023-12-07T16:21:34.827 INFO:tasks.workunit.client.1.smithi152.stdout:5/475: write dd/de/d8f/f93 [5562,19069] 0 2023-12-07T16:21:34.827 INFO:tasks.workunit.client.1.smithi152.stdout:7/361: link db/f5d db/d27/d39/f66 0 2023-12-07T16:21:34.828 INFO:tasks.workunit.client.1.smithi152.stdout:5/476: symlink dd/de/d38/d3d/l9f 0 2023-12-07T16:21:34.829 INFO:tasks.workunit.client.0.smithi063.stdout:2/106: symlink d0/d21/l24 0 2023-12-07T16:21:34.829 INFO:tasks.workunit.client.0.smithi063.stdout:2/107: rename d0/df to d0/df/d11/d25 22 2023-12-07T16:21:34.830 INFO:tasks.workunit.client.0.smithi063.stdout:4/84: mkdir d1/d3/db/d16 0 2023-12-07T16:21:34.831 INFO:tasks.workunit.client.0.smithi063.stdout:9/131: dread d0/f3 [0,4194304] 0 2023-12-07T16:21:34.832 INFO:tasks.workunit.client.0.smithi063.stdout:6/184: dwrite d0/d1e/f24 [0,4194304] 0 2023-12-07T16:21:34.832 INFO:tasks.workunit.client.0.smithi063.stdout:4/85: creat d1/d3/db/d13/f17 x:0 0 0 2023-12-07T16:21:34.833 INFO:tasks.workunit.client.0.smithi063.stdout:4/86: chown d1/d3/db/d13/f17 14 1 2023-12-07T16:21:34.834 INFO:tasks.workunit.client.0.smithi063.stdout:3/92: dwrite f6 [0,4194304] 0 2023-12-07T16:21:34.837 INFO:tasks.workunit.client.0.smithi063.stdout:8/230: sync 2023-12-07T16:21:34.837 INFO:tasks.workunit.client.0.smithi063.stdout:0/164: sync 2023-12-07T16:21:34.837 INFO:tasks.workunit.client.0.smithi063.stdout:0/165: fsync d4/dd/d26/d2b/f33 0 2023-12-07T16:21:34.840 INFO:tasks.workunit.client.0.smithi063.stdout:8/231: creat d7/d14/d15/d2b/f4b x:0 0 0 2023-12-07T16:21:34.840 INFO:tasks.workunit.client.0.smithi063.stdout:8/232: chown d7/d14/d1a/f31 128893 1 2023-12-07T16:21:34.840 INFO:tasks.workunit.client.0.smithi063.stdout:8/233: chown d7/c20 15257024 1 2023-12-07T16:21:34.842 INFO:tasks.workunit.client.0.smithi063.stdout:8/234: creat d7/d14/d15/d48/f4c x:0 0 0 2023-12-07T16:21:34.842 INFO:tasks.workunit.client.0.smithi063.stdout:7/93: write d2/f1e [1150500,89017] 0 2023-12-07T16:21:34.845 INFO:tasks.workunit.client.0.smithi063.stdout:8/235: rename d7/c30 to d7/d38/c4d 0 2023-12-07T16:21:34.848 INFO:tasks.workunit.client.0.smithi063.stdout:7/94: dread - d2/fa zero size 2023-12-07T16:21:34.851 INFO:tasks.workunit.client.0.smithi063.stdout:7/95: symlink d2/de/l28 0 2023-12-07T16:21:34.852 INFO:tasks.workunit.client.0.smithi063.stdout:8/236: mkdir d7/d14/d4e 0 2023-12-07T16:21:34.854 INFO:tasks.workunit.client.0.smithi063.stdout:7/96: rename d2/f23 to d2/d21/f29 0 2023-12-07T16:21:34.855 INFO:tasks.workunit.client.0.smithi063.stdout:8/237: creat d7/d14/f4f x:0 0 0 2023-12-07T16:21:34.857 INFO:tasks.workunit.client.0.smithi063.stdout:8/238: creat d7/d14/d1a/f50 x:0 0 0 2023-12-07T16:21:34.857 INFO:tasks.workunit.client.0.smithi063.stdout:2/108: rename d0/df to d0/d26 0 2023-12-07T16:21:34.860 INFO:tasks.workunit.client.0.smithi063.stdout:8/239: rename d7/d14/d15/d2b/f4b to d7/d14/d1a/f51 0 2023-12-07T16:21:34.860 INFO:tasks.workunit.client.0.smithi063.stdout:8/240: readlink d7/l13 0 2023-12-07T16:21:34.860 INFO:tasks.workunit.client.0.smithi063.stdout:8/241: fdatasync d7/d14/d1a/f51 0 2023-12-07T16:21:34.861 INFO:tasks.workunit.client.0.smithi063.stdout:2/109: read d0/d26/d11/f1b [4428044,76451] 0 2023-12-07T16:21:34.861 INFO:tasks.workunit.client.0.smithi063.stdout:2/110: chown d0/d21/l24 983017 1 2023-12-07T16:21:34.861 INFO:tasks.workunit.client.0.smithi063.stdout:4/87: getdents d1/d3/db/d13 0 2023-12-07T16:21:34.865 INFO:tasks.workunit.client.0.smithi063.stdout:2/111: symlink d0/d26/d11/l27 0 2023-12-07T16:21:34.865 INFO:tasks.workunit.client.0.smithi063.stdout:2/112: truncate d0/d26/f17 411320 0 2023-12-07T16:21:34.865 INFO:tasks.workunit.client.0.smithi063.stdout:3/93: dwrite f5 [4194304,4194304] 0 2023-12-07T16:21:34.865 INFO:tasks.workunit.client.1.smithi152.stdout:7/362: dwrite db/d27/d5e/d45/f50 [0,4194304] 0 2023-12-07T16:21:34.866 INFO:tasks.workunit.client.0.smithi063.stdout:3/94: symlink d7/l17 0 2023-12-07T16:21:34.867 INFO:tasks.workunit.client.0.smithi063.stdout:3/95: getdents d7/d9/dd 0 2023-12-07T16:21:34.868 INFO:tasks.workunit.client.1.smithi152.stdout:7/363: creat db/d27/d39/d41/d37/f67 x:0 0 0 2023-12-07T16:21:34.870 INFO:tasks.workunit.client.1.smithi152.stdout:7/364: mkdir db/d68 0 2023-12-07T16:21:34.870 INFO:tasks.workunit.client.1.smithi152.stdout:7/365: stat db/d27/d39/d41/d37/c5c 0 2023-12-07T16:21:34.870 INFO:tasks.workunit.client.1.smithi152.stdout:7/366: fsync db/d27/d39/d41/d37/f38 0 2023-12-07T16:21:34.871 INFO:tasks.workunit.client.1.smithi152.stdout:7/367: chown db/l2b 3621645 1 2023-12-07T16:21:34.873 INFO:tasks.workunit.client.1.smithi152.stdout:7/368: creat db/d27/d4d/f69 x:0 0 0 2023-12-07T16:21:34.876 INFO:tasks.workunit.client.0.smithi063.stdout:9/132: dwrite d0/d13/f2b [0,4194304] 0 2023-12-07T16:21:34.879 INFO:tasks.workunit.client.0.smithi063.stdout:0/166: write d4/fc [901388,106137] 0 2023-12-07T16:21:34.879 INFO:tasks.workunit.client.1.smithi152.stdout:7/369: dread db/d27/d39/d41/f4f [0,4194304] 0 2023-12-07T16:21:34.882 INFO:tasks.workunit.client.0.smithi063.stdout:0/167: truncate d4/dd/de/d15/f21 600009 0 2023-12-07T16:21:34.882 INFO:tasks.workunit.client.0.smithi063.stdout:9/133: write d0/d7/f2a [750496,17378] 0 2023-12-07T16:21:34.882 INFO:tasks.workunit.client.0.smithi063.stdout:9/134: truncate d0/d13/f2b 4482483 0 2023-12-07T16:21:34.882 INFO:tasks.workunit.client.0.smithi063.stdout:9/135: fsync d0/d7/fe 0 2023-12-07T16:21:34.882 INFO:tasks.workunit.client.1.smithi152.stdout:7/370: creat db/d27/d39/f6a x:0 0 0 2023-12-07T16:21:34.883 INFO:tasks.workunit.client.1.smithi152.stdout:7/371: creat db/d27/d5e/f6b x:0 0 0 2023-12-07T16:21:34.884 INFO:tasks.workunit.client.1.smithi152.stdout:7/372: fsync db/d1c/f10 0 2023-12-07T16:21:34.884 INFO:tasks.workunit.client.0.smithi063.stdout:0/168: symlink d4/d25/l36 0 2023-12-07T16:21:34.885 INFO:tasks.workunit.client.0.smithi063.stdout:9/136: dread d0/d13/f17 [0,4194304] 0 2023-12-07T16:21:34.885 INFO:tasks.workunit.client.0.smithi063.stdout:9/137: fsync d0/f1a 0 2023-12-07T16:21:34.886 INFO:tasks.workunit.client.1.smithi152.stdout:7/373: rename db/d1c/c1b to db/d27/c6c 0 2023-12-07T16:21:34.887 INFO:tasks.workunit.client.1.smithi152.stdout:7/374: creat db/d27/d4d/f6d x:0 0 0 2023-12-07T16:21:34.888 INFO:tasks.workunit.client.0.smithi063.stdout:0/169: write d4/dd/de/f13 [1287158,27240] 0 2023-12-07T16:21:34.888 INFO:tasks.workunit.client.0.smithi063.stdout:3/96: dread f5 [4194304,4194304] 0 2023-12-07T16:21:34.889 INFO:tasks.workunit.client.0.smithi063.stdout:0/170: dread d4/dd/de/f19 [4194304,4194304] 0 2023-12-07T16:21:34.890 INFO:tasks.workunit.client.0.smithi063.stdout:3/97: creat d7/d9/f18 x:0 0 0 2023-12-07T16:21:34.890 INFO:tasks.workunit.client.0.smithi063.stdout:5/109: dwrite d1/d3/de/f10 [0,4194304] 0 2023-12-07T16:21:34.891 INFO:tasks.workunit.client.0.smithi063.stdout:0/171: symlink d4/d25/l37 0 2023-12-07T16:21:34.892 INFO:tasks.workunit.client.0.smithi063.stdout:3/98: rename d7/d9/dd/f13 to d7/d9/dd/f19 0 2023-12-07T16:21:34.892 INFO:tasks.workunit.client.0.smithi063.stdout:3/99: truncate d7/d9/f18 922734 0 2023-12-07T16:21:34.893 INFO:tasks.workunit.client.0.smithi063.stdout:5/110: symlink d1/d3/l23 0 2023-12-07T16:21:34.893 INFO:tasks.workunit.client.0.smithi063.stdout:0/172: creat d4/dd/de/d15/d1f/f38 x:0 0 0 2023-12-07T16:21:34.895 INFO:tasks.workunit.client.0.smithi063.stdout:5/111: creat d1/d3/de/d1e/f24 x:0 0 0 2023-12-07T16:21:34.896 INFO:tasks.workunit.client.0.smithi063.stdout:5/112: dread d1/d3/de/f16 [0,4194304] 0 2023-12-07T16:21:34.896 INFO:tasks.workunit.client.0.smithi063.stdout:5/113: write d1/d3/de/f19 [530815,76077] 0 2023-12-07T16:21:34.896 INFO:tasks.workunit.client.0.smithi063.stdout:5/114: dread d1/d3/de/f16 [0,4194304] 0 2023-12-07T16:21:34.897 INFO:tasks.workunit.client.0.smithi063.stdout:5/115: readlink d1/d3/l23 0 2023-12-07T16:21:34.900 INFO:tasks.workunit.client.0.smithi063.stdout:7/97: dwrite d2/f6 [0,4194304] 0 2023-12-07T16:21:34.901 INFO:tasks.workunit.client.0.smithi063.stdout:8/242: dwrite d7/f24 [0,4194304] 0 2023-12-07T16:21:34.901 INFO:tasks.workunit.client.0.smithi063.stdout:8/243: chown d7/d14/d15/f2d 74022 1 2023-12-07T16:21:34.901 INFO:tasks.workunit.client.0.smithi063.stdout:2/113: dwrite d0/d26/f20 [0,4194304] 0 2023-12-07T16:21:34.901 INFO:tasks.workunit.client.1.smithi152.stdout:5/477: dwrite dd/de/d14/d19/d1a/d1b/f77 [4194304,4194304] 0 2023-12-07T16:21:34.902 INFO:tasks.workunit.client.0.smithi063.stdout:6/185: dwrite d0/d1e/f3e [0,4194304] 0 2023-12-07T16:21:34.904 INFO:tasks.workunit.client.0.smithi063.stdout:3/100: dread d7/d9/dd/f19 [0,4194304] 0 2023-12-07T16:21:34.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:34 smithi063 ceph-mon[112095]: Reconfiguring node-exporter.smithi152 (dependencies changed)... 2023-12-07T16:21:34.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:34 smithi063 ceph-mon[112095]: Reconfiguring daemon node-exporter.smithi152 on smithi152 2023-12-07T16:21:34.906 INFO:tasks.workunit.client.1.smithi152.stdout:5/478: creat dd/de/d17/d54/fa0 x:0 0 0 2023-12-07T16:21:34.906 INFO:tasks.workunit.client.0.smithi063.stdout:0/173: dread d4/dd/de/d15/f18 [0,4194304] 0 2023-12-07T16:21:34.907 INFO:tasks.workunit.client.1.smithi152.stdout:5/479: creat dd/d91/fa1 x:0 0 0 2023-12-07T16:21:34.907 INFO:tasks.workunit.client.1.smithi152.stdout:5/480: read dd/f40 [142214,67545] 0 2023-12-07T16:21:34.908 INFO:tasks.workunit.client.1.smithi152.stdout:7/375: getdents db/d27/d39 0 2023-12-07T16:21:34.909 INFO:tasks.workunit.client.1.smithi152.stdout:7/376: readlink db/d1c/lf 0 2023-12-07T16:21:34.909 INFO:tasks.workunit.client.1.smithi152.stdout:7/377: chown db/d1c/l2d 8197 1 2023-12-07T16:21:34.910 INFO:tasks.workunit.client.1.smithi152.stdout:7/378: creat db/d27/f6e x:0 0 0 2023-12-07T16:21:34.911 INFO:tasks.workunit.client.0.smithi063.stdout:7/98: truncate d2/f1a 3345841 0 2023-12-07T16:21:34.911 INFO:tasks.workunit.client.0.smithi063.stdout:7/99: truncate d2/f1e 5055958 0 2023-12-07T16:21:34.913 INFO:tasks.workunit.client.1.smithi152.stdout:7/379: symlink db/d27/d5e/l6f 0 2023-12-07T16:21:34.913 INFO:tasks.workunit.client.1.smithi152.stdout:7/380: readlink db/l36 0 2023-12-07T16:21:34.914 INFO:tasks.workunit.client.1.smithi152.stdout:7/381: rmdir db/d1c 39 2023-12-07T16:21:34.914 INFO:tasks.workunit.client.1.smithi152.stdout:7/382: chown db/d1c/l2d 30265248 1 2023-12-07T16:21:34.915 INFO:tasks.workunit.client.0.smithi063.stdout:8/244: link d7/d14/d15/l19 d7/d14/d15/l52 0 2023-12-07T16:21:34.915 INFO:tasks.workunit.client.0.smithi063.stdout:8/245: write d7/d14/d15/f2f [1181095,115136] 0 2023-12-07T16:21:34.916 INFO:tasks.workunit.client.1.smithi152.stdout:7/383: rename db/d27/d39/f33 to db/d27/d39/d63/f70 0 2023-12-07T16:21:34.917 INFO:tasks.workunit.client.1.smithi152.stdout:7/384: creat db/d27/d39/d41/d37/f71 x:0 0 0 2023-12-07T16:21:34.918 INFO:tasks.workunit.client.0.smithi063.stdout:2/114: truncate d0/f10 2758744 0 2023-12-07T16:21:34.918 INFO:tasks.workunit.client.0.smithi063.stdout:2/115: chown d0/l2 44598 1 2023-12-07T16:21:34.919 INFO:tasks.workunit.client.1.smithi152.stdout:7/385: mknod db/d68/c72 0 2023-12-07T16:21:34.919 INFO:tasks.workunit.client.1.smithi152.stdout:5/481: dread dd/de/d14/d19/d1a/d1b/f48 [0,4194304] 0 2023-12-07T16:21:34.920 INFO:tasks.workunit.client.1.smithi152.stdout:7/386: creat db/d27/d39/d41/d58/f73 x:0 0 0 2023-12-07T16:21:34.920 INFO:tasks.workunit.client.1.smithi152.stdout:7/387: chown db/d27/d39/d41/d58/f73 2852 1 2023-12-07T16:21:34.920 INFO:tasks.workunit.client.0.smithi063.stdout:6/186: creat d0/d17/f43 x:0 0 0 2023-12-07T16:21:34.921 INFO:tasks.workunit.client.1.smithi152.stdout:5/482: rename dd/de/d14/d1f/l56 to dd/de/d38/d3d/la2 0 2023-12-07T16:21:34.921 INFO:tasks.workunit.client.0.smithi063.stdout:0/174: symlink d4/dd/de/d15/l39 0 2023-12-07T16:21:34.921 INFO:tasks.workunit.client.0.smithi063.stdout:0/175: fdatasync d4/dd/de/d15/f21 0 2023-12-07T16:21:34.922 INFO:tasks.workunit.client.1.smithi152.stdout:5/483: mkdir dd/de/d14/d19/da3 0 2023-12-07T16:21:34.922 INFO:tasks.workunit.client.0.smithi063.stdout:4/88: truncate d1/d3/f8 2829338 0 2023-12-07T16:21:34.922 INFO:tasks.workunit.client.0.smithi063.stdout:4/89: write d1/d3/db/fd [414322,91923] 0 2023-12-07T16:21:34.923 INFO:tasks.workunit.client.0.smithi063.stdout:7/100: mkdir d2/de/d2a 0 2023-12-07T16:21:34.926 INFO:tasks.workunit.client.0.smithi063.stdout:0/176: creat d4/dd/de/d15/d1f/f3a x:0 0 0 2023-12-07T16:21:34.926 INFO:tasks.workunit.client.0.smithi063.stdout:6/187: write d0/d1e/f24 [3717840,34667] 0 2023-12-07T16:21:34.926 INFO:tasks.workunit.client.0.smithi063.stdout:4/90: creat d1/d3/db/d13/f18 x:0 0 0 2023-12-07T16:21:34.928 INFO:tasks.workunit.client.0.smithi063.stdout:6/188: link d0/d17/d1a/d38/l3c d0/d1e/d1d/d1f/l44 0 2023-12-07T16:21:34.928 INFO:tasks.workunit.client.0.smithi063.stdout:6/189: readlink d0/d17/d1a/d38/l3c 0 2023-12-07T16:21:34.929 INFO:tasks.workunit.client.0.smithi063.stdout:5/116: dwrite d1/d3/de/f10 [0,4194304] 0 2023-12-07T16:21:34.930 INFO:tasks.workunit.client.0.smithi063.stdout:4/91: symlink d1/d3/l19 0 2023-12-07T16:21:34.930 INFO:tasks.workunit.client.0.smithi063.stdout:6/190: symlink d0/d17/d1a/d38/l45 0 2023-12-07T16:21:34.932 INFO:tasks.workunit.client.0.smithi063.stdout:6/191: mkdir d0/d17/d46 0 2023-12-07T16:21:34.934 INFO:tasks.workunit.client.1.smithi152.stdout:7/388: dread db/d27/f3d [0,4194304] 0 2023-12-07T16:21:34.934 INFO:tasks.workunit.client.0.smithi063.stdout:3/101: dwrite f5 [0,4194304] 0 2023-12-07T16:21:34.938 INFO:tasks.workunit.client.0.smithi063.stdout:3/102: dread d7/ff [0,4194304] 0 2023-12-07T16:21:34.941 INFO:tasks.workunit.client.0.smithi063.stdout:3/103: unlink l0 0 2023-12-07T16:21:34.941 INFO:tasks.workunit.client.0.smithi063.stdout:3/104: readlink d7/d9/l11 0 2023-12-07T16:21:34.942 INFO:tasks.workunit.client.0.smithi063.stdout:3/105: truncate d7/d9/f12 277263 0 2023-12-07T16:21:34.950 INFO:tasks.workunit.client.0.smithi063.stdout:3/106: rename l3 to d7/d9/dd/l1a 0 2023-12-07T16:21:34.960 INFO:tasks.workunit.client.0.smithi063.stdout:4/92: unlink d1/f12 0 2023-12-07T16:21:34.961 INFO:tasks.workunit.client.0.smithi063.stdout:4/93: unlink d1/f10 0 2023-12-07T16:21:34.962 INFO:tasks.workunit.client.0.smithi063.stdout:4/94: symlink d1/d3/l1a 0 2023-12-07T16:21:34.962 INFO:tasks.workunit.client.0.smithi063.stdout:4/95: dread - d1/d3/db/d13/f18 zero size 2023-12-07T16:21:34.963 INFO:tasks.workunit.client.0.smithi063.stdout:4/96: mknod d1/d3/db/d13/c1b 0 2023-12-07T16:21:34.963 INFO:tasks.workunit.client.0.smithi063.stdout:4/97: fsync d1/d3/f5 0 2023-12-07T16:21:34.964 INFO:tasks.workunit.client.0.smithi063.stdout:4/98: creat d1/d3/db/d13/f1c x:0 0 0 2023-12-07T16:21:34.965 INFO:tasks.workunit.client.0.smithi063.stdout:4/99: rename d1/l15 to d1/d3/db/d13/l1d 0 2023-12-07T16:21:34.966 INFO:tasks.workunit.client.0.smithi063.stdout:4/100: creat d1/d3/f1e x:0 0 0 2023-12-07T16:21:34.979 INFO:tasks.workunit.client.0.smithi063.stdout:7/101: dwrite d2/d21/f29 [0,4194304] 0 2023-12-07T16:21:35.002 INFO:tasks.workunit.client.0.smithi063.stdout:8/246: dwrite d7/d14/d15/f2f [0,4194304] 0 2023-12-07T16:21:35.002 INFO:tasks.workunit.client.0.smithi063.stdout:5/117: dwrite d1/d3/de/f1f [4194304,4194304] 0 2023-12-07T16:21:35.002 INFO:tasks.workunit.client.0.smithi063.stdout:0/177: dwrite d4/dd/de/d15/d1f/d22/f23 [0,4194304] 0 2023-12-07T16:21:35.002 INFO:tasks.workunit.client.0.smithi063.stdout:0/178: fdatasync d4/dd/de/d15/d1f/f3a 0 2023-12-07T16:21:35.002 INFO:tasks.workunit.client.0.smithi063.stdout:2/116: dwrite d0/f10 [0,4194304] 0 2023-12-07T16:21:35.002 INFO:tasks.workunit.client.0.smithi063.stdout:2/117: write d0/d26/f17 [71898,130252] 0 2023-12-07T16:21:35.003 INFO:tasks.workunit.client.1.smithi152.stdout:7/389: dwrite db/d27/d39/d41/d37/f3f [0,4194304] 0 2023-12-07T16:21:35.003 INFO:tasks.workunit.client.1.smithi152.stdout:7/390: chown db/d27/d5e/d45/c4b 131165178 1 2023-12-07T16:21:35.003 INFO:tasks.workunit.client.1.smithi152.stdout:5/484: dwrite dd/de/d14/d67/f80 [0,4194304] 0 2023-12-07T16:21:35.004 INFO:tasks.workunit.client.0.smithi063.stdout:7/102: dwrite d2/f12 [0,4194304] 0 2023-12-07T16:21:35.004 INFO:tasks.workunit.client.0.smithi063.stdout:7/103: dread - d2/ff zero size 2023-12-07T16:21:35.004 INFO:tasks.workunit.client.0.smithi063.stdout:7/104: truncate d2/de/f20 37556 0 2023-12-07T16:21:35.004 INFO:tasks.workunit.client.0.smithi063.stdout:7/105: write d2/f17 [41565,111591] 0 2023-12-07T16:21:35.004 INFO:tasks.workunit.client.0.smithi063.stdout:4/101: dwrite d1/d3/f1e [0,4194304] 0 2023-12-07T16:21:35.006 INFO:tasks.workunit.client.0.smithi063.stdout:5/118: mkdir d1/d3/de/d1e/d25 0 2023-12-07T16:21:35.007 INFO:tasks.workunit.client.0.smithi063.stdout:2/118: mknod d0/c28 0 2023-12-07T16:21:35.008 INFO:tasks.workunit.client.1.smithi152.stdout:5/485: symlink dd/de/d14/d1f/d49/la4 0 2023-12-07T16:21:35.018 INFO:tasks.workunit.client.0.smithi063.stdout:3/107: truncate f5 4941796 0 2023-12-07T16:21:35.018 INFO:tasks.workunit.client.1.smithi152.stdout:7/391: dread db/d27/d39/d41/f60 [4194304,4194304] 0 2023-12-07T16:21:35.020 INFO:tasks.workunit.client.0.smithi063.stdout:2/119: dread d0/d26/d11/f1a [0,4194304] 0 2023-12-07T16:21:35.020 INFO:tasks.workunit.client.1.smithi152.stdout:5/486: dread dd/de/d14/d1f/d28/f69 [0,4194304] 0 2023-12-07T16:21:35.022 INFO:tasks.workunit.client.1.smithi152.stdout:5/487: link dd/de/d14/d1f/c68 dd/de/d38/ca5 0 2023-12-07T16:21:35.022 INFO:tasks.workunit.client.1.smithi152.stdout:5/488: chown dd/de/d17/l26 29 1 2023-12-07T16:21:35.023 INFO:tasks.workunit.client.1.smithi152.stdout:5/489: mkdir dd/de/d14/d19/d7a/da6 0 2023-12-07T16:21:35.027 INFO:tasks.workunit.client.0.smithi063.stdout:3/108: mkdir d7/d9/d1b 0 2023-12-07T16:21:35.027 INFO:tasks.workunit.client.0.smithi063.stdout:3/109: truncate d7/ff 1560618 0 2023-12-07T16:21:35.028 INFO:tasks.workunit.client.0.smithi063.stdout:0/179: dwrite d4/f16 [0,4194304] 0 2023-12-07T16:21:35.028 INFO:tasks.workunit.client.0.smithi063.stdout:0/180: write d4/d25/f2f [1173107,42172] 0 2023-12-07T16:21:35.028 INFO:tasks.workunit.client.0.smithi063.stdout:0/181: fsync d4/dd/de/d15/d1f/d22/f23 0 2023-12-07T16:21:35.028 INFO:tasks.workunit.client.0.smithi063.stdout:5/119: dwrite d1/d3/de/f1f [4194304,4194304] 0 2023-12-07T16:21:35.029 INFO:tasks.workunit.client.0.smithi063.stdout:5/120: chown d1/d3/de/d1e 13 1 2023-12-07T16:21:35.029 INFO:tasks.workunit.client.0.smithi063.stdout:2/120: truncate d0/fa 3937212 0 2023-12-07T16:21:35.032 INFO:tasks.workunit.client.0.smithi063.stdout:7/106: rename d2/l13 to d2/l2b 0 2023-12-07T16:21:35.033 INFO:tasks.workunit.client.0.smithi063.stdout:4/102: truncate d1/d3/f8 178109 0 2023-12-07T16:21:35.034 INFO:tasks.workunit.client.0.smithi063.stdout:3/110: creat d7/d9/dd/f1c x:0 0 0 2023-12-07T16:21:35.035 INFO:tasks.workunit.client.0.smithi063.stdout:0/182: creat d4/dd/de/d2d/f3b x:0 0 0 2023-12-07T16:21:35.040 INFO:tasks.workunit.client.0.smithi063.stdout:7/107: unlink d2/de/l1f 0 2023-12-07T16:21:35.041 INFO:tasks.workunit.client.0.smithi063.stdout:3/111: mknod d7/d9/c1d 0 2023-12-07T16:21:35.041 INFO:tasks.workunit.client.0.smithi063.stdout:3/112: chown d7/d9/dd/l1a 26573 1 2023-12-07T16:21:35.043 INFO:tasks.workunit.client.0.smithi063.stdout:0/183: unlink d4/dd/de/d2d/f3b 0 2023-12-07T16:21:35.043 INFO:tasks.workunit.client.0.smithi063.stdout:0/184: dread - d4/d2a/f34 zero size 2023-12-07T16:21:35.043 INFO:tasks.workunit.client.0.smithi063.stdout:3/113: creat d7/d9/dd/f1e x:0 0 0 2023-12-07T16:21:35.043 INFO:tasks.workunit.client.0.smithi063.stdout:7/108: write d2/f8 [1423967,49391] 0 2023-12-07T16:21:35.044 INFO:tasks.workunit.client.0.smithi063.stdout:3/114: fdatasync d7/d9/f18 0 2023-12-07T16:21:35.044 INFO:tasks.workunit.client.0.smithi063.stdout:7/109: truncate d2/f5 6705 0 2023-12-07T16:21:35.044 INFO:tasks.workunit.client.0.smithi063.stdout:7/110: write d2/de/f1b [553568,93451] 0 2023-12-07T16:21:35.045 INFO:tasks.workunit.client.0.smithi063.stdout:2/121: dwrite d0/d26/d11/f23 [0,4194304] 0 2023-12-07T16:21:35.045 INFO:tasks.workunit.client.0.smithi063.stdout:0/185: unlink d4/dd/de/d15/d1f/f38 0 2023-12-07T16:21:35.045 INFO:tasks.workunit.client.0.smithi063.stdout:0/186: chown d4/dd/f14 401 1 2023-12-07T16:21:35.046 INFO:tasks.workunit.client.0.smithi063.stdout:3/115: creat d7/d9/dd/f1f x:0 0 0 2023-12-07T16:21:35.047 INFO:tasks.workunit.client.0.smithi063.stdout:3/116: truncate d7/fa 507872 0 2023-12-07T16:21:35.049 INFO:tasks.workunit.client.0.smithi063.stdout:2/122: creat d0/d1e/f29 x:0 0 0 2023-12-07T16:21:35.050 INFO:tasks.workunit.client.0.smithi063.stdout:0/187: rename d4/d2a to d4/dd/de/d15/d3c 0 2023-12-07T16:21:35.050 INFO:tasks.workunit.client.0.smithi063.stdout:0/188: fsync d4/dd/de/d15/d1f/f3a 0 2023-12-07T16:21:35.051 INFO:tasks.workunit.client.0.smithi063.stdout:3/117: truncate d7/fe 2381065 0 2023-12-07T16:21:35.052 INFO:tasks.workunit.client.0.smithi063.stdout:7/111: mkdir d2/d2c 0 2023-12-07T16:21:35.053 INFO:tasks.workunit.client.0.smithi063.stdout:0/189: getdents d4/dd/d26/d2b 0 2023-12-07T16:21:35.053 INFO:tasks.workunit.client.0.smithi063.stdout:0/190: read d4/f16 [5079575,38343] 0 2023-12-07T16:21:35.053 INFO:tasks.workunit.client.0.smithi063.stdout:3/118: mknod d7/c20 0 2023-12-07T16:21:35.055 INFO:tasks.workunit.client.0.smithi063.stdout:0/191: creat d4/dd/de/d15/f3d x:0 0 0 2023-12-07T16:21:35.055 INFO:tasks.workunit.client.0.smithi063.stdout:0/192: chown d4/dd/de/f13 43114458 1 2023-12-07T16:21:35.055 INFO:tasks.workunit.client.0.smithi063.stdout:0/193: read - d4/dd/de/d15/f3d zero size 2023-12-07T16:21:35.056 INFO:tasks.workunit.client.0.smithi063.stdout:3/119: mkdir d7/d21 0 2023-12-07T16:21:35.057 INFO:tasks.workunit.client.0.smithi063.stdout:0/194: creat d4/f3e x:0 0 0 2023-12-07T16:21:35.058 INFO:tasks.workunit.client.0.smithi063.stdout:0/195: symlink d4/dd/l3f 0 2023-12-07T16:21:35.058 INFO:tasks.workunit.client.0.smithi063.stdout:0/196: readlink d4/dd/l1b 0 2023-12-07T16:21:35.059 INFO:tasks.workunit.client.0.smithi063.stdout:0/197: unlink d4/dd/de/c1c 0 2023-12-07T16:21:35.060 INFO:tasks.workunit.client.0.smithi063.stdout:0/198: read d4/dd/de/f19 [4634478,105439] 0 2023-12-07T16:21:35.061 INFO:tasks.workunit.client.0.smithi063.stdout:0/199: write d4/dd/de/d15/f18 [1746368,60326] 0 2023-12-07T16:21:35.064 INFO:tasks.workunit.client.0.smithi063.stdout:2/123: dwrite d0/d1e/f29 [0,4194304] 0 2023-12-07T16:21:35.077 INFO:tasks.workunit.client.0.smithi063.stdout:0/200: dwrite d4/dd/de/d15/d1f/d22/f23 [0,4194304] 0 2023-12-07T16:21:35.077 INFO:tasks.workunit.client.0.smithi063.stdout:0/201: fsync d4/dd/de/d15/d1f/f3a 0 2023-12-07T16:21:35.078 INFO:tasks.workunit.client.0.smithi063.stdout:0/202: link d4/l8 d4/d25/l40 0 2023-12-07T16:21:35.079 INFO:tasks.workunit.client.0.smithi063.stdout:0/203: symlink d4/dd/d26/l41 0 2023-12-07T16:21:35.079 INFO:tasks.workunit.client.0.smithi063.stdout:0/204: write d4/fc [1886338,48117] 0 2023-12-07T16:21:35.099 INFO:tasks.workunit.client.0.smithi063.stdout:5/121: rmdir d1/d3 39 2023-12-07T16:21:35.099 INFO:tasks.workunit.client.0.smithi063.stdout:5/122: readlink d1/d3/l23 0 2023-12-07T16:21:35.102 INFO:tasks.workunit.client.1.smithi152.stdout:7/392: dread db/fe [0,4194304] 0 2023-12-07T16:21:35.102 INFO:tasks.workunit.client.1.smithi152.stdout:7/393: read - db/d27/f6e zero size 2023-12-07T16:21:35.102 INFO:tasks.workunit.client.1.smithi152.stdout:7/394: chown db/f61 3278 1 2023-12-07T16:21:35.103 INFO:tasks.workunit.client.0.smithi063.stdout:5/123: write d1/d3/de/d1e/f1d [253093,36381] 0 2023-12-07T16:21:35.107 INFO:tasks.workunit.client.0.smithi063.stdout:5/124: symlink d1/l26 0 2023-12-07T16:21:35.107 INFO:tasks.workunit.client.0.smithi063.stdout:5/125: write d1/f13 [1790512,30118] 0 2023-12-07T16:21:35.107 INFO:tasks.workunit.client.0.smithi063.stdout:5/126: truncate d1/d3/de/f16 1631390 0 2023-12-07T16:21:35.112 INFO:tasks.workunit.client.0.smithi063.stdout:9/138: sync 2023-12-07T16:21:35.112 INFO:tasks.workunit.client.0.smithi063.stdout:9/139: write d0/d7/f16 [30523,65485] 0 2023-12-07T16:21:35.112 INFO:tasks.workunit.client.0.smithi063.stdout:9/140: chown d0/d7/c24 4178 1 2023-12-07T16:21:35.112 INFO:tasks.workunit.client.0.smithi063.stdout:9/141: fdatasync d0/d7/f2a 0 2023-12-07T16:21:35.113 INFO:tasks.workunit.client.0.smithi063.stdout:9/142: getdents d0/d7 0 2023-12-07T16:21:35.113 INFO:tasks.workunit.client.0.smithi063.stdout:9/143: readlink d0/l1d 0 2023-12-07T16:21:35.115 INFO:tasks.workunit.client.0.smithi063.stdout:9/144: write d0/d7/fe [3973467,122163] 0 2023-12-07T16:21:35.116 INFO:tasks.workunit.client.0.smithi063.stdout:1/88: sync 2023-12-07T16:21:35.117 INFO:tasks.workunit.client.1.smithi152.stdout:5/490: dwrite dd/de/d14/d1f/d28/f30 [0,4194304] 0 2023-12-07T16:21:35.118 INFO:tasks.workunit.client.0.smithi063.stdout:9/145: dread d0/d13/f17 [0,4194304] 0 2023-12-07T16:21:35.118 INFO:tasks.workunit.client.0.smithi063.stdout:1/89: rmdir d0/dd/d10/d13 39 2023-12-07T16:21:35.118 INFO:tasks.workunit.client.0.smithi063.stdout:1/90: write d0/dd/f16 [168149,22405] 0 2023-12-07T16:21:35.119 INFO:tasks.workunit.client.0.smithi063.stdout:9/146: symlink d0/d21/l2d 0 2023-12-07T16:21:35.119 INFO:tasks.workunit.client.0.smithi063.stdout:9/147: fdatasync d0/f1a 0 2023-12-07T16:21:35.119 INFO:tasks.workunit.client.1.smithi152.stdout:5/491: write fc [7647056,103555] 0 2023-12-07T16:21:35.120 INFO:tasks.workunit.client.0.smithi063.stdout:1/91: symlink d0/dd/l18 0 2023-12-07T16:21:35.120 INFO:tasks.workunit.client.0.smithi063.stdout:1/92: truncate d0/f1 4649109 0 2023-12-07T16:21:35.122 INFO:tasks.workunit.client.0.smithi063.stdout:9/148: symlink d0/l2e 0 2023-12-07T16:21:35.124 INFO:tasks.workunit.client.1.smithi152.stdout:5/492: write dd/de/d14/d1f/d28/f2f [167158,79240] 0 2023-12-07T16:21:35.124 INFO:tasks.workunit.client.0.smithi063.stdout:4/103: dwrite d1/d3/db/fd [0,4194304] 0 2023-12-07T16:21:35.127 INFO:tasks.workunit.client.0.smithi063.stdout:4/104: mknod d1/d3/db/d16/c1f 0 2023-12-07T16:21:35.129 INFO:tasks.workunit.client.0.smithi063.stdout:7/112: dwrite d2/d21/f29 [4194304,4194304] 0 2023-12-07T16:21:35.129 INFO:tasks.workunit.client.0.smithi063.stdout:7/113: readlink d2/l22 0 2023-12-07T16:21:35.129 INFO:tasks.workunit.client.0.smithi063.stdout:5/127: dwrite d1/d3/de/f14 [0,4194304] 0 2023-12-07T16:21:35.130 INFO:tasks.workunit.client.0.smithi063.stdout:7/114: write d2/de/f16 [239696,38174] 0 2023-12-07T16:21:35.134 INFO:tasks.workunit.client.0.smithi063.stdout:9/149: fdatasync d0/d7/fe 0 2023-12-07T16:21:35.137 INFO:tasks.workunit.client.0.smithi063.stdout:5/128: unlink d1/d3/f22 0 2023-12-07T16:21:35.138 INFO:tasks.workunit.client.0.smithi063.stdout:7/115: write d2/f8 [3532442,1309] 0 2023-12-07T16:21:35.138 INFO:tasks.workunit.client.0.smithi063.stdout:3/120: dwrite d7/d9/dd/f19 [0,4194304] 0 2023-12-07T16:21:35.138 INFO:tasks.workunit.client.0.smithi063.stdout:4/105: write d1/d3/f1e [11697,112099] 0 2023-12-07T16:21:35.154 INFO:tasks.workunit.client.0.smithi063.stdout:5/129: link d1/d3/de/d1e/f21 d1/d3/de/d1e/f27 0 2023-12-07T16:21:35.157 INFO:tasks.workunit.client.1.smithi152.stdout:5/493: dwrite dd/de/d17/f5b [0,4194304] 0 2023-12-07T16:21:35.158 INFO:tasks.workunit.client.0.smithi063.stdout:7/116: creat d2/d21/f2d x:0 0 0 2023-12-07T16:21:35.158 INFO:tasks.workunit.client.0.smithi063.stdout:7/117: fsync d2/f1a 0 2023-12-07T16:21:35.158 INFO:tasks.workunit.client.1.smithi152.stdout:5/494: mknod dd/de/d14/d1f/ca7 0 2023-12-07T16:21:35.159 INFO:tasks.workunit.client.1.smithi152.stdout:5/495: creat dd/de/d14/d1f/fa8 x:0 0 0 2023-12-07T16:21:35.159 INFO:tasks.workunit.client.1.smithi152.stdout:5/496: write dd/de/d14/d19/d1a/d1b/f8d [1089065,32528] 0 2023-12-07T16:21:35.159 INFO:tasks.workunit.client.1.smithi152.stdout:5/497: chown dd/de/d14/d19/d74 26735 1 2023-12-07T16:21:35.161 INFO:tasks.workunit.client.1.smithi152.stdout:5/498: symlink dd/de/d17/d54/d7c/la9 0 2023-12-07T16:21:35.161 INFO:tasks.workunit.client.1.smithi152.stdout:5/499: fdatasync dd/de/d14/d1f/d28/f2d 0 2023-12-07T16:21:35.161 INFO:tasks.workunit.client.0.smithi063.stdout:0/205: rmdir d4/dd/de/d15 39 2023-12-07T16:21:35.161 INFO:tasks.workunit.client.0.smithi063.stdout:0/206: fsync d4/dd/de/f24 0 2023-12-07T16:21:35.162 INFO:tasks.workunit.client.1.smithi152.stdout:5/500: creat dd/de/d8f/faa x:0 0 0 2023-12-07T16:21:35.162 INFO:tasks.workunit.client.1.smithi152.stdout:5/501: readlink dd/de/d14/d19/d74/l75 0 2023-12-07T16:21:35.164 INFO:tasks.workunit.client.1.smithi152.stdout:5/502: rename dd/de/d17/f61 to dd/fab 0 2023-12-07T16:21:35.165 INFO:tasks.workunit.client.0.smithi063.stdout:2/124: dwrite d0/d26/f17 [0,4194304] 0 2023-12-07T16:21:35.166 INFO:tasks.workunit.client.0.smithi063.stdout:2/125: write d0/d26/f17 [1904214,99695] 0 2023-12-07T16:21:35.167 INFO:tasks.workunit.client.0.smithi063.stdout:1/93: dwrite d0/dd/f16 [0,4194304] 0 2023-12-07T16:21:35.167 INFO:tasks.workunit.client.0.smithi063.stdout:1/94: chown d0 4 1 2023-12-07T16:21:35.168 INFO:tasks.workunit.client.0.smithi063.stdout:4/106: dwrite d1/d3/db/d13/f17 [0,4194304] 0 2023-12-07T16:21:35.174 INFO:tasks.workunit.client.0.smithi063.stdout:3/121: rmdir d7/d9/dd 39 2023-12-07T16:21:35.176 INFO:tasks.workunit.client.0.smithi063.stdout:7/118: symlink d2/d2c/l2e 0 2023-12-07T16:21:35.177 INFO:tasks.workunit.client.0.smithi063.stdout:5/130: creat d1/d3/de/f28 x:0 0 0 2023-12-07T16:21:35.177 INFO:tasks.workunit.client.0.smithi063.stdout:0/207: rename d4/d25/l37 to d4/dd/de/l42 0 2023-12-07T16:21:35.177 INFO:tasks.workunit.client.0.smithi063.stdout:0/208: write d4/dd/de/d15/f3d [337463,10629] 0 2023-12-07T16:21:35.178 INFO:tasks.workunit.client.0.smithi063.stdout:0/209: write d4/dd/f14 [2780086,32439] 0 2023-12-07T16:21:35.178 INFO:tasks.workunit.client.0.smithi063.stdout:0/210: dread - d4/dd/de/d15/d3c/f34 zero size 2023-12-07T16:21:35.178 INFO:tasks.workunit.client.0.smithi063.stdout:0/211: fsync d4/dd/de/f19 0 2023-12-07T16:21:35.178 INFO:tasks.workunit.client.0.smithi063.stdout:9/150: getdents d0 0 2023-12-07T16:21:35.178 INFO:tasks.workunit.client.0.smithi063.stdout:9/151: readlink d0/l9 0 2023-12-07T16:21:35.178 INFO:tasks.workunit.client.0.smithi063.stdout:9/152: stat d0/d7/f1e 0 2023-12-07T16:21:35.181 INFO:tasks.workunit.client.1.smithi152.stdout:5/503: dwrite dd/d7b/f84 [0,4194304] 0 2023-12-07T16:21:35.181 INFO:tasks.workunit.client.1.smithi152.stdout:5/504: chown dd/de/d14/d1f/f2e 3084 1 2023-12-07T16:21:35.181 INFO:tasks.workunit.client.0.smithi063.stdout:2/126: creat d0/d21/f2a x:0 0 0 2023-12-07T16:21:35.182 INFO:tasks.workunit.client.0.smithi063.stdout:2/127: chown d0/d26 57 1 2023-12-07T16:21:35.182 INFO:tasks.workunit.client.0.smithi063.stdout:2/128: read - d0/d21/f2a zero size 2023-12-07T16:21:35.182 INFO:tasks.workunit.client.0.smithi063.stdout:9/153: write d0/d13/f2b [3306579,22922] 0 2023-12-07T16:21:35.182 INFO:tasks.workunit.client.0.smithi063.stdout:9/154: stat d0/d7/fe 0 2023-12-07T16:21:35.182 INFO:tasks.workunit.client.0.smithi063.stdout:9/155: chown d0/l11 0 1 2023-12-07T16:21:35.182 INFO:tasks.workunit.client.0.smithi063.stdout:1/95: mkdir d0/dd/d19 0 2023-12-07T16:21:35.183 INFO:tasks.workunit.client.0.smithi063.stdout:9/156: fsync d0/d13/f2b 0 2023-12-07T16:21:35.183 INFO:tasks.workunit.client.1.smithi152.stdout:5/505: symlink dd/de/d38/d3d/lac 0 2023-12-07T16:21:35.188 INFO:tasks.workunit.client.1.smithi152.stdout:1/450: sync 2023-12-07T16:21:35.188 INFO:tasks.workunit.client.1.smithi152.stdout:4/338: sync 2023-12-07T16:21:35.188 INFO:tasks.workunit.client.1.smithi152.stdout:9/489: sync 2023-12-07T16:21:35.189 INFO:tasks.workunit.client.1.smithi152.stdout:1/451: symlink dc/d28/l93 0 2023-12-07T16:21:35.190 INFO:tasks.workunit.client.0.smithi063.stdout:4/107: creat d1/d3/db/f20 x:0 0 0 2023-12-07T16:21:35.190 INFO:tasks.workunit.client.0.smithi063.stdout:4/108: write d1/d3/f1e [4679393,34017] 0 2023-12-07T16:21:35.190 INFO:tasks.workunit.client.0.smithi063.stdout:4/109: truncate d1/d3/db/d13/f18 430969 0 2023-12-07T16:21:35.190 INFO:tasks.workunit.client.1.smithi152.stdout:4/339: write d0/d3/d6/dc/d39/f41 [401073,38011] 0 2023-12-07T16:21:35.190 INFO:tasks.workunit.client.0.smithi063.stdout:3/122: mknod d7/d21/c22 0 2023-12-07T16:21:35.191 INFO:tasks.workunit.client.1.smithi152.stdout:1/452: creat dc/d14/d18/f94 x:0 0 0 2023-12-07T16:21:35.191 INFO:tasks.workunit.client.1.smithi152.stdout:9/490: truncate d1/d9/db/df/d42/f93 3110646 0 2023-12-07T16:21:35.194 INFO:tasks.workunit.client.0.smithi063.stdout:5/131: mknod d1/d3/de/d1e/d25/c29 0 2023-12-07T16:21:35.194 INFO:tasks.workunit.client.1.smithi152.stdout:1/453: symlink dc/d28/d7d/l95 0 2023-12-07T16:21:35.195 INFO:tasks.workunit.client.0.smithi063.stdout:0/212: mkdir d4/dd/de/d15/d1f/d30/d43 0 2023-12-07T16:21:35.195 INFO:tasks.workunit.client.1.smithi152.stdout:9/491: link d1/d9/d4f/la9 d1/d9/db/df/da6/da2/laa 0 2023-12-07T16:21:35.197 INFO:tasks.workunit.client.0.smithi063.stdout:2/129: link d0/d26/c19 d0/d21/c2b 0 2023-12-07T16:21:35.197 INFO:tasks.workunit.client.0.smithi063.stdout:2/130: fdatasync d0/fe 0 2023-12-07T16:21:35.197 INFO:tasks.workunit.client.1.smithi152.stdout:5/506: dwrite dd/de/d14/d19/f25 [0,4194304] 0 2023-12-07T16:21:35.197 INFO:tasks.workunit.client.1.smithi152.stdout:5/507: chown dd/de/d14/d1f/d28/c36 1073569304 1 2023-12-07T16:21:35.198 INFO:tasks.workunit.client.1.smithi152.stdout:9/492: creat d1/d9/d4f/d83/fab x:0 0 0 2023-12-07T16:21:35.198 INFO:tasks.workunit.client.1.smithi152.stdout:1/454: dread dc/d14/d18/f2c [0,4194304] 0 2023-12-07T16:21:35.198 INFO:tasks.workunit.client.1.smithi152.stdout:1/455: dread - dc/d14/d18/d79/f8d zero size 2023-12-07T16:21:35.198 INFO:tasks.workunit.client.1.smithi152.stdout:1/456: readlink dc/d14/d18/d45/l56 0 2023-12-07T16:21:35.198 INFO:tasks.workunit.client.0.smithi063.stdout:1/96: link d0/dd/d10/d13/lf d0/l1a 0 2023-12-07T16:21:35.203 INFO:tasks.workunit.client.1.smithi152.stdout:5/508: stat dd/de/d14/d1f/c68 0 2023-12-07T16:21:35.203 INFO:tasks.workunit.client.1.smithi152.stdout:5/509: stat dd/de/d17/d54/d7c/la9 0 2023-12-07T16:21:35.204 INFO:tasks.workunit.client.1.smithi152.stdout:5/510: readlink dd/de/d14/d19/d1a/d1b/l8a 0 2023-12-07T16:21:35.205 INFO:tasks.workunit.client.0.smithi063.stdout:0/213: dread d4/dd/f14 [0,4194304] 0 2023-12-07T16:21:35.205 INFO:tasks.workunit.client.1.smithi152.stdout:9/493: write d1/d17/d3c/d4a/d7e/f9f [206610,98883] 0 2023-12-07T16:21:35.206 INFO:tasks.workunit.client.0.smithi063.stdout:9/157: rename d0/d21/c26 to d0/d7/c2f 0 2023-12-07T16:21:35.209 INFO:tasks.workunit.client.0.smithi063.stdout:4/110: chown d1/d3/l1a 8162306 1 2023-12-07T16:21:35.209 INFO:tasks.workunit.client.0.smithi063.stdout:7/119: getdents d2/d21 0 2023-12-07T16:21:35.210 INFO:tasks.workunit.client.1.smithi152.stdout:5/511: creat dd/de/d14/d67/fad x:0 0 0 2023-12-07T16:21:35.211 INFO:tasks.workunit.client.1.smithi152.stdout:5/512: write dd/de/d38/f79 [19329,48550] 0 2023-12-07T16:21:35.211 INFO:tasks.workunit.client.0.smithi063.stdout:3/123: symlink d7/d9/d1b/l23 0 2023-12-07T16:21:35.211 INFO:tasks.workunit.client.1.smithi152.stdout:9/494: rmdir d1/d9/db/df/da6/da2 39 2023-12-07T16:21:35.213 INFO:tasks.workunit.client.1.smithi152.stdout:9/495: rmdir d1/d9/d2d/d72/d80 39 2023-12-07T16:21:35.215 INFO:tasks.workunit.client.0.smithi063.stdout:7/120: write d2/de/f15 [620462,30307] 0 2023-12-07T16:21:35.215 INFO:tasks.workunit.client.0.smithi063.stdout:7/121: chown d2/l2b 13 1 2023-12-07T16:21:35.215 INFO:tasks.workunit.client.1.smithi152.stdout:5/513: read dd/de/d38/d3d/f46 [226047,117419] 0 2023-12-07T16:21:35.217 INFO:tasks.workunit.client.1.smithi152.stdout:5/514: mkdir dd/de/d38/d3d/d6d/dae 0 2023-12-07T16:21:35.218 INFO:tasks.workunit.client.1.smithi152.stdout:5/515: link dd/de/d8f/faa dd/de/d14/d19/d7a/da6/faf 0 2023-12-07T16:21:35.220 INFO:tasks.workunit.client.0.smithi063.stdout:9/158: creat d0/f30 x:0 0 0 2023-12-07T16:21:35.223 INFO:tasks.workunit.client.0.smithi063.stdout:6/192: sync 2023-12-07T16:21:35.223 INFO:tasks.workunit.client.0.smithi063.stdout:6/193: fsync d0/d17/d1a/f1c 0 2023-12-07T16:21:35.224 INFO:tasks.workunit.client.1.smithi152.stdout:4/340: dwrite d0/d3/d6/d36/f44 [4194304,4194304] 0 2023-12-07T16:21:35.227 INFO:tasks.workunit.client.1.smithi152.stdout:4/341: rename d0/d3/d6/dc/dd/d34 to d0/d3/d6/d2b/d63 0 2023-12-07T16:21:35.228 INFO:tasks.workunit.client.0.smithi063.stdout:4/111: rmdir d1/d3/db/d13 39 2023-12-07T16:21:35.229 INFO:tasks.workunit.client.0.smithi063.stdout:7/122: creat d2/de/d2a/f2f x:0 0 0 2023-12-07T16:21:35.231 INFO:tasks.workunit.client.0.smithi063.stdout:1/97: dwrite d0/f4 [0,4194304] 0 2023-12-07T16:21:35.232 INFO:tasks.workunit.client.0.smithi063.stdout:1/98: dread d0/f1 [4194304,4194304] 0 2023-12-07T16:21:35.232 INFO:tasks.workunit.client.0.smithi063.stdout:5/132: rename d1/d3/de/d1e/f1b to d1/f2a 0 2023-12-07T16:21:35.234 INFO:tasks.workunit.client.0.smithi063.stdout:5/133: write d1/d3/de/d1e/f1d [412898,6582] 0 2023-12-07T16:21:35.234 INFO:tasks.workunit.client.0.smithi063.stdout:5/134: readlink d1/d3/l23 0 2023-12-07T16:21:35.234 INFO:tasks.workunit.client.0.smithi063.stdout:5/135: write d1/d3/de/f16 [1684492,76961] 0 2023-12-07T16:21:35.234 INFO:tasks.workunit.client.0.smithi063.stdout:5/136: truncate d1/f7 8437200 0 2023-12-07T16:21:35.234 INFO:tasks.workunit.client.0.smithi063.stdout:9/159: truncate d0/d7/fe 7168847 0 2023-12-07T16:21:35.234 INFO:tasks.workunit.client.1.smithi152.stdout:1/457: dwrite f4 [0,4194304] 0 2023-12-07T16:21:35.236 INFO:tasks.workunit.client.0.smithi063.stdout:6/194: rename d0/d1e/d20/f2f to d0/d1e/d20/f47 0 2023-12-07T16:21:35.237 INFO:tasks.workunit.client.0.smithi063.stdout:4/112: mknod d1/d3/db/d16/c21 0 2023-12-07T16:21:35.239 INFO:tasks.workunit.client.0.smithi063.stdout:7/123: creat d2/d21/f30 x:0 0 0 2023-12-07T16:21:35.240 INFO:tasks.workunit.client.0.smithi063.stdout:1/99: rmdir d0 39 2023-12-07T16:21:35.242 INFO:tasks.workunit.client.0.smithi063.stdout:2/131: rename d0/d26/c19 to d0/d21/c2c 0 2023-12-07T16:21:35.242 INFO:tasks.workunit.client.0.smithi063.stdout:8/247: sync 2023-12-07T16:21:35.242 INFO:tasks.workunit.client.0.smithi063.stdout:8/248: write d7/f4a [5838,25120] 0 2023-12-07T16:21:35.244 INFO:tasks.workunit.client.0.smithi063.stdout:2/132: write d0/d26/d11/f1b [5511577,63945] 0 2023-12-07T16:21:35.244 INFO:tasks.workunit.client.0.smithi063.stdout:2/133: fsync d0/fe 0 2023-12-07T16:21:35.245 INFO:tasks.workunit.client.0.smithi063.stdout:9/160: creat d0/f31 x:0 0 0 2023-12-07T16:21:35.247 INFO:tasks.workunit.client.0.smithi063.stdout:3/124: dwrite d7/d9/dd/f19 [0,4194304] 0 2023-12-07T16:21:35.247 INFO:tasks.workunit.client.0.smithi063.stdout:3/125: fdatasync d7/fe 0 2023-12-07T16:21:35.247 INFO:tasks.workunit.client.0.smithi063.stdout:6/195: symlink d0/d1e/l48 0 2023-12-07T16:21:35.248 INFO:tasks.workunit.client.0.smithi063.stdout:4/113: link d1/d3/db/d16/c1f d1/d3/db/d13/c22 0 2023-12-07T16:21:35.249 INFO:tasks.workunit.client.0.smithi063.stdout:1/100: mkdir d0/dd/d10/d1b 0 2023-12-07T16:21:35.249 INFO:tasks.workunit.client.0.smithi063.stdout:1/101: stat d0/dd/d10 0 2023-12-07T16:21:35.252 INFO:tasks.workunit.client.0.smithi063.stdout:7/124: rename d2/f3 to d2/de/d2a/f31 0 2023-12-07T16:21:35.252 INFO:tasks.workunit.client.0.smithi063.stdout:0/214: rmdir d4 39 2023-12-07T16:21:35.255 INFO:tasks.workunit.client.0.smithi063.stdout:3/126: mknod d7/c24 0 2023-12-07T16:21:35.255 INFO:tasks.workunit.client.0.smithi063.stdout:3/127: write d7/d9/dd/f1f [286367,37657] 0 2023-12-07T16:21:35.255 INFO:tasks.workunit.client.0.smithi063.stdout:3/128: stat d7/d9/d1b/l23 0 2023-12-07T16:21:35.255 INFO:tasks.workunit.client.0.smithi063.stdout:3/129: fsync f5 0 2023-12-07T16:21:35.256 INFO:tasks.workunit.client.0.smithi063.stdout:2/134: dread d0/d26/d11/f1a [0,4194304] 0 2023-12-07T16:21:35.256 INFO:tasks.workunit.client.0.smithi063.stdout:6/196: symlink d0/d1e/d1d/d1f/l49 0 2023-12-07T16:21:35.258 INFO:tasks.workunit.client.0.smithi063.stdout:4/114: stat d1/d3/f5 0 2023-12-07T16:21:35.259 INFO:tasks.workunit.client.0.smithi063.stdout:0/215: rmdir d4/dd/de/d15/d1f 39 2023-12-07T16:21:35.260 INFO:tasks.workunit.client.0.smithi063.stdout:4/115: creat d1/d3/db/f23 x:0 0 0 2023-12-07T16:21:35.261 INFO:tasks.workunit.client.0.smithi063.stdout:0/216: getdents d4/d25 0 2023-12-07T16:21:35.261 INFO:tasks.workunit.client.0.smithi063.stdout:0/217: fdatasync d4/dd/de/d15/d1f/f3a 0 2023-12-07T16:21:35.261 INFO:tasks.workunit.client.0.smithi063.stdout:0/218: dread - d4/dd/de/d15/d3c/f34 zero size 2023-12-07T16:21:35.262 INFO:tasks.workunit.client.1.smithi152.stdout:5/516: dwrite dd/f76 [0,4194304] 0 2023-12-07T16:21:35.269 INFO:tasks.workunit.client.0.smithi063.stdout:4/116: truncate d1/d3/f8 921538 0 2023-12-07T16:21:35.271 INFO:tasks.workunit.client.0.smithi063.stdout:1/102: dread d0/f7 [0,4194304] 0 2023-12-07T16:21:35.273 INFO:tasks.workunit.client.0.smithi063.stdout:1/103: creat d0/dd/f1c x:0 0 0 2023-12-07T16:21:35.273 INFO:tasks.workunit.client.0.smithi063.stdout:1/104: readlink d0/dd/l18 0 2023-12-07T16:21:35.273 INFO:tasks.workunit.client.0.smithi063.stdout:4/117: write d1/d3/db/d13/f17 [3950150,91672] 0 2023-12-07T16:21:35.273 INFO:tasks.workunit.client.0.smithi063.stdout:4/118: write d1/d3/db/f20 [16831,88652] 0 2023-12-07T16:21:35.274 INFO:tasks.workunit.client.1.smithi152.stdout:9/496: dwrite d1/d9/db/df/f1f [0,4194304] 0 2023-12-07T16:21:35.274 INFO:tasks.workunit.client.0.smithi063.stdout:1/105: mknod d0/dd/d10/d1b/c1d 0 2023-12-07T16:21:35.274 INFO:tasks.workunit.client.1.smithi152.stdout:5/517: getdents dd/de/d17/d54 0 2023-12-07T16:21:35.274 INFO:tasks.workunit.client.1.smithi152.stdout:5/518: write dd/f5a [852623,95869] 0 2023-12-07T16:21:35.276 INFO:tasks.workunit.client.0.smithi063.stdout:4/119: mknod d1/d3/db/d13/c24 0 2023-12-07T16:21:35.277 INFO:tasks.workunit.client.1.smithi152.stdout:9/497: unlink d1/d17/d58/f61 0 2023-12-07T16:21:35.277 INFO:tasks.workunit.client.1.smithi152.stdout:9/498: write d1/d17/d3c/d4a/d48/f81 [831126,38041] 0 2023-12-07T16:21:35.278 INFO:tasks.workunit.client.1.smithi152.stdout:5/519: mkdir dd/de/d17/d54/db0 0 2023-12-07T16:21:35.279 INFO:tasks.workunit.client.1.smithi152.stdout:9/499: mknod d1/d9/db/df/cac 0 2023-12-07T16:21:35.279 INFO:tasks.workunit.client.1.smithi152.stdout:9/500: chown d1/d17/d58/f7f 1863349294 1 2023-12-07T16:21:35.282 INFO:tasks.workunit.client.0.smithi063.stdout:2/135: dread d0/d1e/f29 [0,4194304] 0 2023-12-07T16:21:35.282 INFO:tasks.workunit.client.0.smithi063.stdout:2/136: fsync d0/d26/d11/f23 0 2023-12-07T16:21:35.282 INFO:tasks.workunit.client.0.smithi063.stdout:2/137: readlink d0/d26/d11/l27 0 2023-12-07T16:21:35.284 INFO:tasks.workunit.client.0.smithi063.stdout:0/219: write d4/dd/de/f13 [3530906,92345] 0 2023-12-07T16:21:35.286 INFO:tasks.workunit.client.0.smithi063.stdout:0/220: creat d4/dd/f44 x:0 0 0 2023-12-07T16:21:35.287 INFO:tasks.workunit.client.0.smithi063.stdout:0/221: creat d4/d25/f45 x:0 0 0 2023-12-07T16:21:35.288 INFO:tasks.workunit.client.1.smithi152.stdout:1/458: dwrite dc/d14/d18/d2d/d4a/f71 [0,4194304] 0 2023-12-07T16:21:35.288 INFO:tasks.workunit.client.1.smithi152.stdout:1/459: truncate dc/de/f92 274064 0 2023-12-07T16:21:35.288 INFO:tasks.workunit.client.1.smithi152.stdout:1/460: readlink dc/d28/d7d/l95 0 2023-12-07T16:21:35.289 INFO:tasks.workunit.client.0.smithi063.stdout:3/130: dwrite d7/d9/f18 [0,4194304] 0 2023-12-07T16:21:35.290 INFO:tasks.workunit.client.0.smithi063.stdout:3/131: chown d7/d9/l11 3797602 1 2023-12-07T16:21:35.290 INFO:tasks.workunit.client.0.smithi063.stdout:8/249: dwrite d7/d38/f3b [0,4194304] 0 2023-12-07T16:21:35.290 INFO:tasks.workunit.client.0.smithi063.stdout:6/197: dwrite d0/d1e/f24 [0,4194304] 0 2023-12-07T16:21:35.290 INFO:tasks.workunit.client.1.smithi152.stdout:4/342: dwrite d0/d3/d6/dc/dd/f33 [0,4194304] 0 2023-12-07T16:21:35.290 INFO:tasks.workunit.client.1.smithi152.stdout:4/343: getdents d0/d3/d6/d5c 0 2023-12-07T16:21:35.292 INFO:tasks.workunit.client.0.smithi063.stdout:5/137: getdents d1/d3/de/d1e 0 2023-12-07T16:21:35.292 INFO:tasks.workunit.client.0.smithi063.stdout:5/138: stat d1/d3/de/d1e/f1d 0 2023-12-07T16:21:35.293 INFO:tasks.workunit.client.1.smithi152.stdout:1/461: getdents dc/d14/d18/d64 0 2023-12-07T16:21:35.296 INFO:tasks.workunit.client.1.smithi152.stdout:5/520: dread dd/de/d14/d19/f25 [0,4194304] 0 2023-12-07T16:21:35.296 INFO:tasks.workunit.client.1.smithi152.stdout:5/521: chown dd/de/d8f/faa 0 1 2023-12-07T16:21:35.296 INFO:tasks.workunit.client.1.smithi152.stdout:5/522: stat dd/l59 0 2023-12-07T16:21:35.297 INFO:tasks.workunit.client.1.smithi152.stdout:1/462: write dc/f40 [734649,73514] 0 2023-12-07T16:21:35.299 INFO:tasks.workunit.client.0.smithi063.stdout:8/250: link d7/d14/d15/d2b/c2e d7/d14/d15/d48/c53 0 2023-12-07T16:21:35.299 INFO:tasks.workunit.client.0.smithi063.stdout:8/251: write d7/d14/d1a/f29 [1112771,29065] 0 2023-12-07T16:21:35.301 INFO:tasks.workunit.client.1.smithi152.stdout:5/523: creat dd/de/d17/d54/fb1 x:0 0 0 2023-12-07T16:21:35.304 INFO:tasks.workunit.client.1.smithi152.stdout:1/463: creat dc/d14/d18/d64/f96 x:0 0 0 2023-12-07T16:21:35.304 INFO:tasks.workunit.client.1.smithi152.stdout:1/464: read - dc/d14/d18/d79/d86/f8e zero size 2023-12-07T16:21:35.304 INFO:tasks.workunit.client.1.smithi152.stdout:1/465: chown dc/d28/f38 99489 1 2023-12-07T16:21:35.305 INFO:tasks.workunit.client.0.smithi063.stdout:0/222: dread d4/d25/f2f [0,4194304] 0 2023-12-07T16:21:35.305 INFO:tasks.workunit.client.0.smithi063.stdout:7/125: dwrite d2/d21/f2d [0,4194304] 0 2023-12-07T16:21:35.308 INFO:tasks.workunit.client.0.smithi063.stdout:8/252: mkdir d7/d14/d1a/d54 0 2023-12-07T16:21:35.312 INFO:tasks.workunit.client.0.smithi063.stdout:2/138: dread d0/d26/d11/f23 [0,4194304] 0 2023-12-07T16:21:35.314 INFO:tasks.workunit.client.1.smithi152.stdout:5/524: dread dd/f76 [0,4194304] 0 2023-12-07T16:21:35.316 INFO:tasks.workunit.client.1.smithi152.stdout:5/525: mknod dd/de/d38/d3d/cb2 0 2023-12-07T16:21:35.321 INFO:tasks.workunit.client.1.smithi152.stdout:1/466: dread dc/d14/d18/d2d/d4a/d52/f73 [0,4194304] 0 2023-12-07T16:21:35.323 INFO:tasks.workunit.client.1.smithi152.stdout:1/467: write dc/d14/d18/f2c [918565,5980] 0 2023-12-07T16:21:35.324 INFO:tasks.workunit.client.1.smithi152.stdout:4/344: dwrite d0/d17/f53 [0,4194304] 0 2023-12-07T16:21:35.326 INFO:tasks.workunit.client.1.smithi152.stdout:1/468: creat dc/d14/d18/d2d/d48/f97 x:0 0 0 2023-12-07T16:21:35.328 INFO:tasks.workunit.client.1.smithi152.stdout:4/345: mknod d0/d3/d6/d2b/c64 0 2023-12-07T16:21:35.328 INFO:tasks.workunit.client.1.smithi152.stdout:4/346: chown d0/d3/d6/dc/dd/f40 1484966219 1 2023-12-07T16:21:35.329 INFO:tasks.workunit.client.1.smithi152.stdout:4/347: write d0/d3/d6/dc/d3a/f58 [1108545,91286] 0 2023-12-07T16:21:35.329 INFO:tasks.workunit.client.0.smithi063.stdout:5/139: dwrite d1/d3/de/f16 [0,4194304] 0 2023-12-07T16:21:35.329 INFO:tasks.workunit.client.0.smithi063.stdout:5/140: truncate d1/d3/f17 4444 0 2023-12-07T16:21:35.330 INFO:tasks.workunit.client.0.smithi063.stdout:6/198: dwrite d0/d1e/d20/f47 [0,4194304] 0 2023-12-07T16:21:35.330 INFO:tasks.workunit.client.1.smithi152.stdout:1/469: link dc/d14/d18/c34 dc/d28/d7d/c98 0 2023-12-07T16:21:35.330 INFO:tasks.workunit.client.1.smithi152.stdout:1/470: fdatasync dc/fd 0 2023-12-07T16:21:35.334 INFO:tasks.workunit.client.1.smithi152.stdout:4/348: write d0/d17/f53 [1806212,45692] 0 2023-12-07T16:21:35.335 INFO:tasks.workunit.client.1.smithi152.stdout:4/349: rmdir d0/d3/d6/d2b/d56/d61 0 2023-12-07T16:21:35.343 INFO:tasks.workunit.client.0.smithi063.stdout:8/253: dwrite d7/d14/d1a/f31 [0,4194304] 0 2023-12-07T16:21:35.347 INFO:tasks.workunit.client.1.smithi152.stdout:5/526: dwrite dd/de/d14/d19/d1a/d1b/f48 [4194304,4194304] 0 2023-12-07T16:21:35.347 INFO:tasks.workunit.client.1.smithi152.stdout:5/527: stat dd/de/d8f/c9a 0 2023-12-07T16:21:35.350 INFO:tasks.workunit.client.1.smithi152.stdout:5/528: unlink dd/de/d14/d1f/c6a 0 2023-12-07T16:21:35.352 INFO:tasks.workunit.client.1.smithi152.stdout:5/529: creat dd/de/d14/d19/d1a/fb3 x:0 0 0 2023-12-07T16:21:35.352 INFO:tasks.workunit.client.1.smithi152.stdout:5/530: truncate dd/de/d14/d19/d1a/d1b/f77 9369667 0 2023-12-07T16:21:35.353 INFO:tasks.workunit.client.1.smithi152.stdout:1/471: dwrite dc/d14/d18/d2d/d48/f97 [0,4194304] 0 2023-12-07T16:21:35.355 INFO:tasks.workunit.client.1.smithi152.stdout:1/472: truncate dc/f40 920783 0 2023-12-07T16:21:35.356 INFO:tasks.workunit.client.0.smithi063.stdout:5/141: dwrite d1/d3/de/d1e/f1d [0,4194304] 0 2023-12-07T16:21:35.356 INFO:tasks.workunit.client.0.smithi063.stdout:5/142: dread - d1/f18 zero size 2023-12-07T16:21:35.357 INFO:tasks.workunit.client.1.smithi152.stdout:1/473: creat dc/d28/d4e/f99 x:0 0 0 2023-12-07T16:21:35.359 INFO:tasks.workunit.client.1.smithi152.stdout:1/474: symlink dc/d14/l9a 0 2023-12-07T16:21:35.359 INFO:tasks.workunit.client.1.smithi152.stdout:1/475: chown dc/d14/d18/d2d/l3a 32134 1 2023-12-07T16:21:35.359 INFO:tasks.workunit.client.1.smithi152.stdout:1/476: readlink dc/d28/l93 0 2023-12-07T16:21:35.360 INFO:tasks.workunit.client.1.smithi152.stdout:1/477: symlink dc/d14/d18/d2d/d91/l9b 0 2023-12-07T16:21:35.362 INFO:tasks.workunit.client.1.smithi152.stdout:1/478: mkdir dc/d14/d18/d2d/d9c 0 2023-12-07T16:21:35.364 INFO:tasks.workunit.client.0.smithi063.stdout:5/143: dread d1/d3/de/f14 [0,4194304] 0 2023-12-07T16:21:35.364 INFO:tasks.workunit.client.0.smithi063.stdout:5/144: write d1/f2a [768861,91060] 0 2023-12-07T16:21:35.383 INFO:tasks.workunit.client.1.smithi152.stdout:1/479: dwrite dc/d14/d18/d2d/f33 [0,4194304] 0 2023-12-07T16:21:35.383 INFO:tasks.workunit.client.1.smithi152.stdout:5/531: dwrite dd/de/d14/d1f/d28/f2d [0,4194304] 0 2023-12-07T16:21:35.385 INFO:tasks.workunit.client.1.smithi152.stdout:1/480: rename dc/f3d to dc/d14/d18/d2d/d4a/d52/f9d 0 2023-12-07T16:21:35.385 INFO:tasks.workunit.client.1.smithi152.stdout:1/481: readlink dc/de/l25 0 2023-12-07T16:21:35.385 INFO:tasks.workunit.client.1.smithi152.stdout:1/482: dread - dc/d14/d18/d64/f96 zero size 2023-12-07T16:21:35.386 INFO:tasks.workunit.client.1.smithi152.stdout:1/483: write dc/d14/d18/d2d/f67 [755775,78203] 0 2023-12-07T16:21:35.387 INFO:tasks.workunit.client.1.smithi152.stdout:5/532: mknod dd/de/d38/d3d/cb4 0 2023-12-07T16:21:35.388 INFO:tasks.workunit.client.1.smithi152.stdout:1/484: creat dc/d14/f9e x:0 0 0 2023-12-07T16:21:35.388 INFO:tasks.workunit.client.1.smithi152.stdout:5/533: mknod dd/cb5 0 2023-12-07T16:21:35.389 INFO:tasks.workunit.client.1.smithi152.stdout:1/485: write dc/d14/d18/f2c [861456,129567] 0 2023-12-07T16:21:35.389 INFO:tasks.workunit.client.1.smithi152.stdout:5/534: getdents dd/de/d14 0 2023-12-07T16:21:35.389 INFO:tasks.workunit.client.1.smithi152.stdout:5/535: readlink dd/de/d38/d3d/l9f 0 2023-12-07T16:21:35.392 INFO:tasks.workunit.client.1.smithi152.stdout:1/486: unlink dc/d14/d18/d64/f96 0 2023-12-07T16:21:35.393 INFO:tasks.workunit.client.1.smithi152.stdout:1/487: write dc/f23 [69957,111842] 0 2023-12-07T16:21:35.396 INFO:tasks.workunit.client.1.smithi152.stdout:1/488: symlink dc/l9f 0 2023-12-07T16:21:35.397 INFO:tasks.workunit.client.1.smithi152.stdout:1/489: rmdir dc/d28/d4e 39 2023-12-07T16:21:35.406 INFO:tasks.workunit.client.1.smithi152.stdout:5/536: dwrite dd/de/d14/d19/d7a/da6/faf [0,4194304] 0 2023-12-07T16:21:35.411 INFO:tasks.workunit.client.0.smithi063.stdout:4/120: rmdir d1 39 2023-12-07T16:21:35.411 INFO:tasks.workunit.client.1.smithi152.stdout:5/537: creat dd/de/d17/d54/db0/fb6 x:0 0 0 2023-12-07T16:21:35.411 INFO:tasks.workunit.client.1.smithi152.stdout:5/538: truncate dd/de/d14/d19/d1a/d1b/f44 1018655 0 2023-12-07T16:21:35.412 INFO:tasks.workunit.client.0.smithi063.stdout:0/223: mknod d4/dd/d26/c46 0 2023-12-07T16:21:35.413 INFO:tasks.workunit.client.0.smithi063.stdout:3/132: dread d7/fa [0,4194304] 0 2023-12-07T16:21:35.414 INFO:tasks.workunit.client.0.smithi063.stdout:2/139: mknod d0/c2d 0 2023-12-07T16:21:35.418 INFO:tasks.workunit.client.0.smithi063.stdout:6/199: mkdir d0/d1e/d20/d4a 0 2023-12-07T16:21:35.418 INFO:tasks.workunit.client.0.smithi063.stdout:6/200: chown d0/f19 1093055 1 2023-12-07T16:21:35.418 INFO:tasks.workunit.client.1.smithi152.stdout:5/539: rmdir dd/de/d17/d54 39 2023-12-07T16:21:35.419 INFO:tasks.workunit.client.1.smithi152.stdout:5/540: mknod dd/de/d8f/cb7 0 2023-12-07T16:21:35.419 INFO:tasks.workunit.client.1.smithi152.stdout:5/541: write dd/de/d38/f79 [1682676,30511] 0 2023-12-07T16:21:35.420 INFO:tasks.workunit.client.1.smithi152.stdout:1/490: dwrite dc/d14/d18/d2d/f33 [0,4194304] 0 2023-12-07T16:21:35.420 INFO:tasks.workunit.client.1.smithi152.stdout:1/491: stat dc/f40 0 2023-12-07T16:21:35.420 INFO:tasks.workunit.client.0.smithi063.stdout:8/254: symlink d7/d14/d1a/d54/l55 0 2023-12-07T16:21:35.421 INFO:tasks.workunit.client.0.smithi063.stdout:8/255: chown d7/f4a 108084179 1 2023-12-07T16:21:35.423 INFO:tasks.workunit.client.1.smithi152.stdout:3/410: sync 2023-12-07T16:21:35.423 INFO:tasks.workunit.client.1.smithi152.stdout:6/391: sync 2023-12-07T16:21:35.426 INFO:tasks.workunit.client.1.smithi152.stdout:5/542: dread dd/de/d14/d19/f64 [0,4194304] 0 2023-12-07T16:21:35.426 INFO:tasks.workunit.client.1.smithi152.stdout:5/543: stat dd/de/f31 0 2023-12-07T16:21:35.426 INFO:tasks.workunit.client.0.smithi063.stdout:0/224: dread d4/dd/de/d15/d1f/d22/f23 [0,4194304] 0 2023-12-07T16:21:35.427 INFO:tasks.workunit.client.1.smithi152.stdout:3/411: mkdir d7/dc/d3e/d6b/d80 0 2023-12-07T16:21:35.427 INFO:tasks.workunit.client.1.smithi152.stdout:5/544: creat dd/de/d14/fb8 x:0 0 0 2023-12-07T16:21:35.428 INFO:tasks.workunit.client.0.smithi063.stdout:3/133: creat d7/d21/f25 x:0 0 0 2023-12-07T16:21:35.428 INFO:tasks.workunit.client.0.smithi063.stdout:3/134: truncate d7/fa 663906 0 2023-12-07T16:21:35.428 INFO:tasks.workunit.client.0.smithi063.stdout:3/135: readlink d7/d9/dd/l1a 0 2023-12-07T16:21:35.430 INFO:tasks.workunit.client.0.smithi063.stdout:2/140: symlink d0/d26/d11/l2e 0 2023-12-07T16:21:35.432 INFO:tasks.workunit.client.0.smithi063.stdout:6/201: mkdir d0/d1e/d1d/d1f/d4b 0 2023-12-07T16:21:35.432 INFO:tasks.workunit.client.1.smithi152.stdout:5/545: rename dd/de/d14/d19/d1a/d1b/f77 to dd/de/d17/d54/d7c/fb9 0 2023-12-07T16:21:35.435 INFO:tasks.workunit.client.0.smithi063.stdout:4/121: mknod d1/d3/c25 0 2023-12-07T16:21:35.435 INFO:tasks.workunit.client.0.smithi063.stdout:4/122: stat d1/d3/db/d13/f18 0 2023-12-07T16:21:35.436 INFO:tasks.workunit.client.0.smithi063.stdout:2/141: symlink d0/l2f 0 2023-12-07T16:21:35.437 INFO:tasks.workunit.client.0.smithi063.stdout:6/202: creat d0/d17/d1a/f4c x:0 0 0 2023-12-07T16:21:35.439 INFO:tasks.workunit.client.0.smithi063.stdout:4/123: mknod d1/d3/db/d16/c26 0 2023-12-07T16:21:35.441 INFO:tasks.workunit.client.1.smithi152.stdout:1/492: dread dc/d14/f2b [0,4194304] 0 2023-12-07T16:21:35.441 INFO:tasks.workunit.client.1.smithi152.stdout:1/493: write dc/d14/f2b [6122892,60508] 0 2023-12-07T16:21:35.442 INFO:tasks.workunit.client.0.smithi063.stdout:4/124: write d1/d3/f5 [2514993,32860] 0 2023-12-07T16:21:35.442 INFO:tasks.workunit.client.0.smithi063.stdout:6/203: mkdir d0/d17/d1a/d4d 0 2023-12-07T16:21:35.442 INFO:tasks.workunit.client.0.smithi063.stdout:6/204: fdatasync d0/d17/d1a/f1c 0 2023-12-07T16:21:35.443 INFO:tasks.workunit.client.1.smithi152.stdout:1/494: link dc/d14/d18/f94 dc/d14/d18/d79/d86/fa0 0 2023-12-07T16:21:35.444 INFO:tasks.workunit.client.1.smithi152.stdout:1/495: creat dc/d14/d18/d79/fa1 x:0 0 0 2023-12-07T16:21:35.446 INFO:tasks.workunit.client.0.smithi063.stdout:4/125: rmdir d1/d3 39 2023-12-07T16:21:35.446 INFO:tasks.workunit.client.1.smithi152.stdout:1/496: creat dc/d14/d18/d64/fa2 x:0 0 0 2023-12-07T16:21:35.449 INFO:tasks.workunit.client.1.smithi152.stdout:1/497: rename dc/de to dc/d14/d18/d2d/d48/da3 0 2023-12-07T16:21:35.449 INFO:tasks.workunit.client.0.smithi063.stdout:6/205: rename d0/d1e/d1d/d1f/l49 to d0/d1e/d29/l4e 0 2023-12-07T16:21:35.449 INFO:tasks.workunit.client.0.smithi063.stdout:6/206: write d0/d17/d1a/f4c [544961,26333] 0 2023-12-07T16:21:35.451 INFO:tasks.workunit.client.0.smithi063.stdout:4/126: write d1/d3/db/d13/f17 [3807964,20258] 0 2023-12-07T16:21:35.452 INFO:tasks.workunit.client.1.smithi152.stdout:1/498: dread dc/d14/f84 [0,4194304] 0 2023-12-07T16:21:35.452 INFO:tasks.workunit.client.1.smithi152.stdout:1/499: fsync dc/d14/d18/d2d/d48/da3/f22 0 2023-12-07T16:21:35.452 INFO:tasks.workunit.client.1.smithi152.stdout:1/500: chown dc/d14/d18/d45/f47 500812148 1 2023-12-07T16:21:35.452 INFO:tasks.workunit.client.1.smithi152.stdout:1/501: write dc/d14/d18/d79/d86/f8e [47386,13702] 0 2023-12-07T16:21:35.452 INFO:tasks.workunit.client.1.smithi152.stdout:1/502: fdatasync dc/d14/d18/d64/f8f 0 2023-12-07T16:21:35.452 INFO:tasks.workunit.client.1.smithi152.stdout:1/503: chown dc/d14/d18/d2d/d48/da3/f2e 1 1 2023-12-07T16:21:35.452 INFO:tasks.workunit.client.1.smithi152.stdout:3/412: dread d7/d10/d1a/d25/d3f/f46 [0,4194304] 0 2023-12-07T16:21:35.455 INFO:tasks.workunit.client.1.smithi152.stdout:3/413: mkdir d7/dc/d3e/d62/d6d/d81 0 2023-12-07T16:21:35.455 INFO:tasks.workunit.client.1.smithi152.stdout:1/504: dread dc/d14/d68/f6b [0,4194304] 0 2023-12-07T16:21:35.456 INFO:tasks.workunit.client.0.smithi063.stdout:5/145: truncate d1/f13 1718210 0 2023-12-07T16:21:35.458 INFO:tasks.workunit.client.0.smithi063.stdout:8/256: dwrite d7/fd [4194304,4194304] 0 2023-12-07T16:21:35.458 INFO:tasks.workunit.client.0.smithi063.stdout:8/257: fdatasync d7/d14/d1a/f33 0 2023-12-07T16:21:35.458 INFO:tasks.workunit.client.0.smithi063.stdout:8/258: dread - d7/d14/d1a/f50 zero size 2023-12-07T16:21:35.458 INFO:tasks.workunit.client.0.smithi063.stdout:4/127: read d1/d3/db/d13/f17 [3427367,63036] 0 2023-12-07T16:21:35.458 INFO:tasks.workunit.client.0.smithi063.stdout:4/128: stat d1/d3/db/f20 0 2023-12-07T16:21:35.458 INFO:tasks.workunit.client.0.smithi063.stdout:4/129: rename d1/d3 to d1/d3/db/d27 22 2023-12-07T16:21:35.461 INFO:tasks.workunit.client.0.smithi063.stdout:5/146: dread d1/f2a [0,4194304] 0 2023-12-07T16:21:35.461 INFO:tasks.workunit.client.0.smithi063.stdout:5/147: write d1/d3/de/f28 [471359,60648] 0 2023-12-07T16:21:35.461 INFO:tasks.workunit.client.0.smithi063.stdout:5/148: write d1/d3/de/f28 [887235,108875] 0 2023-12-07T16:21:35.462 INFO:tasks.workunit.client.0.smithi063.stdout:8/259: unlink d7/d14/d15/d2b/f3c 0 2023-12-07T16:21:35.463 INFO:tasks.workunit.client.0.smithi063.stdout:5/149: mkdir d1/d3/d2b 0 2023-12-07T16:21:35.464 INFO:tasks.workunit.client.0.smithi063.stdout:6/207: dread d0/d1e/d29/f36 [0,4194304] 0 2023-12-07T16:21:35.464 INFO:tasks.workunit.client.0.smithi063.stdout:6/208: truncate d0/f2c 719419 0 2023-12-07T16:21:35.464 INFO:tasks.workunit.client.0.smithi063.stdout:6/209: readlink d0/d1e/d1d/d1f/l44 0 2023-12-07T16:21:35.464 INFO:tasks.workunit.client.0.smithi063.stdout:4/130: dread d1/d3/db/d13/f18 [0,4194304] 0 2023-12-07T16:21:35.465 INFO:tasks.workunit.client.0.smithi063.stdout:4/131: creat d1/f28 x:0 0 0 2023-12-07T16:21:35.466 INFO:tasks.workunit.client.0.smithi063.stdout:4/132: fsync d1/d3/db/d13/f1c 0 2023-12-07T16:21:35.467 INFO:tasks.workunit.client.0.smithi063.stdout:5/150: write d1/d3/de/f14 [2037521,29664] 0 2023-12-07T16:21:35.469 INFO:tasks.workunit.client.1.smithi152.stdout:5/546: dwrite dd/de/d38/f79 [0,4194304] 0 2023-12-07T16:21:35.470 INFO:tasks.workunit.client.0.smithi063.stdout:8/260: write d7/d14/d1a/f29 [824772,58502] 0 2023-12-07T16:21:35.470 INFO:tasks.workunit.client.0.smithi063.stdout:6/210: dread d0/f1b [0,4194304] 0 2023-12-07T16:21:35.471 INFO:tasks.workunit.client.0.smithi063.stdout:5/151: read d1/d3/de/f10 [2380413,4452] 0 2023-12-07T16:21:35.472 INFO:tasks.workunit.client.1.smithi152.stdout:5/547: truncate dd/de/d14/d1f/f20 5234200 0 2023-12-07T16:21:35.473 INFO:tasks.workunit.client.0.smithi063.stdout:8/261: creat d7/d14/d1a/f56 x:0 0 0 2023-12-07T16:21:35.473 INFO:tasks.workunit.client.0.smithi063.stdout:8/262: stat d7/fd 0 2023-12-07T16:21:35.473 INFO:tasks.workunit.client.0.smithi063.stdout:8/263: write d7/d14/d1a/f50 [910314,108228] 0 2023-12-07T16:21:35.474 INFO:tasks.workunit.client.0.smithi063.stdout:0/225: dwrite d4/dd/de/d15/f21 [0,4194304] 0 2023-12-07T16:21:35.474 INFO:tasks.workunit.client.0.smithi063.stdout:0/226: fdatasync d4/dd/de/d15/f3d 0 2023-12-07T16:21:35.479 INFO:tasks.workunit.client.1.smithi152.stdout:5/548: link dd/cb5 dd/de/d14/d19/d1a/cba 0 2023-12-07T16:21:35.479 INFO:tasks.workunit.client.1.smithi152.stdout:5/549: stat dd/l59 0 2023-12-07T16:21:35.481 INFO:tasks.workunit.client.1.smithi152.stdout:5/550: getdents dd/de/d14/d1f 0 2023-12-07T16:21:35.481 INFO:tasks.workunit.client.1.smithi152.stdout:5/551: fdatasync dd/de/d14/f42 0 2023-12-07T16:21:35.484 INFO:tasks.workunit.client.0.smithi063.stdout:7/126: sync 2023-12-07T16:21:35.484 INFO:tasks.workunit.client.0.smithi063.stdout:1/106: sync 2023-12-07T16:21:35.484 INFO:tasks.workunit.client.0.smithi063.stdout:1/107: write d0/dd/d10/d13/fc [5091431,83587] 0 2023-12-07T16:21:35.484 INFO:tasks.workunit.client.0.smithi063.stdout:9/161: sync 2023-12-07T16:21:35.484 INFO:tasks.workunit.client.1.smithi152.stdout:5/552: rename dd/de/d14/d1f/f6e to dd/de/d38/d3d/d6d/dae/fbb 0 2023-12-07T16:21:35.487 INFO:tasks.workunit.client.1.smithi152.stdout:5/553: mkdir dd/de/dbc 0 2023-12-07T16:21:35.489 INFO:tasks.workunit.client.0.smithi063.stdout:1/108: mkdir d0/dd/d10/d1e 0 2023-12-07T16:21:35.489 INFO:tasks.workunit.client.1.smithi152.stdout:3/414: dwrite d7/d10/d19/f45 [0,4194304] 0 2023-12-07T16:21:35.491 INFO:tasks.workunit.client.0.smithi063.stdout:7/127: mknod d2/c32 0 2023-12-07T16:21:35.491 INFO:tasks.workunit.client.0.smithi063.stdout:1/109: mkdir d0/dd/d1f 0 2023-12-07T16:21:35.491 INFO:tasks.workunit.client.0.smithi063.stdout:7/128: write d2/de/d2a/f2f [618032,109781] 0 2023-12-07T16:21:35.496 INFO:tasks.workunit.client.1.smithi152.stdout:5/554: mknod dd/de/d38/d3d/d6d/dae/cbd 0 2023-12-07T16:21:35.497 INFO:tasks.workunit.client.1.smithi152.stdout:3/415: creat d7/d10/d1a/d2f/f82 x:0 0 0 2023-12-07T16:21:35.497 INFO:tasks.workunit.client.0.smithi063.stdout:1/110: mknod d0/dd/d10/d1b/c20 0 2023-12-07T16:21:35.497 INFO:tasks.workunit.client.0.smithi063.stdout:1/111: write d0/dd/d10/f17 [666680,105067] 0 2023-12-07T16:21:35.497 INFO:tasks.workunit.client.0.smithi063.stdout:1/112: truncate d0/f4 8766464 0 2023-12-07T16:21:35.497 INFO:tasks.workunit.client.0.smithi063.stdout:7/129: link d2/c32 d2/d21/c33 0 2023-12-07T16:21:35.497 INFO:tasks.workunit.client.0.smithi063.stdout:7/130: dread - d2/ff zero size 2023-12-07T16:21:35.498 INFO:tasks.workunit.client.1.smithi152.stdout:5/555: write dd/f5a [264810,76680] 0 2023-12-07T16:21:35.498 INFO:tasks.workunit.client.1.smithi152.stdout:5/556: write dd/de/d14/d19/d1a/d1b/f8b [1047321,60416] 0 2023-12-07T16:21:35.500 INFO:tasks.workunit.client.0.smithi063.stdout:1/113: rename d0/f7 to d0/dd/d19/f21 0 2023-12-07T16:21:35.501 INFO:tasks.workunit.client.1.smithi152.stdout:5/557: mkdir dd/d91/dbe 0 2023-12-07T16:21:35.502 INFO:tasks.workunit.client.1.smithi152.stdout:3/416: write d7/dc/d14/f75 [143934,25170] 0 2023-12-07T16:21:35.505 INFO:tasks.workunit.client.0.smithi063.stdout:1/114: mknod d0/dd/d10/d13/c22 0 2023-12-07T16:21:35.506 INFO:tasks.workunit.client.0.smithi063.stdout:7/131: mkdir d2/d34 0 2023-12-07T16:21:35.507 INFO:tasks.workunit.client.0.smithi063.stdout:7/132: rmdir d2/d2c 39 2023-12-07T16:21:35.509 INFO:tasks.workunit.client.0.smithi063.stdout:7/133: creat d2/de/d2a/f35 x:0 0 0 2023-12-07T16:21:35.510 INFO:tasks.workunit.client.1.smithi152.stdout:3/417: write d7/d10/d1a/d2f/f1d [3356347,15063] 0 2023-12-07T16:21:35.513 INFO:tasks.workunit.client.0.smithi063.stdout:7/134: rename d2/f24 to d2/f36 0 2023-12-07T16:21:35.514 INFO:tasks.workunit.client.1.smithi152.stdout:3/418: write d7/dc/f2a [6832806,47317] 0 2023-12-07T16:21:35.514 INFO:tasks.workunit.client.1.smithi152.stdout:3/419: write d7/dc/d14/f39 [1314796,113364] 0 2023-12-07T16:21:35.514 INFO:tasks.workunit.client.1.smithi152.stdout:3/420: truncate d7/d10/d19/f4a 995596 0 2023-12-07T16:21:35.514 INFO:tasks.workunit.client.1.smithi152.stdout:3/421: chown d7/c9 95835 1 2023-12-07T16:21:35.515 INFO:tasks.workunit.client.0.smithi063.stdout:8/264: dwrite d7/d14/d1a/f33 [0,4194304] 0 2023-12-07T16:21:35.515 INFO:tasks.workunit.client.0.smithi063.stdout:8/265: chown d7/d14/d4e 186383 1 2023-12-07T16:21:35.515 INFO:tasks.workunit.client.0.smithi063.stdout:8/266: truncate d7/d14/d15/f2d 349008 0 2023-12-07T16:21:35.519 INFO:tasks.workunit.client.0.smithi063.stdout:1/115: dread d0/f1 [0,4194304] 0 2023-12-07T16:21:35.521 INFO:tasks.workunit.client.0.smithi063.stdout:1/116: mknod d0/dd/d1f/c23 0 2023-12-07T16:21:35.522 INFO:tasks.workunit.client.0.smithi063.stdout:8/267: dread d7/d14/d1a/f29 [0,4194304] 0 2023-12-07T16:21:35.523 INFO:tasks.workunit.client.0.smithi063.stdout:8/268: readlink d7/d14/d1a/d54/l55 0 2023-12-07T16:21:35.523 INFO:tasks.workunit.client.0.smithi063.stdout:1/117: symlink d0/dd/l24 0 2023-12-07T16:21:35.524 INFO:tasks.workunit.client.0.smithi063.stdout:1/118: chown d0/dd/d1f/c23 14511 1 2023-12-07T16:21:35.525 INFO:tasks.workunit.client.0.smithi063.stdout:6/211: dwrite d0/d1e/d1d/f27 [0,4194304] 0 2023-12-07T16:21:35.526 INFO:tasks.workunit.client.0.smithi063.stdout:8/269: mkdir d7/d14/d15/d57 0 2023-12-07T16:21:35.526 INFO:tasks.workunit.client.0.smithi063.stdout:0/227: dwrite d4/f3e [0,4194304] 0 2023-12-07T16:21:35.526 INFO:tasks.workunit.client.0.smithi063.stdout:9/162: dwrite d0/f30 [0,4194304] 0 2023-12-07T16:21:35.527 INFO:tasks.workunit.client.0.smithi063.stdout:4/133: dwrite d1/d3/f5 [0,4194304] 0 2023-12-07T16:21:35.528 INFO:tasks.workunit.client.0.smithi063.stdout:4/134: chown d1/d3/db/d13/l1d 103692 1 2023-12-07T16:21:35.532 INFO:tasks.workunit.client.0.smithi063.stdout:8/270: creat d7/d14/d15/d48/f58 x:0 0 0 2023-12-07T16:21:35.533 INFO:tasks.workunit.client.0.smithi063.stdout:8/271: write d7/d14/f4f [464029,62067] 0 2023-12-07T16:21:35.535 INFO:tasks.workunit.client.0.smithi063.stdout:9/163: mknod d0/c32 0 2023-12-07T16:21:35.535 INFO:tasks.workunit.client.1.smithi152.stdout:5/558: dwrite f8 [0,4194304] 0 2023-12-07T16:21:35.539 INFO:tasks.workunit.client.0.smithi063.stdout:6/212: dread d0/d1e/d1d/d1f/f28 [0,4194304] 0 2023-12-07T16:21:35.539 INFO:tasks.workunit.client.0.smithi063.stdout:6/213: dread - d0/d17/f43 zero size 2023-12-07T16:21:35.542 INFO:tasks.workunit.client.0.smithi063.stdout:8/272: write d7/d14/d15/f2f [1282316,102701] 0 2023-12-07T16:21:35.544 INFO:tasks.workunit.client.0.smithi063.stdout:8/273: creat d7/d14/d15/d2b/f59 x:0 0 0 2023-12-07T16:21:35.546 INFO:tasks.workunit.client.0.smithi063.stdout:6/214: read d0/d1e/d20/f47 [2685235,106258] 0 2023-12-07T16:21:35.548 INFO:tasks.workunit.client.0.smithi063.stdout:9/164: write d0/d13/f2b [2625606,111443] 0 2023-12-07T16:21:35.549 INFO:tasks.workunit.client.0.smithi063.stdout:7/135: dwrite d2/d21/f29 [4194304,4194304] 0 2023-12-07T16:21:35.550 INFO:tasks.workunit.client.0.smithi063.stdout:9/165: rmdir d0/d7 39 2023-12-07T16:21:35.552 INFO:tasks.workunit.client.0.smithi063.stdout:9/166: rmdir d0/d13 39 2023-12-07T16:21:35.553 INFO:tasks.workunit.client.0.smithi063.stdout:0/228: dread d4/dd/de/f13 [0,4194304] 0 2023-12-07T16:21:35.555 INFO:tasks.workunit.client.0.smithi063.stdout:9/167: rename d0/d7/fe to d0/d21/f33 0 2023-12-07T16:21:35.555 INFO:tasks.workunit.client.0.smithi063.stdout:0/229: rename d4/dd to d4/dd/de/d15/d47 22 2023-12-07T16:21:35.557 INFO:tasks.workunit.client.0.smithi063.stdout:0/230: getdents d4/d25 0 2023-12-07T16:21:35.558 INFO:tasks.workunit.client.0.smithi063.stdout:0/231: symlink d4/dd/l48 0 2023-12-07T16:21:35.558 INFO:tasks.workunit.client.0.smithi063.stdout:0/232: chown d4/dd/l1b 3283310 1 2023-12-07T16:21:35.560 INFO:tasks.workunit.client.1.smithi152.stdout:3/422: dwrite d7/d10/d1a/d2f/f54 [0,4194304] 0 2023-12-07T16:21:35.560 INFO:tasks.workunit.client.1.smithi152.stdout:3/423: truncate d7/d10/d41/f6e 769684 0 2023-12-07T16:21:35.562 INFO:tasks.workunit.client.1.smithi152.stdout:3/424: mknod d7/d10/d1a/d25/d78/c83 0 2023-12-07T16:21:35.566 INFO:tasks.workunit.client.0.smithi063.stdout:8/274: dread d7/d14/f35 [0,4194304] 0 2023-12-07T16:21:35.566 INFO:tasks.workunit.client.1.smithi152.stdout:3/425: rename d7/d10/d1a/d2f/d60 to d7/dc/d3e/d62/d6d/d84 0 2023-12-07T16:21:35.566 INFO:tasks.workunit.client.1.smithi152.stdout:3/426: chown d7/d10/d1a/d2f 1093 1 2023-12-07T16:21:35.567 INFO:tasks.workunit.client.0.smithi063.stdout:8/275: symlink d7/d14/d15/d57/l5a 0 2023-12-07T16:21:35.567 INFO:tasks.workunit.client.0.smithi063.stdout:8/276: stat d7/d14/d1a/l43 0 2023-12-07T16:21:35.568 INFO:tasks.workunit.client.0.smithi063.stdout:4/135: dread d1/d3/f5 [0,4194304] 0 2023-12-07T16:21:35.569 INFO:tasks.workunit.client.1.smithi152.stdout:5/559: dwrite dd/de/d14/d67/fad [0,4194304] 0 2023-12-07T16:21:35.571 INFO:tasks.workunit.client.0.smithi063.stdout:4/136: write d1/d3/f5 [3585226,112578] 0 2023-12-07T16:21:35.571 INFO:tasks.workunit.client.0.smithi063.stdout:4/137: dread - d1/f28 zero size 2023-12-07T16:21:35.572 INFO:tasks.workunit.client.1.smithi152.stdout:5/560: mkdir dd/d7b/dbf 0 2023-12-07T16:21:35.573 INFO:tasks.workunit.client.0.smithi063.stdout:1/119: dwrite d0/dd/d19/f21 [0,4194304] 0 2023-12-07T16:21:35.574 INFO:tasks.workunit.client.0.smithi063.stdout:1/120: fsync d0/f1 0 2023-12-07T16:21:35.576 INFO:tasks.workunit.client.0.smithi063.stdout:4/138: rename d1/d3/db/f23 to d1/d3/db/f29 0 2023-12-07T16:21:35.576 INFO:tasks.workunit.client.0.smithi063.stdout:4/139: chown d1/d3/db/d13/l1d 39 1 2023-12-07T16:21:35.577 INFO:tasks.workunit.client.0.smithi063.stdout:0/233: write d4/f3e [4731490,104272] 0 2023-12-07T16:21:35.578 INFO:tasks.workunit.client.0.smithi063.stdout:0/234: truncate d4/dd/f44 818442 0 2023-12-07T16:21:35.578 INFO:tasks.workunit.client.1.smithi152.stdout:5/561: symlink dd/de/d14/d1f/lc0 0 2023-12-07T16:21:35.581 INFO:tasks.workunit.client.0.smithi063.stdout:0/235: creat d4/dd/de/d15/d1f/d30/f49 x:0 0 0 2023-12-07T16:21:35.584 INFO:tasks.workunit.client.0.smithi063.stdout:7/136: dwrite d2/fd [4194304,4194304] 0 2023-12-07T16:21:35.589 INFO:tasks.workunit.client.0.smithi063.stdout:0/236: creat d4/dd/de/d15/d1f/f4a x:0 0 0 2023-12-07T16:21:35.589 INFO:tasks.workunit.client.0.smithi063.stdout:0/237: dread - d4/dd/de/d15/d1f/f3a zero size 2023-12-07T16:21:35.590 INFO:tasks.workunit.client.0.smithi063.stdout:0/238: truncate d4/dd/de/d15/f3d 73925 0 2023-12-07T16:21:35.592 INFO:tasks.workunit.client.0.smithi063.stdout:0/239: creat d4/d25/f4b x:0 0 0 2023-12-07T16:21:35.592 INFO:tasks.workunit.client.0.smithi063.stdout:0/240: chown d4/dd/de/d15/d1f/d30/f49 6686 1 2023-12-07T16:21:35.595 INFO:tasks.workunit.client.0.smithi063.stdout:7/137: dread d2/f1a [0,4194304] 0 2023-12-07T16:21:35.596 INFO:tasks.workunit.client.0.smithi063.stdout:0/241: write d4/dd/de/d15/f21 [3697999,87706] 0 2023-12-07T16:21:35.599 INFO:tasks.workunit.client.0.smithi063.stdout:7/138: mkdir d2/d37 0 2023-12-07T16:21:35.600 INFO:tasks.workunit.client.0.smithi063.stdout:0/242: rename d4/dd/de/d15/d3c to d4/dd/de/d15/d1f/d4c 0 2023-12-07T16:21:35.600 INFO:tasks.workunit.client.0.smithi063.stdout:7/139: creat d2/d34/f38 x:0 0 0 2023-12-07T16:21:35.601 INFO:tasks.workunit.client.0.smithi063.stdout:7/140: creat d2/de/d2a/f39 x:0 0 0 2023-12-07T16:21:35.607 INFO:tasks.workunit.client.0.smithi063.stdout:6/215: dwrite d0/d1e/d1d/f3d [0,4194304] 0 2023-12-07T16:21:35.608 INFO:tasks.workunit.client.0.smithi063.stdout:8/277: truncate d7/d14/f4f 430439 0 2023-12-07T16:21:35.610 INFO:tasks.workunit.client.1.smithi152.stdout:3/427: dwrite d7/d10/d41/f4e [0,4194304] 0 2023-12-07T16:21:35.611 INFO:tasks.workunit.client.0.smithi063.stdout:6/216: mkdir d0/d1e/d1d/d4f 0 2023-12-07T16:21:35.615 INFO:tasks.workunit.client.0.smithi063.stdout:8/278: truncate d7/fd 5979580 0 2023-12-07T16:21:35.620 INFO:tasks.workunit.client.0.smithi063.stdout:1/121: dwrite d0/f4 [0,4194304] 0 2023-12-07T16:21:35.620 INFO:tasks.workunit.client.0.smithi063.stdout:1/122: dread - d0/dd/f1c zero size 2023-12-07T16:21:35.620 INFO:tasks.workunit.client.0.smithi063.stdout:8/279: dread d7/f9 [4194304,4194304] 0 2023-12-07T16:21:35.622 INFO:tasks.workunit.client.1.smithi152.stdout:3/428: write d7/dc/d3e/f53 [6770176,79262] 0 2023-12-07T16:21:35.624 INFO:tasks.workunit.client.1.smithi152.stdout:3/429: creat d7/dc/d3e/d62/d6d/d84/f85 x:0 0 0 2023-12-07T16:21:35.624 INFO:tasks.workunit.client.1.smithi152.stdout:3/430: chown d7/d10/d1a/d2f/f82 9 1 2023-12-07T16:21:35.625 INFO:tasks.workunit.client.1.smithi152.stdout:5/562: dwrite dd/de/d38/d3d/d6d/dae/fbb [0,4194304] 0 2023-12-07T16:21:35.628 INFO:tasks.workunit.client.1.smithi152.stdout:3/431: mkdir d7/d10/d1a/d2f/d86 0 2023-12-07T16:21:35.629 INFO:tasks.workunit.client.0.smithi063.stdout:0/243: dwrite d4/dd/de/f13 [0,4194304] 0 2023-12-07T16:21:35.630 INFO:tasks.workunit.client.1.smithi152.stdout:3/432: creat d7/dc/d14/f87 x:0 0 0 2023-12-07T16:21:35.631 INFO:tasks.workunit.client.0.smithi063.stdout:7/141: dwrite d2/de/f1b [0,4194304] 0 2023-12-07T16:21:35.631 INFO:tasks.workunit.client.0.smithi063.stdout:6/217: dread d0/d1e/d1d/f3d [0,4194304] 0 2023-12-07T16:21:35.632 INFO:tasks.workunit.client.0.smithi063.stdout:4/140: dwrite d1/d3/db/f29 [0,4194304] 0 2023-12-07T16:21:35.636 INFO:tasks.workunit.client.0.smithi063.stdout:8/280: write d7/d14/f35 [677457,121600] 0 2023-12-07T16:21:35.636 INFO:tasks.workunit.client.0.smithi063.stdout:8/281: write d7/d14/d15/d48/f58 [821323,5511] 0 2023-12-07T16:21:35.636 INFO:tasks.workunit.client.0.smithi063.stdout:1/123: dread d0/dd/d19/f21 [0,4194304] 0 2023-12-07T16:21:35.637 INFO:tasks.workunit.client.1.smithi152.stdout:3/433: mknod d7/d10/d1a/d2f/d56/c88 0 2023-12-07T16:21:35.637 INFO:tasks.workunit.client.1.smithi152.stdout:3/434: stat d7/d10/d1a/d2f/f1d 0 2023-12-07T16:21:35.638 INFO:tasks.workunit.client.0.smithi063.stdout:4/141: write d1/d3/db/d13/f17 [1493154,130320] 0 2023-12-07T16:21:35.638 INFO:tasks.workunit.client.0.smithi063.stdout:7/142: creat d2/d2c/f3a x:0 0 0 2023-12-07T16:21:35.641 INFO:tasks.workunit.client.0.smithi063.stdout:6/218: creat d0/d17/d46/f50 x:0 0 0 2023-12-07T16:21:35.641 INFO:tasks.workunit.client.0.smithi063.stdout:6/219: truncate d0/d1e/f26 4756986 0 2023-12-07T16:21:35.643 INFO:tasks.workunit.client.0.smithi063.stdout:3/136: sync 2023-12-07T16:21:35.643 INFO:tasks.workunit.client.0.smithi063.stdout:5/152: sync 2023-12-07T16:21:35.643 INFO:tasks.workunit.client.0.smithi063.stdout:2/142: sync 2023-12-07T16:21:35.646 INFO:tasks.workunit.client.0.smithi063.stdout:8/282: creat d7/d14/d1a/d54/f5b x:0 0 0 2023-12-07T16:21:35.646 INFO:tasks.workunit.client.0.smithi063.stdout:2/143: write d0/d26/f20 [3789463,53007] 0 2023-12-07T16:21:35.646 INFO:tasks.workunit.client.0.smithi063.stdout:2/144: dread - d0/d21/f2a zero size 2023-12-07T16:21:35.646 INFO:tasks.workunit.client.0.smithi063.stdout:2/145: readlink d0/d26/d11/l27 0 2023-12-07T16:21:35.646 INFO:tasks.workunit.client.0.smithi063.stdout:1/124: link d0/lb d0/dd/l25 0 2023-12-07T16:21:35.650 INFO:tasks.workunit.client.0.smithi063.stdout:4/142: unlink d1/d3/db/fd 0 2023-12-07T16:21:35.650 INFO:tasks.workunit.client.0.smithi063.stdout:4/143: truncate d1/d3/db/f29 4685814 0 2023-12-07T16:21:35.651 INFO:tasks.workunit.client.0.smithi063.stdout:7/143: creat d2/d34/f3b x:0 0 0 2023-12-07T16:21:35.652 INFO:tasks.workunit.client.0.smithi063.stdout:6/220: symlink d0/d17/d1a/d38/l51 0 2023-12-07T16:21:35.653 INFO:tasks.workunit.client.0.smithi063.stdout:5/153: getdents d1/d3 0 2023-12-07T16:21:35.653 INFO:tasks.workunit.client.1.smithi152.stdout:8/385: sync 2023-12-07T16:21:35.654 INFO:tasks.workunit.client.1.smithi152.stdout:0/471: sync 2023-12-07T16:21:35.655 INFO:tasks.workunit.client.0.smithi063.stdout:3/137: creat d7/d9/f26 x:0 0 0 2023-12-07T16:21:35.655 INFO:tasks.workunit.client.0.smithi063.stdout:2/146: creat d0/d1e/f30 x:0 0 0 2023-12-07T16:21:35.656 INFO:tasks.workunit.client.0.smithi063.stdout:1/125: symlink d0/dd/l26 0 2023-12-07T16:21:35.657 INFO:tasks.workunit.client.1.smithi152.stdout:8/386: rename d3/d4/d9/d23/f2c to d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/d7d/f8d 0 2023-12-07T16:21:35.657 INFO:tasks.workunit.client.1.smithi152.stdout:8/387: readlink d3/d4/d9/dc/l50 0 2023-12-07T16:21:35.659 INFO:tasks.workunit.client.0.smithi063.stdout:7/144: creat d2/d34/f3c x:0 0 0 2023-12-07T16:21:35.659 INFO:tasks.workunit.client.0.smithi063.stdout:7/145: write d2/f5 [930157,57291] 0 2023-12-07T16:21:35.660 INFO:tasks.workunit.client.1.smithi152.stdout:8/388: creat d3/d4/d4b/f8e x:0 0 0 2023-12-07T16:21:35.660 INFO:tasks.workunit.client.0.smithi063.stdout:6/221: dread d0/d1e/d29/f36 [0,4194304] 0 2023-12-07T16:21:35.660 INFO:tasks.workunit.client.0.smithi063.stdout:6/222: chown d0/d1e/d1d/f3d 6962 1 2023-12-07T16:21:35.660 INFO:tasks.workunit.client.0.smithi063.stdout:5/154: symlink d1/d3/de/d1e/l2c 0 2023-12-07T16:21:35.661 INFO:tasks.workunit.client.0.smithi063.stdout:6/223: dread d0/d1e/f26 [4194304,4194304] 0 2023-12-07T16:21:35.662 INFO:tasks.workunit.client.1.smithi152.stdout:8/389: truncate d3/d4/d9/f33 2188746 0 2023-12-07T16:21:35.663 INFO:tasks.workunit.client.0.smithi063.stdout:3/138: link d7/d9/dd/f19 d7/d9/f27 0 2023-12-07T16:21:35.663 INFO:tasks.workunit.client.0.smithi063.stdout:2/147: mknod d0/d26/c31 0 2023-12-07T16:21:35.664 INFO:tasks.workunit.client.0.smithi063.stdout:3/139: read d7/ff [631852,80320] 0 2023-12-07T16:21:35.664 INFO:tasks.workunit.client.0.smithi063.stdout:3/140: write d7/d9/dd/f1f [1281093,20419] 0 2023-12-07T16:21:35.664 INFO:tasks.workunit.client.0.smithi063.stdout:1/126: creat d0/dd/d10/f27 x:0 0 0 2023-12-07T16:21:35.665 INFO:tasks.workunit.client.1.smithi152.stdout:5/563: dwrite dd/de/d14/d1f/f57 [0,4194304] 0 2023-12-07T16:21:35.665 INFO:tasks.workunit.client.1.smithi152.stdout:5/564: readlink dd/de/d14/d1f/d28/l72 0 2023-12-07T16:21:35.665 INFO:tasks.workunit.client.1.smithi152.stdout:8/390: symlink d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/d7d/l8f 0 2023-12-07T16:21:35.665 INFO:tasks.workunit.client.1.smithi152.stdout:8/391: readlink d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/l71 0 2023-12-07T16:21:35.665 INFO:tasks.workunit.client.0.smithi063.stdout:7/146: creat d2/d2c/f3d x:0 0 0 2023-12-07T16:21:35.666 INFO:tasks.workunit.client.0.smithi063.stdout:7/147: read d2/f1a [2489877,48999] 0 2023-12-07T16:21:35.666 INFO:tasks.workunit.client.0.smithi063.stdout:7/148: readlink d2/l22 0 2023-12-07T16:21:35.666 INFO:tasks.workunit.client.0.smithi063.stdout:2/148: rename d0/l2f to d0/l32 0 2023-12-07T16:21:35.666 INFO:tasks.workunit.client.0.smithi063.stdout:3/141: mknod d7/d9/dd/c28 0 2023-12-07T16:21:35.669 INFO:tasks.workunit.client.1.smithi152.stdout:3/435: dwrite d7/d10/d19/f45 [0,4194304] 0 2023-12-07T16:21:35.669 INFO:tasks.workunit.client.1.smithi152.stdout:3/436: readlink d7/dc/l50 0 2023-12-07T16:21:35.669 INFO:tasks.workunit.client.1.smithi152.stdout:5/565: unlink dd/de/d38/d3d/d6d/dae/fbb 0 2023-12-07T16:21:35.669 INFO:tasks.workunit.client.0.smithi063.stdout:7/149: creat d2/de/f3e x:0 0 0 2023-12-07T16:21:35.669 INFO:tasks.workunit.client.0.smithi063.stdout:7/150: truncate d2/f17 744300 0 2023-12-07T16:21:35.669 INFO:tasks.workunit.client.0.smithi063.stdout:7/151: truncate d2/d2c/f3d 167677 0 2023-12-07T16:21:35.669 INFO:tasks.workunit.client.0.smithi063.stdout:7/152: chown d2/l22 31 1 2023-12-07T16:21:35.669 INFO:tasks.workunit.client.1.smithi152.stdout:8/392: mknod d3/d4/d9/dc/d6f/d7a/c90 0 2023-12-07T16:21:35.670 INFO:tasks.workunit.client.1.smithi152.stdout:8/393: chown d3/d4/d9 288114 1 2023-12-07T16:21:35.671 INFO:tasks.workunit.client.0.smithi063.stdout:3/142: creat d7/d21/f29 x:0 0 0 2023-12-07T16:21:35.671 INFO:tasks.workunit.client.0.smithi063.stdout:4/144: dread d1/d3/f1e [0,4194304] 0 2023-12-07T16:21:35.671 INFO:tasks.workunit.client.0.smithi063.stdout:2/149: write d0/fa [623468,109697] 0 2023-12-07T16:21:35.671 INFO:tasks.workunit.client.1.smithi152.stdout:5/566: creat dd/d7b/fc1 x:0 0 0 2023-12-07T16:21:35.672 INFO:tasks.workunit.client.1.smithi152.stdout:5/567: fsync dd/de/d14/d1f/d49/f5f 0 2023-12-07T16:21:35.672 INFO:tasks.workunit.client.0.smithi063.stdout:7/153: link d2/de/f16 d2/d21/f3f 0 2023-12-07T16:21:35.673 INFO:tasks.workunit.client.0.smithi063.stdout:6/224: dread d0/f1b [0,4194304] 0 2023-12-07T16:21:35.674 INFO:tasks.workunit.client.1.smithi152.stdout:5/568: mknod dd/de/d14/cc2 0 2023-12-07T16:21:35.675 INFO:tasks.workunit.client.0.smithi063.stdout:2/150: write d0/f1f [211015,115440] 0 2023-12-07T16:21:35.675 INFO:tasks.workunit.client.0.smithi063.stdout:4/145: write d1/d3/f1e [4546760,101952] 0 2023-12-07T16:21:35.675 INFO:tasks.workunit.client.0.smithi063.stdout:7/154: creat d2/de/f40 x:0 0 0 2023-12-07T16:21:35.675 INFO:tasks.workunit.client.0.smithi063.stdout:7/155: write d2/fa [701028,57764] 0 2023-12-07T16:21:35.675 INFO:tasks.workunit.client.0.smithi063.stdout:7/156: readlink d2/d2c/l2e 0 2023-12-07T16:21:35.675 INFO:tasks.workunit.client.1.smithi152.stdout:0/472: dwrite d0/d27/d11/f72 [0,4194304] 0 2023-12-07T16:21:35.675 INFO:tasks.workunit.client.1.smithi152.stdout:3/437: dread d7/d10/d1a/d25/d4b/f4d [0,4194304] 0 2023-12-07T16:21:35.677 INFO:tasks.workunit.client.1.smithi152.stdout:8/394: dread d3/d4/d4b/f4f [0,4194304] 0 2023-12-07T16:21:35.677 INFO:tasks.workunit.client.1.smithi152.stdout:8/395: readlink d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/l71 0 2023-12-07T16:21:35.677 INFO:tasks.workunit.client.1.smithi152.stdout:5/569: creat dd/d7b/dbf/fc3 x:0 0 0 2023-12-07T16:21:35.677 INFO:tasks.workunit.client.1.smithi152.stdout:5/570: truncate dd/de/d17/f7f 248460 0 2023-12-07T16:21:35.677 INFO:tasks.workunit.client.1.smithi152.stdout:5/571: chown dd/de/d17/d54/fb1 31 1 2023-12-07T16:21:35.677 INFO:tasks.workunit.client.0.smithi063.stdout:6/225: creat d0/d1e/d2a/f52 x:0 0 0 2023-12-07T16:21:35.678 INFO:tasks.workunit.client.1.smithi152.stdout:8/396: write d3/f1d [2263706,63263] 0 2023-12-07T16:21:35.678 INFO:tasks.workunit.client.1.smithi152.stdout:8/397: write d3/d4/d9/f21 [836323,56814] 0 2023-12-07T16:21:35.682 INFO:tasks.workunit.client.0.smithi063.stdout:2/151: creat d0/f33 x:0 0 0 2023-12-07T16:21:35.682 INFO:tasks.workunit.client.0.smithi063.stdout:4/146: getdents d1 0 2023-12-07T16:21:35.684 INFO:tasks.workunit.client.1.smithi152.stdout:5/572: mknod dd/d91/dbe/cc4 0 2023-12-07T16:21:35.684 INFO:tasks.workunit.client.1.smithi152.stdout:8/398: creat d3/d4/d9/dc/d6f/d7a/d8a/d63/f91 x:0 0 0 2023-12-07T16:21:35.684 INFO:tasks.workunit.client.1.smithi152.stdout:5/573: fsync dd/de/d17/f33 0 2023-12-07T16:21:35.685 INFO:tasks.workunit.client.0.smithi063.stdout:7/157: creat d2/de/d2a/f41 x:0 0 0 2023-12-07T16:21:35.687 INFO:tasks.workunit.client.0.smithi063.stdout:2/152: rename d0/fe to d0/d1e/f34 0 2023-12-07T16:21:35.688 INFO:tasks.workunit.client.0.smithi063.stdout:1/127: dwrite d0/dd/d10/f17 [0,4194304] 0 2023-12-07T16:21:35.688 INFO:tasks.workunit.client.0.smithi063.stdout:4/147: truncate d1/d3/f5 1760410 0 2023-12-07T16:21:35.689 INFO:tasks.workunit.client.1.smithi152.stdout:5/574: symlink dd/de/d38/d3d/d6d/lc5 0 2023-12-07T16:21:35.689 INFO:tasks.workunit.client.1.smithi152.stdout:8/399: fsync d3/d4/d4b/f8e 0 2023-12-07T16:21:35.690 INFO:tasks.workunit.client.0.smithi063.stdout:7/158: mkdir d2/d34/d42 0 2023-12-07T16:21:35.693 INFO:tasks.workunit.client.0.smithi063.stdout:2/153: rename d0/d26/d11/c18 to d0/d21/c35 0 2023-12-07T16:21:35.694 INFO:tasks.workunit.client.0.smithi063.stdout:1/128: dread d0/f1 [0,4194304] 0 2023-12-07T16:21:35.697 INFO:tasks.workunit.client.0.smithi063.stdout:9/168: sync 2023-12-07T16:21:35.699 INFO:tasks.workunit.client.0.smithi063.stdout:2/154: symlink d0/d1e/l36 0 2023-12-07T16:21:35.699 INFO:tasks.workunit.client.0.smithi063.stdout:2/155: stat d0/d26/d11/f1b 0 2023-12-07T16:21:35.699 INFO:tasks.workunit.client.0.smithi063.stdout:2/156: write d0/d26/d11/f23 [4713346,3257] 0 2023-12-07T16:21:35.700 INFO:tasks.workunit.client.0.smithi063.stdout:9/169: getdents d0/d13 0 2023-12-07T16:21:35.700 INFO:tasks.workunit.client.0.smithi063.stdout:2/157: read d0/d26/d11/f23 [1530439,13826] 0 2023-12-07T16:21:35.702 INFO:tasks.workunit.client.1.smithi152.stdout:8/400: dread d3/d4/d9/d34/f49 [0,4194304] 0 2023-12-07T16:21:35.702 INFO:tasks.workunit.client.1.smithi152.stdout:8/401: dread - d3/d1e/d40/d74/f86 zero size 2023-12-07T16:21:35.702 INFO:tasks.workunit.client.1.smithi152.stdout:8/402: fdatasync d3/d4/d9/dc/d6f/d7a/d8a/f28 0 2023-12-07T16:21:35.703 INFO:tasks.workunit.client.0.smithi063.stdout:7/159: symlink d2/l43 0 2023-12-07T16:21:35.704 INFO:tasks.workunit.client.1.smithi152.stdout:8/403: mknod d3/d4/d9/dc/d6f/d7a/c92 0 2023-12-07T16:21:35.704 INFO:tasks.workunit.client.0.smithi063.stdout:9/170: rename d0/l1d to d0/l34 0 2023-12-07T16:21:35.704 INFO:tasks.workunit.client.0.smithi063.stdout:2/158: creat d0/d21/f37 x:0 0 0 2023-12-07T16:21:35.705 INFO:tasks.workunit.client.0.smithi063.stdout:2/159: truncate d0/d21/f37 290675 0 2023-12-07T16:21:35.706 INFO:tasks.workunit.client.0.smithi063.stdout:2/160: mkdir d0/d38 0 2023-12-07T16:21:35.708 INFO:tasks.workunit.client.0.smithi063.stdout:2/161: rmdir d0/d38 0 2023-12-07T16:21:35.708 INFO:tasks.workunit.client.0.smithi063.stdout:4/148: dread d1/d3/f8 [0,4194304] 0 2023-12-07T16:21:35.712 INFO:tasks.workunit.client.0.smithi063.stdout:9/171: dread d0/f1a [0,4194304] 0 2023-12-07T16:21:35.712 INFO:tasks.workunit.client.0.smithi063.stdout:3/143: dread f5 [0,4194304] 0 2023-12-07T16:21:35.712 INFO:tasks.workunit.client.0.smithi063.stdout:3/144: dread - d7/fc zero size 2023-12-07T16:21:35.712 INFO:tasks.workunit.client.0.smithi063.stdout:3/145: write d7/d21/f25 [404002,51036] 0 2023-12-07T16:21:35.717 INFO:tasks.workunit.client.0.smithi063.stdout:4/149: unlink d1/d3/db/lc 0 2023-12-07T16:21:35.717 INFO:tasks.workunit.client.0.smithi063.stdout:4/150: write d1/d3/db/f20 [86121,2308] 0 2023-12-07T16:21:35.717 INFO:tasks.workunit.client.0.smithi063.stdout:4/151: write d1/f28 [812322,30448] 0 2023-12-07T16:21:35.720 INFO:tasks.workunit.client.0.smithi063.stdout:3/146: creat d7/d9/dd/f2a x:0 0 0 2023-12-07T16:21:35.720 INFO:tasks.workunit.client.0.smithi063.stdout:3/147: write d7/d9/dd/f2a [362919,116591] 0 2023-12-07T16:21:35.721 INFO:tasks.workunit.client.0.smithi063.stdout:2/162: dread d0/f1f [0,4194304] 0 2023-12-07T16:21:35.721 INFO:tasks.workunit.client.0.smithi063.stdout:2/163: write d0/d21/f2a [832606,108150] 0 2023-12-07T16:21:35.723 INFO:tasks.workunit.client.0.smithi063.stdout:3/148: mkdir d7/d9/d2b 0 2023-12-07T16:21:35.723 INFO:tasks.workunit.client.1.smithi152.stdout:5/575: dwrite dd/de/d17/f7f [0,4194304] 0 2023-12-07T16:21:35.723 INFO:tasks.workunit.client.1.smithi152.stdout:5/576: chown dd/de/d38/d3d/lac 3 1 2023-12-07T16:21:35.723 INFO:tasks.workunit.client.1.smithi152.stdout:5/577: write dd/d91/fa1 [524612,124370] 0 2023-12-07T16:21:35.725 INFO:tasks.workunit.client.0.smithi063.stdout:3/149: creat d7/d9/d1b/f2c x:0 0 0 2023-12-07T16:21:35.728 INFO:tasks.workunit.client.0.smithi063.stdout:3/150: mknod d7/d21/c2d 0 2023-12-07T16:21:35.729 INFO:tasks.workunit.client.0.smithi063.stdout:1/129: dwrite d0/dd/f16 [4194304,4194304] 0 2023-12-07T16:21:35.730 INFO:tasks.workunit.client.1.smithi152.stdout:3/438: dwrite d7/d10/d41/f4e [0,4194304] 0 2023-12-07T16:21:35.737 INFO:tasks.workunit.client.0.smithi063.stdout:1/130: mknod d0/dd/d10/d13/c28 0 2023-12-07T16:21:35.741 INFO:tasks.workunit.client.1.smithi152.stdout:3/439: rename d7/d10/d41/f4e to d7/dc/f89 0 2023-12-07T16:21:35.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:35 smithi152 ceph-mon[121113]: pgmap v25: 65 pgs: 65 active+clean; 775 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 50 MiB/s rd, 96 MiB/s wr, 506 op/s 2023-12-07T16:21:35.743 INFO:tasks.workunit.client.1.smithi152.stdout:3/440: creat d7/d10/d1a/d25/d78/f8a x:0 0 0 2023-12-07T16:21:35.743 INFO:tasks.workunit.client.1.smithi152.stdout:3/441: write d7/d10/d1a/d2f/f1d [5034991,91954] 0 2023-12-07T16:21:35.743 INFO:tasks.workunit.client.1.smithi152.stdout:3/442: chown d7/d10/d1a/d2f/f20 88 1 2023-12-07T16:21:35.745 INFO:tasks.workunit.client.1.smithi152.stdout:8/404: dwrite d3/d4/d9/dc/f4d [0,4194304] 0 2023-12-07T16:21:35.745 INFO:tasks.workunit.client.1.smithi152.stdout:8/405: fdatasync d3/d4/d9/dc/d6f/d7a/f89 0 2023-12-07T16:21:35.747 INFO:tasks.workunit.client.0.smithi063.stdout:2/164: fsync d0/d26/d11/f23 0 2023-12-07T16:21:35.747 INFO:tasks.workunit.client.0.smithi063.stdout:2/165: chown d0/f33 716 1 2023-12-07T16:21:35.747 INFO:tasks.workunit.client.0.smithi063.stdout:2/166: write d0/d21/f37 [917028,32001] 0 2023-12-07T16:21:35.748 INFO:tasks.workunit.client.0.smithi063.stdout:3/151: dread f5 [0,4194304] 0 2023-12-07T16:21:35.748 INFO:tasks.workunit.client.0.smithi063.stdout:3/152: chown d7/d9 20743 1 2023-12-07T16:21:35.750 INFO:tasks.workunit.client.1.smithi152.stdout:8/406: truncate d3/f1a 1568085 0 2023-12-07T16:21:35.753 INFO:tasks.workunit.client.0.smithi063.stdout:3/153: creat d7/d9/dd/f2e x:0 0 0 2023-12-07T16:21:35.756 INFO:tasks.workunit.client.0.smithi063.stdout:3/154: symlink d7/d21/l2f 0 2023-12-07T16:21:35.765 INFO:tasks.workunit.client.1.smithi152.stdout:3/443: truncate d7/dc/d14/f15 7560805 0 2023-12-07T16:21:35.765 INFO:tasks.workunit.client.0.smithi063.stdout:9/172: dwrite d0/d21/f23 [0,4194304] 0 2023-12-07T16:21:35.765 INFO:tasks.workunit.client.0.smithi063.stdout:9/173: write d0/d13/f25 [274980,32275] 0 2023-12-07T16:21:35.766 INFO:tasks.workunit.client.0.smithi063.stdout:7/160: dwrite d2/de/f15 [0,4194304] 0 2023-12-07T16:21:35.770 INFO:tasks.workunit.client.0.smithi063.stdout:4/152: dwrite d1/d3/f1e [0,4194304] 0 2023-12-07T16:21:35.771 INFO:tasks.workunit.client.0.smithi063.stdout:1/131: dwrite d0/f1 [0,4194304] 0 2023-12-07T16:21:35.771 INFO:tasks.workunit.client.0.smithi063.stdout:1/132: chown d0/dd/d19/f21 1277803 1 2023-12-07T16:21:35.774 INFO:tasks.workunit.client.0.smithi063.stdout:4/153: getdents d1/d3 0 2023-12-07T16:21:35.775 INFO:tasks.workunit.client.1.smithi152.stdout:5/578: dwrite dd/de/d14/d1f/f57 [0,4194304] 0 2023-12-07T16:21:35.776 INFO:tasks.workunit.client.0.smithi063.stdout:1/133: write d0/dd/d19/f21 [4117887,73936] 0 2023-12-07T16:21:35.779 INFO:tasks.workunit.client.1.smithi152.stdout:5/579: rename dd/de/d17/d54 to dd/de/d14/dc6 0 2023-12-07T16:21:35.781 INFO:tasks.workunit.client.0.smithi063.stdout:1/134: getdents d0/dd/d19 0 2023-12-07T16:21:35.781 INFO:tasks.workunit.client.1.smithi152.stdout:8/407: dwrite d3/d1e/f30 [8388608,4194304] 0 2023-12-07T16:21:35.782 INFO:tasks.workunit.client.0.smithi063.stdout:2/167: fsync d0/d21/f37 0 2023-12-07T16:21:35.782 INFO:tasks.workunit.client.1.smithi152.stdout:5/580: creat dd/de/d14/d19/d1a/fc7 x:0 0 0 2023-12-07T16:21:35.784 INFO:tasks.workunit.client.1.smithi152.stdout:8/408: symlink d3/d4/d9/dc/d6f/d7b/d7e/l93 0 2023-12-07T16:21:35.785 INFO:tasks.workunit.client.1.smithi152.stdout:8/409: chown d3/d4/d4b/c4e 734 1 2023-12-07T16:21:35.785 INFO:tasks.workunit.client.1.smithi152.stdout:8/410: fdatasync d3/d4/d9/d23/f45 0 2023-12-07T16:21:35.788 INFO:tasks.workunit.client.0.smithi063.stdout:3/155: dwrite d7/d9/dd/f1e [0,4194304] 0 2023-12-07T16:21:35.788 INFO:tasks.workunit.client.0.smithi063.stdout:3/156: fdatasync d7/d9/f12 0 2023-12-07T16:21:35.789 INFO:tasks.workunit.client.0.smithi063.stdout:1/135: rename d0/dd/l25 to d0/l29 0 2023-12-07T16:21:35.789 INFO:tasks.workunit.client.0.smithi063.stdout:1/136: write d0/dd/d19/f21 [4913303,124437] 0 2023-12-07T16:21:35.790 INFO:tasks.workunit.client.0.smithi063.stdout:2/168: rmdir d0/d1e 39 2023-12-07T16:21:35.790 INFO:tasks.workunit.client.0.smithi063.stdout:2/169: write d0/f33 [522311,77726] 0 2023-12-07T16:21:35.791 INFO:tasks.workunit.client.0.smithi063.stdout:4/154: write d1/d3/f5 [452703,97940] 0 2023-12-07T16:21:35.792 INFO:tasks.workunit.client.0.smithi063.stdout:1/137: write d0/dd/d10/d13/fc [576867,79508] 0 2023-12-07T16:21:35.793 INFO:tasks.workunit.client.1.smithi152.stdout:8/411: write d3/d4/d9/dc/f3e [6579592,106650] 0 2023-12-07T16:21:35.795 INFO:tasks.workunit.client.1.smithi152.stdout:8/412: getdents d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/d7d 0 2023-12-07T16:21:35.795 INFO:tasks.workunit.client.0.smithi063.stdout:1/138: write d0/f4 [7284215,36231] 0 2023-12-07T16:21:35.795 INFO:tasks.workunit.client.0.smithi063.stdout:1/139: chown d0/dd/d10/f27 520128865 1 2023-12-07T16:21:35.796 INFO:tasks.workunit.client.1.smithi152.stdout:8/413: mknod d3/d1e/d55/d83/c94 0 2023-12-07T16:21:35.796 INFO:tasks.workunit.client.0.smithi063.stdout:2/170: mkdir d0/d21/d39 0 2023-12-07T16:21:35.796 INFO:tasks.workunit.client.1.smithi152.stdout:8/414: link d3/d4/d9/cd d3/d1e/d55/d83/c95 0 2023-12-07T16:21:35.798 INFO:tasks.workunit.client.0.smithi063.stdout:4/155: rename d1/d3/db/f29 to d1/d3/db/d13/f2a 0 2023-12-07T16:21:35.799 INFO:tasks.workunit.client.1.smithi152.stdout:8/415: rename d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/l71 to d3/d1e/d55/d83/l96 0 2023-12-07T16:21:35.799 INFO:tasks.workunit.client.1.smithi152.stdout:8/416: write d3/d4/d4b/f8e [101147,49098] 0 2023-12-07T16:21:35.799 INFO:tasks.workunit.client.1.smithi152.stdout:8/417: chown d3/d4/d9/dc/d6f/d7a/d8a/f59 350 1 2023-12-07T16:21:35.799 INFO:tasks.workunit.client.1.smithi152.stdout:8/418: write d3/d4/d9/dc/d6f/d7b/d7e/d85/f8c [95600,37265] 0 2023-12-07T16:21:35.799 INFO:tasks.workunit.client.1.smithi152.stdout:8/419: read - d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/d7d/f87 zero size 2023-12-07T16:21:35.800 INFO:tasks.workunit.client.1.smithi152.stdout:8/420: mknod d3/c97 0 2023-12-07T16:21:35.800 INFO:tasks.workunit.client.0.smithi063.stdout:1/140: unlink d0/dd/d10/d13/lf 0 2023-12-07T16:21:35.800 INFO:tasks.workunit.client.0.smithi063.stdout:1/141: write d0/dd/f1c [821902,129617] 0 2023-12-07T16:21:35.801 INFO:tasks.workunit.client.1.smithi152.stdout:8/421: mknod d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/d7d/c98 0 2023-12-07T16:21:35.803 INFO:tasks.workunit.client.0.smithi063.stdout:4/156: mknod d1/d3/db/c2b 0 2023-12-07T16:21:35.804 INFO:tasks.workunit.client.1.smithi152.stdout:8/422: rename d3/d1e/d40/f69 to d3/d4/d9/dc/d6f/f99 0 2023-12-07T16:21:35.805 INFO:tasks.workunit.client.0.smithi063.stdout:4/157: mkdir d1/d3/db/d2c 0 2023-12-07T16:21:35.807 INFO:tasks.workunit.client.0.smithi063.stdout:3/157: rmdir d7 39 2023-12-07T16:21:35.808 INFO:tasks.workunit.client.0.smithi063.stdout:4/158: symlink d1/d3/db/l2d 0 2023-12-07T16:21:35.810 INFO:tasks.workunit.client.0.smithi063.stdout:3/158: dread d7/fa [0,4194304] 0 2023-12-07T16:21:35.811 INFO:tasks.workunit.client.0.smithi063.stdout:9/174: dwrite d0/d21/f23 [0,4194304] 0 2023-12-07T16:21:35.813 INFO:tasks.workunit.client.0.smithi063.stdout:4/159: unlink d1/d3/db/d16/c1f 0 2023-12-07T16:21:35.814 INFO:tasks.workunit.client.1.smithi152.stdout:8/423: dread d3/d4/d9/d23/f45 [0,4194304] 0 2023-12-07T16:21:35.814 INFO:tasks.workunit.client.1.smithi152.stdout:8/424: write d3/d4/d9/dc/d6f/d7a/d8a/f37 [4326144,115267] 0 2023-12-07T16:21:35.815 INFO:tasks.workunit.client.0.smithi063.stdout:7/161: dwrite d2/de/d2a/f41 [0,4194304] 0 2023-12-07T16:21:35.815 INFO:tasks.workunit.client.1.smithi152.stdout:8/425: link d3/d4/d9/dc/d6f/d7b/d7e/d85/f8c d3/d4/d9/dc/d6f/d7b/d7e/f9a 0 2023-12-07T16:21:35.815 INFO:tasks.workunit.client.1.smithi152.stdout:8/426: dread - d3/d4/d9/dc/d6f/f99 zero size 2023-12-07T16:21:35.816 INFO:tasks.workunit.client.0.smithi063.stdout:3/159: dread d7/d9/dd/f1f [0,4194304] 0 2023-12-07T16:21:35.820 INFO:tasks.workunit.client.0.smithi063.stdout:8/283: sync 2023-12-07T16:21:35.820 INFO:tasks.workunit.client.0.smithi063.stdout:0/244: sync 2023-12-07T16:21:35.820 INFO:tasks.workunit.client.0.smithi063.stdout:5/155: sync 2023-12-07T16:21:35.823 INFO:tasks.workunit.client.0.smithi063.stdout:7/162: rmdir d2/de 39 2023-12-07T16:21:35.823 INFO:tasks.workunit.client.0.smithi063.stdout:7/163: write d2/de/f18 [7783,118267] 0 2023-12-07T16:21:35.825 INFO:tasks.workunit.client.0.smithi063.stdout:0/245: mknod d4/dd/de/d15/c4d 0 2023-12-07T16:21:35.826 INFO:tasks.workunit.client.0.smithi063.stdout:7/164: rmdir d2/d2c 39 2023-12-07T16:21:35.828 INFO:tasks.workunit.client.0.smithi063.stdout:3/160: mknod d7/d21/c30 0 2023-12-07T16:21:35.828 INFO:tasks.workunit.client.0.smithi063.stdout:3/161: fdatasync d7/fe 0 2023-12-07T16:21:35.828 INFO:tasks.workunit.client.0.smithi063.stdout:9/175: dread d0/d7/ff [4194304,4194304] 0 2023-12-07T16:21:35.828 INFO:tasks.workunit.client.0.smithi063.stdout:0/246: creat d4/dd/f4e x:0 0 0 2023-12-07T16:21:35.828 INFO:tasks.workunit.client.0.smithi063.stdout:0/247: write d4/dd/de/d15/f3d [758119,126997] 0 2023-12-07T16:21:35.832 INFO:tasks.workunit.client.1.smithi152.stdout:9/501: sync 2023-12-07T16:21:35.832 INFO:tasks.workunit.client.1.smithi152.stdout:7/395: sync 2023-12-07T16:21:35.832 INFO:tasks.workunit.client.1.smithi152.stdout:2/399: sync 2023-12-07T16:21:35.832 INFO:tasks.workunit.client.1.smithi152.stdout:2/400: dread - d2/d1c/d2e/f64 zero size 2023-12-07T16:21:35.834 INFO:tasks.workunit.client.0.smithi063.stdout:9/176: truncate d0/f3 1340794 0 2023-12-07T16:21:35.834 INFO:tasks.workunit.client.0.smithi063.stdout:9/177: dread - d0/d21/f2c zero size 2023-12-07T16:21:35.834 INFO:tasks.workunit.client.0.smithi063.stdout:3/162: rmdir d7/d9 39 2023-12-07T16:21:35.840 INFO:tasks.workunit.client.0.smithi063.stdout:9/178: getdents d0/d21 0 2023-12-07T16:21:35.844 INFO:tasks.workunit.client.0.smithi063.stdout:3/163: truncate d7/d9/f12 206268 0 2023-12-07T16:21:35.847 INFO:tasks.workunit.client.0.smithi063.stdout:0/248: dread d4/f3e [0,4194304] 0 2023-12-07T16:21:35.849 INFO:tasks.workunit.client.0.smithi063.stdout:6/226: sync 2023-12-07T16:21:35.849 INFO:tasks.workunit.client.0.smithi063.stdout:6/227: chown d0/d1e/d1d/d4f 30800 1 2023-12-07T16:21:35.850 INFO:tasks.workunit.client.0.smithi063.stdout:3/164: symlink d7/d21/l31 0 2023-12-07T16:21:35.850 INFO:tasks.workunit.client.0.smithi063.stdout:0/249: rmdir d4/dd/d26/d2b 39 2023-12-07T16:21:35.851 INFO:tasks.workunit.client.0.smithi063.stdout:5/156: dwrite d1/d3/de/f16 [0,4194304] 0 2023-12-07T16:21:35.851 INFO:tasks.workunit.client.0.smithi063.stdout:5/157: fdatasync d1/d3/de/d1e/f24 0 2023-12-07T16:21:35.851 INFO:tasks.workunit.client.0.smithi063.stdout:6/228: symlink d0/d17/d1a/d4d/l53 0 2023-12-07T16:21:35.852 INFO:tasks.workunit.client.0.smithi063.stdout:3/165: rename d7/d21/c30 to d7/d21/c32 0 2023-12-07T16:21:35.852 INFO:tasks.workunit.client.0.smithi063.stdout:3/166: fsync d7/d9/dd/f2e 0 2023-12-07T16:21:35.854 INFO:tasks.workunit.client.0.smithi063.stdout:0/250: link d4/dd/de/d15/d1f/f4a d4/dd/d26/f4f 0 2023-12-07T16:21:35.855 INFO:tasks.workunit.client.0.smithi063.stdout:5/158: creat d1/d3/f2d x:0 0 0 2023-12-07T16:21:35.856 INFO:tasks.workunit.client.0.smithi063.stdout:5/159: fdatasync d1/d3/de/f16 0 2023-12-07T16:21:35.856 INFO:tasks.workunit.client.0.smithi063.stdout:4/160: dread d1/d3/f1e [0,4194304] 0 2023-12-07T16:21:35.856 INFO:tasks.workunit.client.0.smithi063.stdout:2/171: dwrite d0/f16 [0,4194304] 0 2023-12-07T16:21:35.857 INFO:tasks.workunit.client.0.smithi063.stdout:4/161: write d1/f28 [570021,33334] 0 2023-12-07T16:21:35.857 INFO:tasks.workunit.client.0.smithi063.stdout:0/251: symlink d4/dd/de/d15/l50 0 2023-12-07T16:21:35.859 INFO:tasks.workunit.client.0.smithi063.stdout:8/284: dread d7/d14/d1a/f29 [0,4194304] 0 2023-12-07T16:21:35.859 INFO:tasks.workunit.client.0.smithi063.stdout:6/229: mkdir d0/d54 0 2023-12-07T16:21:35.860 INFO:tasks.workunit.client.0.smithi063.stdout:4/162: rmdir d1/d3/db/d13 39 2023-12-07T16:21:35.861 INFO:tasks.workunit.client.0.smithi063.stdout:0/252: rmdir d4/dd/d26/d2b 39 2023-12-07T16:21:35.866 INFO:tasks.workunit.client.0.smithi063.stdout:4/163: rename d1/d3/db/d16/c26 to d1/d3/db/d2c/c2e 0 2023-12-07T16:21:35.867 INFO:tasks.workunit.client.0.smithi063.stdout:2/172: write d0/d26/d11/f1b [2095281,4070] 0 2023-12-07T16:21:35.867 INFO:tasks.workunit.client.0.smithi063.stdout:2/173: write d0/d21/f2a [1523569,31277] 0 2023-12-07T16:21:35.870 INFO:tasks.workunit.client.0.smithi063.stdout:2/174: dread d0/f33 [0,4194304] 0 2023-12-07T16:21:35.871 INFO:tasks.workunit.client.0.smithi063.stdout:2/175: read d0/d21/f37 [675591,34044] 0 2023-12-07T16:21:35.872 INFO:tasks.workunit.client.0.smithi063.stdout:8/285: write d7/d14/d15/f2f [3158382,68593] 0 2023-12-07T16:21:35.872 INFO:tasks.workunit.client.0.smithi063.stdout:8/286: readlink d7/l13 0 2023-12-07T16:21:35.872 INFO:tasks.workunit.client.0.smithi063.stdout:8/287: chown d7/d14/d1a/d54/f5b 0 1 2023-12-07T16:21:35.872 INFO:tasks.workunit.client.0.smithi063.stdout:6/230: dread d0/fa [0,4194304] 0 2023-12-07T16:21:35.872 INFO:tasks.workunit.client.0.smithi063.stdout:0/253: read d4/dd/de/d15/f21 [3028200,68229] 0 2023-12-07T16:21:35.872 INFO:tasks.workunit.client.0.smithi063.stdout:2/176: write d0/f16 [1935382,748] 0 2023-12-07T16:21:35.873 INFO:tasks.workunit.client.0.smithi063.stdout:8/288: unlink d7/d14/d15/d48/f4c 0 2023-12-07T16:21:35.873 INFO:tasks.workunit.client.0.smithi063.stdout:8/289: write d7/d14/d1a/f29 [1985401,102847] 0 2023-12-07T16:21:35.873 INFO:tasks.workunit.client.0.smithi063.stdout:8/290: chown d7/d14/c26 137737 1 2023-12-07T16:21:35.873 INFO:tasks.workunit.client.0.smithi063.stdout:8/291: write d7/d14/d1a/f29 [3124642,106632] 0 2023-12-07T16:21:35.873 INFO:tasks.workunit.client.0.smithi063.stdout:8/292: fsync d7/d14/d1a/f50 0 2023-12-07T16:21:35.873 INFO:tasks.workunit.client.0.smithi063.stdout:8/293: fsync d7/f4a 0 2023-12-07T16:21:35.874 INFO:tasks.workunit.client.0.smithi063.stdout:6/231: rename d0/d17/d1a/f35 to d0/d17/d46/f55 0 2023-12-07T16:21:35.874 INFO:tasks.workunit.client.0.smithi063.stdout:6/232: read - d0/d17/f43 zero size 2023-12-07T16:21:35.874 INFO:tasks.workunit.client.0.smithi063.stdout:6/233: dread - d0/d1e/d1d/f40 zero size 2023-12-07T16:21:35.874 INFO:tasks.workunit.client.0.smithi063.stdout:6/234: readlink d0/d1e/d29/l31 0 2023-12-07T16:21:35.875 INFO:tasks.workunit.client.0.smithi063.stdout:0/254: symlink d4/dd/d26/d2b/l51 0 2023-12-07T16:21:35.875 INFO:tasks.workunit.client.1.smithi152.stdout:8/427: dwrite d3/d4/d9/dc/d6f/d7a/d8a/d63/f91 [0,4194304] 0 2023-12-07T16:21:35.876 INFO:tasks.workunit.client.0.smithi063.stdout:7/165: dwrite d2/de/d2a/f2f [0,4194304] 0 2023-12-07T16:21:35.876 INFO:tasks.workunit.client.0.smithi063.stdout:6/235: creat d0/d54/f56 x:0 0 0 2023-12-07T16:21:35.877 INFO:tasks.workunit.client.0.smithi063.stdout:2/177: write d0/d1e/f29 [1026863,109129] 0 2023-12-07T16:21:35.878 INFO:tasks.workunit.client.1.smithi152.stdout:8/428: rmdir d3/d4/d9/d23 39 2023-12-07T16:21:35.878 INFO:tasks.workunit.client.0.smithi063.stdout:0/255: mkdir d4/dd/de/d15/d52 0 2023-12-07T16:21:35.878 INFO:tasks.workunit.client.0.smithi063.stdout:0/256: readlink d4/l8 0 2023-12-07T16:21:35.879 INFO:tasks.workunit.client.0.smithi063.stdout:9/179: dwrite d0/d7/f16 [0,4194304] 0 2023-12-07T16:21:35.879 INFO:tasks.workunit.client.1.smithi152.stdout:9/502: dwrite d1/d9/db/df/da6/f4d [0,4194304] 0 2023-12-07T16:21:35.880 INFO:tasks.workunit.client.1.smithi152.stdout:2/401: dwrite d2/d1c/d2e/d38/d90/f4b [0,4194304] 0 2023-12-07T16:21:35.881 INFO:tasks.workunit.client.0.smithi063.stdout:0/257: write d4/dd/de/d15/f3d [137797,80590] 0 2023-12-07T16:21:35.881 INFO:tasks.workunit.client.1.smithi152.stdout:8/429: mkdir d3/d4/d9/dc/d6f/d7a/d8a/d66/d9b 0 2023-12-07T16:21:35.881 INFO:tasks.workunit.client.1.smithi152.stdout:8/430: fdatasync d3/d1e/f30 0 2023-12-07T16:21:35.881 INFO:tasks.workunit.client.1.smithi152.stdout:8/431: fsync d3/d4/d9/dc/d6f/d7a/d8a/d63/f91 0 2023-12-07T16:21:35.882 INFO:tasks.workunit.client.1.smithi152.stdout:8/432: chown d3/d4/d9/d23/l47 495083 1 2023-12-07T16:21:35.882 INFO:tasks.workunit.client.0.smithi063.stdout:7/166: rmdir d2/d34/d42 0 2023-12-07T16:21:35.886 INFO:tasks.workunit.client.0.smithi063.stdout:5/160: dwrite d1/d3/de/d1e/f24 [0,4194304] 0 2023-12-07T16:21:35.887 INFO:tasks.workunit.client.1.smithi152.stdout:2/402: unlink d2/d1c/d2e/d30/d33/l4f 0 2023-12-07T16:21:35.887 INFO:tasks.workunit.client.1.smithi152.stdout:7/396: dwrite db/d27/d39/f2f [0,4194304] 0 2023-12-07T16:21:35.888 INFO:tasks.workunit.client.0.smithi063.stdout:6/236: unlink d0/c22 0 2023-12-07T16:21:35.888 INFO:tasks.workunit.client.0.smithi063.stdout:6/237: write d0/d17/f43 [775854,110281] 0 2023-12-07T16:21:35.888 INFO:tasks.workunit.client.0.smithi063.stdout:6/238: chown d0/d17/d1a/f1c 24567 1 2023-12-07T16:21:35.894 INFO:tasks.workunit.client.1.smithi152.stdout:8/433: dread d3/d1e/f44 [0,4194304] 0 2023-12-07T16:21:35.897 INFO:tasks.workunit.client.0.smithi063.stdout:7/167: dread d2/f8 [0,4194304] 0 2023-12-07T16:21:35.897 INFO:tasks.workunit.client.0.smithi063.stdout:2/178: mknod d0/c3a 0 2023-12-07T16:21:35.900 INFO:tasks.workunit.client.1.smithi152.stdout:8/434: link d3/d4/d9/dc/f39 d3/d1e/f9c 0 2023-12-07T16:21:35.900 INFO:tasks.workunit.client.0.smithi063.stdout:9/180: mknod d0/d13/c35 0 2023-12-07T16:21:35.900 INFO:tasks.workunit.client.0.smithi063.stdout:9/181: fdatasync d0/d13/f2b 0 2023-12-07T16:21:35.904 INFO:tasks.workunit.client.0.smithi063.stdout:0/258: truncate d4/d25/f2f 235913 0 2023-12-07T16:21:35.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:35 smithi063 ceph-mon[112095]: pgmap v25: 65 pgs: 65 active+clean; 775 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 50 MiB/s rd, 96 MiB/s wr, 506 op/s 2023-12-07T16:21:35.909 INFO:tasks.workunit.client.1.smithi152.stdout:7/397: dread db/d1c/f28 [0,4194304] 0 2023-12-07T16:21:35.909 INFO:tasks.workunit.client.1.smithi152.stdout:7/398: stat db/l2b 0 2023-12-07T16:21:35.913 INFO:tasks.workunit.client.0.smithi063.stdout:6/239: rmdir d0/d1e/d29 39 2023-12-07T16:21:35.913 INFO:tasks.workunit.client.0.smithi063.stdout:6/240: chown d0/d17/d46/f55 63173 1 2023-12-07T16:21:35.913 INFO:tasks.workunit.client.0.smithi063.stdout:6/241: write d0/d1e/d20/f47 [5079170,73912] 0 2023-12-07T16:21:35.913 INFO:tasks.workunit.client.0.smithi063.stdout:4/164: write d1/d3/f8 [1764156,121746] 0 2023-12-07T16:21:35.914 INFO:tasks.workunit.client.1.smithi152.stdout:7/399: read db/d27/d5e/f54 [1341255,23950] 0 2023-12-07T16:21:35.914 INFO:tasks.workunit.client.0.smithi063.stdout:7/168: getdents d2/d21 0 2023-12-07T16:21:35.915 INFO:tasks.workunit.client.1.smithi152.stdout:7/400: creat db/d68/f74 x:0 0 0 2023-12-07T16:21:35.916 INFO:tasks.workunit.client.0.smithi063.stdout:4/165: write d1/d3/f5 [1685481,87399] 0 2023-12-07T16:21:35.916 INFO:tasks.workunit.client.0.smithi063.stdout:2/179: rmdir d0/d21 39 2023-12-07T16:21:35.916 INFO:tasks.workunit.client.0.smithi063.stdout:8/294: dwrite d7/fd [4194304,4194304] 0 2023-12-07T16:21:35.916 INFO:tasks.workunit.client.0.smithi063.stdout:8/295: chown d7/d38/c42 56826374 1 2023-12-07T16:21:35.918 INFO:tasks.workunit.client.0.smithi063.stdout:9/182: creat d0/d13/f36 x:0 0 0 2023-12-07T16:21:35.918 INFO:tasks.workunit.client.0.smithi063.stdout:9/183: fsync d0/d13/f25 0 2023-12-07T16:21:35.918 INFO:tasks.workunit.client.0.smithi063.stdout:9/184: chown d0/c6 12320 1 2023-12-07T16:21:35.918 INFO:tasks.workunit.client.0.smithi063.stdout:2/180: dread d0/d26/d11/f1a [0,4194304] 0 2023-12-07T16:21:35.919 INFO:tasks.workunit.client.0.smithi063.stdout:2/181: write d0/d21/f2a [16806,47917] 0 2023-12-07T16:21:35.921 INFO:tasks.workunit.client.0.smithi063.stdout:6/242: rename d0/d17/f43 to d0/d1e/d29/f57 0 2023-12-07T16:21:35.921 INFO:tasks.workunit.client.0.smithi063.stdout:7/169: mknod d2/d37/c44 0 2023-12-07T16:21:35.921 INFO:tasks.workunit.client.0.smithi063.stdout:7/170: dread - d2/de/f3e zero size 2023-12-07T16:21:35.923 INFO:tasks.workunit.client.0.smithi063.stdout:4/166: mknod d1/d3/db/d16/c2f 0 2023-12-07T16:21:35.923 INFO:tasks.workunit.client.1.smithi152.stdout:9/503: dwrite d1/d9/d2d/d46/d9a/f9e [0,4194304] 0 2023-12-07T16:21:35.924 INFO:tasks.workunit.client.0.smithi063.stdout:8/296: creat d7/d14/d1a/f5c x:0 0 0 2023-12-07T16:21:35.925 INFO:tasks.workunit.client.1.smithi152.stdout:7/401: dread db/d27/d39/f22 [0,4194304] 0 2023-12-07T16:21:35.925 INFO:tasks.workunit.client.0.smithi063.stdout:0/259: dread d4/dd/f44 [0,4194304] 0 2023-12-07T16:21:35.926 INFO:tasks.workunit.client.0.smithi063.stdout:2/182: mknod d0/d26/c3b 0 2023-12-07T16:21:35.926 INFO:tasks.workunit.client.0.smithi063.stdout:2/183: chown d0/d26/d11/l2e 16158 1 2023-12-07T16:21:35.930 INFO:tasks.workunit.client.0.smithi063.stdout:9/185: rename d0/c32 to d0/d13/c37 0 2023-12-07T16:21:35.932 INFO:tasks.workunit.client.0.smithi063.stdout:7/171: getdents d2/de 0 2023-12-07T16:21:35.932 INFO:tasks.workunit.client.0.smithi063.stdout:6/243: truncate d0/f2c 467267 0 2023-12-07T16:21:35.933 INFO:tasks.workunit.client.0.smithi063.stdout:4/167: creat d1/d3/db/d13/f30 x:0 0 0 2023-12-07T16:21:35.933 INFO:tasks.workunit.client.0.smithi063.stdout:4/168: getdents d1 0 2023-12-07T16:21:35.933 INFO:tasks.workunit.client.0.smithi063.stdout:9/186: rename d0/l2e to d0/d13/l38 0 2023-12-07T16:21:35.934 INFO:tasks.workunit.client.1.smithi152.stdout:8/435: dwrite d3/d4/d9/d34/f49 [0,4194304] 0 2023-12-07T16:21:35.934 INFO:tasks.workunit.client.1.smithi152.stdout:8/436: write d3/d4/d4b/f78 [85099,22851] 0 2023-12-07T16:21:35.935 INFO:tasks.workunit.client.0.smithi063.stdout:6/244: mknod d0/d1e/d1d/d1f/d4b/c58 0 2023-12-07T16:21:35.935 INFO:tasks.workunit.client.0.smithi063.stdout:6/245: truncate d0/d1e/d1d/d1f/f28 649705 0 2023-12-07T16:21:35.935 INFO:tasks.workunit.client.1.smithi152.stdout:2/403: dwrite d2/d1c/d2e/d30/d42/f92 [0,4194304] 0 2023-12-07T16:21:35.937 INFO:tasks.workunit.client.0.smithi063.stdout:2/184: dread d0/d26/f17 [0,4194304] 0 2023-12-07T16:21:35.938 INFO:tasks.workunit.client.1.smithi152.stdout:8/437: symlink d3/d4/d9/d23/d4c/l9d 0 2023-12-07T16:21:35.941 INFO:tasks.workunit.client.0.smithi063.stdout:5/161: dwrite d1/d3/de/d1e/f1d [0,4194304] 0 2023-12-07T16:21:35.942 INFO:tasks.workunit.client.0.smithi063.stdout:7/172: rename d2/l2b to d2/d34/l45 0 2023-12-07T16:21:35.942 INFO:tasks.workunit.client.0.smithi063.stdout:7/173: fdatasync d2/d21/f30 0 2023-12-07T16:21:35.943 INFO:tasks.workunit.client.0.smithi063.stdout:9/187: mkdir d0/d13/d39 0 2023-12-07T16:21:35.943 INFO:tasks.workunit.client.1.smithi152.stdout:2/404: rename d2/d1c/d2e/d30/d53/d8a/c8c to d2/d1c/d2e/d30/d33/d86/c93 0 2023-12-07T16:21:35.945 INFO:tasks.workunit.client.1.smithi152.stdout:8/438: dread d3/d4/d9/dc/d6f/d7b/d7e/f9a [0,4194304] 0 2023-12-07T16:21:35.946 INFO:tasks.workunit.client.0.smithi063.stdout:5/162: read d1/f2a [138685,101478] 0 2023-12-07T16:21:35.946 INFO:tasks.workunit.client.0.smithi063.stdout:5/163: write d1/d3/de/f16 [4508019,69100] 0 2023-12-07T16:21:35.947 INFO:tasks.workunit.client.1.smithi152.stdout:2/405: symlink d2/d1c/d2e/d30/l94 0 2023-12-07T16:21:35.950 INFO:tasks.workunit.client.1.smithi152.stdout:2/406: creat d2/d1c/d2e/d57/d5b/f95 x:0 0 0 2023-12-07T16:21:35.955 INFO:tasks.workunit.client.1.smithi152.stdout:2/407: symlink d2/d9/d51/d54/d5c/l96 0 2023-12-07T16:21:35.959 INFO:tasks.workunit.client.0.smithi063.stdout:7/174: dread d2/f12 [0,4194304] 0 2023-12-07T16:21:35.959 INFO:tasks.workunit.client.0.smithi063.stdout:9/188: mkdir d0/d13/d39/d3a 0 2023-12-07T16:21:35.959 INFO:tasks.workunit.client.0.smithi063.stdout:9/189: chown d0/d7/c2f 168745 1 2023-12-07T16:21:35.962 INFO:tasks.workunit.client.0.smithi063.stdout:7/175: mkdir d2/d34/d46 0 2023-12-07T16:21:35.964 INFO:tasks.workunit.client.0.smithi063.stdout:5/164: rename d1/d3/de/f19 to d1/f2e 0 2023-12-07T16:21:35.965 INFO:tasks.workunit.client.0.smithi063.stdout:9/190: write d0/f3 [704709,61548] 0 2023-12-07T16:21:35.965 INFO:tasks.workunit.client.0.smithi063.stdout:9/191: chown d0/l1c 780589 1 2023-12-07T16:21:35.966 INFO:tasks.workunit.client.0.smithi063.stdout:5/165: rename d1/d3/de/d1e/d25/c29 to d1/d3/de/d1e/c2f 0 2023-12-07T16:21:35.967 INFO:tasks.workunit.client.0.smithi063.stdout:5/166: chown d1/d3/de/f28 1318628 1 2023-12-07T16:21:35.968 INFO:tasks.workunit.client.0.smithi063.stdout:9/192: symlink d0/d21/l3b 0 2023-12-07T16:21:35.970 INFO:tasks.workunit.client.0.smithi063.stdout:5/167: mknod d1/d3/de/d1e/d25/c30 0 2023-12-07T16:21:35.971 INFO:tasks.workunit.client.0.smithi063.stdout:9/193: symlink d0/d21/l3c 0 2023-12-07T16:21:35.972 INFO:tasks.workunit.client.0.smithi063.stdout:5/168: mkdir d1/d31 0 2023-12-07T16:21:35.976 INFO:tasks.workunit.client.1.smithi152.stdout:9/504: dwrite d1/d17/d3c/d4a/d48/f91 [0,4194304] 0 2023-12-07T16:21:35.976 INFO:tasks.workunit.client.1.smithi152.stdout:7/402: dwrite db/d27/d5e/f54 [0,4194304] 0 2023-12-07T16:21:35.976 INFO:tasks.workunit.client.1.smithi152.stdout:7/403: rename db to db/d27/d39/d75 22 2023-12-07T16:21:35.976 INFO:tasks.workunit.client.0.smithi063.stdout:5/169: rename d1/f13 to d1/f32 0 2023-12-07T16:21:35.976 INFO:tasks.workunit.client.0.smithi063.stdout:5/170: write d1/d3/de/d1e/f24 [4912931,109170] 0 2023-12-07T16:21:35.978 INFO:tasks.workunit.client.0.smithi063.stdout:8/297: dwrite d7/d14/d15/f18 [0,4194304] 0 2023-12-07T16:21:35.978 INFO:tasks.workunit.client.1.smithi152.stdout:9/505: creat d1/d17/d38/fad x:0 0 0 2023-12-07T16:21:35.980 INFO:tasks.workunit.client.0.smithi063.stdout:8/298: getdents d7/d14/d15/d57 0 2023-12-07T16:21:35.980 INFO:tasks.workunit.client.0.smithi063.stdout:8/299: dread - d7/d14/d1a/f56 zero size 2023-12-07T16:21:35.980 INFO:tasks.workunit.client.0.smithi063.stdout:6/246: dwrite d0/d1e/d1d/d1f/f21 [0,4194304] 0 2023-12-07T16:21:35.981 INFO:tasks.workunit.client.1.smithi152.stdout:7/404: rename c0 to db/d27/d39/d63/c76 0 2023-12-07T16:21:35.981 INFO:tasks.workunit.client.1.smithi152.stdout:7/405: chown db/d68 108 1 2023-12-07T16:21:35.982 INFO:tasks.workunit.client.1.smithi152.stdout:9/506: symlink d1/d17/d3c/lae 0 2023-12-07T16:21:35.987 INFO:tasks.workunit.client.1.smithi152.stdout:9/507: mkdir d1/d9/d4f/daf 0 2023-12-07T16:21:35.987 INFO:tasks.workunit.client.1.smithi152.stdout:9/508: write d1/d9/db/d70/f98 [218765,118330] 0 2023-12-07T16:21:35.995 INFO:tasks.workunit.client.0.smithi063.stdout:0/260: dwrite d4/dd/f14 [0,4194304] 0 2023-12-07T16:21:35.995 INFO:tasks.workunit.client.0.smithi063.stdout:4/169: dwrite d1/d3/db/d13/f18 [0,4194304] 0 2023-12-07T16:21:35.996 INFO:tasks.workunit.client.0.smithi063.stdout:0/261: creat d4/dd/de/d15/d52/f53 x:0 0 0 2023-12-07T16:21:35.996 INFO:tasks.workunit.client.0.smithi063.stdout:0/262: stat d4/c9 0 2023-12-07T16:21:36.008 INFO:tasks.workunit.client.0.smithi063.stdout:6/247: dwrite d0/d1e/d1d/d1f/f28 [0,4194304] 0 2023-12-07T16:21:36.008 INFO:tasks.workunit.client.0.smithi063.stdout:6/248: dread - d0/d17/d46/f55 zero size 2023-12-07T16:21:36.008 INFO:tasks.workunit.client.0.smithi063.stdout:6/249: write d0/d1e/d1d/f3a [54202,12706] 0 2023-12-07T16:21:36.008 INFO:tasks.workunit.client.0.smithi063.stdout:8/300: dwrite d7/d14/d15/d48/f58 [0,4194304] 0 2023-12-07T16:21:36.008 INFO:tasks.workunit.client.0.smithi063.stdout:8/301: write d7/d14/d15/d2b/f59 [464890,40378] 0 2023-12-07T16:21:36.008 INFO:tasks.workunit.client.0.smithi063.stdout:7/176: dwrite d2/de/f40 [0,4194304] 0 2023-12-07T16:21:36.008 INFO:tasks.workunit.client.0.smithi063.stdout:7/177: chown d2/d21/f30 1024 1 2023-12-07T16:21:36.008 INFO:tasks.workunit.client.0.smithi063.stdout:9/194: dwrite d0/d7/f16 [0,4194304] 0 2023-12-07T16:21:36.009 INFO:tasks.workunit.client.1.smithi152.stdout:8/439: dwrite d3/d4/f5c [0,4194304] 0 2023-12-07T16:21:36.009 INFO:tasks.workunit.client.1.smithi152.stdout:2/408: dwrite d2/d1c/d2e/d30/d42/f92 [4194304,4194304] 0 2023-12-07T16:21:36.009 INFO:tasks.workunit.client.1.smithi152.stdout:2/409: chown d2/d1c/d2e/d30/d42/d91 27953910 1 2023-12-07T16:21:36.009 INFO:tasks.workunit.client.1.smithi152.stdout:2/410: chown d2/d9 3209 1 2023-12-07T16:21:36.010 INFO:tasks.workunit.client.1.smithi152.stdout:8/440: symlink d3/d4/l9e 0 2023-12-07T16:21:36.011 INFO:tasks.workunit.client.1.smithi152.stdout:8/441: fsync d3/d4/d9/dc/f39 0 2023-12-07T16:21:36.012 INFO:tasks.workunit.client.1.smithi152.stdout:9/509: dread d1/d9/db/d70/f98 [0,4194304] 0 2023-12-07T16:21:36.013 INFO:tasks.workunit.client.1.smithi152.stdout:2/411: unlink d2/d1c/d2e/d30/d53/f8e 0 2023-12-07T16:21:36.014 INFO:tasks.workunit.client.1.smithi152.stdout:8/442: symlink d3/d1e/d43/l9f 0 2023-12-07T16:21:36.016 INFO:tasks.workunit.client.1.smithi152.stdout:2/412: getdents d2/d9/d51/d54 0 2023-12-07T16:21:36.016 INFO:tasks.workunit.client.1.smithi152.stdout:2/413: truncate d2/d9/f48 997593 0 2023-12-07T16:21:36.019 INFO:tasks.workunit.client.1.smithi152.stdout:8/443: creat d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/fa0 x:0 0 0 2023-12-07T16:21:36.020 INFO:tasks.workunit.client.1.smithi152.stdout:8/444: write d3/d4/f35 [926224,86363] 0 2023-12-07T16:21:36.021 INFO:tasks.workunit.client.1.smithi152.stdout:8/445: write d3/d4/d9/d34/f3f [4885872,75067] 0 2023-12-07T16:21:36.021 INFO:tasks.workunit.client.1.smithi152.stdout:2/414: symlink d2/d1c/d2e/d38/l97 0 2023-12-07T16:21:36.021 INFO:tasks.workunit.client.1.smithi152.stdout:2/415: write d2/d1c/d2e/d30/d53/f55 [810860,70186] 0 2023-12-07T16:21:36.025 INFO:tasks.workunit.client.1.smithi152.stdout:7/406: rmdir db/d27 39 2023-12-07T16:21:36.025 INFO:tasks.workunit.client.1.smithi152.stdout:7/407: chown db/d27/d39/d41/l3a 51048 1 2023-12-07T16:21:36.025 INFO:tasks.workunit.client.1.smithi152.stdout:7/408: fsync db/d27/f56 0 2023-12-07T16:21:36.026 INFO:tasks.workunit.client.0.smithi063.stdout:9/195: dwrite d0/f1a [0,4194304] 0 2023-12-07T16:21:36.026 INFO:tasks.workunit.client.0.smithi063.stdout:9/196: truncate d0/d13/f36 218994 0 2023-12-07T16:21:36.026 INFO:tasks.workunit.client.0.smithi063.stdout:9/197: write d0/f31 [996365,79353] 0 2023-12-07T16:21:36.026 INFO:tasks.workunit.client.0.smithi063.stdout:4/170: creat d1/d3/f31 x:0 0 0 2023-12-07T16:21:36.026 INFO:tasks.workunit.client.1.smithi152.stdout:8/446: write d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/d7d/f8d [116176,96780] 0 2023-12-07T16:21:36.026 INFO:tasks.workunit.client.0.smithi063.stdout:2/185: getdents d0/d26 0 2023-12-07T16:21:36.028 INFO:tasks.workunit.client.0.smithi063.stdout:0/263: link d4/f5 d4/dd/de/d15/d1f/f54 0 2023-12-07T16:21:36.028 INFO:tasks.workunit.client.0.smithi063.stdout:0/264: fdatasync d4/dd/de/f24 0 2023-12-07T16:21:36.029 INFO:tasks.workunit.client.1.smithi152.stdout:2/416: creat d2/d9/f98 x:0 0 0 2023-12-07T16:21:36.029 INFO:tasks.workunit.client.1.smithi152.stdout:2/417: stat d2/d9/d51/f63 0 2023-12-07T16:21:36.031 INFO:tasks.workunit.client.1.smithi152.stdout:7/409: truncate db/d27/d5e/d45/f50 3628922 0 2023-12-07T16:21:36.031 INFO:tasks.workunit.client.1.smithi152.stdout:2/418: dread d2/d1c/d2e/d38/d90/f2a [0,4194304] 0 2023-12-07T16:21:36.031 INFO:tasks.workunit.client.1.smithi152.stdout:2/419: readlink d2/d1c/d2e/d30/d53/l76 0 2023-12-07T16:21:36.033 INFO:tasks.workunit.client.1.smithi152.stdout:8/447: creat d3/d4/d9/dc/d6f/d7b/d7e/fa1 x:0 0 0 2023-12-07T16:21:36.034 INFO:tasks.workunit.client.1.smithi152.stdout:8/448: write d3/d4/d9/dc/f20 [764391,24906] 0 2023-12-07T16:21:36.034 INFO:tasks.workunit.client.1.smithi152.stdout:8/449: chown d3/l88 55601338 1 2023-12-07T16:21:36.035 INFO:tasks.workunit.client.1.smithi152.stdout:7/410: getdents db/d27/d5e/d45 0 2023-12-07T16:21:36.036 INFO:tasks.workunit.client.1.smithi152.stdout:8/450: rename d3/d4/d9/d34/l3b to d3/d1e/d55/la2 0 2023-12-07T16:21:36.037 INFO:tasks.workunit.client.1.smithi152.stdout:8/451: symlink d3/d4/d9/dc/d6f/d7b/la3 0 2023-12-07T16:21:36.040 INFO:tasks.workunit.client.1.smithi152.stdout:8/452: creat d3/fa4 x:0 0 0 2023-12-07T16:21:36.043 INFO:tasks.workunit.client.0.smithi063.stdout:2/186: dread d0/d26/d11/f1b [0,4194304] 0 2023-12-07T16:21:36.055 INFO:tasks.workunit.client.1.smithi152.stdout:7/411: dwrite db/d27/d39/d41/d58/f73 [0,4194304] 0 2023-12-07T16:21:36.055 INFO:tasks.workunit.client.1.smithi152.stdout:7/412: fdatasync db/d27/d4d/f6d 0 2023-12-07T16:21:36.055 INFO:tasks.workunit.client.1.smithi152.stdout:7/413: dread - db/d27/d39/d41/d37/f38 zero size 2023-12-07T16:21:36.060 INFO:tasks.workunit.client.1.smithi152.stdout:2/420: dwrite d2/d1c/d2e/f82 [0,4194304] 0 2023-12-07T16:21:36.060 INFO:tasks.workunit.client.1.smithi152.stdout:7/414: dread db/d27/d39/d63/f70 [0,4194304] 0 2023-12-07T16:21:36.060 INFO:tasks.workunit.client.1.smithi152.stdout:8/453: dwrite d3/d1e/d55/f64 [0,4194304] 0 2023-12-07T16:21:36.061 INFO:tasks.workunit.client.1.smithi152.stdout:8/454: write d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/fa0 [673565,8549] 0 2023-12-07T16:21:36.062 INFO:tasks.workunit.client.1.smithi152.stdout:2/421: creat d2/d1c/d52/f99 x:0 0 0 2023-12-07T16:21:36.064 INFO:tasks.workunit.client.1.smithi152.stdout:2/422: mkdir d2/d1c/d2e/d30/d53/d9a 0 2023-12-07T16:21:36.065 INFO:tasks.workunit.client.1.smithi152.stdout:2/423: chown d2/d1c/d2e/d30/l94 130 1 2023-12-07T16:21:36.065 INFO:tasks.workunit.client.1.smithi152.stdout:2/424: write d2/d1c/d2e/d57/f7b [320609,46581] 0 2023-12-07T16:21:36.066 INFO:tasks.workunit.client.1.smithi152.stdout:2/425: symlink d2/d1c/d2e/d30/d42/d84/l9b 0 2023-12-07T16:21:36.066 INFO:tasks.workunit.client.1.smithi152.stdout:2/426: dread - d2/d1c/f80 zero size 2023-12-07T16:21:36.076 INFO:tasks.workunit.client.1.smithi152.stdout:7/415: dwrite db/d27/d39/f66 [0,4194304] 0 2023-12-07T16:21:36.076 INFO:tasks.workunit.client.1.smithi152.stdout:7/416: write db/d27/f6e [490446,72896] 0 2023-12-07T16:21:36.076 INFO:tasks.workunit.client.1.smithi152.stdout:7/417: fsync db/f4a 0 2023-12-07T16:21:36.099 INFO:tasks.workunit.client.1.smithi152.stdout:2/427: dwrite d2/d1c/d2e/f44 [0,4194304] 0 2023-12-07T16:21:36.099 INFO:tasks.workunit.client.1.smithi152.stdout:7/418: dwrite db/d27/d39/d41/f4f [0,4194304] 0 2023-12-07T16:21:36.099 INFO:tasks.workunit.client.1.smithi152.stdout:2/428: write d2/d1c/f80 [494198,19143] 0 2023-12-07T16:21:36.099 INFO:tasks.workunit.client.1.smithi152.stdout:2/429: fdatasync d2/d1c/f69 0 2023-12-07T16:21:36.099 INFO:tasks.workunit.client.1.smithi152.stdout:2/430: readlink d2/d1c/l3f 0 2023-12-07T16:21:36.099 INFO:tasks.workunit.client.1.smithi152.stdout:7/419: write db/d27/d39/d41/d37/f64 [259390,100561] 0 2023-12-07T16:21:36.102 INFO:tasks.workunit.client.1.smithi152.stdout:8/455: dwrite d3/d4/f5c [0,4194304] 0 2023-12-07T16:21:36.102 INFO:tasks.workunit.client.1.smithi152.stdout:7/420: link db/d27/d4d/f6d db/d27/d39/d63/f77 0 2023-12-07T16:21:36.102 INFO:tasks.workunit.client.1.smithi152.stdout:7/421: truncate db/d27/f56 440418 0 2023-12-07T16:21:36.103 INFO:tasks.workunit.client.0.smithi063.stdout:6/250: truncate d0/d1e/d1d/f3d 71293 0 2023-12-07T16:21:36.103 INFO:tasks.workunit.client.1.smithi152.stdout:2/431: creat d2/d1c/d2e/d30/d53/d9a/f9c x:0 0 0 2023-12-07T16:21:36.108 INFO:tasks.workunit.client.0.smithi063.stdout:8/302: truncate d7/d14/f35 3149077 0 2023-12-07T16:21:36.108 INFO:tasks.workunit.client.0.smithi063.stdout:8/303: fdatasync d7/d14/d1a/f31 0 2023-12-07T16:21:36.108 INFO:tasks.workunit.client.0.smithi063.stdout:8/304: write d7/d14/d1a/f50 [693167,63397] 0 2023-12-07T16:21:36.109 INFO:tasks.workunit.client.0.smithi063.stdout:8/305: write d7/d14/d15/f47 [189105,2610] 0 2023-12-07T16:21:36.109 INFO:tasks.workunit.client.1.smithi152.stdout:8/456: mknod d3/d4/d9/d23/ca5 0 2023-12-07T16:21:36.109 INFO:tasks.workunit.client.1.smithi152.stdout:7/422: rmdir db/d27/d39/d63 39 2023-12-07T16:21:36.110 INFO:tasks.workunit.client.1.smithi152.stdout:7/423: mknod db/d27/d39/d41/c78 0 2023-12-07T16:21:36.111 INFO:tasks.workunit.client.1.smithi152.stdout:7/424: symlink db/d27/d39/l79 0 2023-12-07T16:21:36.112 INFO:tasks.workunit.client.1.smithi152.stdout:7/425: rmdir db/d27/d39/d41 39 2023-12-07T16:21:36.113 INFO:tasks.workunit.client.1.smithi152.stdout:8/457: dread d3/d4/d9/dc/f20 [0,4194304] 0 2023-12-07T16:21:36.114 INFO:tasks.workunit.client.1.smithi152.stdout:8/458: mkdir d3/d4/d9/d23/d4c/da6 0 2023-12-07T16:21:36.115 INFO:tasks.workunit.client.1.smithi152.stdout:8/459: truncate d3/d4/d9/f38 1435009 0 2023-12-07T16:21:36.117 INFO:tasks.workunit.client.1.smithi152.stdout:7/426: write db/d27/d39/d41/d37/f3f [2365460,79631] 0 2023-12-07T16:21:36.117 INFO:tasks.workunit.client.1.smithi152.stdout:2/432: dwrite d2/d1c/f7a [0,4194304] 0 2023-12-07T16:21:36.117 INFO:tasks.workunit.client.1.smithi152.stdout:2/433: chown d2/d1c/d2e/d38/l72 389 1 2023-12-07T16:21:36.119 INFO:tasks.workunit.client.1.smithi152.stdout:2/434: rmdir d2/d1c/d2e/d30/d42/d84 39 2023-12-07T16:21:36.119 INFO:tasks.workunit.client.0.smithi063.stdout:9/198: rename d0/d13/f17 to d0/d13/f3d 0 2023-12-07T16:21:36.122 INFO:tasks.workunit.client.0.smithi063.stdout:3/167: sync 2023-12-07T16:21:36.122 INFO:tasks.workunit.client.0.smithi063.stdout:1/142: sync 2023-12-07T16:21:36.124 INFO:tasks.workunit.client.0.smithi063.stdout:7/178: rmdir d2 39 2023-12-07T16:21:36.124 INFO:tasks.workunit.client.0.smithi063.stdout:2/187: truncate d0/d1e/f34 3623621 0 2023-12-07T16:21:36.124 INFO:tasks.workunit.client.0.smithi063.stdout:7/179: chown d2/de/d2a/f35 1177766 1 2023-12-07T16:21:36.124 INFO:tasks.workunit.client.0.smithi063.stdout:2/188: fsync d0/f10 0 2023-12-07T16:21:36.124 INFO:tasks.workunit.client.0.smithi063.stdout:2/189: fsync d0/f1f 0 2023-12-07T16:21:36.124 INFO:tasks.workunit.client.0.smithi063.stdout:0/265: rmdir d4 39 2023-12-07T16:21:36.127 INFO:tasks.workunit.client.0.smithi063.stdout:6/251: link d0/ff d0/d17/d46/f59 0 2023-12-07T16:21:36.127 INFO:tasks.workunit.client.0.smithi063.stdout:6/252: fsync d0/d1e/d1d/d1f/f28 0 2023-12-07T16:21:36.128 INFO:tasks.workunit.client.1.smithi152.stdout:8/460: dread d3/d4/d9/d34/f3f [0,4194304] 0 2023-12-07T16:21:36.133 INFO:tasks.workunit.client.0.smithi063.stdout:8/306: getdents d7/d14/d15/d48 0 2023-12-07T16:21:36.133 INFO:tasks.workunit.client.0.smithi063.stdout:8/307: readlink d7/d14/d1a/l3d 0 2023-12-07T16:21:36.133 INFO:tasks.workunit.client.0.smithi063.stdout:8/308: chown d7/l25 104667731 1 2023-12-07T16:21:36.134 INFO:tasks.workunit.client.1.smithi152.stdout:2/435: dread d2/d1c/d2e/d38/d90/f4b [0,4194304] 0 2023-12-07T16:21:36.138 INFO:tasks.workunit.client.1.smithi152.stdout:2/436: creat d2/d1c/d52/f9d x:0 0 0 2023-12-07T16:21:36.138 INFO:tasks.workunit.client.1.smithi152.stdout:2/437: chown d2/d1c/d2e/d30/d33 10088 1 2023-12-07T16:21:36.138 INFO:tasks.workunit.client.1.smithi152.stdout:2/438: chown d2/d1c/c7e 101045 1 2023-12-07T16:21:36.139 INFO:tasks.workunit.client.0.smithi063.stdout:3/168: creat d7/d9/f33 x:0 0 0 2023-12-07T16:21:36.141 INFO:tasks.workunit.client.0.smithi063.stdout:7/180: creat d2/de/f47 x:0 0 0 2023-12-07T16:21:36.142 INFO:tasks.workunit.client.0.smithi063.stdout:2/190: creat d0/d26/d11/f3c x:0 0 0 2023-12-07T16:21:36.146 INFO:tasks.workunit.client.0.smithi063.stdout:0/266: creat d4/f55 x:0 0 0 2023-12-07T16:21:36.146 INFO:tasks.workunit.client.0.smithi063.stdout:0/267: readlink d4/dd/de/d15/d1f/l31 0 2023-12-07T16:21:36.146 INFO:tasks.workunit.client.0.smithi063.stdout:6/253: mkdir d0/d17/d1a/d4d/d5a 0 2023-12-07T16:21:36.147 INFO:tasks.workunit.client.0.smithi063.stdout:5/171: rmdir d1 39 2023-12-07T16:21:36.147 INFO:tasks.workunit.client.0.smithi063.stdout:5/172: stat d1/d3/de/d1e/f21 0 2023-12-07T16:21:36.149 INFO:tasks.workunit.client.0.smithi063.stdout:8/309: mknod d7/d14/d15/d2b/d40/c5d 0 2023-12-07T16:21:36.149 INFO:tasks.workunit.client.0.smithi063.stdout:8/310: write d7/d14/d15/f47 [921521,83341] 0 2023-12-07T16:21:36.150 INFO:tasks.workunit.client.0.smithi063.stdout:1/143: link d0/dd/d1f/c23 d0/dd/d10/d13/c2a 0 2023-12-07T16:21:36.151 INFO:tasks.workunit.client.0.smithi063.stdout:3/169: creat d7/d21/f34 x:0 0 0 2023-12-07T16:21:36.152 INFO:tasks.workunit.client.0.smithi063.stdout:3/170: chown d7/d9/d1b/l23 3 1 2023-12-07T16:21:36.152 INFO:tasks.workunit.client.0.smithi063.stdout:7/181: mkdir d2/d34/d46/d48 0 2023-12-07T16:21:36.153 INFO:tasks.workunit.client.0.smithi063.stdout:2/191: symlink d0/d1e/l3d 0 2023-12-07T16:21:36.154 INFO:tasks.workunit.client.0.smithi063.stdout:0/268: symlink d4/dd/d26/d2b/l56 0 2023-12-07T16:21:36.154 INFO:tasks.workunit.client.0.smithi063.stdout:0/269: dread - d4/d25/f4b zero size 2023-12-07T16:21:36.155 INFO:tasks.workunit.client.0.smithi063.stdout:5/173: rmdir d1/d3/d2b 0 2023-12-07T16:21:36.157 INFO:tasks.workunit.client.0.smithi063.stdout:9/199: dwrite d0/d7/f16 [0,4194304] 0 2023-12-07T16:21:36.157 INFO:tasks.workunit.client.0.smithi063.stdout:6/254: dread d0/d1e/d1d/d1f/f28 [0,4194304] 0 2023-12-07T16:21:36.157 INFO:tasks.workunit.client.0.smithi063.stdout:8/311: symlink d7/d38/l5e 0 2023-12-07T16:21:36.159 INFO:tasks.workunit.client.0.smithi063.stdout:1/144: creat d0/dd/d10/d1b/f2b x:0 0 0 2023-12-07T16:21:36.160 INFO:tasks.workunit.client.1.smithi152.stdout:8/461: dwrite d3/f1d [0,4194304] 0 2023-12-07T16:21:36.160 INFO:tasks.workunit.client.1.smithi152.stdout:8/462: read d3/d4/f35 [971653,14878] 0 2023-12-07T16:21:36.160 INFO:tasks.workunit.client.1.smithi152.stdout:8/463: chown d3/d1e/d40/d74/f86 22001 1 2023-12-07T16:21:36.160 INFO:tasks.workunit.client.1.smithi152.stdout:2/439: dwrite d2/d1c/d2e/f64 [0,4194304] 0 2023-12-07T16:21:36.161 INFO:tasks.workunit.client.1.smithi152.stdout:2/440: write d2/d1c/d2e/f3e [1659058,37857] 0 2023-12-07T16:21:36.161 INFO:tasks.workunit.client.1.smithi152.stdout:2/441: chown d2/d1c/d2e/d30/d53/f88 357 1 2023-12-07T16:21:36.161 INFO:tasks.workunit.client.0.smithi063.stdout:4/171: dwrite d1/d3/db/d13/f2a [0,4194304] 0 2023-12-07T16:21:36.163 INFO:tasks.workunit.client.0.smithi063.stdout:3/171: mknod d7/d9/d2b/c35 0 2023-12-07T16:21:36.164 INFO:tasks.workunit.client.0.smithi063.stdout:7/182: creat d2/d21/f49 x:0 0 0 2023-12-07T16:21:36.165 INFO:tasks.workunit.client.1.smithi152.stdout:8/464: getdents d3/d4/d9/d34 0 2023-12-07T16:21:36.166 INFO:tasks.workunit.client.0.smithi063.stdout:3/172: dread d7/d21/f25 [0,4194304] 0 2023-12-07T16:21:36.166 INFO:tasks.workunit.client.0.smithi063.stdout:3/173: write d7/d9/dd/f1c [480750,77792] 0 2023-12-07T16:21:36.166 INFO:tasks.workunit.client.0.smithi063.stdout:3/174: chown d7/d9/d2b/c35 381505 1 2023-12-07T16:21:36.166 INFO:tasks.workunit.client.0.smithi063.stdout:3/175: readlink d7/l17 0 2023-12-07T16:21:36.167 INFO:tasks.workunit.client.0.smithi063.stdout:0/270: rename d4/dd/l1b to d4/dd/de/d15/d1f/l57 0 2023-12-07T16:21:36.167 INFO:tasks.workunit.client.0.smithi063.stdout:0/271: dread - d4/dd/de/d15/d52/f53 zero size 2023-12-07T16:21:36.169 INFO:tasks.workunit.client.0.smithi063.stdout:9/200: mkdir d0/d13/d39/d3a/d3e 0 2023-12-07T16:21:36.170 INFO:tasks.workunit.client.0.smithi063.stdout:6/255: mknod d0/d1e/d20/d4a/c5b 0 2023-12-07T16:21:36.172 INFO:tasks.workunit.client.0.smithi063.stdout:8/312: rmdir d7/d14/d1a 39 2023-12-07T16:21:36.174 INFO:tasks.workunit.client.0.smithi063.stdout:3/176: dread d7/fe [0,4194304] 0 2023-12-07T16:21:36.175 INFO:tasks.workunit.client.0.smithi063.stdout:8/313: write d7/d14/d1a/f29 [2486781,72044] 0 2023-12-07T16:21:36.175 INFO:tasks.workunit.client.0.smithi063.stdout:1/145: creat d0/dd/d10/d1e/f2c x:0 0 0 2023-12-07T16:21:36.176 INFO:tasks.workunit.client.0.smithi063.stdout:5/174: dwrite d1/d3/f2d [0,4194304] 0 2023-12-07T16:21:36.177 INFO:tasks.workunit.client.1.smithi152.stdout:1/505: sync 2023-12-07T16:21:36.177 INFO:tasks.workunit.client.1.smithi152.stdout:6/392: sync 2023-12-07T16:21:36.178 INFO:tasks.workunit.client.1.smithi152.stdout:6/393: write d2/d6/f25 [842659,64274] 0 2023-12-07T16:21:36.178 INFO:tasks.workunit.client.0.smithi063.stdout:4/172: getdents d1/d3/db 0 2023-12-07T16:21:36.178 INFO:tasks.workunit.client.0.smithi063.stdout:4/173: stat d1/d3/db/d16/c2f 0 2023-12-07T16:21:36.179 INFO:tasks.workunit.client.0.smithi063.stdout:7/183: creat d2/de/d2a/f4a x:0 0 0 2023-12-07T16:21:36.180 INFO:tasks.workunit.client.0.smithi063.stdout:9/201: mknod d0/d13/d39/c3f 0 2023-12-07T16:21:36.180 INFO:tasks.workunit.client.1.smithi152.stdout:4/350: sync 2023-12-07T16:21:36.180 INFO:tasks.workunit.client.1.smithi152.stdout:4/351: readlink d0/d3/d6/dc/l45 0 2023-12-07T16:21:36.181 INFO:tasks.workunit.client.1.smithi152.stdout:4/352: truncate d0/d3/d6/dc/d22/f4d 4959971 0 2023-12-07T16:21:36.181 INFO:tasks.workunit.client.1.smithi152.stdout:1/506: mkdir dc/d28/d7d/da4 0 2023-12-07T16:21:36.181 INFO:tasks.workunit.client.1.smithi152.stdout:1/507: getdents dc/d28/d4e 0 2023-12-07T16:21:36.184 INFO:tasks.workunit.client.1.smithi152.stdout:8/465: dread d3/d4/f5c [0,4194304] 0 2023-12-07T16:21:36.184 INFO:tasks.workunit.client.1.smithi152.stdout:6/394: read d2/f4 [1052344,73802] 0 2023-12-07T16:21:36.184 INFO:tasks.workunit.client.1.smithi152.stdout:6/395: stat d2/d6/de/d2e/c64 0 2023-12-07T16:21:36.186 INFO:tasks.workunit.client.1.smithi152.stdout:8/466: mkdir d3/da7 0 2023-12-07T16:21:36.187 INFO:tasks.workunit.client.0.smithi063.stdout:6/256: unlink d0/l9 0 2023-12-07T16:21:36.187 INFO:tasks.workunit.client.1.smithi152.stdout:6/396: creat d2/d6/de/d2e/d38/f7b x:0 0 0 2023-12-07T16:21:36.187 INFO:tasks.workunit.client.1.smithi152.stdout:6/397: fsync d2/d6/f6a 0 2023-12-07T16:21:36.188 INFO:tasks.workunit.client.1.smithi152.stdout:8/467: rmdir d3/d4/d9/dc 39 2023-12-07T16:21:36.190 INFO:tasks.workunit.client.1.smithi152.stdout:4/353: write d0/d3/d6/dc/d22/f4d [4658540,90508] 0 2023-12-07T16:21:36.190 INFO:tasks.workunit.client.1.smithi152.stdout:4/354: rename d0 to d0/d3/d6/dc/d39/d65 22 2023-12-07T16:21:36.190 INFO:tasks.workunit.client.1.smithi152.stdout:4/355: stat d0/d3/d6/dc/d22/f32 0 2023-12-07T16:21:36.190 INFO:tasks.workunit.client.1.smithi152.stdout:4/356: chown d0/d3/d6/dc/d3a/d48/d4c/f52 22434 1 2023-12-07T16:21:36.190 INFO:tasks.workunit.client.1.smithi152.stdout:4/357: chown d0/d3/d6/dc/d3a/f58 0 1 2023-12-07T16:21:36.190 INFO:tasks.workunit.client.1.smithi152.stdout:8/468: getdents d3/d4/d9/dc 0 2023-12-07T16:21:36.190 INFO:tasks.workunit.client.1.smithi152.stdout:8/469: chown d3/d4/l52 1486322 1 2023-12-07T16:21:36.191 INFO:tasks.workunit.client.0.smithi063.stdout:8/314: creat d7/d14/d15/d48/f5f x:0 0 0 2023-12-07T16:21:36.191 INFO:tasks.workunit.client.1.smithi152.stdout:4/358: mknod d0/d3/d6/d2b/d56/c66 0 2023-12-07T16:21:36.191 INFO:tasks.workunit.client.1.smithi152.stdout:4/359: fdatasync d0/d3/d6/dc/d3a/f3e 0 2023-12-07T16:21:36.192 INFO:tasks.workunit.client.0.smithi063.stdout:1/146: mknod d0/dd/d19/c2d 0 2023-12-07T16:21:36.192 INFO:tasks.workunit.client.1.smithi152.stdout:8/470: creat d3/d4/d9/dc/d6f/d7a/fa8 x:0 0 0 2023-12-07T16:21:36.192 INFO:tasks.workunit.client.1.smithi152.stdout:6/398: write d2/f3 [1764407,126493] 0 2023-12-07T16:21:36.192 INFO:tasks.workunit.client.1.smithi152.stdout:6/399: chown d2/d6/l16 11 1 2023-12-07T16:21:36.193 INFO:tasks.workunit.client.0.smithi063.stdout:9/202: write d0/d7/f1e [3503027,23794] 0 2023-12-07T16:21:36.194 INFO:tasks.workunit.client.1.smithi152.stdout:4/360: rename d0/d3/d6/d2b/d63 to d0/d3/d6/dc/dd/d67 0 2023-12-07T16:21:36.195 INFO:tasks.workunit.client.0.smithi063.stdout:5/175: rename d1/d3/f2d to d1/d31/f33 0 2023-12-07T16:21:36.196 INFO:tasks.workunit.client.0.smithi063.stdout:4/174: creat d1/d3/f32 x:0 0 0 2023-12-07T16:21:36.196 INFO:tasks.workunit.client.0.smithi063.stdout:4/175: chown d1 260 1 2023-12-07T16:21:36.199 INFO:tasks.workunit.client.0.smithi063.stdout:0/272: dwrite d4/f17 [4194304,4194304] 0 2023-12-07T16:21:36.199 INFO:tasks.workunit.client.0.smithi063.stdout:0/273: write d4/dd/de/d15/d1f/f4a [272802,43160] 0 2023-12-07T16:21:36.199 INFO:tasks.workunit.client.0.smithi063.stdout:7/184: symlink d2/d21/l4b 0 2023-12-07T16:21:36.199 INFO:tasks.workunit.client.0.smithi063.stdout:3/177: dwrite d7/fc [0,4194304] 0 2023-12-07T16:21:36.200 INFO:tasks.workunit.client.0.smithi063.stdout:6/257: mknod d0/d17/d46/c5c 0 2023-12-07T16:21:36.200 INFO:tasks.workunit.client.0.smithi063.stdout:6/258: readlink d0/d1e/d1d/l33 0 2023-12-07T16:21:36.200 INFO:tasks.workunit.client.0.smithi063.stdout:6/259: chown d0/d17/f25 423189 1 2023-12-07T16:21:36.201 INFO:tasks.workunit.client.0.smithi063.stdout:8/315: creat d7/d14/d15/d2b/f60 x:0 0 0 2023-12-07T16:21:36.203 INFO:tasks.workunit.client.1.smithi152.stdout:4/361: dread d0/d3/d6/f1d [0,4194304] 0 2023-12-07T16:21:36.203 INFO:tasks.workunit.client.0.smithi063.stdout:1/147: creat d0/dd/d10/d1e/f2e x:0 0 0 2023-12-07T16:21:36.203 INFO:tasks.workunit.client.0.smithi063.stdout:1/148: truncate d0/dd/d10/f27 38830 0 2023-12-07T16:21:36.204 INFO:tasks.workunit.client.0.smithi063.stdout:4/176: dread - d1/d3/db/d13/f1c zero size 2023-12-07T16:21:36.205 INFO:tasks.workunit.client.0.smithi063.stdout:9/203: dread d0/f31 [0,4194304] 0 2023-12-07T16:21:36.205 INFO:tasks.workunit.client.0.smithi063.stdout:9/204: truncate d0/d21/f2c 341475 0 2023-12-07T16:21:36.205 INFO:tasks.workunit.client.0.smithi063.stdout:9/205: truncate d0/d13/f25 434093 0 2023-12-07T16:21:36.205 INFO:tasks.workunit.client.0.smithi063.stdout:0/274: rmdir d4/dd/de 39 2023-12-07T16:21:36.206 INFO:tasks.workunit.client.0.smithi063.stdout:4/177: write d1/d3/f8 [147208,108720] 0 2023-12-07T16:21:36.206 INFO:tasks.workunit.client.0.smithi063.stdout:4/178: write d1/d3/f31 [620599,13965] 0 2023-12-07T16:21:36.207 INFO:tasks.workunit.client.0.smithi063.stdout:7/185: dread d2/f26 [0,4194304] 0 2023-12-07T16:21:36.214 INFO:tasks.workunit.client.0.smithi063.stdout:6/260: creat d0/d17/f5d x:0 0 0 2023-12-07T16:21:36.217 INFO:tasks.workunit.client.0.smithi063.stdout:8/316: creat d7/f61 x:0 0 0 2023-12-07T16:21:36.218 INFO:tasks.workunit.client.0.smithi063.stdout:9/206: dread d0/f30 [0,4194304] 0 2023-12-07T16:21:36.219 INFO:tasks.workunit.client.1.smithi152.stdout:6/400: dwrite d2/f24 [0,4194304] 0 2023-12-07T16:21:36.221 INFO:tasks.workunit.client.0.smithi063.stdout:1/149: mkdir d0/dd/d10/d13/d2f 0 2023-12-07T16:21:36.224 INFO:tasks.workunit.client.0.smithi063.stdout:4/179: unlink d1/d3/f31 0 2023-12-07T16:21:36.225 INFO:tasks.workunit.client.0.smithi063.stdout:7/186: truncate d2/f12 504293 0 2023-12-07T16:21:36.227 INFO:tasks.workunit.client.0.smithi063.stdout:6/261: unlink d0/fa 0 2023-12-07T16:21:36.228 INFO:tasks.workunit.client.0.smithi063.stdout:9/207: rmdir d0/d13/d39 39 2023-12-07T16:21:36.230 INFO:tasks.workunit.client.0.smithi063.stdout:1/150: symlink d0/dd/d10/d1e/l30 0 2023-12-07T16:21:36.232 INFO:tasks.workunit.client.0.smithi063.stdout:9/208: write d0/d7/f16 [529060,52057] 0 2023-12-07T16:21:36.241 INFO:tasks.workunit.client.0.smithi063.stdout:1/151: creat d0/dd/d10/d1e/f31 x:0 0 0 2023-12-07T16:21:36.243 INFO:tasks.workunit.client.1.smithi152.stdout:4/362: dwrite d0/d3/d6/f2e [0,4194304] 0 2023-12-07T16:21:36.247 INFO:tasks.workunit.client.0.smithi063.stdout:1/152: rename d0/dd/c14 to d0/dd/d10/d13/c32 0 2023-12-07T16:21:36.250 INFO:tasks.workunit.client.1.smithi152.stdout:4/363: read d0/f5 [2823918,37669] 0 2023-12-07T16:21:36.250 INFO:tasks.workunit.client.1.smithi152.stdout:4/364: chown d0/d3/f2d 7613977 1 2023-12-07T16:21:36.250 INFO:tasks.workunit.client.1.smithi152.stdout:4/365: truncate d0/d17/f5f 771914 0 2023-12-07T16:21:36.250 INFO:tasks.workunit.client.1.smithi152.stdout:4/366: read - d0/d3/d6/f26 zero size 2023-12-07T16:21:36.250 INFO:tasks.workunit.client.1.smithi152.stdout:4/367: chown d0/f1 0 1 2023-12-07T16:21:36.250 INFO:tasks.workunit.client.1.smithi152.stdout:4/368: write d0/d3/d6/f27 [1617093,23293] 0 2023-12-07T16:21:36.254 INFO:tasks.workunit.client.0.smithi063.stdout:1/153: creat d0/dd/d10/d1e/f33 x:0 0 0 2023-12-07T16:21:36.254 INFO:tasks.workunit.client.0.smithi063.stdout:5/176: dwrite d1/f18 [0,4194304] 0 2023-12-07T16:21:36.260 INFO:tasks.workunit.client.0.smithi063.stdout:0/275: dwrite d4/dd/f14 [0,4194304] 0 2023-12-07T16:21:36.266 INFO:tasks.workunit.client.0.smithi063.stdout:0/276: write d4/dd/de/f13 [201745,54602] 0 2023-12-07T16:21:36.267 INFO:tasks.workunit.client.0.smithi063.stdout:0/277: write d4/d25/f2f [85761,46454] 0 2023-12-07T16:21:36.270 INFO:tasks.workunit.client.0.smithi063.stdout:5/177: creat d1/f34 x:0 0 0 2023-12-07T16:21:36.276 INFO:tasks.workunit.client.0.smithi063.stdout:2/192: dwrite d0/d1e/f34 [0,4194304] 0 2023-12-07T16:21:36.276 INFO:tasks.workunit.client.0.smithi063.stdout:2/193: fsync d0/d21/f37 0 2023-12-07T16:21:36.276 INFO:tasks.workunit.client.0.smithi063.stdout:4/180: dwrite d1/d3/db/f20 [0,4194304] 0 2023-12-07T16:21:36.277 INFO:tasks.workunit.client.0.smithi063.stdout:4/181: fsync d1/f28 0 2023-12-07T16:21:36.278 INFO:tasks.workunit.client.0.smithi063.stdout:0/278: mknod d4/dd/de/d15/d1f/d22/c58 0 2023-12-07T16:21:36.278 INFO:tasks.workunit.client.0.smithi063.stdout:2/194: dread d0/d26/d11/f1a [0,4194304] 0 2023-12-07T16:21:36.278 INFO:tasks.workunit.client.0.smithi063.stdout:2/195: fsync d0/d1e/f29 0 2023-12-07T16:21:36.279 INFO:tasks.workunit.client.0.smithi063.stdout:5/178: rmdir d1/d3/de 39 2023-12-07T16:21:36.279 INFO:tasks.workunit.client.1.smithi152.stdout:6/401: dwrite d2/d6/de/d45/d55/f5e [0,4194304] 0 2023-12-07T16:21:36.280 INFO:tasks.workunit.client.0.smithi063.stdout:7/187: dwrite d2/f1e [4194304,4194304] 0 2023-12-07T16:21:36.280 INFO:tasks.workunit.client.0.smithi063.stdout:3/178: dwrite d7/d9/dd/f2a [0,4194304] 0 2023-12-07T16:21:36.280 INFO:tasks.workunit.client.0.smithi063.stdout:3/179: fsync d7/d21/f34 0 2023-12-07T16:21:36.282 INFO:tasks.workunit.client.1.smithi152.stdout:4/369: dwrite d0/d3/d6/f26 [0,4194304] 0 2023-12-07T16:21:36.282 INFO:tasks.workunit.client.1.smithi152.stdout:4/370: write d0/d3/d6/dc/d22/f32 [4586556,70084] 0 2023-12-07T16:21:36.282 INFO:tasks.workunit.client.0.smithi063.stdout:9/209: dwrite d0/d13/f2b [0,4194304] 0 2023-12-07T16:21:36.285 INFO:tasks.workunit.client.1.smithi152.stdout:6/402: unlink d2/d6/de/d2e/d4c/d5d/f5f 0 2023-12-07T16:21:36.285 INFO:tasks.workunit.client.1.smithi152.stdout:6/403: chown d2/d6/de/d2e/l3d 12103587 1 2023-12-07T16:21:36.285 INFO:tasks.workunit.client.1.smithi152.stdout:6/404: readlink d2/d6/l32 0 2023-12-07T16:21:36.290 INFO:tasks.workunit.client.1.smithi152.stdout:4/371: getdents d0/d3/d6/dc/d22 0 2023-12-07T16:21:36.290 INFO:tasks.workunit.client.1.smithi152.stdout:4/372: write d0/d3/d6/dc/d3a/d48/d4c/f52 [466003,108773] 0 2023-12-07T16:21:36.292 INFO:tasks.workunit.client.1.smithi152.stdout:4/373: unlink d0/d17/f5f 0 2023-12-07T16:21:36.307 INFO:tasks.workunit.client.0.smithi063.stdout:0/279: dwrite d4/dd/d26/d2b/f33 [0,4194304] 0 2023-12-07T16:21:36.307 INFO:tasks.workunit.client.0.smithi063.stdout:0/280: chown d4/dd/de/d15/d1f/d22/l32 12 1 2023-12-07T16:21:36.309 INFO:tasks.workunit.client.0.smithi063.stdout:9/210: dwrite d0/f30 [0,4194304] 0 2023-12-07T16:21:36.310 INFO:tasks.workunit.client.1.smithi152.stdout:4/374: dwrite d0/d17/f53 [0,4194304] 0 2023-12-07T16:21:36.311 INFO:tasks.workunit.client.0.smithi063.stdout:0/281: dread d4/dd/de/f20 [4194304,4194304] 0 2023-12-07T16:21:36.313 INFO:tasks.workunit.client.0.smithi063.stdout:0/282: write d4/dd/de/f19 [3654335,81910] 0 2023-12-07T16:21:36.314 INFO:tasks.workunit.client.1.smithi152.stdout:3/444: sync 2023-12-07T16:21:36.314 INFO:tasks.workunit.client.1.smithi152.stdout:0/473: sync 2023-12-07T16:21:36.314 INFO:tasks.workunit.client.1.smithi152.stdout:3/445: chown d7/dc/d3e/d62/d6d 12123 1 2023-12-07T16:21:36.316 INFO:tasks.workunit.client.1.smithi152.stdout:3/446: dread d7/d10/d1a/f43 [4194304,4194304] 0 2023-12-07T16:21:36.316 INFO:tasks.workunit.client.1.smithi152.stdout:3/447: fsync d7/dc/f1b 0 2023-12-07T16:21:36.320 INFO:tasks.workunit.client.1.smithi152.stdout:3/448: read d7/dc/f12 [3424890,28149] 0 2023-12-07T16:21:36.324 INFO:tasks.workunit.client.0.smithi063.stdout:0/283: dread d4/dd/f14 [0,4194304] 0 2023-12-07T16:21:36.338 INFO:tasks.workunit.client.1.smithi152.stdout:4/375: dwrite d0/d3/d6/dc/d22/f60 [0,4194304] 0 2023-12-07T16:21:36.339 INFO:tasks.workunit.client.1.smithi152.stdout:3/449: dwrite d7/dc/d14/f39 [0,4194304] 0 2023-12-07T16:21:36.339 INFO:tasks.workunit.client.0.smithi063.stdout:9/211: dwrite d0/d21/f2c [0,4194304] 0 2023-12-07T16:21:36.340 INFO:tasks.workunit.client.1.smithi152.stdout:4/376: mknod d0/d3/d6/dc/d22/c68 0 2023-12-07T16:21:36.342 INFO:tasks.workunit.client.1.smithi152.stdout:3/450: dread d7/dc/d3e/d62/d6d/f73 [0,4194304] 0 2023-12-07T16:21:36.342 INFO:tasks.workunit.client.1.smithi152.stdout:3/451: dread - d7/d10/d1a/d25/f76 zero size 2023-12-07T16:21:36.342 INFO:tasks.workunit.client.1.smithi152.stdout:4/377: mknod d0/d3/d6/d2b/c69 0 2023-12-07T16:21:36.342 INFO:tasks.workunit.client.1.smithi152.stdout:4/378: chown d0/d3/d6/d2b 1306 1 2023-12-07T16:21:36.342 INFO:tasks.workunit.client.1.smithi152.stdout:4/379: creat d0/d3/d6/f6a x:0 0 0 2023-12-07T16:21:36.344 INFO:tasks.workunit.client.1.smithi152.stdout:4/380: mknod d0/d3/d6/d2b/d56/c6b 0 2023-12-07T16:21:36.351 INFO:tasks.workunit.client.1.smithi152.stdout:4/381: dread d0/d3/f2a [0,4194304] 0 2023-12-07T16:21:36.351 INFO:tasks.workunit.client.1.smithi152.stdout:4/382: readlink d0/d3/l5a 0 2023-12-07T16:21:36.352 INFO:tasks.workunit.client.1.smithi152.stdout:4/383: creat d0/d3/d6/dc/dd/f6c x:0 0 0 2023-12-07T16:21:36.352 INFO:tasks.workunit.client.1.smithi152.stdout:4/384: getdents d0/d3/d6/dc/d3a/d48/d4c 0 2023-12-07T16:21:36.352 INFO:tasks.workunit.client.1.smithi152.stdout:4/385: fdatasync d0/d3/d6/dc/d22/f54 0 2023-12-07T16:21:36.354 INFO:tasks.workunit.client.1.smithi152.stdout:4/386: link d0/d3/d6/d36/f44 d0/d3/f6d 0 2023-12-07T16:21:36.355 INFO:tasks.workunit.client.1.smithi152.stdout:4/387: mknod d0/d3/d6/dc/d3a/d46/c6e 0 2023-12-07T16:21:36.374 INFO:tasks.workunit.client.1.smithi152.stdout:4/388: dwrite d0/d3/f7 [4194304,4194304] 0 2023-12-07T16:21:36.389 INFO:tasks.workunit.client.1.smithi152.stdout:4/389: dwrite d0/d3/f3c [0,4194304] 0 2023-12-07T16:21:36.389 INFO:tasks.workunit.client.1.smithi152.stdout:4/390: fsync d0/d3/f2d 0 2023-12-07T16:21:36.390 INFO:tasks.workunit.client.1.smithi152.stdout:4/391: symlink d0/d3/d6/dc/l6f 0 2023-12-07T16:21:36.394 INFO:tasks.workunit.client.1.smithi152.stdout:4/392: truncate d0/d3/f3c 3540313 0 2023-12-07T16:21:36.395 INFO:tasks.workunit.client.1.smithi152.stdout:4/393: creat d0/d3/d6/d2b/d56/f70 x:0 0 0 2023-12-07T16:21:36.396 INFO:tasks.workunit.client.1.smithi152.stdout:4/394: unlink d0/d3/d6/f27 0 2023-12-07T16:21:36.397 INFO:tasks.workunit.client.1.smithi152.stdout:4/395: fdatasync d0/d3/d6/dc/dd/f6c 0 2023-12-07T16:21:36.397 INFO:tasks.workunit.client.1.smithi152.stdout:4/396: mknod d0/d3/d6/dc/dd/c71 0 2023-12-07T16:21:36.402 INFO:tasks.workunit.client.1.smithi152.stdout:4/397: rmdir d0/d3/d6/dc/dd 39 2023-12-07T16:21:36.402 INFO:tasks.workunit.client.1.smithi152.stdout:4/398: truncate d0/d17/f43 653140 0 2023-12-07T16:21:36.403 INFO:tasks.workunit.client.1.smithi152.stdout:4/399: creat d0/d3/d6/d5c/f72 x:0 0 0 2023-12-07T16:21:36.403 INFO:tasks.workunit.client.1.smithi152.stdout:4/400: fdatasync d0/d3/d6/dc/d39/f5e 0 2023-12-07T16:21:36.404 INFO:tasks.workunit.client.0.smithi063.stdout:4/182: rmdir d1/d3 39 2023-12-07T16:21:36.405 INFO:tasks.workunit.client.0.smithi063.stdout:2/196: creat d0/d1e/f3e x:0 0 0 2023-12-07T16:21:36.406 INFO:tasks.workunit.client.0.smithi063.stdout:5/179: rmdir d1/d3 39 2023-12-07T16:21:36.406 INFO:tasks.workunit.client.0.smithi063.stdout:2/197: write d0/f14 [1249369,10982] 0 2023-12-07T16:21:36.416 INFO:tasks.workunit.client.0.smithi063.stdout:7/188: creat d2/d34/d46/d48/f4c x:0 0 0 2023-12-07T16:21:36.418 INFO:tasks.workunit.client.0.smithi063.stdout:3/180: mknod d7/d9/d1b/c36 0 2023-12-07T16:21:36.418 INFO:tasks.workunit.client.0.smithi063.stdout:3/181: fsync d7/d21/f29 0 2023-12-07T16:21:36.423 INFO:tasks.workunit.client.0.smithi063.stdout:0/284: rename d4/dd/de/d15/d1f/d30 to d4/dd/de/d15/d59 0 2023-12-07T16:21:36.423 INFO:tasks.workunit.client.0.smithi063.stdout:0/285: write d4/f55 [83951,34876] 0 2023-12-07T16:21:36.423 INFO:tasks.workunit.client.0.smithi063.stdout:0/286: dread - d4/d25/f4b zero size 2023-12-07T16:21:36.423 INFO:tasks.workunit.client.0.smithi063.stdout:0/287: readlink d4/dd/de/d15/d1f/l31 0 2023-12-07T16:21:36.423 INFO:tasks.workunit.client.0.smithi063.stdout:0/288: readlink d4/dd/d26/d2b/l56 0 2023-12-07T16:21:36.427 INFO:tasks.workunit.client.0.smithi063.stdout:9/212: creat d0/d13/f40 x:0 0 0 2023-12-07T16:21:36.428 INFO:tasks.workunit.client.0.smithi063.stdout:4/183: creat d1/d3/db/d13/f33 x:0 0 0 2023-12-07T16:21:36.428 INFO:tasks.workunit.client.0.smithi063.stdout:4/184: chown d1/d3/db/d16 4045783 1 2023-12-07T16:21:36.429 INFO:tasks.workunit.client.0.smithi063.stdout:5/180: creat d1/d3/f35 x:0 0 0 2023-12-07T16:21:36.431 INFO:tasks.workunit.client.0.smithi063.stdout:2/198: link d0/d26/d11/l27 d0/d21/d39/l3f 0 2023-12-07T16:21:36.433 INFO:tasks.workunit.client.0.smithi063.stdout:7/189: creat d2/de/f4d x:0 0 0 2023-12-07T16:21:36.434 INFO:tasks.workunit.client.0.smithi063.stdout:3/182: mknod d7/d9/d1b/c37 0 2023-12-07T16:21:36.436 INFO:tasks.workunit.client.0.smithi063.stdout:9/213: mknod d0/d13/d39/c41 0 2023-12-07T16:21:36.437 INFO:tasks.workunit.client.0.smithi063.stdout:0/289: dread d4/dd/de/f13 [0,4194304] 0 2023-12-07T16:21:36.437 INFO:tasks.workunit.client.0.smithi063.stdout:0/290: dread - d4/dd/de/d15/d52/f53 zero size 2023-12-07T16:21:36.437 INFO:tasks.workunit.client.0.smithi063.stdout:0/291: chown d4/dd/de/l42 137001 1 2023-12-07T16:21:36.437 INFO:tasks.workunit.client.0.smithi063.stdout:5/181: creat d1/d3/de/d1e/d25/f36 x:0 0 0 2023-12-07T16:21:36.439 INFO:tasks.workunit.client.0.smithi063.stdout:2/199: unlink d0/f1f 0 2023-12-07T16:21:36.439 INFO:tasks.workunit.client.0.smithi063.stdout:4/185: dread d1/d3/db/d13/f18 [0,4194304] 0 2023-12-07T16:21:36.439 INFO:tasks.workunit.client.0.smithi063.stdout:4/186: chown d1/f28 914 1 2023-12-07T16:21:36.440 INFO:tasks.workunit.client.0.smithi063.stdout:7/190: creat d2/f4e x:0 0 0 2023-12-07T16:21:36.440 INFO:tasks.workunit.client.0.smithi063.stdout:7/191: write d2/ff [877700,95248] 0 2023-12-07T16:21:36.441 INFO:tasks.workunit.client.0.smithi063.stdout:3/183: rmdir d7/d21 39 2023-12-07T16:21:36.441 INFO:tasks.workunit.client.0.smithi063.stdout:3/184: write f5 [5259717,69776] 0 2023-12-07T16:21:36.441 INFO:tasks.workunit.client.0.smithi063.stdout:0/292: dread d4/d25/f2f [0,4194304] 0 2023-12-07T16:21:36.443 INFO:tasks.workunit.client.0.smithi063.stdout:9/214: mkdir d0/d13/d39/d42 0 2023-12-07T16:21:36.443 INFO:tasks.workunit.client.0.smithi063.stdout:9/215: readlink d0/d13/l38 0 2023-12-07T16:21:36.444 INFO:tasks.workunit.client.0.smithi063.stdout:2/200: mkdir d0/d26/d40 0 2023-12-07T16:21:36.448 INFO:tasks.workunit.client.0.smithi063.stdout:4/187: unlink d1/d3/db/ce 0 2023-12-07T16:21:36.450 INFO:tasks.workunit.client.0.smithi063.stdout:3/185: creat d7/d9/d1b/f38 x:0 0 0 2023-12-07T16:21:36.454 INFO:tasks.workunit.client.0.smithi063.stdout:5/182: dread d1/d3/de/f10 [0,4194304] 0 2023-12-07T16:21:36.455 INFO:tasks.workunit.client.0.smithi063.stdout:0/293: rename d4/dd/de/d15/d1f/l31 to d4/dd/de/l5a 0 2023-12-07T16:21:36.455 INFO:tasks.workunit.client.0.smithi063.stdout:4/188: creat d1/f34 x:0 0 0 2023-12-07T16:21:36.455 INFO:tasks.workunit.client.0.smithi063.stdout:3/186: rmdir d7 39 2023-12-07T16:21:36.458 INFO:tasks.workunit.client.0.smithi063.stdout:5/183: dread d1/f2a [0,4194304] 0 2023-12-07T16:21:36.459 INFO:tasks.workunit.client.0.smithi063.stdout:0/294: mkdir d4/dd/de/d15/d52/d5b 0 2023-12-07T16:21:36.459 INFO:tasks.workunit.client.0.smithi063.stdout:0/295: readlink d4/dd/d26/l41 0 2023-12-07T16:21:36.459 INFO:tasks.workunit.client.0.smithi063.stdout:8/317: sync 2023-12-07T16:21:36.459 INFO:tasks.workunit.client.0.smithi063.stdout:6/262: sync 2023-12-07T16:21:36.459 INFO:tasks.workunit.client.0.smithi063.stdout:1/154: sync 2023-12-07T16:21:36.460 INFO:tasks.workunit.client.0.smithi063.stdout:4/189: creat d1/d3/f35 x:0 0 0 2023-12-07T16:21:36.461 INFO:tasks.workunit.client.0.smithi063.stdout:5/184: creat d1/d3/f37 x:0 0 0 2023-12-07T16:21:36.464 INFO:tasks.workunit.client.0.smithi063.stdout:0/296: creat d4/dd/de/d15/d59/d43/f5c x:0 0 0 2023-12-07T16:21:36.465 INFO:tasks.workunit.client.0.smithi063.stdout:2/201: dwrite d0/d26/f20 [0,4194304] 0 2023-12-07T16:21:36.466 INFO:tasks.workunit.client.0.smithi063.stdout:8/318: rename d7/d14/d15/d2b/f60 to d7/d14/d15/d2b/d40/f62 0 2023-12-07T16:21:36.468 INFO:tasks.workunit.client.0.smithi063.stdout:6/263: link d0/d1e/c30 d0/d1e/d2a/c5e 0 2023-12-07T16:21:36.469 INFO:tasks.workunit.client.0.smithi063.stdout:7/192: dwrite d2/f12 [0,4194304] 0 2023-12-07T16:21:36.469 INFO:tasks.workunit.client.0.smithi063.stdout:2/202: dread d0/d21/f2a [0,4194304] 0 2023-12-07T16:21:36.471 INFO:tasks.workunit.client.0.smithi063.stdout:4/190: truncate d1/d3/db/d13/f2a 1224132 0 2023-12-07T16:21:36.471 INFO:tasks.workunit.client.0.smithi063.stdout:4/191: readlink d1/d3/db/l2d 0 2023-12-07T16:21:36.471 INFO:tasks.workunit.client.0.smithi063.stdout:4/192: fdatasync d1/d3/db/d13/f18 0 2023-12-07T16:21:36.476 INFO:tasks.workunit.client.0.smithi063.stdout:0/297: creat d4/dd/de/d15/d52/d5b/f5d x:0 0 0 2023-12-07T16:21:36.477 INFO:tasks.workunit.client.0.smithi063.stdout:4/193: dread d1/d3/f8 [0,4194304] 0 2023-12-07T16:21:36.479 INFO:tasks.workunit.client.0.smithi063.stdout:3/187: dwrite d7/d9/f12 [0,4194304] 0 2023-12-07T16:21:36.480 INFO:tasks.workunit.client.0.smithi063.stdout:3/188: chown d7/d9/dd/f1f 7 1 2023-12-07T16:21:36.481 INFO:tasks.workunit.client.0.smithi063.stdout:6/264: truncate d0/d1e/f3e 4132834 0 2023-12-07T16:21:36.484 INFO:tasks.workunit.client.0.smithi063.stdout:7/193: getdents d2/de/d2a 0 2023-12-07T16:21:36.484 INFO:tasks.workunit.client.0.smithi063.stdout:7/194: write d2/de/f16 [1242023,62921] 0 2023-12-07T16:21:36.486 INFO:tasks.workunit.client.0.smithi063.stdout:2/203: symlink d0/d26/d11/l41 0 2023-12-07T16:21:36.487 INFO:tasks.workunit.client.0.smithi063.stdout:2/204: read d0/f10 [869160,12966] 0 2023-12-07T16:21:36.487 INFO:tasks.workunit.client.0.smithi063.stdout:1/155: dwrite d0/dd/f1c [0,4194304] 0 2023-12-07T16:21:36.487 INFO:tasks.workunit.client.0.smithi063.stdout:5/185: mkdir d1/d38 0 2023-12-07T16:21:36.489 INFO:tasks.workunit.client.0.smithi063.stdout:4/194: link d1/d3/f8 d1/d3/f36 0 2023-12-07T16:21:36.491 INFO:tasks.workunit.client.0.smithi063.stdout:0/298: dread d4/fc [0,4194304] 0 2023-12-07T16:21:36.493 INFO:tasks.workunit.client.0.smithi063.stdout:3/189: mknod d7/c39 0 2023-12-07T16:21:36.495 INFO:tasks.workunit.client.0.smithi063.stdout:6/265: rename d0/d1e/d20/f47 to d0/d54/f5f 0 2023-12-07T16:21:36.496 INFO:tasks.workunit.client.0.smithi063.stdout:7/195: link d2/de/f1b d2/d34/d46/d48/f4f 0 2023-12-07T16:21:36.496 INFO:tasks.workunit.client.0.smithi063.stdout:7/196: truncate d2/d2c/f3d 1097429 0 2023-12-07T16:21:36.501 INFO:tasks.workunit.client.0.smithi063.stdout:1/156: dread d0/f1 [4194304,4194304] 0 2023-12-07T16:21:36.501 INFO:tasks.workunit.client.0.smithi063.stdout:4/195: getdents d1/d3/db/d13 0 2023-12-07T16:21:36.502 INFO:tasks.workunit.client.0.smithi063.stdout:8/319: dwrite d7/d14/f4f [0,4194304] 0 2023-12-07T16:21:36.502 INFO:tasks.workunit.client.0.smithi063.stdout:5/186: dread d1/f18 [0,4194304] 0 2023-12-07T16:21:36.502 INFO:tasks.workunit.client.0.smithi063.stdout:8/320: chown d7/c1c 7 1 2023-12-07T16:21:36.502 INFO:tasks.workunit.client.0.smithi063.stdout:3/190: getdents d7/d9/d2b 0 2023-12-07T16:21:36.503 INFO:tasks.workunit.client.0.smithi063.stdout:2/205: dwrite d0/f33 [0,4194304] 0 2023-12-07T16:21:36.504 INFO:tasks.workunit.client.0.smithi063.stdout:6/266: getdents d0/d1e/d1d 0 2023-12-07T16:21:36.504 INFO:tasks.workunit.client.0.smithi063.stdout:0/299: dread d4/f17 [0,4194304] 0 2023-12-07T16:21:36.505 INFO:tasks.workunit.client.0.smithi063.stdout:5/187: dread d1/d3/de/d1e/f21 [0,4194304] 0 2023-12-07T16:21:36.506 INFO:tasks.workunit.client.0.smithi063.stdout:7/197: rmdir d2/d21 39 2023-12-07T16:21:36.508 INFO:tasks.workunit.client.0.smithi063.stdout:1/157: symlink d0/dd/d19/l34 0 2023-12-07T16:21:36.510 INFO:tasks.workunit.client.0.smithi063.stdout:3/191: dread d7/d9/f27 [0,4194304] 0 2023-12-07T16:21:36.511 INFO:tasks.workunit.client.0.smithi063.stdout:8/321: mkdir d7/d14/d15/d2b/d40/d63 0 2023-12-07T16:21:36.514 INFO:tasks.workunit.client.0.smithi063.stdout:7/198: dread d2/de/d2a/f2f [0,4194304] 0 2023-12-07T16:21:36.514 INFO:tasks.workunit.client.0.smithi063.stdout:7/199: stat d2/de/f40 0 2023-12-07T16:21:36.514 INFO:tasks.workunit.client.0.smithi063.stdout:7/200: rename d2 to d2/d21/d50 22 2023-12-07T16:21:36.514 INFO:tasks.workunit.client.0.smithi063.stdout:7/201: write d2/d21/f30 [1000430,45108] 0 2023-12-07T16:21:36.514 INFO:tasks.workunit.client.0.smithi063.stdout:2/206: symlink d0/d21/l42 0 2023-12-07T16:21:36.515 INFO:tasks.workunit.client.0.smithi063.stdout:6/267: mkdir d0/d1e/d60 0 2023-12-07T16:21:36.518 INFO:tasks.workunit.client.0.smithi063.stdout:0/300: mkdir d4/dd/d26/d2b/d5e 0 2023-12-07T16:21:36.521 INFO:tasks.workunit.client.0.smithi063.stdout:5/188: truncate d1/f32 1345904 0 2023-12-07T16:21:36.523 INFO:tasks.workunit.client.0.smithi063.stdout:3/192: rmdir d7/d21 39 2023-12-07T16:21:36.525 INFO:tasks.workunit.client.0.smithi063.stdout:8/322: truncate d7/d14/d1a/f33 3324002 0 2023-12-07T16:21:36.527 INFO:tasks.workunit.client.0.smithi063.stdout:7/202: unlink d2/d21/f30 0 2023-12-07T16:21:36.529 INFO:tasks.workunit.client.0.smithi063.stdout:7/203: symlink d2/d2c/l51 0 2023-12-07T16:21:36.535 INFO:tasks.workunit.client.0.smithi063.stdout:2/207: dwrite d0/f10 [0,4194304] 0 2023-12-07T16:21:36.536 INFO:tasks.workunit.client.0.smithi063.stdout:1/158: dwrite d0/dd/d10/d1e/f2e [0,4194304] 0 2023-12-07T16:21:36.539 INFO:tasks.workunit.client.0.smithi063.stdout:9/216: sync 2023-12-07T16:21:36.543 INFO:tasks.workunit.client.0.smithi063.stdout:2/208: creat d0/d1e/f43 x:0 0 0 2023-12-07T16:21:36.544 INFO:tasks.workunit.client.0.smithi063.stdout:1/159: symlink d0/dd/d1f/l35 0 2023-12-07T16:21:36.545 INFO:tasks.workunit.client.0.smithi063.stdout:2/209: creat d0/f44 x:0 0 0 2023-12-07T16:21:36.545 INFO:tasks.workunit.client.0.smithi063.stdout:2/210: read - d0/d1e/f30 zero size 2023-12-07T16:21:36.545 INFO:tasks.workunit.client.0.smithi063.stdout:8/323: write d7/d14/d1a/f31 [204379,2046] 0 2023-12-07T16:21:36.546 INFO:tasks.workunit.client.0.smithi063.stdout:1/160: mknod d0/dd/d10/d1e/c36 0 2023-12-07T16:21:36.548 INFO:tasks.workunit.client.0.smithi063.stdout:2/211: creat d0/d21/f45 x:0 0 0 2023-12-07T16:21:36.548 INFO:tasks.workunit.client.0.smithi063.stdout:2/212: write d0/d1e/f43 [708600,101358] 0 2023-12-07T16:21:36.548 INFO:tasks.workunit.client.0.smithi063.stdout:8/324: link d7/d38/l3e d7/d14/d1a/l64 0 2023-12-07T16:21:36.549 INFO:tasks.workunit.client.0.smithi063.stdout:9/217: dread d0/d7/f16 [0,4194304] 0 2023-12-07T16:21:36.550 INFO:tasks.workunit.client.0.smithi063.stdout:1/161: mknod d0/dd/d10/d1e/c37 0 2023-12-07T16:21:36.550 INFO:tasks.workunit.client.0.smithi063.stdout:2/213: creat d0/d1e/f46 x:0 0 0 2023-12-07T16:21:36.550 INFO:tasks.workunit.client.0.smithi063.stdout:2/214: readlink d0/l2 0 2023-12-07T16:21:36.550 INFO:tasks.workunit.client.0.smithi063.stdout:8/325: mknod d7/d14/d15/d2b/d40/c65 0 2023-12-07T16:21:36.552 INFO:tasks.workunit.client.0.smithi063.stdout:1/162: mkdir d0/dd/d10/d1e/d38 0 2023-12-07T16:21:36.552 INFO:tasks.workunit.client.0.smithi063.stdout:1/163: chown d0/dd/d10/d1e/l30 1489554640 1 2023-12-07T16:21:36.552 INFO:tasks.workunit.client.0.smithi063.stdout:2/215: symlink d0/d26/d40/l47 0 2023-12-07T16:21:36.554 INFO:tasks.workunit.client.0.smithi063.stdout:8/326: rename d7/f61 to d7/d14/d15/d57/f66 0 2023-12-07T16:21:36.554 INFO:tasks.workunit.client.0.smithi063.stdout:8/327: chown d7/d14/d15/d57 491407828 1 2023-12-07T16:21:36.555 INFO:tasks.workunit.client.0.smithi063.stdout:2/216: creat d0/f48 x:0 0 0 2023-12-07T16:21:36.555 INFO:tasks.workunit.client.0.smithi063.stdout:2/217: mknod d0/d26/d11/c49 0 2023-12-07T16:21:36.555 INFO:tasks.workunit.client.0.smithi063.stdout:2/218: fsync d0/d26/f20 0 2023-12-07T16:21:36.556 INFO:tasks.workunit.client.1.smithi152.stdout:5/581: sync 2023-12-07T16:21:36.557 INFO:tasks.workunit.client.1.smithi152.stdout:9/510: sync 2023-12-07T16:21:36.557 INFO:tasks.workunit.client.1.smithi152.stdout:5/582: fdatasync dd/de/d14/dc6/fb1 0 2023-12-07T16:21:36.557 INFO:tasks.workunit.client.0.smithi063.stdout:1/164: write d0/dd/d10/f17 [1218918,64566] 0 2023-12-07T16:21:36.557 INFO:tasks.workunit.client.1.smithi152.stdout:9/511: creat d1/d9/d2d/fb0 x:0 0 0 2023-12-07T16:21:36.557 INFO:tasks.workunit.client.1.smithi152.stdout:9/512: truncate d1/d9/d2d/f8f 28272 0 2023-12-07T16:21:36.558 INFO:tasks.workunit.client.1.smithi152.stdout:9/513: write d1/d9/d2d/f8f [901072,109617] 0 2023-12-07T16:21:36.558 INFO:tasks.workunit.client.1.smithi152.stdout:9/514: dread - d1/d9/db/df/f50 zero size 2023-12-07T16:21:36.558 INFO:tasks.workunit.client.1.smithi152.stdout:5/583: creat dd/d91/dbe/fc8 x:0 0 0 2023-12-07T16:21:36.559 INFO:tasks.workunit.client.0.smithi063.stdout:1/165: getdents d0/dd/d10 0 2023-12-07T16:21:36.560 INFO:tasks.workunit.client.0.smithi063.stdout:1/166: stat d0/c6 0 2023-12-07T16:21:36.562 INFO:tasks.workunit.client.0.smithi063.stdout:1/167: dread d0/dd/d10/f27 [0,4194304] 0 2023-12-07T16:21:36.569 INFO:tasks.workunit.client.0.smithi063.stdout:8/328: dread d7/d14/d15/f18 [0,4194304] 0 2023-12-07T16:21:36.569 INFO:tasks.workunit.client.0.smithi063.stdout:9/218: dread d0/d21/f23 [0,4194304] 0 2023-12-07T16:21:36.569 INFO:tasks.workunit.client.0.smithi063.stdout:5/189: dwrite d1/d3/de/d1e/f27 [0,4194304] 0 2023-12-07T16:21:36.572 INFO:tasks.workunit.client.0.smithi063.stdout:8/329: rmdir d7/d14/d15/d2b/d40 39 2023-12-07T16:21:36.573 INFO:tasks.workunit.client.0.smithi063.stdout:0/301: dwrite d4/dd/de/f24 [0,4194304] 0 2023-12-07T16:21:36.573 INFO:tasks.workunit.client.0.smithi063.stdout:1/168: dread d0/dd/d19/f21 [0,4194304] 0 2023-12-07T16:21:36.573 INFO:tasks.workunit.client.0.smithi063.stdout:9/219: creat d0/d21/f43 x:0 0 0 2023-12-07T16:21:36.575 INFO:tasks.workunit.client.1.smithi152.stdout:9/515: dread d1/f49 [0,4194304] 0 2023-12-07T16:21:36.575 INFO:tasks.workunit.client.0.smithi063.stdout:8/330: creat d7/d14/d4e/f67 x:0 0 0 2023-12-07T16:21:36.578 INFO:tasks.workunit.client.0.smithi063.stdout:1/169: link d0/dd/d10/f17 d0/dd/f39 0 2023-12-07T16:21:36.579 INFO:tasks.workunit.client.0.smithi063.stdout:3/193: dwrite d7/d9/dd/f1f [0,4194304] 0 2023-12-07T16:21:36.580 INFO:tasks.workunit.client.1.smithi152.stdout:5/584: dwrite dd/de/d14/f42 [0,4194304] 0 2023-12-07T16:21:36.581 INFO:tasks.workunit.client.0.smithi063.stdout:5/190: symlink d1/l39 0 2023-12-07T16:21:36.581 INFO:tasks.workunit.client.0.smithi063.stdout:5/191: write d1/d3/f17 [30291,68558] 0 2023-12-07T16:21:36.581 INFO:tasks.workunit.client.0.smithi063.stdout:0/302: getdents d4/dd/de/d15/d52/d5b 0 2023-12-07T16:21:36.584 INFO:tasks.workunit.client.0.smithi063.stdout:8/331: link d7/d14/d1a/f5c d7/d14/d15/f68 0 2023-12-07T16:21:36.585 INFO:tasks.workunit.client.0.smithi063.stdout:1/170: truncate d0/dd/f16 6850076 0 2023-12-07T16:21:36.585 INFO:tasks.workunit.client.0.smithi063.stdout:7/204: dwrite d2/d34/f38 [0,4194304] 0 2023-12-07T16:21:36.590 INFO:tasks.workunit.client.0.smithi063.stdout:5/192: mkdir d1/d3/d3a 0 2023-12-07T16:21:36.592 INFO:tasks.workunit.client.0.smithi063.stdout:8/332: mknod d7/c69 0 2023-12-07T16:21:36.594 INFO:tasks.workunit.client.0.smithi063.stdout:7/205: rmdir d2/d34 39 2023-12-07T16:21:36.594 INFO:tasks.workunit.client.0.smithi063.stdout:7/206: stat d2/de/f16 0 2023-12-07T16:21:36.594 INFO:tasks.workunit.client.0.smithi063.stdout:7/207: dread - d2/de/d2a/f4a zero size 2023-12-07T16:21:36.595 INFO:tasks.workunit.client.0.smithi063.stdout:5/193: creat d1/d3/f3b x:0 0 0 2023-12-07T16:21:36.597 INFO:tasks.workunit.client.0.smithi063.stdout:2/219: rename d0/d26/d40 to d0/d4a 0 2023-12-07T16:21:36.597 INFO:tasks.workunit.client.0.smithi063.stdout:2/220: dread - d0/f48 zero size 2023-12-07T16:21:36.597 INFO:tasks.workunit.client.0.smithi063.stdout:5/194: read d1/d3/de/d1e/f1d [587426,41583] 0 2023-12-07T16:21:36.597 INFO:tasks.workunit.client.0.smithi063.stdout:5/195: fsync d1/d3/de/f1f 0 2023-12-07T16:21:36.597 INFO:tasks.workunit.client.0.smithi063.stdout:5/196: truncate d1/d31/f33 5204237 0 2023-12-07T16:21:36.597 INFO:tasks.workunit.client.0.smithi063.stdout:5/197: chown d1 0 1 2023-12-07T16:21:36.598 INFO:tasks.workunit.client.1.smithi152.stdout:9/516: dwrite d1/d9/d2d/fb0 [0,4194304] 0 2023-12-07T16:21:36.598 INFO:tasks.workunit.client.0.smithi063.stdout:9/220: dwrite d0/d7/ff [4194304,4194304] 0 2023-12-07T16:21:36.598 INFO:tasks.workunit.client.0.smithi063.stdout:8/333: unlink d7/d38/l39 0 2023-12-07T16:21:36.599 INFO:tasks.workunit.client.0.smithi063.stdout:0/303: dwrite d4/f5 [0,4194304] 0 2023-12-07T16:21:36.600 INFO:tasks.workunit.client.0.smithi063.stdout:3/194: rename d7/c20 to d7/d21/c3a 0 2023-12-07T16:21:36.601 INFO:tasks.workunit.client.0.smithi063.stdout:2/221: creat d0/f4b x:0 0 0 2023-12-07T16:21:36.601 INFO:tasks.workunit.client.0.smithi063.stdout:0/304: dread d4/d25/f2f [0,4194304] 0 2023-12-07T16:21:36.601 INFO:tasks.workunit.client.0.smithi063.stdout:0/305: fdatasync d4/d25/f4b 0 2023-12-07T16:21:36.601 INFO:tasks.workunit.client.0.smithi063.stdout:5/198: getdents d1/d3/de/d1e 0 2023-12-07T16:21:36.602 INFO:tasks.workunit.client.1.smithi152.stdout:8/471: sync 2023-12-07T16:21:36.602 INFO:tasks.workunit.client.1.smithi152.stdout:1/508: sync 2023-12-07T16:21:36.604 INFO:tasks.workunit.client.1.smithi152.stdout:8/472: symlink d3/d4/d9/dc/d6f/d7a/la9 0 2023-12-07T16:21:36.604 INFO:tasks.workunit.client.1.smithi152.stdout:8/473: write d3/d4/d4b/f4f [1245814,100335] 0 2023-12-07T16:21:36.604 INFO:tasks.workunit.client.1.smithi152.stdout:1/509: rmdir dc/d28/d7d 39 2023-12-07T16:21:36.605 INFO:tasks.workunit.client.1.smithi152.stdout:8/474: symlink d3/da7/laa 0 2023-12-07T16:21:36.605 INFO:tasks.workunit.client.0.smithi063.stdout:2/222: write d0/d26/f20 [1278361,85307] 0 2023-12-07T16:21:36.606 INFO:tasks.workunit.client.0.smithi063.stdout:9/221: fsync d0/d21/f43 0 2023-12-07T16:21:36.607 INFO:tasks.workunit.client.1.smithi152.stdout:1/510: symlink dc/d14/d18/d64/d8a/la5 0 2023-12-07T16:21:36.607 INFO:tasks.workunit.client.0.smithi063.stdout:8/334: symlink d7/d14/d15/d2b/d40/d63/l6a 0 2023-12-07T16:21:36.608 INFO:tasks.workunit.client.1.smithi152.stdout:8/475: creat d3/d4/d9/d34/d5f/fab x:0 0 0 2023-12-07T16:21:36.608 INFO:tasks.workunit.client.1.smithi152.stdout:1/511: read dc/d28/f55 [5607,114406] 0 2023-12-07T16:21:36.608 INFO:tasks.workunit.client.1.smithi152.stdout:1/512: stat dc/d14/d18/d64/f8f 0 2023-12-07T16:21:36.608 INFO:tasks.workunit.client.1.smithi152.stdout:1/513: fsync dc/d14/d18/f70 0 2023-12-07T16:21:36.608 INFO:tasks.workunit.client.1.smithi152.stdout:1/514: dread - dc/f63 zero size 2023-12-07T16:21:36.609 INFO:tasks.workunit.client.0.smithi063.stdout:8/335: write d7/d14/d15/f46 [12667,48556] 0 2023-12-07T16:21:36.609 INFO:tasks.workunit.client.0.smithi063.stdout:8/336: dread - d7/d14/d15/d2b/d40/f62 zero size 2023-12-07T16:21:36.609 INFO:tasks.workunit.client.1.smithi152.stdout:8/476: symlink d3/da7/lac 0 2023-12-07T16:21:36.610 INFO:tasks.workunit.client.0.smithi063.stdout:7/208: rename d2/de/f1d to d2/d34/d46/d48/f52 0 2023-12-07T16:21:36.611 INFO:tasks.workunit.client.1.smithi152.stdout:1/515: symlink dc/d28/d7d/la6 0 2023-12-07T16:21:36.611 INFO:tasks.workunit.client.1.smithi152.stdout:8/477: mkdir d3/d4/d9/dad 0 2023-12-07T16:21:36.611 INFO:tasks.workunit.client.1.smithi152.stdout:8/478: write d3/d4/d9/dc/d6f/d7a/d8a/f6c [917585,106068] 0 2023-12-07T16:21:36.612 INFO:tasks.workunit.client.1.smithi152.stdout:1/516: creat dc/d14/d18/d45/d74/fa7 x:0 0 0 2023-12-07T16:21:36.615 INFO:tasks.workunit.client.0.smithi063.stdout:2/223: rmdir d0/d26 39 2023-12-07T16:21:36.615 INFO:tasks.workunit.client.0.smithi063.stdout:2/224: chown d0 840151 1 2023-12-07T16:21:36.618 INFO:tasks.workunit.client.0.smithi063.stdout:9/222: creat d0/d13/d39/d3a/d3e/f44 x:0 0 0 2023-12-07T16:21:36.618 INFO:tasks.workunit.client.0.smithi063.stdout:9/223: stat d0/d7/c10 0 2023-12-07T16:21:36.621 INFO:tasks.workunit.client.0.smithi063.stdout:0/306: write d4/dd/de/f13 [1566775,74172] 0 2023-12-07T16:21:36.621 INFO:tasks.workunit.client.0.smithi063.stdout:0/307: write d4/dd/de/d15/d1f/f4a [878929,72340] 0 2023-12-07T16:21:36.621 INFO:tasks.workunit.client.0.smithi063.stdout:0/308: stat d4/dd/d26 0 2023-12-07T16:21:36.622 INFO:tasks.workunit.client.0.smithi063.stdout:8/337: truncate d7/d14/d1a/f22 6116942 0 2023-12-07T16:21:36.623 INFO:tasks.workunit.client.0.smithi063.stdout:7/209: getdents d2/d34/d46 0 2023-12-07T16:21:36.625 INFO:tasks.workunit.client.0.smithi063.stdout:9/224: mknod d0/d13/d39/d3a/d3e/c45 0 2023-12-07T16:21:36.627 INFO:tasks.workunit.client.0.smithi063.stdout:7/210: mkdir d2/de/d53 0 2023-12-07T16:21:36.627 INFO:tasks.workunit.client.0.smithi063.stdout:7/211: stat d2/d34/f3b 0 2023-12-07T16:21:36.627 INFO:tasks.workunit.client.0.smithi063.stdout:8/338: read d7/d38/f3b [2159260,93747] 0 2023-12-07T16:21:36.627 INFO:tasks.workunit.client.0.smithi063.stdout:8/339: readlink d7/d14/d15/d48/l45 0 2023-12-07T16:21:36.627 INFO:tasks.workunit.client.0.smithi063.stdout:8/340: chown d7/d14/f4f 10 1 2023-12-07T16:21:36.627 INFO:tasks.workunit.client.0.smithi063.stdout:8/341: chown d7/d14/d15/l52 0 1 2023-12-07T16:21:36.627 INFO:tasks.workunit.client.0.smithi063.stdout:8/342: chown d7/d14/d1a/f56 1291974331 1 2023-12-07T16:21:36.627 INFO:tasks.workunit.client.0.smithi063.stdout:8/343: write d7/d14/d4e/f67 [862166,59307] 0 2023-12-07T16:21:36.627 INFO:tasks.workunit.client.0.smithi063.stdout:8/344: dread - d7/d14/d1a/d54/f5b zero size 2023-12-07T16:21:36.627 INFO:tasks.workunit.client.0.smithi063.stdout:1/171: dread d0/dd/f39 [0,4194304] 0 2023-12-07T16:21:36.627 INFO:tasks.workunit.client.0.smithi063.stdout:1/172: chown d0/dd/d10/d13/d2f 848902 1 2023-12-07T16:21:36.628 INFO:tasks.workunit.client.0.smithi063.stdout:2/225: rmdir d0/d4a 39 2023-12-07T16:21:36.628 INFO:tasks.workunit.client.0.smithi063.stdout:9/225: write d0/f3 [1250013,83522] 0 2023-12-07T16:21:36.628 INFO:tasks.workunit.client.0.smithi063.stdout:7/212: rename d2/f6 to d2/d34/f54 0 2023-12-07T16:21:36.630 INFO:tasks.workunit.client.0.smithi063.stdout:8/345: creat d7/d14/d15/d2b/d40/d63/f6b x:0 0 0 2023-12-07T16:21:36.631 INFO:tasks.workunit.client.0.smithi063.stdout:1/173: mknod d0/dd/d10/d13/d2f/c3a 0 2023-12-07T16:21:36.632 INFO:tasks.workunit.client.0.smithi063.stdout:2/226: mkdir d0/d26/d4c 0 2023-12-07T16:21:36.633 INFO:tasks.workunit.client.0.smithi063.stdout:9/226: mknod d0/d21/c46 0 2023-12-07T16:21:36.634 INFO:tasks.workunit.client.0.smithi063.stdout:9/227: fsync d0/d21/f23 0 2023-12-07T16:21:36.634 INFO:tasks.workunit.client.0.smithi063.stdout:7/213: creat d2/d34/f55 x:0 0 0 2023-12-07T16:21:36.635 INFO:tasks.workunit.client.0.smithi063.stdout:7/214: dread - d2/d34/f3c zero size 2023-12-07T16:21:36.636 INFO:tasks.workunit.client.0.smithi063.stdout:2/227: truncate d0/d26/d11/f1b 773134 0 2023-12-07T16:21:36.637 INFO:tasks.workunit.client.0.smithi063.stdout:3/195: dwrite f6 [0,4194304] 0 2023-12-07T16:21:36.638 INFO:tasks.workunit.client.0.smithi063.stdout:9/228: creat d0/f47 x:0 0 0 2023-12-07T16:21:36.638 INFO:tasks.workunit.client.0.smithi063.stdout:9/229: truncate d0/f31 1687583 0 2023-12-07T16:21:36.640 INFO:tasks.workunit.client.0.smithi063.stdout:4/196: sync 2023-12-07T16:21:36.640 INFO:tasks.workunit.client.0.smithi063.stdout:4/197: chown d1/d3/db/d16/c2f 57 1 2023-12-07T16:21:36.640 INFO:tasks.workunit.client.0.smithi063.stdout:6/268: sync 2023-12-07T16:21:36.642 INFO:tasks.workunit.client.0.smithi063.stdout:7/215: mkdir d2/d34/d46/d48/d56 0 2023-12-07T16:21:36.642 INFO:tasks.workunit.client.0.smithi063.stdout:2/228: creat d0/d26/f4d x:0 0 0 2023-12-07T16:21:36.644 INFO:tasks.workunit.client.0.smithi063.stdout:3/196: rename d7/d9/d2b/c35 to d7/d21/c3b 0 2023-12-07T16:21:36.644 INFO:tasks.workunit.client.0.smithi063.stdout:3/197: fsync d7/d9/dd/f1e 0 2023-12-07T16:21:36.644 INFO:tasks.workunit.client.0.smithi063.stdout:3/198: fsync d7/d9/dd/f1f 0 2023-12-07T16:21:36.644 INFO:tasks.workunit.client.0.smithi063.stdout:3/199: write d7/d21/f29 [565467,104883] 0 2023-12-07T16:21:36.644 INFO:tasks.workunit.client.0.smithi063.stdout:3/200: fsync d7/d9/dd/f1c 0 2023-12-07T16:21:36.645 INFO:tasks.workunit.client.0.smithi063.stdout:9/230: creat d0/d13/d39/f48 x:0 0 0 2023-12-07T16:21:36.645 INFO:tasks.workunit.client.0.smithi063.stdout:9/231: chown d0/d13 9 1 2023-12-07T16:21:36.646 INFO:tasks.workunit.client.0.smithi063.stdout:4/198: creat d1/d3/db/d16/f37 x:0 0 0 2023-12-07T16:21:36.646 INFO:tasks.workunit.client.0.smithi063.stdout:8/346: dread d7/d14/f4f [0,4194304] 0 2023-12-07T16:21:36.647 INFO:tasks.workunit.client.0.smithi063.stdout:6/269: creat d0/d17/d1a/f61 x:0 0 0 2023-12-07T16:21:36.647 INFO:tasks.workunit.client.1.smithi152.stdout:8/479: dwrite d3/d1e/d40/d74/f86 [0,4194304] 0 2023-12-07T16:21:36.647 INFO:tasks.workunit.client.0.smithi063.stdout:3/201: symlink d7/l3c 0 2023-12-07T16:21:36.648 INFO:tasks.workunit.client.0.smithi063.stdout:3/202: chown d7/l17 11794 1 2023-12-07T16:21:36.650 INFO:tasks.workunit.client.0.smithi063.stdout:9/232: creat d0/d13/f49 x:0 0 0 2023-12-07T16:21:36.650 INFO:tasks.workunit.client.0.smithi063.stdout:4/199: creat d1/d3/db/f38 x:0 0 0 2023-12-07T16:21:36.652 INFO:tasks.workunit.client.0.smithi063.stdout:6/270: creat d0/d17/d1a/d38/f62 x:0 0 0 2023-12-07T16:21:36.652 INFO:tasks.workunit.client.0.smithi063.stdout:6/271: readlink d0/l14 0 2023-12-07T16:21:36.652 INFO:tasks.workunit.client.0.smithi063.stdout:7/216: write d2/de/d2a/f41 [1356178,41847] 0 2023-12-07T16:21:36.652 INFO:tasks.workunit.client.0.smithi063.stdout:5/199: dwrite d1/d3/de/f10 [0,4194304] 0 2023-12-07T16:21:36.652 INFO:tasks.workunit.client.0.smithi063.stdout:5/200: stat d1/d3/l23 0 2023-12-07T16:21:36.653 INFO:tasks.workunit.client.0.smithi063.stdout:3/203: creat d7/d9/d2b/f3d x:0 0 0 2023-12-07T16:21:36.653 INFO:tasks.workunit.client.0.smithi063.stdout:3/204: read - d7/d9/d1b/f2c zero size 2023-12-07T16:21:36.653 INFO:tasks.workunit.client.0.smithi063.stdout:3/205: readlink l4 0 2023-12-07T16:21:36.654 INFO:tasks.workunit.client.0.smithi063.stdout:4/200: rename d1/d3/db/d13/f17 to d1/d3/db/d13/f39 0 2023-12-07T16:21:36.654 INFO:tasks.workunit.client.0.smithi063.stdout:6/272: creat d0/d1e/f63 x:0 0 0 2023-12-07T16:21:36.655 INFO:tasks.workunit.client.0.smithi063.stdout:7/217: symlink d2/de/l57 0 2023-12-07T16:21:36.656 INFO:tasks.workunit.client.0.smithi063.stdout:3/206: truncate d7/ff 1045958 0 2023-12-07T16:21:36.658 INFO:tasks.workunit.client.0.smithi063.stdout:4/201: mkdir d1/d3/d3a 0 2023-12-07T16:21:36.660 INFO:tasks.workunit.client.0.smithi063.stdout:6/273: truncate d0/d17/d1a/f1c 2867392 0 2023-12-07T16:21:36.660 INFO:tasks.workunit.client.0.smithi063.stdout:6/274: write d0/d17/d1a/f61 [595331,99271] 0 2023-12-07T16:21:36.660 INFO:tasks.workunit.client.0.smithi063.stdout:0/309: dwrite d4/dd/d26/f4f [0,4194304] 0 2023-12-07T16:21:36.662 INFO:tasks.workunit.client.0.smithi063.stdout:9/233: write d0/f3 [1140758,123569] 0 2023-12-07T16:21:36.662 INFO:tasks.workunit.client.0.smithi063.stdout:9/234: stat d0/d13/f3d 0 2023-12-07T16:21:36.662 INFO:tasks.workunit.client.0.smithi063.stdout:9/235: readlink d0/l11 0 2023-12-07T16:21:36.663 INFO:tasks.workunit.client.0.smithi063.stdout:4/202: mknod d1/d3/c3b 0 2023-12-07T16:21:36.663 INFO:tasks.workunit.client.0.smithi063.stdout:4/203: stat d1/d3/l19 0 2023-12-07T16:21:36.666 INFO:tasks.workunit.client.0.smithi063.stdout:0/310: creat d4/dd/de/d15/f5f x:0 0 0 2023-12-07T16:21:36.678 INFO:tasks.workunit.client.0.smithi063.stdout:9/236: rename d0/d7/f1e to d0/d13/d39/d3a/d3e/f4a 0 2023-12-07T16:21:36.679 INFO:tasks.workunit.client.0.smithi063.stdout:4/204: unlink d1/d3/f32 0 2023-12-07T16:21:36.679 INFO:tasks.workunit.client.0.smithi063.stdout:9/237: mknod d0/d21/c4b 0 2023-12-07T16:21:36.680 INFO:tasks.workunit.client.0.smithi063.stdout:9/238: creat d0/d13/d39/d3a/d3e/f4c x:0 0 0 2023-12-07T16:21:36.685 INFO:tasks.workunit.client.0.smithi063.stdout:8/347: dwrite f5 [4194304,4194304] 0 2023-12-07T16:21:36.686 INFO:tasks.workunit.client.0.smithi063.stdout:9/239: write d0/f1a [1880595,71501] 0 2023-12-07T16:21:36.686 INFO:tasks.workunit.client.0.smithi063.stdout:8/348: truncate d7/d14/d15/f2f 2808651 0 2023-12-07T16:21:36.686 INFO:tasks.workunit.client.0.smithi063.stdout:8/349: write d7/d14/d15/f47 [1592571,42880] 0 2023-12-07T16:21:36.688 INFO:tasks.workunit.client.0.smithi063.stdout:9/240: dread d0/d13/f36 [0,4194304] 0 2023-12-07T16:21:36.688 INFO:tasks.workunit.client.0.smithi063.stdout:4/205: dread d1/d3/f5 [0,4194304] 0 2023-12-07T16:21:36.689 INFO:tasks.workunit.client.0.smithi063.stdout:9/241: stat d0/d13/c37 0 2023-12-07T16:21:36.689 INFO:tasks.workunit.client.0.smithi063.stdout:2/229: dwrite d0/d1e/f43 [0,4194304] 0 2023-12-07T16:21:36.690 INFO:tasks.workunit.client.1.smithi152.stdout:8/480: dwrite d3/f1d [0,4194304] 0 2023-12-07T16:21:36.691 INFO:tasks.workunit.client.1.smithi152.stdout:8/481: chown d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/d7d/f87 22427 1 2023-12-07T16:21:36.691 INFO:tasks.workunit.client.1.smithi152.stdout:8/482: fsync d3/d4/d9/dc/d6f/d7a/d8a/f28 0 2023-12-07T16:21:36.691 INFO:tasks.workunit.client.0.smithi063.stdout:4/206: mknod d1/d3/db/d16/c3c 0 2023-12-07T16:21:36.692 INFO:tasks.workunit.client.0.smithi063.stdout:9/242: creat d0/d13/d39/d3a/f4d x:0 0 0 2023-12-07T16:21:36.692 INFO:tasks.workunit.client.0.smithi063.stdout:9/243: write d0/d7/ff [1192395,4389] 0 2023-12-07T16:21:36.692 INFO:tasks.workunit.client.0.smithi063.stdout:9/244: stat d0/d7/f2a 0 2023-12-07T16:21:36.692 INFO:tasks.workunit.client.0.smithi063.stdout:9/245: chown d0/d21/c29 1546026 1 2023-12-07T16:21:36.692 INFO:tasks.workunit.client.0.smithi063.stdout:9/246: dread - d0/d13/d39/d3a/d3e/f4c zero size 2023-12-07T16:21:36.692 INFO:tasks.workunit.client.0.smithi063.stdout:9/247: write d0/d13/d39/f48 [912494,44363] 0 2023-12-07T16:21:36.692 INFO:tasks.workunit.client.0.smithi063.stdout:8/350: dread d7/d14/d15/f2d [0,4194304] 0 2023-12-07T16:21:36.692 INFO:tasks.workunit.client.0.smithi063.stdout:7/218: dwrite d2/de/f15 [4194304,4194304] 0 2023-12-07T16:21:36.693 INFO:tasks.workunit.client.1.smithi152.stdout:8/483: mkdir d3/d1e/d55/d83/dae 0 2023-12-07T16:21:36.696 INFO:tasks.workunit.client.0.smithi063.stdout:3/207: dread d7/d21/f29 [0,4194304] 0 2023-12-07T16:21:36.696 INFO:tasks.workunit.client.0.smithi063.stdout:5/201: dwrite d1/f18 [0,4194304] 0 2023-12-07T16:21:36.696 INFO:tasks.workunit.client.0.smithi063.stdout:2/230: rmdir d0/d21/d39 39 2023-12-07T16:21:36.696 INFO:tasks.workunit.client.0.smithi063.stdout:2/231: chown d0/d21/l24 948157 1 2023-12-07T16:21:36.702 INFO:tasks.workunit.client.0.smithi063.stdout:8/351: link d7/c49 d7/d14/d15/d2b/c6c 0 2023-12-07T16:21:36.704 INFO:tasks.workunit.client.0.smithi063.stdout:7/219: mknod d2/de/c58 0 2023-12-07T16:21:36.707 INFO:tasks.workunit.client.0.smithi063.stdout:3/208: rename d7/d9/l11 to d7/d9/d2b/l3e 0 2023-12-07T16:21:36.707 INFO:tasks.workunit.client.0.smithi063.stdout:6/275: rmdir d0/d17/d1a 39 2023-12-07T16:21:36.710 INFO:tasks.workunit.client.1.smithi152.stdout:7/427: sync 2023-12-07T16:21:36.710 INFO:tasks.workunit.client.1.smithi152.stdout:2/442: sync 2023-12-07T16:21:36.710 INFO:tasks.workunit.client.1.smithi152.stdout:7/428: fsync db/d27/f56 0 2023-12-07T16:21:36.710 INFO:tasks.workunit.client.1.smithi152.stdout:7/429: write db/d27/f3d [4296909,117979] 0 2023-12-07T16:21:36.711 INFO:tasks.workunit.client.0.smithi063.stdout:2/232: link d0/f14 d0/d21/d39/f4e 0 2023-12-07T16:21:36.711 INFO:tasks.workunit.client.0.smithi063.stdout:6/276: dread d0/d17/d46/f59 [0,4194304] 0 2023-12-07T16:21:36.711 INFO:tasks.workunit.client.0.smithi063.stdout:6/277: fsync d0/d1e/f24 0 2023-12-07T16:21:36.717 INFO:tasks.workunit.client.0.smithi063.stdout:5/202: rename d1/d3/f37 to d1/d3/de/d1e/d25/f3c 0 2023-12-07T16:21:36.717 INFO:tasks.workunit.client.1.smithi152.stdout:7/430: write db/d27/d39/d41/d58/f73 [3050296,119278] 0 2023-12-07T16:21:36.717 INFO:tasks.workunit.client.1.smithi152.stdout:7/431: chown db/d27/f56 591 1 2023-12-07T16:21:36.718 INFO:tasks.workunit.client.1.smithi152.stdout:7/432: creat db/d27/f7a x:0 0 0 2023-12-07T16:21:36.719 INFO:tasks.workunit.client.1.smithi152.stdout:7/433: readlink db/d1c/l46 0 2023-12-07T16:21:36.719 INFO:tasks.workunit.client.1.smithi152.stdout:7/434: truncate db/d27/d39/d41/d37/f67 115220 0 2023-12-07T16:21:36.719 INFO:tasks.workunit.client.1.smithi152.stdout:7/435: readlink l5 0 2023-12-07T16:21:36.719 INFO:tasks.workunit.client.1.smithi152.stdout:8/484: dwrite d3/d4/d9/dc/d6f/d7b/d7e/f9a [0,4194304] 0 2023-12-07T16:21:36.719 INFO:tasks.workunit.client.0.smithi063.stdout:8/352: rename d7/ff to d7/d14/d15/f6d 0 2023-12-07T16:21:36.721 INFO:tasks.workunit.client.0.smithi063.stdout:8/353: link d7/d14/d1a/f56 d7/d14/d1a/f6e 0 2023-12-07T16:21:36.721 INFO:tasks.workunit.client.0.smithi063.stdout:8/354: chown d7/l25 184 1 2023-12-07T16:21:36.722 INFO:tasks.workunit.client.1.smithi152.stdout:7/436: symlink db/d27/d39/d63/l7b 0 2023-12-07T16:21:36.723 INFO:tasks.workunit.client.1.smithi152.stdout:8/485: creat d3/d4/d9/d34/faf x:0 0 0 2023-12-07T16:21:36.723 INFO:tasks.workunit.client.0.smithi063.stdout:6/278: dread d0/d1e/d1d/f27 [0,4194304] 0 2023-12-07T16:21:36.723 INFO:tasks.workunit.client.0.smithi063.stdout:2/233: read d0/d1e/f29 [2029559,119785] 0 2023-12-07T16:21:36.723 INFO:tasks.workunit.client.0.smithi063.stdout:5/203: dread d1/f2a [0,4194304] 0 2023-12-07T16:21:36.725 INFO:tasks.workunit.client.1.smithi152.stdout:7/437: mknod db/d27/d4d/c7c 0 2023-12-07T16:21:36.725 INFO:tasks.workunit.client.1.smithi152.stdout:7/438: write db/d27/d39/d63/f77 [166418,12240] 0 2023-12-07T16:21:36.726 INFO:tasks.workunit.client.1.smithi152.stdout:7/439: write db/d1c/f10 [2212783,123484] 0 2023-12-07T16:21:36.726 INFO:tasks.workunit.client.1.smithi152.stdout:8/486: creat d3/d1e/d55/d83/dae/fb0 x:0 0 0 2023-12-07T16:21:36.726 INFO:tasks.workunit.client.1.smithi152.stdout:8/487: write d3/d4/d9/d34/f42 [595397,74720] 0 2023-12-07T16:21:36.727 INFO:tasks.workunit.client.0.smithi063.stdout:4/207: getdents d1/d3/db/d16 0 2023-12-07T16:21:36.728 INFO:tasks.workunit.client.0.smithi063.stdout:6/279: truncate d0/d54/f5f 4183155 0 2023-12-07T16:21:36.729 INFO:tasks.workunit.client.0.smithi063.stdout:9/248: rmdir d0/d13/d39 39 2023-12-07T16:21:36.729 INFO:tasks.workunit.client.1.smithi152.stdout:7/440: link db/d27/d39/d41/c78 db/d27/d39/d41/c7d 0 2023-12-07T16:21:36.731 INFO:tasks.workunit.client.0.smithi063.stdout:2/234: mknod d0/d1e/c4f 0 2023-12-07T16:21:36.731 INFO:tasks.workunit.client.0.smithi063.stdout:8/355: dread d7/d14/f35 [0,4194304] 0 2023-12-07T16:21:36.732 INFO:tasks.workunit.client.0.smithi063.stdout:8/356: read d7/d14/f35 [2994297,29531] 0 2023-12-07T16:21:36.732 INFO:tasks.workunit.client.0.smithi063.stdout:8/357: chown d7/c49 89 1 2023-12-07T16:21:36.732 INFO:tasks.workunit.client.0.smithi063.stdout:5/204: mknod d1/d3/de/d1e/c3d 0 2023-12-07T16:21:36.733 INFO:tasks.workunit.client.0.smithi063.stdout:4/208: link d1/d3/db/d13/c24 d1/d3/db/d13/c3d 0 2023-12-07T16:21:36.733 INFO:tasks.workunit.client.0.smithi063.stdout:4/209: dread - d1/d3/db/d13/f1c zero size 2023-12-07T16:21:36.733 INFO:tasks.workunit.client.0.smithi063.stdout:5/205: dread d1/f2a [0,4194304] 0 2023-12-07T16:21:36.735 INFO:tasks.workunit.client.0.smithi063.stdout:6/280: mkdir d0/d17/d1a/d38/d64 0 2023-12-07T16:21:36.735 INFO:tasks.workunit.client.0.smithi063.stdout:6/281: fdatasync d0/f19 0 2023-12-07T16:21:36.736 INFO:tasks.workunit.client.0.smithi063.stdout:9/249: symlink d0/d13/d39/d3a/l4e 0 2023-12-07T16:21:36.738 INFO:tasks.workunit.client.0.smithi063.stdout:8/358: rename d7/d14/d15/d48/f5f to d7/d14/d15/d57/f6f 0 2023-12-07T16:21:36.739 INFO:tasks.workunit.client.0.smithi063.stdout:8/359: chown d7/d38/l5e 3 1 2023-12-07T16:21:36.739 INFO:tasks.workunit.client.0.smithi063.stdout:4/210: creat d1/d3/db/f3e x:0 0 0 2023-12-07T16:21:36.741 INFO:tasks.workunit.client.0.smithi063.stdout:4/211: write d1/d3/db/d13/f18 [2586924,96350] 0 2023-12-07T16:21:36.741 INFO:tasks.workunit.client.0.smithi063.stdout:4/212: chown d1/d3/db/d13/f1c 44 1 2023-12-07T16:21:36.741 INFO:tasks.workunit.client.0.smithi063.stdout:5/206: symlink d1/d3/de/d1e/l3e 0 2023-12-07T16:21:36.741 INFO:tasks.workunit.client.0.smithi063.stdout:5/207: stat d1/d3/de/f16 0 2023-12-07T16:21:36.744 INFO:tasks.workunit.client.0.smithi063.stdout:4/213: mkdir d1/d3/d3f 0 2023-12-07T16:21:36.744 INFO:tasks.workunit.client.0.smithi063.stdout:4/214: read - d1/f34 zero size 2023-12-07T16:21:36.745 INFO:tasks.workunit.client.1.smithi152.stdout:2/443: dwrite d2/d1c/d2e/d57/f7b [0,4194304] 0 2023-12-07T16:21:36.745 INFO:tasks.workunit.client.1.smithi152.stdout:2/444: write d2/d1c/d2e/d30/d33/f40 [43503,17642] 0 2023-12-07T16:21:36.745 INFO:tasks.workunit.client.1.smithi152.stdout:2/445: stat d2/d9/f98 0 2023-12-07T16:21:36.745 INFO:tasks.workunit.client.1.smithi152.stdout:2/446: write d2/d1c/d2e/d38/f3b [4579421,40223] 0 2023-12-07T16:21:36.745 INFO:tasks.workunit.client.1.smithi152.stdout:2/447: truncate f1 5377032 0 2023-12-07T16:21:36.745 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:36 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:21:36.749 INFO:tasks.workunit.client.1.smithi152.stdout:2/448: rename d2/d9/lc to d2/d1c/d2e/d38/l9e 0 2023-12-07T16:21:36.750 INFO:tasks.workunit.client.1.smithi152.stdout:2/449: creat d2/d1c/d2e/d57/f9f x:0 0 0 2023-12-07T16:21:36.751 INFO:tasks.workunit.client.0.smithi063.stdout:7/220: dwrite d2/d21/f3f [0,4194304] 0 2023-12-07T16:21:36.751 INFO:tasks.workunit.client.0.smithi063.stdout:8/360: read d7/d14/f35 [2031850,49772] 0 2023-12-07T16:21:36.752 INFO:tasks.workunit.client.1.smithi152.stdout:2/450: mkdir d2/d56/da0 0 2023-12-07T16:21:36.753 INFO:tasks.workunit.client.0.smithi063.stdout:5/208: dread d1/d31/f33 [0,4194304] 0 2023-12-07T16:21:36.753 INFO:tasks.workunit.client.0.smithi063.stdout:5/209: readlink d1/d3/de/d1e/l2c 0 2023-12-07T16:21:36.754 INFO:tasks.workunit.client.0.smithi063.stdout:7/221: truncate d2/de/f40 2567142 0 2023-12-07T16:21:36.755 INFO:tasks.workunit.client.0.smithi063.stdout:4/215: dread d1/d3/db/f20 [0,4194304] 0 2023-12-07T16:21:36.756 INFO:tasks.workunit.client.0.smithi063.stdout:8/361: getdents d7/d38 0 2023-12-07T16:21:36.756 INFO:tasks.workunit.client.0.smithi063.stdout:8/362: stat d7/d14/d15/c34 0 2023-12-07T16:21:36.757 INFO:tasks.workunit.client.0.smithi063.stdout:8/363: truncate d7/d14/d15/f2d 1071606 0 2023-12-07T16:21:36.757 INFO:tasks.workunit.client.0.smithi063.stdout:5/210: read d1/d3/de/d1e/f27 [690626,91859] 0 2023-12-07T16:21:36.757 INFO:tasks.workunit.client.0.smithi063.stdout:8/364: write d7/d14/d1a/f50 [607166,2613] 0 2023-12-07T16:21:36.759 INFO:tasks.workunit.client.0.smithi063.stdout:4/216: unlink d1/d3/db/d13/c22 0 2023-12-07T16:21:36.759 INFO:tasks.workunit.client.0.smithi063.stdout:8/365: creat d7/d38/f70 x:0 0 0 2023-12-07T16:21:36.761 INFO:tasks.workunit.client.0.smithi063.stdout:2/235: dwrite d0/d21/f2a [0,4194304] 0 2023-12-07T16:21:36.763 INFO:tasks.workunit.client.0.smithi063.stdout:5/211: dread d1/d31/f33 [4194304,4194304] 0 2023-12-07T16:21:36.763 INFO:tasks.workunit.client.0.smithi063.stdout:5/212: getdents d1/d38 0 2023-12-07T16:21:36.763 INFO:tasks.workunit.client.0.smithi063.stdout:2/236: unlink d0/d26/d11/l41 0 2023-12-07T16:21:36.765 INFO:tasks.workunit.client.0.smithi063.stdout:2/237: unlink d0/lc 0 2023-12-07T16:21:36.765 INFO:tasks.workunit.client.0.smithi063.stdout:8/366: write d7/d14/d1a/f22 [427888,68309] 0 2023-12-07T16:21:36.765 INFO:tasks.workunit.client.0.smithi063.stdout:8/367: write d7/d14/d1a/f33 [3418251,101818] 0 2023-12-07T16:21:36.766 INFO:tasks.workunit.client.0.smithi063.stdout:2/238: symlink d0/d26/d11/l50 0 2023-12-07T16:21:36.766 INFO:tasks.workunit.client.0.smithi063.stdout:2/239: fdatasync d0/d26/f4d 0 2023-12-07T16:21:36.767 INFO:tasks.workunit.client.0.smithi063.stdout:8/368: rename d7/d14/d15/d2b/l44 to d7/d14/d15/d48/l71 0 2023-12-07T16:21:36.769 INFO:tasks.workunit.client.0.smithi063.stdout:2/240: creat d0/d21/d39/f51 x:0 0 0 2023-12-07T16:21:36.769 INFO:tasks.workunit.client.0.smithi063.stdout:5/213: write d1/d3/de/d1e/f21 [251682,81590] 0 2023-12-07T16:21:36.769 INFO:tasks.workunit.client.0.smithi063.stdout:5/214: fdatasync d1/d31/f33 0 2023-12-07T16:21:36.769 INFO:tasks.workunit.client.0.smithi063.stdout:5/215: chown d1/l26 445072 1 2023-12-07T16:21:36.769 INFO:tasks.workunit.client.0.smithi063.stdout:5/216: truncate d1/f2a 900120 0 2023-12-07T16:21:36.769 INFO:tasks.workunit.client.0.smithi063.stdout:8/369: mknod d7/d14/d1a/c72 0 2023-12-07T16:21:36.769 INFO:tasks.workunit.client.0.smithi063.stdout:8/370: fdatasync d7/d14/d15/d2b/d40/d63/f6b 0 2023-12-07T16:21:36.769 INFO:tasks.workunit.client.0.smithi063.stdout:8/371: stat d7/d14/f35 0 2023-12-07T16:21:36.770 INFO:tasks.workunit.client.0.smithi063.stdout:2/241: mkdir d0/d26/d11/d52 0 2023-12-07T16:21:36.770 INFO:tasks.workunit.client.0.smithi063.stdout:2/242: write d0/d26/d11/f3c [1017817,72743] 0 2023-12-07T16:21:36.771 INFO:tasks.workunit.client.0.smithi063.stdout:8/372: read f5 [3784468,6601] 0 2023-12-07T16:21:36.771 INFO:tasks.workunit.client.0.smithi063.stdout:5/217: getdents d1/d3/de 0 2023-12-07T16:21:36.771 INFO:tasks.workunit.client.0.smithi063.stdout:5/218: write d1/f2e [1497428,60411] 0 2023-12-07T16:21:36.772 INFO:tasks.workunit.client.0.smithi063.stdout:6/282: dwrite d0/d1e/f24 [0,4194304] 0 2023-12-07T16:21:36.772 INFO:tasks.workunit.client.0.smithi063.stdout:9/250: dwrite d0/d21/f33 [4194304,4194304] 0 2023-12-07T16:21:36.772 INFO:tasks.workunit.client.0.smithi063.stdout:2/243: unlink d0/d26/d11/f1a 0 2023-12-07T16:21:36.774 INFO:tasks.workunit.client.0.smithi063.stdout:8/373: mkdir d7/d38/d73 0 2023-12-07T16:21:36.774 INFO:tasks.workunit.client.0.smithi063.stdout:8/374: dread - d7/d14/d15/f68 zero size 2023-12-07T16:21:36.775 INFO:tasks.workunit.client.0.smithi063.stdout:2/244: write d0/d26/d11/f23 [3514850,76204] 0 2023-12-07T16:21:36.777 INFO:tasks.workunit.client.1.smithi152.stdout:2/451: dwrite d2/d1c/d2e/d57/f9f [0,4194304] 0 2023-12-07T16:21:36.777 INFO:tasks.workunit.client.0.smithi063.stdout:6/283: link d0/fe d0/d17/d1a/d4d/f65 0 2023-12-07T16:21:36.778 INFO:tasks.workunit.client.1.smithi152.stdout:2/452: symlink d2/d9/d51/d54/d5c/la1 0 2023-12-07T16:21:36.779 INFO:tasks.workunit.client.0.smithi063.stdout:6/284: dread d0/d1e/d1d/f3d [0,4194304] 0 2023-12-07T16:21:36.780 INFO:tasks.workunit.client.1.smithi152.stdout:2/453: getdents d2/d9/d51 0 2023-12-07T16:21:36.780 INFO:tasks.workunit.client.1.smithi152.stdout:2/454: write d2/d1c/d2e/d38/d90/f4b [5156680,52272] 0 2023-12-07T16:21:36.781 INFO:tasks.workunit.client.1.smithi152.stdout:2/455: creat d2/d1c/d2e/fa2 x:0 0 0 2023-12-07T16:21:36.783 INFO:tasks.workunit.client.0.smithi063.stdout:5/219: dread d1/d3/de/f1f [0,4194304] 0 2023-12-07T16:21:36.783 INFO:tasks.workunit.client.0.smithi063.stdout:9/251: mknod d0/d21/c4f 0 2023-12-07T16:21:36.783 INFO:tasks.workunit.client.0.smithi063.stdout:7/222: dwrite d2/d34/f3c [0,4194304] 0 2023-12-07T16:21:36.783 INFO:tasks.workunit.client.0.smithi063.stdout:8/375: creat d7/d14/d1a/f74 x:0 0 0 2023-12-07T16:21:36.783 INFO:tasks.workunit.client.0.smithi063.stdout:1/174: sync 2023-12-07T16:21:36.784 INFO:tasks.workunit.client.1.smithi152.stdout:2/456: link d2/d9/d51/d54/d5c/la1 d2/d1c/d2e/d30/d53/la3 0 2023-12-07T16:21:36.785 INFO:tasks.workunit.client.0.smithi063.stdout:4/217: getdents d1/d3/db/d13 0 2023-12-07T16:21:36.785 INFO:tasks.workunit.client.0.smithi063.stdout:4/218: chown d1/d3/db/d13/c1b 757161021 1 2023-12-07T16:21:36.787 INFO:tasks.workunit.client.0.smithi063.stdout:9/252: dread d0/d13/d39/f48 [0,4194304] 0 2023-12-07T16:21:36.787 INFO:tasks.workunit.client.0.smithi063.stdout:9/253: chown d0/d7/l20 6316031 1 2023-12-07T16:21:36.795 INFO:tasks.workunit.client.0.smithi063.stdout:5/220: mknod d1/d3/d3a/c3f 0 2023-12-07T16:21:36.795 INFO:tasks.workunit.client.0.smithi063.stdout:2/245: dwrite d0/f48 [0,4194304] 0 2023-12-07T16:21:36.797 INFO:tasks.workunit.client.0.smithi063.stdout:7/223: truncate d2/f1a 43481 0 2023-12-07T16:21:36.799 INFO:tasks.workunit.client.0.smithi063.stdout:1/175: creat d0/dd/f3b x:0 0 0 2023-12-07T16:21:36.800 INFO:tasks.workunit.client.0.smithi063.stdout:4/219: symlink d1/d3/db/d2c/l40 0 2023-12-07T16:21:36.800 INFO:tasks.workunit.client.0.smithi063.stdout:4/220: write d1/d3/db/d13/f33 [76526,28954] 0 2023-12-07T16:21:36.802 INFO:tasks.workunit.client.0.smithi063.stdout:5/221: creat d1/f40 x:0 0 0 2023-12-07T16:21:36.804 INFO:tasks.workunit.client.0.smithi063.stdout:2/246: unlink d0/d26/f4d 0 2023-12-07T16:21:36.805 INFO:tasks.workunit.client.0.smithi063.stdout:7/224: symlink d2/de/d2a/l59 0 2023-12-07T16:21:36.806 INFO:tasks.workunit.client.0.smithi063.stdout:4/221: truncate d1/d3/f1e 3585841 0 2023-12-07T16:21:36.806 INFO:tasks.workunit.client.0.smithi063.stdout:4/222: stat d1/d3/db/d13/c1b 0 2023-12-07T16:21:36.807 INFO:tasks.workunit.client.0.smithi063.stdout:5/222: mknod d1/d31/c41 0 2023-12-07T16:21:36.807 INFO:tasks.workunit.client.0.smithi063.stdout:5/223: read d1/d3/f17 [41846,3052] 0 2023-12-07T16:21:36.807 INFO:tasks.workunit.client.0.smithi063.stdout:5/224: write d1/f40 [481995,15906] 0 2023-12-07T16:21:36.808 INFO:tasks.workunit.client.0.smithi063.stdout:2/247: mknod d0/d26/d4c/c53 0 2023-12-07T16:21:36.810 INFO:tasks.workunit.client.1.smithi152.stdout:2/457: dwrite d2/d1c/d2e/f3e [0,4194304] 0 2023-12-07T16:21:36.810 INFO:tasks.workunit.client.1.smithi152.stdout:2/458: getdents d2/d1c/d2e/d30/d42/d91 0 2023-12-07T16:21:36.810 INFO:tasks.workunit.client.1.smithi152.stdout:2/459: write d2/d1c/d2e/d30/d53/f88 [568245,57309] 0 2023-12-07T16:21:36.810 INFO:tasks.workunit.client.0.smithi063.stdout:7/225: mkdir d2/d34/d5a 0 2023-12-07T16:21:36.811 INFO:tasks.workunit.client.0.smithi063.stdout:8/376: getdents d7/d14/d15/d2b 0 2023-12-07T16:21:36.812 INFO:tasks.workunit.client.0.smithi063.stdout:8/377: truncate d7/d14/d1a/f74 272629 0 2023-12-07T16:21:36.812 INFO:tasks.workunit.client.0.smithi063.stdout:2/248: write d0/d21/f2a [1052133,55743] 0 2023-12-07T16:21:36.814 INFO:tasks.workunit.client.0.smithi063.stdout:7/226: mknod d2/de/c5b 0 2023-12-07T16:21:36.814 INFO:tasks.workunit.client.0.smithi063.stdout:7/227: chown d2/c32 1519089937 1 2023-12-07T16:21:36.814 INFO:tasks.workunit.client.0.smithi063.stdout:1/176: dread d0/dd/d10/d13/fc [0,4194304] 0 2023-12-07T16:21:36.815 INFO:tasks.workunit.client.0.smithi063.stdout:6/285: dwrite d0/d1e/f12 [4194304,4194304] 0 2023-12-07T16:21:36.815 INFO:tasks.workunit.client.0.smithi063.stdout:6/286: readlink d0/d1e/l48 0 2023-12-07T16:21:36.815 INFO:tasks.workunit.client.0.smithi063.stdout:6/287: dread - d0/d17/d1a/d38/f62 zero size 2023-12-07T16:21:36.815 INFO:tasks.workunit.client.0.smithi063.stdout:6/288: truncate d0/d17/f25 972464 0 2023-12-07T16:21:36.817 INFO:tasks.workunit.client.0.smithi063.stdout:5/225: rename d1/d3/l23 to d1/l42 0 2023-12-07T16:21:36.818 INFO:tasks.workunit.client.0.smithi063.stdout:5/226: truncate d1/d3/f3b 429347 0 2023-12-07T16:21:36.818 INFO:tasks.workunit.client.0.smithi063.stdout:7/228: dread d2/f36 [0,4194304] 0 2023-12-07T16:21:36.819 INFO:tasks.workunit.client.0.smithi063.stdout:6/289: creat d0/d1e/d1d/d4f/f66 x:0 0 0 2023-12-07T16:21:36.820 INFO:tasks.workunit.client.0.smithi063.stdout:7/229: write d2/d34/d46/d48/f4f [2212610,42547] 0 2023-12-07T16:21:36.821 INFO:tasks.workunit.client.0.smithi063.stdout:7/230: write d2/f5 [335949,52635] 0 2023-12-07T16:21:36.821 INFO:tasks.workunit.client.0.smithi063.stdout:7/231: fdatasync d2/f26 0 2023-12-07T16:21:36.822 INFO:tasks.workunit.client.0.smithi063.stdout:6/290: link d0/d17/d1a/d38/l3c d0/d1e/l67 0 2023-12-07T16:21:36.823 INFO:tasks.workunit.client.0.smithi063.stdout:7/232: mknod d2/de/d2a/c5c 0 2023-12-07T16:21:36.824 INFO:tasks.workunit.client.0.smithi063.stdout:7/233: readlink d2/d2c/l2e 0 2023-12-07T16:21:36.825 INFO:tasks.workunit.client.0.smithi063.stdout:6/291: mkdir d0/d1e/d60/d68 0 2023-12-07T16:21:36.825 INFO:tasks.workunit.client.0.smithi063.stdout:8/378: fdatasync d7/d14/d1a/f22 0 2023-12-07T16:21:36.827 INFO:tasks.workunit.client.0.smithi063.stdout:0/311: sync 2023-12-07T16:21:36.828 INFO:tasks.workunit.client.0.smithi063.stdout:9/254: dwrite d0/d13/f36 [0,4194304] 0 2023-12-07T16:21:36.833 INFO:tasks.workunit.client.0.smithi063.stdout:3/209: sync 2023-12-07T16:21:36.833 INFO:tasks.workunit.client.0.smithi063.stdout:9/255: creat d0/d13/d39/d42/f50 x:0 0 0 2023-12-07T16:21:36.833 INFO:tasks.workunit.client.0.smithi063.stdout:9/256: write d0/d13/d39/d3a/d3e/f4c [907062,57802] 0 2023-12-07T16:21:36.835 INFO:tasks.workunit.client.0.smithi063.stdout:3/210: creat d7/d9/f3f x:0 0 0 2023-12-07T16:21:36.835 INFO:tasks.workunit.client.0.smithi063.stdout:3/211: chown d7/d9/d1b/f2c 183428022 1 2023-12-07T16:21:36.837 INFO:tasks.workunit.client.0.smithi063.stdout:8/379: dread d7/d14/d15/f6d [0,4194304] 0 2023-12-07T16:21:36.838 INFO:tasks.workunit.client.0.smithi063.stdout:9/257: link d0/f31 d0/d13/d39/f51 0 2023-12-07T16:21:36.840 INFO:tasks.workunit.client.0.smithi063.stdout:3/212: creat d7/d9/f40 x:0 0 0 2023-12-07T16:21:36.843 INFO:tasks.workunit.client.1.smithi152.stdout:6/405: sync 2023-12-07T16:21:36.843 INFO:tasks.workunit.client.1.smithi152.stdout:3/452: sync 2023-12-07T16:21:36.843 INFO:tasks.workunit.client.1.smithi152.stdout:3/453: write d7/dc/d3e/f5e [61917,68480] 0 2023-12-07T16:21:36.844 INFO:tasks.workunit.client.0.smithi063.stdout:8/380: unlink d7/d14/d15/d2b/d40/c65 0 2023-12-07T16:21:36.845 INFO:tasks.workunit.client.0.smithi063.stdout:9/258: link d0/l27 d0/d13/l52 0 2023-12-07T16:21:36.845 INFO:tasks.workunit.client.0.smithi063.stdout:9/259: chown d0/d21/c4b 59445 1 2023-12-07T16:21:36.847 INFO:tasks.workunit.client.1.smithi152.stdout:0/474: sync 2023-12-07T16:21:36.848 INFO:tasks.workunit.client.1.smithi152.stdout:4/401: sync 2023-12-07T16:21:36.848 INFO:tasks.workunit.client.1.smithi152.stdout:0/475: write d0/dc/d3d/d4c/f8e [945071,50404] 0 2023-12-07T16:21:36.849 INFO:tasks.workunit.client.0.smithi063.stdout:4/223: dwrite d1/d3/db/d13/f33 [0,4194304] 0 2023-12-07T16:21:36.849 INFO:tasks.workunit.client.1.smithi152.stdout:4/402: creat d0/d3/d6/d5c/f73 x:0 0 0 2023-12-07T16:21:36.850 INFO:tasks.workunit.client.0.smithi063.stdout:3/213: mkdir d7/d9/d2b/d41 0 2023-12-07T16:21:36.850 INFO:tasks.workunit.client.0.smithi063.stdout:9/260: getdents d0/d13/d39/d3a/d3e 0 2023-12-07T16:21:36.851 INFO:tasks.workunit.client.1.smithi152.stdout:3/454: rename d7/d10/d1a/d2f/f54 to d7/d10/d41/f8b 0 2023-12-07T16:21:36.852 INFO:tasks.workunit.client.1.smithi152.stdout:4/403: creat d0/d3/d6/d5c/f74 x:0 0 0 2023-12-07T16:21:36.852 INFO:tasks.workunit.client.1.smithi152.stdout:3/455: symlink d7/dc/d3e/d7d/l8c 0 2023-12-07T16:21:36.854 INFO:tasks.workunit.client.1.smithi152.stdout:4/404: unlink d0/f5 0 2023-12-07T16:21:36.859 INFO:tasks.workunit.client.0.smithi063.stdout:3/214: creat d7/d9/dd/f42 x:0 0 0 2023-12-07T16:21:36.859 INFO:tasks.workunit.client.0.smithi063.stdout:9/261: symlink d0/d13/d39/l53 0 2023-12-07T16:21:36.860 INFO:tasks.workunit.client.1.smithi152.stdout:3/456: creat d7/d10/d1a/d2f/d86/f8d x:0 0 0 2023-12-07T16:21:36.862 INFO:tasks.workunit.client.0.smithi063.stdout:3/215: unlink d7/d9/c1d 0 2023-12-07T16:21:36.864 INFO:tasks.workunit.client.0.smithi063.stdout:9/262: mknod d0/d7/c54 0 2023-12-07T16:21:36.865 INFO:tasks.workunit.client.0.smithi063.stdout:3/216: creat d7/d9/d2b/f43 x:0 0 0 2023-12-07T16:21:36.865 INFO:tasks.workunit.client.0.smithi063.stdout:3/217: write d7/d9/f40 [636245,16580] 0 2023-12-07T16:21:36.867 INFO:tasks.workunit.client.0.smithi063.stdout:3/218: rename d7/c24 to d7/d9/d1b/c44 0 2023-12-07T16:21:36.868 INFO:tasks.workunit.client.0.smithi063.stdout:1/177: dwrite d0/dd/d10/d1e/f33 [0,4194304] 0 2023-12-07T16:21:36.869 INFO:tasks.workunit.client.0.smithi063.stdout:3/219: write d7/d9/dd/f19 [653831,82484] 0 2023-12-07T16:21:36.876 INFO:tasks.workunit.client.0.smithi063.stdout:1/178: mknod d0/dd/d10/d13/d2f/c3c 0 2023-12-07T16:21:36.877 INFO:tasks.workunit.client.0.smithi063.stdout:2/249: dwrite d0/d21/f2a [4194304,4194304] 0 2023-12-07T16:21:36.878 INFO:tasks.workunit.client.0.smithi063.stdout:1/179: creat d0/dd/d10/d13/f3d x:0 0 0 2023-12-07T16:21:36.878 INFO:tasks.workunit.client.0.smithi063.stdout:1/180: rename d0/dd/d10 to d0/dd/d10/d1b/d3e 22 2023-12-07T16:21:36.880 INFO:tasks.workunit.client.0.smithi063.stdout:2/250: creat d0/d4a/f54 x:0 0 0 2023-12-07T16:21:36.894 INFO:tasks.workunit.client.0.smithi063.stdout:9/263: dread d0/d7/ff [0,4194304] 0 2023-12-07T16:21:36.894 INFO:tasks.workunit.client.0.smithi063.stdout:1/181: dread d0/dd/f16 [4194304,4194304] 0 2023-12-07T16:21:36.895 INFO:tasks.workunit.client.0.smithi063.stdout:9/264: creat d0/d7/f55 x:0 0 0 2023-12-07T16:21:36.896 INFO:tasks.workunit.client.0.smithi063.stdout:9/265: readlink d0/d21/l2d 0 2023-12-07T16:21:36.896 INFO:tasks.workunit.client.0.smithi063.stdout:1/182: creat d0/dd/d10/d1e/f3f x:0 0 0 2023-12-07T16:21:36.896 INFO:tasks.workunit.client.0.smithi063.stdout:2/251: write d0/d1e/f34 [1145602,49452] 0 2023-12-07T16:21:36.896 INFO:tasks.workunit.client.0.smithi063.stdout:9/266: creat d0/f56 x:0 0 0 2023-12-07T16:21:36.898 INFO:tasks.workunit.client.0.smithi063.stdout:2/252: write d0/d21/d39/f4e [3699808,125367] 0 2023-12-07T16:21:36.899 INFO:tasks.workunit.client.0.smithi063.stdout:2/253: dread - d0/f4b zero size 2023-12-07T16:21:36.900 INFO:tasks.workunit.client.0.smithi063.stdout:2/254: creat d0/d26/d4c/f55 x:0 0 0 2023-12-07T16:21:36.900 INFO:tasks.workunit.client.0.smithi063.stdout:2/255: fsync d0/f33 0 2023-12-07T16:21:36.900 INFO:tasks.workunit.client.0.smithi063.stdout:2/256: write d0/d26/d4c/f55 [811160,18789] 0 2023-12-07T16:21:36.901 INFO:tasks.workunit.client.0.smithi063.stdout:7/234: dwrite d2/de/f18 [0,4194304] 0 2023-12-07T16:21:36.901 INFO:tasks.workunit.client.0.smithi063.stdout:5/227: dwrite d1/d3/f35 [0,4194304] 0 2023-12-07T16:21:36.901 INFO:tasks.workunit.client.0.smithi063.stdout:7/235: chown d2/d34/f3c 5126101 1 2023-12-07T16:21:36.901 INFO:tasks.workunit.client.0.smithi063.stdout:8/381: fsync d7/d14/d1a/f50 0 2023-12-07T16:21:36.901 INFO:tasks.workunit.client.0.smithi063.stdout:8/382: dread - d7/d14/d1a/f6e zero size 2023-12-07T16:21:36.901 INFO:tasks.workunit.client.0.smithi063.stdout:8/383: truncate d7/d14/d15/d57/f6f 28930 0 2023-12-07T16:21:36.902 INFO:tasks.workunit.client.0.smithi063.stdout:8/384: write d7/d14/d4e/f67 [889630,86260] 0 2023-12-07T16:21:36.902 INFO:tasks.workunit.client.0.smithi063.stdout:6/292: dwrite d0/f15 [0,4194304] 0 2023-12-07T16:21:36.902 INFO:tasks.workunit.client.1.smithi152.stdout:6/406: dwrite d2/d6/f6a [0,4194304] 0 2023-12-07T16:21:36.902 INFO:tasks.workunit.client.1.smithi152.stdout:6/407: write d2/d6/d9/d14/d48/f54 [668510,79748] 0 2023-12-07T16:21:36.904 INFO:tasks.workunit.client.0.smithi063.stdout:0/312: dwrite d4/dd/f4e [0,4194304] 0 2023-12-07T16:21:36.904 INFO:tasks.workunit.client.1.smithi152.stdout:3/457: dwrite d7/dc/d14/f75 [0,4194304] 0 2023-12-07T16:21:36.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:36 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:21:36.907 INFO:tasks.workunit.client.0.smithi063.stdout:5/228: link d1/d3/de/d1e/f27 d1/d38/f43 0 2023-12-07T16:21:36.909 INFO:tasks.workunit.client.0.smithi063.stdout:1/183: dread d0/f4 [0,4194304] 0 2023-12-07T16:21:36.909 INFO:tasks.workunit.client.0.smithi063.stdout:7/236: mkdir d2/d34/d46/d5d 0 2023-12-07T16:21:36.910 INFO:tasks.workunit.client.0.smithi063.stdout:8/385: mkdir d7/d14/d15/d2b/d40/d63/d75 0 2023-12-07T16:21:36.913 INFO:tasks.workunit.client.0.smithi063.stdout:4/224: dwrite d1/d3/f1e [0,4194304] 0 2023-12-07T16:21:36.913 INFO:tasks.workunit.client.0.smithi063.stdout:4/225: truncate d1/d3/f5 2522437 0 2023-12-07T16:21:36.915 INFO:tasks.workunit.client.1.smithi152.stdout:0/476: dwrite d0/f18 [0,4194304] 0 2023-12-07T16:21:36.916 INFO:tasks.workunit.client.0.smithi063.stdout:3/220: dwrite d7/fa [0,4194304] 0 2023-12-07T16:21:36.916 INFO:tasks.workunit.client.0.smithi063.stdout:3/221: write d7/d21/f25 [1208641,105184] 0 2023-12-07T16:21:36.916 INFO:tasks.workunit.client.0.smithi063.stdout:3/222: truncate d7/d9/dd/f1c 732622 0 2023-12-07T16:21:36.916 INFO:tasks.workunit.client.0.smithi063.stdout:3/223: stat d7/c39 0 2023-12-07T16:21:36.916 INFO:tasks.workunit.client.0.smithi063.stdout:3/224: chown d7/fa 4 1 2023-12-07T16:21:36.919 INFO:tasks.workunit.client.0.smithi063.stdout:6/293: mkdir d0/d1e/d60/d68/d69 0 2023-12-07T16:21:36.923 INFO:tasks.workunit.client.0.smithi063.stdout:6/294: dread d0/f1b [0,4194304] 0 2023-12-07T16:21:36.923 INFO:tasks.workunit.client.0.smithi063.stdout:5/229: symlink d1/d31/l44 0 2023-12-07T16:21:36.923 INFO:tasks.workunit.client.0.smithi063.stdout:0/313: mknod d4/dd/de/c60 0 2023-12-07T16:21:36.923 INFO:tasks.workunit.client.1.smithi152.stdout:0/477: rename d0/d27/d11/d68/f9d to d0/dc/d3d/d4c/fa1 0 2023-12-07T16:21:36.925 INFO:tasks.workunit.client.0.smithi063.stdout:9/267: dwrite d0/f31 [0,4194304] 0 2023-12-07T16:21:36.926 INFO:tasks.workunit.client.0.smithi063.stdout:8/386: symlink d7/l76 0 2023-12-07T16:21:36.927 INFO:tasks.workunit.client.0.smithi063.stdout:7/237: mknod d2/d34/d5a/c5e 0 2023-12-07T16:21:36.928 INFO:tasks.workunit.client.0.smithi063.stdout:4/226: mkdir d1/d3/db/d41 0 2023-12-07T16:21:36.930 INFO:tasks.workunit.client.1.smithi152.stdout:0/478: rename d0/dc/c54 to d0/d2f/d30/d6e/d77/ca2 0 2023-12-07T16:21:36.934 INFO:tasks.workunit.client.0.smithi063.stdout:0/314: mkdir d4/dd/de/d15/d1f/d61 0 2023-12-07T16:21:36.934 INFO:tasks.workunit.client.0.smithi063.stdout:0/315: chown d4/dd/d26/f4f 11226 1 2023-12-07T16:21:36.935 INFO:tasks.workunit.client.1.smithi152.stdout:6/408: dwrite d2/f2a [0,4194304] 0 2023-12-07T16:21:36.940 INFO:tasks.workunit.client.1.smithi152.stdout:6/409: creat d2/d6/d9/f7c x:0 0 0 2023-12-07T16:21:36.944 INFO:tasks.workunit.client.0.smithi063.stdout:2/257: rename d0/d26 to d0/d21/d56 0 2023-12-07T16:21:36.944 INFO:tasks.workunit.client.0.smithi063.stdout:9/268: dread d0/d13/d39/d3a/d3e/f4a [0,4194304] 0 2023-12-07T16:21:36.944 INFO:tasks.workunit.client.0.smithi063.stdout:9/269: chown d0/d13/l22 62975 1 2023-12-07T16:21:36.948 INFO:tasks.workunit.client.0.smithi063.stdout:0/316: creat d4/dd/de/d15/d1f/d4c/f62 x:0 0 0 2023-12-07T16:21:36.948 INFO:tasks.workunit.client.1.smithi152.stdout:6/410: write d2/d6/d9/f35 [3746325,23074] 0 2023-12-07T16:21:36.951 INFO:tasks.workunit.client.1.smithi152.stdout:6/411: mknod d2/d6/de/d3f/c7d 0 2023-12-07T16:21:36.952 INFO:tasks.workunit.client.1.smithi152.stdout:6/412: mknod d2/d4f/c7e 0 2023-12-07T16:21:36.953 INFO:tasks.workunit.client.0.smithi063.stdout:3/225: dwrite d7/d9/d1b/f38 [0,4194304] 0 2023-12-07T16:21:36.953 INFO:tasks.workunit.client.0.smithi063.stdout:7/238: rename d2/de to d2/d34/d5a/d5f 0 2023-12-07T16:21:36.956 INFO:tasks.workunit.client.1.smithi152.stdout:6/413: rename d2/d6/d9/c2d to d2/d6/d19/c7f 0 2023-12-07T16:21:36.957 INFO:tasks.workunit.client.1.smithi152.stdout:6/414: getdents d2/d6/de/d2e 0 2023-12-07T16:21:36.957 INFO:tasks.workunit.client.1.smithi152.stdout:6/415: write d2/d6/f4d [4706579,32101] 0 2023-12-07T16:21:36.959 INFO:tasks.workunit.client.1.smithi152.stdout:6/416: creat d2/d6/f80 x:0 0 0 2023-12-07T16:21:36.960 INFO:tasks.workunit.client.0.smithi063.stdout:3/226: creat d7/d9/f45 x:0 0 0 2023-12-07T16:21:36.960 INFO:tasks.workunit.client.1.smithi152.stdout:6/417: mkdir d2/d6/d9/d14/d48/d70/d81 0 2023-12-07T16:21:36.960 INFO:tasks.workunit.client.0.smithi063.stdout:5/230: dread d1/d38/f43 [0,4194304] 0 2023-12-07T16:21:36.962 INFO:tasks.workunit.client.0.smithi063.stdout:2/258: rename d0/d21/d56/c31 to d0/d21/d56/d11/d52/c57 0 2023-12-07T16:21:36.964 INFO:tasks.workunit.client.0.smithi063.stdout:7/239: creat d2/d34/d5a/d5f/d53/f60 x:0 0 0 2023-12-07T16:21:36.964 INFO:tasks.workunit.client.0.smithi063.stdout:7/240: dread - d2/d34/d5a/d5f/f47 zero size 2023-12-07T16:21:36.964 INFO:tasks.workunit.client.0.smithi063.stdout:3/227: creat d7/d9/f46 x:0 0 0 2023-12-07T16:21:36.967 INFO:tasks.workunit.client.1.smithi152.stdout:3/458: dwrite d7/d10/d1a/d2f/f82 [0,4194304] 0 2023-12-07T16:21:36.967 INFO:tasks.workunit.client.0.smithi063.stdout:2/259: creat d0/d21/d56/d11/f58 x:0 0 0 2023-12-07T16:21:36.967 INFO:tasks.workunit.client.0.smithi063.stdout:3/228: mknod d7/d9/c47 0 2023-12-07T16:21:36.967 INFO:tasks.workunit.client.0.smithi063.stdout:3/229: write d7/d9/f26 [891394,32961] 0 2023-12-07T16:21:36.968 INFO:tasks.workunit.client.1.smithi152.stdout:6/418: write d2/f5 [3110602,123961] 0 2023-12-07T16:21:36.970 INFO:tasks.workunit.client.0.smithi063.stdout:5/231: dread d1/f7 [0,4194304] 0 2023-12-07T16:21:36.971 INFO:tasks.workunit.client.1.smithi152.stdout:3/459: mkdir d7/d10/d1a/d25/d8e 0 2023-12-07T16:21:36.972 INFO:tasks.workunit.client.0.smithi063.stdout:2/260: creat d0/d21/d56/d4c/f59 x:0 0 0 2023-12-07T16:21:36.973 INFO:tasks.workunit.client.0.smithi063.stdout:5/232: mknod d1/d38/c45 0 2023-12-07T16:21:36.973 INFO:tasks.workunit.client.1.smithi152.stdout:6/419: creat d2/d6/de/d45/f82 x:0 0 0 2023-12-07T16:21:36.975 INFO:tasks.workunit.client.0.smithi063.stdout:2/261: unlink d0/d21/d56/d11/l50 0 2023-12-07T16:21:36.976 INFO:tasks.workunit.client.0.smithi063.stdout:2/262: symlink d0/d21/l5a 0 2023-12-07T16:21:36.976 INFO:tasks.workunit.client.0.smithi063.stdout:2/263: fsync d0/d21/d56/d11/f23 0 2023-12-07T16:21:36.977 INFO:tasks.workunit.client.0.smithi063.stdout:2/264: mkdir d0/d21/d56/d4c/d5b 0 2023-12-07T16:21:36.978 INFO:tasks.workunit.client.0.smithi063.stdout:2/265: write d0/d21/d56/f20 [3921639,125113] 0 2023-12-07T16:21:36.979 INFO:tasks.workunit.client.0.smithi063.stdout:2/266: read d0/f14 [2016617,33849] 0 2023-12-07T16:21:36.979 INFO:tasks.workunit.client.1.smithi152.stdout:0/479: dwrite d0/dc/d26/f67 [0,4194304] 0 2023-12-07T16:21:36.980 INFO:tasks.workunit.client.1.smithi152.stdout:0/480: mknod d0/dc/d36/ca3 0 2023-12-07T16:21:36.986 INFO:tasks.workunit.client.0.smithi063.stdout:2/267: dread d0/f14 [0,4194304] 0 2023-12-07T16:21:36.986 INFO:tasks.workunit.client.0.smithi063.stdout:2/268: readlink d0/d21/d56/d11/l2e 0 2023-12-07T16:21:36.986 INFO:tasks.workunit.client.0.smithi063.stdout:2/269: stat d0/f48 0 2023-12-07T16:21:36.990 INFO:tasks.workunit.client.0.smithi063.stdout:7/241: dread d2/d21/f2d [0,4194304] 0 2023-12-07T16:21:36.990 INFO:tasks.workunit.client.0.smithi063.stdout:7/242: fsync d2/d2c/f3d 0 2023-12-07T16:21:36.994 INFO:tasks.workunit.client.0.smithi063.stdout:6/295: dwrite d0/d17/d1a/f61 [0,4194304] 0 2023-12-07T16:21:36.997 INFO:tasks.workunit.client.0.smithi063.stdout:5/233: dread d1/d3/f35 [0,4194304] 0 2023-12-07T16:21:36.997 INFO:tasks.workunit.client.0.smithi063.stdout:3/230: dread d7/d9/f12 [0,4194304] 0 2023-12-07T16:21:37.000 INFO:tasks.workunit.client.0.smithi063.stdout:8/387: dwrite d7/d14/d15/f47 [0,4194304] 0 2023-12-07T16:21:37.003 INFO:tasks.workunit.client.0.smithi063.stdout:9/270: dwrite d0/d13/d39/d3a/f4d [0,4194304] 0 2023-12-07T16:21:37.003 INFO:tasks.workunit.client.0.smithi063.stdout:8/388: creat d7/d14/d1a/f77 x:0 0 0 2023-12-07T16:21:37.003 INFO:tasks.workunit.client.0.smithi063.stdout:8/389: chown d7/d14/d15/d2b/f59 140269 1 2023-12-07T16:21:37.004 INFO:tasks.workunit.client.0.smithi063.stdout:4/227: dwrite d1/d3/db/d13/f39 [0,4194304] 0 2023-12-07T16:21:37.004 INFO:tasks.workunit.client.0.smithi063.stdout:0/317: dwrite d4/d25/f2f [0,4194304] 0 2023-12-07T16:21:37.005 INFO:tasks.workunit.client.1.smithi152.stdout:3/460: dwrite d7/f52 [4194304,4194304] 0 2023-12-07T16:21:37.005 INFO:tasks.workunit.client.0.smithi063.stdout:9/271: mkdir d0/d13/d39/d42/d57 0 2023-12-07T16:21:37.005 INFO:tasks.workunit.client.0.smithi063.stdout:9/272: readlink d0/d7/l20 0 2023-12-07T16:21:37.009 INFO:tasks.workunit.client.0.smithi063.stdout:8/390: getdents d7/d14/d4e 0 2023-12-07T16:21:37.010 INFO:tasks.workunit.client.0.smithi063.stdout:8/391: readlink d7/d14/d15/l52 0 2023-12-07T16:21:37.010 INFO:tasks.workunit.client.0.smithi063.stdout:7/243: dwrite d2/d34/f3c [0,4194304] 0 2023-12-07T16:21:37.011 INFO:tasks.workunit.client.1.smithi152.stdout:1/517: sync 2023-12-07T16:21:37.013 INFO:tasks.workunit.client.1.smithi152.stdout:3/461: creat d7/d10/d1a/d25/d4b/d68/f8f x:0 0 0 2023-12-07T16:21:37.013 INFO:tasks.workunit.client.0.smithi063.stdout:4/228: rmdir d1/d3 39 2023-12-07T16:21:37.016 INFO:tasks.workunit.client.1.smithi152.stdout:6/420: rename d2/d6/d9/d14 to d2/d4f/d83 0 2023-12-07T16:21:37.016 INFO:tasks.workunit.client.1.smithi152.stdout:6/421: fsync d2/d6/de/d45/d55/f5e 0 2023-12-07T16:21:37.018 INFO:tasks.workunit.client.1.smithi152.stdout:1/518: mknod dc/d14/d68/ca8 0 2023-12-07T16:21:37.018 INFO:tasks.workunit.client.1.smithi152.stdout:1/519: dread - dc/d14/d18/d64/fa2 zero size 2023-12-07T16:21:37.019 INFO:tasks.workunit.client.1.smithi152.stdout:3/462: symlink d7/dc/d3e/d6b/l90 0 2023-12-07T16:21:37.020 INFO:tasks.workunit.client.1.smithi152.stdout:0/481: rename d0/d27/ff to d0/fa4 0 2023-12-07T16:21:37.022 INFO:tasks.workunit.client.1.smithi152.stdout:6/422: getdents d2/d6 0 2023-12-07T16:21:37.022 INFO:tasks.workunit.client.1.smithi152.stdout:6/423: write d2/d4f/d83/d48/f54 [1304969,30331] 0 2023-12-07T16:21:37.024 INFO:tasks.workunit.client.1.smithi152.stdout:1/520: unlink dc/d14/d68/f82 0 2023-12-07T16:21:37.024 INFO:tasks.workunit.client.1.smithi152.stdout:1/521: getdents dc/d14/d18/d79/d7c 0 2023-12-07T16:21:37.024 INFO:tasks.workunit.client.1.smithi152.stdout:1/522: dread - dc/d14/d18/d45/d74/fa7 zero size 2023-12-07T16:21:37.024 INFO:tasks.workunit.client.1.smithi152.stdout:3/463: creat d7/d10/f91 x:0 0 0 2023-12-07T16:21:37.025 INFO:tasks.workunit.client.1.smithi152.stdout:6/424: unlink d2/d6/d9/f28 0 2023-12-07T16:21:37.027 INFO:tasks.workunit.client.1.smithi152.stdout:1/523: rename dc/d14/d18/d79/d7c to dc/d14/d90/da9 0 2023-12-07T16:21:37.027 INFO:tasks.workunit.client.1.smithi152.stdout:1/524: dread - dc/d14/d18/f3f zero size 2023-12-07T16:21:37.031 INFO:tasks.workunit.client.0.smithi063.stdout:2/270: rename d0/d21/d56/d4c to d0/d1e/d5c 0 2023-12-07T16:21:37.031 INFO:tasks.workunit.client.1.smithi152.stdout:3/464: creat d7/d10/d1a/d25/d78/f92 x:0 0 0 2023-12-07T16:21:37.031 INFO:tasks.workunit.client.1.smithi152.stdout:6/425: rename d2/d6/de/d45/d55/f5e to d2/d4f/d83/d48/f84 0 2023-12-07T16:21:37.031 INFO:tasks.workunit.client.1.smithi152.stdout:1/525: creat dc/d14/d18/d2d/d48/da3/d58/faa x:0 0 0 2023-12-07T16:21:37.031 INFO:tasks.workunit.client.1.smithi152.stdout:3/465: stat d7/dc/d3e/d62/d6d/d84/f85 0 2023-12-07T16:21:37.031 INFO:tasks.workunit.client.1.smithi152.stdout:3/466: truncate d7/dc/d3e/f5e 264310 0 2023-12-07T16:21:37.031 INFO:tasks.workunit.client.1.smithi152.stdout:1/526: write dc/d14/d18/d79/d86/fa0 [871866,120576] 0 2023-12-07T16:21:37.032 INFO:tasks.workunit.client.1.smithi152.stdout:6/426: truncate d2/d6/fc 4184697 0 2023-12-07T16:21:37.033 INFO:tasks.workunit.client.0.smithi063.stdout:2/271: mkdir d0/d21/d56/d11/d52/d5d 0 2023-12-07T16:21:37.034 INFO:tasks.workunit.client.1.smithi152.stdout:1/527: rename dc/d28/l93 to dc/d14/d18/d64/lab 0 2023-12-07T16:21:37.034 INFO:tasks.workunit.client.1.smithi152.stdout:6/427: truncate d2/d6/de/d45/f6e 1634742 0 2023-12-07T16:21:37.035 INFO:tasks.workunit.client.1.smithi152.stdout:1/528: creat dc/d14/d90/fac x:0 0 0 2023-12-07T16:21:37.035 INFO:tasks.workunit.client.1.smithi152.stdout:6/428: stat d2/l43 0 2023-12-07T16:21:37.038 INFO:tasks.workunit.client.0.smithi063.stdout:7/244: write d2/f1e [5041180,102550] 0 2023-12-07T16:21:37.039 INFO:tasks.workunit.client.1.smithi152.stdout:0/482: dread d0/d27/f6d [0,4194304] 0 2023-12-07T16:21:37.039 INFO:tasks.workunit.client.1.smithi152.stdout:0/483: chown d0/dc/d3d/d73 348113 1 2023-12-07T16:21:37.042 INFO:tasks.workunit.client.0.smithi063.stdout:7/245: mkdir d2/d34/d5a/d5f/d61 0 2023-12-07T16:21:37.043 INFO:tasks.workunit.client.1.smithi152.stdout:1/529: write dc/d28/f39 [2717350,70727] 0 2023-12-07T16:21:37.043 INFO:tasks.workunit.client.1.smithi152.stdout:1/530: chown dc/d14/d18/d45/l49 1 1 2023-12-07T16:21:37.045 INFO:tasks.workunit.client.1.smithi152.stdout:1/531: mknod dc/d14/d90/da9/cad 0 2023-12-07T16:21:37.045 INFO:tasks.workunit.client.1.smithi152.stdout:1/532: truncate dc/d14/d18/d79/f8d 382028 0 2023-12-07T16:21:37.051 INFO:tasks.workunit.client.0.smithi063.stdout:5/234: dwrite d1/f40 [0,4194304] 0 2023-12-07T16:21:37.051 INFO:tasks.workunit.client.0.smithi063.stdout:5/235: write d1/d3/de/f28 [1987027,128594] 0 2023-12-07T16:21:37.067 INFO:tasks.workunit.client.0.smithi063.stdout:6/296: dwrite d0/d1e/f26 [0,4194304] 0 2023-12-07T16:21:37.070 INFO:tasks.workunit.client.0.smithi063.stdout:9/273: dwrite d0/d13/f49 [0,4194304] 0 2023-12-07T16:21:37.070 INFO:tasks.workunit.client.0.smithi063.stdout:8/392: dwrite d7/d14/d15/d2b/d40/f62 [0,4194304] 0 2023-12-07T16:21:37.070 INFO:tasks.workunit.client.0.smithi063.stdout:6/297: link d0/d17/l23 d0/d1e/d1d/d1f/d4b/l6a 0 2023-12-07T16:21:37.070 INFO:tasks.workunit.client.0.smithi063.stdout:6/298: chown d0/d1e 5 1 2023-12-07T16:21:37.070 INFO:tasks.workunit.client.0.smithi063.stdout:3/231: dwrite f6 [0,4194304] 0 2023-12-07T16:21:37.070 INFO:tasks.workunit.client.0.smithi063.stdout:3/232: chown d7/d9/d1b/c36 122 1 2023-12-07T16:21:37.070 INFO:tasks.workunit.client.0.smithi063.stdout:0/318: dwrite d4/dd/de/d15/d59/f49 [0,4194304] 0 2023-12-07T16:21:37.070 INFO:tasks.workunit.client.0.smithi063.stdout:7/246: dwrite d2/d34/d5a/d5f/f16 [0,4194304] 0 2023-12-07T16:21:37.072 INFO:tasks.workunit.client.0.smithi063.stdout:9/274: write d0/f31 [3493831,72577] 0 2023-12-07T16:21:37.072 INFO:tasks.workunit.client.0.smithi063.stdout:9/275: chown d0/d21/l3c 42927 1 2023-12-07T16:21:37.072 INFO:tasks.workunit.client.1.smithi152.stdout:3/467: dwrite d7/d10/d1a/f28 [0,4194304] 0 2023-12-07T16:21:37.073 INFO:tasks.workunit.client.0.smithi063.stdout:8/393: creat d7/d14/d4e/f78 x:0 0 0 2023-12-07T16:21:37.074 INFO:tasks.workunit.client.0.smithi063.stdout:8/394: fdatasync d7/d14/d1a/f5c 0 2023-12-07T16:21:37.076 INFO:tasks.workunit.client.1.smithi152.stdout:3/468: symlink d7/d10/d1a/d2f/l93 0 2023-12-07T16:21:37.077 INFO:tasks.workunit.client.1.smithi152.stdout:3/469: symlink d7/dc/d3e/d62/l94 0 2023-12-07T16:21:37.078 INFO:tasks.workunit.client.1.smithi152.stdout:3/470: creat d7/dc/d3e/f95 x:0 0 0 2023-12-07T16:21:37.079 INFO:tasks.workunit.client.1.smithi152.stdout:3/471: getdents d7/dc/d3e/d7d 0 2023-12-07T16:21:37.085 INFO:tasks.workunit.client.1.smithi152.stdout:6/429: rename d2/d6 to d2/d4f/d83/d85 0 2023-12-07T16:21:37.085 INFO:tasks.workunit.client.1.smithi152.stdout:1/533: fsync dc/d14/d90/fac 0 2023-12-07T16:21:37.086 INFO:tasks.workunit.client.0.smithi063.stdout:5/236: truncate d1/f40 1651007 0 2023-12-07T16:21:37.086 INFO:tasks.workunit.client.0.smithi063.stdout:0/319: write d4/dd/de/d15/d1f/d22/f23 [7299980,130865] 0 2023-12-07T16:21:37.086 INFO:tasks.workunit.client.0.smithi063.stdout:0/320: dread - d4/dd/de/d15/d1f/d4c/f62 zero size 2023-12-07T16:21:37.086 INFO:tasks.workunit.client.0.smithi063.stdout:0/321: fdatasync d4/f55 0 2023-12-07T16:21:37.087 INFO:tasks.workunit.client.1.smithi152.stdout:1/534: dread - dc/d14/d18/d64/f8f zero size 2023-12-07T16:21:37.087 INFO:tasks.workunit.client.1.smithi152.stdout:1/535: stat dc/d14/d18/f70 0 2023-12-07T16:21:37.087 INFO:tasks.workunit.client.1.smithi152.stdout:6/430: creat d2/d4f/d83/d85/de/d45/f86 x:0 0 0 2023-12-07T16:21:37.090 INFO:tasks.workunit.client.0.smithi063.stdout:7/247: creat d2/d34/d46/d48/f62 x:0 0 0 2023-12-07T16:21:37.093 INFO:tasks.workunit.client.1.smithi152.stdout:3/472: dread d7/f32 [0,4194304] 0 2023-12-07T16:21:37.093 INFO:tasks.workunit.client.1.smithi152.stdout:3/473: fsync d7/dc/f12 0 2023-12-07T16:21:37.093 INFO:tasks.workunit.client.1.smithi152.stdout:3/474: write d7/dc/f33 [203667,118595] 0 2023-12-07T16:21:37.094 INFO:tasks.workunit.client.0.smithi063.stdout:9/276: creat d0/d7/f58 x:0 0 0 2023-12-07T16:21:37.095 INFO:tasks.workunit.client.1.smithi152.stdout:3/475: mkdir d7/d10/d41/d96 0 2023-12-07T16:21:37.096 INFO:tasks.workunit.client.1.smithi152.stdout:6/431: dread d2/d4f/d83/d48/f54 [0,4194304] 0 2023-12-07T16:21:37.096 INFO:tasks.workunit.client.0.smithi063.stdout:5/237: truncate d1/f11 281817 0 2023-12-07T16:21:37.097 INFO:tasks.workunit.client.0.smithi063.stdout:0/322: mkdir d4/dd/de/d15/d52/d5b/d63 0 2023-12-07T16:21:37.097 INFO:tasks.workunit.client.0.smithi063.stdout:0/323: truncate d4/dd/de/d15/d59/f49 4948864 0 2023-12-07T16:21:37.097 INFO:tasks.workunit.client.0.smithi063.stdout:0/324: write d4/f55 [325563,126114] 0 2023-12-07T16:21:37.098 INFO:tasks.workunit.client.0.smithi063.stdout:9/277: truncate d0/d13/d39/d3a/d3e/f4a 2573428 0 2023-12-07T16:21:37.098 INFO:tasks.workunit.client.1.smithi152.stdout:3/476: creat d7/dc/d3e/d48/f97 x:0 0 0 2023-12-07T16:21:37.098 INFO:tasks.workunit.client.0.smithi063.stdout:5/238: getdents d1/d3/d3a 0 2023-12-07T16:21:37.101 INFO:tasks.workunit.client.1.smithi152.stdout:6/432: write d2/f3 [6017818,128969] 0 2023-12-07T16:21:37.101 INFO:tasks.workunit.client.1.smithi152.stdout:6/433: chown d2/d4f/d83/d85/de/d2e/c64 17179 1 2023-12-07T16:21:37.101 INFO:tasks.workunit.client.0.smithi063.stdout:5/239: rename d1/d3/de/d1e/d25/f36 to d1/d3/de/d1e/f46 0 2023-12-07T16:21:37.101 INFO:tasks.workunit.client.0.smithi063.stdout:5/240: truncate d1/d3/de/d1e/d25/f3c 681339 0 2023-12-07T16:21:37.102 INFO:tasks.workunit.client.0.smithi063.stdout:0/325: dread d4/f16 [4194304,4194304] 0 2023-12-07T16:21:37.102 INFO:tasks.workunit.client.0.smithi063.stdout:0/326: chown d4/d25/l36 1906 1 2023-12-07T16:21:37.104 INFO:tasks.workunit.client.0.smithi063.stdout:5/241: truncate d1/d31/f33 2663743 0 2023-12-07T16:21:37.106 INFO:tasks.workunit.client.0.smithi063.stdout:5/242: creat d1/d3/de/d1e/f47 x:0 0 0 2023-12-07T16:21:37.107 INFO:tasks.workunit.client.0.smithi063.stdout:0/327: write d4/dd/f4e [3771465,31562] 0 2023-12-07T16:21:37.107 INFO:tasks.workunit.client.0.smithi063.stdout:0/328: getdents d4/dd/d26/d2b/d5e 0 2023-12-07T16:21:37.107 INFO:tasks.workunit.client.0.smithi063.stdout:0/329: readlink d4/dd/l3f 0 2023-12-07T16:21:37.107 INFO:tasks.workunit.client.0.smithi063.stdout:0/330: fsync d4/d25/f4b 0 2023-12-07T16:21:37.108 INFO:tasks.workunit.client.0.smithi063.stdout:5/243: write d1/d3/de/d1e/f1d [263888,21198] 0 2023-12-07T16:21:37.109 INFO:tasks.workunit.client.0.smithi063.stdout:0/331: creat d4/dd/d26/d2b/d5e/f64 x:0 0 0 2023-12-07T16:21:37.111 INFO:tasks.workunit.client.0.smithi063.stdout:5/244: unlink d1/d3/d3a/c3f 0 2023-12-07T16:21:37.113 INFO:tasks.workunit.client.1.smithi152.stdout:3/477: dread d7/d10/d19/f45 [0,4194304] 0 2023-12-07T16:21:37.113 INFO:tasks.workunit.client.1.smithi152.stdout:3/478: write d7/d10/d1a/d25/d3f/f51 [666357,46906] 0 2023-12-07T16:21:37.114 INFO:tasks.workunit.client.0.smithi063.stdout:5/245: unlink d1/d3/de/d1e/f21 0 2023-12-07T16:21:37.114 INFO:tasks.workunit.client.0.smithi063.stdout:5/246: write d1/d3/de/f14 [4544324,91507] 0 2023-12-07T16:21:37.115 INFO:tasks.workunit.client.0.smithi063.stdout:6/299: dwrite d0/f8 [0,4194304] 0 2023-12-07T16:21:37.116 INFO:tasks.workunit.client.0.smithi063.stdout:5/247: symlink d1/d31/l48 0 2023-12-07T16:21:37.116 INFO:tasks.workunit.client.1.smithi152.stdout:3/479: rename d7/d10/d41/d70 to d7/dc/d3e/d62/d6d/d98 0 2023-12-07T16:21:37.117 INFO:tasks.workunit.client.1.smithi152.stdout:1/536: dwrite dc/f63 [0,4194304] 0 2023-12-07T16:21:37.120 INFO:tasks.workunit.client.0.smithi063.stdout:3/233: dwrite d7/d21/f29 [0,4194304] 0 2023-12-07T16:21:37.120 INFO:tasks.workunit.client.0.smithi063.stdout:8/395: dwrite d7/d14/d15/d57/f66 [0,4194304] 0 2023-12-07T16:21:37.120 INFO:tasks.workunit.client.0.smithi063.stdout:7/248: dwrite d2/f12 [0,4194304] 0 2023-12-07T16:21:37.120 INFO:tasks.workunit.client.1.smithi152.stdout:3/480: creat d7/dc/d3e/d7d/f99 x:0 0 0 2023-12-07T16:21:37.121 INFO:tasks.workunit.client.0.smithi063.stdout:3/234: unlink d7/d9/f33 0 2023-12-07T16:21:37.121 INFO:tasks.workunit.client.1.smithi152.stdout:1/537: link dc/d14/d18/d64/d8a/la5 dc/d14/d18/d2d/d4a/lae 0 2023-12-07T16:21:37.121 INFO:tasks.workunit.client.1.smithi152.stdout:1/538: readlink dc/d14/d18/d45/l56 0 2023-12-07T16:21:37.123 INFO:tasks.workunit.client.0.smithi063.stdout:8/396: truncate f5 1207477 0 2023-12-07T16:21:37.125 INFO:tasks.workunit.client.0.smithi063.stdout:7/249: mknod d2/d34/d5a/c63 0 2023-12-07T16:21:37.125 INFO:tasks.workunit.client.0.smithi063.stdout:3/235: write d7/d9/dd/f1f [2907685,16355] 0 2023-12-07T16:21:37.126 INFO:tasks.workunit.client.0.smithi063.stdout:8/397: unlink d7/d14/d1a/f6e 0 2023-12-07T16:21:37.127 INFO:tasks.workunit.client.0.smithi063.stdout:3/236: write d7/d9/dd/f19 [1722080,39441] 0 2023-12-07T16:21:37.130 INFO:tasks.workunit.client.1.smithi152.stdout:6/434: dwrite d2/d4f/d83/d85/d19/d1f/f20 [0,4194304] 0 2023-12-07T16:21:37.131 INFO:tasks.workunit.client.0.smithi063.stdout:7/250: unlink d2/d37/c44 0 2023-12-07T16:21:37.131 INFO:tasks.workunit.client.0.smithi063.stdout:8/398: rename d7/d14/d4e/f67 to d7/d14/d15/d2b/f79 0 2023-12-07T16:21:37.131 INFO:tasks.workunit.client.0.smithi063.stdout:3/237: creat d7/f48 x:0 0 0 2023-12-07T16:21:37.131 INFO:tasks.workunit.client.0.smithi063.stdout:8/399: fsync d7/d14/f4f 0 2023-12-07T16:21:37.131 INFO:tasks.workunit.client.0.smithi063.stdout:7/251: truncate d2/d34/d5a/d5f/f20 2871 0 2023-12-07T16:21:37.132 INFO:tasks.workunit.client.1.smithi152.stdout:6/435: mknod d2/d4f/d83/d85/d9/c87 0 2023-12-07T16:21:37.133 INFO:tasks.workunit.client.0.smithi063.stdout:3/238: read d7/fe [3298417,25318] 0 2023-12-07T16:21:37.133 INFO:tasks.workunit.client.0.smithi063.stdout:7/252: truncate d2/d34/d5a/d5f/f15 2198859 0 2023-12-07T16:21:37.133 INFO:tasks.workunit.client.0.smithi063.stdout:7/253: fsync d2/f17 0 2023-12-07T16:21:37.133 INFO:tasks.workunit.client.0.smithi063.stdout:7/254: chown d2/d34/d46/d5d 6049 1 2023-12-07T16:21:37.133 INFO:tasks.workunit.client.0.smithi063.stdout:7/255: chown d2/d2c/l2e 555612 1 2023-12-07T16:21:37.134 INFO:tasks.workunit.client.0.smithi063.stdout:3/239: mkdir d7/d49 0 2023-12-07T16:21:37.134 INFO:tasks.workunit.client.0.smithi063.stdout:3/240: write d7/d9/d2b/f43 [908047,54122] 0 2023-12-07T16:21:37.134 INFO:tasks.workunit.client.0.smithi063.stdout:3/241: mknod d7/d9/c4a 0 2023-12-07T16:21:37.135 INFO:tasks.workunit.client.0.smithi063.stdout:7/256: mkdir d2/d64 0 2023-12-07T16:21:37.139 INFO:tasks.workunit.client.0.smithi063.stdout:5/248: dread d1/d3/de/f10 [0,4194304] 0 2023-12-07T16:21:37.139 INFO:tasks.workunit.client.0.smithi063.stdout:5/249: write d1/d3/de/d1e/f46 [224859,26024] 0 2023-12-07T16:21:37.146 INFO:tasks.workunit.client.0.smithi063.stdout:8/400: dread d7/d14/d15/f47 [0,4194304] 0 2023-12-07T16:21:37.146 INFO:tasks.workunit.client.1.smithi152.stdout:6/436: dread d2/d4f/d83/d85/d19/d1f/f20 [0,4194304] 0 2023-12-07T16:21:37.147 INFO:tasks.workunit.client.0.smithi063.stdout:8/401: truncate d7/d14/d1a/f33 61197 0 2023-12-07T16:21:37.147 INFO:tasks.workunit.client.0.smithi063.stdout:8/402: truncate d7/d14/d1a/d54/f5b 941296 0 2023-12-07T16:21:37.147 INFO:tasks.workunit.client.0.smithi063.stdout:8/403: getdents d7/d38/d73 0 2023-12-07T16:21:37.148 INFO:tasks.workunit.client.1.smithi152.stdout:6/437: mknod d2/d4f/d83/d85/c88 0 2023-12-07T16:21:37.148 INFO:tasks.workunit.client.1.smithi152.stdout:6/438: fsync d2/d4f/d83/d85/de/d3f/f40 0 2023-12-07T16:21:37.148 INFO:tasks.workunit.client.1.smithi152.stdout:6/439: stat d2/d4f/d83/d85/de/d3f 0 2023-12-07T16:21:37.148 INFO:tasks.workunit.client.0.smithi063.stdout:8/404: stat d7/d14/d15/d48/l45 0 2023-12-07T16:21:37.148 INFO:tasks.workunit.client.0.smithi063.stdout:8/405: stat d7/d14/d1a/f56 0 2023-12-07T16:21:37.157 INFO:tasks.workunit.client.0.smithi063.stdout:7/257: dwrite d2/f1a [0,4194304] 0 2023-12-07T16:21:37.157 INFO:tasks.workunit.client.0.smithi063.stdout:7/258: chown d2/d34/d46/d5d 1 1 2023-12-07T16:21:37.157 INFO:tasks.workunit.client.0.smithi063.stdout:7/259: write d2/d21/f49 [501809,54163] 0 2023-12-07T16:21:37.157 INFO:tasks.workunit.client.0.smithi063.stdout:7/260: dread - d2/d34/f3b zero size 2023-12-07T16:21:37.157 INFO:tasks.workunit.client.0.smithi063.stdout:8/406: dread d7/d14/f35 [0,4194304] 0 2023-12-07T16:21:37.157 INFO:tasks.workunit.client.0.smithi063.stdout:8/407: chown d7/d14/d15/f2d 210674802 1 2023-12-07T16:21:37.157 INFO:tasks.workunit.client.0.smithi063.stdout:7/261: mknod d2/d34/d5a/d5f/d61/c65 0 2023-12-07T16:21:37.158 INFO:tasks.workunit.client.1.smithi152.stdout:6/440: dread d2/f5 [4194304,4194304] 0 2023-12-07T16:21:37.159 INFO:tasks.workunit.client.1.smithi152.stdout:6/441: creat d2/d4f/d83/d85/f89 x:0 0 0 2023-12-07T16:21:37.159 INFO:tasks.workunit.client.1.smithi152.stdout:6/442: readlink d2/d4f/d83/d85/d19/l76 0 2023-12-07T16:21:37.159 INFO:tasks.workunit.client.1.smithi152.stdout:6/443: stat d2/d4f/d83/d85/d19/d1f/d49/l75 0 2023-12-07T16:21:37.159 INFO:tasks.workunit.client.1.smithi152.stdout:6/444: getdents d2/d4f/d83/d85/de/d45/d55 0 2023-12-07T16:21:37.162 INFO:tasks.workunit.client.0.smithi063.stdout:7/262: dread d2/d21/f2d [0,4194304] 0 2023-12-07T16:21:37.162 INFO:tasks.workunit.client.0.smithi063.stdout:7/263: getdents d2/d34/d46/d48/d56 0 2023-12-07T16:21:37.164 INFO:tasks.workunit.client.0.smithi063.stdout:7/264: creat d2/d34/d5a/f66 x:0 0 0 2023-12-07T16:21:37.165 INFO:tasks.workunit.client.0.smithi063.stdout:7/265: symlink d2/d34/d5a/d5f/d61/l67 0 2023-12-07T16:21:37.165 INFO:tasks.workunit.client.1.smithi152.stdout:6/445: dread d2/d4f/d83/d85/de/d2e/f41 [0,4194304] 0 2023-12-07T16:21:37.165 INFO:tasks.workunit.client.1.smithi152.stdout:6/446: readlink d2/d4f/d83/d85/l10 0 2023-12-07T16:21:37.165 INFO:tasks.workunit.client.1.smithi152.stdout:6/447: fsync d2/d4f/d83/d85/d19/d1f/f20 0 2023-12-07T16:21:37.166 INFO:tasks.workunit.client.0.smithi063.stdout:7/266: creat d2/d2c/f68 x:0 0 0 2023-12-07T16:21:37.166 INFO:tasks.workunit.client.0.smithi063.stdout:7/267: mknod d2/d34/d5a/c69 0 2023-12-07T16:21:37.166 INFO:tasks.workunit.client.1.smithi152.stdout:6/448: mknod d2/d4f/d83/d85/d19/d1f/c8a 0 2023-12-07T16:21:37.166 INFO:tasks.workunit.client.1.smithi152.stdout:6/449: chown d2/d4f/d83/d85/d19/f46 195553 1 2023-12-07T16:21:37.167 INFO:tasks.workunit.client.1.smithi152.stdout:6/450: mkdir d2/d4f/d83/d85/de/d3f/d8b 0 2023-12-07T16:21:37.167 INFO:tasks.workunit.client.0.smithi063.stdout:7/268: creat d2/d34/d5a/d5f/d61/f6a x:0 0 0 2023-12-07T16:21:37.169 INFO:tasks.workunit.client.0.smithi063.stdout:7/269: rename d2/d21/l4b to d2/d64/l6b 0 2023-12-07T16:21:37.171 INFO:tasks.workunit.client.0.smithi063.stdout:1/184: sync 2023-12-07T16:21:37.171 INFO:tasks.workunit.client.0.smithi063.stdout:1/185: rename d0/dd/d10/d13/d2f to d0/dd/d10/d13/d2f/d40 22 2023-12-07T16:21:37.174 INFO:tasks.workunit.client.0.smithi063.stdout:1/186: creat d0/dd/f41 x:0 0 0 2023-12-07T16:21:37.174 INFO:tasks.workunit.client.0.smithi063.stdout:1/187: write d0/dd/d10/d1e/f2e [4392812,118949] 0 2023-12-07T16:21:37.174 INFO:tasks.workunit.client.1.smithi152.stdout:6/451: getdents d2/d4f/d83 0 2023-12-07T16:21:37.174 INFO:tasks.workunit.client.1.smithi152.stdout:6/452: fdatasync d2/f2a 0 2023-12-07T16:21:37.174 INFO:tasks.workunit.client.1.smithi152.stdout:6/453: chown d2/d4f/d83/d85/d9 30783665 1 2023-12-07T16:21:37.174 INFO:tasks.workunit.client.0.smithi063.stdout:5/250: fsync d1/f32 0 2023-12-07T16:21:37.175 INFO:tasks.workunit.client.1.smithi152.stdout:6/454: getdents d2/d4f/d83/d85/de 0 2023-12-07T16:21:37.178 INFO:tasks.workunit.client.1.smithi152.stdout:6/455: creat d2/d4f/d83/d85/de/d3f/f8c x:0 0 0 2023-12-07T16:21:37.178 INFO:tasks.workunit.client.1.smithi152.stdout:6/456: dread - d2/d4f/d83/d85/de/d2e/d4c/d5d/f6b zero size 2023-12-07T16:21:37.178 INFO:tasks.workunit.client.0.smithi063.stdout:1/188: rename d0/dd/d10/d1e/f33 to d0/dd/f42 0 2023-12-07T16:21:37.178 INFO:tasks.workunit.client.0.smithi063.stdout:1/189: write d0/dd/d10/d1e/f2c [1001893,68091] 0 2023-12-07T16:21:37.178 INFO:tasks.workunit.client.0.smithi063.stdout:0/332: getdents d4/dd/de/d15/d52/d5b 0 2023-12-07T16:21:37.179 INFO:tasks.workunit.client.0.smithi063.stdout:0/333: chown d4/f5 31 1 2023-12-07T16:21:37.180 INFO:tasks.workunit.client.0.smithi063.stdout:7/270: dread d2/d34/d5a/d5f/f18 [0,4194304] 0 2023-12-07T16:21:37.180 INFO:tasks.workunit.client.0.smithi063.stdout:7/271: fdatasync d2/d34/d5a/d5f/f4d 0 2023-12-07T16:21:37.181 INFO:tasks.workunit.client.1.smithi152.stdout:1/539: rmdir dc/d14/d18/d64 39 2023-12-07T16:21:37.181 INFO:tasks.workunit.client.0.smithi063.stdout:6/300: dwrite d0/d17/f5d [0,4194304] 0 2023-12-07T16:21:37.181 INFO:tasks.workunit.client.0.smithi063.stdout:5/251: mknod d1/d38/c49 0 2023-12-07T16:21:37.181 INFO:tasks.workunit.client.0.smithi063.stdout:5/252: stat d1/d3/f3b 0 2023-12-07T16:21:37.182 INFO:tasks.workunit.client.0.smithi063.stdout:5/253: fsync d1/d38/f43 0 2023-12-07T16:21:37.182 INFO:tasks.workunit.client.0.smithi063.stdout:5/254: truncate d1/d3/de/d1e/d25/f3c 1642376 0 2023-12-07T16:21:37.182 INFO:tasks.workunit.client.1.smithi152.stdout:1/540: creat dc/d14/d18/d64/faf x:0 0 0 2023-12-07T16:21:37.183 INFO:tasks.workunit.client.1.smithi152.stdout:1/541: write dc/fd [5630218,81785] 0 2023-12-07T16:21:37.186 INFO:tasks.workunit.client.0.smithi063.stdout:1/190: creat d0/dd/d19/f43 x:0 0 0 2023-12-07T16:21:37.186 INFO:tasks.workunit.client.0.smithi063.stdout:1/191: readlink d0/dd/d19/l34 0 2023-12-07T16:21:37.187 INFO:tasks.workunit.client.1.smithi152.stdout:6/457: dread d2/d4f/d83/d85/de/d2e/d38/f50 [0,4194304] 0 2023-12-07T16:21:37.188 INFO:tasks.workunit.client.0.smithi063.stdout:0/334: getdents d4/dd 0 2023-12-07T16:21:37.194 INFO:tasks.workunit.client.1.smithi152.stdout:1/542: write dc/d28/f39 [5784664,51592] 0 2023-12-07T16:21:37.196 INFO:tasks.workunit.client.1.smithi152.stdout:1/543: unlink dc/f4d 0 2023-12-07T16:21:37.196 INFO:tasks.workunit.client.1.smithi152.stdout:1/544: chown dc/d14/d18/d64/fa2 77249566 1 2023-12-07T16:21:37.196 INFO:tasks.workunit.client.1.smithi152.stdout:1/545: fsync dc/d14/d68/f6b 0 2023-12-07T16:21:37.197 INFO:tasks.workunit.client.1.smithi152.stdout:1/546: creat dc/d28/d7d/da4/fb0 x:0 0 0 2023-12-07T16:21:37.198 INFO:tasks.workunit.client.0.smithi063.stdout:7/272: link d2/d2c/f68 d2/d37/f6c 0 2023-12-07T16:21:37.198 INFO:tasks.workunit.client.0.smithi063.stdout:6/301: dread d0/f8 [0,4194304] 0 2023-12-07T16:21:37.199 INFO:tasks.workunit.client.1.smithi152.stdout:1/547: creat dc/d14/fb1 x:0 0 0 2023-12-07T16:21:37.199 INFO:tasks.workunit.client.1.smithi152.stdout:1/548: write dc/d28/f5e [1640973,46728] 0 2023-12-07T16:21:37.200 INFO:tasks.workunit.client.0.smithi063.stdout:9/278: dread d0/d13/d39/d3a/d3e/f4a [0,4194304] 0 2023-12-07T16:21:37.205 INFO:tasks.workunit.client.1.smithi152.stdout:1/549: write dc/d28/d4e/f61 [1188489,98191] 0 2023-12-07T16:21:37.207 INFO:tasks.workunit.client.1.smithi152.stdout:1/550: rmdir dc/d14/d18/d2d/d48/da3/d58 39 2023-12-07T16:21:37.207 INFO:tasks.workunit.client.1.smithi152.stdout:1/551: fsync dc/d14/d18/d2d/d48/da3/f2e 0 2023-12-07T16:21:37.208 INFO:tasks.workunit.client.1.smithi152.stdout:1/552: mkdir dc/d14/d18/d2d/d9c/db2 0 2023-12-07T16:21:37.209 INFO:tasks.workunit.client.0.smithi063.stdout:1/192: dwrite d0/dd/d10/d1e/f31 [0,4194304] 0 2023-12-07T16:21:37.210 INFO:tasks.workunit.client.1.smithi152.stdout:6/458: dwrite d2/d4f/d83/d85/de/d2e/d38/f50 [0,4194304] 0 2023-12-07T16:21:37.219 INFO:tasks.workunit.client.0.smithi063.stdout:8/408: getdents d7/d14/d1a 0 2023-12-07T16:21:37.219 INFO:tasks.workunit.client.0.smithi063.stdout:8/409: write d7/d14/d1a/d54/f5b [611298,14780] 0 2023-12-07T16:21:37.220 INFO:tasks.workunit.client.0.smithi063.stdout:8/410: chown d7/d14/d15/l52 67643588 1 2023-12-07T16:21:37.229 INFO:tasks.workunit.client.1.smithi152.stdout:1/553: dread dc/d28/d4e/f61 [0,4194304] 0 2023-12-07T16:21:37.230 INFO:tasks.workunit.client.0.smithi063.stdout:5/255: getdents d1/d31 0 2023-12-07T16:21:37.230 INFO:tasks.workunit.client.0.smithi063.stdout:5/256: fsync d1/d3/de/f10 0 2023-12-07T16:21:37.233 INFO:tasks.workunit.client.0.smithi063.stdout:0/335: creat d4/dd/d26/d2b/d5e/f65 x:0 0 0 2023-12-07T16:21:37.236 INFO:tasks.workunit.client.0.smithi063.stdout:6/302: truncate d0/fe 4065855 0 2023-12-07T16:21:37.237 INFO:tasks.workunit.client.1.smithi152.stdout:6/459: dwrite d2/d4f/d83/d85/d9/f35 [0,4194304] 0 2023-12-07T16:21:37.237 INFO:tasks.workunit.client.1.smithi152.stdout:6/460: truncate d2/d4f/d83/d85/d19/f22 419491 0 2023-12-07T16:21:37.237 INFO:tasks.workunit.client.1.smithi152.stdout:6/461: chown d2/d4f/d83/d85/de/d2e/f41 9034 1 2023-12-07T16:21:37.241 INFO:tasks.workunit.client.0.smithi063.stdout:9/279: mknod d0/d13/c59 0 2023-12-07T16:21:37.249 INFO:tasks.workunit.client.1.smithi152.stdout:6/462: dread d2/d4f/d83/d85/d19/d1f/f47 [0,4194304] 0 2023-12-07T16:21:37.249 INFO:tasks.workunit.client.1.smithi152.stdout:6/463: chown d2/d4f/d83/d85/d19/d1f/f20 1 1 2023-12-07T16:21:37.249 INFO:tasks.workunit.client.1.smithi152.stdout:6/464: readlink d2/d4f/d83/d85/l10 0 2023-12-07T16:21:37.250 INFO:tasks.workunit.client.1.smithi152.stdout:6/465: creat d2/d4f/d83/d48/f8d x:0 0 0 2023-12-07T16:21:37.252 INFO:tasks.workunit.client.0.smithi063.stdout:8/411: dwrite d7/d14/d15/f46 [0,4194304] 0 2023-12-07T16:21:37.252 INFO:tasks.workunit.client.0.smithi063.stdout:8/412: dread - d7/d14/d1a/f51 zero size 2023-12-07T16:21:37.252 INFO:tasks.workunit.client.0.smithi063.stdout:0/336: creat d4/dd/de/d15/d1f/d61/f66 x:0 0 0 2023-12-07T16:21:37.255 INFO:tasks.workunit.client.0.smithi063.stdout:7/273: getdents d2/d21 0 2023-12-07T16:21:37.256 INFO:tasks.workunit.client.0.smithi063.stdout:6/303: stat d0/d1e/d29/l4e 0 2023-12-07T16:21:37.256 INFO:tasks.workunit.client.0.smithi063.stdout:6/304: chown d0/d1e/f63 465 1 2023-12-07T16:21:37.257 INFO:tasks.workunit.client.0.smithi063.stdout:5/257: dwrite d1/f2a [0,4194304] 0 2023-12-07T16:21:37.257 INFO:tasks.workunit.client.1.smithi152.stdout:1/554: dwrite dc/d14/d18/d64/f89 [0,4194304] 0 2023-12-07T16:21:37.258 INFO:tasks.workunit.client.1.smithi152.stdout:1/555: fsync dc/d14/d90/fac 0 2023-12-07T16:21:37.258 INFO:tasks.workunit.client.0.smithi063.stdout:9/280: creat d0/d21/f5a x:0 0 0 2023-12-07T16:21:37.260 INFO:tasks.workunit.client.0.smithi063.stdout:8/413: mknod d7/d14/d15/d2b/c7a 0 2023-12-07T16:21:37.262 INFO:tasks.workunit.client.1.smithi152.stdout:1/556: symlink dc/d14/d18/d2d/d48/lb3 0 2023-12-07T16:21:37.264 INFO:tasks.workunit.client.1.smithi152.stdout:1/557: getdents dc 0 2023-12-07T16:21:37.265 INFO:tasks.workunit.client.0.smithi063.stdout:0/337: mknod d4/dd/de/d15/d52/d5b/d63/c67 0 2023-12-07T16:21:37.265 INFO:tasks.workunit.client.0.smithi063.stdout:0/338: chown d4/dd/de/f13 7 1 2023-12-07T16:21:37.265 INFO:tasks.workunit.client.0.smithi063.stdout:7/274: mkdir d2/d34/d5a/d5f/d6d 0 2023-12-07T16:21:37.265 INFO:tasks.workunit.client.0.smithi063.stdout:1/193: rmdir d0/dd 39 2023-12-07T16:21:37.266 INFO:tasks.workunit.client.0.smithi063.stdout:1/194: read - d0/dd/d19/f43 zero size 2023-12-07T16:21:37.266 INFO:tasks.workunit.client.1.smithi152.stdout:1/558: unlink dc/d14/c29 0 2023-12-07T16:21:37.266 INFO:tasks.workunit.client.1.smithi152.stdout:1/559: chown dc/d14/d18/d2d/d4a/c59 116 1 2023-12-07T16:21:37.266 INFO:tasks.workunit.client.1.smithi152.stdout:1/560: rmdir dc/d14/d18/d2d/d4a/d52 39 2023-12-07T16:21:37.268 INFO:tasks.workunit.client.0.smithi063.stdout:9/281: truncate d0/d13/f49 3314238 0 2023-12-07T16:21:37.269 INFO:tasks.workunit.client.0.smithi063.stdout:8/414: rename d7/d14/d1a/d54/l55 to d7/l7b 0 2023-12-07T16:21:37.271 INFO:tasks.workunit.client.0.smithi063.stdout:0/339: mkdir d4/dd/de/d2d/d68 0 2023-12-07T16:21:37.271 INFO:tasks.workunit.client.0.smithi063.stdout:0/340: truncate d4/dd/de/f13 5205117 0 2023-12-07T16:21:37.271 INFO:tasks.workunit.client.0.smithi063.stdout:0/341: truncate d4/dd/d26/d2b/d5e/f65 985316 0 2023-12-07T16:21:37.273 INFO:tasks.workunit.client.0.smithi063.stdout:1/195: truncate d0/dd/f16 3256631 0 2023-12-07T16:21:37.274 INFO:tasks.workunit.client.0.smithi063.stdout:6/305: dread d0/d17/f5d [0,4194304] 0 2023-12-07T16:21:37.275 INFO:tasks.workunit.client.1.smithi152.stdout:1/561: dread dc/d14/d18/d2d/d4a/f71 [0,4194304] 0 2023-12-07T16:21:37.275 INFO:tasks.workunit.client.0.smithi063.stdout:9/282: rename d0/d7/c10 to d0/d13/d39/c5b 0 2023-12-07T16:21:37.276 INFO:tasks.workunit.client.1.smithi152.stdout:1/562: link dc/d14/d18/d45/f47 dc/d14/fb4 0 2023-12-07T16:21:37.277 INFO:tasks.workunit.client.0.smithi063.stdout:8/415: rmdir d7/d14/d15 39 2023-12-07T16:21:37.277 INFO:tasks.workunit.client.0.smithi063.stdout:8/416: read d7/d14/d1a/f50 [233426,14208] 0 2023-12-07T16:21:37.278 INFO:tasks.workunit.client.1.smithi152.stdout:1/563: rmdir dc/d14/d18/d79/d86 39 2023-12-07T16:21:37.280 INFO:tasks.workunit.client.0.smithi063.stdout:1/196: truncate d0/dd/d10/d1e/f2e 4430423 0 2023-12-07T16:21:37.280 INFO:tasks.workunit.client.0.smithi063.stdout:0/342: mkdir d4/dd/d26/d2b/d5e/d69 0 2023-12-07T16:21:37.280 INFO:tasks.workunit.client.0.smithi063.stdout:0/343: read - d4/dd/de/d15/f5f zero size 2023-12-07T16:21:37.281 INFO:tasks.workunit.client.1.smithi152.stdout:6/466: dwrite d2/f4 [4194304,4194304] 0 2023-12-07T16:21:37.283 INFO:tasks.workunit.client.0.smithi063.stdout:9/283: rename d0/d21/c4f to d0/d13/d39/d42/c5c 0 2023-12-07T16:21:37.286 INFO:tasks.workunit.client.1.smithi152.stdout:6/467: mknod d2/d4f/d83/d48/d70/c8e 0 2023-12-07T16:21:37.286 INFO:tasks.workunit.client.0.smithi063.stdout:9/284: rename d0/d21/f5a to d0/d13/f5d 0 2023-12-07T16:21:37.287 INFO:tasks.workunit.client.0.smithi063.stdout:5/258: dwrite d1/f2e [0,4194304] 0 2023-12-07T16:21:37.288 INFO:tasks.workunit.client.0.smithi063.stdout:1/197: mknod d0/c44 0 2023-12-07T16:21:37.289 INFO:tasks.workunit.client.0.smithi063.stdout:8/417: rename d7/d14/d15/f47 to d7/d38/d73/f7c 0 2023-12-07T16:21:37.291 INFO:tasks.workunit.client.0.smithi063.stdout:9/285: mknod d0/d13/d39/d42/d57/c5e 0 2023-12-07T16:21:37.292 INFO:tasks.workunit.client.1.smithi152.stdout:6/468: write d2/d4f/d83/d85/de/d2e/f41 [213827,50489] 0 2023-12-07T16:21:37.293 INFO:tasks.workunit.client.1.smithi152.stdout:6/469: mknod d2/d4f/d83/d85/d9/c8f 0 2023-12-07T16:21:37.294 INFO:tasks.workunit.client.1.smithi152.stdout:8/488: sync 2023-12-07T16:21:37.294 INFO:tasks.workunit.client.0.smithi063.stdout:5/259: creat d1/d3/de/f4a x:0 0 0 2023-12-07T16:21:37.294 INFO:tasks.workunit.client.1.smithi152.stdout:6/470: write d2/d4f/d83/d48/f53 [3023276,94366] 0 2023-12-07T16:21:37.295 INFO:tasks.workunit.client.1.smithi152.stdout:8/489: mkdir d3/d1e/d55/d83/dae/db1 0 2023-12-07T16:21:37.295 INFO:tasks.workunit.client.1.smithi152.stdout:8/490: chown d3/d4/d9/dad 1 1 2023-12-07T16:21:37.295 INFO:tasks.workunit.client.1.smithi152.stdout:8/491: write d3/d4/d9/f38 [2283703,52346] 0 2023-12-07T16:21:37.295 INFO:tasks.workunit.client.1.smithi152.stdout:8/492: getdents d3/d4/d9/dc/d6f/d7a/d8a 0 2023-12-07T16:21:37.296 INFO:tasks.workunit.client.0.smithi063.stdout:1/198: rename d0/dd/d10/d13/c2a to d0/dd/d19/c45 0 2023-12-07T16:21:37.297 INFO:tasks.workunit.client.0.smithi063.stdout:9/286: unlink d0/f30 0 2023-12-07T16:21:37.298 INFO:tasks.workunit.client.1.smithi152.stdout:8/493: mkdir d3/d4/d9/d23/d4c/da6/db2 0 2023-12-07T16:21:37.299 INFO:tasks.workunit.client.1.smithi152.stdout:8/494: chown d3/d1e/d43/l70 68 1 2023-12-07T16:21:37.299 INFO:tasks.workunit.client.1.smithi152.stdout:6/471: mknod d2/d4f/d83/d85/d19/c90 0 2023-12-07T16:21:37.301 INFO:tasks.workunit.client.1.smithi152.stdout:8/495: mkdir d3/d4/d9/dad/db3 0 2023-12-07T16:21:37.302 INFO:tasks.workunit.client.1.smithi152.stdout:8/496: truncate d3/d4/d9/dc/d6f/f99 69408 0 2023-12-07T16:21:37.302 INFO:tasks.workunit.client.0.smithi063.stdout:9/287: symlink d0/d13/d39/d3a/l5f 0 2023-12-07T16:21:37.305 INFO:tasks.workunit.client.0.smithi063.stdout:2/272: sync 2023-12-07T16:21:37.305 INFO:tasks.workunit.client.0.smithi063.stdout:2/273: write d0/d1e/d5c/f59 [630105,36048] 0 2023-12-07T16:21:37.305 INFO:tasks.workunit.client.0.smithi063.stdout:2/274: truncate d0/d21/d56/d11/f1b 1778210 0 2023-12-07T16:21:37.305 INFO:tasks.workunit.client.0.smithi063.stdout:4/229: sync 2023-12-07T16:21:37.305 INFO:tasks.workunit.client.0.smithi063.stdout:1/199: read d0/dd/d10/d1e/f31 [3877084,110337] 0 2023-12-07T16:21:37.305 INFO:tasks.workunit.client.0.smithi063.stdout:1/200: chown d0/dd/l26 173694 1 2023-12-07T16:21:37.305 INFO:tasks.workunit.client.0.smithi063.stdout:1/201: dread - d0/dd/d10/d13/f3d zero size 2023-12-07T16:21:37.305 INFO:tasks.workunit.client.0.smithi063.stdout:6/306: dwrite d0/d17/d46/f59 [0,4194304] 0 2023-12-07T16:21:37.308 INFO:tasks.workunit.client.0.smithi063.stdout:5/260: dread d1/f2e [0,4194304] 0 2023-12-07T16:21:37.309 INFO:tasks.workunit.client.0.smithi063.stdout:5/261: write d1/d3/de/f16 [3682437,53484] 0 2023-12-07T16:21:37.309 INFO:tasks.workunit.client.1.smithi152.stdout:8/497: creat d3/d1e/d55/d83/dae/fb4 x:0 0 0 2023-12-07T16:21:37.309 INFO:tasks.workunit.client.1.smithi152.stdout:8/498: read d3/d1e/f30 [5867249,109032] 0 2023-12-07T16:21:37.310 INFO:tasks.workunit.client.0.smithi063.stdout:9/288: mknod d0/d13/d39/c60 0 2023-12-07T16:21:37.310 INFO:tasks.workunit.client.1.smithi152.stdout:1/564: dwrite dc/d14/d18/d64/f72 [0,4194304] 0 2023-12-07T16:21:37.312 INFO:tasks.workunit.client.1.smithi152.stdout:8/499: symlink d3/d4/d9/dc/d6f/d7a/d8a/d66/d82/lb5 0 2023-12-07T16:21:37.312 INFO:tasks.workunit.client.1.smithi152.stdout:8/500: write d3/d4/d9/dc/d6f/d7a/fa8 [546226,35953] 0 2023-12-07T16:21:37.312 INFO:tasks.workunit.client.0.smithi063.stdout:2/275: dread d0/d21/d39/f4e [0,4194304] 0 2023-12-07T16:21:37.314 INFO:tasks.workunit.client.0.smithi063.stdout:4/230: dread d1/d3/db/f20 [0,4194304] 0 2023-12-07T16:21:37.315 INFO:tasks.workunit.client.1.smithi152.stdout:1/565: creat dc/d14/d18/fb5 x:0 0 0 2023-12-07T16:21:37.315 INFO:tasks.workunit.client.1.smithi152.stdout:1/566: stat dc/d14/d18/d64/f8f 0 2023-12-07T16:21:37.315 INFO:tasks.workunit.client.0.smithi063.stdout:1/202: mkdir d0/dd/d10/d46 0 2023-12-07T16:21:37.316 INFO:tasks.workunit.client.1.smithi152.stdout:8/501: link d3/d4/d9/f21 d3/da7/fb6 0 2023-12-07T16:21:37.317 INFO:tasks.workunit.client.1.smithi152.stdout:1/567: creat dc/d14/d68/fb6 x:0 0 0 2023-12-07T16:21:37.317 INFO:tasks.workunit.client.1.smithi152.stdout:1/568: chown dc/d14/d18 949 1 2023-12-07T16:21:37.318 INFO:tasks.workunit.client.0.smithi063.stdout:5/262: mknod d1/d3/de/c4b 0 2023-12-07T16:21:37.318 INFO:tasks.workunit.client.0.smithi063.stdout:5/263: stat d1/d31/l48 0 2023-12-07T16:21:37.318 INFO:tasks.workunit.client.0.smithi063.stdout:9/289: mknod d0/d13/d39/d42/c61 0 2023-12-07T16:21:37.320 INFO:tasks.workunit.client.0.smithi063.stdout:5/264: creat d1/d3/d3a/f4c x:0 0 0 2023-12-07T16:21:37.324 INFO:tasks.workunit.client.0.smithi063.stdout:9/290: rename d0/d7/c54 to d0/d13/d39/d42/c62 0 2023-12-07T16:21:37.324 INFO:tasks.workunit.client.0.smithi063.stdout:9/291: write d0/d7/f55 [1000119,120548] 0 2023-12-07T16:21:37.324 INFO:tasks.workunit.client.0.smithi063.stdout:9/292: readlink d0/l1b 0 2023-12-07T16:21:37.326 INFO:tasks.workunit.client.0.smithi063.stdout:5/265: mknod d1/d3/d3a/c4d 0 2023-12-07T16:21:37.328 INFO:tasks.workunit.client.0.smithi063.stdout:9/293: mknod d0/d13/d39/d3a/d3e/c63 0 2023-12-07T16:21:37.332 INFO:tasks.workunit.client.0.smithi063.stdout:5/266: mknod d1/c4e 0 2023-12-07T16:21:37.333 INFO:tasks.workunit.client.1.smithi152.stdout:8/502: dread d3/d4/d9/f18 [8388608,4194304] 0 2023-12-07T16:21:37.335 INFO:tasks.workunit.client.1.smithi152.stdout:8/503: symlink d3/d4/d9/d23/lb7 0 2023-12-07T16:21:37.335 INFO:tasks.workunit.client.0.smithi063.stdout:1/203: truncate d0/dd/d10/d1e/f31 1618221 0 2023-12-07T16:21:37.335 INFO:tasks.workunit.client.0.smithi063.stdout:1/204: chown d0/dd/d10/f27 1225 1 2023-12-07T16:21:37.339 INFO:tasks.workunit.client.0.smithi063.stdout:3/242: sync 2023-12-07T16:21:37.339 INFO:tasks.workunit.client.0.smithi063.stdout:7/275: rmdir d2/d34/d5a 39 2023-12-07T16:21:37.343 INFO:tasks.workunit.client.0.smithi063.stdout:3/243: unlink d7/c10 0 2023-12-07T16:21:37.343 INFO:tasks.workunit.client.0.smithi063.stdout:1/205: write d0/f1 [3488082,70268] 0 2023-12-07T16:21:37.343 INFO:tasks.workunit.client.0.smithi063.stdout:3/244: dread - d7/d9/d1b/f2c zero size 2023-12-07T16:21:37.343 INFO:tasks.workunit.client.0.smithi063.stdout:3/245: fdatasync d7/d9/d2b/f43 0 2023-12-07T16:21:37.343 INFO:tasks.workunit.client.0.smithi063.stdout:3/246: truncate d7/d9/d1b/f38 4852992 0 2023-12-07T16:21:37.344 INFO:tasks.workunit.client.0.smithi063.stdout:7/276: unlink d2/d34/d46/d48/f52 0 2023-12-07T16:21:37.347 INFO:tasks.workunit.client.0.smithi063.stdout:7/277: rmdir d2/d34/d5a/d5f/d2a 39 2023-12-07T16:21:37.349 INFO:tasks.workunit.client.0.smithi063.stdout:1/206: rename d0/dd/d10/d1e/d38 to d0/d47 0 2023-12-07T16:21:37.352 INFO:tasks.workunit.client.0.smithi063.stdout:7/278: symlink d2/d2c/l6e 0 2023-12-07T16:21:37.355 INFO:tasks.workunit.client.0.smithi063.stdout:1/207: getdents d0/dd/d10/d13/d2f 0 2023-12-07T16:21:37.358 INFO:tasks.workunit.client.0.smithi063.stdout:1/208: mknod d0/d47/c48 0 2023-12-07T16:21:37.358 INFO:tasks.workunit.client.0.smithi063.stdout:1/209: write d0/dd/d10/d1e/f2c [1110963,90513] 0 2023-12-07T16:21:37.358 INFO:tasks.workunit.client.0.smithi063.stdout:1/210: write d0/dd/d10/f27 [120146,7171] 0 2023-12-07T16:21:37.359 INFO:tasks.workunit.client.0.smithi063.stdout:1/211: symlink d0/dd/d10/d46/l49 0 2023-12-07T16:21:37.361 INFO:tasks.workunit.client.0.smithi063.stdout:1/212: mknod d0/dd/d1f/c4a 0 2023-12-07T16:21:37.362 INFO:tasks.workunit.client.0.smithi063.stdout:0/344: dwrite d4/dd/d26/d2b/d5e/f65 [0,4194304] 0 2023-12-07T16:21:37.362 INFO:tasks.workunit.client.0.smithi063.stdout:0/345: chown d4/dd/l3f 31 1 2023-12-07T16:21:37.362 INFO:tasks.workunit.client.0.smithi063.stdout:1/213: creat d0/f4b x:0 0 0 2023-12-07T16:21:37.367 INFO:tasks.workunit.client.0.smithi063.stdout:6/307: dwrite d0/d17/d1a/f4c [0,4194304] 0 2023-12-07T16:21:37.368 INFO:tasks.workunit.client.0.smithi063.stdout:0/346: creat d4/dd/f6a x:0 0 0 2023-12-07T16:21:37.368 INFO:tasks.workunit.client.0.smithi063.stdout:0/347: chown d4/dd/de/d15/d1f/d4c 11 1 2023-12-07T16:21:37.368 INFO:tasks.workunit.client.0.smithi063.stdout:1/214: fdatasync d0/dd/d10/d1e/f2e 0 2023-12-07T16:21:37.369 INFO:tasks.workunit.client.1.smithi152.stdout:6/472: dwrite d2/d4f/d83/d48/f54 [0,4194304] 0 2023-12-07T16:21:37.370 INFO:tasks.workunit.client.0.smithi063.stdout:8/418: dwrite d7/d14/f35 [0,4194304] 0 2023-12-07T16:21:37.370 INFO:tasks.workunit.client.0.smithi063.stdout:8/419: write d7/d14/f4f [4413670,12544] 0 2023-12-07T16:21:37.371 INFO:tasks.workunit.client.1.smithi152.stdout:6/473: write d2/d4f/d83/d85/de/d2e/f4e [297879,10074] 0 2023-12-07T16:21:37.371 INFO:tasks.workunit.client.1.smithi152.stdout:6/474: fsync d2/d4f/d83/d48/f84 0 2023-12-07T16:21:37.371 INFO:tasks.workunit.client.1.smithi152.stdout:6/475: read - d2/d4f/d83/d85/f89 zero size 2023-12-07T16:21:37.372 INFO:tasks.workunit.client.0.smithi063.stdout:8/420: read d7/d38/f3b [3013973,54110] 0 2023-12-07T16:21:37.372 INFO:tasks.workunit.client.0.smithi063.stdout:6/308: symlink d0/d17/d46/l6b 0 2023-12-07T16:21:37.373 INFO:tasks.workunit.client.0.smithi063.stdout:0/348: mkdir d4/dd/de/d15/d52/d5b/d63/d6b 0 2023-12-07T16:21:37.373 INFO:tasks.workunit.client.1.smithi152.stdout:6/476: link d2/d4f/d83/d85/de/d2e/l3d d2/d4f/d83/d85/de/d2e/l91 0 2023-12-07T16:21:37.373 INFO:tasks.workunit.client.1.smithi152.stdout:6/477: fsync d2/d4f/d83/d85/f63 0 2023-12-07T16:21:37.374 INFO:tasks.workunit.client.0.smithi063.stdout:1/215: read d0/f4 [7214988,69803] 0 2023-12-07T16:21:37.375 INFO:tasks.workunit.client.0.smithi063.stdout:5/267: dwrite d1/f7 [0,4194304] 0 2023-12-07T16:21:37.379 INFO:tasks.workunit.client.0.smithi063.stdout:8/421: creat d7/d14/f7d x:0 0 0 2023-12-07T16:21:37.381 INFO:tasks.workunit.client.0.smithi063.stdout:8/422: read d7/d14/d15/d2b/f79 [514228,60836] 0 2023-12-07T16:21:37.383 INFO:tasks.workunit.client.0.smithi063.stdout:0/349: creat d4/dd/f6c x:0 0 0 2023-12-07T16:21:37.383 INFO:tasks.workunit.client.0.smithi063.stdout:6/309: mkdir d0/d1e/d1d/d1f/d6c 0 2023-12-07T16:21:37.384 INFO:tasks.workunit.client.0.smithi063.stdout:8/423: mkdir d7/d14/d1a/d54/d7e 0 2023-12-07T16:21:37.384 INFO:tasks.workunit.client.0.smithi063.stdout:8/424: truncate d7/d14/d1a/f5c 964655 0 2023-12-07T16:21:37.384 INFO:tasks.workunit.client.0.smithi063.stdout:8/425: chown d7/le 1969853 1 2023-12-07T16:21:37.384 INFO:tasks.workunit.client.0.smithi063.stdout:2/276: dwrite d0/f16 [4194304,4194304] 0 2023-12-07T16:21:37.385 INFO:tasks.workunit.client.1.smithi152.stdout:8/504: dwrite d3/d4/d9/d23/f36 [0,4194304] 0 2023-12-07T16:21:37.385 INFO:tasks.workunit.client.1.smithi152.stdout:8/505: write d3/d1e/d55/d83/dae/fb0 [323072,87920] 0 2023-12-07T16:21:37.385 INFO:tasks.workunit.client.1.smithi152.stdout:1/569: dwrite dc/f40 [0,4194304] 0 2023-12-07T16:21:37.385 INFO:tasks.workunit.client.1.smithi152.stdout:1/570: chown dc/d14/d90 242192578 1 2023-12-07T16:21:37.386 INFO:tasks.workunit.client.0.smithi063.stdout:5/268: link d1/l42 d1/d3/de/d1e/l4f 0 2023-12-07T16:21:37.386 INFO:tasks.workunit.client.0.smithi063.stdout:3/247: dwrite d7/fc [4194304,4194304] 0 2023-12-07T16:21:37.387 INFO:tasks.workunit.client.0.smithi063.stdout:1/216: link d0/l1a d0/dd/d10/d46/l4c 0 2023-12-07T16:21:37.387 INFO:tasks.workunit.client.0.smithi063.stdout:1/217: readlink d0/dd/d10/d46/l49 0 2023-12-07T16:21:37.387 INFO:tasks.workunit.client.0.smithi063.stdout:7/279: dwrite d2/d34/d5a/d5f/f16 [4194304,4194304] 0 2023-12-07T16:21:37.387 INFO:tasks.workunit.client.0.smithi063.stdout:7/280: dread - d2/d34/d5a/d5f/d2a/f4a zero size 2023-12-07T16:21:37.387 INFO:tasks.workunit.client.0.smithi063.stdout:0/350: stat d4/l8 0 2023-12-07T16:21:37.388 INFO:tasks.workunit.client.0.smithi063.stdout:6/310: mknod d0/d17/d46/c6d 0 2023-12-07T16:21:37.390 INFO:tasks.workunit.client.1.smithi152.stdout:1/571: mkdir dc/d14/d18/d79/d86/db7 0 2023-12-07T16:21:37.390 INFO:tasks.workunit.client.1.smithi152.stdout:8/506: dread d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/fa0 [0,4194304] 0 2023-12-07T16:21:37.391 INFO:tasks.workunit.client.0.smithi063.stdout:2/277: rmdir d0/d1e/d5c 39 2023-12-07T16:21:37.392 INFO:tasks.workunit.client.1.smithi152.stdout:1/572: rmdir dc/d14/d18/d2d 39 2023-12-07T16:21:37.393 INFO:tasks.workunit.client.1.smithi152.stdout:1/573: link dc/d14/d18/d2d/d48/da3/f2e dc/d14/d18/d2d/d48/da3/fb8 0 2023-12-07T16:21:37.394 INFO:tasks.workunit.client.0.smithi063.stdout:2/278: write d0/d1e/f43 [2958735,90283] 0 2023-12-07T16:21:37.396 INFO:tasks.workunit.client.1.smithi152.stdout:1/574: symlink dc/d28/d7d/lb9 0 2023-12-07T16:21:37.398 INFO:tasks.workunit.client.1.smithi152.stdout:6/478: dwrite d2/d4f/d83/d85/de/d3f/f59 [0,4194304] 0 2023-12-07T16:21:37.399 INFO:tasks.workunit.client.1.smithi152.stdout:1/575: dread dc/d14/d18/d79/d86/fa0 [0,4194304] 0 2023-12-07T16:21:37.401 INFO:tasks.workunit.client.1.smithi152.stdout:1/576: symlink dc/d14/d18/d79/d86/db7/lba 0 2023-12-07T16:21:37.402 INFO:tasks.workunit.client.1.smithi152.stdout:1/577: mkdir dc/d14/d90/dbb 0 2023-12-07T16:21:37.404 INFO:tasks.workunit.client.1.smithi152.stdout:1/578: truncate dc/d14/d18/d2d/d48/da3/f22 3012478 0 2023-12-07T16:21:37.406 INFO:tasks.workunit.client.1.smithi152.stdout:1/579: symlink dc/d14/d18/d2d/d48/da3/lbc 0 2023-12-07T16:21:37.408 INFO:tasks.workunit.client.1.smithi152.stdout:1/580: truncate dc/d14/d18/f30 3133466 0 2023-12-07T16:21:37.408 INFO:tasks.workunit.client.1.smithi152.stdout:1/581: write dc/d28/f39 [8390961,11997] 0 2023-12-07T16:21:37.410 INFO:tasks.workunit.client.1.smithi152.stdout:1/582: mknod dc/d14/d18/d64/d8a/cbd 0 2023-12-07T16:21:37.411 INFO:tasks.workunit.client.1.smithi152.stdout:1/583: truncate dc/d14/d18/d2d/d48/da3/d58/faa 478542 0 2023-12-07T16:21:37.415 INFO:tasks.workunit.client.0.smithi063.stdout:5/269: getdents d1/d3/d3a 0 2023-12-07T16:21:37.416 INFO:tasks.workunit.client.0.smithi063.stdout:8/426: dwrite d7/d14/d1a/d54/f5b [0,4194304] 0 2023-12-07T16:21:37.416 INFO:tasks.workunit.client.0.smithi063.stdout:8/427: readlink d7/d14/d15/d48/l45 0 2023-12-07T16:21:37.416 INFO:tasks.workunit.client.0.smithi063.stdout:8/428: truncate d7/d14/d15/d2b/d40/d63/f6b 485120 0 2023-12-07T16:21:37.416 INFO:tasks.workunit.client.0.smithi063.stdout:8/429: write d7/d14/d15/d2b/d40/d63/f6b [690266,42468] 0 2023-12-07T16:21:37.417 INFO:tasks.workunit.client.0.smithi063.stdout:1/218: creat d0/dd/d19/f4d x:0 0 0 2023-12-07T16:21:37.417 INFO:tasks.workunit.client.0.smithi063.stdout:3/248: mkdir d7/d49/d4b 0 2023-12-07T16:21:37.417 INFO:tasks.workunit.client.0.smithi063.stdout:3/249: read - d7/d9/f3f zero size 2023-12-07T16:21:37.417 INFO:tasks.workunit.client.0.smithi063.stdout:3/250: write d7/d9/f26 [957775,65348] 0 2023-12-07T16:21:37.421 INFO:tasks.workunit.client.0.smithi063.stdout:7/281: link d2/d34/d5a/d5f/d2a/c5c d2/d34/d5a/d5f/c6f 0 2023-12-07T16:21:37.421 INFO:tasks.workunit.client.0.smithi063.stdout:0/351: creat d4/dd/de/d15/d59/f6d x:0 0 0 2023-12-07T16:21:37.422 INFO:tasks.workunit.client.0.smithi063.stdout:6/311: mknod d0/d1e/c6e 0 2023-12-07T16:21:37.422 INFO:tasks.workunit.client.0.smithi063.stdout:6/312: write d0/d17/d46/f50 [812308,51362] 0 2023-12-07T16:21:37.422 INFO:tasks.workunit.client.0.smithi063.stdout:6/313: getdents d0/d17/d1a/d38/d64 0 2023-12-07T16:21:37.424 INFO:tasks.workunit.client.0.smithi063.stdout:2/279: creat d0/d4a/f5e x:0 0 0 2023-12-07T16:21:37.429 INFO:tasks.workunit.client.1.smithi152.stdout:6/479: dwrite d2/d4f/d83/d48/f84 [0,4194304] 0 2023-12-07T16:21:37.430 INFO:tasks.workunit.client.0.smithi063.stdout:8/430: rmdir d7/d38/d73 39 2023-12-07T16:21:37.431 INFO:tasks.workunit.client.1.smithi152.stdout:1/584: dwrite dc/d28/d4e/f99 [0,4194304] 0 2023-12-07T16:21:37.431 INFO:tasks.workunit.client.0.smithi063.stdout:1/219: rename d0/dd/d10/f17 to d0/dd/d1f/f4e 0 2023-12-07T16:21:37.434 INFO:tasks.workunit.client.1.smithi152.stdout:1/585: unlink dc/d14/d18/d45/l56 0 2023-12-07T16:21:37.434 INFO:tasks.workunit.client.0.smithi063.stdout:3/251: creat d7/f4c x:0 0 0 2023-12-07T16:21:37.434 INFO:tasks.workunit.client.0.smithi063.stdout:3/252: truncate d7/d9/dd/f42 589255 0 2023-12-07T16:21:37.434 INFO:tasks.workunit.client.0.smithi063.stdout:3/253: readlink l2 0 2023-12-07T16:21:37.435 INFO:tasks.workunit.client.1.smithi152.stdout:1/586: symlink dc/d28/d7d/da4/lbe 0 2023-12-07T16:21:37.436 INFO:tasks.workunit.client.0.smithi063.stdout:0/352: symlink d4/dd/de/d2d/l6e 0 2023-12-07T16:21:37.437 INFO:tasks.workunit.client.1.smithi152.stdout:1/587: mkdir dc/d14/d18/d2d/d48/da3/dbf 0 2023-12-07T16:21:37.437 INFO:tasks.workunit.client.1.smithi152.stdout:1/588: read dc/d28/f5e [1682409,6328] 0 2023-12-07T16:21:37.439 INFO:tasks.workunit.client.1.smithi152.stdout:1/589: creat dc/d14/d68/fc0 x:0 0 0 2023-12-07T16:21:37.439 INFO:tasks.workunit.client.1.smithi152.stdout:1/590: read - dc/d14/fb1 zero size 2023-12-07T16:21:37.440 INFO:tasks.workunit.client.0.smithi063.stdout:2/280: getdents d0 0 2023-12-07T16:21:37.441 INFO:tasks.workunit.client.0.smithi063.stdout:5/270: mknod d1/d3/de/d1e/c50 0 2023-12-07T16:21:37.441 INFO:tasks.workunit.client.0.smithi063.stdout:8/431: creat d7/f7f x:0 0 0 2023-12-07T16:21:37.442 INFO:tasks.workunit.client.1.smithi152.stdout:1/591: truncate dc/d14/d18/f94 439949 0 2023-12-07T16:21:37.442 INFO:tasks.workunit.client.1.smithi152.stdout:1/592: readlink dc/d14/d18/d64/d8a/la5 0 2023-12-07T16:21:37.442 INFO:tasks.workunit.client.1.smithi152.stdout:1/593: chown dc/d14/d18/d2d/d48/da3/d58/l5b 920287 1 2023-12-07T16:21:37.444 INFO:tasks.workunit.client.1.smithi152.stdout:6/480: dread d2/d4f/d83/d85/de/d3f/f40 [0,4194304] 0 2023-12-07T16:21:37.445 INFO:tasks.workunit.client.0.smithi063.stdout:7/282: mkdir d2/d34/d46/d48/d70 0 2023-12-07T16:21:37.445 INFO:tasks.workunit.client.1.smithi152.stdout:6/481: mkdir d2/d4f/d83/d92 0 2023-12-07T16:21:37.446 INFO:tasks.workunit.client.0.smithi063.stdout:0/353: symlink d4/dd/d26/d2b/d5e/d69/l6f 0 2023-12-07T16:21:37.447 INFO:tasks.workunit.client.0.smithi063.stdout:7/283: write d2/d34/d5a/d5f/d2a/f2f [1747347,35122] 0 2023-12-07T16:21:37.448 INFO:tasks.workunit.client.1.smithi152.stdout:6/482: creat d2/d4f/d83/d58/f93 x:0 0 0 2023-12-07T16:21:37.448 INFO:tasks.workunit.client.1.smithi152.stdout:6/483: truncate d2/d4f/d83/d85/d9/f7c 979360 0 2023-12-07T16:21:37.449 INFO:tasks.workunit.client.1.smithi152.stdout:6/484: rename d2/d4f/d83/d85/d19/d1f/d49 to d2/d4f/d83/d85/d94 0 2023-12-07T16:21:37.451 INFO:tasks.workunit.client.0.smithi063.stdout:8/432: creat d7/d14/d15/d2b/d40/d63/d75/f80 x:0 0 0 2023-12-07T16:21:37.452 INFO:tasks.workunit.client.0.smithi063.stdout:0/354: creat d4/dd/d26/f70 x:0 0 0 2023-12-07T16:21:37.454 INFO:tasks.workunit.client.0.smithi063.stdout:7/284: write d2/d2c/f3d [1125266,101082] 0 2023-12-07T16:21:37.455 INFO:tasks.workunit.client.0.smithi063.stdout:8/433: rmdir d7/d14/d15/d48 39 2023-12-07T16:21:37.455 INFO:tasks.workunit.client.0.smithi063.stdout:8/434: chown d7/d14/d15/d48/l45 1954 1 2023-12-07T16:21:37.456 INFO:tasks.workunit.client.0.smithi063.stdout:8/435: read d7/f4a [25797,69035] 0 2023-12-07T16:21:37.456 INFO:tasks.workunit.client.1.smithi152.stdout:6/485: creat d2/d4f/d83/d85/f95 x:0 0 0 2023-12-07T16:21:37.456 INFO:tasks.workunit.client.1.smithi152.stdout:9/517: sync 2023-12-07T16:21:37.458 INFO:tasks.workunit.client.0.smithi063.stdout:7/285: rename d2/d2c/l6e to d2/d34/l71 0 2023-12-07T16:21:37.459 INFO:tasks.workunit.client.0.smithi063.stdout:2/281: dread d0/d1e/f34 [0,4194304] 0 2023-12-07T16:21:37.459 INFO:tasks.workunit.client.0.smithi063.stdout:3/254: dwrite d7/d9/d2b/f43 [0,4194304] 0 2023-12-07T16:21:37.460 INFO:tasks.workunit.client.1.smithi152.stdout:4/405: sync 2023-12-07T16:21:37.460 INFO:tasks.workunit.client.1.smithi152.stdout:7/441: sync 2023-12-07T16:21:37.460 INFO:tasks.workunit.client.1.smithi152.stdout:3/481: sync 2023-12-07T16:21:37.460 INFO:tasks.workunit.client.1.smithi152.stdout:3/482: write d7/d10/f91 [602834,117735] 0 2023-12-07T16:21:37.460 INFO:tasks.workunit.client.1.smithi152.stdout:2/460: sync 2023-12-07T16:21:37.460 INFO:tasks.workunit.client.1.smithi152.stdout:5/585: sync 2023-12-07T16:21:37.460 INFO:tasks.workunit.client.1.smithi152.stdout:0/484: sync 2023-12-07T16:21:37.460 INFO:tasks.workunit.client.1.smithi152.stdout:9/518: symlink d1/d17/d3c/d4a/lb1 0 2023-12-07T16:21:37.461 INFO:tasks.workunit.client.0.smithi063.stdout:8/436: creat d7/d14/f81 x:0 0 0 2023-12-07T16:21:37.468 INFO:tasks.workunit.client.1.smithi152.stdout:9/519: rename d1/f5 to d1/d17/d3c/d4a/d48/d8c/fb2 0 2023-12-07T16:21:37.469 INFO:tasks.workunit.client.1.smithi152.stdout:5/586: mkdir dd/de/d8f/dc9 0 2023-12-07T16:21:37.469 INFO:tasks.workunit.client.1.smithi152.stdout:4/406: mkdir d0/d3/d6/d2b/d75 0 2023-12-07T16:21:37.470 INFO:tasks.workunit.client.0.smithi063.stdout:0/355: dread d4/dd/f14 [0,4194304] 0 2023-12-07T16:21:37.470 INFO:tasks.workunit.client.0.smithi063.stdout:0/356: stat d4/f17 0 2023-12-07T16:21:37.470 INFO:tasks.workunit.client.0.smithi063.stdout:7/286: creat d2/d34/d5a/d5f/d6d/f72 x:0 0 0 2023-12-07T16:21:37.470 INFO:tasks.workunit.client.1.smithi152.stdout:7/442: creat db/d27/d39/d41/d58/f7e x:0 0 0 2023-12-07T16:21:37.470 INFO:tasks.workunit.client.1.smithi152.stdout:2/461: link d2/d1c/d2e/d30/d33/f2d d2/d1c/d2e/d5d/fa4 0 2023-12-07T16:21:37.474 INFO:tasks.workunit.client.0.smithi063.stdout:0/357: creat d4/d25/f71 x:0 0 0 2023-12-07T16:21:37.476 INFO:tasks.workunit.client.1.smithi152.stdout:7/443: creat db/d27/f7f x:0 0 0 2023-12-07T16:21:37.476 INFO:tasks.workunit.client.1.smithi152.stdout:2/462: creat d2/d56/da0/fa5 x:0 0 0 2023-12-07T16:21:37.476 INFO:tasks.workunit.client.1.smithi152.stdout:2/463: write d2/d9/d51/f63 [1443624,110926] 0 2023-12-07T16:21:37.476 INFO:tasks.workunit.client.1.smithi152.stdout:5/587: creat dd/de/d38/d3d/fca x:0 0 0 2023-12-07T16:21:37.479 INFO:tasks.workunit.client.0.smithi063.stdout:7/287: rename d2/d34/d5a/d5f/f40 to d2/d34/d46/d48/d56/f73 0 2023-12-07T16:21:37.479 INFO:tasks.workunit.client.0.smithi063.stdout:1/220: dwrite d0/dd/d10/d13/f3d [0,4194304] 0 2023-12-07T16:21:37.480 INFO:tasks.workunit.client.1.smithi152.stdout:7/444: mkdir db/d27/d39/d41/d58/d80 0 2023-12-07T16:21:37.480 INFO:tasks.workunit.client.1.smithi152.stdout:3/483: dread d7/d10/d1a/f28 [0,4194304] 0 2023-12-07T16:21:37.480 INFO:tasks.workunit.client.1.smithi152.stdout:2/464: mkdir d2/d1c/d2e/d30/d53/d9a/da6 0 2023-12-07T16:21:37.482 INFO:tasks.workunit.client.1.smithi152.stdout:5/588: mknod dd/de/d14/d19/d1a/ccb 0 2023-12-07T16:21:37.483 INFO:tasks.workunit.client.0.smithi063.stdout:0/358: mknod d4/dd/de/d15/c72 0 2023-12-07T16:21:37.484 INFO:tasks.workunit.client.1.smithi152.stdout:7/445: creat db/d27/d5e/d45/f81 x:0 0 0 2023-12-07T16:21:37.486 INFO:tasks.workunit.client.1.smithi152.stdout:5/589: rename dd/de/dbc to dd/de/d14/d19/d1a/dcc 0 2023-12-07T16:21:37.488 INFO:tasks.workunit.client.1.smithi152.stdout:3/484: dread d7/d10/d1a/d2f/f1d [0,4194304] 0 2023-12-07T16:21:37.488 INFO:tasks.workunit.client.1.smithi152.stdout:3/485: getdents d7/d10/d1a/d25/d8e 0 2023-12-07T16:21:37.488 INFO:tasks.workunit.client.1.smithi152.stdout:3/486: chown d7/d10/d1a/f28 59969458 1 2023-12-07T16:21:37.489 INFO:tasks.workunit.client.1.smithi152.stdout:3/487: write d7/dc/d14/f3a [5123340,118300] 0 2023-12-07T16:21:37.489 INFO:tasks.workunit.client.1.smithi152.stdout:1/594: dwrite dc/d28/f38 [4194304,4194304] 0 2023-12-07T16:21:37.489 INFO:tasks.workunit.client.1.smithi152.stdout:5/590: symlink dd/de/d38/d3d/d6d/lcd 0 2023-12-07T16:21:37.494 INFO:tasks.workunit.client.1.smithi152.stdout:5/591: unlink dd/de/d14/d1f/d28/c9b 0 2023-12-07T16:21:37.562 INFO:tasks.workunit.client.0.smithi063.stdout:0/359: creat d4/dd/d26/d2b/d5e/f73 x:0 0 0 2023-12-07T16:21:37.566 INFO:tasks.workunit.client.0.smithi063.stdout:0/360: truncate d4/dd/de/d15/d59/f49 3969336 0 2023-12-07T16:21:37.566 INFO:tasks.workunit.client.1.smithi152.stdout:6/486: dwrite d2/f24 [0,4194304] 0 2023-12-07T16:21:37.568 INFO:tasks.workunit.client.0.smithi063.stdout:7/288: read d2/f26 [378615,73375] 0 2023-12-07T16:21:37.568 INFO:tasks.workunit.client.0.smithi063.stdout:7/289: read - d2/d34/f3b zero size 2023-12-07T16:21:37.568 INFO:tasks.workunit.client.1.smithi152.stdout:6/487: symlink d2/d4f/d83/d85/l96 0 2023-12-07T16:21:37.570 INFO:tasks.workunit.client.1.smithi152.stdout:6/488: symlink d2/d4f/d83/d85/de/d45/d55/l97 0 2023-12-07T16:21:37.571 INFO:tasks.workunit.client.0.smithi063.stdout:5/271: dwrite d1/d3/de/d1e/f1d [0,4194304] 0 2023-12-07T16:21:37.573 INFO:tasks.workunit.client.1.smithi152.stdout:6/489: rename d2/d4f/d83/d85/d9/l3e to d2/d4f/d83/d85/de/d3f/d8b/l98 0 2023-12-07T16:21:37.573 INFO:tasks.workunit.client.1.smithi152.stdout:6/490: dread - d2/d4f/d83/d85/f74 zero size 2023-12-07T16:21:37.574 INFO:tasks.workunit.client.0.smithi063.stdout:0/361: mkdir d4/dd/de/d15/d52/d5b/d63/d74 0 2023-12-07T16:21:37.574 INFO:tasks.workunit.client.0.smithi063.stdout:0/362: fsync d4/dd/de/f20 0 2023-12-07T16:21:37.575 INFO:tasks.workunit.client.1.smithi152.stdout:6/491: creat d2/d4f/d83/f99 x:0 0 0 2023-12-07T16:21:37.575 INFO:tasks.workunit.client.0.smithi063.stdout:7/290: readlink d2/l1c 0 2023-12-07T16:21:37.576 INFO:tasks.workunit.client.1.smithi152.stdout:6/492: truncate d2/d4f/d83/d85/fc 1127278 0 2023-12-07T16:21:37.578 INFO:tasks.workunit.client.0.smithi063.stdout:7/291: creat d2/d34/d46/f74 x:0 0 0 2023-12-07T16:21:37.578 INFO:tasks.workunit.client.0.smithi063.stdout:7/292: dread - d2/d34/d5a/d5f/f47 zero size 2023-12-07T16:21:37.579 INFO:tasks.workunit.client.1.smithi152.stdout:6/493: creat d2/d4f/f9a x:0 0 0 2023-12-07T16:21:37.581 INFO:tasks.workunit.client.1.smithi152.stdout:6/494: creat d2/d4f/d83/d85/de/d2e/d4c/d5d/f9b x:0 0 0 2023-12-07T16:21:37.583 INFO:tasks.workunit.client.1.smithi152.stdout:6/495: creat d2/d4f/d83/d85/de/d3f/d8b/f9c x:0 0 0 2023-12-07T16:21:37.585 INFO:tasks.workunit.client.1.smithi152.stdout:6/496: mkdir d2/d4f/d83/d85/de/d2e/d38/d9d 0 2023-12-07T16:21:37.586 INFO:tasks.workunit.client.0.smithi063.stdout:1/221: dread d0/dd/f16 [0,4194304] 0 2023-12-07T16:21:37.586 INFO:tasks.workunit.client.1.smithi152.stdout:6/497: rename d2/d4f/d83/d85/d19/d1f/f37 to d2/d4f/d83/d48/d70/f9e 0 2023-12-07T16:21:37.587 INFO:tasks.workunit.client.0.smithi063.stdout:1/222: mkdir d0/dd/d4f 0 2023-12-07T16:21:37.588 INFO:tasks.workunit.client.1.smithi152.stdout:6/498: creat d2/d4f/d83/d85/d94/f9f x:0 0 0 2023-12-07T16:21:37.589 INFO:tasks.workunit.client.1.smithi152.stdout:6/499: mkdir d2/d4f/d83/da0 0 2023-12-07T16:21:37.589 INFO:tasks.workunit.client.1.smithi152.stdout:6/500: write d2/d4f/d83/d48/f54 [4197739,68249] 0 2023-12-07T16:21:37.589 INFO:tasks.workunit.client.1.smithi152.stdout:6/501: chown d2/d4f/d83/d85/de/d2e/l91 14 1 2023-12-07T16:21:37.589 INFO:tasks.workunit.client.1.smithi152.stdout:6/502: write d2/d4f/d83/d85/de/d2e/d4c/d5d/f9b [100037,73163] 0 2023-12-07T16:21:37.589 INFO:tasks.workunit.client.1.smithi152.stdout:6/503: stat d2/d4f/d83/d85/de/d45/f82 0 2023-12-07T16:21:37.589 INFO:tasks.workunit.client.1.smithi152.stdout:6/504: chown d2/d4f/d83/d48/d70/d81 6610384 1 2023-12-07T16:21:37.616 INFO:tasks.workunit.client.0.smithi063.stdout:7/293: read d2/f12 [3018374,116740] 0 2023-12-07T16:21:37.617 INFO:tasks.workunit.client.0.smithi063.stdout:1/223: write d0/dd/d10/d1e/f2c [72713,18795] 0 2023-12-07T16:21:37.617 INFO:tasks.workunit.client.0.smithi063.stdout:7/294: getdents d2/d34/d5a 0 2023-12-07T16:21:37.620 INFO:tasks.workunit.client.0.smithi063.stdout:1/224: mkdir d0/dd/d19/d50 0 2023-12-07T16:21:37.620 INFO:tasks.workunit.client.0.smithi063.stdout:7/295: fdatasync d2/f1e 0 2023-12-07T16:21:37.621 INFO:tasks.workunit.client.1.smithi152.stdout:0/485: dwrite d0/dc/d3d/d4c/f8e [0,4194304] 0 2023-12-07T16:21:37.621 INFO:tasks.workunit.client.1.smithi152.stdout:0/486: readlink d0/dc/d3d/d4c/l5e 0 2023-12-07T16:21:37.621 INFO:tasks.workunit.client.1.smithi152.stdout:0/487: stat d0/dc/c1c 0 2023-12-07T16:21:37.621 INFO:tasks.workunit.client.0.smithi063.stdout:1/225: creat d0/dd/d10/d1b/f51 x:0 0 0 2023-12-07T16:21:37.623 INFO:tasks.workunit.client.0.smithi063.stdout:7/296: rename d2/d34/d5a/d5f/d2a/f39 to d2/d2c/f75 0 2023-12-07T16:21:37.630 INFO:tasks.workunit.client.0.smithi063.stdout:7/297: write d2/d21/f2d [2379735,116521] 0 2023-12-07T16:21:37.630 INFO:tasks.workunit.client.0.smithi063.stdout:7/298: fdatasync d2/d34/d46/f74 0 2023-12-07T16:21:37.653 INFO:tasks.workunit.client.1.smithi152.stdout:4/407: dwrite d0/d3/d6/dc/dd/f6c [0,4194304] 0 2023-12-07T16:21:37.653 INFO:tasks.workunit.client.1.smithi152.stdout:4/408: chown d0/d3/d6/dc/d3a/d48/f5d 538 1 2023-12-07T16:21:37.653 INFO:tasks.workunit.client.0.smithi063.stdout:2/282: dwrite d0/d1e/f43 [0,4194304] 0 2023-12-07T16:21:37.653 INFO:tasks.workunit.client.1.smithi152.stdout:3/488: dwrite d7/dc/d3e/f95 [0,4194304] 0 2023-12-07T16:21:37.658 INFO:tasks.workunit.client.1.smithi152.stdout:7/446: dwrite db/d27/f3d [0,4194304] 0 2023-12-07T16:21:37.658 INFO:tasks.workunit.client.1.smithi152.stdout:7/447: fsync db/d27/d39/d41/d37/f3f 0 2023-12-07T16:21:37.658 INFO:tasks.workunit.client.0.smithi063.stdout:8/437: dwrite d7/d14/d1a/d54/f5b [0,4194304] 0 2023-12-07T16:21:37.662 INFO:tasks.workunit.client.1.smithi152.stdout:5/592: dwrite dd/de/d14/d1f/d28/f2f [0,4194304] 0 2023-12-07T16:21:37.664 INFO:tasks.workunit.client.0.smithi063.stdout:7/299: dwrite d2/fa [0,4194304] 0 2023-12-07T16:21:37.664 INFO:tasks.workunit.client.0.smithi063.stdout:8/438: mknod d7/d14/d1a/d54/c82 0 2023-12-07T16:21:37.664 INFO:tasks.workunit.client.0.smithi063.stdout:5/272: dwrite d1/f18 [0,4194304] 0 2023-12-07T16:21:37.664 INFO:tasks.workunit.client.0.smithi063.stdout:3/255: dwrite d7/d9/dd/f42 [0,4194304] 0 2023-12-07T16:21:37.664 INFO:tasks.workunit.client.0.smithi063.stdout:3/256: dread - d7/d9/f46 zero size 2023-12-07T16:21:37.666 INFO:tasks.workunit.client.1.smithi152.stdout:2/465: dwrite d2/d1c/d2e/fa2 [0,4194304] 0 2023-12-07T16:21:37.666 INFO:tasks.workunit.client.1.smithi152.stdout:2/466: write d2/d1c/d2e/f46 [4856721,102403] 0 2023-12-07T16:21:37.666 INFO:tasks.workunit.client.1.smithi152.stdout:1/595: dwrite dc/d14/d18/f3f [0,4194304] 0 2023-12-07T16:21:37.668 INFO:tasks.workunit.client.1.smithi152.stdout:6/505: dwrite d2/d4f/d83/d85/f74 [0,4194304] 0 2023-12-07T16:21:37.671 INFO:tasks.workunit.client.1.smithi152.stdout:4/409: write d0/d3/f2a [1838911,116343] 0 2023-12-07T16:21:37.675 INFO:tasks.workunit.client.0.smithi063.stdout:5/273: dread d1/f2e [0,4194304] 0 2023-12-07T16:21:37.675 INFO:tasks.workunit.client.0.smithi063.stdout:0/363: dwrite d4/d25/f2f [0,4194304] 0 2023-12-07T16:21:37.676 INFO:tasks.workunit.client.0.smithi063.stdout:8/439: mkdir d7/d38/d73/d83 0 2023-12-07T16:21:37.677 INFO:tasks.workunit.client.0.smithi063.stdout:5/274: mknod d1/d38/c51 0 2023-12-07T16:21:37.678 INFO:tasks.workunit.client.1.smithi152.stdout:1/596: unlink dc/d28/c87 0 2023-12-07T16:21:37.678 INFO:tasks.workunit.client.0.smithi063.stdout:0/364: rmdir d4/dd/de 39 2023-12-07T16:21:37.679 INFO:tasks.workunit.client.0.smithi063.stdout:5/275: chown d1/d3/de/d1e/c3d 18320764 1 2023-12-07T16:21:37.679 INFO:tasks.workunit.client.0.smithi063.stdout:5/276: chown d1/d3/de/d1e/l4f 1778418 1 2023-12-07T16:21:37.681 INFO:tasks.workunit.client.0.smithi063.stdout:8/440: write d7/d14/f27 [3072961,107047] 0 2023-12-07T16:21:37.684 INFO:tasks.workunit.client.0.smithi063.stdout:8/441: dread d7/f4a [0,4194304] 0 2023-12-07T16:21:37.685 INFO:tasks.workunit.client.0.smithi063.stdout:0/365: write d4/dd/de/d15/d1f/f4a [452862,4077] 0 2023-12-07T16:21:37.685 INFO:tasks.workunit.client.1.smithi152.stdout:4/410: link d0/d3/d6/c9 d0/d3/d6/dc/dd/d67/c76 0 2023-12-07T16:21:37.687 INFO:tasks.workunit.client.1.smithi152.stdout:1/597: mknod dc/d14/d90/dbb/cc1 0 2023-12-07T16:21:37.688 INFO:tasks.workunit.client.0.smithi063.stdout:0/366: symlink d4/dd/de/d15/d59/d43/l75 0 2023-12-07T16:21:37.688 INFO:tasks.workunit.client.1.smithi152.stdout:4/411: mknod d0/d3/d6/d5c/c77 0 2023-12-07T16:21:37.689 INFO:tasks.workunit.client.0.smithi063.stdout:0/367: link d4/dd/de/d15/c72 d4/dd/de/d15/c76 0 2023-12-07T16:21:37.689 INFO:tasks.workunit.client.0.smithi063.stdout:0/368: readlink d4/d25/l40 0 2023-12-07T16:21:37.689 INFO:tasks.workunit.client.1.smithi152.stdout:1/598: unlink dc/d28/d7d/da4/lbe 0 2023-12-07T16:21:37.691 INFO:tasks.workunit.client.0.smithi063.stdout:0/369: mknod d4/dd/c77 0 2023-12-07T16:21:37.691 INFO:tasks.workunit.client.1.smithi152.stdout:1/599: rename f4 to dc/d14/d18/d2d/d48/fc2 0 2023-12-07T16:21:37.692 INFO:tasks.workunit.client.0.smithi063.stdout:0/370: symlink d4/dd/de/l78 0 2023-12-07T16:21:37.692 INFO:tasks.workunit.client.0.smithi063.stdout:0/371: write d4/dd/d26/f4f [4989775,102835] 0 2023-12-07T16:21:37.694 INFO:tasks.workunit.client.1.smithi152.stdout:4/412: write d0/d3/d6/d36/f44 [7861476,23320] 0 2023-12-07T16:21:37.694 INFO:tasks.workunit.client.0.smithi063.stdout:0/372: unlink d4/dd/f6c 0 2023-12-07T16:21:37.694 INFO:tasks.workunit.client.1.smithi152.stdout:4/413: read d0/d3/d6/dc/dd/d67/f47 [661472,8935] 0 2023-12-07T16:21:37.695 INFO:tasks.workunit.client.1.smithi152.stdout:4/414: write d0/d17/f53 [4399714,80738] 0 2023-12-07T16:21:37.695 INFO:tasks.workunit.client.1.smithi152.stdout:4/415: dread - d0/d3/d6/dc/d39/f5e zero size 2023-12-07T16:21:37.695 INFO:tasks.workunit.client.0.smithi063.stdout:0/373: creat d4/dd/de/d15/d52/d5b/d63/d74/f79 x:0 0 0 2023-12-07T16:21:37.695 INFO:tasks.workunit.client.0.smithi063.stdout:0/374: readlink d4/dd/de/d15/d1f/l57 0 2023-12-07T16:21:37.695 INFO:tasks.workunit.client.0.smithi063.stdout:0/375: dread - d4/dd/de/d15/d1f/f3a zero size 2023-12-07T16:21:37.695 INFO:tasks.workunit.client.0.smithi063.stdout:0/376: chown d4/dd/d26/c46 4730 1 2023-12-07T16:21:37.696 INFO:tasks.workunit.client.1.smithi152.stdout:3/489: dwrite d7/f32 [0,4194304] 0 2023-12-07T16:21:37.697 INFO:tasks.workunit.client.0.smithi063.stdout:0/377: rename d4/dd/de/d15/d52/d5b/d63/d74/f79 to d4/dd/de/d2d/f7a 0 2023-12-07T16:21:37.699 INFO:tasks.workunit.client.0.smithi063.stdout:0/378: creat d4/dd/de/d15/d1f/d22/f7b x:0 0 0 2023-12-07T16:21:37.699 INFO:tasks.workunit.client.0.smithi063.stdout:0/379: fdatasync d4/dd/f6a 0 2023-12-07T16:21:37.701 INFO:tasks.workunit.client.0.smithi063.stdout:0/380: creat d4/dd/de/f7c x:0 0 0 2023-12-07T16:21:37.701 INFO:tasks.workunit.client.0.smithi063.stdout:0/381: readlink d4/dd/d26/d2b/l56 0 2023-12-07T16:21:37.702 INFO:tasks.workunit.client.0.smithi063.stdout:0/382: creat d4/d25/f7d x:0 0 0 2023-12-07T16:21:37.702 INFO:tasks.workunit.client.0.smithi063.stdout:0/383: read - d4/dd/de/d15/d52/d5b/f5d zero size 2023-12-07T16:21:37.706 INFO:tasks.workunit.client.1.smithi152.stdout:7/448: dwrite db/d27/d39/d41/f4f [0,4194304] 0 2023-12-07T16:21:37.708 INFO:tasks.workunit.client.1.smithi152.stdout:1/600: dread dc/d28/d4e/f61 [0,4194304] 0 2023-12-07T16:21:37.708 INFO:tasks.workunit.client.1.smithi152.stdout:1/601: truncate dc/d14/d18/fb5 934575 0 2023-12-07T16:21:37.709 INFO:tasks.workunit.client.1.smithi152.stdout:7/449: creat db/d27/d5e/d45/f82 x:0 0 0 2023-12-07T16:21:37.709 INFO:tasks.workunit.client.1.smithi152.stdout:7/450: chown db/d27/d39/d41/d37/c42 1 1 2023-12-07T16:21:37.710 INFO:tasks.workunit.client.1.smithi152.stdout:1/602: rmdir dc/d14/d68 39 2023-12-07T16:21:37.713 INFO:tasks.workunit.client.1.smithi152.stdout:5/593: dwrite dd/d7b/f84 [4194304,4194304] 0 2023-12-07T16:21:37.713 INFO:tasks.workunit.client.1.smithi152.stdout:7/451: mknod db/c83 0 2023-12-07T16:21:37.713 INFO:tasks.workunit.client.1.smithi152.stdout:7/452: write db/d27/d5e/d45/f82 [860272,36000] 0 2023-12-07T16:21:37.714 INFO:tasks.workunit.client.1.smithi152.stdout:1/603: symlink dc/d14/d90/da9/lc3 0 2023-12-07T16:21:37.716 INFO:tasks.workunit.client.0.smithi063.stdout:2/283: dwrite d0/d21/d39/f4e [0,4194304] 0 2023-12-07T16:21:37.716 INFO:tasks.workunit.client.0.smithi063.stdout:2/284: truncate d0/d21/d56/d11/f58 210622 0 2023-12-07T16:21:37.716 INFO:tasks.workunit.client.1.smithi152.stdout:2/467: dwrite d2/d1c/f80 [0,4194304] 0 2023-12-07T16:21:37.717 INFO:tasks.workunit.client.1.smithi152.stdout:7/453: link db/d27/d39/d41/d58/f7e db/d27/d5e/f84 0 2023-12-07T16:21:37.719 INFO:tasks.workunit.client.0.smithi063.stdout:2/285: creat d0/d21/d56/d11/d52/d5d/f5f x:0 0 0 2023-12-07T16:21:37.719 INFO:tasks.workunit.client.0.smithi063.stdout:2/286: fsync d0/d21/f2a 0 2023-12-07T16:21:37.719 INFO:tasks.workunit.client.1.smithi152.stdout:3/490: dwrite d7/f8 [4194304,4194304] 0 2023-12-07T16:21:37.719 INFO:tasks.workunit.client.1.smithi152.stdout:3/491: stat d7/dc 0 2023-12-07T16:21:37.720 INFO:tasks.workunit.client.0.smithi063.stdout:5/277: dwrite d1/f34 [0,4194304] 0 2023-12-07T16:21:37.720 INFO:tasks.workunit.client.1.smithi152.stdout:2/468: unlink d2/d1c/d2e/d38/l97 0 2023-12-07T16:21:37.720 INFO:tasks.workunit.client.1.smithi152.stdout:2/469: write d2/d1c/d2e/d5d/f7c [864854,31776] 0 2023-12-07T16:21:37.721 INFO:tasks.workunit.client.0.smithi063.stdout:3/257: dwrite d7/d9/f18 [4194304,4194304] 0 2023-12-07T16:21:37.721 INFO:tasks.workunit.client.1.smithi152.stdout:1/604: dread dc/d14/d18/d79/f8d [0,4194304] 0 2023-12-07T16:21:37.721 INFO:tasks.workunit.client.1.smithi152.stdout:1/605: truncate dc/d28/f55 1556380 0 2023-12-07T16:21:37.721 INFO:tasks.workunit.client.1.smithi152.stdout:1/606: write dc/d14/d18/f35 [973440,38464] 0 2023-12-07T16:21:37.722 INFO:tasks.workunit.client.1.smithi152.stdout:8/507: sync 2023-12-07T16:21:37.723 INFO:tasks.workunit.client.1.smithi152.stdout:7/454: link db/d1c/l34 db/d27/d39/d41/d58/l85 0 2023-12-07T16:21:37.723 INFO:tasks.workunit.client.0.smithi063.stdout:7/300: getdents d2/d2c 0 2023-12-07T16:21:37.724 INFO:tasks.workunit.client.0.smithi063.stdout:2/287: read d0/f10 [3083327,92955] 0 2023-12-07T16:21:37.725 INFO:tasks.workunit.client.0.smithi063.stdout:0/384: dwrite d4/f17 [0,4194304] 0 2023-12-07T16:21:37.725 INFO:tasks.workunit.client.0.smithi063.stdout:0/385: read d4/fc [1930919,683] 0 2023-12-07T16:21:37.725 INFO:tasks.workunit.client.0.smithi063.stdout:2/288: write d0/d4a/f54 [290745,83765] 0 2023-12-07T16:21:37.725 INFO:tasks.workunit.client.0.smithi063.stdout:0/386: fsync d4/dd/f44 0 2023-12-07T16:21:37.727 INFO:tasks.workunit.client.1.smithi152.stdout:5/594: dread dd/de/d14/d1f/d28/f30 [0,4194304] 0 2023-12-07T16:21:37.727 INFO:tasks.workunit.client.0.smithi063.stdout:7/301: mknod d2/d34/d5a/c76 0 2023-12-07T16:21:37.727 INFO:tasks.workunit.client.0.smithi063.stdout:7/302: read - d2/d34/d5a/d5f/f27 zero size 2023-12-07T16:21:37.727 INFO:tasks.workunit.client.0.smithi063.stdout:7/303: truncate d2/d34/d5a/d5f/d2a/f4a 304289 0 2023-12-07T16:21:37.729 INFO:tasks.workunit.client.1.smithi152.stdout:3/492: link d7/d10/d1a/d25/d4b/f4d d7/d10/d1a/d25/f9a 0 2023-12-07T16:21:37.732 INFO:tasks.workunit.client.1.smithi152.stdout:2/470: rmdir d2/d9 39 2023-12-07T16:21:37.735 INFO:tasks.workunit.client.0.smithi063.stdout:4/231: sync 2023-12-07T16:21:37.735 INFO:tasks.workunit.client.0.smithi063.stdout:9/294: sync 2023-12-07T16:21:37.738 INFO:tasks.workunit.client.0.smithi063.stdout:9/295: rename d0/d13/d39/d3a/d3e to d0/d21/d64 0 2023-12-07T16:21:37.738 INFO:tasks.workunit.client.0.smithi063.stdout:9/296: chown d0/d13/d39/d42/f50 328036278 1 2023-12-07T16:21:37.738 INFO:tasks.workunit.client.1.smithi152.stdout:4/416: truncate d0/d3/f6d 1286090 0 2023-12-07T16:21:37.738 INFO:tasks.workunit.client.1.smithi152.stdout:4/417: chown d0/d3/d6/dc/dd 9400 1 2023-12-07T16:21:37.738 INFO:tasks.workunit.client.1.smithi152.stdout:7/455: link l3 db/d27/d39/d41/d58/d80/l86 0 2023-12-07T16:21:37.739 INFO:tasks.workunit.client.0.smithi063.stdout:4/232: link d1/d3/db/d2c/l40 d1/d3/d3a/l42 0 2023-12-07T16:21:37.741 INFO:tasks.workunit.client.0.smithi063.stdout:9/297: write d0/d13/f36 [4177616,99225] 0 2023-12-07T16:21:37.741 INFO:tasks.workunit.client.1.smithi152.stdout:1/607: rename dc/d14/d18/d2d/d4a/c59 to dc/d14/d18/d45/d74/cc4 0 2023-12-07T16:21:37.742 INFO:tasks.workunit.client.1.smithi152.stdout:2/471: truncate d2/f5a 770888 0 2023-12-07T16:21:37.742 INFO:tasks.workunit.client.1.smithi152.stdout:2/472: chown d2/d1c/d2e/d30/d53 10 1 2023-12-07T16:21:37.743 INFO:tasks.workunit.client.0.smithi063.stdout:7/304: write d2/d21/f2d [2437145,68465] 0 2023-12-07T16:21:37.743 INFO:tasks.workunit.client.0.smithi063.stdout:2/289: dread d0/d1e/f43 [0,4194304] 0 2023-12-07T16:21:37.743 INFO:tasks.workunit.client.0.smithi063.stdout:2/290: chown d0/d1e/d5c/c53 5000502 1 2023-12-07T16:21:37.743 INFO:tasks.workunit.client.0.smithi063.stdout:2/291: fdatasync d0/d21/d39/f51 0 2023-12-07T16:21:37.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:37 smithi152 ceph-mon[121113]: pgmap v26: 65 pgs: 65 active+clean; 775 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 50 MiB/s rd, 96 MiB/s wr, 506 op/s 2023-12-07T16:21:37.744 INFO:tasks.workunit.client.1.smithi152.stdout:5/595: dread dd/f76 [0,4194304] 0 2023-12-07T16:21:37.744 INFO:tasks.workunit.client.1.smithi152.stdout:2/473: write d2/d1c/d2e/d30/d33/f3d [974044,119791] 0 2023-12-07T16:21:37.745 INFO:tasks.workunit.client.1.smithi152.stdout:4/418: mknod d0/d3/d6/dc/d3a/d48/d4c/c78 0 2023-12-07T16:21:37.745 INFO:tasks.workunit.client.1.smithi152.stdout:4/419: chown d0/d3/c62 452280 1 2023-12-07T16:21:37.746 INFO:tasks.workunit.client.1.smithi152.stdout:1/608: write dc/d28/f43 [5858038,22393] 0 2023-12-07T16:21:37.747 INFO:tasks.workunit.client.0.smithi063.stdout:9/298: symlink d0/d13/d39/d42/d57/l65 0 2023-12-07T16:21:37.747 INFO:tasks.workunit.client.0.smithi063.stdout:4/233: mknod d1/d3/db/d41/c43 0 2023-12-07T16:21:37.747 INFO:tasks.workunit.client.1.smithi152.stdout:7/456: mkdir db/d68/d87 0 2023-12-07T16:21:37.747 INFO:tasks.workunit.client.1.smithi152.stdout:7/457: stat db/d27/d4d 0 2023-12-07T16:21:37.749 INFO:tasks.workunit.client.1.smithi152.stdout:8/508: rename d3/d4/d9/f1c to d3/d1e/d55/fb8 0 2023-12-07T16:21:37.750 INFO:tasks.workunit.client.1.smithi152.stdout:5/596: truncate dd/f1e 1031780 0 2023-12-07T16:21:37.750 INFO:tasks.workunit.client.1.smithi152.stdout:5/597: chown dd/de/d38/l51 632048861 1 2023-12-07T16:21:37.752 INFO:tasks.workunit.client.1.smithi152.stdout:2/474: getdents d2/d56/da0 0 2023-12-07T16:21:37.752 INFO:tasks.workunit.client.1.smithi152.stdout:2/475: chown d2/d1c/f41 14566 1 2023-12-07T16:21:37.753 INFO:tasks.workunit.client.1.smithi152.stdout:4/420: getdents d0/d3/d6/d5c 0 2023-12-07T16:21:37.754 INFO:tasks.workunit.client.1.smithi152.stdout:1/609: creat dc/d14/d18/d45/fc5 x:0 0 0 2023-12-07T16:21:37.754 INFO:tasks.workunit.client.1.smithi152.stdout:7/458: rmdir db/d27/d39/d63 39 2023-12-07T16:21:37.758 INFO:tasks.workunit.client.0.smithi063.stdout:2/292: dread d0/d21/d56/f17 [0,4194304] 0 2023-12-07T16:21:37.758 INFO:tasks.workunit.client.0.smithi063.stdout:2/293: fsync d0/d1e/f3e 0 2023-12-07T16:21:37.758 INFO:tasks.workunit.client.1.smithi152.stdout:8/509: unlink d3/d4/d9/f21 0 2023-12-07T16:21:37.758 INFO:tasks.workunit.client.1.smithi152.stdout:8/510: truncate d3/d4/d9/dc/d6f/d7a/d8a/f6c 1149819 0 2023-12-07T16:21:37.761 INFO:tasks.workunit.client.0.smithi063.stdout:2/294: symlink d0/d21/d56/d11/d52/l60 0 2023-12-07T16:21:37.762 INFO:tasks.workunit.client.1.smithi152.stdout:7/459: creat db/d27/d4d/f88 x:0 0 0 2023-12-07T16:21:37.762 INFO:tasks.workunit.client.1.smithi152.stdout:7/460: write db/d27/f7a [342253,59912] 0 2023-12-07T16:21:37.763 INFO:tasks.workunit.client.1.smithi152.stdout:3/493: rename d7/d10/l24 to d7/d10/d1a/d2f/l9b 0 2023-12-07T16:21:37.763 INFO:tasks.workunit.client.1.smithi152.stdout:3/494: write d7/d10/d1a/f72 [754229,76259] 0 2023-12-07T16:21:37.765 INFO:tasks.workunit.client.1.smithi152.stdout:4/421: dread d0/d3/f7 [4194304,4194304] 0 2023-12-07T16:21:37.765 INFO:tasks.workunit.client.1.smithi152.stdout:5/598: dread dd/de/d14/d19/d1a/d1b/f48 [4194304,4194304] 0 2023-12-07T16:21:37.765 INFO:tasks.workunit.client.1.smithi152.stdout:8/511: creat d3/d4/d9/d23/fb9 x:0 0 0 2023-12-07T16:21:37.765 INFO:tasks.workunit.client.1.smithi152.stdout:8/512: chown d3/d4/d9/dad 343657 1 2023-12-07T16:21:37.765 INFO:tasks.workunit.client.1.smithi152.stdout:8/513: write d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/d7d/f87 [16948,26259] 0 2023-12-07T16:21:37.765 INFO:tasks.workunit.client.1.smithi152.stdout:7/461: symlink db/d27/d39/l89 0 2023-12-07T16:21:37.766 INFO:tasks.workunit.client.0.smithi063.stdout:3/258: dwrite d7/d9/f12 [0,4194304] 0 2023-12-07T16:21:37.766 INFO:tasks.workunit.client.1.smithi152.stdout:1/610: rename dc/d14/d18/d79/f8d to dc/d14/d18/d79/d86/db7/fc6 0 2023-12-07T16:21:37.767 INFO:tasks.workunit.client.0.smithi063.stdout:3/259: mknod d7/d21/c4d 0 2023-12-07T16:21:37.767 INFO:tasks.workunit.client.1.smithi152.stdout:3/495: symlink d7/dc/d3e/d6b/l9c 0 2023-12-07T16:21:37.767 INFO:tasks.workunit.client.1.smithi152.stdout:2/476: dread d2/d9/f2f [0,4194304] 0 2023-12-07T16:21:37.768 INFO:tasks.workunit.client.1.smithi152.stdout:4/422: creat d0/d17/f79 x:0 0 0 2023-12-07T16:21:37.768 INFO:tasks.workunit.client.1.smithi152.stdout:4/423: readlink d0/l49 0 2023-12-07T16:21:37.768 INFO:tasks.workunit.client.1.smithi152.stdout:4/424: readlink d0/d3/d6/dc/d39/l3b 0 2023-12-07T16:21:37.769 INFO:tasks.workunit.client.1.smithi152.stdout:8/514: rmdir d3/d1e/d40/d74 39 2023-12-07T16:21:37.769 INFO:tasks.workunit.client.1.smithi152.stdout:8/515: stat d3/d4/d9/d23/d4c/da6 0 2023-12-07T16:21:37.769 INFO:tasks.workunit.client.1.smithi152.stdout:8/516: readlink d3/d4/d9/d23/l47 0 2023-12-07T16:21:37.770 INFO:tasks.workunit.client.1.smithi152.stdout:7/462: getdents db/d27/d39/d41/d37 0 2023-12-07T16:21:37.772 INFO:tasks.workunit.client.1.smithi152.stdout:1/611: rename l7 to dc/d14/d90/lc7 0 2023-12-07T16:21:37.772 INFO:tasks.workunit.client.1.smithi152.stdout:3/496: symlink d7/dc/d3e/d62/d6d/d84/l9d 0 2023-12-07T16:21:37.772 INFO:tasks.workunit.client.1.smithi152.stdout:3/497: read - d7/d10/d1a/d25/f27 zero size 2023-12-07T16:21:37.774 INFO:tasks.workunit.client.0.smithi063.stdout:5/278: dwrite d1/d3/de/f10 [4194304,4194304] 0 2023-12-07T16:21:37.777 INFO:tasks.workunit.client.1.smithi152.stdout:1/612: write dc/f36 [756222,29110] 0 2023-12-07T16:21:37.777 INFO:tasks.workunit.client.0.smithi063.stdout:3/260: dread d7/d9/d2b/f43 [0,4194304] 0 2023-12-07T16:21:37.777 INFO:tasks.workunit.client.1.smithi152.stdout:2/477: rename d2/d1c/d2e/d30/d53 to d2/d1c/d2e/d57/d5b/da7 0 2023-12-07T16:21:37.777 INFO:tasks.workunit.client.1.smithi152.stdout:2/478: fsync d2/d1c/d2e/fa2 0 2023-12-07T16:21:37.777 INFO:tasks.workunit.client.1.smithi152.stdout:2/479: readlink d2/d9/d51/d54/d5c/l96 0 2023-12-07T16:21:37.778 INFO:tasks.workunit.client.0.smithi063.stdout:5/279: symlink d1/l52 0 2023-12-07T16:21:37.778 INFO:tasks.workunit.client.0.smithi063.stdout:5/280: chown d1/d38/f43 47976 1 2023-12-07T16:21:37.780 INFO:tasks.workunit.client.1.smithi152.stdout:3/498: symlink d7/dc/d3e/d62/d6d/d84/l9e 0 2023-12-07T16:21:37.780 INFO:tasks.workunit.client.1.smithi152.stdout:3/499: truncate d7/dc/d14/f69 517579 0 2023-12-07T16:21:37.783 INFO:tasks.workunit.client.0.smithi063.stdout:4/234: dwrite d1/d3/f36 [0,4194304] 0 2023-12-07T16:21:37.783 INFO:tasks.workunit.client.0.smithi063.stdout:3/261: creat d7/d9/d2b/f4e x:0 0 0 2023-12-07T16:21:37.783 INFO:tasks.workunit.client.0.smithi063.stdout:0/387: dwrite d4/fc [0,4194304] 0 2023-12-07T16:21:37.783 INFO:tasks.workunit.client.1.smithi152.stdout:8/517: rename d3/d1e/d55/d83/dae/fb0 to d3/d4/d9/dc/d6f/fba 0 2023-12-07T16:21:37.784 INFO:tasks.workunit.client.1.smithi152.stdout:3/500: write d7/d10/d1a/f43 [2316868,44096] 0 2023-12-07T16:21:37.784 INFO:tasks.workunit.client.1.smithi152.stdout:4/425: dread d0/d3/f3c [0,4194304] 0 2023-12-07T16:21:37.785 INFO:tasks.workunit.client.0.smithi063.stdout:9/299: dwrite d0/f31 [0,4194304] 0 2023-12-07T16:21:37.787 INFO:tasks.workunit.client.0.smithi063.stdout:9/300: read d0/d7/f16 [2819096,43709] 0 2023-12-07T16:21:37.787 INFO:tasks.workunit.client.1.smithi152.stdout:8/518: creat d3/d4/d9/dc/d6f/d7a/d8a/d63/d7c/fbb x:0 0 0 2023-12-07T16:21:37.787 INFO:tasks.workunit.client.1.smithi152.stdout:3/501: creat d7/d10/d1a/d2f/d56/f9f x:0 0 0 2023-12-07T16:21:37.787 INFO:tasks.workunit.client.1.smithi152.stdout:2/480: getdents d2/d1c/d2e/d57/d5b/da7/d8a 0 2023-12-07T16:21:37.788 INFO:tasks.workunit.client.1.smithi152.stdout:1/613: dread dc/d28/f39 [4194304,4194304] 0 2023-12-07T16:21:37.788 INFO:tasks.workunit.client.0.smithi063.stdout:4/235: mkdir d1/d3/d3f/d44 0 2023-12-07T16:21:37.789 INFO:tasks.workunit.client.0.smithi063.stdout:5/281: creat d1/d3/de/d1e/d25/f53 x:0 0 0 2023-12-07T16:21:37.790 INFO:tasks.workunit.client.1.smithi152.stdout:4/426: write d0/d3/d6/dc/dd/f6c [1735668,52529] 0 2023-12-07T16:21:37.790 INFO:tasks.workunit.client.0.smithi063.stdout:0/388: mkdir d4/d7e 0 2023-12-07T16:21:37.791 INFO:tasks.workunit.client.0.smithi063.stdout:2/295: dwrite d0/d21/d56/d11/f23 [4194304,4194304] 0 2023-12-07T16:21:37.791 INFO:tasks.workunit.client.0.smithi063.stdout:0/389: write d4/dd/d26/d2b/f33 [2398397,104377] 0 2023-12-07T16:21:37.791 INFO:tasks.workunit.client.0.smithi063.stdout:0/390: chown d4/dd/l48 0 1 2023-12-07T16:21:37.791 INFO:tasks.workunit.client.1.smithi152.stdout:5/599: dwrite dd/de/d14/d19/d1a/d1b/f8b [0,4194304] 0 2023-12-07T16:21:37.792 INFO:tasks.workunit.client.0.smithi063.stdout:9/301: unlink d0/d13/c1f 0 2023-12-07T16:21:37.792 INFO:tasks.workunit.client.0.smithi063.stdout:9/302: truncate d0/d7/f58 1029286 0 2023-12-07T16:21:37.792 INFO:tasks.workunit.client.0.smithi063.stdout:2/296: symlink d0/d1e/d5c/l61 0 2023-12-07T16:21:37.794 INFO:tasks.workunit.client.1.smithi152.stdout:3/502: dread d7/d10/d1a/d25/d4b/f4d [0,4194304] 0 2023-12-07T16:21:37.794 INFO:tasks.workunit.client.0.smithi063.stdout:2/297: mknod d0/d21/d39/c62 0 2023-12-07T16:21:37.794 INFO:tasks.workunit.client.0.smithi063.stdout:2/298: fdatasync d0/d21/d56/f20 0 2023-12-07T16:21:37.794 INFO:tasks.workunit.client.0.smithi063.stdout:2/299: write d0/d1e/f30 [11043,27442] 0 2023-12-07T16:21:37.802 INFO:tasks.workunit.client.0.smithi063.stdout:2/300: dread d0/f16 [4194304,4194304] 0 2023-12-07T16:21:37.803 INFO:tasks.workunit.client.0.smithi063.stdout:4/236: dread d1/d3/f8 [0,4194304] 0 2023-12-07T16:21:37.803 INFO:tasks.workunit.client.0.smithi063.stdout:4/237: chown d1/d3 974 1 2023-12-07T16:21:37.805 INFO:tasks.workunit.client.0.smithi063.stdout:4/238: creat d1/d3/db/d13/f45 x:0 0 0 2023-12-07T16:21:37.806 INFO:tasks.workunit.client.0.smithi063.stdout:5/282: dread d1/d3/f35 [0,4194304] 0 2023-12-07T16:21:37.806 INFO:tasks.workunit.client.0.smithi063.stdout:4/239: creat d1/d3/db/d41/f46 x:0 0 0 2023-12-07T16:21:37.806 INFO:tasks.workunit.client.0.smithi063.stdout:4/240: chown d1/d3/d3a 0 1 2023-12-07T16:21:37.807 INFO:tasks.workunit.client.0.smithi063.stdout:5/283: symlink d1/d3/l54 0 2023-12-07T16:21:37.808 INFO:tasks.workunit.client.0.smithi063.stdout:5/284: symlink d1/d3/d3a/l55 0 2023-12-07T16:21:37.810 INFO:tasks.workunit.client.0.smithi063.stdout:9/303: dread d0/d21/f33 [0,4194304] 0 2023-12-07T16:21:37.810 INFO:tasks.workunit.client.0.smithi063.stdout:5/285: write d1/d3/de/d1e/f1d [1880214,128672] 0 2023-12-07T16:21:37.812 INFO:tasks.workunit.client.0.smithi063.stdout:9/304: symlink d0/l66 0 2023-12-07T16:21:37.813 INFO:tasks.workunit.client.0.smithi063.stdout:5/286: mkdir d1/d31/d56 0 2023-12-07T16:21:37.815 INFO:tasks.workunit.client.0.smithi063.stdout:4/241: dread d1/d3/db/f20 [0,4194304] 0 2023-12-07T16:21:37.815 INFO:tasks.workunit.client.0.smithi063.stdout:4/242: truncate d1/d3/f35 129957 0 2023-12-07T16:21:37.816 INFO:tasks.workunit.client.0.smithi063.stdout:4/243: fdatasync d1/d3/f5 0 2023-12-07T16:21:37.818 INFO:tasks.workunit.client.0.smithi063.stdout:9/305: dread d0/d21/f33 [0,4194304] 0 2023-12-07T16:21:37.818 INFO:tasks.workunit.client.0.smithi063.stdout:2/301: dwrite d0/f33 [0,4194304] 0 2023-12-07T16:21:37.820 INFO:tasks.workunit.client.0.smithi063.stdout:4/244: write d1/d3/db/d13/f39 [3080663,71880] 0 2023-12-07T16:21:37.823 INFO:tasks.workunit.client.0.smithi063.stdout:4/245: mknod d1/d3/d3a/c47 0 2023-12-07T16:21:37.824 INFO:tasks.workunit.client.0.smithi063.stdout:2/302: write d0/d21/d39/f4e [784623,54552] 0 2023-12-07T16:21:37.829 INFO:tasks.workunit.client.0.smithi063.stdout:2/303: getdents d0/d1e 0 2023-12-07T16:21:37.829 INFO:tasks.workunit.client.0.smithi063.stdout:2/304: write d0/f44 [804329,64780] 0 2023-12-07T16:21:37.833 INFO:tasks.workunit.client.1.smithi152.stdout:8/519: unlink d3/d1e/d55/d83/l96 0 2023-12-07T16:21:37.833 INFO:tasks.workunit.client.1.smithi152.stdout:8/520: chown d3/d4/d9/dc/f3e 29107 1 2023-12-07T16:21:37.835 INFO:tasks.workunit.client.1.smithi152.stdout:8/521: read d3/d4/d9/dc/d6f/d7a/d8a/f28 [565776,28863] 0 2023-12-07T16:21:37.836 INFO:tasks.workunit.client.1.smithi152.stdout:1/614: link dc/d14/d18/d2d/d48/da3/d58/c5c dc/d28/d4e/cc8 0 2023-12-07T16:21:37.836 INFO:tasks.workunit.client.1.smithi152.stdout:1/615: chown dc/d14/d90/dbb/cc1 34 1 2023-12-07T16:21:37.838 INFO:tasks.workunit.client.1.smithi152.stdout:7/463: rmdir db/d27/d39/d41/d58 39 2023-12-07T16:21:37.839 INFO:tasks.workunit.client.1.smithi152.stdout:7/464: stat db/d27/d39/d63/l7b 0 2023-12-07T16:21:37.839 INFO:tasks.workunit.client.1.smithi152.stdout:7/465: write db/d27/d39/d41/d37/f64 [361393,45128] 0 2023-12-07T16:21:37.841 INFO:tasks.workunit.client.1.smithi152.stdout:4/427: truncate d0/d3/d6/dc/dd/d67/f42 582891 0 2023-12-07T16:21:37.841 INFO:tasks.workunit.client.1.smithi152.stdout:4/428: read - d0/d3/d6/dc/d3a/d48/f5d zero size 2023-12-07T16:21:37.841 INFO:tasks.workunit.client.1.smithi152.stdout:4/429: chown d0/d3/d6/dc/d3a/d46/d4e/f57 57207544 1 2023-12-07T16:21:37.841 INFO:tasks.workunit.client.1.smithi152.stdout:4/430: fsync d0/d3/d6/d2b/d56/f70 0 2023-12-07T16:21:37.851 INFO:tasks.workunit.client.0.smithi063.stdout:2/305: dread d0/d1e/f43 [0,4194304] 0 2023-12-07T16:21:37.851 INFO:tasks.workunit.client.0.smithi063.stdout:2/306: dread - d0/d21/d56/d11/d52/d5d/f5f zero size 2023-12-07T16:21:37.851 INFO:tasks.workunit.client.0.smithi063.stdout:2/307: fdatasync d0/d21/d56/d11/f23 0 2023-12-07T16:21:37.852 INFO:tasks.workunit.client.0.smithi063.stdout:2/308: write d0/d1e/d5c/f55 [739751,45168] 0 2023-12-07T16:21:37.856 INFO:tasks.workunit.client.0.smithi063.stdout:5/287: dwrite d1/f11 [0,4194304] 0 2023-12-07T16:21:37.856 INFO:tasks.workunit.client.0.smithi063.stdout:4/246: dwrite d1/d3/db/f3e [0,4194304] 0 2023-12-07T16:21:37.856 INFO:tasks.workunit.client.0.smithi063.stdout:9/306: dwrite d0/d7/f58 [0,4194304] 0 2023-12-07T16:21:37.856 INFO:tasks.workunit.client.0.smithi063.stdout:4/247: readlink d1/d3/db/d13/l1d 0 2023-12-07T16:21:37.857 INFO:tasks.workunit.client.0.smithi063.stdout:2/309: mkdir d0/d21/d56/d11/d52/d63 0 2023-12-07T16:21:37.857 INFO:tasks.workunit.client.1.smithi152.stdout:5/600: rename dd/de/d14/d19/d1a/d1b/f8d to dd/de/d17/fce 0 2023-12-07T16:21:37.858 INFO:tasks.workunit.client.0.smithi063.stdout:5/288: creat d1/d38/f57 x:0 0 0 2023-12-07T16:21:37.860 INFO:tasks.workunit.client.1.smithi152.stdout:3/503: creat d7/d10/d19/fa0 x:0 0 0 2023-12-07T16:21:37.860 INFO:tasks.workunit.client.1.smithi152.stdout:8/522: dwrite d3/d4/d9/dc/d6f/d7a/d8a/f37 [0,4194304] 0 2023-12-07T16:21:37.863 INFO:tasks.workunit.client.1.smithi152.stdout:7/466: creat db/d27/d39/d41/d58/f8a x:0 0 0 2023-12-07T16:21:37.864 INFO:tasks.workunit.client.1.smithi152.stdout:1/616: dwrite dc/d14/d68/fb6 [0,4194304] 0 2023-12-07T16:21:37.865 INFO:tasks.workunit.client.0.smithi063.stdout:9/307: getdents d0/d13 0 2023-12-07T16:21:37.865 INFO:tasks.workunit.client.0.smithi063.stdout:9/308: dread - d0/d13/d39/d42/f50 zero size 2023-12-07T16:21:37.866 INFO:tasks.workunit.client.1.smithi152.stdout:5/601: rename dd/de/d14/dc6/fa0 to dd/de/d14/d19/d1a/d1b/fcf 0 2023-12-07T16:21:37.866 INFO:tasks.workunit.client.1.smithi152.stdout:5/602: chown dd/de/d38/d3d/f46 24713 1 2023-12-07T16:21:37.866 INFO:tasks.workunit.client.1.smithi152.stdout:5/603: fsync dd/f5a 0 2023-12-07T16:21:37.867 INFO:tasks.workunit.client.0.smithi063.stdout:2/310: creat d0/d1e/d5c/d5b/f64 x:0 0 0 2023-12-07T16:21:37.867 INFO:tasks.workunit.client.0.smithi063.stdout:5/289: creat d1/d38/f58 x:0 0 0 2023-12-07T16:21:37.871 INFO:tasks.workunit.client.1.smithi152.stdout:8/523: mkdir d3/d1e/d43/dbc 0 2023-12-07T16:21:37.871 INFO:tasks.workunit.client.1.smithi152.stdout:8/524: fsync d3/fa4 0 2023-12-07T16:21:37.871 INFO:tasks.workunit.client.0.smithi063.stdout:9/309: rename d0/d7/f16 to d0/f67 0 2023-12-07T16:21:37.871 INFO:tasks.workunit.client.0.smithi063.stdout:5/290: mknod d1/d3/de/c59 0 2023-12-07T16:21:37.872 INFO:tasks.workunit.client.0.smithi063.stdout:5/291: mkdir d1/d3/d3a/d5a 0 2023-12-07T16:21:37.873 INFO:tasks.workunit.client.1.smithi152.stdout:7/467: creat db/d27/d5e/f8b x:0 0 0 2023-12-07T16:21:37.873 INFO:tasks.workunit.client.1.smithi152.stdout:2/481: getdents d2/d1c/d2e/d30 0 2023-12-07T16:21:37.878 INFO:tasks.workunit.client.1.smithi152.stdout:1/617: mkdir dc/d14/d18/d2d/d48/da3/d58/dc9 0 2023-12-07T16:21:37.878 INFO:tasks.workunit.client.1.smithi152.stdout:1/618: truncate dc/d28/d7d/da4/fb0 1009548 0 2023-12-07T16:21:37.881 INFO:tasks.workunit.client.1.smithi152.stdout:3/504: rename d7/d10/d1a/f28 to d7/dc/d3e/d7d/fa1 0 2023-12-07T16:21:37.883 INFO:tasks.workunit.client.0.smithi063.stdout:4/248: dwrite d1/f28 [0,4194304] 0 2023-12-07T16:21:37.883 INFO:tasks.workunit.client.1.smithi152.stdout:5/604: mkdir dd/de/d14/d19/d1a/dcc/dd0 0 2023-12-07T16:21:37.885 INFO:tasks.workunit.client.0.smithi063.stdout:9/310: dread d0/f1a [0,4194304] 0 2023-12-07T16:21:37.886 INFO:tasks.workunit.client.1.smithi152.stdout:8/525: unlink d3/d4/d9/dc/d6f/d7a/d8a/d66/c72 0 2023-12-07T16:21:37.888 INFO:tasks.workunit.client.0.smithi063.stdout:4/249: getdents d1/d3/db/d13 0 2023-12-07T16:21:37.888 INFO:tasks.workunit.client.0.smithi063.stdout:4/250: chown d1/d3/db/d13/l1d 2567077 1 2023-12-07T16:21:37.889 INFO:tasks.workunit.client.1.smithi152.stdout:7/468: creat db/d68/d87/f8c x:0 0 0 2023-12-07T16:21:37.889 INFO:tasks.workunit.client.1.smithi152.stdout:2/482: mkdir d2/d1c/d52/da8 0 2023-12-07T16:21:37.892 INFO:tasks.workunit.client.0.smithi063.stdout:5/292: dread d1/d3/de/d1e/f24 [0,4194304] 0 2023-12-07T16:21:37.894 INFO:tasks.workunit.client.1.smithi152.stdout:1/619: mknod dc/d14/d18/d2d/d4a/cca 0 2023-12-07T16:21:37.895 INFO:tasks.workunit.client.1.smithi152.stdout:8/526: write d3/d4/d9/dc/f4d [2408938,125543] 0 2023-12-07T16:21:37.895 INFO:tasks.workunit.client.1.smithi152.stdout:3/505: dread d7/d10/d1a/d2f/f20 [0,4194304] 0 2023-12-07T16:21:37.895 INFO:tasks.workunit.client.1.smithi152.stdout:2/483: write f1 [4738213,56229] 0 2023-12-07T16:21:37.896 INFO:tasks.workunit.client.1.smithi152.stdout:7/469: truncate db/d27/d5e/d45/f4c 1634742 0 2023-12-07T16:21:37.897 INFO:tasks.workunit.client.1.smithi152.stdout:7/470: fsync db/f18 0 2023-12-07T16:21:37.897 INFO:tasks.workunit.client.1.smithi152.stdout:7/471: fdatasync db/d27/f7f 0 2023-12-07T16:21:37.897 INFO:tasks.workunit.client.1.smithi152.stdout:7/472: dread - db/d27/f7f zero size 2023-12-07T16:21:37.897 INFO:tasks.workunit.client.1.smithi152.stdout:7/473: fsync db/d1c/f28 0 2023-12-07T16:21:37.898 INFO:tasks.workunit.client.1.smithi152.stdout:1/620: write dc/d14/d18/f2c [1632941,20946] 0 2023-12-07T16:21:37.900 INFO:tasks.workunit.client.1.smithi152.stdout:8/527: mkdir d3/d4/d9/dc/d6f/d7b/dbd 0 2023-12-07T16:21:37.903 INFO:tasks.workunit.client.1.smithi152.stdout:3/506: mkdir d7/dc/d3e/d6b/d80/da2 0 2023-12-07T16:21:37.903 INFO:tasks.workunit.client.1.smithi152.stdout:7/474: link db/d27/d39/d41/d37/f38 db/d27/d39/d41/d58/d80/f8d 0 2023-12-07T16:21:37.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:37 smithi063 ceph-mon[112095]: pgmap v26: 65 pgs: 65 active+clean; 775 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 50 MiB/s rd, 96 MiB/s wr, 506 op/s 2023-12-07T16:21:37.906 INFO:tasks.workunit.client.1.smithi152.stdout:1/621: link dc/d14/d18/d2d/d48/da3/f22 dc/d14/d18/d45/fcb 0 2023-12-07T16:21:37.909 INFO:tasks.workunit.client.1.smithi152.stdout:1/622: write dc/d14/d18/d2d/d4a/d52/f69 [784582,120912] 0 2023-12-07T16:21:37.909 INFO:tasks.workunit.client.1.smithi152.stdout:7/475: link db/d68/c72 db/c8e 0 2023-12-07T16:21:37.909 INFO:tasks.workunit.client.1.smithi152.stdout:8/528: dread d3/d4/d9/dc/d6f/fba [0,4194304] 0 2023-12-07T16:21:37.909 INFO:tasks.workunit.client.1.smithi152.stdout:1/623: symlink dc/d14/d18/lcc 0 2023-12-07T16:21:37.913 INFO:tasks.workunit.client.0.smithi063.stdout:2/311: dwrite d0/d21/d56/d11/f23 [4194304,4194304] 0 2023-12-07T16:21:37.915 INFO:tasks.workunit.client.1.smithi152.stdout:2/484: dread d2/d1c/d2e/d38/f3b [0,4194304] 0 2023-12-07T16:21:37.915 INFO:tasks.workunit.client.0.smithi063.stdout:2/312: mkdir d0/d1e/d5c/d65 0 2023-12-07T16:21:37.916 INFO:tasks.workunit.client.1.smithi152.stdout:1/624: unlink dc/d14/d18/f30 0 2023-12-07T16:21:37.916 INFO:tasks.workunit.client.1.smithi152.stdout:8/529: rename d3/d4/d9/d34/f3f to d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/d7d/fbe 0 2023-12-07T16:21:37.916 INFO:tasks.workunit.client.1.smithi152.stdout:9/520: sync 2023-12-07T16:21:37.917 INFO:tasks.workunit.client.1.smithi152.stdout:0/488: sync 2023-12-07T16:21:37.917 INFO:tasks.workunit.client.1.smithi152.stdout:6/506: sync 2023-12-07T16:21:37.918 INFO:tasks.workunit.client.0.smithi063.stdout:2/313: rename d0/c2d to d0/d21/d56/d11/c66 0 2023-12-07T16:21:37.918 INFO:tasks.workunit.client.1.smithi152.stdout:2/485: truncate d2/d1c/d2e/d5d/f7c 59652 0 2023-12-07T16:21:37.920 INFO:tasks.workunit.client.1.smithi152.stdout:5/605: dwrite dd/de/d14/d19/f64 [0,4194304] 0 2023-12-07T16:21:37.920 INFO:tasks.workunit.client.1.smithi152.stdout:5/606: read - dd/fab zero size 2023-12-07T16:21:37.922 INFO:tasks.workunit.client.1.smithi152.stdout:9/521: creat d1/d9/db/d70/fb3 x:0 0 0 2023-12-07T16:21:37.922 INFO:tasks.workunit.client.1.smithi152.stdout:7/476: dread db/d27/d39/d41/d58/f73 [0,4194304] 0 2023-12-07T16:21:37.922 INFO:tasks.workunit.client.1.smithi152.stdout:7/477: fsync db/d27/d39/d63/f77 0 2023-12-07T16:21:37.923 INFO:tasks.workunit.client.1.smithi152.stdout:7/478: chown db/d1c/lf 217 1 2023-12-07T16:21:37.923 INFO:tasks.workunit.client.0.smithi063.stdout:1/226: sync 2023-12-07T16:21:37.923 INFO:tasks.workunit.client.1.smithi152.stdout:0/489: creat d0/dc/d3d/d4c/fa5 x:0 0 0 2023-12-07T16:21:37.924 INFO:tasks.workunit.client.0.smithi063.stdout:6/314: sync 2023-12-07T16:21:37.924 INFO:tasks.workunit.client.0.smithi063.stdout:6/315: write d0/f2c [987031,36754] 0 2023-12-07T16:21:37.924 INFO:tasks.workunit.client.0.smithi063.stdout:1/227: rmdir d0/dd/d10/d13 39 2023-12-07T16:21:37.926 INFO:tasks.workunit.client.1.smithi152.stdout:6/507: mkdir d2/d4f/d83/d85/de/d3f/da1 0 2023-12-07T16:21:37.927 INFO:tasks.workunit.client.1.smithi152.stdout:6/508: dread - d2/d4f/d83/d85/de/d2e/d38/f7b zero size 2023-12-07T16:21:37.927 INFO:tasks.workunit.client.1.smithi152.stdout:6/509: write d2/d4f/d83/d48/f53 [4321497,49338] 0 2023-12-07T16:21:37.927 INFO:tasks.workunit.client.0.smithi063.stdout:1/228: rename d0/dd/d19/f4d to d0/dd/d10/d1e/f52 0 2023-12-07T16:21:37.927 INFO:tasks.workunit.client.0.smithi063.stdout:1/229: chown d0/dd/d10/f27 11 1 2023-12-07T16:21:37.928 INFO:tasks.workunit.client.1.smithi152.stdout:2/486: creat d2/d1c/d2e/d30/d33/d86/fa9 x:0 0 0 2023-12-07T16:21:37.929 INFO:tasks.workunit.client.0.smithi063.stdout:6/316: symlink d0/l6f 0 2023-12-07T16:21:37.931 INFO:tasks.workunit.client.0.smithi063.stdout:6/317: creat d0/d1e/d60/d68/f70 x:0 0 0 2023-12-07T16:21:37.931 INFO:tasks.workunit.client.1.smithi152.stdout:5/607: mknod dd/de/d14/d19/d1a/dcc/cd1 0 2023-12-07T16:21:37.933 INFO:tasks.workunit.client.1.smithi152.stdout:7/479: symlink db/d27/d4d/l8f 0 2023-12-07T16:21:37.934 INFO:tasks.workunit.client.0.smithi063.stdout:6/318: symlink d0/d17/d1a/d4d/d5a/l71 0 2023-12-07T16:21:37.936 INFO:tasks.workunit.client.1.smithi152.stdout:6/510: mkdir d2/d4f/d83/da0/da2 0 2023-12-07T16:21:37.937 INFO:tasks.workunit.client.1.smithi152.stdout:1/625: dread dc/d28/d4e/f99 [0,4194304] 0 2023-12-07T16:21:37.937 INFO:tasks.workunit.client.1.smithi152.stdout:5/608: truncate dd/de/d14/f3f 1921380 0 2023-12-07T16:21:37.939 INFO:tasks.workunit.client.1.smithi152.stdout:7/480: creat db/d1c/f90 x:0 0 0 2023-12-07T16:21:37.941 INFO:tasks.workunit.client.0.smithi063.stdout:6/319: mknod d0/c72 0 2023-12-07T16:21:37.944 INFO:tasks.workunit.client.1.smithi152.stdout:6/511: write d2/d4f/d83/d85/de/d2e/f41 [2028097,25873] 0 2023-12-07T16:21:37.944 INFO:tasks.workunit.client.1.smithi152.stdout:6/512: chown d2/d4f/l5a 2 1 2023-12-07T16:21:37.944 INFO:tasks.workunit.client.1.smithi152.stdout:5/609: mknod dd/de/cd2 0 2023-12-07T16:21:37.944 INFO:tasks.workunit.client.1.smithi152.stdout:1/626: unlink dc/d14/d18/d45/f47 0 2023-12-07T16:21:37.944 INFO:tasks.workunit.client.1.smithi152.stdout:1/627: write dc/d14/d18/d2d/d4a/d52/f69 [1099074,130470] 0 2023-12-07T16:21:37.945 INFO:tasks.workunit.client.0.smithi063.stdout:6/320: rename d0/d1e/c6e to d0/d1e/d20/c73 0 2023-12-07T16:21:37.945 INFO:tasks.workunit.client.0.smithi063.stdout:6/321: write d0/d1e/d1d/f3a [581918,49418] 0 2023-12-07T16:21:37.945 INFO:tasks.workunit.client.1.smithi152.stdout:7/481: creat db/d27/f91 x:0 0 0 2023-12-07T16:21:37.947 INFO:tasks.workunit.client.0.smithi063.stdout:9/311: dwrite d0/f31 [0,4194304] 0 2023-12-07T16:21:37.947 INFO:tasks.workunit.client.0.smithi063.stdout:9/312: write d0/d21/f2c [4916590,68193] 0 2023-12-07T16:21:37.947 INFO:tasks.workunit.client.0.smithi063.stdout:6/322: rename d0/d17/d1a/d4d/f65 to d0/d17/d1a/f74 0 2023-12-07T16:21:37.947 INFO:tasks.workunit.client.0.smithi063.stdout:6/323: dread - d0/d1e/d60/d68/f70 zero size 2023-12-07T16:21:37.947 INFO:tasks.workunit.client.1.smithi152.stdout:6/513: creat d2/d4f/d83/d85/de/fa3 x:0 0 0 2023-12-07T16:21:37.947 INFO:tasks.workunit.client.1.smithi152.stdout:5/610: mkdir dd/de/d38/d3d/dd3 0 2023-12-07T16:21:37.948 INFO:tasks.workunit.client.1.smithi152.stdout:5/611: fsync dd/f2b 0 2023-12-07T16:21:37.949 INFO:tasks.workunit.client.1.smithi152.stdout:1/628: creat dc/d14/d18/d2d/d48/da3/d58/dc9/fcd x:0 0 0 2023-12-07T16:21:37.949 INFO:tasks.workunit.client.0.smithi063.stdout:9/313: creat d0/f68 x:0 0 0 2023-12-07T16:21:37.950 INFO:tasks.workunit.client.1.smithi152.stdout:7/482: symlink db/l92 0 2023-12-07T16:21:37.950 INFO:tasks.workunit.client.1.smithi152.stdout:7/483: chown db/d27/d4d/f69 72867560 1 2023-12-07T16:21:37.950 INFO:tasks.workunit.client.1.smithi152.stdout:2/487: dread d2/d1c/d2e/f46 [0,4194304] 0 2023-12-07T16:21:37.951 INFO:tasks.workunit.client.0.smithi063.stdout:9/314: getdents d0/d21/d64 0 2023-12-07T16:21:37.951 INFO:tasks.workunit.client.1.smithi152.stdout:5/612: symlink dd/de/d14/d1f/d28/ld4 0 2023-12-07T16:21:37.951 INFO:tasks.workunit.client.0.smithi063.stdout:9/315: creat d0/d13/d39/f69 x:0 0 0 2023-12-07T16:21:37.953 INFO:tasks.workunit.client.1.smithi152.stdout:1/629: creat dc/d14/d18/d2d/d9c/fce x:0 0 0 2023-12-07T16:21:37.953 INFO:tasks.workunit.client.1.smithi152.stdout:7/484: mknod db/d27/d39/d41/d37/c93 0 2023-12-07T16:21:37.953 INFO:tasks.workunit.client.1.smithi152.stdout:5/613: dread dd/de/d14/d19/d1a/d1b/f70 [0,4194304] 0 2023-12-07T16:21:37.955 INFO:tasks.workunit.client.1.smithi152.stdout:1/630: symlink dc/d14/d18/d2d/d91/lcf 0 2023-12-07T16:21:37.955 INFO:tasks.workunit.client.1.smithi152.stdout:5/614: symlink dd/de/d14/d1f/d49/ld5 0 2023-12-07T16:21:37.960 INFO:tasks.workunit.client.1.smithi152.stdout:5/615: symlink dd/d7b/dbf/ld6 0 2023-12-07T16:21:37.962 INFO:tasks.workunit.client.1.smithi152.stdout:5/616: rename dd/de/d14/d1f/d49/f5f to dd/de/d8f/dc9/fd7 0 2023-12-07T16:21:37.963 INFO:tasks.workunit.client.0.smithi063.stdout:4/251: dwrite d1/d3/db/d13/f1c [0,4194304] 0 2023-12-07T16:21:37.964 INFO:tasks.workunit.client.1.smithi152.stdout:1/631: dread dc/d14/fb4 [4194304,4194304] 0 2023-12-07T16:21:37.965 INFO:tasks.workunit.client.1.smithi152.stdout:5/617: write dd/de/d14/d1f/d28/f2d [4702905,67584] 0 2023-12-07T16:21:37.965 INFO:tasks.workunit.client.1.smithi152.stdout:5/618: chown dd/de/d14/d19/d1a/d1b/l8a 10607470 1 2023-12-07T16:21:37.966 INFO:tasks.workunit.client.1.smithi152.stdout:1/632: creat dc/d14/d18/d79/d86/db7/fd0 x:0 0 0 2023-12-07T16:21:37.966 INFO:tasks.workunit.client.1.smithi152.stdout:1/633: fsync dc/d14/d18/d45/fc5 0 2023-12-07T16:21:37.966 INFO:tasks.workunit.client.1.smithi152.stdout:1/634: dread - dc/d14/d18/d64/fa2 zero size 2023-12-07T16:21:37.966 INFO:tasks.workunit.client.0.smithi063.stdout:4/252: rename d1/d3/f35 to d1/d3/db/d13/f48 0 2023-12-07T16:21:37.966 INFO:tasks.workunit.client.1.smithi152.stdout:5/619: write dd/d7b/f7d [238117,91677] 0 2023-12-07T16:21:37.968 INFO:tasks.workunit.client.0.smithi063.stdout:4/253: mkdir d1/d3/d3f/d49 0 2023-12-07T16:21:37.968 INFO:tasks.workunit.client.0.smithi063.stdout:4/254: dread - d1/d3/db/d13/f45 zero size 2023-12-07T16:21:37.969 INFO:tasks.workunit.client.0.smithi063.stdout:4/255: rmdir d1/d3/db 39 2023-12-07T16:21:37.971 INFO:tasks.workunit.client.0.smithi063.stdout:4/256: creat d1/d3/f4a x:0 0 0 2023-12-07T16:21:37.971 INFO:tasks.workunit.client.0.smithi063.stdout:4/257: dread - d1/d3/db/d41/f46 zero size 2023-12-07T16:21:37.971 INFO:tasks.workunit.client.0.smithi063.stdout:6/324: dread d0/d17/d1a/f74 [0,4194304] 0 2023-12-07T16:21:37.973 INFO:tasks.workunit.client.0.smithi063.stdout:4/258: mkdir d1/d3/d3f/d49/d4b 0 2023-12-07T16:21:37.973 INFO:tasks.workunit.client.1.smithi152.stdout:6/514: dread d2/f24 [0,4194304] 0 2023-12-07T16:21:37.973 INFO:tasks.workunit.client.1.smithi152.stdout:6/515: chown d2/d4f/d83/d48/c73 16 1 2023-12-07T16:21:37.973 INFO:tasks.workunit.client.1.smithi152.stdout:6/516: write d2/d4f/d83/d48/d70/f9e [4829154,14192] 0 2023-12-07T16:21:37.974 INFO:tasks.workunit.client.0.smithi063.stdout:4/259: read d1/d3/db/d13/f1c [1891953,39935] 0 2023-12-07T16:21:37.974 INFO:tasks.workunit.client.0.smithi063.stdout:4/260: chown d1/d3/f1e 12199 1 2023-12-07T16:21:37.975 INFO:tasks.workunit.client.0.smithi063.stdout:6/325: creat d0/d17/d1a/d38/f75 x:0 0 0 2023-12-07T16:21:37.975 INFO:tasks.workunit.client.0.smithi063.stdout:6/326: chown d0/d17/d1a/f1c 131002 1 2023-12-07T16:21:37.975 INFO:tasks.workunit.client.0.smithi063.stdout:6/327: write d0/f2c [1434523,8015] 0 2023-12-07T16:21:37.976 INFO:tasks.workunit.client.1.smithi152.stdout:6/517: getdents d2/d4f/d83/d85/d9 0 2023-12-07T16:21:37.976 INFO:tasks.workunit.client.1.smithi152.stdout:6/518: write d2/d4f/d83/d58/f93 [74324,33047] 0 2023-12-07T16:21:37.976 INFO:tasks.workunit.client.1.smithi152.stdout:5/620: write dd/de/d14/d19/f64 [323224,85051] 0 2023-12-07T16:21:37.977 INFO:tasks.workunit.client.0.smithi063.stdout:6/328: mkdir d0/d1e/d60/d68/d76 0 2023-12-07T16:21:37.977 INFO:tasks.workunit.client.0.smithi063.stdout:6/329: write d0/d1e/d1d/d1f/f21 [5048972,11736] 0 2023-12-07T16:21:37.977 INFO:tasks.workunit.client.0.smithi063.stdout:6/330: creat d0/d1e/d60/d68/d76/f77 x:0 0 0 2023-12-07T16:21:37.978 INFO:tasks.workunit.client.0.smithi063.stdout:6/331: mkdir d0/d1e/d60/d68/d78 0 2023-12-07T16:21:37.979 INFO:tasks.workunit.client.1.smithi152.stdout:5/621: dread dd/d91/fa1 [0,4194304] 0 2023-12-07T16:21:37.980 INFO:tasks.workunit.client.1.smithi152.stdout:5/622: rmdir dd/de/d14/dc6/d7c 39 2023-12-07T16:21:37.981 INFO:tasks.workunit.client.0.smithi063.stdout:5/293: dwrite d1/d38/f58 [0,4194304] 0 2023-12-07T16:21:37.981 INFO:tasks.workunit.client.0.smithi063.stdout:5/294: readlink d1/d3/d3a/l55 0 2023-12-07T16:21:37.981 INFO:tasks.workunit.client.1.smithi152.stdout:5/623: rmdir dd/de/d8f/dc9 39 2023-12-07T16:21:37.982 INFO:tasks.workunit.client.1.smithi152.stdout:5/624: mknod dd/d91/cd8 0 2023-12-07T16:21:37.982 INFO:tasks.workunit.client.1.smithi152.stdout:5/625: chown dd/de/d8f 1 1 2023-12-07T16:21:37.982 INFO:tasks.workunit.client.1.smithi152.stdout:5/626: chown dd/de/d14/d67 2617 1 2023-12-07T16:21:37.985 INFO:tasks.workunit.client.1.smithi152.stdout:9/522: dwrite d1/d9/db/f2c [0,4194304] 0 2023-12-07T16:21:37.985 INFO:tasks.workunit.client.0.smithi063.stdout:6/332: read d0/d17/f5d [575906,113370] 0 2023-12-07T16:21:37.987 INFO:tasks.workunit.client.1.smithi152.stdout:3/507: dwrite d7/dc/f89 [4194304,4194304] 0 2023-12-07T16:21:37.989 INFO:tasks.workunit.client.0.smithi063.stdout:5/295: rename d1/d31/l48 to d1/d3/de/d1e/l5b 0 2023-12-07T16:21:37.989 INFO:tasks.workunit.client.0.smithi063.stdout:5/296: write d1/f2a [4849854,90054] 0 2023-12-07T16:21:37.990 INFO:tasks.workunit.client.0.smithi063.stdout:6/333: mkdir d0/d79 0 2023-12-07T16:21:37.991 INFO:tasks.workunit.client.0.smithi063.stdout:2/314: dwrite d0/d21/f2a [0,4194304] 0 2023-12-07T16:21:37.991 INFO:tasks.workunit.client.0.smithi063.stdout:4/261: dread d1/d3/db/d13/f39 [0,4194304] 0 2023-12-07T16:21:37.991 INFO:tasks.workunit.client.0.smithi063.stdout:5/297: creat d1/f5c x:0 0 0 2023-12-07T16:21:37.991 INFO:tasks.workunit.client.0.smithi063.stdout:5/298: readlink d1/l26 0 2023-12-07T16:21:37.992 INFO:tasks.workunit.client.1.smithi152.stdout:8/530: dwrite d3/d4/d9/dc/d6f/f99 [0,4194304] 0 2023-12-07T16:21:37.992 INFO:tasks.workunit.client.1.smithi152.stdout:6/519: dread d2/d4f/d83/d48/f84 [0,4194304] 0 2023-12-07T16:21:37.992 INFO:tasks.workunit.client.1.smithi152.stdout:9/523: symlink d1/d9/d2d/d72/d80/lb4 0 2023-12-07T16:21:37.992 INFO:tasks.workunit.client.1.smithi152.stdout:9/524: chown d1/d9/d2d/d65 6825 1 2023-12-07T16:21:37.992 INFO:tasks.workunit.client.1.smithi152.stdout:0/490: dwrite d0/d27/d11/f40 [0,4194304] 0 2023-12-07T16:21:37.992 INFO:tasks.workunit.client.1.smithi152.stdout:0/491: stat d0/d27/f6d 0 2023-12-07T16:21:37.992 INFO:tasks.workunit.client.1.smithi152.stdout:2/488: dread d2/d1c/d2e/d5d/f7c [0,4194304] 0 2023-12-07T16:21:37.992 INFO:tasks.workunit.client.1.smithi152.stdout:2/489: dread - d2/d1c/d2e/d30/d33/d86/fa9 zero size 2023-12-07T16:21:37.993 INFO:tasks.workunit.client.0.smithi063.stdout:2/315: unlink d0/d1e/f43 0 2023-12-07T16:21:37.993 INFO:tasks.workunit.client.1.smithi152.stdout:8/531: write d3/d4/d4b/f8e [41975,45657] 0 2023-12-07T16:21:37.994 INFO:tasks.workunit.client.0.smithi063.stdout:1/230: dwrite d0/dd/f3b [0,4194304] 0 2023-12-07T16:21:37.997 INFO:tasks.workunit.client.1.smithi152.stdout:9/525: rmdir d1/d9/db/df 39 2023-12-07T16:21:37.997 INFO:tasks.workunit.client.1.smithi152.stdout:7/485: dwrite db/d27/d39/d41/d58/f7e [0,4194304] 0 2023-12-07T16:21:37.999 INFO:tasks.workunit.client.0.smithi063.stdout:6/334: write d0/d17/f5d [1635779,113065] 0 2023-12-07T16:21:37.999 INFO:tasks.workunit.client.0.smithi063.stdout:6/335: dread - d0/d1e/d1d/d1f/f32 zero size 2023-12-07T16:21:37.999 INFO:tasks.workunit.client.0.smithi063.stdout:6/336: dread - d0/d1e/d2a/f52 zero size 2023-12-07T16:21:37.999 INFO:tasks.workunit.client.0.smithi063.stdout:6/337: write d0/d1e/d1d/f40 [675058,76305] 0 2023-12-07T16:21:37.999 INFO:tasks.workunit.client.0.smithi063.stdout:6/338: chown d0/d1e/c30 1573423508 1 2023-12-07T16:21:37.999 INFO:tasks.workunit.client.0.smithi063.stdout:6/339: readlink d0/d1e/d1d/l33 0 2023-12-07T16:21:38.000 INFO:tasks.workunit.client.0.smithi063.stdout:1/231: unlink d0/dd/d10/d13/fc 0 2023-12-07T16:21:38.000 INFO:tasks.workunit.client.0.smithi063.stdout:1/232: truncate d0/f1 5433244 0 2023-12-07T16:21:38.000 INFO:tasks.workunit.client.0.smithi063.stdout:1/233: dread - d0/dd/d10/d1e/f52 zero size 2023-12-07T16:21:38.002 INFO:tasks.workunit.client.1.smithi152.stdout:7/486: dread db/d27/d39/d63/f77 [0,4194304] 0 2023-12-07T16:21:38.002 INFO:tasks.workunit.client.1.smithi152.stdout:7/487: truncate db/d27/f91 764929 0 2023-12-07T16:21:38.003 INFO:tasks.workunit.client.1.smithi152.stdout:1/635: dwrite dc/d14/d68/fc0 [0,4194304] 0 2023-12-07T16:21:38.003 INFO:tasks.workunit.client.1.smithi152.stdout:1/636: chown dc/d14/d18/d45/d74/fa7 14645 1 2023-12-07T16:21:38.004 INFO:tasks.workunit.client.1.smithi152.stdout:8/532: dread d3/d4/d9/f33 [0,4194304] 0 2023-12-07T16:21:38.005 INFO:tasks.workunit.client.1.smithi152.stdout:0/492: creat d0/d2f/d30/d6e/d77/fa6 x:0 0 0 2023-12-07T16:21:38.005 INFO:tasks.workunit.client.1.smithi152.stdout:0/493: write d0/dc/d26/f63 [990072,61854] 0 2023-12-07T16:21:38.005 INFO:tasks.workunit.client.1.smithi152.stdout:0/494: dread - d0/dc/d26/f41 zero size 2023-12-07T16:21:38.005 INFO:tasks.workunit.client.1.smithi152.stdout:0/495: write d0/dc/d36/d7d/f8a [5068875,122360] 0 2023-12-07T16:21:38.005 INFO:tasks.workunit.client.1.smithi152.stdout:2/490: truncate d2/d1c/d2e/d38/f3b 627613 0 2023-12-07T16:21:38.006 INFO:tasks.workunit.client.0.smithi063.stdout:4/262: dread d1/d3/f5 [0,4194304] 0 2023-12-07T16:21:38.006 INFO:tasks.workunit.client.0.smithi063.stdout:4/263: truncate d1/d3/db/d13/f48 160339 0 2023-12-07T16:21:38.006 INFO:tasks.workunit.client.0.smithi063.stdout:4/264: readlink d1/d3/db/l2d 0 2023-12-07T16:21:38.013 INFO:tasks.workunit.client.0.smithi063.stdout:1/234: getdents d0/dd/d10/d1e 0 2023-12-07T16:21:38.013 INFO:tasks.workunit.client.0.smithi063.stdout:1/235: truncate d0/dd/f39 4412828 0 2023-12-07T16:21:38.014 INFO:tasks.workunit.client.0.smithi063.stdout:4/265: rmdir d1/d3/d3a 39 2023-12-07T16:21:38.018 INFO:tasks.workunit.client.1.smithi152.stdout:7/488: creat db/d1c/f94 x:0 0 0 2023-12-07T16:21:38.019 INFO:tasks.workunit.client.1.smithi152.stdout:7/489: write db/f47 [4547578,128748] 0 2023-12-07T16:21:38.019 INFO:tasks.workunit.client.1.smithi152.stdout:7/490: dread - db/d68/f74 zero size 2023-12-07T16:21:38.022 INFO:tasks.workunit.client.1.smithi152.stdout:6/520: dread d2/d4f/d83/d85/de/f62 [0,4194304] 0 2023-12-07T16:21:38.024 INFO:tasks.workunit.client.1.smithi152.stdout:1/637: rename dc/d14/d18/d64/fa2 to dc/d14/d18/d2d/d48/da3/d58/fd1 0 2023-12-07T16:21:38.024 INFO:tasks.workunit.client.1.smithi152.stdout:1/638: chown dc/d14/d18/d2d/c78 111 1 2023-12-07T16:21:38.028 INFO:tasks.workunit.client.1.smithi152.stdout:0/496: symlink d0/dc/d26/la7 0 2023-12-07T16:21:38.028 INFO:tasks.workunit.client.0.smithi063.stdout:2/316: getdents d0/d1e 0 2023-12-07T16:21:38.029 INFO:tasks.workunit.client.0.smithi063.stdout:2/317: chown d0/d21/c35 1433 1 2023-12-07T16:21:38.029 INFO:tasks.workunit.client.0.smithi063.stdout:2/318: stat d0/d21/d56/c3b 0 2023-12-07T16:21:38.029 INFO:tasks.workunit.client.0.smithi063.stdout:5/299: dwrite d1/d3/de/f14 [0,4194304] 0 2023-12-07T16:21:38.030 INFO:tasks.workunit.client.0.smithi063.stdout:5/300: truncate d1/d38/f57 1032381 0 2023-12-07T16:21:38.031 INFO:tasks.workunit.client.0.smithi063.stdout:2/319: rename d0/d1e/d5c to d0/d67 0 2023-12-07T16:21:38.033 INFO:tasks.workunit.client.1.smithi152.stdout:7/491: rename db/f4a to db/f95 0 2023-12-07T16:21:38.033 INFO:tasks.workunit.client.1.smithi152.stdout:7/492: stat db/d27/d39/d41/d58 0 2023-12-07T16:21:38.033 INFO:tasks.workunit.client.1.smithi152.stdout:7/493: truncate db/d27/d4d/f88 684175 0 2023-12-07T16:21:38.033 INFO:tasks.workunit.client.0.smithi063.stdout:5/301: chown d1/d3/de/d1e/f27 10218 1 2023-12-07T16:21:38.033 INFO:tasks.workunit.client.0.smithi063.stdout:8/442: sync 2023-12-07T16:21:38.035 INFO:tasks.workunit.client.0.smithi063.stdout:2/320: mknod d0/d67/d5b/c68 0 2023-12-07T16:21:38.035 INFO:tasks.workunit.client.1.smithi152.stdout:6/521: creat d2/d4f/d83/d85/de/fa4 x:0 0 0 2023-12-07T16:21:38.035 INFO:tasks.workunit.client.1.smithi152.stdout:6/522: read d2/d4f/d83/d85/de/f62 [85296,6621] 0 2023-12-07T16:21:38.035 INFO:tasks.workunit.client.1.smithi152.stdout:6/523: dread - d2/d4f/d83/d85/de/fa4 zero size 2023-12-07T16:21:38.036 INFO:tasks.workunit.client.0.smithi063.stdout:5/302: truncate d1/f18 2550669 0 2023-12-07T16:21:38.036 INFO:tasks.workunit.client.0.smithi063.stdout:5/303: dread - d1/f5c zero size 2023-12-07T16:21:38.037 INFO:tasks.workunit.client.0.smithi063.stdout:2/321: write d0/d67/f55 [498719,70815] 0 2023-12-07T16:21:38.037 INFO:tasks.workunit.client.0.smithi063.stdout:2/322: chown d0/f14 7 1 2023-12-07T16:21:38.037 INFO:tasks.workunit.client.1.smithi152.stdout:8/533: rename d3/d4/d9/dc/d6f/d7a/d8a/f61 to d3/d4/d9/dc/d6f/d7a/d8a/d63/fbf 0 2023-12-07T16:21:38.037 INFO:tasks.workunit.client.0.smithi063.stdout:8/443: creat d7/d14/d1a/d54/d7e/f84 x:0 0 0 2023-12-07T16:21:38.039 INFO:tasks.workunit.client.1.smithi152.stdout:0/497: mknod d0/ca8 0 2023-12-07T16:21:38.039 INFO:tasks.workunit.client.0.smithi063.stdout:5/304: rename d1/d38/c45 to d1/d3/de/d1e/d25/c5d 0 2023-12-07T16:21:38.040 INFO:tasks.workunit.client.1.smithi152.stdout:9/526: dwrite d1/d17/d3c/d4a/d48/f59 [0,4194304] 0 2023-12-07T16:21:38.040 INFO:tasks.workunit.client.1.smithi152.stdout:9/527: readlink d1/d9/d2d/l44 0 2023-12-07T16:21:38.040 INFO:tasks.workunit.client.1.smithi152.stdout:9/528: write d1/d9/d2d/d46/f9c [978704,29942] 0 2023-12-07T16:21:38.041 INFO:tasks.workunit.client.0.smithi063.stdout:8/444: truncate f5 426455 0 2023-12-07T16:21:38.041 INFO:tasks.workunit.client.1.smithi152.stdout:6/524: creat d2/d4f/d83/d85/de/d45/fa5 x:0 0 0 2023-12-07T16:21:38.043 INFO:tasks.workunit.client.0.smithi063.stdout:4/266: dwrite d1/d3/db/d13/f48 [0,4194304] 0 2023-12-07T16:21:38.044 INFO:tasks.workunit.client.0.smithi063.stdout:4/267: chown d1/d3/db 24915 1 2023-12-07T16:21:38.045 INFO:tasks.workunit.client.1.smithi152.stdout:2/491: dwrite d2/f29 [0,4194304] 0 2023-12-07T16:21:38.045 INFO:tasks.workunit.client.1.smithi152.stdout:8/534: creat d3/d1e/d43/dbc/fc0 x:0 0 0 2023-12-07T16:21:38.046 INFO:tasks.workunit.client.0.smithi063.stdout:7/305: sync 2023-12-07T16:21:38.046 INFO:tasks.workunit.client.0.smithi063.stdout:3/262: sync 2023-12-07T16:21:38.046 INFO:tasks.workunit.client.0.smithi063.stdout:5/305: read d1/d3/de/f14 [4102944,117138] 0 2023-12-07T16:21:38.047 INFO:tasks.workunit.client.0.smithi063.stdout:0/391: sync 2023-12-07T16:21:38.047 INFO:tasks.workunit.client.0.smithi063.stdout:0/392: write d4/d25/f2f [4320843,118783] 0 2023-12-07T16:21:38.047 INFO:tasks.workunit.client.0.smithi063.stdout:6/340: dwrite d0/d1e/d2a/f52 [0,4194304] 0 2023-12-07T16:21:38.047 INFO:tasks.workunit.client.0.smithi063.stdout:6/341: write d0/f1b [1131276,126572] 0 2023-12-07T16:21:38.048 INFO:tasks.workunit.client.0.smithi063.stdout:8/445: creat d7/d14/d4e/f85 x:0 0 0 2023-12-07T16:21:38.048 INFO:tasks.workunit.client.1.smithi152.stdout:1/639: dwrite dc/d14/d18/d2d/d4a/d52/f73 [0,4194304] 0 2023-12-07T16:21:38.052 INFO:tasks.workunit.client.1.smithi152.stdout:9/529: creat d1/d17/d3c/d4a/d48/fb5 x:0 0 0 2023-12-07T16:21:38.054 INFO:tasks.workunit.client.0.smithi063.stdout:4/268: unlink d1/d3/c3b 0 2023-12-07T16:21:38.054 INFO:tasks.workunit.client.0.smithi063.stdout:4/269: write d1/d3/db/d13/f2a [1362241,84445] 0 2023-12-07T16:21:38.055 INFO:tasks.workunit.client.0.smithi063.stdout:4/270: chown d1/d3/db/f38 0 1 2023-12-07T16:21:38.055 INFO:tasks.workunit.client.1.smithi152.stdout:6/525: mknod d2/d4f/d83/d85/de/d2e/d38/d9d/ca6 0 2023-12-07T16:21:38.055 INFO:tasks.workunit.client.1.smithi152.stdout:6/526: chown d2/d4f/d83/d85 586 1 2023-12-07T16:21:38.056 INFO:tasks.workunit.client.0.smithi063.stdout:3/263: mkdir d7/d4f 0 2023-12-07T16:21:38.056 INFO:tasks.workunit.client.0.smithi063.stdout:3/264: rename d7/d9/d2b/d41 to d7/d9/d2b/d41/d50 22 2023-12-07T16:21:38.057 INFO:tasks.workunit.client.0.smithi063.stdout:5/306: mkdir d1/d38/d5e 0 2023-12-07T16:21:38.058 INFO:tasks.workunit.client.1.smithi152.stdout:2/492: mknod d2/d1c/d2e/d30/caa 0 2023-12-07T16:21:38.060 INFO:tasks.workunit.client.1.smithi152.stdout:8/535: mknod d3/d4/d9/dc/d6f/d7a/d8a/d63/d7c/cc1 0 2023-12-07T16:21:38.061 INFO:tasks.workunit.client.0.smithi063.stdout:0/393: mknod d4/dd/de/d15/d1f/d61/c7f 0 2023-12-07T16:21:38.061 INFO:tasks.workunit.client.0.smithi063.stdout:0/394: dread - d4/dd/de/d15/d52/f53 zero size 2023-12-07T16:21:38.065 INFO:tasks.workunit.client.1.smithi152.stdout:8/536: rmdir d3/d1e/d43 39 2023-12-07T16:21:38.065 INFO:tasks.workunit.client.1.smithi152.stdout:8/537: write d3/d4/d9/d34/d5f/fab [15905,16794] 0 2023-12-07T16:21:38.065 INFO:tasks.workunit.client.1.smithi152.stdout:8/538: dread - d3/d1e/d43/dbc/fc0 zero size 2023-12-07T16:21:38.067 INFO:tasks.workunit.client.0.smithi063.stdout:6/342: creat d0/d1e/d20/d4a/f7a x:0 0 0 2023-12-07T16:21:38.068 INFO:tasks.workunit.client.0.smithi063.stdout:7/306: symlink d2/d37/l77 0 2023-12-07T16:21:38.068 INFO:tasks.workunit.client.0.smithi063.stdout:7/307: getdents d2/d34/d46/d48/d70 0 2023-12-07T16:21:38.068 INFO:tasks.workunit.client.0.smithi063.stdout:8/446: dread d7/d14/d1a/f74 [0,4194304] 0 2023-12-07T16:21:38.070 INFO:tasks.workunit.client.1.smithi152.stdout:2/493: dread d2/d1c/d2e/d30/d33/f2d [0,4194304] 0 2023-12-07T16:21:38.070 INFO:tasks.workunit.client.1.smithi152.stdout:2/494: fdatasync d2/d1c/d2e/d57/d5b/da7/f88 0 2023-12-07T16:21:38.071 INFO:tasks.workunit.client.0.smithi063.stdout:3/265: link d7/d9/dd/f1c d7/f51 0 2023-12-07T16:21:38.071 INFO:tasks.workunit.client.0.smithi063.stdout:5/307: truncate d1/d3/de/d1e/f27 28155 0 2023-12-07T16:21:38.072 INFO:tasks.workunit.client.0.smithi063.stdout:4/271: dread d1/d3/db/d13/f33 [0,4194304] 0 2023-12-07T16:21:38.072 INFO:tasks.workunit.client.0.smithi063.stdout:4/272: readlink d1/d3/d3a/l42 0 2023-12-07T16:21:38.072 INFO:tasks.workunit.client.0.smithi063.stdout:4/273: chown d1/d3 230 1 2023-12-07T16:21:38.072 INFO:tasks.workunit.client.1.smithi152.stdout:8/539: mknod d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/d7d/cc2 0 2023-12-07T16:21:38.075 INFO:tasks.workunit.client.1.smithi152.stdout:2/495: rmdir d2/d1c/d2e/d57 39 2023-12-07T16:21:38.075 INFO:tasks.workunit.client.1.smithi152.stdout:2/496: truncate d2/f29 4311428 0 2023-12-07T16:21:38.075 INFO:tasks.workunit.client.0.smithi063.stdout:8/447: creat d7/d14/d15/d2b/d40/d63/d75/f86 x:0 0 0 2023-12-07T16:21:38.076 INFO:tasks.workunit.client.0.smithi063.stdout:7/308: unlink d2/d34/d5a/d5f/f20 0 2023-12-07T16:21:38.076 INFO:tasks.workunit.client.0.smithi063.stdout:3/266: rename d7/d9/d1b/l23 to d7/d9/l52 0 2023-12-07T16:21:38.076 INFO:tasks.workunit.client.0.smithi063.stdout:3/267: dread - d7/d9/dd/f2e zero size 2023-12-07T16:21:38.077 INFO:tasks.workunit.client.1.smithi152.stdout:8/540: unlink d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/d7d/cc2 0 2023-12-07T16:21:38.078 INFO:tasks.workunit.client.0.smithi063.stdout:0/395: dread d4/dd/de/d15/d1f/d22/f23 [0,4194304] 0 2023-12-07T16:21:38.079 INFO:tasks.workunit.client.1.smithi152.stdout:8/541: mkdir d3/d4/d9/d23/d4c/da6/db2/dc3 0 2023-12-07T16:21:38.080 INFO:tasks.workunit.client.0.smithi063.stdout:4/274: creat d1/d3/d3f/d44/f4c x:0 0 0 2023-12-07T16:21:38.081 INFO:tasks.workunit.client.1.smithi152.stdout:6/527: dread d2/d4f/d83/d85/de/d2e/f41 [0,4194304] 0 2023-12-07T16:21:38.082 INFO:tasks.workunit.client.0.smithi063.stdout:8/448: unlink d7/d14/d1a/c72 0 2023-12-07T16:21:38.083 INFO:tasks.workunit.client.0.smithi063.stdout:3/268: dread d7/f51 [0,4194304] 0 2023-12-07T16:21:38.083 INFO:tasks.workunit.client.0.smithi063.stdout:2/323: dwrite d0/f44 [0,4194304] 0 2023-12-07T16:21:38.083 INFO:tasks.workunit.client.0.smithi063.stdout:2/324: fdatasync d0/d21/f2a 0 2023-12-07T16:21:38.084 INFO:tasks.workunit.client.0.smithi063.stdout:7/309: mkdir d2/d34/d5a/d5f/d78 0 2023-12-07T16:21:38.084 INFO:tasks.workunit.client.0.smithi063.stdout:7/310: truncate d2/d34/f3b 328190 0 2023-12-07T16:21:38.084 INFO:tasks.workunit.client.0.smithi063.stdout:5/308: symlink d1/d3/de/d1e/l5f 0 2023-12-07T16:21:38.084 INFO:tasks.workunit.client.1.smithi152.stdout:8/542: mkdir d3/d4/d9/dc/d6f/d7b/dbd/dc4 0 2023-12-07T16:21:38.084 INFO:tasks.workunit.client.1.smithi152.stdout:0/498: dwrite d0/d27/d11/f72 [0,4194304] 0 2023-12-07T16:21:38.085 INFO:tasks.workunit.client.1.smithi152.stdout:8/543: read d3/d4/d4b/f78 [21934,37597] 0 2023-12-07T16:21:38.086 INFO:tasks.workunit.client.0.smithi063.stdout:3/269: mkdir d7/d4f/d53 0 2023-12-07T16:21:38.088 INFO:tasks.workunit.client.1.smithi152.stdout:6/528: mkdir d2/d4f/d83/d48/d70/da7 0 2023-12-07T16:21:38.089 INFO:tasks.workunit.client.0.smithi063.stdout:3/270: mkdir d7/d4f/d53/d54 0 2023-12-07T16:21:38.091 INFO:tasks.workunit.client.0.smithi063.stdout:2/325: creat d0/d21/f69 x:0 0 0 2023-12-07T16:21:38.093 INFO:tasks.workunit.client.1.smithi152.stdout:0/499: creat d0/dc/d36/d7d/d92/fa9 x:0 0 0 2023-12-07T16:21:38.094 INFO:tasks.workunit.client.0.smithi063.stdout:3/271: link f5 d7/d4f/f55 0 2023-12-07T16:21:38.095 INFO:tasks.workunit.client.1.smithi152.stdout:8/544: mkdir d3/d1e/d55/d83/dc5 0 2023-12-07T16:21:38.095 INFO:tasks.workunit.client.1.smithi152.stdout:8/545: chown d3/d4/d9/d23/l47 31559 1 2023-12-07T16:21:38.096 INFO:tasks.workunit.client.0.smithi063.stdout:2/326: mkdir d0/d67/d65/d6a 0 2023-12-07T16:21:38.096 INFO:tasks.workunit.client.1.smithi152.stdout:0/500: rename d0/c93 to d0/dc/d36/d7d/caa 0 2023-12-07T16:21:38.098 INFO:tasks.workunit.client.1.smithi152.stdout:8/546: creat d3/d4/d9/d23/fc6 x:0 0 0 2023-12-07T16:21:38.098 INFO:tasks.workunit.client.1.smithi152.stdout:9/530: dwrite d1/d17/d3c/d4a/d7e/f9f [0,4194304] 0 2023-12-07T16:21:38.099 INFO:tasks.workunit.client.1.smithi152.stdout:2/497: dread d2/d9/f2f [0,4194304] 0 2023-12-07T16:21:38.100 INFO:tasks.workunit.client.0.smithi063.stdout:3/272: mkdir d7/d9/dd/d56 0 2023-12-07T16:21:38.101 INFO:tasks.workunit.client.0.smithi063.stdout:7/311: dread d2/d34/d5a/d5f/d2a/f31 [4194304,4194304] 0 2023-12-07T16:21:38.101 INFO:tasks.workunit.client.0.smithi063.stdout:7/312: chown d2/d34/d5a/d5f/d2a/f2f 19372 1 2023-12-07T16:21:38.101 INFO:tasks.workunit.client.0.smithi063.stdout:2/327: creat d0/d21/d56/d11/d52/d63/f6b x:0 0 0 2023-12-07T16:21:38.104 INFO:tasks.workunit.client.1.smithi152.stdout:7/494: dwrite db/d68/d87/f8c [0,4194304] 0 2023-12-07T16:21:38.106 INFO:tasks.workunit.client.1.smithi152.stdout:1/640: dwrite dc/f63 [0,4194304] 0 2023-12-07T16:21:38.108 INFO:tasks.workunit.client.0.smithi063.stdout:7/313: mknod d2/d34/d46/d48/d56/c79 0 2023-12-07T16:21:38.108 INFO:tasks.workunit.client.0.smithi063.stdout:3/273: unlink d7/d9/d2b/f4e 0 2023-12-07T16:21:38.109 INFO:tasks.workunit.client.0.smithi063.stdout:3/274: write d7/d9/f40 [207264,96751] 0 2023-12-07T16:21:38.111 INFO:tasks.workunit.client.1.smithi152.stdout:1/641: getdents dc/d14/d68 0 2023-12-07T16:21:38.115 INFO:tasks.workunit.client.0.smithi063.stdout:7/314: truncate d2/d34/d5a/d5f/f16 7557038 0 2023-12-07T16:21:38.120 INFO:tasks.workunit.client.1.smithi152.stdout:9/531: dread d1/d17/d3c/d4a/d48/f52 [0,4194304] 0 2023-12-07T16:21:38.120 INFO:tasks.workunit.client.1.smithi152.stdout:9/532: read - d1/d17/d4e/fa8 zero size 2023-12-07T16:21:38.121 INFO:tasks.workunit.client.1.smithi152.stdout:9/533: chown d1/d9/db/df/f50 24 1 2023-12-07T16:21:38.123 INFO:tasks.workunit.client.1.smithi152.stdout:9/534: mknod d1/d9/d2d/cb6 0 2023-12-07T16:21:38.123 INFO:tasks.workunit.client.1.smithi152.stdout:8/547: dread d3/d4/d9/dc/d6f/d7a/d8a/f31 [0,4194304] 0 2023-12-07T16:21:38.125 INFO:tasks.workunit.client.1.smithi152.stdout:9/535: creat d1/d17/fb7 x:0 0 0 2023-12-07T16:21:38.125 INFO:tasks.workunit.client.1.smithi152.stdout:9/536: truncate d1/d9/d2d/d65/f6f 492977 0 2023-12-07T16:21:38.127 INFO:tasks.workunit.client.1.smithi152.stdout:9/537: dread d1/f3a [0,4194304] 0 2023-12-07T16:21:38.129 INFO:tasks.workunit.client.1.smithi152.stdout:8/548: write d3/d4/d9/dc/d6f/d7b/d7e/f9a [2692677,76847] 0 2023-12-07T16:21:38.130 INFO:tasks.workunit.client.1.smithi152.stdout:9/538: unlink d1/d17/d4e/d5a/l75 0 2023-12-07T16:21:38.131 INFO:tasks.workunit.client.0.smithi063.stdout:0/396: dwrite d4/dd/de/d15/f18 [0,4194304] 0 2023-12-07T16:21:38.136 INFO:tasks.workunit.client.1.smithi152.stdout:9/539: rename d1/d17/d4e/fa8 to d1/d17/d58/d86/fb8 0 2023-12-07T16:21:38.139 INFO:tasks.workunit.client.1.smithi152.stdout:0/501: fdatasync d0/dc/d36/d7d/f8a 0 2023-12-07T16:21:38.141 INFO:tasks.workunit.client.1.smithi152.stdout:0/502: mkdir d0/dc/d3d/dab 0 2023-12-07T16:21:38.143 INFO:tasks.workunit.client.0.smithi063.stdout:6/343: dwrite d0/d1e/d2a/f52 [0,4194304] 0 2023-12-07T16:21:38.146 INFO:tasks.workunit.client.0.smithi063.stdout:6/344: symlink d0/d17/d1a/d38/l7b 0 2023-12-07T16:21:38.149 INFO:tasks.workunit.client.0.smithi063.stdout:6/345: rename d0/d1e/d2a/c5e to d0/d17/d1a/d38/c7c 0 2023-12-07T16:21:38.152 INFO:tasks.workunit.client.0.smithi063.stdout:6/346: write d0/f1b [177088,62971] 0 2023-12-07T16:21:38.153 INFO:tasks.workunit.client.1.smithi152.stdout:6/529: dwrite d2/d4f/d83/d85/d19/f46 [0,4194304] 0 2023-12-07T16:21:38.158 INFO:tasks.workunit.client.0.smithi063.stdout:6/347: unlink d0/d1e/d1d/l37 0 2023-12-07T16:21:38.158 INFO:tasks.workunit.client.0.smithi063.stdout:6/348: read - d0/d1e/d60/d68/d76/f77 zero size 2023-12-07T16:21:38.159 INFO:tasks.workunit.client.0.smithi063.stdout:6/349: getdents d0/d1e/d60 0 2023-12-07T16:21:38.160 INFO:tasks.workunit.client.0.smithi063.stdout:6/350: mkdir d0/d1e/d60/d68/d69/d7d 0 2023-12-07T16:21:38.161 INFO:tasks.workunit.client.0.smithi063.stdout:6/351: rmdir d0/d1e/d20 39 2023-12-07T16:21:38.162 INFO:tasks.workunit.client.0.smithi063.stdout:6/352: creat d0/d1e/d60/d68/f7e x:0 0 0 2023-12-07T16:21:38.162 INFO:tasks.workunit.client.0.smithi063.stdout:6/353: creat d0/d17/d46/f7f x:0 0 0 2023-12-07T16:21:38.163 INFO:tasks.workunit.client.0.smithi063.stdout:6/354: truncate d0/f8 5001940 0 2023-12-07T16:21:38.163 INFO:tasks.workunit.client.0.smithi063.stdout:6/355: write d0/d17/d46/f55 [1029386,120968] 0 2023-12-07T16:21:38.164 INFO:tasks.workunit.client.0.smithi063.stdout:6/356: rename d0/d17/d46/f59 to d0/d1e/d60/d68/d69/d7d/f80 0 2023-12-07T16:21:38.165 INFO:tasks.workunit.client.0.smithi063.stdout:8/449: dwrite d7/d14/f4f [0,4194304] 0 2023-12-07T16:21:38.168 INFO:tasks.workunit.client.1.smithi152.stdout:6/530: read d2/d4f/d83/d85/de/d45/f6e [433542,34782] 0 2023-12-07T16:21:38.170 INFO:tasks.workunit.client.1.smithi152.stdout:6/531: mkdir d2/d4f/d83/d48/da8 0 2023-12-07T16:21:38.172 INFO:tasks.workunit.client.1.smithi152.stdout:6/532: mknod d2/d4f/d83/d85/de/d2e/d38/d9d/ca9 0 2023-12-07T16:21:38.183 INFO:tasks.workunit.client.1.smithi152.stdout:1/642: dwrite dc/d14/d18/d2d/d48/da3/f77 [0,4194304] 0 2023-12-07T16:21:38.185 INFO:tasks.workunit.client.1.smithi152.stdout:1/643: dread dc/d14/d18/d79/d86/fa0 [0,4194304] 0 2023-12-07T16:21:38.185 INFO:tasks.workunit.client.1.smithi152.stdout:2/498: dwrite d2/d1c/d2e/d57/d5b/da7/f55 [0,4194304] 0 2023-12-07T16:21:38.185 INFO:tasks.workunit.client.1.smithi152.stdout:2/499: write d2/d9/f48 [1349125,72059] 0 2023-12-07T16:21:38.187 INFO:tasks.workunit.client.0.smithi063.stdout:4/275: dwrite d1/d3/db/d13/f45 [0,4194304] 0 2023-12-07T16:21:38.187 INFO:tasks.workunit.client.0.smithi063.stdout:4/276: stat d1/d3/db/c2b 0 2023-12-07T16:21:38.187 INFO:tasks.workunit.client.1.smithi152.stdout:1/644: link dc/d14/d18/f70 dc/d14/d18/d2d/d48/da3/dbf/fd2 0 2023-12-07T16:21:38.194 INFO:tasks.workunit.client.0.smithi063.stdout:4/277: link d1/d3/db/d16/c3c d1/d3/db/d41/c4d 0 2023-12-07T16:21:38.194 INFO:tasks.workunit.client.0.smithi063.stdout:4/278: truncate d1/d3/f36 5236940 0 2023-12-07T16:21:38.194 INFO:tasks.workunit.client.0.smithi063.stdout:4/279: creat d1/d3/f4e x:0 0 0 2023-12-07T16:21:38.195 INFO:tasks.workunit.client.0.smithi063.stdout:4/280: creat d1/d3/db/f4f x:0 0 0 2023-12-07T16:21:38.196 INFO:tasks.workunit.client.0.smithi063.stdout:4/281: rmdir d1/d3/d3f 39 2023-12-07T16:21:38.197 INFO:tasks.workunit.client.0.smithi063.stdout:4/282: rmdir d1/d3/d3f/d49/d4b 0 2023-12-07T16:21:38.197 INFO:tasks.workunit.client.0.smithi063.stdout:4/283: chown d1/d3/db/d16/c3c 1 1 2023-12-07T16:21:38.197 INFO:tasks.workunit.client.0.smithi063.stdout:4/284: truncate d1/f34 191689 0 2023-12-07T16:21:38.199 INFO:tasks.workunit.client.1.smithi152.stdout:2/500: mkdir d2/d1c/d2e/d5d/dab 0 2023-12-07T16:21:38.200 INFO:tasks.workunit.client.1.smithi152.stdout:1/645: creat dc/d14/fd3 x:0 0 0 2023-12-07T16:21:38.200 INFO:tasks.workunit.client.1.smithi152.stdout:1/646: chown dc/d28/f5e 9575 1 2023-12-07T16:21:38.200 INFO:tasks.workunit.client.1.smithi152.stdout:1/647: truncate dc/d14/d18/f35 1293644 0 2023-12-07T16:21:38.200 INFO:tasks.workunit.client.1.smithi152.stdout:1/648: write dc/d14/d90/fac [1010174,6546] 0 2023-12-07T16:21:38.200 INFO:tasks.workunit.client.1.smithi152.stdout:2/501: creat d2/d1c/d2e/d38/d90/fac x:0 0 0 2023-12-07T16:21:38.203 INFO:tasks.workunit.client.0.smithi063.stdout:2/328: dwrite d0/d67/d5b/f64 [0,4194304] 0 2023-12-07T16:21:38.203 INFO:tasks.workunit.client.1.smithi152.stdout:9/540: dwrite d1/d17/d3c/fa0 [0,4194304] 0 2023-12-07T16:21:38.203 INFO:tasks.workunit.client.0.smithi063.stdout:5/309: dwrite d1/d3/f17 [0,4194304] 0 2023-12-07T16:21:38.204 INFO:tasks.workunit.client.1.smithi152.stdout:6/533: dwrite d2/d4f/d83/d85/de/d45/f6e [0,4194304] 0 2023-12-07T16:21:38.205 INFO:tasks.workunit.client.0.smithi063.stdout:6/357: dwrite d0/d1e/d60/d68/f70 [0,4194304] 0 2023-12-07T16:21:38.206 INFO:tasks.workunit.client.0.smithi063.stdout:3/275: dwrite d7/d4f/f55 [0,4194304] 0 2023-12-07T16:21:38.207 INFO:tasks.workunit.client.1.smithi152.stdout:7/495: dwrite db/f18 [0,4194304] 0 2023-12-07T16:21:38.207 INFO:tasks.workunit.client.1.smithi152.stdout:0/503: dwrite d0/d2f/d30/d6e/d77/f96 [0,4194304] 0 2023-12-07T16:21:38.207 INFO:tasks.workunit.client.1.smithi152.stdout:0/504: fdatasync d0/d2f/f52 0 2023-12-07T16:21:38.207 INFO:tasks.workunit.client.1.smithi152.stdout:8/549: dwrite d3/f1d [0,4194304] 0 2023-12-07T16:21:38.207 INFO:tasks.workunit.client.1.smithi152.stdout:1/649: rename dc/d14/d18/d2d/d48/f97 to dc/d14/d18/d2d/d4a/fd4 0 2023-12-07T16:21:38.208 INFO:tasks.workunit.client.0.smithi063.stdout:8/450: dwrite d7/d14/d1a/d54/f5b [4194304,4194304] 0 2023-12-07T16:21:38.208 INFO:tasks.workunit.client.0.smithi063.stdout:0/397: dwrite d4/f5 [0,4194304] 0 2023-12-07T16:21:38.208 INFO:tasks.workunit.client.0.smithi063.stdout:0/398: stat d4/dd/d26/f70 0 2023-12-07T16:21:38.208 INFO:tasks.workunit.client.0.smithi063.stdout:2/329: link d0/d21/f45 d0/d21/d56/d11/d52/d63/f6c 0 2023-12-07T16:21:38.208 INFO:tasks.workunit.client.0.smithi063.stdout:2/330: chown d0/d21/d56/d11/f23 10 1 2023-12-07T16:21:38.208 INFO:tasks.workunit.client.0.smithi063.stdout:2/331: stat d0/d4a/f54 0 2023-12-07T16:21:38.208 INFO:tasks.workunit.client.0.smithi063.stdout:2/332: stat d0/d21/d56/d11/f3c 0 2023-12-07T16:21:38.210 INFO:tasks.workunit.client.1.smithi152.stdout:2/502: creat d2/d56/da0/fad x:0 0 0 2023-12-07T16:21:38.210 INFO:tasks.workunit.client.0.smithi063.stdout:6/358: dread d0/d17/d46/f50 [0,4194304] 0 2023-12-07T16:21:38.213 INFO:tasks.workunit.client.1.smithi152.stdout:9/541: mknod d1/d9/d2d/cb9 0 2023-12-07T16:21:38.214 INFO:tasks.workunit.client.0.smithi063.stdout:8/451: write d7/d38/f3b [3709951,58008] 0 2023-12-07T16:21:38.215 INFO:tasks.workunit.client.1.smithi152.stdout:6/534: symlink d2/d4f/d83/d85/d65/laa 0 2023-12-07T16:21:38.215 INFO:tasks.workunit.client.1.smithi152.stdout:2/503: dread d2/d1c/f41 [0,4194304] 0 2023-12-07T16:21:38.217 INFO:tasks.workunit.client.0.smithi063.stdout:3/276: symlink d7/d4f/d53/d54/l57 0 2023-12-07T16:21:38.221 INFO:tasks.workunit.client.1.smithi152.stdout:2/504: write d2/d1c/d2e/d38/d90/f4b [3839162,26607] 0 2023-12-07T16:21:38.221 INFO:tasks.workunit.client.1.smithi152.stdout:2/505: write d2/d1c/d2e/d57/f9f [4615637,124402] 0 2023-12-07T16:21:38.221 INFO:tasks.workunit.client.0.smithi063.stdout:2/333: mkdir d0/d21/d56/d11/d6d 0 2023-12-07T16:21:38.223 INFO:tasks.workunit.client.0.smithi063.stdout:6/359: creat d0/d1e/f81 x:0 0 0 2023-12-07T16:21:38.223 INFO:tasks.workunit.client.1.smithi152.stdout:2/506: write f1 [3281462,5842] 0 2023-12-07T16:21:38.226 INFO:tasks.workunit.client.0.smithi063.stdout:8/452: rename d7/d14/d15/d2b/c2e to d7/d14/d4e/c87 0 2023-12-07T16:21:38.229 INFO:tasks.workunit.client.1.smithi152.stdout:8/550: unlink d3/d4/d4b/f78 0 2023-12-07T16:21:38.229 INFO:tasks.workunit.client.1.smithi152.stdout:8/551: chown d3/d4/d9/d34/faf 10169 1 2023-12-07T16:21:38.232 INFO:tasks.workunit.client.1.smithi152.stdout:7/496: rename db/l92 to db/d27/d39/d41/d58/l96 0 2023-12-07T16:21:38.232 INFO:tasks.workunit.client.0.smithi063.stdout:3/277: rename d7/d9/f26 to d7/d4f/d53/d54/f58 0 2023-12-07T16:21:38.232 INFO:tasks.workunit.client.0.smithi063.stdout:8/453: creat d7/d14/d1a/d54/d7e/f88 x:0 0 0 2023-12-07T16:21:38.233 INFO:tasks.workunit.client.1.smithi152.stdout:1/650: rmdir dc/d14/d18/d2d/d91 39 2023-12-07T16:21:38.234 INFO:tasks.workunit.client.1.smithi152.stdout:2/507: write d2/d1c/d2e/f46 [3080397,93006] 0 2023-12-07T16:21:38.235 INFO:tasks.workunit.client.0.smithi063.stdout:5/310: dwrite d1/f34 [0,4194304] 0 2023-12-07T16:21:38.235 INFO:tasks.workunit.client.0.smithi063.stdout:5/311: fsync d1/d3/de/d1e/f27 0 2023-12-07T16:21:38.236 INFO:tasks.workunit.client.1.smithi152.stdout:9/542: symlink d1/d17/d4e/d5a/lba 0 2023-12-07T16:21:38.236 INFO:tasks.workunit.client.0.smithi063.stdout:2/334: truncate d0/fa 3845764 0 2023-12-07T16:21:38.236 INFO:tasks.workunit.client.0.smithi063.stdout:3/278: rename d7/c39 to d7/d4f/d53/c59 0 2023-12-07T16:21:38.236 INFO:tasks.workunit.client.0.smithi063.stdout:3/279: readlink d7/d9/d2b/l3e 0 2023-12-07T16:21:38.237 INFO:tasks.workunit.client.0.smithi063.stdout:4/285: dwrite d1/d3/f8 [4194304,4194304] 0 2023-12-07T16:21:38.237 INFO:tasks.workunit.client.0.smithi063.stdout:8/454: creat d7/d14/d1a/f89 x:0 0 0 2023-12-07T16:21:38.237 INFO:tasks.workunit.client.0.smithi063.stdout:8/455: chown d7 1 1 2023-12-07T16:21:38.237 INFO:tasks.workunit.client.1.smithi152.stdout:0/505: creat d0/dc/d36/d3a/d51/d82/fac x:0 0 0 2023-12-07T16:21:38.238 INFO:tasks.workunit.client.0.smithi063.stdout:5/312: symlink d1/d31/d56/l60 0 2023-12-07T16:21:38.240 INFO:tasks.workunit.client.1.smithi152.stdout:8/552: symlink d3/d4/d9/dc/d6f/d7a/d8a/d63/d7c/lc7 0 2023-12-07T16:21:38.240 INFO:tasks.workunit.client.0.smithi063.stdout:2/335: creat d0/d4a/f6e x:0 0 0 2023-12-07T16:21:38.240 INFO:tasks.workunit.client.0.smithi063.stdout:2/336: fsync d0/d21/d56/d11/d52/d5d/f5f 0 2023-12-07T16:21:38.240 INFO:tasks.workunit.client.0.smithi063.stdout:2/337: fsync d0/d21/f37 0 2023-12-07T16:21:38.241 INFO:tasks.workunit.client.1.smithi152.stdout:7/497: symlink db/l97 0 2023-12-07T16:21:38.242 INFO:tasks.workunit.client.1.smithi152.stdout:7/498: chown db/d27/d39/d63 6531 1 2023-12-07T16:21:38.242 INFO:tasks.workunit.client.1.smithi152.stdout:1/651: write dc/d14/d18/d2d/f33 [3792859,10156] 0 2023-12-07T16:21:38.242 INFO:tasks.workunit.client.1.smithi152.stdout:1/652: fsync f9 0 2023-12-07T16:21:38.242 INFO:tasks.workunit.client.0.smithi063.stdout:8/456: unlink d7/d14/d15/c34 0 2023-12-07T16:21:38.242 INFO:tasks.workunit.client.0.smithi063.stdout:8/457: readlink d7/d14/d15/l19 0 2023-12-07T16:21:38.244 INFO:tasks.workunit.client.1.smithi152.stdout:2/508: symlink d2/d1c/d2e/d30/d33/lae 0 2023-12-07T16:21:38.245 INFO:tasks.workunit.client.1.smithi152.stdout:9/543: unlink d1/d17/d3c/d4a/d48/fb5 0 2023-12-07T16:21:38.245 INFO:tasks.workunit.client.1.smithi152.stdout:9/544: chown d1/d9/d2d/d46/d9a/f9e 181778 1 2023-12-07T16:21:38.245 INFO:tasks.workunit.client.0.smithi063.stdout:8/458: rename d7/d14/d15/f2f to d7/d38/d73/f8a 0 2023-12-07T16:21:38.247 INFO:tasks.workunit.client.1.smithi152.stdout:8/553: creat d3/fc8 x:0 0 0 2023-12-07T16:21:38.247 INFO:tasks.workunit.client.1.smithi152.stdout:8/554: truncate d3/f1a 2305733 0 2023-12-07T16:21:38.248 INFO:tasks.workunit.client.0.smithi063.stdout:6/360: dwrite d0/d17/d1a/d38/f75 [0,4194304] 0 2023-12-07T16:21:38.249 INFO:tasks.workunit.client.1.smithi152.stdout:7/499: getdents db/d27/d5e/d45 0 2023-12-07T16:21:38.252 INFO:tasks.workunit.client.1.smithi152.stdout:1/653: write dc/f63 [3047076,33363] 0 2023-12-07T16:21:38.255 INFO:tasks.workunit.client.0.smithi063.stdout:2/338: dread d0/f14 [0,4194304] 0 2023-12-07T16:21:38.256 INFO:tasks.workunit.client.0.smithi063.stdout:2/339: dread - d0/d21/d56/d11/d52/d63/f6b zero size 2023-12-07T16:21:38.256 INFO:tasks.workunit.client.0.smithi063.stdout:6/361: creat d0/d17/d1a/d4d/f82 x:0 0 0 2023-12-07T16:21:38.257 INFO:tasks.workunit.client.0.smithi063.stdout:3/280: dread d7/d9/dd/f2a [0,4194304] 0 2023-12-07T16:21:38.257 INFO:tasks.workunit.client.0.smithi063.stdout:5/313: dread d1/f32 [0,4194304] 0 2023-12-07T16:21:38.257 INFO:tasks.workunit.client.0.smithi063.stdout:2/340: write d0/d21/f37 [325072,73901] 0 2023-12-07T16:21:38.259 INFO:tasks.workunit.client.0.smithi063.stdout:6/362: mknod d0/d1e/d1d/d1f/c83 0 2023-12-07T16:21:38.259 INFO:tasks.workunit.client.0.smithi063.stdout:6/363: fsync d0/d1e/d60/d68/d76/f77 0 2023-12-07T16:21:38.259 INFO:tasks.workunit.client.0.smithi063.stdout:6/364: fdatasync d0/d54/f5f 0 2023-12-07T16:21:38.259 INFO:tasks.workunit.client.1.smithi152.stdout:0/506: rename d0/dc/d36/d3a/d51/f61 to d0/dc/d36/d3a/d69/fad 0 2023-12-07T16:21:38.259 INFO:tasks.workunit.client.1.smithi152.stdout:9/545: dread d1/d9/db/df/f43 [0,4194304] 0 2023-12-07T16:21:38.261 INFO:tasks.workunit.client.1.smithi152.stdout:8/555: creat d3/d4/d9/dc/d6f/fc9 x:0 0 0 2023-12-07T16:21:38.264 INFO:tasks.workunit.client.1.smithi152.stdout:1/654: creat dc/d14/d18/d79/d86/fd5 x:0 0 0 2023-12-07T16:21:38.270 INFO:tasks.workunit.client.0.smithi063.stdout:5/314: rename d1/d38 to d1/d31/d56/d61 0 2023-12-07T16:21:38.270 INFO:tasks.workunit.client.0.smithi063.stdout:3/281: creat d7/d9/d2b/d41/f5a x:0 0 0 2023-12-07T16:21:38.270 INFO:tasks.workunit.client.0.smithi063.stdout:2/341: mknod d0/d21/c6f 0 2023-12-07T16:21:38.271 INFO:tasks.workunit.client.1.smithi152.stdout:0/507: fsync d0/dc/d36/d3a/d51/f7a 0 2023-12-07T16:21:38.274 INFO:tasks.workunit.client.1.smithi152.stdout:2/509: dread d2/ff [0,4194304] 0 2023-12-07T16:21:38.276 INFO:tasks.workunit.client.1.smithi152.stdout:0/508: unlink d0/dc/d36/d3a/d51/c57 0 2023-12-07T16:21:38.276 INFO:tasks.workunit.client.1.smithi152.stdout:8/556: dread d3/d4/d9/d23/f36 [0,4194304] 0 2023-12-07T16:21:38.276 INFO:tasks.workunit.client.1.smithi152.stdout:8/557: readlink d3/d1e/d40/l5a 0 2023-12-07T16:21:38.277 INFO:tasks.workunit.client.0.smithi063.stdout:2/342: creat d0/d21/d56/f70 x:0 0 0 2023-12-07T16:21:38.278 INFO:tasks.workunit.client.0.smithi063.stdout:2/343: fdatasync d0/d21/d56/d11/d52/d63/f6b 0 2023-12-07T16:21:38.278 INFO:tasks.workunit.client.0.smithi063.stdout:8/459: dwrite d7/d14/d15/d2b/d40/d63/d75/f86 [0,4194304] 0 2023-12-07T16:21:38.279 INFO:tasks.workunit.client.0.smithi063.stdout:7/315: truncate d2/d21/f3f 6594564 0 2023-12-07T16:21:38.279 INFO:tasks.workunit.client.1.smithi152.stdout:2/510: mkdir d2/d1c/d2e/d5d/daf 0 2023-12-07T16:21:38.279 INFO:tasks.workunit.client.1.smithi152.stdout:2/511: chown d2/f29 86687980 1 2023-12-07T16:21:38.279 INFO:tasks.workunit.client.1.smithi152.stdout:1/655: dread dc/d14/d18/d2d/d48/fc2 [0,4194304] 0 2023-12-07T16:21:38.279 INFO:tasks.workunit.client.0.smithi063.stdout:2/344: mkdir d0/d21/d56/d71 0 2023-12-07T16:21:38.279 INFO:tasks.workunit.client.0.smithi063.stdout:2/345: write d0/f10 [4966193,10934] 0 2023-12-07T16:21:38.281 INFO:tasks.workunit.client.0.smithi063.stdout:7/316: creat d2/d34/d46/d48/f7a x:0 0 0 2023-12-07T16:21:38.283 INFO:tasks.workunit.client.1.smithi152.stdout:0/509: mkdir d0/dc/d36/d3a/d51/d82/dae 0 2023-12-07T16:21:38.283 INFO:tasks.workunit.client.1.smithi152.stdout:8/558: mkdir d3/d4/d9/d34/dca 0 2023-12-07T16:21:38.283 INFO:tasks.workunit.client.1.smithi152.stdout:0/510: getdents d0/dc/d36/d3a/d51/d82/dae 0 2023-12-07T16:21:38.283 INFO:tasks.workunit.client.0.smithi063.stdout:7/317: symlink d2/d34/d46/d48/d70/l7b 0 2023-12-07T16:21:38.284 INFO:tasks.workunit.client.1.smithi152.stdout:2/512: rename d2/d1c/d2e/f82 to d2/d9/d51/fb0 0 2023-12-07T16:21:38.285 INFO:tasks.workunit.client.1.smithi152.stdout:3/508: sync 2023-12-07T16:21:38.285 INFO:tasks.workunit.client.1.smithi152.stdout:3/509: write d7/d10/d19/fa0 [25943,6222] 0 2023-12-07T16:21:38.285 INFO:tasks.workunit.client.1.smithi152.stdout:3/510: readlink d7/dc/d3e/d62/l94 0 2023-12-07T16:21:38.285 INFO:tasks.workunit.client.1.smithi152.stdout:3/511: fsync d7/f32 0 2023-12-07T16:21:38.286 INFO:tasks.workunit.client.1.smithi152.stdout:3/512: rename d7 to d7/d10/d41/da3 22 2023-12-07T16:21:38.286 INFO:tasks.workunit.client.1.smithi152.stdout:5/627: sync 2023-12-07T16:21:38.288 INFO:tasks.workunit.client.1.smithi152.stdout:0/511: link d0/dc/d36/d3a/d51/d82/c91 d0/dc/d36/d3a/d51/d82/caf 0 2023-12-07T16:21:38.288 INFO:tasks.workunit.client.1.smithi152.stdout:4/431: sync 2023-12-07T16:21:38.291 INFO:tasks.workunit.client.1.smithi152.stdout:5/628: mknod dd/de/d14/d19/d1a/dcc/cd9 0 2023-12-07T16:21:38.294 INFO:tasks.workunit.client.0.smithi063.stdout:7/318: dread d2/d2c/f3d [0,4194304] 0 2023-12-07T16:21:38.294 INFO:tasks.workunit.client.1.smithi152.stdout:4/432: write d0/d3/d6/dc/dd/f6c [1238135,127862] 0 2023-12-07T16:21:38.294 INFO:tasks.workunit.client.1.smithi152.stdout:4/433: chown d0/d3/d6/d2b/d56/c66 690506068 1 2023-12-07T16:21:38.294 INFO:tasks.workunit.client.1.smithi152.stdout:4/434: fsync d0/d3/d6/dc/d3a/d48/f5d 0 2023-12-07T16:21:38.295 INFO:tasks.workunit.client.1.smithi152.stdout:5/629: mkdir dd/de/d14/d19/d1a/d1b/dda 0 2023-12-07T16:21:38.295 INFO:tasks.workunit.client.1.smithi152.stdout:5/630: write dd/de/d8f/f93 [59955,107102] 0 2023-12-07T16:21:38.297 INFO:tasks.workunit.client.1.smithi152.stdout:5/631: unlink dd/de/d14/dc6/d7c/f87 0 2023-12-07T16:21:38.297 INFO:tasks.workunit.client.0.smithi063.stdout:7/319: write d2/f26 [726877,26785] 0 2023-12-07T16:21:38.298 INFO:tasks.workunit.client.0.smithi063.stdout:7/320: chown d2/d34/d46/f74 467503 1 2023-12-07T16:21:38.298 INFO:tasks.workunit.client.0.smithi063.stdout:9/316: sync 2023-12-07T16:21:38.299 INFO:tasks.workunit.client.1.smithi152.stdout:5/632: mkdir dd/ddb 0 2023-12-07T16:21:38.301 INFO:tasks.workunit.client.1.smithi152.stdout:5/633: link dd/d91/dbe/cc4 dd/d7b/cdc 0 2023-12-07T16:21:38.303 INFO:tasks.workunit.client.0.smithi063.stdout:2/346: dread d0/d1e/f29 [0,4194304] 0 2023-12-07T16:21:38.305 INFO:tasks.workunit.client.0.smithi063.stdout:2/347: symlink d0/d4a/l72 0 2023-12-07T16:21:38.305 INFO:tasks.workunit.client.0.smithi063.stdout:2/348: dread - d0/d21/d56/d11/d52/d5d/f5f zero size 2023-12-07T16:21:38.306 INFO:tasks.workunit.client.0.smithi063.stdout:2/349: symlink d0/d67/d5b/l73 0 2023-12-07T16:21:38.308 INFO:tasks.workunit.client.1.smithi152.stdout:4/435: dread d0/d3/d6/f26 [0,4194304] 0 2023-12-07T16:21:38.309 INFO:tasks.workunit.client.0.smithi063.stdout:2/350: symlink d0/d21/d56/d11/d52/d5d/l74 0 2023-12-07T16:21:38.309 INFO:tasks.workunit.client.1.smithi152.stdout:5/634: rename dd/de/f32 to dd/de/d14/d19/d74/fdd 0 2023-12-07T16:21:38.309 INFO:tasks.workunit.client.1.smithi152.stdout:5/635: dread - dd/de/d14/dc6/fb1 zero size 2023-12-07T16:21:38.311 INFO:tasks.workunit.client.0.smithi063.stdout:2/351: mknod d0/d4a/c75 0 2023-12-07T16:21:38.311 INFO:tasks.workunit.client.1.smithi152.stdout:1/656: dwrite dc/f63 [0,4194304] 0 2023-12-07T16:21:38.311 INFO:tasks.workunit.client.1.smithi152.stdout:1/657: fdatasync dc/d14/d18/fb5 0 2023-12-07T16:21:38.312 INFO:tasks.workunit.client.0.smithi063.stdout:2/352: dread - d0/d1e/f46 zero size 2023-12-07T16:21:38.314 INFO:tasks.workunit.client.1.smithi152.stdout:4/436: unlink d0/d3/d6/dc/d3a/f3e 0 2023-12-07T16:21:38.314 INFO:tasks.workunit.client.1.smithi152.stdout:4/437: chown d0/d3/d6/dc/d39 551364100 1 2023-12-07T16:21:38.314 INFO:tasks.workunit.client.1.smithi152.stdout:5/636: mkdir dd/de/d14/d19/dde 0 2023-12-07T16:21:38.315 INFO:tasks.workunit.client.1.smithi152.stdout:1/658: read dc/d28/d4e/f99 [2186775,66334] 0 2023-12-07T16:21:38.315 INFO:tasks.workunit.client.1.smithi152.stdout:1/659: read - dc/d14/d18/d64/f8f zero size 2023-12-07T16:21:38.315 INFO:tasks.workunit.client.1.smithi152.stdout:4/438: getdents d0/d3/d6/dc/d3a/d46/d4e 0 2023-12-07T16:21:38.316 INFO:tasks.workunit.client.0.smithi063.stdout:3/282: dwrite d7/d9/dd/f1f [4194304,4194304] 0 2023-12-07T16:21:38.316 INFO:tasks.workunit.client.0.smithi063.stdout:3/283: chown d7/fa 5819597 1 2023-12-07T16:21:38.317 INFO:tasks.workunit.client.0.smithi063.stdout:9/317: dread d0/d13/f36 [0,4194304] 0 2023-12-07T16:21:38.317 INFO:tasks.workunit.client.0.smithi063.stdout:9/318: dread - d0/d21/f43 zero size 2023-12-07T16:21:38.317 INFO:tasks.workunit.client.0.smithi063.stdout:9/319: fdatasync d0/d13/f36 0 2023-12-07T16:21:38.317 INFO:tasks.workunit.client.0.smithi063.stdout:9/320: readlink d0/d13/l52 0 2023-12-07T16:21:38.317 INFO:tasks.workunit.client.1.smithi152.stdout:5/637: mkdir dd/de/d14/d19/da3/ddf 0 2023-12-07T16:21:38.318 INFO:tasks.workunit.client.1.smithi152.stdout:9/546: dwrite d1/d9/db/d70/fb3 [0,4194304] 0 2023-12-07T16:21:38.319 INFO:tasks.workunit.client.1.smithi152.stdout:9/547: chown d1/d9/db 1861162905 1 2023-12-07T16:21:38.320 INFO:tasks.workunit.client.1.smithi152.stdout:4/439: symlink d0/d17/l7a 0 2023-12-07T16:21:38.325 INFO:tasks.workunit.client.1.smithi152.stdout:5/638: mkdir dd/de/d38/d3d/d6d/dae/de0 0 2023-12-07T16:21:38.329 INFO:tasks.workunit.client.1.smithi152.stdout:9/548: dread d1/dd/f78 [0,4194304] 0 2023-12-07T16:21:38.331 INFO:tasks.workunit.client.1.smithi152.stdout:4/440: unlink d0/d17/l7a 0 2023-12-07T16:21:38.331 INFO:tasks.workunit.client.1.smithi152.stdout:5/639: creat dd/de/d14/d1f/d49/fe1 x:0 0 0 2023-12-07T16:21:38.332 INFO:tasks.workunit.client.1.smithi152.stdout:4/441: write d0/d3/d6/d5c/f73 [344993,90265] 0 2023-12-07T16:21:38.335 INFO:tasks.workunit.client.0.smithi063.stdout:7/321: dwrite d2/d34/d5a/d5f/d2a/f35 [0,4194304] 0 2023-12-07T16:21:38.336 INFO:tasks.workunit.client.1.smithi152.stdout:5/640: rmdir dd/de/d8f/dc9 39 2023-12-07T16:21:38.336 INFO:tasks.workunit.client.1.smithi152.stdout:9/549: link d1/d17/d3c/fa0 d1/d9/d2d/d65/fbb 0 2023-12-07T16:21:38.337 INFO:tasks.workunit.client.1.smithi152.stdout:5/641: rmdir dd/de/d14/d19 39 2023-12-07T16:21:38.337 INFO:tasks.workunit.client.0.smithi063.stdout:7/322: mkdir d2/d34/d5a/d5f/d78/d7c 0 2023-12-07T16:21:38.339 INFO:tasks.workunit.client.0.smithi063.stdout:7/323: rename d2/d34/d46/d48/f7a to d2/d34/d46/d48/d56/f7d 0 2023-12-07T16:21:38.339 INFO:tasks.workunit.client.0.smithi063.stdout:7/324: write d2/d21/f49 [246214,18407] 0 2023-12-07T16:21:38.340 INFO:tasks.workunit.client.1.smithi152.stdout:5/642: rename dd/de/d8f/f93 to dd/de/d38/fe2 0 2023-12-07T16:21:38.340 INFO:tasks.workunit.client.0.smithi063.stdout:7/325: mkdir d2/d34/d5a/d5f/d2a/d7e 0 2023-12-07T16:21:38.341 INFO:tasks.workunit.client.1.smithi152.stdout:5/643: mknod dd/de/d38/d3d/dd3/ce3 0 2023-12-07T16:21:38.345 INFO:tasks.workunit.client.1.smithi152.stdout:4/442: dread d0/d3/d6/dc/d3a/d46/d4e/f57 [0,4194304] 0 2023-12-07T16:21:38.345 INFO:tasks.workunit.client.1.smithi152.stdout:5/644: mknod dd/ddb/ce4 0 2023-12-07T16:21:38.346 INFO:tasks.workunit.client.1.smithi152.stdout:4/443: read d0/d3/f37 [2720372,49294] 0 2023-12-07T16:21:38.347 INFO:tasks.workunit.client.1.smithi152.stdout:5/645: read dd/de/d14/d1f/f2e [8807207,95607] 0 2023-12-07T16:21:38.348 INFO:tasks.workunit.client.1.smithi152.stdout:4/444: creat d0/d3/d6/dc/dd/d67/f7b x:0 0 0 2023-12-07T16:21:38.349 INFO:tasks.workunit.client.1.smithi152.stdout:4/445: truncate d0/d3/d6/dc/dd/d67/f7b 710164 0 2023-12-07T16:21:38.349 INFO:tasks.workunit.client.1.smithi152.stdout:4/446: readlink d0/d3/d6/dc/d22/l3d 0 2023-12-07T16:21:38.349 INFO:tasks.workunit.client.1.smithi152.stdout:4/447: dread - d0/d3/d6/dc/d3a/d48/f5d zero size 2023-12-07T16:21:38.350 INFO:tasks.workunit.client.1.smithi152.stdout:5/646: link dd/de/d14/d1f/d28/f69 dd/de/d14/d1f/d28/fe5 0 2023-12-07T16:21:38.351 INFO:tasks.workunit.client.1.smithi152.stdout:0/512: dwrite d0/d27/f59 [4194304,4194304] 0 2023-12-07T16:21:38.351 INFO:tasks.workunit.client.1.smithi152.stdout:0/513: write d0/dc/d36/d3a/d51/d82/fac [162798,22021] 0 2023-12-07T16:21:38.351 INFO:tasks.workunit.client.1.smithi152.stdout:0/514: stat d0/c15 0 2023-12-07T16:21:38.351 INFO:tasks.workunit.client.1.smithi152.stdout:0/515: truncate d0/dc/f79 1143508 0 2023-12-07T16:21:38.351 INFO:tasks.workunit.client.1.smithi152.stdout:0/516: readlink d0/dc/d3d/l65 0 2023-12-07T16:21:38.351 INFO:tasks.workunit.client.1.smithi152.stdout:4/448: mkdir d0/d3/d6/dc/dd/d7c 0 2023-12-07T16:21:38.352 INFO:tasks.workunit.client.1.smithi152.stdout:5/647: mknod dd/de/d14/d1f/d28/ce6 0 2023-12-07T16:21:38.352 INFO:tasks.workunit.client.1.smithi152.stdout:5/648: fdatasync dd/de/d14/d1f/f2e 0 2023-12-07T16:21:38.353 INFO:tasks.workunit.client.1.smithi152.stdout:0/517: symlink d0/dc/d26/lb0 0 2023-12-07T16:21:38.354 INFO:tasks.workunit.client.1.smithi152.stdout:9/550: dread d1/d9/f12 [0,4194304] 0 2023-12-07T16:21:38.354 INFO:tasks.workunit.client.1.smithi152.stdout:4/449: unlink d0/d3/d6/d5c/f73 0 2023-12-07T16:21:38.355 INFO:tasks.workunit.client.1.smithi152.stdout:9/551: read d1/d9/db/df/da6/f4d [210143,74822] 0 2023-12-07T16:21:38.355 INFO:tasks.workunit.client.1.smithi152.stdout:9/552: read - d1/d17/d3c/f90 zero size 2023-12-07T16:21:38.356 INFO:tasks.workunit.client.1.smithi152.stdout:0/518: unlink d0/dc/d3d/d73/f98 0 2023-12-07T16:21:38.357 INFO:tasks.workunit.client.1.smithi152.stdout:4/450: mknod d0/d3/d6/dc/d3a/d46/d4e/c7d 0 2023-12-07T16:21:38.357 INFO:tasks.workunit.client.1.smithi152.stdout:4/451: readlink d0/d3/d6/l51 0 2023-12-07T16:21:38.357 INFO:tasks.workunit.client.1.smithi152.stdout:5/649: write dd/de/d38/d3d/f46 [2178379,53019] 0 2023-12-07T16:21:38.357 INFO:tasks.workunit.client.1.smithi152.stdout:4/452: read - d0/d3/d6/dc/d39/f5e zero size 2023-12-07T16:21:38.358 INFO:tasks.workunit.client.1.smithi152.stdout:0/519: link d0/d2f/d30/f4a d0/dc/d26/fb1 0 2023-12-07T16:21:38.358 INFO:tasks.workunit.client.1.smithi152.stdout:0/520: readlink d0/l1e 0 2023-12-07T16:21:38.359 INFO:tasks.workunit.client.1.smithi152.stdout:0/521: truncate d0/f18 5078941 0 2023-12-07T16:21:38.359 INFO:tasks.workunit.client.1.smithi152.stdout:0/522: chown d0/dc/d36/d3a/d51/f7a 79 1 2023-12-07T16:21:38.361 INFO:tasks.workunit.client.1.smithi152.stdout:4/453: link d0/d3/d6/d2b/c64 d0/d3/d6/dc/dd/d67/c7e 0 2023-12-07T16:21:38.362 INFO:tasks.workunit.client.1.smithi152.stdout:0/523: rename d0/l1e to d0/dc/d36/lb2 0 2023-12-07T16:21:38.363 INFO:tasks.workunit.client.1.smithi152.stdout:0/524: write d0/dc/d36/d3a/d69/fad [1060294,106746] 0 2023-12-07T16:21:38.364 INFO:tasks.workunit.client.1.smithi152.stdout:4/454: truncate d0/f1 490071 0 2023-12-07T16:21:38.364 INFO:tasks.workunit.client.1.smithi152.stdout:8/559: dwrite d3/d4/f5c [0,4194304] 0 2023-12-07T16:21:38.364 INFO:tasks.workunit.client.1.smithi152.stdout:1/660: dwrite dc/d14/d18/d2d/d4a/d52/f73 [0,4194304] 0 2023-12-07T16:21:38.365 INFO:tasks.workunit.client.1.smithi152.stdout:0/525: mknod d0/dc/d3d/cb3 0 2023-12-07T16:21:38.366 INFO:tasks.workunit.client.1.smithi152.stdout:0/526: read d0/d2f/d30/d6e/d77/f96 [961034,106505] 0 2023-12-07T16:21:38.367 INFO:tasks.workunit.client.1.smithi152.stdout:4/455: mkdir d0/d17/d7f 0 2023-12-07T16:21:38.367 INFO:tasks.workunit.client.1.smithi152.stdout:4/456: write d0/d3/d6/d5c/f74 [1014887,40996] 0 2023-12-07T16:21:38.369 INFO:tasks.workunit.client.1.smithi152.stdout:0/527: creat d0/fb4 x:0 0 0 2023-12-07T16:21:38.369 INFO:tasks.workunit.client.1.smithi152.stdout:0/528: stat d0/dc/d3d/d4c 0 2023-12-07T16:21:38.369 INFO:tasks.workunit.client.1.smithi152.stdout:9/553: dread d1/d9/d2d/d46/d9a/f9e [0,4194304] 0 2023-12-07T16:21:38.370 INFO:tasks.workunit.client.0.smithi063.stdout:3/284: dwrite d7/d9/f46 [0,4194304] 0 2023-12-07T16:21:38.370 INFO:tasks.workunit.client.0.smithi063.stdout:9/321: dwrite d0/f31 [0,4194304] 0 2023-12-07T16:21:38.371 INFO:tasks.workunit.client.1.smithi152.stdout:5/650: rmdir dd/de/d14/d1f/d49 39 2023-12-07T16:21:38.371 INFO:tasks.workunit.client.0.smithi063.stdout:7/326: dwrite d2/d34/d5a/d5f/f27 [0,4194304] 0 2023-12-07T16:21:38.373 INFO:tasks.workunit.client.1.smithi152.stdout:0/529: symlink d0/lb5 0 2023-12-07T16:21:38.373 INFO:tasks.workunit.client.1.smithi152.stdout:0/530: write d0/dc/f79 [1675035,78364] 0 2023-12-07T16:21:38.374 INFO:tasks.workunit.client.0.smithi063.stdout:9/322: mkdir d0/d21/d64/d6a 0 2023-12-07T16:21:38.378 INFO:tasks.workunit.client.0.smithi063.stdout:7/327: link d2/d2c/l51 d2/d34/l7f 0 2023-12-07T16:21:38.378 INFO:tasks.workunit.client.0.smithi063.stdout:7/328: dread - d2/d34/d46/d48/d56/f7d zero size 2023-12-07T16:21:38.378 INFO:tasks.workunit.client.0.smithi063.stdout:7/329: write d2/d34/f3b [266189,78527] 0 2023-12-07T16:21:38.378 INFO:tasks.workunit.client.1.smithi152.stdout:5/651: unlink dd/de/d38/d3d/d6d/lc5 0 2023-12-07T16:21:38.378 INFO:tasks.workunit.client.1.smithi152.stdout:0/531: creat d0/dc/d3d/dab/fb6 x:0 0 0 2023-12-07T16:21:38.378 INFO:tasks.workunit.client.1.smithi152.stdout:5/652: readlink dd/de/d17/l26 0 2023-12-07T16:21:38.381 INFO:tasks.workunit.client.0.smithi063.stdout:9/323: link d0/d13/d39/d3a/l4e d0/d13/d39/d3a/l6b 0 2023-12-07T16:21:38.382 INFO:tasks.workunit.client.1.smithi152.stdout:0/532: rename d0/dc/d3d/cb3 to d0/d2f/d30/cb7 0 2023-12-07T16:21:38.383 INFO:tasks.workunit.client.0.smithi063.stdout:9/324: write d0/d13/d39/d3a/f4d [2335334,53617] 0 2023-12-07T16:21:38.384 INFO:tasks.workunit.client.1.smithi152.stdout:4/457: dread d0/d3/d6/dc/d22/f54 [0,4194304] 0 2023-12-07T16:21:38.385 INFO:tasks.workunit.client.1.smithi152.stdout:0/533: getdents d0/dc/d36/d3a/d69 0 2023-12-07T16:21:38.387 INFO:tasks.workunit.client.1.smithi152.stdout:5/653: write dd/de/d14/d19/d1a/f55 [400530,606] 0 2023-12-07T16:21:38.387 INFO:tasks.workunit.client.1.smithi152.stdout:4/458: write d0/d3/f7 [6711077,98586] 0 2023-12-07T16:21:38.387 INFO:tasks.workunit.client.1.smithi152.stdout:4/459: dread - d0/d3/d6/d5c/f72 zero size 2023-12-07T16:21:38.387 INFO:tasks.workunit.client.1.smithi152.stdout:0/534: creat d0/dc/d36/fb8 x:0 0 0 2023-12-07T16:21:38.390 INFO:tasks.workunit.client.1.smithi152.stdout:4/460: mkdir d0/d3/d6/dc/d3a/d46/d80 0 2023-12-07T16:21:38.390 INFO:tasks.workunit.client.1.smithi152.stdout:0/535: read d0/d27/f59 [7945916,118921] 0 2023-12-07T16:21:38.393 INFO:tasks.workunit.client.1.smithi152.stdout:0/536: creat d0/dc/d36/d3a/d51/d82/fb9 x:0 0 0 2023-12-07T16:21:38.393 INFO:tasks.workunit.client.1.smithi152.stdout:0/537: stat d0/d27/d8c/f8d 0 2023-12-07T16:21:38.393 INFO:tasks.workunit.client.1.smithi152.stdout:0/538: chown d0/d2f/d30/d6e/d77/fa6 3 1 2023-12-07T16:21:38.394 INFO:tasks.workunit.client.1.smithi152.stdout:0/539: creat d0/d2f/d30/d6e/d77/d9f/fba x:0 0 0 2023-12-07T16:21:38.397 INFO:tasks.workunit.client.1.smithi152.stdout:0/540: unlink d0/dc/d36/d3a/f4f 0 2023-12-07T16:21:38.400 INFO:tasks.workunit.client.1.smithi152.stdout:1/661: dwrite dc/d14/d18/d79/d86/db7/fc6 [0,4194304] 0 2023-12-07T16:21:38.400 INFO:tasks.workunit.client.1.smithi152.stdout:1/662: chown dc/fd 6 1 2023-12-07T16:21:38.403 INFO:tasks.workunit.client.1.smithi152.stdout:1/663: symlink dc/d14/d18/d64/d8a/ld6 0 2023-12-07T16:21:38.405 INFO:tasks.workunit.client.1.smithi152.stdout:1/664: creat dc/d14/d18/d2d/d48/fd7 x:0 0 0 2023-12-07T16:21:38.407 INFO:tasks.workunit.client.1.smithi152.stdout:1/665: link dc/d14/d18/f35 dc/d14/fd8 0 2023-12-07T16:21:38.410 INFO:tasks.workunit.client.1.smithi152.stdout:1/666: mknod dc/d14/d18/cd9 0 2023-12-07T16:21:38.410 INFO:tasks.workunit.client.0.smithi063.stdout:9/325: dread d0/d21/f23 [0,4194304] 0 2023-12-07T16:21:38.411 INFO:tasks.workunit.client.0.smithi063.stdout:9/326: dread - d0/f68 zero size 2023-12-07T16:21:38.412 INFO:tasks.workunit.client.1.smithi152.stdout:1/667: getdents dc/d14/d18/d79/d86/db7 0 2023-12-07T16:21:38.412 INFO:tasks.workunit.client.0.smithi063.stdout:9/327: creat d0/d13/d39/d3a/f6c x:0 0 0 2023-12-07T16:21:38.413 INFO:tasks.workunit.client.0.smithi063.stdout:9/328: creat d0/d7/f6d x:0 0 0 2023-12-07T16:21:38.414 INFO:tasks.workunit.client.0.smithi063.stdout:9/329: write d0/d21/d64/f4a [3064176,69237] 0 2023-12-07T16:21:38.414 INFO:tasks.workunit.client.0.smithi063.stdout:9/330: truncate d0/d13/f25 2650 0 2023-12-07T16:21:38.415 INFO:tasks.workunit.client.0.smithi063.stdout:9/331: symlink d0/d7/l6e 0 2023-12-07T16:21:38.415 INFO:tasks.workunit.client.0.smithi063.stdout:9/332: dread - d0/d21/d64/f44 zero size 2023-12-07T16:21:38.417 INFO:tasks.workunit.client.1.smithi152.stdout:1/668: write dc/f2a [804374,9719] 0 2023-12-07T16:21:38.420 INFO:tasks.workunit.client.1.smithi152.stdout:8/560: dwrite d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/fa0 [0,4194304] 0 2023-12-07T16:21:38.424 INFO:tasks.workunit.client.1.smithi152.stdout:1/669: dread dc/d14/f84 [0,4194304] 0 2023-12-07T16:21:38.424 INFO:tasks.workunit.client.0.smithi063.stdout:7/330: dwrite d2/d34/d5a/d5f/f3e [0,4194304] 0 2023-12-07T16:21:38.424 INFO:tasks.workunit.client.1.smithi152.stdout:9/554: dwrite d1/d9/d2d/f8f [0,4194304] 0 2023-12-07T16:21:38.425 INFO:tasks.workunit.client.1.smithi152.stdout:8/561: dread d3/d4/d9/dc/d6f/d7a/d8a/f31 [0,4194304] 0 2023-12-07T16:21:38.429 INFO:tasks.workunit.client.1.smithi152.stdout:9/555: mknod d1/d9/db/df/cbc 0 2023-12-07T16:21:38.429 INFO:tasks.workunit.client.1.smithi152.stdout:8/562: truncate d3/d4/d9/dc/f4d 579745 0 2023-12-07T16:21:38.433 INFO:tasks.workunit.client.1.smithi152.stdout:9/556: unlink d1/d9/d2d/f40 0 2023-12-07T16:21:38.433 INFO:tasks.workunit.client.1.smithi152.stdout:9/557: dread - d1/d9/db/df/f50 zero size 2023-12-07T16:21:38.433 INFO:tasks.workunit.client.0.smithi063.stdout:3/285: dwrite d7/d9/f18 [0,4194304] 0 2023-12-07T16:21:38.434 INFO:tasks.workunit.client.1.smithi152.stdout:8/563: truncate d3/d4/d9/dc/d6f/d7a/d8a/d63/f91 349569 0 2023-12-07T16:21:38.436 INFO:tasks.workunit.client.1.smithi152.stdout:5/654: dwrite dd/de/d38/d3d/fca [0,4194304] 0 2023-12-07T16:21:38.436 INFO:tasks.workunit.client.1.smithi152.stdout:4/461: dwrite d0/d17/f53 [4194304,4194304] 0 2023-12-07T16:21:38.437 INFO:tasks.workunit.client.0.smithi063.stdout:9/333: dwrite d0/f68 [0,4194304] 0 2023-12-07T16:21:38.437 INFO:tasks.workunit.client.0.smithi063.stdout:9/334: readlink d0/d7/l6e 0 2023-12-07T16:21:38.437 INFO:tasks.workunit.client.1.smithi152.stdout:0/541: dwrite d0/dc/f34 [0,4194304] 0 2023-12-07T16:21:38.437 INFO:tasks.workunit.client.1.smithi152.stdout:0/542: chown d0/dc/d36/d7d/d92/fa9 22749 1 2023-12-07T16:21:38.437 INFO:tasks.workunit.client.1.smithi152.stdout:0/543: chown d0/c47 31538685 1 2023-12-07T16:21:38.438 INFO:tasks.workunit.client.0.smithi063.stdout:9/335: mkdir d0/d13/d6f 0 2023-12-07T16:21:38.438 INFO:tasks.workunit.client.1.smithi152.stdout:1/670: dread dc/d28/f38 [4194304,4194304] 0 2023-12-07T16:21:38.439 INFO:tasks.workunit.client.0.smithi063.stdout:1/236: sync 2023-12-07T16:21:38.439 INFO:tasks.workunit.client.0.smithi063.stdout:1/237: readlink d0/dd/d19/l34 0 2023-12-07T16:21:38.441 INFO:tasks.workunit.client.0.smithi063.stdout:7/331: dread d2/f8 [0,4194304] 0 2023-12-07T16:21:38.441 INFO:tasks.workunit.client.0.smithi063.stdout:7/332: stat d2/d37 0 2023-12-07T16:21:38.441 INFO:tasks.workunit.client.0.smithi063.stdout:1/238: truncate d0/dd/d10/d1e/f2c 776655 0 2023-12-07T16:21:38.441 INFO:tasks.workunit.client.0.smithi063.stdout:1/239: chown d0/dd/f16 0 1 2023-12-07T16:21:38.441 INFO:tasks.workunit.client.0.smithi063.stdout:1/240: write d0/dd/d19/f43 [402830,116168] 0 2023-12-07T16:21:38.442 INFO:tasks.workunit.client.1.smithi152.stdout:5/655: write dd/de/d14/d19/d1a/d1b/f8b [3806514,73328] 0 2023-12-07T16:21:38.442 INFO:tasks.workunit.client.1.smithi152.stdout:5/656: dread - dd/fab zero size 2023-12-07T16:21:38.442 INFO:tasks.workunit.client.1.smithi152.stdout:5/657: readlink dd/de/d14/d19/d1a/d1b/l8a 0 2023-12-07T16:21:38.443 INFO:tasks.workunit.client.1.smithi152.stdout:9/558: creat d1/d9/db/df/fbd x:0 0 0 2023-12-07T16:21:38.443 INFO:tasks.workunit.client.1.smithi152.stdout:8/564: rename d3/d1e/d40/f6e to d3/d4/d9/d23/fcb 0 2023-12-07T16:21:38.443 INFO:tasks.workunit.client.0.smithi063.stdout:1/241: write d0/dd/d10/d1e/f2e [2749624,60501] 0 2023-12-07T16:21:38.445 INFO:tasks.workunit.client.1.smithi152.stdout:9/559: write d1/d9/db/f33 [1640104,96972] 0 2023-12-07T16:21:38.448 INFO:tasks.workunit.client.0.smithi063.stdout:7/333: creat d2/d34/d5a/d5f/f80 x:0 0 0 2023-12-07T16:21:38.448 INFO:tasks.workunit.client.0.smithi063.stdout:7/334: stat d2/d34/d5a/d5f/d53 0 2023-12-07T16:21:38.454 INFO:tasks.workunit.client.0.smithi063.stdout:7/335: write d2/f8 [4518569,120647] 0 2023-12-07T16:21:38.454 INFO:tasks.workunit.client.1.smithi152.stdout:5/658: dread dd/de/d14/d1f/d28/fe5 [0,4194304] 0 2023-12-07T16:21:38.456 INFO:tasks.workunit.client.0.smithi063.stdout:9/336: dread d0/d13/f36 [0,4194304] 0 2023-12-07T16:21:38.456 INFO:tasks.workunit.client.0.smithi063.stdout:9/337: truncate d0/d7/f55 1341610 0 2023-12-07T16:21:38.458 INFO:tasks.workunit.client.1.smithi152.stdout:4/462: mkdir d0/d81 0 2023-12-07T16:21:38.461 INFO:tasks.workunit.client.1.smithi152.stdout:0/544: rmdir d0/d2f 39 2023-12-07T16:21:38.462 INFO:tasks.workunit.client.0.smithi063.stdout:9/338: dread d0/d7/f55 [0,4194304] 0 2023-12-07T16:21:38.462 INFO:tasks.workunit.client.0.smithi063.stdout:9/339: dread - d0/d7/f6d zero size 2023-12-07T16:21:38.462 INFO:tasks.workunit.client.1.smithi152.stdout:5/659: write f8 [2023918,35837] 0 2023-12-07T16:21:38.465 INFO:tasks.workunit.client.1.smithi152.stdout:5/660: dread dd/d91/fa1 [0,4194304] 0 2023-12-07T16:21:38.466 INFO:tasks.workunit.client.1.smithi152.stdout:1/671: mknod dc/d14/d18/cda 0 2023-12-07T16:21:38.470 INFO:tasks.workunit.client.1.smithi152.stdout:9/560: rmdir d1/d9/db/d70 39 2023-12-07T16:21:38.470 INFO:tasks.workunit.client.1.smithi152.stdout:9/561: dread - d1/d17/d38/fad zero size 2023-12-07T16:21:38.476 INFO:tasks.workunit.client.0.smithi063.stdout:3/286: dwrite f6 [0,4194304] 0 2023-12-07T16:21:38.479 INFO:tasks.workunit.client.1.smithi152.stdout:4/463: unlink d0/d17/f53 0 2023-12-07T16:21:38.479 INFO:tasks.workunit.client.1.smithi152.stdout:1/672: creat dc/d28/d4e/fdb x:0 0 0 2023-12-07T16:21:38.479 INFO:tasks.workunit.client.1.smithi152.stdout:1/673: fsync dc/d14/d18/d79/d86/fd5 0 2023-12-07T16:21:38.479 INFO:tasks.workunit.client.0.smithi063.stdout:9/340: dread d0/d13/d39/f51 [0,4194304] 0 2023-12-07T16:21:38.479 INFO:tasks.workunit.client.0.smithi063.stdout:9/341: chown d0/d13/f25 132512 1 2023-12-07T16:21:38.479 INFO:tasks.workunit.client.0.smithi063.stdout:1/242: dwrite d0/dd/d10/d1e/f31 [0,4194304] 0 2023-12-07T16:21:38.480 INFO:tasks.workunit.client.0.smithi063.stdout:7/336: dwrite d2/d34/d5a/d5f/f15 [0,4194304] 0 2023-12-07T16:21:38.481 INFO:tasks.workunit.client.1.smithi152.stdout:1/674: mknod dc/d14/d18/d2d/d9c/cdc 0 2023-12-07T16:21:38.482 INFO:tasks.workunit.client.0.smithi063.stdout:3/287: dread d7/d21/f25 [0,4194304] 0 2023-12-07T16:21:38.482 INFO:tasks.workunit.client.1.smithi152.stdout:1/675: mknod dc/d14/d18/d2d/d91/cdd 0 2023-12-07T16:21:38.482 INFO:tasks.workunit.client.0.smithi063.stdout:9/342: creat d0/d7/f70 x:0 0 0 2023-12-07T16:21:38.485 INFO:tasks.workunit.client.0.smithi063.stdout:7/337: creat d2/d34/d5a/d5f/f81 x:0 0 0 2023-12-07T16:21:38.487 INFO:tasks.workunit.client.1.smithi152.stdout:1/676: mkdir dc/d14/d18/d2d/d48/da3/d58/dde 0 2023-12-07T16:21:38.488 INFO:tasks.workunit.client.0.smithi063.stdout:9/343: rmdir d0/d21 39 2023-12-07T16:21:38.488 INFO:tasks.workunit.client.0.smithi063.stdout:9/344: chown d0/d13/c37 16208325 1 2023-12-07T16:21:38.488 INFO:tasks.workunit.client.0.smithi063.stdout:9/345: stat d0/d7/ff 0 2023-12-07T16:21:38.488 INFO:tasks.workunit.client.0.smithi063.stdout:9/346: chown d0/d13/d39/c3f 5059778 1 2023-12-07T16:21:38.489 INFO:tasks.workunit.client.0.smithi063.stdout:7/338: creat d2/d34/d46/d48/d56/f82 x:0 0 0 2023-12-07T16:21:38.492 INFO:tasks.workunit.client.1.smithi152.stdout:6/535: sync 2023-12-07T16:21:38.494 INFO:tasks.workunit.client.1.smithi152.stdout:6/536: link d2/d4f/d83/d85/ca d2/d4f/d83/cab 0 2023-12-07T16:21:38.495 INFO:tasks.workunit.client.1.smithi152.stdout:8/565: dwrite d3/d4/d9/dc/f39 [0,4194304] 0 2023-12-07T16:21:38.496 INFO:tasks.workunit.client.1.smithi152.stdout:6/537: mknod d2/d4f/d83/d85/d19/d1f/cac 0 2023-12-07T16:21:38.496 INFO:tasks.workunit.client.1.smithi152.stdout:6/538: readlink d2/d4f/d83/d85/l10 0 2023-12-07T16:21:38.496 INFO:tasks.workunit.client.1.smithi152.stdout:8/566: mkdir d3/d4/d9/dc/d6f/d7b/dbd/dcc 0 2023-12-07T16:21:38.497 INFO:tasks.workunit.client.1.smithi152.stdout:4/464: dread d0/d3/f2d [0,4194304] 0 2023-12-07T16:21:38.499 INFO:tasks.workunit.client.1.smithi152.stdout:0/545: dwrite d0/d2f/d30/f4a [0,4194304] 0 2023-12-07T16:21:38.499 INFO:tasks.workunit.client.1.smithi152.stdout:0/546: fdatasync d0/d2f/f4d 0 2023-12-07T16:21:38.499 INFO:tasks.workunit.client.1.smithi152.stdout:0/547: write d0/dc/d36/f9c [32343,40403] 0 2023-12-07T16:21:38.502 INFO:tasks.workunit.client.1.smithi152.stdout:6/539: link d2/d4f/d83/d85/d19/l71 d2/d4f/d83/d85/de/d2e/d4c/lad 0 2023-12-07T16:21:38.503 INFO:tasks.workunit.client.1.smithi152.stdout:6/540: dread d2/d4f/d83/d85/de/f62 [0,4194304] 0 2023-12-07T16:21:38.508 INFO:tasks.workunit.client.1.smithi152.stdout:9/562: dwrite d1/d9/d2d/fb0 [0,4194304] 0 2023-12-07T16:21:38.515 INFO:tasks.workunit.client.1.smithi152.stdout:9/563: write d1/d9/db/df/da6/f4d [1460016,44993] 0 2023-12-07T16:21:38.516 INFO:tasks.workunit.client.1.smithi152.stdout:6/541: dread d2/d4f/d83/d85/d19/f22 [0,4194304] 0 2023-12-07T16:21:38.516 INFO:tasks.workunit.client.1.smithi152.stdout:6/542: fsync d2/d4f/d83/d85/de/d45/f86 0 2023-12-07T16:21:38.517 INFO:tasks.workunit.client.1.smithi152.stdout:9/564: creat d1/d9/db/df/d42/fbe x:0 0 0 2023-12-07T16:21:38.519 INFO:tasks.workunit.client.0.smithi063.stdout:3/288: dwrite d7/d9/d2b/d41/f5a [0,4194304] 0 2023-12-07T16:21:38.523 INFO:tasks.workunit.client.1.smithi152.stdout:9/565: read d1/f31 [4230952,113479] 0 2023-12-07T16:21:38.523 INFO:tasks.workunit.client.1.smithi152.stdout:0/548: dread d0/f18 [0,4194304] 0 2023-12-07T16:21:38.523 INFO:tasks.workunit.client.1.smithi152.stdout:5/661: dwrite dd/de/d14/d1f/d28/f2d [4194304,4194304] 0 2023-12-07T16:21:38.523 INFO:tasks.workunit.client.1.smithi152.stdout:5/662: fsync dd/de/d14/d1f/d28/fe5 0 2023-12-07T16:21:38.523 INFO:tasks.workunit.client.1.smithi152.stdout:5/663: write dd/de/d14/dc6/db0/fb6 [1027500,11289] 0 2023-12-07T16:21:38.525 INFO:tasks.workunit.client.0.smithi063.stdout:3/289: creat d7/d4f/d53/f5b x:0 0 0 2023-12-07T16:21:38.525 INFO:tasks.workunit.client.1.smithi152.stdout:9/566: rmdir d1/d17/d3c/d4a/d48/d8c 39 2023-12-07T16:21:38.525 INFO:tasks.workunit.client.1.smithi152.stdout:9/567: chown d1/dd 224 1 2023-12-07T16:21:38.525 INFO:tasks.workunit.client.1.smithi152.stdout:7/500: sync 2023-12-07T16:21:38.526 INFO:tasks.workunit.client.1.smithi152.stdout:7/501: dread - db/d27/d39/d41/d58/f8a zero size 2023-12-07T16:21:38.526 INFO:tasks.workunit.client.0.smithi063.stdout:3/290: mkdir d7/d9/d1b/d5c 0 2023-12-07T16:21:38.526 INFO:tasks.workunit.client.1.smithi152.stdout:7/502: write db/d27/d39/d41/d58/f73 [3943846,107813] 0 2023-12-07T16:21:38.528 INFO:tasks.workunit.client.1.smithi152.stdout:0/549: creat d0/dc/d3d/d73/fbb x:0 0 0 2023-12-07T16:21:38.528 INFO:tasks.workunit.client.1.smithi152.stdout:0/550: chown d0/dc/d36/d3a/d51/d82/c91 259818 1 2023-12-07T16:21:38.529 INFO:tasks.workunit.client.1.smithi152.stdout:5/664: creat dd/ddb/fe7 x:0 0 0 2023-12-07T16:21:38.529 INFO:tasks.workunit.client.1.smithi152.stdout:5/665: chown dd/de/f13 1656 1 2023-12-07T16:21:38.530 INFO:tasks.workunit.client.1.smithi152.stdout:9/568: mkdir d1/d9/d2d/d46/d9a/dbf 0 2023-12-07T16:21:38.531 INFO:tasks.workunit.client.0.smithi063.stdout:3/291: write d7/d9/f12 [3761050,10955] 0 2023-12-07T16:21:38.532 INFO:tasks.workunit.client.1.smithi152.stdout:0/551: unlink d0/d27/d11/f40 0 2023-12-07T16:21:38.533 INFO:tasks.workunit.client.0.smithi063.stdout:1/243: dwrite d0/f1 [0,4194304] 0 2023-12-07T16:21:38.533 INFO:tasks.workunit.client.0.smithi063.stdout:1/244: readlink d0/dd/d10/d1e/l30 0 2023-12-07T16:21:38.533 INFO:tasks.workunit.client.1.smithi152.stdout:0/552: dread d0/f49 [0,4194304] 0 2023-12-07T16:21:38.534 INFO:tasks.workunit.client.1.smithi152.stdout:0/553: mknod d0/cbc 0 2023-12-07T16:21:38.535 INFO:tasks.workunit.client.1.smithi152.stdout:0/554: chown d0/dc/d3d/d4c/f6a 9 1 2023-12-07T16:21:38.535 INFO:tasks.workunit.client.1.smithi152.stdout:0/555: chown d0/dc/d36/d3a/d69 109347 1 2023-12-07T16:21:38.535 INFO:tasks.workunit.client.1.smithi152.stdout:0/556: dread - d0/dc/d3d/dab/fb6 zero size 2023-12-07T16:21:38.535 INFO:tasks.workunit.client.0.smithi063.stdout:1/245: unlink d0/dd/d10/d1e/f3f 0 2023-12-07T16:21:38.536 INFO:tasks.workunit.client.1.smithi152.stdout:0/557: mknod d0/d27/d11/cbd 0 2023-12-07T16:21:38.536 INFO:tasks.workunit.client.1.smithi152.stdout:0/558: chown d0/dc/d36/d3a/d51/l94 2511 1 2023-12-07T16:21:38.536 INFO:tasks.workunit.client.1.smithi152.stdout:0/559: readlink d0/dc/d3d/l7f 0 2023-12-07T16:21:38.536 INFO:tasks.workunit.client.1.smithi152.stdout:0/560: write d0/d2f/d30/d6e/d77/d9f/fa0 [511892,101349] 0 2023-12-07T16:21:38.537 INFO:tasks.workunit.client.0.smithi063.stdout:9/347: dwrite d0/d21/f33 [4194304,4194304] 0 2023-12-07T16:21:38.538 INFO:tasks.workunit.client.0.smithi063.stdout:9/348: creat d0/d21/f71 x:0 0 0 2023-12-07T16:21:38.539 INFO:tasks.workunit.client.1.smithi152.stdout:0/561: rename d0/dc/d36/d7d/caa to d0/dc/d26/cbe 0 2023-12-07T16:21:38.539 INFO:tasks.workunit.client.1.smithi152.stdout:0/562: fdatasync d0/d2f/f52 0 2023-12-07T16:21:38.539 INFO:tasks.workunit.client.0.smithi063.stdout:9/349: symlink d0/d13/l72 0 2023-12-07T16:21:38.541 INFO:tasks.workunit.client.0.smithi063.stdout:9/350: unlink d0/d13/d39/f69 0 2023-12-07T16:21:38.543 INFO:tasks.workunit.client.1.smithi152.stdout:9/569: read d1/d9/db/df/da6/f4d [3067621,58919] 0 2023-12-07T16:21:38.543 INFO:tasks.workunit.client.1.smithi152.stdout:9/570: stat d1/d17/d3c/d4a 0 2023-12-07T16:21:38.543 INFO:tasks.workunit.client.1.smithi152.stdout:9/571: fsync d1/d17/d3c/d4a/d48/f52 0 2023-12-07T16:21:38.543 INFO:tasks.workunit.client.1.smithi152.stdout:9/572: chown d1/d17/d3c/fa7 0 1 2023-12-07T16:21:38.543 INFO:tasks.workunit.client.1.smithi152.stdout:9/573: chown d1/d17/d3c/d4a/d48/f59 27072 1 2023-12-07T16:21:38.543 INFO:tasks.workunit.client.1.smithi152.stdout:6/543: dwrite d2/d4f/d83/d85/f4d [0,4194304] 0 2023-12-07T16:21:38.543 INFO:tasks.workunit.client.1.smithi152.stdout:6/544: chown d2/d4f/d83/d85/f4d 2 1 2023-12-07T16:21:38.543 INFO:tasks.workunit.client.1.smithi152.stdout:0/563: mkdir d0/dc/d3d/d73/dbf 0 2023-12-07T16:21:38.544 INFO:tasks.workunit.client.0.smithi063.stdout:9/351: read d0/d21/d64/f4c [296657,97241] 0 2023-12-07T16:21:38.544 INFO:tasks.workunit.client.0.smithi063.stdout:9/352: readlink d0/l27 0 2023-12-07T16:21:38.544 INFO:tasks.workunit.client.0.smithi063.stdout:9/353: truncate d0/d7/f70 916935 0 2023-12-07T16:21:38.544 INFO:tasks.workunit.client.0.smithi063.stdout:9/354: readlink d0/d21/l3b 0 2023-12-07T16:21:38.544 INFO:tasks.workunit.client.0.smithi063.stdout:9/355: truncate d0/d7/f70 1707717 0 2023-12-07T16:21:38.544 INFO:tasks.workunit.client.1.smithi152.stdout:1/677: dwrite dc/d14/fd3 [0,4194304] 0 2023-12-07T16:21:38.544 INFO:tasks.workunit.client.1.smithi152.stdout:0/564: write d0/f5 [1056883,19862] 0 2023-12-07T16:21:38.546 INFO:tasks.workunit.client.1.smithi152.stdout:8/567: dwrite d3/d1e/f9c [0,4194304] 0 2023-12-07T16:21:38.546 INFO:tasks.workunit.client.1.smithi152.stdout:9/574: link d1/d9/d2d/cb9 d1/d9/d2d/d72/cc0 0 2023-12-07T16:21:38.546 INFO:tasks.workunit.client.1.smithi152.stdout:8/568: write d3/d4/d9/dc/d6f/d7a/fa8 [1232066,70485] 0 2023-12-07T16:21:38.546 INFO:tasks.workunit.client.1.smithi152.stdout:8/569: chown d3/c97 6 1 2023-12-07T16:21:38.546 INFO:tasks.workunit.client.1.smithi152.stdout:8/570: chown d3/d4/l2a 6 1 2023-12-07T16:21:38.546 INFO:tasks.workunit.client.1.smithi152.stdout:8/571: write d3/d4/d9/d34/d5f/f6d [475990,129461] 0 2023-12-07T16:21:38.548 INFO:tasks.workunit.client.1.smithi152.stdout:6/545: creat d2/d4f/d83/d85/d9/fae x:0 0 0 2023-12-07T16:21:38.550 INFO:tasks.workunit.client.1.smithi152.stdout:2/513: sync 2023-12-07T16:21:38.550 INFO:tasks.workunit.client.1.smithi152.stdout:3/513: sync 2023-12-07T16:21:38.550 INFO:tasks.workunit.client.1.smithi152.stdout:3/514: write d7/dc/d14/f16 [5057687,176] 0 2023-12-07T16:21:38.550 INFO:tasks.workunit.client.1.smithi152.stdout:3/515: read - d7/d10/d1a/d25/d3f/f6f zero size 2023-12-07T16:21:38.551 INFO:tasks.workunit.client.1.smithi152.stdout:2/514: write d2/d1c/d2e/d57/d5b/da7/f88 [1531875,123030] 0 2023-12-07T16:21:38.552 INFO:tasks.workunit.client.0.smithi063.stdout:3/292: dread d7/d9/f27 [0,4194304] 0 2023-12-07T16:21:38.555 INFO:tasks.workunit.client.1.smithi152.stdout:2/515: read d2/d1c/d2e/d38/d90/f36 [2252305,112776] 0 2023-12-07T16:21:38.555 INFO:tasks.workunit.client.1.smithi152.stdout:9/575: mknod d1/d9/db/df/da6/cc1 0 2023-12-07T16:21:38.555 INFO:tasks.workunit.client.0.smithi063.stdout:3/293: mkdir d7/d9/d1b/d5c/d5d 0 2023-12-07T16:21:38.558 INFO:tasks.workunit.client.1.smithi152.stdout:8/572: fdatasync d3/da7/fb6 0 2023-12-07T16:21:38.559 INFO:tasks.workunit.client.1.smithi152.stdout:3/516: rmdir d7/d10/d41/d96 0 2023-12-07T16:21:38.559 INFO:tasks.workunit.client.1.smithi152.stdout:3/517: dread - d7/d10/d1a/d25/f27 zero size 2023-12-07T16:21:38.559 INFO:tasks.workunit.client.1.smithi152.stdout:6/546: write d2/d4f/d83/d48/f53 [1074028,6668] 0 2023-12-07T16:21:38.559 INFO:tasks.workunit.client.0.smithi063.stdout:3/294: truncate d7/d9/dd/f1f 7581513 0 2023-12-07T16:21:38.561 INFO:tasks.workunit.client.1.smithi152.stdout:2/516: rename d2/d1c/d2e/d38 to d2/d1c/d2e/d57/db1 0 2023-12-07T16:21:38.562 INFO:tasks.workunit.client.1.smithi152.stdout:9/576: creat d1/d9/d4f/daf/fc2 x:0 0 0 2023-12-07T16:21:38.563 INFO:tasks.workunit.client.1.smithi152.stdout:6/547: link d2/d4f/d83/d85/de/d2e/d4c/lad d2/laf 0 2023-12-07T16:21:38.565 INFO:tasks.workunit.client.0.smithi063.stdout:3/295: write d7/d9/d2b/f43 [240661,101111] 0 2023-12-07T16:21:38.566 INFO:tasks.workunit.client.1.smithi152.stdout:3/518: rename d7/dc/d3e/d6b/f7b to d7/d10/d1a/d25/d4b/fa4 0 2023-12-07T16:21:38.566 INFO:tasks.workunit.client.1.smithi152.stdout:3/519: write d7/d10/d1a/d2f/f82 [5187276,77359] 0 2023-12-07T16:21:38.566 INFO:tasks.workunit.client.1.smithi152.stdout:3/520: fdatasync d7/d10/d1a/d25/f76 0 2023-12-07T16:21:38.569 INFO:tasks.workunit.client.0.smithi063.stdout:3/296: rename d7/d9/dd/f1c to d7/d49/d4b/f5e 0 2023-12-07T16:21:38.570 INFO:tasks.workunit.client.1.smithi152.stdout:9/577: rename d1/d17/f9d to d1/d17/d3c/d4a/d48/d8c/fc3 0 2023-12-07T16:21:38.571 INFO:tasks.workunit.client.0.smithi063.stdout:3/297: symlink d7/d21/l5f 0 2023-12-07T16:21:38.571 INFO:tasks.workunit.client.1.smithi152.stdout:9/578: creat d1/d9/d4f/fc4 x:0 0 0 2023-12-07T16:21:38.572 INFO:tasks.workunit.client.1.smithi152.stdout:9/579: dread - d1/d9/d4f/fc4 zero size 2023-12-07T16:21:38.572 INFO:tasks.workunit.client.1.smithi152.stdout:9/580: creat d1/d17/d3c/d4a/d7e/fc5 x:0 0 0 2023-12-07T16:21:38.572 INFO:tasks.workunit.client.1.smithi152.stdout:9/581: truncate d1/d9/db/d70/f98 684605 0 2023-12-07T16:21:38.573 INFO:tasks.workunit.client.0.smithi063.stdout:1/246: dwrite d0/dd/d10/d1e/f52 [0,4194304] 0 2023-12-07T16:21:38.574 INFO:tasks.workunit.client.1.smithi152.stdout:9/582: truncate d1/d9/db/df/f27 1897417 0 2023-12-07T16:21:38.575 INFO:tasks.workunit.client.0.smithi063.stdout:3/298: unlink d7/d21/f25 0 2023-12-07T16:21:38.577 INFO:tasks.workunit.client.1.smithi152.stdout:9/583: unlink d1/d17/d3c/d4a/d48/f52 0 2023-12-07T16:21:38.577 INFO:tasks.workunit.client.1.smithi152.stdout:9/584: chown d1/d9/db/l6d 791 1 2023-12-07T16:21:38.577 INFO:tasks.workunit.client.1.smithi152.stdout:9/585: stat d1/d17/d3c/d4a/l7d 0 2023-12-07T16:21:38.577 INFO:tasks.workunit.client.1.smithi152.stdout:9/586: chown d1/f3a 5803642 1 2023-12-07T16:21:38.578 INFO:tasks.workunit.client.0.smithi063.stdout:1/247: rename d0/c6 to d0/dd/d19/d50/c53 0 2023-12-07T16:21:38.579 INFO:tasks.workunit.client.1.smithi152.stdout:2/517: write f1 [573632,112637] 0 2023-12-07T16:21:38.579 INFO:tasks.workunit.client.1.smithi152.stdout:8/573: dread d3/f1d [0,4194304] 0 2023-12-07T16:21:38.579 INFO:tasks.workunit.client.1.smithi152.stdout:9/587: mkdir d1/d17/d3c/d4a/dc6 0 2023-12-07T16:21:38.581 INFO:tasks.workunit.client.1.smithi152.stdout:8/574: mkdir d3/d4/d9/d23/d4c/da6/db2/dc3/dcd 0 2023-12-07T16:21:38.581 INFO:tasks.workunit.client.1.smithi152.stdout:8/575: stat d3/d4/l9e 0 2023-12-07T16:21:38.581 INFO:tasks.workunit.client.0.smithi063.stdout:3/299: rmdir d7/d9/d2b 39 2023-12-07T16:21:38.581 INFO:tasks.workunit.client.0.smithi063.stdout:3/300: fdatasync d7/f4c 0 2023-12-07T16:21:38.582 INFO:tasks.workunit.client.0.smithi063.stdout:1/248: symlink d0/dd/d10/d46/l54 0 2023-12-07T16:21:38.582 INFO:tasks.workunit.client.1.smithi152.stdout:9/588: symlink d1/d17/d58/d86/lc7 0 2023-12-07T16:21:38.582 INFO:tasks.workunit.client.1.smithi152.stdout:9/589: truncate d1/d17/d3c/d4a/d48/f91 4778148 0 2023-12-07T16:21:38.584 INFO:tasks.workunit.client.1.smithi152.stdout:9/590: creat d1/d9/d4f/fc8 x:0 0 0 2023-12-07T16:21:38.584 INFO:tasks.workunit.client.1.smithi152.stdout:8/576: write d3/d1e/f44 [4036766,94976] 0 2023-12-07T16:21:38.584 INFO:tasks.workunit.client.0.smithi063.stdout:3/301: mkdir d7/d9/dd/d60 0 2023-12-07T16:21:38.584 INFO:tasks.workunit.client.0.smithi063.stdout:3/302: dread - d7/d21/f34 zero size 2023-12-07T16:21:38.585 INFO:tasks.workunit.client.1.smithi152.stdout:9/591: creat d1/d17/d3c/fc9 x:0 0 0 2023-12-07T16:21:38.586 INFO:tasks.workunit.client.0.smithi063.stdout:3/303: symlink d7/d4f/d53/d54/l61 0 2023-12-07T16:21:38.586 INFO:tasks.workunit.client.1.smithi152.stdout:9/592: symlink d1/d17/d38/d53/lca 0 2023-12-07T16:21:38.587 INFO:tasks.workunit.client.1.smithi152.stdout:9/593: creat d1/d17/d3c/d4a/d48/fcb x:0 0 0 2023-12-07T16:21:38.590 INFO:tasks.workunit.client.1.smithi152.stdout:9/594: write d1/d17/d3c/d4a/d7e/f9f [2781060,90388] 0 2023-12-07T16:21:38.590 INFO:tasks.workunit.client.1.smithi152.stdout:9/595: fdatasync d1/d17/d3c/fc9 0 2023-12-07T16:21:38.593 INFO:tasks.workunit.client.1.smithi152.stdout:9/596: mkdir d1/d9/d2d/dcc 0 2023-12-07T16:21:38.593 INFO:tasks.workunit.client.1.smithi152.stdout:9/597: readlink d1/d9/db/df/da6/l45 0 2023-12-07T16:21:38.596 INFO:tasks.workunit.client.1.smithi152.stdout:5/666: dwrite dd/de/f31 [0,4194304] 0 2023-12-07T16:21:38.596 INFO:tasks.workunit.client.1.smithi152.stdout:5/667: stat dd/de/d14/d19/f8c 0 2023-12-07T16:21:38.601 INFO:tasks.workunit.client.0.smithi063.stdout:9/356: dwrite d0/d13/f5d [0,4194304] 0 2023-12-07T16:21:38.601 INFO:tasks.workunit.client.1.smithi152.stdout:0/565: dwrite d0/dc/d3d/f5b [0,4194304] 0 2023-12-07T16:21:38.601 INFO:tasks.workunit.client.1.smithi152.stdout:0/566: chown d0/d2f/f35 249195 1 2023-12-07T16:21:38.601 INFO:tasks.workunit.client.1.smithi152.stdout:0/567: chown d0/dc/d36/d3a/d69/f99 201851455 1 2023-12-07T16:21:38.602 INFO:tasks.workunit.client.1.smithi152.stdout:1/678: dwrite dc/d14/d18/d79/fa1 [0,4194304] 0 2023-12-07T16:21:38.602 INFO:tasks.workunit.client.1.smithi152.stdout:6/548: dwrite d2/d4f/d83/d48/f84 [0,4194304] 0 2023-12-07T16:21:38.602 INFO:tasks.workunit.client.1.smithi152.stdout:8/577: dread d3/d4/d9/f18 [4194304,4194304] 0 2023-12-07T16:21:38.611 INFO:tasks.workunit.client.1.smithi152.stdout:1/679: creat dc/d14/d18/d45/fdf x:0 0 0 2023-12-07T16:21:38.611 INFO:tasks.workunit.client.1.smithi152.stdout:1/680: write dc/d14/d18/d79/f85 [815381,21557] 0 2023-12-07T16:21:38.613 INFO:tasks.workunit.client.1.smithi152.stdout:6/549: truncate d2/d4f/d83/d85/f6a 1051332 0 2023-12-07T16:21:38.614 INFO:tasks.workunit.client.1.smithi152.stdout:5/668: dread dd/de/d14/f42 [0,4194304] 0 2023-12-07T16:21:38.614 INFO:tasks.workunit.client.1.smithi152.stdout:3/521: dwrite d7/dc/d3e/d7d/f99 [0,4194304] 0 2023-12-07T16:21:38.614 INFO:tasks.workunit.client.1.smithi152.stdout:8/578: stat d3/d1e/d40/l4a 0 2023-12-07T16:21:38.616 INFO:tasks.workunit.client.1.smithi152.stdout:1/681: symlink dc/d14/d18/d2d/d4a/le0 0 2023-12-07T16:21:38.617 INFO:tasks.workunit.client.1.smithi152.stdout:6/550: mkdir d2/d4f/d83/d48/da8/db0 0 2023-12-07T16:21:38.619 INFO:tasks.workunit.client.1.smithi152.stdout:5/669: link dd/de/d14/d19/d1a/f92 dd/de/d38/d3d/d6d/dae/de0/fe8 0 2023-12-07T16:21:38.619 INFO:tasks.workunit.client.1.smithi152.stdout:5/670: dread - dd/de/d14/d67/f78 zero size 2023-12-07T16:21:38.620 INFO:tasks.workunit.client.1.smithi152.stdout:8/579: symlink d3/d4/d9/dc/d6f/d7a/d8a/d63/lce 0 2023-12-07T16:21:38.622 INFO:tasks.workunit.client.1.smithi152.stdout:1/682: getdents dc/d14/d18 0 2023-12-07T16:21:38.622 INFO:tasks.workunit.client.1.smithi152.stdout:1/683: readlink la 0 2023-12-07T16:21:38.622 INFO:tasks.workunit.client.1.smithi152.stdout:1/684: readlink dc/d14/d18/l20 0 2023-12-07T16:21:38.623 INFO:tasks.workunit.client.1.smithi152.stdout:5/671: link dd/d7b/f84 dd/de/d14/dc6/db0/fe9 0 2023-12-07T16:21:38.623 INFO:tasks.workunit.client.1.smithi152.stdout:5/672: fsync dd/de/d8f/faa 0 2023-12-07T16:21:38.623 INFO:tasks.workunit.client.1.smithi152.stdout:8/580: symlink d3/d4/d9/d23/d4c/lcf 0 2023-12-07T16:21:38.627 INFO:tasks.workunit.client.1.smithi152.stdout:1/685: mknod dc/d14/d18/d2d/d48/da3/d58/ce1 0 2023-12-07T16:21:38.627 INFO:tasks.workunit.client.1.smithi152.stdout:8/581: creat d3/d1e/fd0 x:0 0 0 2023-12-07T16:21:38.627 INFO:tasks.workunit.client.1.smithi152.stdout:5/673: symlink dd/de/d14/d19/d7a/da6/lea 0 2023-12-07T16:21:38.628 INFO:tasks.workunit.client.1.smithi152.stdout:5/674: unlink dd/d7b/f7d 0 2023-12-07T16:21:38.628 INFO:tasks.workunit.client.1.smithi152.stdout:5/675: truncate dd/de/d14/d19/d1a/d1b/f44 2012097 0 2023-12-07T16:21:38.628 INFO:tasks.workunit.client.0.smithi063.stdout:3/304: dwrite d7/d4f/d53/d54/f58 [0,4194304] 0 2023-12-07T16:21:38.628 INFO:tasks.workunit.client.0.smithi063.stdout:3/305: dread - d7/d4f/d53/f5b zero size 2023-12-07T16:21:38.629 INFO:tasks.workunit.client.1.smithi152.stdout:5/676: creat dd/de/d14/d19/d1a/dcc/feb x:0 0 0 2023-12-07T16:21:38.629 INFO:tasks.workunit.client.1.smithi152.stdout:5/677: chown dd/f40 8368558 1 2023-12-07T16:21:38.630 INFO:tasks.workunit.client.0.smithi063.stdout:3/306: creat d7/d9/d2b/f62 x:0 0 0 2023-12-07T16:21:38.636 INFO:tasks.workunit.client.1.smithi152.stdout:1/686: write dc/d28/d4e/f99 [3542373,22318] 0 2023-12-07T16:21:38.637 INFO:tasks.workunit.client.1.smithi152.stdout:1/687: creat dc/d14/d18/d2d/d48/da3/d58/dde/fe2 x:0 0 0 2023-12-07T16:21:38.638 INFO:tasks.workunit.client.1.smithi152.stdout:1/688: symlink dc/d14/d18/d2d/d4a/le3 0 2023-12-07T16:21:38.638 INFO:tasks.workunit.client.1.smithi152.stdout:1/689: write dc/d14/d18/d64/f8f [499732,127469] 0 2023-12-07T16:21:38.639 INFO:tasks.workunit.client.1.smithi152.stdout:1/690: truncate dc/d14/d18/d2d/d4a/d52/f73 2976438 0 2023-12-07T16:21:38.639 INFO:tasks.workunit.client.1.smithi152.stdout:1/691: write dc/d28/f55 [1968981,44345] 0 2023-12-07T16:21:38.641 INFO:tasks.workunit.client.1.smithi152.stdout:1/692: creat dc/d14/d18/fe4 x:0 0 0 2023-12-07T16:21:38.642 INFO:tasks.workunit.client.1.smithi152.stdout:1/693: mkdir dc/d14/d18/d79/de5 0 2023-12-07T16:21:38.646 INFO:tasks.workunit.client.1.smithi152.stdout:0/568: dwrite d0/f18 [4194304,4194304] 0 2023-12-07T16:21:38.648 INFO:tasks.workunit.client.0.smithi063.stdout:1/249: dwrite d0/dd/d1f/f4e [0,4194304] 0 2023-12-07T16:21:38.649 INFO:tasks.workunit.client.0.smithi063.stdout:3/307: write d7/d9/d2b/f43 [2950704,94760] 0 2023-12-07T16:21:38.651 INFO:tasks.workunit.client.0.smithi063.stdout:1/250: dread d0/dd/d10/d1e/f2c [0,4194304] 0 2023-12-07T16:21:38.652 INFO:tasks.workunit.client.0.smithi063.stdout:3/308: link d7/l17 d7/d9/d1b/d5c/d5d/l63 0 2023-12-07T16:21:38.654 INFO:tasks.workunit.client.0.smithi063.stdout:3/309: rename d7/d9/f40 to d7/d4f/f64 0 2023-12-07T16:21:38.654 INFO:tasks.workunit.client.0.smithi063.stdout:3/310: chown d7/d49/d4b/f5e 3627397 1 2023-12-07T16:21:38.655 INFO:tasks.workunit.client.0.smithi063.stdout:3/311: mknod d7/d9/dd/d56/c65 0 2023-12-07T16:21:38.655 INFO:tasks.workunit.client.0.smithi063.stdout:3/312: chown d7/d4f 392882 1 2023-12-07T16:21:38.656 INFO:tasks.workunit.client.0.smithi063.stdout:3/313: stat d7/d9/c4a 0 2023-12-07T16:21:38.657 INFO:tasks.workunit.client.0.smithi063.stdout:9/357: dwrite d0/d13/f5d [0,4194304] 0 2023-12-07T16:21:38.658 INFO:tasks.workunit.client.1.smithi152.stdout:6/551: dwrite d2/d4f/d83/d85/de/d3f/f40 [0,4194304] 0 2023-12-07T16:21:38.658 INFO:tasks.workunit.client.1.smithi152.stdout:5/678: dwrite dd/de/d14/d19/d74/fdd [0,4194304] 0 2023-12-07T16:21:38.658 INFO:tasks.workunit.client.0.smithi063.stdout:9/358: write d0/d7/ff [8121922,128103] 0 2023-12-07T16:21:38.659 INFO:tasks.workunit.client.0.smithi063.stdout:3/314: rename f5 to d7/d9/dd/f66 0 2023-12-07T16:21:38.668 INFO:tasks.workunit.client.1.smithi152.stdout:6/552: creat d2/d4f/d83/d85/d94/fb1 x:0 0 0 2023-12-07T16:21:38.668 INFO:tasks.workunit.client.0.smithi063.stdout:9/359: dread d0/f67 [0,4194304] 0 2023-12-07T16:21:38.668 INFO:tasks.workunit.client.0.smithi063.stdout:9/360: creat d0/f73 x:0 0 0 2023-12-07T16:21:38.670 INFO:tasks.workunit.client.0.smithi063.stdout:9/361: creat d0/d13/d39/d3a/f74 x:0 0 0 2023-12-07T16:21:38.678 INFO:tasks.workunit.client.1.smithi152.stdout:5/679: creat dd/de/d38/d3d/dd3/fec x:0 0 0 2023-12-07T16:21:38.678 INFO:tasks.workunit.client.1.smithi152.stdout:5/680: fdatasync dd/de/d14/d19/d74/fdd 0 2023-12-07T16:21:38.678 INFO:tasks.workunit.client.1.smithi152.stdout:5/681: chown dd/de/d14/d19/d1a/cba 948 1 2023-12-07T16:21:38.683 INFO:tasks.workunit.client.1.smithi152.stdout:6/553: creat d2/d4f/d83/d48/da8/fb2 x:0 0 0 2023-12-07T16:21:38.683 INFO:tasks.workunit.client.1.smithi152.stdout:5/682: write dd/de/d14/d19/d1a/d1b/f44 [1838682,129372] 0 2023-12-07T16:21:38.683 INFO:tasks.workunit.client.1.smithi152.stdout:6/554: read d2/d4f/d83/d85/d19/f22 [243296,17726] 0 2023-12-07T16:21:38.684 INFO:tasks.workunit.client.1.smithi152.stdout:6/555: read - d2/d4f/d83/d48/f8d zero size 2023-12-07T16:21:38.684 INFO:tasks.workunit.client.1.smithi152.stdout:9/598: dwrite d1/d9/db/df/f27 [0,4194304] 0 2023-12-07T16:21:38.684 INFO:tasks.workunit.client.1.smithi152.stdout:5/683: truncate fc 8923733 0 2023-12-07T16:21:38.684 INFO:tasks.workunit.client.1.smithi152.stdout:5/684: fsync dd/ddb/fe7 0 2023-12-07T16:21:38.685 INFO:tasks.workunit.client.1.smithi152.stdout:6/556: mknod d2/d4f/d83/d85/de/cb3 0 2023-12-07T16:21:38.686 INFO:tasks.workunit.client.0.smithi063.stdout:1/251: dwrite d0/f4 [4194304,4194304] 0 2023-12-07T16:21:38.686 INFO:tasks.workunit.client.1.smithi152.stdout:9/599: truncate d1/d9/db/df/d42/f93 34055 0 2023-12-07T16:21:38.686 INFO:tasks.workunit.client.1.smithi152.stdout:9/600: fdatasync d1/d9/d2d/d65/fbb 0 2023-12-07T16:21:38.687 INFO:tasks.workunit.client.0.smithi063.stdout:1/252: truncate d0/dd/f42 2411742 0 2023-12-07T16:21:38.687 INFO:tasks.workunit.client.1.smithi152.stdout:9/601: read d1/d17/d3c/d4a/d48/d8c/fb2 [1447452,40587] 0 2023-12-07T16:21:38.689 INFO:tasks.workunit.client.1.smithi152.stdout:5/685: rename dd/d91/cd8 to dd/de/ced 0 2023-12-07T16:21:38.689 INFO:tasks.workunit.client.1.smithi152.stdout:5/686: fsync dd/de/d8f/faa 0 2023-12-07T16:21:38.691 INFO:tasks.workunit.client.1.smithi152.stdout:6/557: unlink d2/d4f/d83/d48/da8/fb2 0 2023-12-07T16:21:38.692 INFO:tasks.workunit.client.1.smithi152.stdout:9/602: creat d1/d9/db/df/d42/fcd x:0 0 0 2023-12-07T16:21:38.693 INFO:tasks.workunit.client.0.smithi063.stdout:9/362: dwrite d0/d21/f23 [0,4194304] 0 2023-12-07T16:21:38.694 INFO:tasks.workunit.client.1.smithi152.stdout:6/558: unlink d2/d4f/d83/d48/f84 0 2023-12-07T16:21:38.695 INFO:tasks.workunit.client.1.smithi152.stdout:6/559: write d2/d4f/d83/d85/de/d2e/f41 [1871032,31378] 0 2023-12-07T16:21:38.695 INFO:tasks.workunit.client.1.smithi152.stdout:6/560: truncate d2/d4f/d83/d85/de/d2e/d4c/d5d/f9b 247670 0 2023-12-07T16:21:38.696 INFO:tasks.workunit.client.1.smithi152.stdout:9/603: mknod d1/d17/d3c/d4a/d7e/cce 0 2023-12-07T16:21:38.697 INFO:tasks.workunit.client.1.smithi152.stdout:6/561: symlink d2/d4f/d83/d85/de/d45/lb4 0 2023-12-07T16:21:38.699 INFO:tasks.workunit.client.1.smithi152.stdout:9/604: symlink d1/d9/db/df/d42/lcf 0 2023-12-07T16:21:38.699 INFO:tasks.workunit.client.1.smithi152.stdout:9/605: fdatasync d1/d9/d2d/d65/f6f 0 2023-12-07T16:21:38.699 INFO:tasks.workunit.client.1.smithi152.stdout:9/606: stat d1/dd/la1 0 2023-12-07T16:21:38.700 INFO:tasks.workunit.client.1.smithi152.stdout:6/562: mkdir d2/d4f/d83/d85/de/d3f/da1/db5 0 2023-12-07T16:21:38.705 INFO:tasks.workunit.client.1.smithi152.stdout:4/465: sync 2023-12-07T16:21:38.707 INFO:tasks.workunit.client.1.smithi152.stdout:7/503: sync 2023-12-07T16:21:38.711 INFO:tasks.workunit.client.1.smithi152.stdout:4/466: creat d0/d3/d6/d36/f82 x:0 0 0 2023-12-07T16:21:38.714 INFO:tasks.workunit.client.1.smithi152.stdout:4/467: dread d0/d3/d6/d5c/f74 [0,4194304] 0 2023-12-07T16:21:38.744 INFO:tasks.workunit.client.1.smithi152.stdout:9/607: dwrite d1/d9/db/f79 [0,4194304] 0 2023-12-07T16:21:38.745 INFO:tasks.workunit.client.1.smithi152.stdout:6/563: dwrite d2/d4f/d83/d85/d19/d1f/f47 [0,4194304] 0 2023-12-07T16:21:38.745 INFO:tasks.workunit.client.0.smithi063.stdout:9/363: dwrite d0/d7/f2a [8388608,4194304] 0 2023-12-07T16:21:38.745 INFO:tasks.workunit.client.1.smithi152.stdout:9/608: readlink d1/d17/d58/d86/lc7 0 2023-12-07T16:21:38.748 INFO:tasks.workunit.client.1.smithi152.stdout:5/687: dwrite dd/de/f13 [0,4194304] 0 2023-12-07T16:21:38.748 INFO:tasks.workunit.client.1.smithi152.stdout:5/688: chown dd/de/d14/d1f/d28/c3b 285232 1 2023-12-07T16:21:38.748 INFO:tasks.workunit.client.1.smithi152.stdout:5/689: stat dd/de/d38/d3d/l4e 0 2023-12-07T16:21:38.748 INFO:tasks.workunit.client.1.smithi152.stdout:5/690: truncate dd/de/d14/d19/d1a/fc7 960514 0 2023-12-07T16:21:38.748 INFO:tasks.workunit.client.1.smithi152.stdout:4/468: dwrite d0/d3/d6/dc/dd/f24 [0,4194304] 0 2023-12-07T16:21:38.748 INFO:tasks.workunit.client.1.smithi152.stdout:4/469: fdatasync d0/d3/d6/dc/d3a/f58 0 2023-12-07T16:21:38.748 INFO:tasks.workunit.client.1.smithi152.stdout:6/564: creat d2/d4f/d83/d48/d70/da7/fb6 x:0 0 0 2023-12-07T16:21:38.749 INFO:tasks.workunit.client.1.smithi152.stdout:7/504: dwrite db/d27/d39/d41/d37/f67 [0,4194304] 0 2023-12-07T16:21:38.749 INFO:tasks.workunit.client.1.smithi152.stdout:9/609: dread d1/d17/d3c/d4a/d48/f56 [0,4194304] 0 2023-12-07T16:21:38.749 INFO:tasks.workunit.client.1.smithi152.stdout:7/505: readlink db/d27/d4d/l8f 0 2023-12-07T16:21:38.750 INFO:tasks.workunit.client.1.smithi152.stdout:5/691: creat dd/de/d8f/fee x:0 0 0 2023-12-07T16:21:38.750 INFO:tasks.workunit.client.1.smithi152.stdout:4/470: mkdir d0/d3/d6/d2b/d56/d83 0 2023-12-07T16:21:38.750 INFO:tasks.workunit.client.1.smithi152.stdout:4/471: chown d0/d3/f2d 9503 1 2023-12-07T16:21:38.751 INFO:tasks.workunit.client.1.smithi152.stdout:4/472: fsync d0/d3/d6/f26 0 2023-12-07T16:21:38.752 INFO:tasks.workunit.client.1.smithi152.stdout:6/565: unlink d2/d4f/d83/d85/de/d45/f6e 0 2023-12-07T16:21:38.754 INFO:tasks.workunit.client.1.smithi152.stdout:7/506: symlink db/d68/l98 0 2023-12-07T16:21:38.754 INFO:tasks.workunit.client.1.smithi152.stdout:9/610: symlink d1/d9/db/df/ld0 0 2023-12-07T16:21:38.758 INFO:tasks.workunit.client.1.smithi152.stdout:5/692: rename dd/de/d14/d1f/d28 to dd/de/d14/d19/d1a/def 0 2023-12-07T16:21:38.760 INFO:tasks.workunit.client.1.smithi152.stdout:6/566: rename d2/d4f/d83/d85/de/d2e/d38 to d2/d4f/d83/d48/d70/da7/db7 0 2023-12-07T16:21:38.762 INFO:tasks.workunit.client.1.smithi152.stdout:5/693: mkdir dd/de/d38/d3d/dd3/df0 0 2023-12-07T16:21:38.763 INFO:tasks.workunit.client.1.smithi152.stdout:6/567: creat d2/d4f/d83/d85/de/d2e/d4c/d5d/fb8 x:0 0 0 2023-12-07T16:21:38.763 INFO:tasks.workunit.client.1.smithi152.stdout:6/568: readlink d2/d4f/d83/d58/l5b 0 2023-12-07T16:21:38.763 INFO:tasks.workunit.client.1.smithi152.stdout:6/569: fdatasync d2/d4f/d83/d85/de/fa4 0 2023-12-07T16:21:38.765 INFO:tasks.workunit.client.1.smithi152.stdout:6/570: truncate d2/d4f/d83/d85/d19/f46 240796 0 2023-12-07T16:21:38.767 INFO:tasks.workunit.client.1.smithi152.stdout:6/571: rmdir d2/d4f/d83/d48/da8/db0 0 2023-12-07T16:21:38.769 INFO:tasks.workunit.client.0.smithi063.stdout:9/364: dread d0/d13/f2b [0,4194304] 0 2023-12-07T16:21:38.769 INFO:tasks.workunit.client.1.smithi152.stdout:6/572: mknod d2/d4f/d83/d85/de/d2e/cb9 0 2023-12-07T16:21:38.770 INFO:tasks.workunit.client.0.smithi063.stdout:9/365: link d0/d21/d64/f4a d0/d21/d64/d6a/f75 0 2023-12-07T16:21:38.770 INFO:tasks.workunit.client.1.smithi152.stdout:4/473: dwrite d0/d17/f79 [0,4194304] 0 2023-12-07T16:21:38.772 INFO:tasks.workunit.client.0.smithi063.stdout:9/366: creat d0/d13/d39/d42/d57/f76 x:0 0 0 2023-12-07T16:21:38.775 INFO:tasks.workunit.client.0.smithi063.stdout:9/367: rename d0/d21/d64/f44 to d0/d13/d39/d42/f77 0 2023-12-07T16:21:38.778 INFO:tasks.workunit.client.1.smithi152.stdout:4/474: creat d0/d3/d6/dc/d3a/d46/d4e/f84 x:0 0 0 2023-12-07T16:21:38.778 INFO:tasks.workunit.client.1.smithi152.stdout:4/475: chown d0/d3/d6/f26 56 1 2023-12-07T16:21:38.779 INFO:tasks.workunit.client.0.smithi063.stdout:9/368: mkdir d0/d13/d39/d3a/d78 0 2023-12-07T16:21:38.779 INFO:tasks.workunit.client.0.smithi063.stdout:9/369: chown d0/d7/f6d 28547418 1 2023-12-07T16:21:38.781 INFO:tasks.workunit.client.1.smithi152.stdout:4/476: rename d0/d3/d6/d5c to d0/d3/d6/d36/d85 0 2023-12-07T16:21:38.781 INFO:tasks.workunit.client.1.smithi152.stdout:5/694: dread dd/de/d38/f43 [0,4194304] 0 2023-12-07T16:21:38.781 INFO:tasks.workunit.client.1.smithi152.stdout:4/477: creat d0/d17/d7f/f86 x:0 0 0 2023-12-07T16:21:38.785 INFO:tasks.workunit.client.0.smithi063.stdout:6/365: sync 2023-12-07T16:21:38.785 INFO:tasks.workunit.client.0.smithi063.stdout:4/286: sync 2023-12-07T16:21:38.785 INFO:tasks.workunit.client.0.smithi063.stdout:0/399: sync 2023-12-07T16:21:38.786 INFO:tasks.workunit.client.0.smithi063.stdout:6/366: readlink d0/d17/d1a/d4d/d5a/l71 0 2023-12-07T16:21:38.786 INFO:tasks.workunit.client.0.smithi063.stdout:4/287: rmdir d1/d3/db/d13 39 2023-12-07T16:21:38.786 INFO:tasks.workunit.client.0.smithi063.stdout:4/288: chown d1/d3/db/d16/f37 8171 1 2023-12-07T16:21:38.786 INFO:tasks.workunit.client.0.smithi063.stdout:4/289: fdatasync d1/d3/db/d13/f1c 0 2023-12-07T16:21:38.788 INFO:tasks.workunit.client.0.smithi063.stdout:0/400: creat d4/dd/de/d15/d52/d5b/d63/f80 x:0 0 0 2023-12-07T16:21:38.789 INFO:tasks.workunit.client.0.smithi063.stdout:0/401: creat d4/dd/de/d15/d52/f81 x:0 0 0 2023-12-07T16:21:38.790 INFO:tasks.workunit.client.0.smithi063.stdout:0/402: creat d4/dd/de/d15/d1f/d61/f82 x:0 0 0 2023-12-07T16:21:38.795 INFO:tasks.workunit.client.0.smithi063.stdout:6/367: dread d0/d17/d1a/f1c [0,4194304] 0 2023-12-07T16:21:38.796 INFO:tasks.workunit.client.0.smithi063.stdout:6/368: creat d0/d1e/d1d/d4f/f84 x:0 0 0 2023-12-07T16:21:38.797 INFO:tasks.workunit.client.0.smithi063.stdout:6/369: write d0/d1e/d1d/d4f/f84 [736781,65481] 0 2023-12-07T16:21:38.798 INFO:tasks.workunit.client.0.smithi063.stdout:4/290: dread d1/d3/db/d13/f1c [0,4194304] 0 2023-12-07T16:21:38.799 INFO:tasks.workunit.client.0.smithi063.stdout:4/291: link d1/d3/d3a/l42 d1/d3/d3f/d44/l50 0 2023-12-07T16:21:38.800 INFO:tasks.workunit.client.0.smithi063.stdout:6/370: write d0/f15 [158842,46490] 0 2023-12-07T16:21:38.800 INFO:tasks.workunit.client.0.smithi063.stdout:4/292: mkdir d1/d3/d51 0 2023-12-07T16:21:38.800 INFO:tasks.workunit.client.0.smithi063.stdout:4/293: read - d1/d3/db/f38 zero size 2023-12-07T16:21:38.800 INFO:tasks.workunit.client.0.smithi063.stdout:4/294: truncate d1/d3/db/d16/f37 484971 0 2023-12-07T16:21:38.801 INFO:tasks.workunit.client.1.smithi152.stdout:7/507: dwrite f8 [0,4194304] 0 2023-12-07T16:21:38.801 INFO:tasks.workunit.client.1.smithi152.stdout:9/611: dwrite d1/d9/d2d/f84 [0,4194304] 0 2023-12-07T16:21:38.801 INFO:tasks.workunit.client.0.smithi063.stdout:6/371: getdents d0/d1e/d60/d68/d69 0 2023-12-07T16:21:38.802 INFO:tasks.workunit.client.1.smithi152.stdout:7/508: mknod db/d27/d5e/c99 0 2023-12-07T16:21:38.802 INFO:tasks.workunit.client.1.smithi152.stdout:7/509: write f6 [12765772,29067] 0 2023-12-07T16:21:38.804 INFO:tasks.workunit.client.0.smithi063.stdout:8/460: sync 2023-12-07T16:21:38.804 INFO:tasks.workunit.client.0.smithi063.stdout:5/315: sync 2023-12-07T16:21:38.805 INFO:tasks.workunit.client.1.smithi152.stdout:6/573: dwrite d2/d4f/d83/d85/f95 [0,4194304] 0 2023-12-07T16:21:38.805 INFO:tasks.workunit.client.1.smithi152.stdout:6/574: write d2/d4f/d83/d85/de/d3f/f8c [626558,25876] 0 2023-12-07T16:21:38.805 INFO:tasks.workunit.client.1.smithi152.stdout:7/510: read db/d27/d5e/f48 [3120998,12738] 0 2023-12-07T16:21:38.805 INFO:tasks.workunit.client.1.smithi152.stdout:5/695: dwrite dd/de/d38/f43 [0,4194304] 0 2023-12-07T16:21:38.805 INFO:tasks.workunit.client.1.smithi152.stdout:9/612: creat d1/d17/d3c/d4a/dc6/fd1 x:0 0 0 2023-12-07T16:21:38.806 INFO:tasks.workunit.client.1.smithi152.stdout:9/613: chown d1 0 1 2023-12-07T16:21:38.806 INFO:tasks.workunit.client.0.smithi063.stdout:5/316: creat d1/d31/d56/f62 x:0 0 0 2023-12-07T16:21:38.813 INFO:tasks.workunit.client.1.smithi152.stdout:4/478: rmdir d0/d17 39 2023-12-07T16:21:38.815 INFO:tasks.workunit.client.0.smithi063.stdout:5/317: getdents d1/d3/de/d1e/d25 0 2023-12-07T16:21:38.815 INFO:tasks.workunit.client.0.smithi063.stdout:5/318: fsync d1/f18 0 2023-12-07T16:21:38.815 INFO:tasks.workunit.client.0.smithi063.stdout:5/319: chown d1/d3/de/d1e 5829614 1 2023-12-07T16:21:38.818 INFO:tasks.workunit.client.0.smithi063.stdout:5/320: mknod d1/d3/de/d1e/c63 0 2023-12-07T16:21:38.819 INFO:tasks.workunit.client.1.smithi152.stdout:5/696: mknod dd/d7b/dbf/cf1 0 2023-12-07T16:21:38.819 INFO:tasks.workunit.client.1.smithi152.stdout:5/697: readlink dd/de/d38/d3d/l8e 0 2023-12-07T16:21:38.819 INFO:tasks.workunit.client.1.smithi152.stdout:5/698: truncate dd/ddb/fe7 936569 0 2023-12-07T16:21:38.819 INFO:tasks.workunit.client.1.smithi152.stdout:5/699: fsync dd/de/d8f/dc9/fd7 0 2023-12-07T16:21:38.821 INFO:tasks.workunit.client.1.smithi152.stdout:9/614: rename d1/c34 to d1/d17/d58/d86/cd2 0 2023-12-07T16:21:38.821 INFO:tasks.workunit.client.1.smithi152.stdout:9/615: fdatasync d1/d17/d3c/fa7 0 2023-12-07T16:21:38.822 INFO:tasks.workunit.client.0.smithi063.stdout:5/321: link d1/f5c d1/d31/d56/d61/f64 0 2023-12-07T16:21:38.823 INFO:tasks.workunit.client.1.smithi152.stdout:9/616: mkdir d1/d9/d4f/dd3 0 2023-12-07T16:21:38.826 INFO:tasks.workunit.client.1.smithi152.stdout:9/617: rename d1/d9/d4f/d74 to d1/d9/db/df/dd4 0 2023-12-07T16:21:38.826 INFO:tasks.workunit.client.1.smithi152.stdout:9/618: dread - d1/d9/d4f/daf/fc2 zero size 2023-12-07T16:21:38.826 INFO:tasks.workunit.client.0.smithi063.stdout:5/322: rename d1/d3/de/f28 to d1/f65 0 2023-12-07T16:21:38.828 INFO:tasks.workunit.client.1.smithi152.stdout:9/619: creat d1/d17/fd5 x:0 0 0 2023-12-07T16:21:38.828 INFO:tasks.workunit.client.0.smithi063.stdout:5/323: creat d1/d3/d3a/d5a/f66 x:0 0 0 2023-12-07T16:21:38.829 INFO:tasks.workunit.client.0.smithi063.stdout:5/324: chown d1/d3/de 51068 1 2023-12-07T16:21:38.830 INFO:tasks.workunit.client.0.smithi063.stdout:5/325: creat d1/d31/d56/f67 x:0 0 0 2023-12-07T16:21:38.833 INFO:tasks.workunit.client.0.smithi063.stdout:5/326: mkdir d1/d3/d3a/d68 0 2023-12-07T16:21:38.833 INFO:tasks.workunit.client.0.smithi063.stdout:5/327: chown d1/d3/de/c4b 7323929 1 2023-12-07T16:21:38.833 INFO:tasks.workunit.client.1.smithi152.stdout:9/620: rmdir d1/d9/d4f/daf 39 2023-12-07T16:21:38.835 INFO:tasks.workunit.client.1.smithi152.stdout:9/621: mkdir d1/dd/dd6 0 2023-12-07T16:21:38.835 INFO:tasks.workunit.client.1.smithi152.stdout:9/622: fsync d1/d17/d3c/f5f 0 2023-12-07T16:21:38.835 INFO:tasks.workunit.client.1.smithi152.stdout:9/623: dread - d1/d17/d3c/d4a/d7e/f9b zero size 2023-12-07T16:21:38.835 INFO:tasks.workunit.client.1.smithi152.stdout:9/624: chown d1/d9/d2d/d46 1009351 1 2023-12-07T16:21:38.835 INFO:tasks.workunit.client.1.smithi152.stdout:9/625: write d1/d17/d3c/fc9 [111334,16285] 0 2023-12-07T16:21:38.843 INFO:tasks.workunit.client.1.smithi152.stdout:9/626: write d1/d9/db/d70/fb3 [1526761,76412] 0 2023-12-07T16:21:38.844 INFO:tasks.workunit.client.1.smithi152.stdout:9/627: fdatasync d1/d17/d3c/d4a/d48/f56 0 2023-12-07T16:21:38.845 INFO:tasks.workunit.client.1.smithi152.stdout:5/700: dread dd/de/d38/d3d/d6d/f90 [0,4194304] 0 2023-12-07T16:21:38.848 INFO:tasks.workunit.client.1.smithi152.stdout:5/701: dread dd/de/d14/d19/f6c [0,4194304] 0 2023-12-07T16:21:38.848 INFO:tasks.workunit.client.1.smithi152.stdout:5/702: mkdir dd/de/d8f/df2 0 2023-12-07T16:21:38.850 INFO:tasks.workunit.client.0.smithi063.stdout:4/295: dwrite d1/d3/db/f38 [0,4194304] 0 2023-12-07T16:21:38.850 INFO:tasks.workunit.client.0.smithi063.stdout:4/296: readlink d1/d3/l19 0 2023-12-07T16:21:38.850 INFO:tasks.workunit.client.1.smithi152.stdout:5/703: rename dd/de/d14/d19/f6c to dd/de/d14/d19/d7a/ff3 0 2023-12-07T16:21:38.850 INFO:tasks.workunit.client.1.smithi152.stdout:5/704: readlink dd/de/d14/d1f/d49/ld5 0 2023-12-07T16:21:38.850 INFO:tasks.workunit.client.1.smithi152.stdout:5/705: chown dd/f2b 108 1 2023-12-07T16:21:38.851 INFO:tasks.workunit.client.1.smithi152.stdout:5/706: mknod dd/de/d38/d3d/dd3/df0/cf4 0 2023-12-07T16:21:38.851 INFO:tasks.workunit.client.1.smithi152.stdout:5/707: readlink dd/de/l22 0 2023-12-07T16:21:38.852 INFO:tasks.workunit.client.0.smithi063.stdout:4/297: creat d1/d3/db/d41/f52 x:0 0 0 2023-12-07T16:21:38.852 INFO:tasks.workunit.client.1.smithi152.stdout:5/708: getdents dd/de/d38/d3d/d6d/dae 0 2023-12-07T16:21:38.853 INFO:tasks.workunit.client.0.smithi063.stdout:4/298: truncate d1/d3/db/d13/f45 1868824 0 2023-12-07T16:21:38.855 INFO:tasks.workunit.client.1.smithi152.stdout:5/709: dread dd/de/d8f/dc9/fd7 [0,4194304] 0 2023-12-07T16:21:38.855 INFO:tasks.workunit.client.1.smithi152.stdout:5/710: dread - dd/de/d14/d1f/d49/fe1 zero size 2023-12-07T16:21:38.856 INFO:tasks.workunit.client.1.smithi152.stdout:5/711: mknod dd/de/d14/d19/d1a/cf5 0 2023-12-07T16:21:38.857 INFO:tasks.workunit.client.1.smithi152.stdout:5/712: creat dd/de/d14/dc6/ff6 x:0 0 0 2023-12-07T16:21:38.860 INFO:tasks.workunit.client.1.smithi152.stdout:5/713: creat dd/de/d14/ff7 x:0 0 0 2023-12-07T16:21:38.861 INFO:tasks.workunit.client.1.smithi152.stdout:8/582: sync 2023-12-07T16:21:38.862 INFO:tasks.workunit.client.1.smithi152.stdout:3/522: sync 2023-12-07T16:21:38.862 INFO:tasks.workunit.client.1.smithi152.stdout:2/518: sync 2023-12-07T16:21:38.862 INFO:tasks.workunit.client.1.smithi152.stdout:2/519: readlink d2/d1c/d2e/d30/l6c 0 2023-12-07T16:21:38.862 INFO:tasks.workunit.client.1.smithi152.stdout:3/523: chown d7/d10/d1a/d2f/d5c 446107 1 2023-12-07T16:21:38.862 INFO:tasks.workunit.client.1.smithi152.stdout:1/694: sync 2023-12-07T16:21:38.862 INFO:tasks.workunit.client.1.smithi152.stdout:0/569: sync 2023-12-07T16:21:38.862 INFO:tasks.workunit.client.1.smithi152.stdout:8/583: write d3/d4/d9/dc/d6f/d7a/d8a/d63/f91 [476151,92991] 0 2023-12-07T16:21:38.862 INFO:tasks.workunit.client.1.smithi152.stdout:0/570: fdatasync d0/dc/f22 0 2023-12-07T16:21:38.862 INFO:tasks.workunit.client.1.smithi152.stdout:0/571: write d0/f9 [1017222,2902] 0 2023-12-07T16:21:38.862 INFO:tasks.workunit.client.1.smithi152.stdout:5/714: mknod dd/de/d14/d19/d1a/def/cf8 0 2023-12-07T16:21:38.862 INFO:tasks.workunit.client.1.smithi152.stdout:3/524: creat d7/dc/d3e/d7d/fa5 x:0 0 0 2023-12-07T16:21:38.864 INFO:tasks.workunit.client.1.smithi152.stdout:7/511: dwrite db/d27/d39/d41/d58/f55 [0,4194304] 0 2023-12-07T16:21:38.865 INFO:tasks.workunit.client.1.smithi152.stdout:1/695: rename dc/d14/f9e to dc/d14/d18/d2d/d91/fe6 0 2023-12-07T16:21:38.865 INFO:tasks.workunit.client.1.smithi152.stdout:8/584: creat d3/d4/d9/dc/d6f/d7a/d8a/d63/fd1 x:0 0 0 2023-12-07T16:21:38.865 INFO:tasks.workunit.client.1.smithi152.stdout:1/696: write dc/d14/d18/d45/fdf [301885,803] 0 2023-12-07T16:21:38.866 INFO:tasks.workunit.client.1.smithi152.stdout:4/479: dwrite d0/d3/d6/dc/d22/f4f [0,4194304] 0 2023-12-07T16:21:38.866 INFO:tasks.workunit.client.1.smithi152.stdout:6/575: dwrite d2/d4f/d83/f99 [0,4194304] 0 2023-12-07T16:21:38.866 INFO:tasks.workunit.client.1.smithi152.stdout:9/628: dread d1/d9/f23 [0,4194304] 0 2023-12-07T16:21:38.867 INFO:tasks.workunit.client.0.smithi063.stdout:5/328: dwrite d1/d3/de/f10 [4194304,4194304] 0 2023-12-07T16:21:38.867 INFO:tasks.workunit.client.0.smithi063.stdout:8/461: dwrite d7/d14/d1a/f5c [0,4194304] 0 2023-12-07T16:21:38.867 INFO:tasks.workunit.client.0.smithi063.stdout:8/462: truncate d7/d14/d15/d57/f66 4316143 0 2023-12-07T16:21:38.867 INFO:tasks.workunit.client.0.smithi063.stdout:8/463: chown d7/d14/d15/f18 50264 1 2023-12-07T16:21:38.867 INFO:tasks.workunit.client.1.smithi152.stdout:5/715: link dd/de/d38/d3d/l98 dd/de/d38/d3d/dd3/df0/lf9 0 2023-12-07T16:21:38.867 INFO:tasks.workunit.client.1.smithi152.stdout:3/525: truncate f2 4718163 0 2023-12-07T16:21:38.870 INFO:tasks.workunit.client.0.smithi063.stdout:8/464: creat d7/d14/d15/f8b x:0 0 0 2023-12-07T16:21:38.871 INFO:tasks.workunit.client.1.smithi152.stdout:2/520: dread d2/d1c/d2e/d57/f9f [0,4194304] 0 2023-12-07T16:21:38.871 INFO:tasks.workunit.client.1.smithi152.stdout:7/512: creat db/d1c/f9a x:0 0 0 2023-12-07T16:21:38.872 INFO:tasks.workunit.client.0.smithi063.stdout:6/372: dwrite d0/f19 [0,4194304] 0 2023-12-07T16:21:38.872 INFO:tasks.workunit.client.0.smithi063.stdout:6/373: write d0/d54/f56 [19254,74755] 0 2023-12-07T16:21:38.872 INFO:tasks.workunit.client.0.smithi063.stdout:8/465: mknod d7/d14/d15/c8c 0 2023-12-07T16:21:38.876 INFO:tasks.workunit.client.1.smithi152.stdout:0/572: rename d0/dc/d36/d3a/d51/d82/c91 to d0/d27/d11/cc0 0 2023-12-07T16:21:38.879 INFO:tasks.workunit.client.0.smithi063.stdout:6/374: getdents d0/d17/d1a/d4d 0 2023-12-07T16:21:38.881 INFO:tasks.workunit.client.0.smithi063.stdout:6/375: rmdir d0/d1e/d20 39 2023-12-07T16:21:38.882 INFO:tasks.workunit.client.0.smithi063.stdout:6/376: creat d0/d1e/d1d/d1f/d4b/f85 x:0 0 0 2023-12-07T16:21:38.883 INFO:tasks.workunit.client.1.smithi152.stdout:1/697: rmdir dc/d14/d68 39 2023-12-07T16:21:38.883 INFO:tasks.workunit.client.1.smithi152.stdout:9/629: dread d1/d9/d2d/d65/fbb [0,4194304] 0 2023-12-07T16:21:38.884 INFO:tasks.workunit.client.1.smithi152.stdout:2/521: mkdir d2/d1c/d2e/d57/d5b/da7/d9a/da6/db2 0 2023-12-07T16:21:38.884 INFO:tasks.workunit.client.0.smithi063.stdout:6/377: creat d0/d1e/d60/d68/d69/d7d/f86 x:0 0 0 2023-12-07T16:21:38.884 INFO:tasks.workunit.client.0.smithi063.stdout:6/378: chown d0/d17/d1a/d4d/l53 16068 1 2023-12-07T16:21:38.884 INFO:tasks.workunit.client.0.smithi063.stdout:6/379: readlink d0/d17/d1a/d38/l51 0 2023-12-07T16:21:38.886 INFO:tasks.workunit.client.1.smithi152.stdout:7/513: getdents db/d68/d87 0 2023-12-07T16:21:38.886 INFO:tasks.workunit.client.1.smithi152.stdout:3/526: dread d7/dc/d14/f16 [0,4194304] 0 2023-12-07T16:21:38.886 INFO:tasks.workunit.client.1.smithi152.stdout:8/585: mknod d3/d4/d9/dc/d6f/d7b/dbd/cd2 0 2023-12-07T16:21:38.886 INFO:tasks.workunit.client.1.smithi152.stdout:8/586: chown d3/d1e/d43/c6a 8811 1 2023-12-07T16:21:38.887 INFO:tasks.workunit.client.1.smithi152.stdout:0/573: rename d0/dc/l24 to d0/dc/d3d/d73/lc1 0 2023-12-07T16:21:38.887 INFO:tasks.workunit.client.0.smithi063.stdout:6/380: symlink d0/d1e/d2a/l87 0 2023-12-07T16:21:38.887 INFO:tasks.workunit.client.0.smithi063.stdout:6/381: write d0/ff [4415775,107952] 0 2023-12-07T16:21:38.889 INFO:tasks.workunit.client.1.smithi152.stdout:1/698: mknod dc/d14/d18/d79/de5/ce7 0 2023-12-07T16:21:38.891 INFO:tasks.workunit.client.1.smithi152.stdout:6/576: link d2/d4f/d83/d85/d9/f35 d2/d4f/d83/d85/d19/fba 0 2023-12-07T16:21:38.891 INFO:tasks.workunit.client.1.smithi152.stdout:6/577: truncate d2/d4f/d83/d85/de/f61 4594304 0 2023-12-07T16:21:38.891 INFO:tasks.workunit.client.1.smithi152.stdout:6/578: write d2/d4f/d83/d85/d94/f9f [702491,29248] 0 2023-12-07T16:21:38.891 INFO:tasks.workunit.client.0.smithi063.stdout:6/382: mkdir d0/d1e/d1d/d4f/d88 0 2023-12-07T16:21:38.892 INFO:tasks.workunit.client.1.smithi152.stdout:9/630: mknod d1/dd/dd6/cd7 0 2023-12-07T16:21:38.892 INFO:tasks.workunit.client.0.smithi063.stdout:4/299: dwrite d1/d3/db/d13/f39 [0,4194304] 0 2023-12-07T16:21:38.893 INFO:tasks.workunit.client.0.smithi063.stdout:6/383: rename d0/d17/d1a/d4d/l53 to d0/d1e/d20/l89 0 2023-12-07T16:21:38.893 INFO:tasks.workunit.client.0.smithi063.stdout:4/300: rmdir d1/d3/d3f 39 2023-12-07T16:21:38.893 INFO:tasks.workunit.client.1.smithi152.stdout:2/522: write d2/d1c/d2e/fa2 [3197303,71913] 0 2023-12-07T16:21:38.894 INFO:tasks.workunit.client.1.smithi152.stdout:7/514: creat db/d27/d39/d63/f9b x:0 0 0 2023-12-07T16:21:38.894 INFO:tasks.workunit.client.1.smithi152.stdout:7/515: chown db/d27/d5e/f48 16 1 2023-12-07T16:21:38.895 INFO:tasks.workunit.client.0.smithi063.stdout:6/384: mknod d0/d1e/d1d/d1f/c8a 0 2023-12-07T16:21:38.896 INFO:tasks.workunit.client.0.smithi063.stdout:6/385: mkdir d0/d17/d1a/d4d/d8b 0 2023-12-07T16:21:38.896 INFO:tasks.workunit.client.0.smithi063.stdout:6/386: chown d0/d17/d1a/d38/f62 7 1 2023-12-07T16:21:38.896 INFO:tasks.workunit.client.0.smithi063.stdout:6/387: chown d0/d1e/d1d/d1f/f32 41836089 1 2023-12-07T16:21:38.897 INFO:tasks.workunit.client.0.smithi063.stdout:6/388: symlink d0/d17/d1a/d4d/d8b/l8c 0 2023-12-07T16:21:38.897 INFO:tasks.workunit.client.1.smithi152.stdout:3/527: getdents d7/d10/d1a/d25 0 2023-12-07T16:21:38.899 INFO:tasks.workunit.client.1.smithi152.stdout:0/574: creat d0/fc2 x:0 0 0 2023-12-07T16:21:38.899 INFO:tasks.workunit.client.1.smithi152.stdout:0/575: stat d0/d27/f9b 0 2023-12-07T16:21:38.899 INFO:tasks.workunit.client.1.smithi152.stdout:0/576: dread - d0/dc/d36/fb8 zero size 2023-12-07T16:21:38.899 INFO:tasks.workunit.client.1.smithi152.stdout:0/577: write d0/d2f/f35 [1180075,9427] 0 2023-12-07T16:21:38.900 INFO:tasks.workunit.client.1.smithi152.stdout:0/578: truncate d0/dc/f34 4388080 0 2023-12-07T16:21:38.903 INFO:tasks.workunit.client.0.smithi063.stdout:5/329: dwrite d1/d31/d56/d61/f64 [0,4194304] 0 2023-12-07T16:21:38.904 INFO:tasks.workunit.client.1.smithi152.stdout:1/699: mkdir dc/d28/d4e/de8 0 2023-12-07T16:21:38.905 INFO:tasks.workunit.client.1.smithi152.stdout:5/716: dwrite dd/de/d14/d19/d1a/d1b/f8b [0,4194304] 0 2023-12-07T16:21:38.905 INFO:tasks.workunit.client.1.smithi152.stdout:6/579: link d2/d4f/d83/d85/d65/l66 d2/d4f/d83/da0/da2/lbb 0 2023-12-07T16:21:38.906 INFO:tasks.workunit.client.0.smithi063.stdout:5/330: rmdir d1/d3/de/d1e/d25 39 2023-12-07T16:21:38.906 INFO:tasks.workunit.client.0.smithi063.stdout:5/331: dread - d1/d3/de/f4a zero size 2023-12-07T16:21:38.906 INFO:tasks.workunit.client.0.smithi063.stdout:8/466: dwrite d7/f24 [0,4194304] 0 2023-12-07T16:21:38.907 INFO:tasks.workunit.client.1.smithi152.stdout:9/631: truncate d1/d9/d2d/d65/f73 8446276 0 2023-12-07T16:21:38.907 INFO:tasks.workunit.client.1.smithi152.stdout:9/632: chown d1/c7 13330396 1 2023-12-07T16:21:38.907 INFO:tasks.workunit.client.0.smithi063.stdout:4/301: write d1/d3/db/d13/f45 [276790,53037] 0 2023-12-07T16:21:38.907 INFO:tasks.workunit.client.0.smithi063.stdout:4/302: write d1/d3/f5 [2769877,110799] 0 2023-12-07T16:21:38.909 INFO:tasks.workunit.client.1.smithi152.stdout:2/523: getdents d2/d1c/d2e/d57/d5b/da7/d9a 0 2023-12-07T16:21:38.912 INFO:tasks.workunit.client.0.smithi063.stdout:8/467: write d7/d14/d1a/f22 [3537553,43238] 0 2023-12-07T16:21:38.912 INFO:tasks.workunit.client.0.smithi063.stdout:8/468: chown d7/le 92822024 1 2023-12-07T16:21:38.912 INFO:tasks.workunit.client.0.smithi063.stdout:5/332: symlink d1/d3/de/l69 0 2023-12-07T16:21:38.912 INFO:tasks.workunit.client.1.smithi152.stdout:7/516: mknod db/d27/d39/d41/c9c 0 2023-12-07T16:21:38.913 INFO:tasks.workunit.client.0.smithi063.stdout:8/469: write d7/d14/d15/f2d [12178,87859] 0 2023-12-07T16:21:38.913 INFO:tasks.workunit.client.0.smithi063.stdout:4/303: mknod d1/d3/c53 0 2023-12-07T16:21:38.914 INFO:tasks.workunit.client.1.smithi152.stdout:0/579: rename d0/d27/f6d to d0/dc/d3d/fc3 0 2023-12-07T16:21:38.914 INFO:tasks.workunit.client.1.smithi152.stdout:3/528: mknod d7/dc/d3e/d62/d6d/d84/ca6 0 2023-12-07T16:21:38.914 INFO:tasks.workunit.client.1.smithi152.stdout:3/529: readlink d7/dc/d3e/d48/l79 0 2023-12-07T16:21:38.914 INFO:tasks.workunit.client.1.smithi152.stdout:0/580: chown d0/d27/f1f 104394833 1 2023-12-07T16:21:38.914 INFO:tasks.workunit.client.1.smithi152.stdout:0/581: dread - d0/dc/d3d/dab/fb6 zero size 2023-12-07T16:21:38.916 INFO:tasks.workunit.client.0.smithi063.stdout:5/333: unlink d1/d31/d56/f62 0 2023-12-07T16:21:38.919 INFO:tasks.workunit.client.1.smithi152.stdout:1/700: mkdir dc/d14/d18/de9 0 2023-12-07T16:21:38.919 INFO:tasks.workunit.client.1.smithi152.stdout:1/701: chown dc/d28/d7d 382716 1 2023-12-07T16:21:38.920 INFO:tasks.workunit.client.1.smithi152.stdout:5/717: creat dd/de/d38/d3d/d6d/dae/de0/ffa x:0 0 0 2023-12-07T16:21:38.920 INFO:tasks.workunit.client.1.smithi152.stdout:2/524: mknod d2/d1c/d2e/d57/d5b/da7/d9a/da6/cb3 0 2023-12-07T16:21:38.920 INFO:tasks.workunit.client.1.smithi152.stdout:2/525: write d2/d1c/d2e/d5d/f7c [292822,85143] 0 2023-12-07T16:21:38.921 INFO:tasks.workunit.client.1.smithi152.stdout:0/582: symlink d0/dc/d36/d3a/d51/d82/lc4 0 2023-12-07T16:21:38.921 INFO:tasks.workunit.client.0.smithi063.stdout:8/470: creat d7/d38/d73/f8d x:0 0 0 2023-12-07T16:21:38.921 INFO:tasks.workunit.client.0.smithi063.stdout:5/334: rename d1/d3/d3a/d68 to d1/d31/d56/d61/d5e/d6a 0 2023-12-07T16:21:38.922 INFO:tasks.workunit.client.1.smithi152.stdout:8/587: dwrite d3/d4/d9/dc/d6f/f99 [0,4194304] 0 2023-12-07T16:21:38.922 INFO:tasks.workunit.client.1.smithi152.stdout:4/480: dwrite d0/d3/d6/dc/d22/f32 [4194304,4194304] 0 2023-12-07T16:21:38.923 INFO:tasks.workunit.client.1.smithi152.stdout:2/526: write d2/d9/f1b [5536867,10517] 0 2023-12-07T16:21:38.924 INFO:tasks.workunit.client.1.smithi152.stdout:8/588: symlink d3/d4/d9/d23/d4c/da6/db2/dc3/dcd/ld3 0 2023-12-07T16:21:38.924 INFO:tasks.workunit.client.1.smithi152.stdout:8/589: dread - d3/d4/d9/dc/d6f/d7a/d8a/f59 zero size 2023-12-07T16:21:38.924 INFO:tasks.workunit.client.1.smithi152.stdout:8/590: fdatasync d3/fc8 0 2023-12-07T16:21:38.925 INFO:tasks.workunit.client.0.smithi063.stdout:8/471: unlink d7/c1c 0 2023-12-07T16:21:38.925 INFO:tasks.workunit.client.1.smithi152.stdout:4/481: rename d0/d3/d6/dc/l6f to d0/d3/d6/d36/l87 0 2023-12-07T16:21:38.926 INFO:tasks.workunit.client.1.smithi152.stdout:5/718: creat dd/de/d14/d19/da3/ddf/ffb x:0 0 0 2023-12-07T16:21:38.927 INFO:tasks.workunit.client.1.smithi152.stdout:0/583: write d0/dc/f3c [2287416,10002] 0 2023-12-07T16:21:38.928 INFO:tasks.workunit.client.0.smithi063.stdout:5/335: mkdir d1/d3/de/d1e/d6b 0 2023-12-07T16:21:38.929 INFO:tasks.workunit.client.0.smithi063.stdout:5/336: write d1/d31/d56/d61/f57 [213967,72551] 0 2023-12-07T16:21:38.929 INFO:tasks.workunit.client.0.smithi063.stdout:4/304: write d1/d3/db/d13/f2a [351292,65142] 0 2023-12-07T16:21:38.929 INFO:tasks.workunit.client.0.smithi063.stdout:4/305: chown d1/d3/db/d13/l1d 38008869 1 2023-12-07T16:21:38.929 INFO:tasks.workunit.client.1.smithi152.stdout:2/527: truncate d2/d1c/d2e/d57/db1/d90/f2a 2254228 0 2023-12-07T16:21:38.929 INFO:tasks.workunit.client.1.smithi152.stdout:2/528: readlink d2/l12 0 2023-12-07T16:21:38.930 INFO:tasks.workunit.client.1.smithi152.stdout:4/482: rename d0/d3/d6/dc/d22/f60 to d0/d3/d6/dc/d3a/d46/d80/f88 0 2023-12-07T16:21:38.930 INFO:tasks.workunit.client.1.smithi152.stdout:5/719: symlink dd/de/d14/d1f/d49/lfc 0 2023-12-07T16:21:38.933 INFO:tasks.workunit.client.0.smithi063.stdout:8/472: mkdir d7/d38/d8e 0 2023-12-07T16:21:38.933 INFO:tasks.workunit.client.0.smithi063.stdout:8/473: chown d7/d14/d1a/l3d 49796263 1 2023-12-07T16:21:38.938 INFO:tasks.workunit.client.0.smithi063.stdout:5/337: mknod d1/d31/d56/d61/d5e/d6a/c6c 0 2023-12-07T16:21:38.938 INFO:tasks.workunit.client.0.smithi063.stdout:5/338: chown d1/d3/de/d1e/d25/c5d 219 1 2023-12-07T16:21:38.939 INFO:tasks.workunit.client.0.smithi063.stdout:4/306: rename d1/d3/db/d13/c24 to d1/d3/d51/c54 0 2023-12-07T16:21:38.939 INFO:tasks.workunit.client.0.smithi063.stdout:4/307: stat d1/d3/l19 0 2023-12-07T16:21:38.939 INFO:tasks.workunit.client.0.smithi063.stdout:4/308: chown d1/f34 3436 1 2023-12-07T16:21:38.939 INFO:tasks.workunit.client.0.smithi063.stdout:4/309: dread - d1/d3/db/d41/f52 zero size 2023-12-07T16:21:38.939 INFO:tasks.workunit.client.1.smithi152.stdout:3/530: dread d7/dc/d14/f1e [0,4194304] 0 2023-12-07T16:21:38.939 INFO:tasks.workunit.client.1.smithi152.stdout:2/529: dread d2/d9/f48 [0,4194304] 0 2023-12-07T16:21:38.941 INFO:tasks.workunit.client.1.smithi152.stdout:3/531: unlink d7/d10/d1a/d25/d4b/d68/f8f 0 2023-12-07T16:21:38.941 INFO:tasks.workunit.client.1.smithi152.stdout:3/532: chown d7/d10/d1a/d25/d78/f8a 30 1 2023-12-07T16:21:38.945 INFO:tasks.workunit.client.1.smithi152.stdout:2/530: getdents d2/d1c 0 2023-12-07T16:21:38.947 INFO:tasks.workunit.client.1.smithi152.stdout:3/533: rmdir d7/dc/d3e/d6c 0 2023-12-07T16:21:38.949 INFO:tasks.workunit.client.1.smithi152.stdout:3/534: symlink d7/d10/d1a/d2f/d56/la7 0 2023-12-07T16:21:38.951 INFO:tasks.workunit.client.0.smithi063.stdout:8/474: read f5 [315057,77963] 0 2023-12-07T16:21:38.951 INFO:tasks.workunit.client.0.smithi063.stdout:8/475: write d7/d14/d15/f2d [1089728,87393] 0 2023-12-07T16:21:38.953 INFO:tasks.workunit.client.1.smithi152.stdout:2/531: dread d2/d9/d51/f63 [0,4194304] 0 2023-12-07T16:21:38.953 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:38 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:38.953 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:38 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:38.953 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:38 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-07T16:21:38.953 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:38 smithi063 ceph-mon[112095]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-07T16:21:38.953 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:38 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-07T16:21:38.953 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:38 smithi063 ceph-mon[112095]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-07T16:21:38.953 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:38 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-07T16:21:38.953 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:38 smithi063 ceph-mon[112095]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-07T16:21:38.953 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:38 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:21:38.953 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:38 smithi063 ceph-mon[112095]: Upgrade: Need to upgrade myself (mgr.smithi152.sxayfb) 2023-12-07T16:21:38.953 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:38 smithi063 ceph-mon[112095]: Upgrade: Need to upgrade myself (mgr.smithi152.sxayfb) 2023-12-07T16:21:38.954 INFO:tasks.workunit.client.1.smithi152.stdout:2/532: creat d2/d9/d51/d54/fb4 x:0 0 0 2023-12-07T16:21:38.954 INFO:tasks.workunit.client.0.smithi063.stdout:8/476: creat d7/f8f x:0 0 0 2023-12-07T16:21:38.955 INFO:tasks.workunit.client.0.smithi063.stdout:8/477: dread - d7/d14/f81 zero size 2023-12-07T16:21:38.955 INFO:tasks.workunit.client.0.smithi063.stdout:8/478: truncate d7/d38/d73/f8d 761413 0 2023-12-07T16:21:38.955 INFO:tasks.workunit.client.0.smithi063.stdout:8/479: symlink d7/d14/d15/d2b/d40/d63/l90 0 2023-12-07T16:21:38.955 INFO:tasks.workunit.client.1.smithi152.stdout:2/533: rmdir d2/d1c/d2e/d57/d5b/da7/d9a/da6/db2 0 2023-12-07T16:21:38.956 INFO:tasks.workunit.client.1.smithi152.stdout:2/534: mknod d2/cb5 0 2023-12-07T16:21:38.957 INFO:tasks.workunit.client.0.smithi063.stdout:8/480: rename d7/f9 to d7/d38/d8e/f91 0 2023-12-07T16:21:38.957 INFO:tasks.workunit.client.1.smithi152.stdout:2/535: mkdir d2/d1c/d52/da8/db6 0 2023-12-07T16:21:38.957 INFO:tasks.workunit.client.0.smithi063.stdout:8/481: mknod d7/d14/d15/d2b/d40/d63/c92 0 2023-12-07T16:21:38.958 INFO:tasks.workunit.client.1.smithi152.stdout:2/536: unlink d2/d1c/d2e/d57/d5b/da7/l59 0 2023-12-07T16:21:38.959 INFO:tasks.workunit.client.1.smithi152.stdout:2/537: mknod d2/d1c/d2e/d57/d5b/da7/cb7 0 2023-12-07T16:21:38.964 INFO:tasks.workunit.client.1.smithi152.stdout:2/538: truncate d2/f8 1868249 0 2023-12-07T16:21:38.964 INFO:tasks.workunit.client.0.smithi063.stdout:5/339: dread d1/f18 [0,4194304] 0 2023-12-07T16:21:38.964 INFO:tasks.workunit.client.0.smithi063.stdout:5/340: fdatasync d1/d3/de/f1f 0 2023-12-07T16:21:38.967 INFO:tasks.workunit.client.0.smithi063.stdout:5/341: read d1/d31/d56/d61/f43 [5077,99111] 0 2023-12-07T16:21:38.974 INFO:tasks.workunit.client.1.smithi152.stdout:7/517: dwrite db/d27/d39/d41/d37/f71 [0,4194304] 0 2023-12-07T16:21:38.975 INFO:tasks.workunit.client.0.smithi063.stdout:8/482: read d7/d14/d1a/f33 [59163,27500] 0 2023-12-07T16:21:38.978 INFO:tasks.workunit.client.1.smithi152.stdout:7/518: creat db/d27/f9d x:0 0 0 2023-12-07T16:21:38.980 INFO:tasks.workunit.client.1.smithi152.stdout:7/519: creat db/d27/d5e/d45/f9e x:0 0 0 2023-12-07T16:21:38.980 INFO:tasks.workunit.client.0.smithi063.stdout:8/483: dread d7/d14/f28 [0,4194304] 0 2023-12-07T16:21:38.981 INFO:tasks.workunit.client.0.smithi063.stdout:8/484: mkdir d7/d14/d15/d93 0 2023-12-07T16:21:38.987 INFO:tasks.workunit.client.1.smithi152.stdout:7/520: write db/d27/d39/f66 [3089798,107894] 0 2023-12-07T16:21:38.987 INFO:tasks.workunit.client.1.smithi152.stdout:6/580: dwrite d2/d4f/d83/d85/d19/d1f/f47 [0,4194304] 0 2023-12-07T16:21:38.988 INFO:tasks.workunit.client.0.smithi063.stdout:6/389: dwrite d0/d17/d1a/f1c [0,4194304] 0 2023-12-07T16:21:38.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:38 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:38.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:38 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:38.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:38 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-07T16:21:38.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:38 smithi152 ceph-mon[121113]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-07T16:21:38.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:38 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-07T16:21:38.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:38 smithi152 ceph-mon[121113]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-07T16:21:38.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:38 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-07T16:21:38.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:38 smithi152 ceph-mon[121113]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-07T16:21:38.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:38 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:21:38.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:38 smithi152 ceph-mon[121113]: Upgrade: Need to upgrade myself (mgr.smithi152.sxayfb) 2023-12-07T16:21:38.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:38 smithi152 ceph-mon[121113]: Upgrade: Need to upgrade myself (mgr.smithi152.sxayfb) 2023-12-07T16:21:38.996 INFO:tasks.workunit.client.0.smithi063.stdout:6/390: unlink d0/l4 0 2023-12-07T16:21:38.997 INFO:tasks.workunit.client.0.smithi063.stdout:6/391: mknod d0/d1e/d1d/d1f/c8d 0 2023-12-07T16:21:39.006 INFO:tasks.workunit.client.1.smithi152.stdout:9/633: dwrite d1/d17/d38/d53/f7a [0,4194304] 0 2023-12-07T16:21:39.006 INFO:tasks.workunit.client.1.smithi152.stdout:9/634: truncate d1/d9/d2d/d65/f6f 1489980 0 2023-12-07T16:21:39.006 INFO:tasks.workunit.client.1.smithi152.stdout:9/635: stat d1/d9/d2d/d72/d80/da4 0 2023-12-07T16:21:39.007 INFO:tasks.workunit.client.1.smithi152.stdout:1/702: dwrite dc/d28/f38 [0,4194304] 0 2023-12-07T16:21:39.008 INFO:tasks.workunit.client.1.smithi152.stdout:1/703: write dc/d14/d18/fe4 [466350,74218] 0 2023-12-07T16:21:39.008 INFO:tasks.workunit.client.1.smithi152.stdout:9/636: mknod d1/d9/db/cd8 0 2023-12-07T16:21:39.008 INFO:tasks.workunit.client.1.smithi152.stdout:8/591: dwrite d3/d4/f5c [4194304,4194304] 0 2023-12-07T16:21:39.010 INFO:tasks.workunit.client.1.smithi152.stdout:8/592: write d3/f1d [847813,121381] 0 2023-12-07T16:21:39.010 INFO:tasks.workunit.client.1.smithi152.stdout:8/593: write d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/d7d/f8d [8434716,13119] 0 2023-12-07T16:21:39.010 INFO:tasks.workunit.client.1.smithi152.stdout:8/594: truncate d3/d4/d9/dc/d6f/d7b/d7e/fa1 987606 0 2023-12-07T16:21:39.010 INFO:tasks.workunit.client.1.smithi152.stdout:8/595: stat d3/d4/d9/dc/d6f/d7a/c90 0 2023-12-07T16:21:39.011 INFO:tasks.workunit.client.1.smithi152.stdout:1/704: dread dc/d14/fb4 [4194304,4194304] 0 2023-12-07T16:21:39.012 INFO:tasks.workunit.client.1.smithi152.stdout:4/483: dwrite d0/d3/d6/dc/dd/f40 [0,4194304] 0 2023-12-07T16:21:39.013 INFO:tasks.workunit.client.1.smithi152.stdout:9/637: mkdir d1/d17/d58/d86/dd9 0 2023-12-07T16:21:39.014 INFO:tasks.workunit.client.1.smithi152.stdout:1/705: write dc/d14/d18/d2d/f33 [1673888,109291] 0 2023-12-07T16:21:39.021 INFO:tasks.workunit.client.1.smithi152.stdout:8/596: mkdir d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/dd4 0 2023-12-07T16:21:39.022 INFO:tasks.workunit.client.1.smithi152.stdout:4/484: getdents d0/d3/d6/dc/dd 0 2023-12-07T16:21:39.024 INFO:tasks.workunit.client.1.smithi152.stdout:3/535: dwrite d7/f8 [4194304,4194304] 0 2023-12-07T16:21:39.024 INFO:tasks.workunit.client.1.smithi152.stdout:9/638: mknod d1/d9/db/df/da6/cda 0 2023-12-07T16:21:39.024 INFO:tasks.workunit.client.1.smithi152.stdout:9/639: chown d1/d9/db/df 202683 1 2023-12-07T16:21:39.024 INFO:tasks.workunit.client.1.smithi152.stdout:5/720: dwrite dd/de/d14/d1f/d49/f9e [0,4194304] 0 2023-12-07T16:21:39.024 INFO:tasks.workunit.client.1.smithi152.stdout:2/539: dwrite d2/d56/da0/fad [0,4194304] 0 2023-12-07T16:21:39.024 INFO:tasks.workunit.client.1.smithi152.stdout:1/706: creat dc/d14/d18/d79/d86/fea x:0 0 0 2023-12-07T16:21:39.024 INFO:tasks.workunit.client.1.smithi152.stdout:5/721: write dd/de/d14/d19/d1a/d1b/f44 [1821106,92159] 0 2023-12-07T16:21:39.024 INFO:tasks.workunit.client.1.smithi152.stdout:7/521: fdatasync db/d27/d39/f66 0 2023-12-07T16:21:39.024 INFO:tasks.workunit.client.1.smithi152.stdout:7/522: fdatasync db/f5d 0 2023-12-07T16:21:39.024 INFO:tasks.workunit.client.0.smithi063.stdout:5/342: dwrite d1/d3/de/d1e/f1d [0,4194304] 0 2023-12-07T16:21:39.025 INFO:tasks.workunit.client.0.smithi063.stdout:6/392: dwrite d0/d17/d46/f50 [0,4194304] 0 2023-12-07T16:21:39.025 INFO:tasks.workunit.client.0.smithi063.stdout:6/393: write d0/d17/d46/f55 [1271604,56205] 0 2023-12-07T16:21:39.025 INFO:tasks.workunit.client.0.smithi063.stdout:8/485: dwrite d7/d14/d1a/f51 [0,4194304] 0 2023-12-07T16:21:39.027 INFO:tasks.workunit.client.1.smithi152.stdout:8/597: unlink d3/d4/d9/dc/f3e 0 2023-12-07T16:21:39.028 INFO:tasks.workunit.client.1.smithi152.stdout:4/485: symlink d0/d3/d6/d36/l89 0 2023-12-07T16:21:39.032 INFO:tasks.workunit.client.1.smithi152.stdout:9/640: mkdir d1/d9/db/df/da6/da2/ddb 0 2023-12-07T16:21:39.035 INFO:tasks.workunit.client.1.smithi152.stdout:3/536: dread d7/f32 [4194304,4194304] 0 2023-12-07T16:21:39.036 INFO:tasks.workunit.client.1.smithi152.stdout:2/540: creat d2/d1c/d2e/d57/fb8 x:0 0 0 2023-12-07T16:21:39.037 INFO:tasks.workunit.client.1.smithi152.stdout:1/707: creat dc/d14/d18/d64/d8a/feb x:0 0 0 2023-12-07T16:21:39.045 INFO:tasks.workunit.client.1.smithi152.stdout:7/523: creat db/d27/d39/f9f x:0 0 0 2023-12-07T16:21:39.045 INFO:tasks.workunit.client.1.smithi152.stdout:7/524: chown db/d27/f6e 1795884 1 2023-12-07T16:21:39.045 INFO:tasks.workunit.client.1.smithi152.stdout:5/722: dwrite dd/de/d14/f63 [0,4194304] 0 2023-12-07T16:21:39.048 INFO:tasks.workunit.client.0.smithi063.stdout:6/394: rmdir d0 39 2023-12-07T16:21:39.050 INFO:tasks.workunit.client.1.smithi152.stdout:4/486: link d0/d3/d6/dc/d3a/d46/d80/f88 d0/d3/d6/f8a 0 2023-12-07T16:21:39.050 INFO:tasks.workunit.client.0.smithi063.stdout:8/486: dread d7/d14/f4f [0,4194304] 0 2023-12-07T16:21:39.050 INFO:tasks.workunit.client.0.smithi063.stdout:8/487: truncate d7/d38/d8e/f91 5885333 0 2023-12-07T16:21:39.051 INFO:tasks.workunit.client.1.smithi152.stdout:9/641: fsync d1/d17/d58/f7f 0 2023-12-07T16:21:39.051 INFO:tasks.workunit.client.1.smithi152.stdout:9/642: write d1/d17/d58/d86/f87 [226708,48692] 0 2023-12-07T16:21:39.051 INFO:tasks.workunit.client.0.smithi063.stdout:2/353: sync 2023-12-07T16:21:39.052 INFO:tasks.workunit.client.1.smithi152.stdout:3/537: getdents d7/d10/d1a 0 2023-12-07T16:21:39.055 INFO:tasks.workunit.client.1.smithi152.stdout:2/541: creat d2/d9/d51/d54/fb9 x:0 0 0 2023-12-07T16:21:39.055 INFO:tasks.workunit.client.1.smithi152.stdout:2/542: stat d2/d1c/d2e/d5d/daf 0 2023-12-07T16:21:39.055 INFO:tasks.workunit.client.1.smithi152.stdout:1/708: dwrite dc/d14/d18/d2d/d48/fc2 [0,4194304] 0 2023-12-07T16:21:39.055 INFO:tasks.workunit.client.1.smithi152.stdout:1/709: chown dc/d14/d18/d2d/d48/da3/d58/dc9 1 1 2023-12-07T16:21:39.057 INFO:tasks.workunit.client.0.smithi063.stdout:8/488: mknod d7/d38/d73/d83/c94 0 2023-12-07T16:21:39.057 INFO:tasks.workunit.client.1.smithi152.stdout:5/723: creat dd/de/d8f/dc9/ffd x:0 0 0 2023-12-07T16:21:39.057 INFO:tasks.workunit.client.1.smithi152.stdout:5/724: stat dd/d91/fa1 0 2023-12-07T16:21:39.057 INFO:tasks.workunit.client.1.smithi152.stdout:9/643: symlink d1/d17/d3c/d4a/d48/d8c/ldc 0 2023-12-07T16:21:39.058 INFO:tasks.workunit.client.0.smithi063.stdout:2/354: link d0/f16 d0/d1e/f76 0 2023-12-07T16:21:39.060 INFO:tasks.workunit.client.0.smithi063.stdout:6/395: link d0/d1e/d1d/f3d d0/d17/d1a/d4d/f8e 0 2023-12-07T16:21:39.060 INFO:tasks.workunit.client.0.smithi063.stdout:6/396: dread - d0/d17/d1a/d4d/f82 zero size 2023-12-07T16:21:39.060 INFO:tasks.workunit.client.0.smithi063.stdout:6/397: fdatasync d0/d1e/d60/d68/d76/f77 0 2023-12-07T16:21:39.060 INFO:tasks.workunit.client.0.smithi063.stdout:6/398: fsync d0/d17/f25 0 2023-12-07T16:21:39.060 INFO:tasks.workunit.client.1.smithi152.stdout:5/725: rename dd/de/d14/d19/d1a/fb3 to dd/de/d14/d19/d1a/dcc/dd0/ffe 0 2023-12-07T16:21:39.061 INFO:tasks.workunit.client.0.smithi063.stdout:2/355: creat d0/f77 x:0 0 0 2023-12-07T16:21:39.061 INFO:tasks.workunit.client.0.smithi063.stdout:2/356: fsync d0/d1e/f34 0 2023-12-07T16:21:39.062 INFO:tasks.workunit.client.1.smithi152.stdout:9/644: mkdir d1/d17/d4e/d5a/ddd 0 2023-12-07T16:21:39.062 INFO:tasks.workunit.client.0.smithi063.stdout:6/399: creat d0/d79/f8f x:0 0 0 2023-12-07T16:21:39.063 INFO:tasks.workunit.client.1.smithi152.stdout:4/487: dread d0/d3/d6/dc/d22/f4f [0,4194304] 0 2023-12-07T16:21:39.063 INFO:tasks.workunit.client.1.smithi152.stdout:4/488: chown d0/d3/d6/dc/d3a/d46/d4e/f84 7037 1 2023-12-07T16:21:39.063 INFO:tasks.workunit.client.1.smithi152.stdout:2/543: mkdir d2/dba 0 2023-12-07T16:21:39.064 INFO:tasks.workunit.client.0.smithi063.stdout:2/357: write d0/fa [2112757,112733] 0 2023-12-07T16:21:39.064 INFO:tasks.workunit.client.0.smithi063.stdout:2/358: stat d0/d1e 0 2023-12-07T16:21:39.064 INFO:tasks.workunit.client.1.smithi152.stdout:9/645: truncate d1/d9/d2d/d65/fbb 863028 0 2023-12-07T16:21:39.065 INFO:tasks.workunit.client.0.smithi063.stdout:6/400: link d0/d17/d46/f7f d0/d1e/d1d/d1f/d6c/f90 0 2023-12-07T16:21:39.066 INFO:tasks.workunit.client.1.smithi152.stdout:7/525: dwrite db/d27/d39/d41/d58/f73 [0,4194304] 0 2023-12-07T16:21:39.066 INFO:tasks.workunit.client.1.smithi152.stdout:7/526: dread - db/d27/d4d/f69 zero size 2023-12-07T16:21:39.067 INFO:tasks.workunit.client.1.smithi152.stdout:7/527: dread - db/d68/f74 zero size 2023-12-07T16:21:39.067 INFO:tasks.workunit.client.1.smithi152.stdout:9/646: creat d1/d9/db/d70/fde x:0 0 0 2023-12-07T16:21:39.067 INFO:tasks.workunit.client.1.smithi152.stdout:9/647: fsync d1/d17/d4e/f99 0 2023-12-07T16:21:39.068 INFO:tasks.workunit.client.1.smithi152.stdout:1/710: dread dc/d14/d18/d2d/d48/da3/dbf/fd2 [0,4194304] 0 2023-12-07T16:21:39.068 INFO:tasks.workunit.client.0.smithi063.stdout:6/401: write d0/ff [3043005,59186] 0 2023-12-07T16:21:39.069 INFO:tasks.workunit.client.1.smithi152.stdout:7/528: symlink db/d27/d39/d41/la0 0 2023-12-07T16:21:39.070 INFO:tasks.workunit.client.1.smithi152.stdout:4/489: write d0/d3/f3c [2837857,5772] 0 2023-12-07T16:21:39.070 INFO:tasks.workunit.client.1.smithi152.stdout:2/544: write d2/d1c/d2e/f46 [3789162,101142] 0 2023-12-07T16:21:39.070 INFO:tasks.workunit.client.1.smithi152.stdout:2/545: chown d2/d1c/d2e/d30/d33/c32 6750449 1 2023-12-07T16:21:39.070 INFO:tasks.workunit.client.1.smithi152.stdout:9/648: mknod d1/d9/db/df/dd4/cdf 0 2023-12-07T16:21:39.070 INFO:tasks.workunit.client.1.smithi152.stdout:9/649: dread - d1/d9/db/df/f50 zero size 2023-12-07T16:21:39.071 INFO:tasks.workunit.client.0.smithi063.stdout:6/402: chown d0/l6 56824 1 2023-12-07T16:21:39.071 INFO:tasks.workunit.client.0.smithi063.stdout:7/339: sync 2023-12-07T16:21:39.071 INFO:tasks.workunit.client.0.smithi063.stdout:1/253: sync 2023-12-07T16:21:39.071 INFO:tasks.workunit.client.0.smithi063.stdout:3/315: sync 2023-12-07T16:21:39.071 INFO:tasks.workunit.client.1.smithi152.stdout:1/711: creat dc/d14/d90/dbb/fec x:0 0 0 2023-12-07T16:21:39.071 INFO:tasks.workunit.client.1.smithi152.stdout:1/712: truncate dc/f40 4442125 0 2023-12-07T16:21:39.072 INFO:tasks.workunit.client.1.smithi152.stdout:7/529: mknod db/d27/d4d/ca1 0 2023-12-07T16:21:39.074 INFO:tasks.workunit.client.0.smithi063.stdout:3/316: write d7/f51 [289373,66733] 0 2023-12-07T16:21:39.074 INFO:tasks.workunit.client.0.smithi063.stdout:7/340: rmdir d2 39 2023-12-07T16:21:39.074 INFO:tasks.workunit.client.0.smithi063.stdout:6/403: mkdir d0/d1e/d1d/d1f/d4b/d91 0 2023-12-07T16:21:39.076 INFO:tasks.workunit.client.1.smithi152.stdout:2/546: mkdir d2/d1c/d2e/d57/d5b/da7/d9a/da6/dbb 0 2023-12-07T16:21:39.076 INFO:tasks.workunit.client.1.smithi152.stdout:2/547: fdatasync d2/d1c/d2e/d57/d5b/da7/d9a/f9c 0 2023-12-07T16:21:39.076 INFO:tasks.workunit.client.1.smithi152.stdout:4/490: mknod d0/d3/c8b 0 2023-12-07T16:21:39.079 INFO:tasks.workunit.client.1.smithi152.stdout:1/713: unlink dc/d14/d18/d2d/d48/da3/f2e 0 2023-12-07T16:21:39.080 INFO:tasks.workunit.client.0.smithi063.stdout:8/489: dread d7/d14/d1a/d54/f5b [0,4194304] 0 2023-12-07T16:21:39.081 INFO:tasks.workunit.client.1.smithi152.stdout:7/530: read db/d27/d4d/f88 [145552,90853] 0 2023-12-07T16:21:39.082 INFO:tasks.workunit.client.0.smithi063.stdout:3/317: creat d7/d4f/f67 x:0 0 0 2023-12-07T16:21:39.082 INFO:tasks.workunit.client.0.smithi063.stdout:3/318: chown d7/d49/d4b/f5e 121820 1 2023-12-07T16:21:39.082 INFO:tasks.workunit.client.0.smithi063.stdout:6/404: truncate d0/f8 2512675 0 2023-12-07T16:21:39.082 INFO:tasks.workunit.client.0.smithi063.stdout:7/341: symlink d2/d34/d46/d5d/l83 0 2023-12-07T16:21:39.082 INFO:tasks.workunit.client.0.smithi063.stdout:7/342: fdatasync d2/d34/d5a/d5f/d2a/f35 0 2023-12-07T16:21:39.083 INFO:tasks.workunit.client.0.smithi063.stdout:3/319: write d7/d9/dd/f42 [3225486,1839] 0 2023-12-07T16:21:39.085 INFO:tasks.workunit.client.1.smithi152.stdout:2/548: mkdir d2/dba/dbc 0 2023-12-07T16:21:39.088 INFO:tasks.workunit.client.0.smithi063.stdout:8/490: creat d7/d38/d73/d83/f95 x:0 0 0 2023-12-07T16:21:39.088 INFO:tasks.workunit.client.0.smithi063.stdout:3/320: creat d7/d4f/d53/f68 x:0 0 0 2023-12-07T16:21:39.088 INFO:tasks.workunit.client.0.smithi063.stdout:3/321: write d7/d9/f45 [72864,57455] 0 2023-12-07T16:21:39.088 INFO:tasks.workunit.client.0.smithi063.stdout:3/322: read - d7/d4f/f67 zero size 2023-12-07T16:21:39.088 INFO:tasks.workunit.client.1.smithi152.stdout:1/714: creat dc/d14/d18/d2d/d4a/fed x:0 0 0 2023-12-07T16:21:39.088 INFO:tasks.workunit.client.1.smithi152.stdout:1/715: dread - dc/d14/d18/d45/fc5 zero size 2023-12-07T16:21:39.088 INFO:tasks.workunit.client.1.smithi152.stdout:1/716: chown dc/d14/d18/d2d/d48/fc2 4190712 1 2023-12-07T16:21:39.089 INFO:tasks.workunit.client.1.smithi152.stdout:7/531: write db/d27/d39/d41/d37/f71 [1791348,127774] 0 2023-12-07T16:21:39.090 INFO:tasks.workunit.client.1.smithi152.stdout:2/549: read d2/d1c/d2e/f46 [3700176,70493] 0 2023-12-07T16:21:39.091 INFO:tasks.workunit.client.0.smithi063.stdout:3/323: creat d7/d21/f69 x:0 0 0 2023-12-07T16:21:39.091 INFO:tasks.workunit.client.0.smithi063.stdout:3/324: chown d7/d4f/d53/d54 108 1 2023-12-07T16:21:39.091 INFO:tasks.workunit.client.1.smithi152.stdout:1/717: mknod dc/d14/d90/dbb/cee 0 2023-12-07T16:21:39.091 INFO:tasks.workunit.client.1.smithi152.stdout:8/598: rmdir d3/d4/d9/dc/d6f/d7a/d8a/d63/d67 39 2023-12-07T16:21:39.092 INFO:tasks.workunit.client.0.smithi063.stdout:3/325: write d7/f51 [434032,94289] 0 2023-12-07T16:21:39.101 INFO:tasks.workunit.client.1.smithi152.stdout:2/550: rename d2/d1c/f80 to d2/d1c/d2e/d57/d5b/da7/fbd 0 2023-12-07T16:21:39.103 INFO:tasks.workunit.client.0.smithi063.stdout:3/326: write d7/d9/d2b/f43 [549730,126798] 0 2023-12-07T16:21:39.103 INFO:tasks.workunit.client.1.smithi152.stdout:1/718: mkdir dc/def 0 2023-12-07T16:21:39.103 INFO:tasks.workunit.client.1.smithi152.stdout:1/719: fsync dc/f40 0 2023-12-07T16:21:39.103 INFO:tasks.workunit.client.1.smithi152.stdout:1/720: readlink dc/d14/d18/d45/l49 0 2023-12-07T16:21:39.104 INFO:tasks.workunit.client.1.smithi152.stdout:8/599: mknod d3/d4/d9/dc/d6f/d7a/d8a/d66/d9b/cd5 0 2023-12-07T16:21:39.105 INFO:tasks.workunit.client.1.smithi152.stdout:8/600: write d3/d4/d9/dc/d6f/d7a/d8a/d63/fbf [265425,35170] 0 2023-12-07T16:21:39.107 INFO:tasks.workunit.client.1.smithi152.stdout:8/601: read d3/d4/d9/dc/d6f/d7b/d7e/f9a [4013738,20851] 0 2023-12-07T16:21:39.107 INFO:tasks.workunit.client.1.smithi152.stdout:8/602: chown d3/d4/c84 481272 1 2023-12-07T16:21:39.107 INFO:tasks.workunit.client.1.smithi152.stdout:2/551: link d2/d1c/d2e/d57/d5b/da7/cb7 d2/d1c/d52/da8/db6/cbe 0 2023-12-07T16:21:39.107 INFO:tasks.workunit.client.1.smithi152.stdout:2/552: stat d2/l12 0 2023-12-07T16:21:39.107 INFO:tasks.workunit.client.1.smithi152.stdout:8/603: read d3/d4/d9/d34/d5f/f6d [113783,95774] 0 2023-12-07T16:21:39.109 INFO:tasks.workunit.client.1.smithi152.stdout:2/553: creat d2/d1c/d2e/d57/fbf x:0 0 0 2023-12-07T16:21:39.110 INFO:tasks.workunit.client.1.smithi152.stdout:8/604: mkdir d3/d4/d9/d23/d4c/da6/db2/dd6 0 2023-12-07T16:21:39.110 INFO:tasks.workunit.client.1.smithi152.stdout:2/554: symlink d2/d1c/d52/da8/db6/lc0 0 2023-12-07T16:21:39.112 INFO:tasks.workunit.client.1.smithi152.stdout:8/605: truncate d3/d4/d9/dc/d6f/d7a/d8a/d63/f91 489833 0 2023-12-07T16:21:39.114 INFO:tasks.workunit.client.1.smithi152.stdout:2/555: rename d2/f29 to d2/d1c/d2e/d5d/fc1 0 2023-12-07T16:21:39.116 INFO:tasks.workunit.client.1.smithi152.stdout:2/556: rename d2/d1c/d2e/d30/d33/d86/fa9 to d2/d1c/d2e/d30/fc2 0 2023-12-07T16:21:39.116 INFO:tasks.workunit.client.1.smithi152.stdout:2/557: write d2/d1c/d2e/d57/f68 [363680,65337] 0 2023-12-07T16:21:39.116 INFO:tasks.workunit.client.1.smithi152.stdout:2/558: mknod d2/d1c/d2e/d57/cc3 0 2023-12-07T16:21:39.117 INFO:tasks.workunit.client.1.smithi152.stdout:2/559: creat d2/d9/d51/d54/fc4 x:0 0 0 2023-12-07T16:21:39.124 INFO:tasks.workunit.client.0.smithi063.stdout:8/491: dwrite d7/d14/d15/f18 [0,4194304] 0 2023-12-07T16:21:39.125 INFO:tasks.workunit.client.1.smithi152.stdout:9/650: dwrite d1/d9/db/df/d42/f93 [0,4194304] 0 2023-12-07T16:21:39.125 INFO:tasks.workunit.client.1.smithi152.stdout:9/651: dread - d1/f76 zero size 2023-12-07T16:21:39.125 INFO:tasks.workunit.client.1.smithi152.stdout:9/652: dread - d1/d17/d58/d86/fb8 zero size 2023-12-07T16:21:39.125 INFO:tasks.workunit.client.1.smithi152.stdout:9/653: chown d1/dd/f5c 324241 1 2023-12-07T16:21:39.125 INFO:tasks.workunit.client.1.smithi152.stdout:9/654: dread - d1/d17/d3c/f90 zero size 2023-12-07T16:21:39.125 INFO:tasks.workunit.client.1.smithi152.stdout:4/491: dwrite d0/d3/d6/dc/dd/d67/f47 [0,4194304] 0 2023-12-07T16:21:39.126 INFO:tasks.workunit.client.0.smithi063.stdout:2/359: dwrite d0/d1e/f34 [0,4194304] 0 2023-12-07T16:21:39.126 INFO:tasks.workunit.client.1.smithi152.stdout:9/655: creat d1/d17/d58/fe0 x:0 0 0 2023-12-07T16:21:39.126 INFO:tasks.workunit.client.1.smithi152.stdout:9/656: write d1/d9/f35 [4865464,85430] 0 2023-12-07T16:21:39.127 INFO:tasks.workunit.client.0.smithi063.stdout:7/343: dwrite d2/f17 [0,4194304] 0 2023-12-07T16:21:39.127 INFO:tasks.workunit.client.0.smithi063.stdout:2/360: getdents d0/d4a 0 2023-12-07T16:21:39.127 INFO:tasks.workunit.client.0.smithi063.stdout:3/327: fsync d7/f51 0 2023-12-07T16:21:39.127 INFO:tasks.workunit.client.1.smithi152.stdout:1/721: dwrite dc/d14/d18/d2d/d48/da3/f77 [4194304,4194304] 0 2023-12-07T16:21:39.128 INFO:tasks.workunit.client.1.smithi152.stdout:4/492: mknod d0/c8c 0 2023-12-07T16:21:39.129 INFO:tasks.workunit.client.0.smithi063.stdout:6/405: dwrite d0/d1e/d60/d68/f70 [0,4194304] 0 2023-12-07T16:21:39.135 INFO:tasks.workunit.client.1.smithi152.stdout:9/657: link d1/d9/d2d/d72/d80/da4/fa5 d1/d17/d58/d86/fe1 0 2023-12-07T16:21:39.135 INFO:tasks.workunit.client.1.smithi152.stdout:9/658: readlink d1/d9/d2d/l4c 0 2023-12-07T16:21:39.135 INFO:tasks.workunit.client.1.smithi152.stdout:9/659: fdatasync d1/d9/f23 0 2023-12-07T16:21:39.135 INFO:tasks.workunit.client.1.smithi152.stdout:9/660: dread - d1/d17/d3c/f90 zero size 2023-12-07T16:21:39.135 INFO:tasks.workunit.client.1.smithi152.stdout:7/532: rmdir db/d27 39 2023-12-07T16:21:39.138 INFO:tasks.workunit.client.0.smithi063.stdout:7/344: creat d2/d64/f84 x:0 0 0 2023-12-07T16:21:39.139 INFO:tasks.workunit.client.0.smithi063.stdout:2/361: dread d0/d21/d56/d11/f58 [0,4194304] 0 2023-12-07T16:21:39.139 INFO:tasks.workunit.client.0.smithi063.stdout:2/362: write d0/f4b [409230,89605] 0 2023-12-07T16:21:39.141 INFO:tasks.workunit.client.1.smithi152.stdout:1/722: mkdir dc/d28/d4e/de8/df0 0 2023-12-07T16:21:39.141 INFO:tasks.workunit.client.0.smithi063.stdout:6/406: mknod d0/d1e/d29/c92 0 2023-12-07T16:21:39.142 INFO:tasks.workunit.client.0.smithi063.stdout:7/345: mknod d2/d2c/c85 0 2023-12-07T16:21:39.142 INFO:tasks.workunit.client.0.smithi063.stdout:7/346: chown d2/d34/d5a/d5f/f27 6301 1 2023-12-07T16:21:39.143 INFO:tasks.workunit.client.1.smithi152.stdout:4/493: mknod d0/d3/d6/d2b/c8d 0 2023-12-07T16:21:39.143 INFO:tasks.workunit.client.0.smithi063.stdout:3/328: dread d7/d9/f12 [0,4194304] 0 2023-12-07T16:21:39.143 INFO:tasks.workunit.client.0.smithi063.stdout:2/363: link d0/d4a/f54 d0/d67/d5b/f78 0 2023-12-07T16:21:39.145 INFO:tasks.workunit.client.0.smithi063.stdout:6/407: write d0/f2c [1116563,85218] 0 2023-12-07T16:21:39.145 INFO:tasks.workunit.client.1.smithi152.stdout:7/533: creat db/d27/d39/fa2 x:0 0 0 2023-12-07T16:21:39.145 INFO:tasks.workunit.client.0.smithi063.stdout:7/347: creat d2/d34/d5a/d5f/d2a/d7e/f86 x:0 0 0 2023-12-07T16:21:39.146 INFO:tasks.workunit.client.0.smithi063.stdout:7/348: readlink d2/d34/d46/d5d/l83 0 2023-12-07T16:21:39.147 INFO:tasks.workunit.client.0.smithi063.stdout:2/364: mknod d0/d67/c79 0 2023-12-07T16:21:39.148 INFO:tasks.workunit.client.0.smithi063.stdout:8/492: dwrite d7/d14/d15/d57/f6f [0,4194304] 0 2023-12-07T16:21:39.151 INFO:tasks.workunit.client.1.smithi152.stdout:1/723: link dc/d14/d18/d2d/d48/da3/d58/l6d dc/d14/d90/lf1 0 2023-12-07T16:21:39.151 INFO:tasks.workunit.client.0.smithi063.stdout:2/365: symlink d0/d21/d39/l7a 0 2023-12-07T16:21:39.152 INFO:tasks.workunit.client.0.smithi063.stdout:6/408: rename d0/d1e/d1d/d1f/d4b/d91 to d0/d17/d46/d93 0 2023-12-07T16:21:39.152 INFO:tasks.workunit.client.1.smithi152.stdout:4/494: symlink d0/d3/d6/l8e 0 2023-12-07T16:21:39.152 INFO:tasks.workunit.client.1.smithi152.stdout:4/495: dread - d0/d3/d6/dc/d3a/d48/f5d zero size 2023-12-07T16:21:39.154 INFO:tasks.workunit.client.1.smithi152.stdout:9/661: dwrite d1/d9/db/df/f27 [0,4194304] 0 2023-12-07T16:21:39.154 INFO:tasks.workunit.client.0.smithi063.stdout:8/493: symlink d7/d38/l96 0 2023-12-07T16:21:39.154 INFO:tasks.workunit.client.0.smithi063.stdout:8/494: write d7/d38/d73/f8d [564103,61798] 0 2023-12-07T16:21:39.156 INFO:tasks.workunit.client.0.smithi063.stdout:2/366: mknod d0/d67/d5b/c7b 0 2023-12-07T16:21:39.156 INFO:tasks.workunit.client.0.smithi063.stdout:2/367: write d0/d1e/f46 [484162,35776] 0 2023-12-07T16:21:39.159 INFO:tasks.workunit.client.0.smithi063.stdout:8/495: creat d7/d14/d15/d57/f97 x:0 0 0 2023-12-07T16:21:39.159 INFO:tasks.workunit.client.0.smithi063.stdout:2/368: creat d0/d4a/f7c x:0 0 0 2023-12-07T16:21:39.159 INFO:tasks.workunit.client.0.smithi063.stdout:2/369: stat d0/d21/d56/d11/l22 0 2023-12-07T16:21:39.161 INFO:tasks.workunit.client.1.smithi152.stdout:4/496: creat d0/d3/d6/d2b/d75/f8f x:0 0 0 2023-12-07T16:21:39.161 INFO:tasks.workunit.client.1.smithi152.stdout:9/662: rmdir d1/d9/d2d/d65 39 2023-12-07T16:21:39.161 INFO:tasks.workunit.client.0.smithi063.stdout:2/370: rename d0/c15 to d0/c7d 0 2023-12-07T16:21:39.163 INFO:tasks.workunit.client.1.smithi152.stdout:4/497: dread d0/d3/d6/dc/dd/d67/f7b [0,4194304] 0 2023-12-07T16:21:39.163 INFO:tasks.workunit.client.1.smithi152.stdout:7/534: dread db/d68/d87/f8c [0,4194304] 0 2023-12-07T16:21:39.166 INFO:tasks.workunit.client.0.smithi063.stdout:6/409: dread d0/d1e/d1d/d1f/f21 [0,4194304] 0 2023-12-07T16:21:39.168 INFO:tasks.workunit.client.1.smithi152.stdout:9/663: rename d1/d17/d38 to d1/dd/dd6/de2 0 2023-12-07T16:21:39.169 INFO:tasks.workunit.client.0.smithi063.stdout:6/410: mkdir d0/d79/d94 0 2023-12-07T16:21:39.169 INFO:tasks.workunit.client.0.smithi063.stdout:6/411: write d0/d1e/d1d/f40 [1375157,115397] 0 2023-12-07T16:21:39.169 INFO:tasks.workunit.client.0.smithi063.stdout:2/371: dread d0/d1e/f30 [0,4194304] 0 2023-12-07T16:21:39.169 INFO:tasks.workunit.client.0.smithi063.stdout:2/372: fdatasync d0/d21/d56/d11/d52/d5d/f5f 0 2023-12-07T16:21:39.169 INFO:tasks.workunit.client.0.smithi063.stdout:2/373: fsync d0/d1e/f34 0 2023-12-07T16:21:39.171 INFO:tasks.workunit.client.1.smithi152.stdout:4/498: getdents d0/d3/d6/dc/d22 0 2023-12-07T16:21:39.180 INFO:tasks.workunit.client.1.smithi152.stdout:4/499: write d0/d3/d6/dc/d22/f32 [4298172,45772] 0 2023-12-07T16:21:39.182 INFO:tasks.workunit.client.0.smithi063.stdout:7/349: dwrite d2/d2c/f75 [0,4194304] 0 2023-12-07T16:21:39.184 INFO:tasks.workunit.client.0.smithi063.stdout:6/412: dread d0/d1e/d1d/f27 [0,4194304] 0 2023-12-07T16:21:39.187 INFO:tasks.workunit.client.0.smithi063.stdout:6/413: getdents d0/d17/d1a/d4d 0 2023-12-07T16:21:39.188 INFO:tasks.workunit.client.0.smithi063.stdout:2/374: dread d0/d67/d5b/f64 [0,4194304] 0 2023-12-07T16:21:39.188 INFO:tasks.workunit.client.0.smithi063.stdout:2/375: dread - d0/d21/d39/f51 zero size 2023-12-07T16:21:39.189 INFO:tasks.workunit.client.0.smithi063.stdout:7/350: getdents d2/d34/d46/d48 0 2023-12-07T16:21:39.189 INFO:tasks.workunit.client.0.smithi063.stdout:2/376: mknod d0/d21/d56/d11/d52/d5d/c7e 0 2023-12-07T16:21:39.189 INFO:tasks.workunit.client.0.smithi063.stdout:2/377: chown d0/l1d 4 1 2023-12-07T16:21:39.189 INFO:tasks.workunit.client.0.smithi063.stdout:3/329: dwrite f6 [4194304,4194304] 0 2023-12-07T16:21:39.190 INFO:tasks.workunit.client.0.smithi063.stdout:3/330: write d7/d4f/f67 [932201,7628] 0 2023-12-07T16:21:39.190 INFO:tasks.workunit.client.0.smithi063.stdout:3/331: chown d7/l8 7095 1 2023-12-07T16:21:39.191 INFO:tasks.workunit.client.0.smithi063.stdout:3/332: rmdir d7/d4f/d53/d54 39 2023-12-07T16:21:39.191 INFO:tasks.workunit.client.0.smithi063.stdout:3/333: chown d7/d21/f29 171 1 2023-12-07T16:21:39.193 INFO:tasks.workunit.client.0.smithi063.stdout:2/378: symlink d0/d1e/l7f 0 2023-12-07T16:21:39.195 INFO:tasks.workunit.client.0.smithi063.stdout:8/496: dwrite d7/fd [0,4194304] 0 2023-12-07T16:21:39.195 INFO:tasks.workunit.client.0.smithi063.stdout:8/497: write d7/d14/f7d [544530,90632] 0 2023-12-07T16:21:39.195 INFO:tasks.workunit.client.0.smithi063.stdout:8/498: fdatasync d7/d14/d15/d2b/f41 0 2023-12-07T16:21:39.195 INFO:tasks.workunit.client.0.smithi063.stdout:3/334: rename d7/d21/f29 to d7/d4f/d53/f6a 0 2023-12-07T16:21:39.196 INFO:tasks.workunit.client.0.smithi063.stdout:7/351: write d2/d34/d5a/d5f/f3e [2886383,84330] 0 2023-12-07T16:21:39.196 INFO:tasks.workunit.client.0.smithi063.stdout:7/352: readlink d2/d2c/l2e 0 2023-12-07T16:21:39.196 INFO:tasks.workunit.client.0.smithi063.stdout:7/353: read - d2/d34/d46/d48/d56/f82 zero size 2023-12-07T16:21:39.197 INFO:tasks.workunit.client.0.smithi063.stdout:8/499: mkdir d7/d14/d15/d2b/d40/d63/d75/d98 0 2023-12-07T16:21:39.200 INFO:tasks.workunit.client.0.smithi063.stdout:3/335: link d7/d9/dd/f1e d7/d9/dd/f6b 0 2023-12-07T16:21:39.200 INFO:tasks.workunit.client.0.smithi063.stdout:3/336: rename d7/d49/d4b to d7/d49/d4b/d6c 22 2023-12-07T16:21:39.200 INFO:tasks.workunit.client.0.smithi063.stdout:7/354: getdents d2 0 2023-12-07T16:21:39.203 INFO:tasks.workunit.client.0.smithi063.stdout:3/337: rename d7/d9/d2b/f43 to d7/d49/d4b/f6d 0 2023-12-07T16:21:39.204 INFO:tasks.workunit.client.0.smithi063.stdout:7/355: mkdir d2/d2c/d87 0 2023-12-07T16:21:39.204 INFO:tasks.workunit.client.0.smithi063.stdout:7/356: write d2/d64/f84 [350289,16963] 0 2023-12-07T16:21:39.204 INFO:tasks.workunit.client.0.smithi063.stdout:7/357: write d2/d2c/f3a [438581,36370] 0 2023-12-07T16:21:39.205 INFO:tasks.workunit.client.0.smithi063.stdout:3/338: read d7/d4f/d53/d54/f58 [3651496,65263] 0 2023-12-07T16:21:39.207 INFO:tasks.workunit.client.1.smithi152.stdout:7/535: dwrite db/d1c/f51 [0,4194304] 0 2023-12-07T16:21:39.207 INFO:tasks.workunit.client.1.smithi152.stdout:7/536: chown db/d27/d4d 126 1 2023-12-07T16:21:39.208 INFO:tasks.workunit.client.0.smithi063.stdout:3/339: mknod d7/d9/d1b/d5c/d5d/c6e 0 2023-12-07T16:21:39.208 INFO:tasks.workunit.client.0.smithi063.stdout:6/414: dwrite d0/d17/f5d [0,4194304] 0 2023-12-07T16:21:39.209 INFO:tasks.workunit.client.0.smithi063.stdout:3/340: mknod d7/d9/dd/d56/c6f 0 2023-12-07T16:21:39.226 INFO:tasks.workunit.client.0.smithi063.stdout:3/341: dwrite d7/d9/dd/f6b [4194304,4194304] 0 2023-12-07T16:21:39.237 INFO:tasks.workunit.client.1.smithi152.stdout:1/724: dwrite dc/d14/d18/d64/f72 [0,4194304] 0 2023-12-07T16:21:39.238 INFO:tasks.workunit.client.1.smithi152.stdout:9/664: dwrite d1/d9/f20 [0,4194304] 0 2023-12-07T16:21:39.240 INFO:tasks.workunit.client.0.smithi063.stdout:6/415: write d0/f2c [243060,55821] 0 2023-12-07T16:21:39.240 INFO:tasks.workunit.client.0.smithi063.stdout:6/416: chown d0/d1e/f63 1625586413 1 2023-12-07T16:21:39.244 INFO:tasks.workunit.client.0.smithi063.stdout:6/417: mkdir d0/d17/d95 0 2023-12-07T16:21:39.245 INFO:tasks.workunit.client.0.smithi063.stdout:2/379: write d0/f10 [4656340,31861] 0 2023-12-07T16:21:39.248 INFO:tasks.workunit.client.0.smithi063.stdout:7/358: write d2/f1e [662061,126755] 0 2023-12-07T16:21:39.248 INFO:tasks.workunit.client.0.smithi063.stdout:7/359: fsync d2/f36 0 2023-12-07T16:21:39.251 INFO:tasks.workunit.client.0.smithi063.stdout:3/342: dwrite d7/f48 [0,4194304] 0 2023-12-07T16:21:39.253 INFO:tasks.workunit.client.0.smithi063.stdout:6/418: unlink d0/d1e/d1d/d4f/f84 0 2023-12-07T16:21:39.254 INFO:tasks.workunit.client.0.smithi063.stdout:2/380: mknod d0/d21/d56/c80 0 2023-12-07T16:21:39.255 INFO:tasks.workunit.client.0.smithi063.stdout:7/360: creat d2/d34/d5a/d5f/d6d/f88 x:0 0 0 2023-12-07T16:21:39.258 INFO:tasks.workunit.client.0.smithi063.stdout:3/343: rename d7/d4f/d53/d54/l57 to d7/d49/d4b/l70 0 2023-12-07T16:21:39.260 INFO:tasks.workunit.client.0.smithi063.stdout:6/419: unlink d0/d1e/d1d/f3a 0 2023-12-07T16:21:39.260 INFO:tasks.workunit.client.0.smithi063.stdout:6/420: truncate d0/d1e/f63 594271 0 2023-12-07T16:21:39.261 INFO:tasks.workunit.client.0.smithi063.stdout:2/381: creat d0/d21/d56/d11/d6d/f81 x:0 0 0 2023-12-07T16:21:39.261 INFO:tasks.workunit.client.0.smithi063.stdout:2/382: chown d0/d21/d56/d11/l22 25400767 1 2023-12-07T16:21:39.262 INFO:tasks.workunit.client.0.smithi063.stdout:3/344: creat d7/d4f/d53/d54/f71 x:0 0 0 2023-12-07T16:21:39.263 INFO:tasks.workunit.client.0.smithi063.stdout:6/421: mknod d0/d1e/d20/c96 0 2023-12-07T16:21:39.263 INFO:tasks.workunit.client.0.smithi063.stdout:6/422: chown d0/d17/f25 7685 1 2023-12-07T16:21:39.264 INFO:tasks.workunit.client.0.smithi063.stdout:6/423: fdatasync d0/ff 0 2023-12-07T16:21:39.265 INFO:tasks.workunit.client.0.smithi063.stdout:6/424: write d0/d1e/d1d/d1f/f28 [475816,31450] 0 2023-12-07T16:21:39.267 INFO:tasks.workunit.client.0.smithi063.stdout:6/425: mknod d0/d1e/d60/d68/c97 0 2023-12-07T16:21:39.269 INFO:tasks.workunit.client.0.smithi063.stdout:8/500: dwrite d7/d38/f70 [0,4194304] 0 2023-12-07T16:21:39.270 INFO:tasks.workunit.client.0.smithi063.stdout:2/383: dread d0/d21/f2a [0,4194304] 0 2023-12-07T16:21:39.271 INFO:tasks.workunit.client.1.smithi152.stdout:9/665: dwrite d1/d9/db/df/d42/fbe [0,4194304] 0 2023-12-07T16:21:39.272 INFO:tasks.workunit.client.1.smithi152.stdout:9/666: truncate d1/d9/db/df/fbd 69939 0 2023-12-07T16:21:39.274 INFO:tasks.workunit.client.0.smithi063.stdout:7/361: dread d2/d21/f3f [0,4194304] 0 2023-12-07T16:21:39.274 INFO:tasks.workunit.client.0.smithi063.stdout:7/362: stat d2/d21/f3f 0 2023-12-07T16:21:39.274 INFO:tasks.workunit.client.0.smithi063.stdout:8/501: getdents d7/d14/d1a/d54/d7e 0 2023-12-07T16:21:39.278 INFO:tasks.workunit.client.0.smithi063.stdout:8/502: link d7/d14/d15/d2b/d40/d63/l90 d7/d14/d15/d2b/l99 0 2023-12-07T16:21:39.278 INFO:tasks.workunit.client.0.smithi063.stdout:8/503: fsync d7/d14/d15/d2b/d40/f62 0 2023-12-07T16:21:39.278 INFO:tasks.workunit.client.0.smithi063.stdout:8/504: read - d7/d14/d1a/d54/d7e/f88 zero size 2023-12-07T16:21:39.280 INFO:tasks.workunit.client.0.smithi063.stdout:3/345: dread d7/d9/f46 [0,4194304] 0 2023-12-07T16:21:39.283 INFO:tasks.workunit.client.0.smithi063.stdout:8/505: creat d7/d14/d15/d2b/d40/f9a x:0 0 0 2023-12-07T16:21:39.283 INFO:tasks.workunit.client.1.smithi152.stdout:7/537: creat db/d27/d39/d41/d37/fa3 x:0 0 0 2023-12-07T16:21:39.285 INFO:tasks.workunit.client.0.smithi063.stdout:3/346: mkdir d7/d4f/d53/d72 0 2023-12-07T16:21:39.287 INFO:tasks.workunit.client.0.smithi063.stdout:8/506: symlink d7/d14/d15/d2b/d40/d63/l9b 0 2023-12-07T16:21:39.292 INFO:tasks.workunit.client.0.smithi063.stdout:3/347: link d7/d21/c2d d7/d49/c73 0 2023-12-07T16:21:39.293 INFO:tasks.workunit.client.0.smithi063.stdout:6/426: dread d0/d17/d46/f50 [0,4194304] 0 2023-12-07T16:21:39.293 INFO:tasks.workunit.client.0.smithi063.stdout:6/427: getdents d0/d1e/d1d/d4f/d88 0 2023-12-07T16:21:39.293 INFO:tasks.workunit.client.0.smithi063.stdout:6/428: fsync d0/d1e/d1d/f3d 0 2023-12-07T16:21:39.293 INFO:tasks.workunit.client.0.smithi063.stdout:6/429: readlink d0/d1e/d1d/l33 0 2023-12-07T16:21:39.293 INFO:tasks.workunit.client.0.smithi063.stdout:6/430: truncate d0/d1e/d60/d68/f70 4437888 0 2023-12-07T16:21:39.295 INFO:tasks.workunit.client.0.smithi063.stdout:3/348: rmdir d7/d9/d2b 39 2023-12-07T16:21:39.295 INFO:tasks.workunit.client.0.smithi063.stdout:3/349: chown d7/d9/d1b/c37 48902 1 2023-12-07T16:21:39.299 INFO:tasks.workunit.client.1.smithi152.stdout:7/538: dread db/d27/d39/f66 [0,4194304] 0 2023-12-07T16:21:39.300 INFO:tasks.workunit.client.0.smithi063.stdout:6/431: rename d0/d1e/d2a/l3b to d0/d17/l98 0 2023-12-07T16:21:39.302 INFO:tasks.workunit.client.0.smithi063.stdout:6/432: getdents d0/d1e/d60/d68 0 2023-12-07T16:21:39.304 INFO:tasks.workunit.client.0.smithi063.stdout:1/254: sync 2023-12-07T16:21:39.304 INFO:tasks.workunit.client.0.smithi063.stdout:4/310: sync 2023-12-07T16:21:39.304 INFO:tasks.workunit.client.0.smithi063.stdout:9/370: sync 2023-12-07T16:21:39.304 INFO:tasks.workunit.client.0.smithi063.stdout:9/371: write d0/f47 [802294,34417] 0 2023-12-07T16:21:39.304 INFO:tasks.workunit.client.0.smithi063.stdout:6/433: mknod d0/d1e/d20/d4a/c99 0 2023-12-07T16:21:39.307 INFO:tasks.workunit.client.0.smithi063.stdout:0/403: sync 2023-12-07T16:21:39.307 INFO:tasks.workunit.client.0.smithi063.stdout:5/343: sync 2023-12-07T16:21:39.307 INFO:tasks.workunit.client.0.smithi063.stdout:5/344: fsync d1/d31/d56/f67 0 2023-12-07T16:21:39.307 INFO:tasks.workunit.client.0.smithi063.stdout:4/311: rename d1/c7 to d1/d3/d3f/d44/c55 0 2023-12-07T16:21:39.308 INFO:tasks.workunit.client.0.smithi063.stdout:6/434: creat d0/d79/f9a x:0 0 0 2023-12-07T16:21:39.310 INFO:tasks.workunit.client.0.smithi063.stdout:4/312: creat d1/d3/db/f56 x:0 0 0 2023-12-07T16:21:39.310 INFO:tasks.workunit.client.0.smithi063.stdout:4/313: chown d1/d3/db/d13/f48 881781045 1 2023-12-07T16:21:39.310 INFO:tasks.workunit.client.0.smithi063.stdout:0/404: mknod d4/dd/de/d15/d1f/d4c/c83 0 2023-12-07T16:21:39.312 INFO:tasks.workunit.client.1.smithi152.stdout:4/500: rename d0/d3/d6/dc/d3a/d46/d80/f88 to d0/d3/d6/dc/dd/f90 0 2023-12-07T16:21:39.314 INFO:tasks.workunit.client.0.smithi063.stdout:5/345: rename d1/d3/de/d1e/c2f to d1/d31/d56/d61/d5e/c6d 0 2023-12-07T16:21:39.314 INFO:tasks.workunit.client.0.smithi063.stdout:4/314: read d1/d3/db/d13/f1c [2358069,93547] 0 2023-12-07T16:21:39.314 INFO:tasks.workunit.client.0.smithi063.stdout:4/315: dread - d1/d3/db/f4f zero size 2023-12-07T16:21:39.314 INFO:tasks.workunit.client.0.smithi063.stdout:4/316: chown d1/d3/d3f/d44/f4c 15015 1 2023-12-07T16:21:39.314 INFO:tasks.workunit.client.0.smithi063.stdout:4/317: rename d1 to d1/d3/db/d2c/d57 22 2023-12-07T16:21:39.315 INFO:tasks.workunit.client.0.smithi063.stdout:0/405: mkdir d4/dd/de/d15/d52/d5b/d63/d74/d84 0 2023-12-07T16:21:39.315 INFO:tasks.workunit.client.0.smithi063.stdout:0/406: readlink d4/dd/d26/d2b/l51 0 2023-12-07T16:21:39.315 INFO:tasks.workunit.client.0.smithi063.stdout:4/318: rename d1/d3/db/d13/f30 to d1/d3/d3f/d44/f58 0 2023-12-07T16:21:39.317 INFO:tasks.workunit.client.0.smithi063.stdout:0/407: creat d4/dd/d26/d2b/d5e/d69/f85 x:0 0 0 2023-12-07T16:21:39.318 INFO:tasks.workunit.client.0.smithi063.stdout:0/408: mkdir d4/dd/de/d15/d86 0 2023-12-07T16:21:39.322 INFO:tasks.workunit.client.0.smithi063.stdout:1/255: dread d0/dd/d10/d1e/f2e [0,4194304] 0 2023-12-07T16:21:39.322 INFO:tasks.workunit.client.0.smithi063.stdout:2/384: dwrite d0/f33 [4194304,4194304] 0 2023-12-07T16:21:39.322 INFO:tasks.workunit.client.0.smithi063.stdout:2/385: fsync d0/d67/f59 0 2023-12-07T16:21:39.323 INFO:tasks.workunit.client.0.smithi063.stdout:1/256: mkdir d0/dd/d55 0 2023-12-07T16:21:39.324 INFO:tasks.workunit.client.0.smithi063.stdout:2/386: creat d0/d67/f82 x:0 0 0 2023-12-07T16:21:39.324 INFO:tasks.workunit.client.0.smithi063.stdout:2/387: creat d0/d21/d56/d11/d52/d5d/f83 x:0 0 0 2023-12-07T16:21:39.325 INFO:tasks.workunit.client.0.smithi063.stdout:2/388: chown d0/d21/d56/d11 0 1 2023-12-07T16:21:39.325 INFO:tasks.workunit.client.0.smithi063.stdout:2/389: write d0/d21/f45 [485195,27556] 0 2023-12-07T16:21:39.325 INFO:tasks.workunit.client.0.smithi063.stdout:2/390: symlink d0/d67/d65/l84 0 2023-12-07T16:21:39.328 INFO:tasks.workunit.client.0.smithi063.stdout:7/363: dwrite d2/d34/d5a/d5f/f18 [0,4194304] 0 2023-12-07T16:21:39.328 INFO:tasks.workunit.client.1.smithi152.stdout:9/667: dwrite d1/d9/db/f79 [0,4194304] 0 2023-12-07T16:21:39.332 INFO:tasks.workunit.client.0.smithi063.stdout:7/364: mknod d2/d37/c89 0 2023-12-07T16:21:39.334 INFO:tasks.workunit.client.0.smithi063.stdout:7/365: mknod d2/d34/d5a/d5f/d53/c8a 0 2023-12-07T16:21:39.334 INFO:tasks.workunit.client.0.smithi063.stdout:7/366: chown d2/d21/f49 27 1 2023-12-07T16:21:39.334 INFO:tasks.workunit.client.0.smithi063.stdout:3/350: dwrite d7/d4f/f55 [0,4194304] 0 2023-12-07T16:21:39.334 INFO:tasks.workunit.client.0.smithi063.stdout:7/367: fsync d2/d34/d5a/d5f/d2a/f31 0 2023-12-07T16:21:39.334 INFO:tasks.workunit.client.0.smithi063.stdout:3/351: truncate d7/d9/d2b/f62 136350 0 2023-12-07T16:21:39.334 INFO:tasks.workunit.client.1.smithi152.stdout:1/725: mknod dc/d14/d18/d2d/cf2 0 2023-12-07T16:21:39.336 INFO:tasks.workunit.client.1.smithi152.stdout:1/726: read dc/f63 [1242728,68046] 0 2023-12-07T16:21:39.338 INFO:tasks.workunit.client.1.smithi152.stdout:1/727: rename dc/d14/d18/d2d/d4a/fed to dc/d14/d18/de9/ff3 0 2023-12-07T16:21:39.339 INFO:tasks.workunit.client.1.smithi152.stdout:1/728: write dc/d14/fd3 [2147847,91841] 0 2023-12-07T16:21:39.339 INFO:tasks.workunit.client.1.smithi152.stdout:1/729: chown dc/d14/d18/d2d/f33 736314072 1 2023-12-07T16:21:39.340 INFO:tasks.workunit.client.1.smithi152.stdout:1/730: creat dc/d28/ff4 x:0 0 0 2023-12-07T16:21:39.341 INFO:tasks.workunit.client.1.smithi152.stdout:1/731: mkdir dc/d14/d90/da9/df5 0 2023-12-07T16:21:39.342 INFO:tasks.workunit.client.1.smithi152.stdout:1/732: mkdir dc/def/df6 0 2023-12-07T16:21:39.343 INFO:tasks.workunit.client.1.smithi152.stdout:1/733: write dc/f40 [1926813,66981] 0 2023-12-07T16:21:39.344 INFO:tasks.workunit.client.1.smithi152.stdout:1/734: getdents dc/d28/d4e/de8 0 2023-12-07T16:21:39.344 INFO:tasks.workunit.client.1.smithi152.stdout:1/735: fsync dc/d14/f84 0 2023-12-07T16:21:39.348 INFO:tasks.workunit.client.0.smithi063.stdout:3/352: dread d7/d9/f46 [0,4194304] 0 2023-12-07T16:21:39.352 INFO:tasks.workunit.client.0.smithi063.stdout:2/391: dwrite d0/d21/f2a [0,4194304] 0 2023-12-07T16:21:39.354 INFO:tasks.workunit.client.0.smithi063.stdout:2/392: symlink d0/d21/d56/d71/l85 0 2023-12-07T16:21:39.356 INFO:tasks.workunit.client.0.smithi063.stdout:2/393: symlink d0/d1e/l86 0 2023-12-07T16:21:39.357 INFO:tasks.workunit.client.0.smithi063.stdout:2/394: symlink d0/d67/d5b/l87 0 2023-12-07T16:21:39.358 INFO:tasks.workunit.client.0.smithi063.stdout:2/395: read d0/d67/f59 [234085,79936] 0 2023-12-07T16:21:39.358 INFO:tasks.workunit.client.0.smithi063.stdout:2/396: chown d0/d21/d56/d11/d52/d5d/l74 4348 1 2023-12-07T16:21:39.361 INFO:tasks.workunit.client.0.smithi063.stdout:2/397: symlink d0/d21/d56/l88 0 2023-12-07T16:21:39.362 INFO:tasks.workunit.client.0.smithi063.stdout:8/507: dwrite d7/d38/d73/f8a [0,4194304] 0 2023-12-07T16:21:39.364 INFO:tasks.workunit.client.0.smithi063.stdout:8/508: rename d7/d14/d15/c8c to d7/d14/d15/d2b/d40/d63/c9c 0 2023-12-07T16:21:39.364 INFO:tasks.workunit.client.0.smithi063.stdout:7/368: write d2/fa [2236913,127220] 0 2023-12-07T16:21:39.366 INFO:tasks.workunit.client.0.smithi063.stdout:8/509: symlink d7/d38/d8e/l9d 0 2023-12-07T16:21:39.367 INFO:tasks.workunit.client.0.smithi063.stdout:7/369: rename d2/d37/c89 to d2/d21/c8b 0 2023-12-07T16:21:39.368 INFO:tasks.workunit.client.0.smithi063.stdout:2/398: dread d0/d67/d5b/f78 [0,4194304] 0 2023-12-07T16:21:39.368 INFO:tasks.workunit.client.0.smithi063.stdout:7/370: symlink d2/d34/d5a/l8c 0 2023-12-07T16:21:39.368 INFO:tasks.workunit.client.0.smithi063.stdout:7/371: readlink d2/d34/d46/d48/d70/l7b 0 2023-12-07T16:21:39.369 INFO:tasks.workunit.client.0.smithi063.stdout:7/372: chown d2/d21/f49 2485351 1 2023-12-07T16:21:39.369 INFO:tasks.workunit.client.0.smithi063.stdout:1/257: dread d0/dd/d10/d1e/f31 [0,4194304] 0 2023-12-07T16:21:39.369 INFO:tasks.workunit.client.0.smithi063.stdout:1/258: chown d0/dd/f16 60 1 2023-12-07T16:21:39.369 INFO:tasks.workunit.client.0.smithi063.stdout:1/259: stat d0/dd/d10/d13/d2f 0 2023-12-07T16:21:39.370 INFO:tasks.workunit.client.0.smithi063.stdout:7/373: rmdir d2/d34/d46/d5d 39 2023-12-07T16:21:39.370 INFO:tasks.workunit.client.0.smithi063.stdout:2/399: write d0/d21/d56/d11/f3c [969262,2468] 0 2023-12-07T16:21:39.370 INFO:tasks.workunit.client.0.smithi063.stdout:3/353: dwrite d7/d9/dd/f2e [0,4194304] 0 2023-12-07T16:21:39.370 INFO:tasks.workunit.client.0.smithi063.stdout:3/354: fdatasync d7/d9/f18 0 2023-12-07T16:21:39.370 INFO:tasks.workunit.client.0.smithi063.stdout:3/355: chown d7/d9/c47 332410 1 2023-12-07T16:21:39.372 INFO:tasks.workunit.client.0.smithi063.stdout:1/260: creat d0/dd/f56 x:0 0 0 2023-12-07T16:21:39.372 INFO:tasks.workunit.client.0.smithi063.stdout:1/261: chown d0/dd/d10/d46/l4c 24009 1 2023-12-07T16:21:39.373 INFO:tasks.workunit.client.0.smithi063.stdout:7/374: mknod d2/d34/d5a/d5f/d78/c8d 0 2023-12-07T16:21:39.373 INFO:tasks.workunit.client.0.smithi063.stdout:2/400: stat d0/d21/d56/d11/c66 0 2023-12-07T16:21:39.373 INFO:tasks.workunit.client.0.smithi063.stdout:2/401: fsync d0/d21/d56/f17 0 2023-12-07T16:21:39.377 INFO:tasks.workunit.client.0.smithi063.stdout:6/435: dwrite d0/d1e/d60/d68/d76/f77 [0,4194304] 0 2023-12-07T16:21:39.377 INFO:tasks.workunit.client.0.smithi063.stdout:6/436: stat d0/d1e 0 2023-12-07T16:21:39.378 INFO:tasks.workunit.client.0.smithi063.stdout:5/346: dwrite d1/d3/de/d1e/d25/f3c [0,4194304] 0 2023-12-07T16:21:39.378 INFO:tasks.workunit.client.0.smithi063.stdout:5/347: chown d1/d3/de 394426432 1 2023-12-07T16:21:39.380 INFO:tasks.workunit.client.0.smithi063.stdout:3/356: mknod d7/d4f/d53/c74 0 2023-12-07T16:21:39.381 INFO:tasks.workunit.client.0.smithi063.stdout:8/510: dread d7/d14/f35 [0,4194304] 0 2023-12-07T16:21:39.383 INFO:tasks.workunit.client.0.smithi063.stdout:1/262: link d0/d47/c48 d0/dd/d55/c57 0 2023-12-07T16:21:39.383 INFO:tasks.workunit.client.0.smithi063.stdout:8/511: write d7/d38/f3b [2263988,91827] 0 2023-12-07T16:21:39.386 INFO:tasks.workunit.client.0.smithi063.stdout:2/402: rename d0/d21/d56/d11/f3c to d0/d21/d56/d11/f89 0 2023-12-07T16:21:39.389 INFO:tasks.workunit.client.1.smithi152.stdout:9/668: dwrite d1/d9/db/df/f27 [0,4194304] 0 2023-12-07T16:21:39.389 INFO:tasks.workunit.client.1.smithi152.stdout:9/669: readlink d1/dd/l2a 0 2023-12-07T16:21:39.389 INFO:tasks.workunit.client.1.smithi152.stdout:9/670: truncate d1/d9/d2d/d72/f8e 513136 0 2023-12-07T16:21:39.393 INFO:tasks.workunit.client.1.smithi152.stdout:9/671: creat d1/d17/d3c/d4a/d48/fe3 x:0 0 0 2023-12-07T16:21:39.394 INFO:tasks.workunit.client.0.smithi063.stdout:5/348: rename d1/d3/l54 to d1/d3/de/d1e/d25/l6e 0 2023-12-07T16:21:39.394 INFO:tasks.workunit.client.0.smithi063.stdout:5/349: chown d1/d31/d56/f67 146 1 2023-12-07T16:21:39.394 INFO:tasks.workunit.client.1.smithi152.stdout:1/736: dwrite dc/d14/d18/d45/fdf [0,4194304] 0 2023-12-07T16:21:39.395 INFO:tasks.workunit.client.1.smithi152.stdout:9/672: creat d1/d9/db/d70/fe4 x:0 0 0 2023-12-07T16:21:39.395 INFO:tasks.workunit.client.1.smithi152.stdout:9/673: write d1/d17/d3c/fa0 [1232619,113000] 0 2023-12-07T16:21:39.397 INFO:tasks.workunit.client.0.smithi063.stdout:3/357: mknod d7/d9/d2b/c75 0 2023-12-07T16:21:39.397 INFO:tasks.workunit.client.0.smithi063.stdout:0/409: rmdir d4/dd/de/d15/d52/d5b/d63/d74 39 2023-12-07T16:21:39.397 INFO:tasks.workunit.client.0.smithi063.stdout:1/263: dread d0/f4 [0,4194304] 0 2023-12-07T16:21:39.398 INFO:tasks.workunit.client.0.smithi063.stdout:0/410: read d4/f5 [834555,14147] 0 2023-12-07T16:21:39.398 INFO:tasks.workunit.client.0.smithi063.stdout:0/411: chown d4/dd/de/d15/d1f/d4c/f62 79667949 1 2023-12-07T16:21:39.399 INFO:tasks.workunit.client.1.smithi152.stdout:1/737: truncate dc/d28/d4e/f99 4058135 0 2023-12-07T16:21:39.400 INFO:tasks.workunit.client.0.smithi063.stdout:2/403: rmdir d0/d21/d56/d11/d52/d63 39 2023-12-07T16:21:39.402 INFO:tasks.workunit.client.1.smithi152.stdout:1/738: symlink dc/d14/d18/d79/de5/lf7 0 2023-12-07T16:21:39.402 INFO:tasks.workunit.client.0.smithi063.stdout:5/350: unlink d1/d3/d3a/c4d 0 2023-12-07T16:21:39.403 INFO:tasks.workunit.client.1.smithi152.stdout:1/739: symlink dc/d14/d18/d2d/d48/da3/d58/lf8 0 2023-12-07T16:21:39.404 INFO:tasks.workunit.client.0.smithi063.stdout:3/358: mkdir d7/d4f/d53/d54/d76 0 2023-12-07T16:21:39.404 INFO:tasks.workunit.client.0.smithi063.stdout:3/359: readlink d7/d9/dd/l1a 0 2023-12-07T16:21:39.405 INFO:tasks.workunit.client.0.smithi063.stdout:1/264: creat d0/dd/d10/d46/f58 x:0 0 0 2023-12-07T16:21:39.405 INFO:tasks.workunit.client.0.smithi063.stdout:1/265: dread - d0/dd/d10/d46/f58 zero size 2023-12-07T16:21:39.406 INFO:tasks.workunit.client.1.smithi152.stdout:7/539: creat db/d27/fa4 x:0 0 0 2023-12-07T16:21:39.406 INFO:tasks.workunit.client.1.smithi152.stdout:7/540: fdatasync db/d1c/f94 0 2023-12-07T16:21:39.406 INFO:tasks.workunit.client.1.smithi152.stdout:7/541: dread - db/d27/d4d/f69 zero size 2023-12-07T16:21:39.406 INFO:tasks.workunit.client.1.smithi152.stdout:7/542: chown db/d1c/lf 20 1 2023-12-07T16:21:39.406 INFO:tasks.workunit.client.1.smithi152.stdout:7/543: chown db/d27/d39/d41/d37/f71 2210 1 2023-12-07T16:21:39.406 INFO:tasks.workunit.client.1.smithi152.stdout:1/740: symlink dc/d14/d18/d45/d74/lf9 0 2023-12-07T16:21:39.406 INFO:tasks.workunit.client.0.smithi063.stdout:0/412: rename d4/dd/de/d15/d1f/f3a to d4/dd/de/d15/d52/f87 0 2023-12-07T16:21:39.407 INFO:tasks.workunit.client.0.smithi063.stdout:2/404: mknod d0/d67/d65/d6a/c8a 0 2023-12-07T16:21:39.407 INFO:tasks.workunit.client.1.smithi152.stdout:7/544: mkdir db/d27/d39/d41/d58/da5 0 2023-12-07T16:21:39.407 INFO:tasks.workunit.client.1.smithi152.stdout:7/545: readlink db/l12 0 2023-12-07T16:21:39.407 INFO:tasks.workunit.client.1.smithi152.stdout:7/546: chown db/c44 749 1 2023-12-07T16:21:39.408 INFO:tasks.workunit.client.1.smithi152.stdout:7/547: symlink db/d27/d39/d41/d37/la6 0 2023-12-07T16:21:39.408 INFO:tasks.workunit.client.0.smithi063.stdout:5/351: creat d1/d31/d56/f6f x:0 0 0 2023-12-07T16:21:39.408 INFO:tasks.workunit.client.0.smithi063.stdout:5/352: chown d1/d3/de/d1e/d25/f53 19464 1 2023-12-07T16:21:39.409 INFO:tasks.workunit.client.0.smithi063.stdout:3/360: creat d7/d49/f77 x:0 0 0 2023-12-07T16:21:39.409 INFO:tasks.workunit.client.1.smithi152.stdout:4/501: rmdir d0/d3/d6/d2b 39 2023-12-07T16:21:39.409 INFO:tasks.workunit.client.1.smithi152.stdout:4/502: chown d0/d3/d6/d2b/d75/f8f 909177 1 2023-12-07T16:21:39.410 INFO:tasks.workunit.client.1.smithi152.stdout:7/548: creat db/d27/fa7 x:0 0 0 2023-12-07T16:21:39.411 INFO:tasks.workunit.client.0.smithi063.stdout:0/413: rmdir d4/dd/d26 39 2023-12-07T16:21:39.412 INFO:tasks.workunit.client.0.smithi063.stdout:0/414: write d4/d25/f71 [47756,124992] 0 2023-12-07T16:21:39.412 INFO:tasks.workunit.client.0.smithi063.stdout:0/415: dread - d4/d25/f4b zero size 2023-12-07T16:21:39.412 INFO:tasks.workunit.client.1.smithi152.stdout:7/549: rename db/d27/d5e/f6b to db/d1c/fa8 0 2023-12-07T16:21:39.414 INFO:tasks.workunit.client.1.smithi152.stdout:7/550: mkdir db/d27/d5e/d45/da9 0 2023-12-07T16:21:39.415 INFO:tasks.workunit.client.0.smithi063.stdout:1/266: dread d0/f4 [0,4194304] 0 2023-12-07T16:21:39.415 INFO:tasks.workunit.client.0.smithi063.stdout:1/267: stat d0/dd/d10/d1e/f52 0 2023-12-07T16:21:39.416 INFO:tasks.workunit.client.1.smithi152.stdout:7/551: mknod db/d27/d5e/caa 0 2023-12-07T16:21:39.416 INFO:tasks.workunit.client.0.smithi063.stdout:5/353: mknod d1/d31/d56/c70 0 2023-12-07T16:21:39.418 INFO:tasks.workunit.client.0.smithi063.stdout:7/375: dwrite d2/d2c/f68 [0,4194304] 0 2023-12-07T16:21:39.418 INFO:tasks.workunit.client.0.smithi063.stdout:3/361: mknod d7/d4f/d53/c78 0 2023-12-07T16:21:39.418 INFO:tasks.workunit.client.1.smithi152.stdout:7/552: creat db/d27/d5e/d45/fab x:0 0 0 2023-12-07T16:21:39.418 INFO:tasks.workunit.client.1.smithi152.stdout:7/553: dread - db/d27/d39/d41/d37/f38 zero size 2023-12-07T16:21:39.419 INFO:tasks.workunit.client.0.smithi063.stdout:0/416: creat d4/dd/d26/d2b/d5e/f88 x:0 0 0 2023-12-07T16:21:39.419 INFO:tasks.workunit.client.0.smithi063.stdout:0/417: dread - d4/dd/de/d15/d52/d5b/d63/f80 zero size 2023-12-07T16:21:39.420 INFO:tasks.workunit.client.0.smithi063.stdout:1/268: rmdir d0/dd/d10/d13 39 2023-12-07T16:21:39.420 INFO:tasks.workunit.client.0.smithi063.stdout:1/269: chown d0/d47/c48 2658549 1 2023-12-07T16:21:39.420 INFO:tasks.workunit.client.1.smithi152.stdout:1/741: dread dc/fd [0,4194304] 0 2023-12-07T16:21:39.422 INFO:tasks.workunit.client.0.smithi063.stdout:3/362: dread d7/f51 [0,4194304] 0 2023-12-07T16:21:39.422 INFO:tasks.workunit.client.1.smithi152.stdout:1/742: read dc/f13 [2992749,86742] 0 2023-12-07T16:21:39.424 INFO:tasks.workunit.client.1.smithi152.stdout:1/743: symlink dc/d14/d18/lfa 0 2023-12-07T16:21:39.424 INFO:tasks.workunit.client.0.smithi063.stdout:8/512: dwrite d7/d38/d73/f8a [0,4194304] 0 2023-12-07T16:21:39.425 INFO:tasks.workunit.client.1.smithi152.stdout:1/744: creat dc/d14/d18/d79/ffb x:0 0 0 2023-12-07T16:21:39.427 INFO:tasks.workunit.client.1.smithi152.stdout:1/745: mkdir dc/d14/d18/d2d/d9c/dfc 0 2023-12-07T16:21:39.427 INFO:tasks.workunit.client.0.smithi063.stdout:7/376: link d2/d34/d5a/d5f/d2a/f2f d2/d34/d46/d5d/f8e 0 2023-12-07T16:21:39.427 INFO:tasks.workunit.client.0.smithi063.stdout:6/437: dwrite d0/d1e/d60/d68/f70 [0,4194304] 0 2023-12-07T16:21:39.427 INFO:tasks.workunit.client.0.smithi063.stdout:7/377: read - d2/d34/d5a/d5f/d53/f60 zero size 2023-12-07T16:21:39.427 INFO:tasks.workunit.client.0.smithi063.stdout:1/270: mknod d0/dd/d1f/c59 0 2023-12-07T16:21:39.427 INFO:tasks.workunit.client.0.smithi063.stdout:5/354: dread d1/f2a [0,4194304] 0 2023-12-07T16:21:39.428 INFO:tasks.workunit.client.1.smithi152.stdout:9/674: dwrite d1/d9/d2d/d46/f5d [0,4194304] 0 2023-12-07T16:21:39.429 INFO:tasks.workunit.client.1.smithi152.stdout:1/746: write dc/d14/d18/d2d/f67 [2053356,90565] 0 2023-12-07T16:21:39.430 INFO:tasks.workunit.client.1.smithi152.stdout:4/503: dwrite d0/d3/d6/dc/dd/f6c [0,4194304] 0 2023-12-07T16:21:39.432 INFO:tasks.workunit.client.1.smithi152.stdout:1/747: truncate dc/d28/f5e 1524451 0 2023-12-07T16:21:39.433 INFO:tasks.workunit.client.1.smithi152.stdout:4/504: mknod d0/d3/d6/dc/dd/c91 0 2023-12-07T16:21:39.433 INFO:tasks.workunit.client.0.smithi063.stdout:8/513: creat d7/d14/f9e x:0 0 0 2023-12-07T16:21:39.433 INFO:tasks.workunit.client.0.smithi063.stdout:6/438: getdents d0/d1e/d1d/d1f/d4b 0 2023-12-07T16:21:39.434 INFO:tasks.workunit.client.0.smithi063.stdout:1/271: rmdir d0/dd/d10/d1e 39 2023-12-07T16:21:39.435 INFO:tasks.workunit.client.1.smithi152.stdout:1/748: link dc/d28/d4e/f80 dc/d14/d18/d79/d86/db7/ffd 0 2023-12-07T16:21:39.437 INFO:tasks.workunit.client.0.smithi063.stdout:5/355: rename d1/d3/de/d1e/l5b to d1/d3/de/l71 0 2023-12-07T16:21:39.437 INFO:tasks.workunit.client.1.smithi152.stdout:6/581: sync 2023-12-07T16:21:39.437 INFO:tasks.workunit.client.1.smithi152.stdout:0/584: sync 2023-12-07T16:21:39.437 INFO:tasks.workunit.client.1.smithi152.stdout:0/585: chown d0/f1a 1626062 1 2023-12-07T16:21:39.440 INFO:tasks.workunit.client.1.smithi152.stdout:0/586: write d0/fa4 [8769723,21832] 0 2023-12-07T16:21:39.440 INFO:tasks.workunit.client.0.smithi063.stdout:8/514: mkdir d7/d38/d73/d83/d9f 0 2023-12-07T16:21:39.440 INFO:tasks.workunit.client.0.smithi063.stdout:8/515: fdatasync d7/d14/d15/d57/f66 0 2023-12-07T16:21:39.441 INFO:tasks.workunit.client.1.smithi152.stdout:6/582: creat d2/d4f/d83/d85/de/fbc x:0 0 0 2023-12-07T16:21:39.449 INFO:tasks.workunit.client.1.smithi152.stdout:6/583: write d2/d4f/d83/d48/f53 [2486634,6085] 0 2023-12-07T16:21:39.449 INFO:tasks.workunit.client.0.smithi063.stdout:3/363: dwrite d7/ff [0,4194304] 0 2023-12-07T16:21:39.451 INFO:tasks.workunit.client.0.smithi063.stdout:1/272: creat d0/dd/d10/d1e/f5a x:0 0 0 2023-12-07T16:21:39.452 INFO:tasks.workunit.client.1.smithi152.stdout:7/554: dwrite db/d68/d87/f8c [4194304,4194304] 0 2023-12-07T16:21:39.452 INFO:tasks.workunit.client.0.smithi063.stdout:5/356: symlink d1/d3/l72 0 2023-12-07T16:21:39.452 INFO:tasks.workunit.client.0.smithi063.stdout:5/357: chown d1/d31/d56/d61/f57 6532 1 2023-12-07T16:21:39.452 INFO:tasks.workunit.client.0.smithi063.stdout:3/364: write d7/d9/d2b/d41/f5a [745711,31274] 0 2023-12-07T16:21:39.453 INFO:tasks.workunit.client.1.smithi152.stdout:9/675: dwrite d1/d17/d3c/d4a/d7e/f9b [0,4194304] 0 2023-12-07T16:21:39.453 INFO:tasks.workunit.client.1.smithi152.stdout:7/555: write db/d27/d4d/f6d [66830,23028] 0 2023-12-07T16:21:39.453 INFO:tasks.workunit.client.0.smithi063.stdout:8/516: truncate d7/d14/d15/f6d 3055789 0 2023-12-07T16:21:39.453 INFO:tasks.workunit.client.0.smithi063.stdout:8/517: stat d7/d14/d15/d2b/d40/f9a 0 2023-12-07T16:21:39.456 INFO:tasks.workunit.client.0.smithi063.stdout:1/273: unlink d0/dd/d10/d46/l49 0 2023-12-07T16:21:39.457 INFO:tasks.workunit.client.0.smithi063.stdout:5/358: creat d1/d31/d56/f73 x:0 0 0 2023-12-07T16:21:39.457 INFO:tasks.workunit.client.0.smithi063.stdout:5/359: fsync d1/f40 0 2023-12-07T16:21:39.459 INFO:tasks.workunit.client.0.smithi063.stdout:3/365: mkdir d7/d9/d1b/d5c/d5d/d79 0 2023-12-07T16:21:39.460 INFO:tasks.workunit.client.0.smithi063.stdout:1/274: creat d0/dd/d1f/f5b x:0 0 0 2023-12-07T16:21:39.462 INFO:tasks.workunit.client.0.smithi063.stdout:5/360: rename d1/d3/de/d1e/l4f to d1/d3/d3a/l74 0 2023-12-07T16:21:39.462 INFO:tasks.workunit.client.0.smithi063.stdout:5/361: fsync d1/d3/f35 0 2023-12-07T16:21:39.463 INFO:tasks.workunit.client.0.smithi063.stdout:3/366: link d7/d4f/f64 d7/d49/d4b/f7a 0 2023-12-07T16:21:39.464 INFO:tasks.workunit.client.0.smithi063.stdout:8/518: dread d7/f24 [0,4194304] 0 2023-12-07T16:21:39.464 INFO:tasks.workunit.client.0.smithi063.stdout:8/519: read - d7/f8f zero size 2023-12-07T16:21:39.465 INFO:tasks.workunit.client.0.smithi063.stdout:5/362: creat d1/d31/d56/d61/d5e/f75 x:0 0 0 2023-12-07T16:21:39.466 INFO:tasks.workunit.client.0.smithi063.stdout:3/367: mknod d7/d4f/c7b 0 2023-12-07T16:21:39.466 INFO:tasks.workunit.client.0.smithi063.stdout:3/368: fdatasync d7/d49/d4b/f5e 0 2023-12-07T16:21:39.466 INFO:tasks.workunit.client.0.smithi063.stdout:1/275: mknod d0/c5c 0 2023-12-07T16:21:39.468 INFO:tasks.workunit.client.0.smithi063.stdout:8/520: creat d7/d14/d15/d2b/d40/d63/d75/fa0 x:0 0 0 2023-12-07T16:21:39.469 INFO:tasks.workunit.client.1.smithi152.stdout:0/587: dwrite d0/d2f/f3f [0,4194304] 0 2023-12-07T16:21:39.469 INFO:tasks.workunit.client.1.smithi152.stdout:0/588: write d0/dc/d3d/d4c/f6a [974785,15356] 0 2023-12-07T16:21:39.469 INFO:tasks.workunit.client.0.smithi063.stdout:6/439: dwrite d0/d1e/d29/f36 [0,4194304] 0 2023-12-07T16:21:39.471 INFO:tasks.workunit.client.0.smithi063.stdout:3/369: unlink d7/d21/c22 0 2023-12-07T16:21:39.473 INFO:tasks.workunit.client.0.smithi063.stdout:1/276: symlink d0/dd/d19/l5d 0 2023-12-07T16:21:39.473 INFO:tasks.workunit.client.0.smithi063.stdout:2/405: rmdir d0 39 2023-12-07T16:21:39.473 INFO:tasks.workunit.client.0.smithi063.stdout:2/406: write d0/d21/d56/d11/f58 [1207233,116740] 0 2023-12-07T16:21:39.475 INFO:tasks.workunit.client.0.smithi063.stdout:6/440: creat d0/d17/d1a/d4d/d5a/f9b x:0 0 0 2023-12-07T16:21:39.476 INFO:tasks.workunit.client.0.smithi063.stdout:3/370: symlink d7/d9/l7c 0 2023-12-07T16:21:39.476 INFO:tasks.workunit.client.0.smithi063.stdout:3/371: chown d7/d21/l2f 30502130 1 2023-12-07T16:21:39.477 INFO:tasks.workunit.client.0.smithi063.stdout:3/372: stat d7/d9/dd/f1e 0 2023-12-07T16:21:39.477 INFO:tasks.workunit.client.0.smithi063.stdout:1/277: creat d0/dd/d10/d46/f5e x:0 0 0 2023-12-07T16:21:39.478 INFO:tasks.workunit.client.0.smithi063.stdout:2/407: mknod d0/d21/c8b 0 2023-12-07T16:21:39.478 INFO:tasks.workunit.client.0.smithi063.stdout:2/408: chown d0/d4a/f6e 614861 1 2023-12-07T16:21:39.479 INFO:tasks.workunit.client.0.smithi063.stdout:8/521: dread d7/d14/d15/d2b/d40/d63/d75/f86 [0,4194304] 0 2023-12-07T16:21:39.479 INFO:tasks.workunit.client.0.smithi063.stdout:3/373: mkdir d7/d4f/d53/d72/d7d 0 2023-12-07T16:21:39.479 INFO:tasks.workunit.client.0.smithi063.stdout:3/374: fsync d7/d9/d2b/f3d 0 2023-12-07T16:21:39.479 INFO:tasks.workunit.client.0.smithi063.stdout:0/418: getdents d4/dd/d26/d2b/d5e 0 2023-12-07T16:21:39.482 INFO:tasks.workunit.client.0.smithi063.stdout:3/375: dread d7/d4f/f67 [0,4194304] 0 2023-12-07T16:21:39.482 INFO:tasks.workunit.client.0.smithi063.stdout:3/376: chown d7/d9/dd 3117 1 2023-12-07T16:21:39.482 INFO:tasks.workunit.client.0.smithi063.stdout:3/377: write d7/d9/f3f [972654,15825] 0 2023-12-07T16:21:39.482 INFO:tasks.workunit.client.0.smithi063.stdout:3/378: fsync d7/f51 0 2023-12-07T16:21:39.482 INFO:tasks.workunit.client.0.smithi063.stdout:2/409: mkdir d0/d21/d56/d11/d52/d63/d8c 0 2023-12-07T16:21:39.485 INFO:tasks.workunit.client.0.smithi063.stdout:8/522: rename d7/d14/f81 to d7/d38/d73/fa1 0 2023-12-07T16:21:39.487 INFO:tasks.workunit.client.0.smithi063.stdout:1/278: link d0/lb d0/dd/d19/d50/l5f 0 2023-12-07T16:21:39.488 INFO:tasks.workunit.client.0.smithi063.stdout:3/379: stat d7/d21/c3a 0 2023-12-07T16:21:39.489 INFO:tasks.workunit.client.0.smithi063.stdout:2/410: mkdir d0/d21/d8d 0 2023-12-07T16:21:39.491 INFO:tasks.workunit.client.0.smithi063.stdout:1/279: creat d0/dd/d10/d13/f60 x:0 0 0 2023-12-07T16:21:39.492 INFO:tasks.workunit.client.0.smithi063.stdout:1/280: write d0/dd/d10/d1b/f51 [86020,44951] 0 2023-12-07T16:21:39.494 INFO:tasks.workunit.client.0.smithi063.stdout:3/380: mkdir d7/d7e 0 2023-12-07T16:21:39.494 INFO:tasks.workunit.client.0.smithi063.stdout:3/381: fsync d7/f48 0 2023-12-07T16:21:39.496 INFO:tasks.workunit.client.0.smithi063.stdout:2/411: rmdir d0/d21/d8d 0 2023-12-07T16:21:39.499 INFO:tasks.workunit.client.0.smithi063.stdout:2/412: read d0/f14 [2942717,90000] 0 2023-12-07T16:21:39.499 INFO:tasks.workunit.client.0.smithi063.stdout:2/413: write d0/d4a/f6e [609677,8259] 0 2023-12-07T16:21:39.500 INFO:tasks.workunit.client.0.smithi063.stdout:6/441: dwrite d0/d1e/d60/d68/d69/d7d/f86 [0,4194304] 0 2023-12-07T16:21:39.501 INFO:tasks.workunit.client.0.smithi063.stdout:3/382: mkdir d7/d9/dd/d7f 0 2023-12-07T16:21:39.503 INFO:tasks.workunit.client.0.smithi063.stdout:3/383: symlink d7/d4f/d53/d54/d76/l80 0 2023-12-07T16:21:39.507 INFO:tasks.workunit.client.0.smithi063.stdout:1/281: rmdir d0/dd/d1f 39 2023-12-07T16:21:39.507 INFO:tasks.workunit.client.0.smithi063.stdout:1/282: chown d0/dd/d10/d13 518538367 1 2023-12-07T16:21:39.508 INFO:tasks.workunit.client.0.smithi063.stdout:5/363: rmdir d1/d3 39 2023-12-07T16:21:39.508 INFO:tasks.workunit.client.0.smithi063.stdout:5/364: chown d1/d3/de/d1e/f24 6 1 2023-12-07T16:21:39.510 INFO:tasks.workunit.client.0.smithi063.stdout:1/283: symlink d0/dd/d1f/l61 0 2023-12-07T16:21:39.512 INFO:tasks.workunit.client.0.smithi063.stdout:1/284: creat d0/dd/d10/f62 x:0 0 0 2023-12-07T16:21:39.512 INFO:tasks.workunit.client.0.smithi063.stdout:1/285: truncate d0/dd/d10/d1e/f2e 1238053 0 2023-12-07T16:21:39.513 INFO:tasks.workunit.client.0.smithi063.stdout:6/442: dread d0/d17/d1a/f4c [0,4194304] 0 2023-12-07T16:21:39.513 INFO:tasks.workunit.client.0.smithi063.stdout:1/286: mknod d0/dd/d10/d13/d2f/c63 0 2023-12-07T16:21:39.515 INFO:tasks.workunit.client.0.smithi063.stdout:1/287: link d0/f4b d0/dd/d10/d1e/f64 0 2023-12-07T16:21:39.517 INFO:tasks.workunit.client.0.smithi063.stdout:1/288: creat d0/dd/d1f/f65 x:0 0 0 2023-12-07T16:21:39.517 INFO:tasks.workunit.client.0.smithi063.stdout:1/289: readlink d0/dd/d1f/l35 0 2023-12-07T16:21:39.517 INFO:tasks.workunit.client.0.smithi063.stdout:0/419: dwrite d4/dd/de/d15/d1f/f54 [0,4194304] 0 2023-12-07T16:21:39.519 INFO:tasks.workunit.client.0.smithi063.stdout:0/420: write d4/f5 [1292657,59003] 0 2023-12-07T16:21:39.520 INFO:tasks.workunit.client.0.smithi063.stdout:3/384: dread f6 [4194304,4194304] 0 2023-12-07T16:21:39.520 INFO:tasks.workunit.client.0.smithi063.stdout:3/385: chown d7/d9/d1b/d5c 522540416 1 2023-12-07T16:21:39.523 INFO:tasks.workunit.client.0.smithi063.stdout:2/414: dwrite d0/d1e/f29 [4194304,4194304] 0 2023-12-07T16:21:39.523 INFO:tasks.workunit.client.0.smithi063.stdout:2/415: chown d0/d21/d56/d11/d52/c57 1 1 2023-12-07T16:21:39.523 INFO:tasks.workunit.client.0.smithi063.stdout:2/416: chown d0/d1e/l7f 0 1 2023-12-07T16:21:39.523 INFO:tasks.workunit.client.0.smithi063.stdout:2/417: truncate d0/d21/d56/d11/d6d/f81 292779 0 2023-12-07T16:21:39.524 INFO:tasks.workunit.client.0.smithi063.stdout:0/421: creat d4/dd/de/d15/d52/d5b/d63/d6b/f89 x:0 0 0 2023-12-07T16:21:39.524 INFO:tasks.workunit.client.0.smithi063.stdout:0/422: chown d4/dd/l12 172370 1 2023-12-07T16:21:39.524 INFO:tasks.workunit.client.0.smithi063.stdout:3/386: write d7/d9/f12 [56971,76833] 0 2023-12-07T16:21:39.524 INFO:tasks.workunit.client.0.smithi063.stdout:3/387: fdatasync d7/d9/dd/f42 0 2023-12-07T16:21:39.527 INFO:tasks.workunit.client.0.smithi063.stdout:2/418: mkdir d0/d67/d65/d6a/d8e 0 2023-12-07T16:21:39.527 INFO:tasks.workunit.client.0.smithi063.stdout:0/423: creat d4/f8a x:0 0 0 2023-12-07T16:21:39.527 INFO:tasks.workunit.client.0.smithi063.stdout:2/419: write d0/d21/d39/f4e [2872979,125698] 0 2023-12-07T16:21:39.528 INFO:tasks.workunit.client.0.smithi063.stdout:5/365: dread d1/d3/de/f10 [0,4194304] 0 2023-12-07T16:21:39.528 INFO:tasks.workunit.client.0.smithi063.stdout:8/523: dwrite d7/f4a [0,4194304] 0 2023-12-07T16:21:39.530 INFO:tasks.workunit.client.0.smithi063.stdout:0/424: creat d4/dd/de/d15/d1f/d61/f8b x:0 0 0 2023-12-07T16:21:39.530 INFO:tasks.workunit.client.0.smithi063.stdout:0/425: fsync d4/dd/de/d15/f21 0 2023-12-07T16:21:39.532 INFO:tasks.workunit.client.0.smithi063.stdout:2/420: creat d0/d21/d56/d11/d52/d63/d8c/f8f x:0 0 0 2023-12-07T16:21:39.534 INFO:tasks.workunit.client.0.smithi063.stdout:5/366: link d1/f11 d1/d3/de/f76 0 2023-12-07T16:21:39.536 INFO:tasks.workunit.client.0.smithi063.stdout:8/524: symlink d7/d14/d15/d48/la2 0 2023-12-07T16:21:39.537 INFO:tasks.workunit.client.0.smithi063.stdout:2/421: creat d0/d1e/f90 x:0 0 0 2023-12-07T16:21:39.538 INFO:tasks.workunit.client.0.smithi063.stdout:6/443: dwrite d0/d17/d1a/d4d/f8e [0,4194304] 0 2023-12-07T16:21:39.538 INFO:tasks.workunit.client.0.smithi063.stdout:6/444: fsync d0/d17/d46/f55 0 2023-12-07T16:21:39.538 INFO:tasks.workunit.client.0.smithi063.stdout:1/290: dwrite d0/dd/d10/d13/f3d [0,4194304] 0 2023-12-07T16:21:39.539 INFO:tasks.workunit.client.0.smithi063.stdout:2/422: write d0/d67/f59 [4458,93663] 0 2023-12-07T16:21:39.539 INFO:tasks.workunit.client.0.smithi063.stdout:2/423: stat d0/f16 0 2023-12-07T16:21:39.539 INFO:tasks.workunit.client.0.smithi063.stdout:2/424: chown d0/d4a/f5e 162 1 2023-12-07T16:21:39.541 INFO:tasks.workunit.client.0.smithi063.stdout:6/445: mkdir d0/d1e/d60/d68/d78/d9c 0 2023-12-07T16:21:39.541 INFO:tasks.workunit.client.0.smithi063.stdout:6/446: chown d0/d1e/d1d/d1f/c8a 3448 1 2023-12-07T16:21:39.542 INFO:tasks.workunit.client.0.smithi063.stdout:5/367: dread d1/f65 [0,4194304] 0 2023-12-07T16:21:39.543 INFO:tasks.workunit.client.0.smithi063.stdout:2/425: creat d0/d67/d65/d6a/d8e/f91 x:0 0 0 2023-12-07T16:21:39.544 INFO:tasks.workunit.client.0.smithi063.stdout:2/426: fsync d0/d21/d56/f17 0 2023-12-07T16:21:39.545 INFO:tasks.workunit.client.0.smithi063.stdout:3/388: rmdir d7/d9 39 2023-12-07T16:21:39.545 INFO:tasks.workunit.client.0.smithi063.stdout:3/389: chown d7/f51 186944971 1 2023-12-07T16:21:39.546 INFO:tasks.workunit.client.0.smithi063.stdout:6/447: mkdir d0/d17/d1a/d4d/d5a/d9d 0 2023-12-07T16:21:39.548 INFO:tasks.workunit.client.0.smithi063.stdout:5/368: creat d1/d3/d3a/f77 x:0 0 0 2023-12-07T16:21:39.548 INFO:tasks.workunit.client.0.smithi063.stdout:3/390: write d7/fa [588896,24082] 0 2023-12-07T16:21:39.548 INFO:tasks.workunit.client.0.smithi063.stdout:3/391: write d7/d21/f34 [816910,59158] 0 2023-12-07T16:21:39.551 INFO:tasks.workunit.client.0.smithi063.stdout:1/291: rename d0/dd/d19/l5d to d0/l66 0 2023-12-07T16:21:39.552 INFO:tasks.workunit.client.0.smithi063.stdout:2/427: symlink d0/d21/d39/l92 0 2023-12-07T16:21:39.554 INFO:tasks.workunit.client.0.smithi063.stdout:6/448: rename d0/d17/d46/f7f to d0/d17/d46/f9e 0 2023-12-07T16:21:39.554 INFO:tasks.workunit.client.0.smithi063.stdout:6/449: chown d0/d17/d1a/d38/l7b 415459 1 2023-12-07T16:21:39.558 INFO:tasks.workunit.client.0.smithi063.stdout:8/525: dwrite d7/d38/d73/d83/f95 [0,4194304] 0 2023-12-07T16:21:39.558 INFO:tasks.workunit.client.1.smithi152.stdout:6/584: mknod d2/d4f/d83/d48/d70/da7/cbd 0 2023-12-07T16:21:39.561 INFO:tasks.workunit.client.0.smithi063.stdout:3/392: rmdir d7/d9/d1b/d5c/d5d/d79 0 2023-12-07T16:21:39.561 INFO:tasks.workunit.client.0.smithi063.stdout:1/292: getdents d0/dd/d55 0 2023-12-07T16:21:39.561 INFO:tasks.workunit.client.1.smithi152.stdout:9/676: symlink d1/d9/d2d/d72/d80/le5 0 2023-12-07T16:21:39.565 INFO:tasks.workunit.client.1.smithi152.stdout:2/560: sync 2023-12-07T16:21:39.565 INFO:tasks.workunit.client.0.smithi063.stdout:6/450: mkdir d0/d1e/d60/d68/d78/d9c/d9f 0 2023-12-07T16:21:39.566 INFO:tasks.workunit.client.0.smithi063.stdout:6/451: read d0/d1e/d1d/f27 [3049169,90135] 0 2023-12-07T16:21:39.566 INFO:tasks.workunit.client.0.smithi063.stdout:6/452: truncate d0/d17/d1a/d4d/d5a/f9b 612104 0 2023-12-07T16:21:39.566 INFO:tasks.workunit.client.1.smithi152.stdout:0/589: mknod d0/dc/d36/d7d/cc5 0 2023-12-07T16:21:39.566 INFO:tasks.workunit.client.1.smithi152.stdout:7/556: mkdir db/d27/d39/d41/d58/d80/dac 0 2023-12-07T16:21:39.569 INFO:tasks.workunit.client.1.smithi152.stdout:6/585: unlink d2/d4f/d83/d85/d9/fae 0 2023-12-07T16:21:39.569 INFO:tasks.workunit.client.1.smithi152.stdout:6/586: chown d2/d4f/d83/d85/de/c39 56 1 2023-12-07T16:21:39.569 INFO:tasks.workunit.client.1.smithi152.stdout:6/587: write d2/d4f/d83/d85/de/d2e/f4e [1218216,27277] 0 2023-12-07T16:21:39.570 INFO:tasks.workunit.client.1.smithi152.stdout:6/588: write d2/d4f/d83/d48/d70/f9e [4569215,70926] 0 2023-12-07T16:21:39.572 INFO:tasks.workunit.client.1.smithi152.stdout:0/590: creat d0/dc/d36/d3a/d51/fc6 x:0 0 0 2023-12-07T16:21:39.573 INFO:tasks.workunit.client.0.smithi063.stdout:3/393: creat d7/d9/d1b/d5c/d5d/f81 x:0 0 0 2023-12-07T16:21:39.573 INFO:tasks.workunit.client.0.smithi063.stdout:6/453: readlink d0/l14 0 2023-12-07T16:21:39.574 INFO:tasks.workunit.client.1.smithi152.stdout:7/557: mknod db/d27/cad 0 2023-12-07T16:21:39.575 INFO:tasks.workunit.client.0.smithi063.stdout:3/394: creat d7/d4f/d53/f82 x:0 0 0 2023-12-07T16:21:39.575 INFO:tasks.workunit.client.0.smithi063.stdout:3/395: read d7/d21/f34 [392485,44419] 0 2023-12-07T16:21:39.576 INFO:tasks.workunit.client.0.smithi063.stdout:3/396: chown d7/d4f/d53/f6a 1515341 1 2023-12-07T16:21:39.576 INFO:tasks.workunit.client.0.smithi063.stdout:6/454: creat d0/d79/fa0 x:0 0 0 2023-12-07T16:21:39.577 INFO:tasks.workunit.client.0.smithi063.stdout:8/526: dread d7/d14/d1a/d54/f5b [0,4194304] 0 2023-12-07T16:21:39.579 INFO:tasks.workunit.client.1.smithi152.stdout:5/726: sync 2023-12-07T16:21:39.579 INFO:tasks.workunit.client.1.smithi152.stdout:5/727: stat dd/de/d14/d19/d1a/dcc/feb 0 2023-12-07T16:21:39.579 INFO:tasks.workunit.client.1.smithi152.stdout:3/538: sync 2023-12-07T16:21:39.579 INFO:tasks.workunit.client.1.smithi152.stdout:0/591: dread d0/d2f/d30/d6e/d77/d9f/fa0 [0,4194304] 0 2023-12-07T16:21:39.579 INFO:tasks.workunit.client.1.smithi152.stdout:0/592: chown d0/d2f/d30/f5a 1 1 2023-12-07T16:21:39.579 INFO:tasks.workunit.client.1.smithi152.stdout:7/558: symlink db/d68/d87/lae 0 2023-12-07T16:21:39.579 INFO:tasks.workunit.client.1.smithi152.stdout:7/559: write db/d27/f49 [746694,79439] 0 2023-12-07T16:21:39.579 INFO:tasks.workunit.client.1.smithi152.stdout:7/560: dread - db/d27/d5e/d45/f9e zero size 2023-12-07T16:21:39.579 INFO:tasks.workunit.client.1.smithi152.stdout:7/561: write db/d27/d39/d41/d58/f73 [4260890,100061] 0 2023-12-07T16:21:39.579 INFO:tasks.workunit.client.1.smithi152.stdout:7/562: readlink db/d27/d39/d41/l5f 0 2023-12-07T16:21:39.580 INFO:tasks.workunit.client.0.smithi063.stdout:3/397: unlink d7/d9/f3f 0 2023-12-07T16:21:39.580 INFO:tasks.workunit.client.1.smithi152.stdout:5/728: truncate fc 8033497 0 2023-12-07T16:21:39.580 INFO:tasks.workunit.client.1.smithi152.stdout:5/729: readlink dd/de/d38/d3d/la2 0 2023-12-07T16:21:39.582 INFO:tasks.workunit.client.1.smithi152.stdout:7/563: read f8 [3702449,11876] 0 2023-12-07T16:21:39.582 INFO:tasks.workunit.client.1.smithi152.stdout:7/564: fdatasync db/d27/d5e/d45/f4c 0 2023-12-07T16:21:39.582 INFO:tasks.workunit.client.1.smithi152.stdout:7/565: fsync db/d27/d39/d41/d37/f38 0 2023-12-07T16:21:39.583 INFO:tasks.workunit.client.0.smithi063.stdout:8/527: rename d7/f8f to d7/d14/d15/d2b/d40/d63/d75/d98/fa3 0 2023-12-07T16:21:39.583 INFO:tasks.workunit.client.0.smithi063.stdout:8/528: truncate d7/d14/f9e 1019243 0 2023-12-07T16:21:39.584 INFO:tasks.workunit.client.0.smithi063.stdout:3/398: link d7/d9/dd/f1f d7/d4f/d53/d54/d76/f83 0 2023-12-07T16:21:39.585 INFO:tasks.workunit.client.1.smithi152.stdout:8/606: sync 2023-12-07T16:21:39.585 INFO:tasks.workunit.client.1.smithi152.stdout:7/566: creat db/d1c/faf x:0 0 0 2023-12-07T16:21:39.585 INFO:tasks.workunit.client.1.smithi152.stdout:7/567: chown db/d27/d39/d41/d37/c5c 23427 1 2023-12-07T16:21:39.586 INFO:tasks.workunit.client.1.smithi152.stdout:4/505: write d0/f1 [556176,53062] 0 2023-12-07T16:21:39.587 INFO:tasks.workunit.client.1.smithi152.stdout:8/607: creat d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/dd4/fd7 x:0 0 0 2023-12-07T16:21:39.587 INFO:tasks.workunit.client.1.smithi152.stdout:8/608: readlink d3/d4/d9/d23/d4c/da6/db2/dc3/dcd/ld3 0 2023-12-07T16:21:39.587 INFO:tasks.workunit.client.0.smithi063.stdout:8/529: creat d7/d14/d15/d48/fa4 x:0 0 0 2023-12-07T16:21:39.587 INFO:tasks.workunit.client.0.smithi063.stdout:8/530: truncate d7/d14/d15/f2d 2143760 0 2023-12-07T16:21:39.587 INFO:tasks.workunit.client.0.smithi063.stdout:5/369: dwrite d1/d31/d56/d61/f57 [0,4194304] 0 2023-12-07T16:21:39.588 INFO:tasks.workunit.client.1.smithi152.stdout:6/589: dread d2/d4f/d83/d85/f95 [0,4194304] 0 2023-12-07T16:21:39.588 INFO:tasks.workunit.client.1.smithi152.stdout:0/593: mknod d0/d27/d8c/cc7 0 2023-12-07T16:21:39.589 INFO:tasks.workunit.client.1.smithi152.stdout:7/568: stat db/d27/d39/d41/d58/l85 0 2023-12-07T16:21:39.590 INFO:tasks.workunit.client.0.smithi063.stdout:0/426: dwrite d4/dd/de/d15/d1f/f54 [0,4194304] 0 2023-12-07T16:21:39.590 INFO:tasks.workunit.client.0.smithi063.stdout:3/399: rename d7/fe to d7/d9/f84 0 2023-12-07T16:21:39.591 INFO:tasks.workunit.client.0.smithi063.stdout:3/400: write d7/d9/d2b/f3d [467622,122793] 0 2023-12-07T16:21:39.591 INFO:tasks.workunit.client.1.smithi152.stdout:4/506: rename d0/d3/d6/dc/d22/f54 to d0/d3/d6/dc/d39/f92 0 2023-12-07T16:21:39.591 INFO:tasks.workunit.client.1.smithi152.stdout:8/609: creat d3/d4/d9/dc/d6f/d7b/d7e/d85/fd8 x:0 0 0 2023-12-07T16:21:39.591 INFO:tasks.workunit.client.1.smithi152.stdout:8/610: readlink d3/d4/d9/dc/d6f/d7a/d8a/l29 0 2023-12-07T16:21:39.591 INFO:tasks.workunit.client.1.smithi152.stdout:8/611: chown d3/d4/l2a 908940 1 2023-12-07T16:21:39.592 INFO:tasks.workunit.client.0.smithi063.stdout:5/370: creat d1/d3/de/d1e/f78 x:0 0 0 2023-12-07T16:21:39.592 INFO:tasks.workunit.client.0.smithi063.stdout:5/371: chown d1/f65 469318 1 2023-12-07T16:21:39.592 INFO:tasks.workunit.client.0.smithi063.stdout:2/428: dwrite d0/d4a/f54 [0,4194304] 0 2023-12-07T16:21:39.592 INFO:tasks.workunit.client.1.smithi152.stdout:0/594: mkdir d0/dc/d3d/dab/dc8 0 2023-12-07T16:21:39.593 INFO:tasks.workunit.client.0.smithi063.stdout:5/372: write d1/f18 [2524738,52265] 0 2023-12-07T16:21:39.593 INFO:tasks.workunit.client.1.smithi152.stdout:5/730: dread dd/f1e [0,4194304] 0 2023-12-07T16:21:39.593 INFO:tasks.workunit.client.1.smithi152.stdout:5/731: truncate dd/de/d14/d19/d1a/d1b/f70 1343366 0 2023-12-07T16:21:39.593 INFO:tasks.workunit.client.1.smithi152.stdout:5/732: chown dd/d91/fa1 43357504 1 2023-12-07T16:21:39.593 INFO:tasks.workunit.client.1.smithi152.stdout:5/733: read - dd/de/d38/f7e zero size 2023-12-07T16:21:39.594 INFO:tasks.workunit.client.0.smithi063.stdout:8/531: read d7/f4a [1163220,14663] 0 2023-12-07T16:21:39.594 INFO:tasks.workunit.client.1.smithi152.stdout:7/569: link db/f47 db/d27/d4d/fb0 0 2023-12-07T16:21:39.594 INFO:tasks.workunit.client.1.smithi152.stdout:0/595: write d0/dc/d36/d3a/d69/fad [410829,48870] 0 2023-12-07T16:21:39.596 INFO:tasks.workunit.client.1.smithi152.stdout:0/596: read d0/dc/d36/f9c [27897,111691] 0 2023-12-07T16:21:39.596 INFO:tasks.workunit.client.1.smithi152.stdout:8/612: rmdir d3/d1e/d43 39 2023-12-07T16:21:39.596 INFO:tasks.workunit.client.0.smithi063.stdout:5/373: write d1/f11 [1015166,28861] 0 2023-12-07T16:21:39.596 INFO:tasks.workunit.client.0.smithi063.stdout:0/427: rmdir d4/dd/de/d15/d1f 39 2023-12-07T16:21:39.597 INFO:tasks.workunit.client.1.smithi152.stdout:4/507: truncate d0/d3/d6/d36/d85/f74 204717 0 2023-12-07T16:21:39.597 INFO:tasks.workunit.client.0.smithi063.stdout:3/401: creat d7/d4f/d53/d72/d7d/f85 x:0 0 0 2023-12-07T16:21:39.600 INFO:tasks.workunit.client.1.smithi152.stdout:1/749: dread dc/d28/d4e/f99 [0,4194304] 0 2023-12-07T16:21:39.600 INFO:tasks.workunit.client.1.smithi152.stdout:5/734: symlink dd/de/d14/d19/da3/ddf/lff 0 2023-12-07T16:21:39.603 INFO:tasks.workunit.client.1.smithi152.stdout:7/570: creat db/d27/d39/d41/d58/d80/dac/fb1 x:0 0 0 2023-12-07T16:21:39.605 INFO:tasks.workunit.client.0.smithi063.stdout:2/429: rename d0/d21/c6f to d0/d21/d39/c93 0 2023-12-07T16:21:39.605 INFO:tasks.workunit.client.0.smithi063.stdout:2/430: truncate d0/d21/d56/d11/d52/d63/f6b 198460 0 2023-12-07T16:21:39.605 INFO:tasks.workunit.client.1.smithi152.stdout:8/613: symlink d3/d4/d9/d23/d4c/ld9 0 2023-12-07T16:21:39.606 INFO:tasks.workunit.client.0.smithi063.stdout:2/431: fsync d0/d67/f59 0 2023-12-07T16:21:39.606 INFO:tasks.workunit.client.0.smithi063.stdout:2/432: stat d0/d21/d39/f4e 0 2023-12-07T16:21:39.606 INFO:tasks.workunit.client.0.smithi063.stdout:1/293: dwrite d0/f4 [0,4194304] 0 2023-12-07T16:21:39.607 INFO:tasks.workunit.client.0.smithi063.stdout:1/294: dread - d0/dd/f56 zero size 2023-12-07T16:21:39.607 INFO:tasks.workunit.client.0.smithi063.stdout:1/295: getdents d0/dd/d55 0 2023-12-07T16:21:39.608 INFO:tasks.workunit.client.1.smithi152.stdout:4/508: rename d0/d3/d6/dc/dd to d0/d3/d6/dc/d39/d93 0 2023-12-07T16:21:39.608 INFO:tasks.workunit.client.1.smithi152.stdout:4/509: chown d0/d3/d6/dc/d39/d93/d67/c76 112799 1 2023-12-07T16:21:39.608 INFO:tasks.workunit.client.0.smithi063.stdout:8/532: creat d7/d38/d73/d83/d9f/fa5 x:0 0 0 2023-12-07T16:21:39.610 INFO:tasks.workunit.client.0.smithi063.stdout:0/428: creat d4/dd/de/d15/f8c x:0 0 0 2023-12-07T16:21:39.610 INFO:tasks.workunit.client.0.smithi063.stdout:0/429: chown d4/d25/f4b 18 1 2023-12-07T16:21:39.611 INFO:tasks.workunit.client.1.smithi152.stdout:1/750: mkdir dc/d14/dfe 0 2023-12-07T16:21:39.612 INFO:tasks.workunit.client.0.smithi063.stdout:6/455: dwrite d0/d17/d1a/f74 [0,4194304] 0 2023-12-07T16:21:39.614 INFO:tasks.workunit.client.1.smithi152.stdout:4/510: write d0/d3/d6/dc/d39/d93/d67/f47 [529255,91152] 0 2023-12-07T16:21:39.615 INFO:tasks.workunit.client.1.smithi152.stdout:7/571: mknod db/d27/d4d/cb2 0 2023-12-07T16:21:39.616 INFO:tasks.workunit.client.1.smithi152.stdout:1/751: dread dc/d14/d18/f94 [0,4194304] 0 2023-12-07T16:21:39.616 INFO:tasks.workunit.client.1.smithi152.stdout:7/572: dread - db/d1c/faf zero size 2023-12-07T16:21:39.616 INFO:tasks.workunit.client.1.smithi152.stdout:5/735: dread dd/de/d14/d19/d1a/f55 [0,4194304] 0 2023-12-07T16:21:39.616 INFO:tasks.workunit.client.1.smithi152.stdout:3/539: dwrite d7/f5a [0,4194304] 0 2023-12-07T16:21:39.616 INFO:tasks.workunit.client.1.smithi152.stdout:3/540: fsync d7/dc/d14/f75 0 2023-12-07T16:21:39.616 INFO:tasks.workunit.client.1.smithi152.stdout:8/614: mknod d3/d4/d9/dc/d6f/d7b/d7e/cda 0 2023-12-07T16:21:39.618 INFO:tasks.workunit.client.0.smithi063.stdout:3/402: creat d7/d9/d2b/d41/f86 x:0 0 0 2023-12-07T16:21:39.618 INFO:tasks.workunit.client.0.smithi063.stdout:6/456: write d0/d1e/d2a/f52 [2313264,82160] 0 2023-12-07T16:21:39.618 INFO:tasks.workunit.client.0.smithi063.stdout:6/457: write d0/d1e/f63 [1503148,34132] 0 2023-12-07T16:21:39.620 INFO:tasks.workunit.client.1.smithi152.stdout:1/752: creat dc/d14/d90/da9/df5/fff x:0 0 0 2023-12-07T16:21:39.620 INFO:tasks.workunit.client.1.smithi152.stdout:1/753: fdatasync dc/d14/d18/d45/d74/fa7 0 2023-12-07T16:21:39.621 INFO:tasks.workunit.client.1.smithi152.stdout:8/615: write d3/d1e/f30 [9112105,43930] 0 2023-12-07T16:21:39.621 INFO:tasks.workunit.client.1.smithi152.stdout:8/616: write d3/d1e/d43/dbc/fc0 [903829,103699] 0 2023-12-07T16:21:39.621 INFO:tasks.workunit.client.1.smithi152.stdout:8/617: readlink d3/d4/d9/dc/d6f/l8b 0 2023-12-07T16:21:39.621 INFO:tasks.workunit.client.1.smithi152.stdout:8/618: fsync d3/d4/d4b/f8e 0 2023-12-07T16:21:39.621 INFO:tasks.workunit.client.1.smithi152.stdout:3/541: dread d7/dc/f33 [0,4194304] 0 2023-12-07T16:21:39.623 INFO:tasks.workunit.client.1.smithi152.stdout:5/736: truncate dd/de/d14/d19/d7a/da6/faf 800373 0 2023-12-07T16:21:39.625 INFO:tasks.workunit.client.1.smithi152.stdout:3/542: dread d7/dc/d3e/f5e [0,4194304] 0 2023-12-07T16:21:39.626 INFO:tasks.workunit.client.1.smithi152.stdout:8/619: mkdir d3/d4/d9/dc/d6f/d7b/dbd/dcc/ddb 0 2023-12-07T16:21:39.628 INFO:tasks.workunit.client.1.smithi152.stdout:4/511: dread d0/d3/d6/dc/d3a/d46/d4e/f57 [0,4194304] 0 2023-12-07T16:21:39.628 INFO:tasks.workunit.client.1.smithi152.stdout:5/737: mkdir dd/de/d38/d3d/d100 0 2023-12-07T16:21:39.628 INFO:tasks.workunit.client.1.smithi152.stdout:5/738: readlink dd/l50 0 2023-12-07T16:21:39.628 INFO:tasks.workunit.client.1.smithi152.stdout:5/739: chown dd/de/d14/d1f/d49/f73 3333307 1 2023-12-07T16:21:39.628 INFO:tasks.workunit.client.1.smithi152.stdout:1/754: dread dc/d14/d18/fb5 [0,4194304] 0 2023-12-07T16:21:39.629 INFO:tasks.workunit.client.0.smithi063.stdout:2/433: creat d0/d21/d56/d11/f94 x:0 0 0 2023-12-07T16:21:39.630 INFO:tasks.workunit.client.1.smithi152.stdout:3/543: rename d7/dc/d3e/d6b/l77 to d7/dc/d3e/d62/d6d/d81/la8 0 2023-12-07T16:21:39.636 INFO:tasks.workunit.client.1.smithi152.stdout:8/620: truncate d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/d7d/fbe 4945194 0 2023-12-07T16:21:39.636 INFO:tasks.workunit.client.1.smithi152.stdout:4/512: creat d0/d3/d6/d36/d85/f94 x:0 0 0 2023-12-07T16:21:39.636 INFO:tasks.workunit.client.1.smithi152.stdout:5/740: link dd/l59 dd/de/d14/d19/d7a/l101 0 2023-12-07T16:21:39.636 INFO:tasks.workunit.client.1.smithi152.stdout:4/513: truncate d0/d3/d6/dc/d39/d93/d67/f7b 1009107 0 2023-12-07T16:21:39.636 INFO:tasks.workunit.client.1.smithi152.stdout:5/741: write dd/d91/dbe/fc8 [117770,59220] 0 2023-12-07T16:21:39.637 INFO:tasks.workunit.client.1.smithi152.stdout:1/755: mknod dc/d14/d18/d45/d74/c100 0 2023-12-07T16:21:39.640 INFO:tasks.workunit.client.0.smithi063.stdout:3/403: truncate d7/d49/d4b/f5e 414582 0 2023-12-07T16:21:39.640 INFO:tasks.workunit.client.1.smithi152.stdout:3/544: creat d7/dc/fa9 x:0 0 0 2023-12-07T16:21:39.640 INFO:tasks.workunit.client.1.smithi152.stdout:5/742: read dd/de/f13 [693983,65064] 0 2023-12-07T16:21:39.640 INFO:tasks.workunit.client.1.smithi152.stdout:5/743: chown dd/de/d14/d19/d1a/cf5 42 1 2023-12-07T16:21:39.641 INFO:tasks.workunit.client.1.smithi152.stdout:8/621: creat d3/d4/d9/dad/fdc x:0 0 0 2023-12-07T16:21:39.641 INFO:tasks.workunit.client.1.smithi152.stdout:8/622: chown d3/d4/l2a 27618647 1 2023-12-07T16:21:39.643 INFO:tasks.workunit.client.1.smithi152.stdout:3/545: rename d7/dc/f12 to d7/d10/d1a/d2f/d56/d57/faa 0 2023-12-07T16:21:39.643 INFO:tasks.workunit.client.1.smithi152.stdout:0/597: dwrite d0/d2f/d30/f4a [0,4194304] 0 2023-12-07T16:21:39.645 INFO:tasks.workunit.client.0.smithi063.stdout:0/430: dwrite d4/dd/d26/f70 [0,4194304] 0 2023-12-07T16:21:39.647 INFO:tasks.workunit.client.1.smithi152.stdout:8/623: creat d3/d1e/d55/fdd x:0 0 0 2023-12-07T16:21:39.647 INFO:tasks.workunit.client.1.smithi152.stdout:8/624: chown d3/d4/c2f 532312657 1 2023-12-07T16:21:39.647 INFO:tasks.workunit.client.0.smithi063.stdout:6/458: symlink d0/d17/d46/d93/la1 0 2023-12-07T16:21:39.647 INFO:tasks.workunit.client.0.smithi063.stdout:2/434: mknod d0/d67/d65/d6a/c95 0 2023-12-07T16:21:39.648 INFO:tasks.workunit.client.1.smithi152.stdout:3/546: mkdir d7/dc/d3e/d6b/d80/da2/dab 0 2023-12-07T16:21:39.649 INFO:tasks.workunit.client.0.smithi063.stdout:8/533: truncate d7/d38/d73/d83/f95 177407 0 2023-12-07T16:21:39.649 INFO:tasks.workunit.client.1.smithi152.stdout:5/744: rmdir dd/de/d14/d19/da3/ddf 39 2023-12-07T16:21:39.650 INFO:tasks.workunit.client.1.smithi152.stdout:0/598: mkdir d0/dc/d3d/d73/dbf/dc9 0 2023-12-07T16:21:39.650 INFO:tasks.workunit.client.1.smithi152.stdout:0/599: truncate d0/d2f/f35 1886466 0 2023-12-07T16:21:39.651 INFO:tasks.workunit.client.0.smithi063.stdout:3/404: rename d7/d9/l52 to d7/d4f/d53/d72/l87 0 2023-12-07T16:21:39.652 INFO:tasks.workunit.client.0.smithi063.stdout:5/374: dwrite d1/f2a [4194304,4194304] 0 2023-12-07T16:21:39.653 INFO:tasks.workunit.client.0.smithi063.stdout:5/375: write d1/d3/de/d1e/d25/f53 [923558,128835] 0 2023-12-07T16:21:39.653 INFO:tasks.workunit.client.0.smithi063.stdout:5/376: dread - d1/d3/de/f4a zero size 2023-12-07T16:21:39.653 INFO:tasks.workunit.client.0.smithi063.stdout:5/377: fdatasync d1/d31/d56/f6f 0 2023-12-07T16:21:39.653 INFO:tasks.workunit.client.1.smithi152.stdout:1/756: dread dc/d28/f39 [0,4194304] 0 2023-12-07T16:21:39.653 INFO:tasks.workunit.client.1.smithi152.stdout:1/757: fdatasync dc/d14/d18/d2d/d48/fc2 0 2023-12-07T16:21:39.653 INFO:tasks.workunit.client.1.smithi152.stdout:5/745: write dd/de/d17/f5b [453790,92800] 0 2023-12-07T16:21:39.653 INFO:tasks.workunit.client.1.smithi152.stdout:5/746: chown dd/de/d14/d19/d7a/da6 21437 1 2023-12-07T16:21:39.653 INFO:tasks.workunit.client.1.smithi152.stdout:3/547: creat d7/dc/d3e/d6b/fac x:0 0 0 2023-12-07T16:21:39.654 INFO:tasks.workunit.client.1.smithi152.stdout:6/590: dwrite d2/d4f/d83/d85/de/fa4 [0,4194304] 0 2023-12-07T16:21:39.656 INFO:tasks.workunit.client.0.smithi063.stdout:0/431: rmdir d4/dd/de/d15/d86 0 2023-12-07T16:21:39.657 INFO:tasks.workunit.client.0.smithi063.stdout:6/459: creat d0/d17/d1a/d4d/d8b/fa2 x:0 0 0 2023-12-07T16:21:39.658 INFO:tasks.workunit.client.1.smithi152.stdout:5/747: link dd/de/d38/d3d/d6d/dae/de0/ffa dd/d7b/dbf/f102 0 2023-12-07T16:21:39.661 INFO:tasks.workunit.client.0.smithi063.stdout:3/405: creat d7/d9/f88 x:0 0 0 2023-12-07T16:21:39.661 INFO:tasks.workunit.client.0.smithi063.stdout:3/406: write d7/d9/d1b/d5c/d5d/f81 [758206,107301] 0 2023-12-07T16:21:39.662 INFO:tasks.workunit.client.0.smithi063.stdout:5/378: rmdir d1/d3/d3a 39 2023-12-07T16:21:39.664 INFO:tasks.workunit.client.0.smithi063.stdout:0/432: rename d4/dd/de/d15/d1f/d61/f82 to d4/d25/f8d 0 2023-12-07T16:21:39.665 INFO:tasks.workunit.client.0.smithi063.stdout:0/433: fsync d4/dd/d26/d2b/d5e/d69/f85 0 2023-12-07T16:21:39.665 INFO:tasks.workunit.client.1.smithi152.stdout:6/591: link d2/d4f/d83/d85/de/f61 d2/d4f/d83/d85/fbe 0 2023-12-07T16:21:39.666 INFO:tasks.workunit.client.1.smithi152.stdout:6/592: chown d2/d4f/d83/d48/d70/da7/db7/d9d 27227 1 2023-12-07T16:21:39.666 INFO:tasks.workunit.client.0.smithi063.stdout:5/379: write d1/f5c [2226255,34197] 0 2023-12-07T16:21:39.667 INFO:tasks.workunit.client.0.smithi063.stdout:6/460: mknod d0/d1e/d1d/d1f/d6c/ca3 0 2023-12-07T16:21:39.667 INFO:tasks.workunit.client.0.smithi063.stdout:6/461: write d0/d79/f8f [869154,2323] 0 2023-12-07T16:21:39.668 INFO:tasks.workunit.client.1.smithi152.stdout:3/548: dread d7/d10/d1a/d2f/d56/d57/faa [0,4194304] 0 2023-12-07T16:21:39.668 INFO:tasks.workunit.client.1.smithi152.stdout:4/514: dwrite d0/d3/f2a [4194304,4194304] 0 2023-12-07T16:21:39.670 INFO:tasks.workunit.client.1.smithi152.stdout:5/748: rename dd/de/d14/d19/d1a/d1b/c65 to dd/de/d14/d19/d1a/dcc/c103 0 2023-12-07T16:21:39.670 INFO:tasks.workunit.client.1.smithi152.stdout:5/749: readlink dd/l59 0 2023-12-07T16:21:39.670 INFO:tasks.workunit.client.1.smithi152.stdout:7/573: dwrite db/d1c/f28 [0,4194304] 0 2023-12-07T16:21:39.670 INFO:tasks.workunit.client.1.smithi152.stdout:1/758: dread dc/d14/d18/d79/d86/db7/ffd [0,4194304] 0 2023-12-07T16:21:39.671 INFO:tasks.workunit.client.1.smithi152.stdout:1/759: write dc/d14/d18/d64/d8a/feb [1031998,122786] 0 2023-12-07T16:21:39.675 INFO:tasks.workunit.client.1.smithi152.stdout:6/593: getdents d2/d4f/d83/d48/da8 0 2023-12-07T16:21:39.675 INFO:tasks.workunit.client.1.smithi152.stdout:3/549: getdents d7/d10/d1a/d2f/d5c 0 2023-12-07T16:21:39.675 INFO:tasks.workunit.client.1.smithi152.stdout:3/550: write d7/dc/f33 [136547,30959] 0 2023-12-07T16:21:39.675 INFO:tasks.workunit.client.1.smithi152.stdout:3/551: truncate d7/dc/d3e/d62/d6d/d84/f85 767964 0 2023-12-07T16:21:39.676 INFO:tasks.workunit.client.1.smithi152.stdout:3/552: chown d7/d10/l36 818168965 1 2023-12-07T16:21:39.676 INFO:tasks.workunit.client.1.smithi152.stdout:6/594: truncate d2/d4f/d83/d85/fc 1754174 0 2023-12-07T16:21:39.676 INFO:tasks.workunit.client.1.smithi152.stdout:0/600: fsync d0/dc/d36/d3a/d69/fad 0 2023-12-07T16:21:39.677 INFO:tasks.workunit.client.0.smithi063.stdout:6/462: mkdir d0/d1e/d60/d68/d76/da4 0 2023-12-07T16:21:39.677 INFO:tasks.workunit.client.0.smithi063.stdout:3/407: mknod d7/d49/d4b/c89 0 2023-12-07T16:21:39.679 INFO:tasks.workunit.client.0.smithi063.stdout:5/380: dread d1/f2e [0,4194304] 0 2023-12-07T16:21:39.679 INFO:tasks.workunit.client.0.smithi063.stdout:2/435: dwrite d0/d21/f69 [0,4194304] 0 2023-12-07T16:21:39.679 INFO:tasks.workunit.client.0.smithi063.stdout:6/463: unlink d0/d17/d1a/d4d/f82 0 2023-12-07T16:21:39.681 INFO:tasks.workunit.client.1.smithi152.stdout:4/515: creat d0/d3/f95 x:0 0 0 2023-12-07T16:21:39.681 INFO:tasks.workunit.client.1.smithi152.stdout:5/750: creat dd/de/d14/d19/d1a/d1b/f104 x:0 0 0 2023-12-07T16:21:39.685 INFO:tasks.workunit.client.1.smithi152.stdout:3/553: rename d7/l38 to d7/dc/d3e/d6b/d80/da2/lad 0 2023-12-07T16:21:39.685 INFO:tasks.workunit.client.1.smithi152.stdout:7/574: symlink db/d68/lb3 0 2023-12-07T16:21:39.685 INFO:tasks.workunit.client.0.smithi063.stdout:3/408: symlink d7/l8a 0 2023-12-07T16:21:39.686 INFO:tasks.workunit.client.1.smithi152.stdout:8/625: dwrite d3/d4/d9/dc/d6f/d7b/d7e/f9a [0,4194304] 0 2023-12-07T16:21:39.688 INFO:tasks.workunit.client.1.smithi152.stdout:6/595: symlink d2/d4f/d83/d48/d70/da7/db7/d9d/lbf 0 2023-12-07T16:21:39.688 INFO:tasks.workunit.client.0.smithi063.stdout:5/381: mkdir d1/d3/de/d1e/d6b/d79 0 2023-12-07T16:21:39.690 INFO:tasks.workunit.client.0.smithi063.stdout:5/382: write d1/d3/de/f10 [7719318,100410] 0 2023-12-07T16:21:39.690 INFO:tasks.workunit.client.1.smithi152.stdout:0/601: mkdir d0/dc/d36/d3a/dca 0 2023-12-07T16:21:39.690 INFO:tasks.workunit.client.0.smithi063.stdout:2/436: creat d0/d67/d65/f96 x:0 0 0 2023-12-07T16:21:39.691 INFO:tasks.workunit.client.0.smithi063.stdout:2/437: chown d0/d21/d56/d11/d52/d5d/c7e 41826 1 2023-12-07T16:21:39.691 INFO:tasks.workunit.client.1.smithi152.stdout:3/554: write d7/dc/d14/f3a [3266638,80003] 0 2023-12-07T16:21:39.693 INFO:tasks.workunit.client.0.smithi063.stdout:8/534: dwrite d7/d14/f4f [0,4194304] 0 2023-12-07T16:21:39.693 INFO:tasks.workunit.client.0.smithi063.stdout:8/535: fsync d7/d38/d73/d83/d9f/fa5 0 2023-12-07T16:21:39.694 INFO:tasks.workunit.client.1.smithi152.stdout:5/751: symlink dd/de/d14/dc6/d7c/l105 0 2023-12-07T16:21:39.694 INFO:tasks.workunit.client.0.smithi063.stdout:6/464: rename d0/d1e/d29/c92 to d0/d79/d94/ca5 0 2023-12-07T16:21:39.695 INFO:tasks.workunit.client.1.smithi152.stdout:3/555: dread d7/d10/d1a/d25/d4b/f4d [0,4194304] 0 2023-12-07T16:21:39.695 INFO:tasks.workunit.client.1.smithi152.stdout:3/556: fsync d7/d10/d1a/d2f/f20 0 2023-12-07T16:21:39.695 INFO:tasks.workunit.client.1.smithi152.stdout:3/557: readlink d7/dc/d3e/d48/l7e 0 2023-12-07T16:21:39.696 INFO:tasks.workunit.client.1.smithi152.stdout:3/558: truncate d7/d10/d1a/d2f/d5c/f7f 200757 0 2023-12-07T16:21:39.696 INFO:tasks.workunit.client.1.smithi152.stdout:3/559: write d7/d10/d1a/d25/f27 [935453,82868] 0 2023-12-07T16:21:39.696 INFO:tasks.workunit.client.1.smithi152.stdout:3/560: chown d7/dc/fa9 9645 1 2023-12-07T16:21:39.696 INFO:tasks.workunit.client.1.smithi152.stdout:4/516: symlink d0/d3/d6/dc/l96 0 2023-12-07T16:21:39.696 INFO:tasks.workunit.client.0.smithi063.stdout:3/409: creat d7/d9/d2b/f8b x:0 0 0 2023-12-07T16:21:39.696 INFO:tasks.workunit.client.1.smithi152.stdout:7/575: creat db/d27/fb4 x:0 0 0 2023-12-07T16:21:39.700 INFO:tasks.workunit.client.0.smithi063.stdout:2/438: creat d0/d1e/f97 x:0 0 0 2023-12-07T16:21:39.702 INFO:tasks.workunit.client.1.smithi152.stdout:8/626: rename d3/d4/d9/dc/d6f/d7a/d8a/d66/d82 to d3/d1e/d55/d83/dde 0 2023-12-07T16:21:39.704 INFO:tasks.workunit.client.0.smithi063.stdout:6/465: symlink d0/d1e/d1d/d1f/d4b/la6 0 2023-12-07T16:21:39.704 INFO:tasks.workunit.client.0.smithi063.stdout:0/434: dwrite d4/d25/f45 [0,4194304] 0 2023-12-07T16:21:39.706 INFO:tasks.workunit.client.1.smithi152.stdout:1/760: dwrite dc/d14/d18/d79/d86/db7/ffd [0,4194304] 0 2023-12-07T16:21:39.706 INFO:tasks.workunit.client.0.smithi063.stdout:3/410: rmdir d7/d49/d4b 39 2023-12-07T16:21:39.706 INFO:tasks.workunit.client.0.smithi063.stdout:3/411: truncate d7/d21/f69 731939 0 2023-12-07T16:21:39.708 INFO:tasks.workunit.client.0.smithi063.stdout:3/412: dread d7/d49/d4b/f5e [0,4194304] 0 2023-12-07T16:21:39.708 INFO:tasks.workunit.client.1.smithi152.stdout:0/602: mkdir d0/d2f/d30/d6e/d77/d9f/dcb 0 2023-12-07T16:21:39.711 INFO:tasks.workunit.client.1.smithi152.stdout:3/561: creat d7/dc/d3e/d62/d6d/d98/fae x:0 0 0 2023-12-07T16:21:39.711 INFO:tasks.workunit.client.1.smithi152.stdout:8/627: write d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/fa0 [3652332,37577] 0 2023-12-07T16:21:39.712 INFO:tasks.workunit.client.1.smithi152.stdout:1/761: write dc/d14/d18/d2d/d4a/f71 [1769843,48295] 0 2023-12-07T16:21:39.712 INFO:tasks.workunit.client.0.smithi063.stdout:2/439: creat d0/d67/d5b/f98 x:0 0 0 2023-12-07T16:21:39.713 INFO:tasks.workunit.client.0.smithi063.stdout:2/440: fdatasync d0/f33 0 2023-12-07T16:21:39.717 INFO:tasks.workunit.client.1.smithi152.stdout:6/596: rename d2/d4f/d83/d85/d19/l71 to d2/d4f/lc0 0 2023-12-07T16:21:39.720 INFO:tasks.workunit.client.0.smithi063.stdout:6/466: creat d0/d17/d95/fa7 x:0 0 0 2023-12-07T16:21:39.721 INFO:tasks.workunit.client.1.smithi152.stdout:1/762: dread dc/d28/f55 [0,4194304] 0 2023-12-07T16:21:39.721 INFO:tasks.workunit.client.1.smithi152.stdout:1/763: write dc/d14/d18/d45/fc5 [980014,18497] 0 2023-12-07T16:21:39.721 INFO:tasks.workunit.client.1.smithi152.stdout:1/764: write dc/d14/d18/d45/d74/fa7 [59399,67742] 0 2023-12-07T16:21:39.723 INFO:tasks.workunit.client.1.smithi152.stdout:0/603: mknod d0/dc/d36/d7d/d92/ccc 0 2023-12-07T16:21:39.725 INFO:tasks.workunit.client.0.smithi063.stdout:3/413: creat d7/d9/dd/d56/f8c x:0 0 0 2023-12-07T16:21:39.730 INFO:tasks.workunit.client.0.smithi063.stdout:2/441: creat d0/d21/d56/d11/f99 x:0 0 0 2023-12-07T16:21:39.730 INFO:tasks.workunit.client.0.smithi063.stdout:2/442: chown d0/c3a 14393 1 2023-12-07T16:21:39.730 INFO:tasks.workunit.client.0.smithi063.stdout:6/467: creat d0/d1e/d1d/d1f/d6c/fa8 x:0 0 0 2023-12-07T16:21:39.731 INFO:tasks.workunit.client.0.smithi063.stdout:3/414: write d7/d9/dd/f2a [464242,130558] 0 2023-12-07T16:21:39.732 INFO:tasks.workunit.client.1.smithi152.stdout:8/628: unlink d3/d4/d9/c48 0 2023-12-07T16:21:39.733 INFO:tasks.workunit.client.1.smithi152.stdout:4/517: dread d0/d3/d6/dc/d39/d93/d67/f47 [0,4194304] 0 2023-12-07T16:21:39.733 INFO:tasks.workunit.client.0.smithi063.stdout:2/443: creat d0/d1e/f9a x:0 0 0 2023-12-07T16:21:39.733 INFO:tasks.workunit.client.0.smithi063.stdout:5/383: dwrite d1/d3/f17 [0,4194304] 0 2023-12-07T16:21:39.733 INFO:tasks.workunit.client.0.smithi063.stdout:6/468: getdents d0/d1e/d60/d68/d78/d9c 0 2023-12-07T16:21:39.735 INFO:tasks.workunit.client.1.smithi152.stdout:5/752: dwrite dd/de/d14/d19/d1a/d1b/f70 [0,4194304] 0 2023-12-07T16:21:39.736 INFO:tasks.workunit.client.0.smithi063.stdout:8/536: dwrite d7/d14/d15/d2b/f59 [0,4194304] 0 2023-12-07T16:21:39.736 INFO:tasks.workunit.client.0.smithi063.stdout:8/537: readlink d7/l13 0 2023-12-07T16:21:39.736 INFO:tasks.workunit.client.0.smithi063.stdout:8/538: fdatasync d7/d14/d15/d2b/d40/d63/d75/f80 0 2023-12-07T16:21:39.745 INFO:tasks.workunit.client.0.smithi063.stdout:8/539: mknod d7/d14/d1a/d54/d7e/ca6 0 2023-12-07T16:21:39.747 INFO:tasks.workunit.client.0.smithi063.stdout:3/415: dread d7/d9/f46 [0,4194304] 0 2023-12-07T16:21:39.749 INFO:tasks.workunit.client.0.smithi063.stdout:0/435: dwrite d4/dd/de/d15/d1f/d61/f66 [0,4194304] 0 2023-12-07T16:21:39.750 INFO:tasks.workunit.client.0.smithi063.stdout:0/436: readlink d4/dd/de/d15/d1f/l57 0 2023-12-07T16:21:39.750 INFO:tasks.workunit.client.0.smithi063.stdout:0/437: write d4/d25/f4b [1044267,76367] 0 2023-12-07T16:21:39.750 INFO:tasks.workunit.client.0.smithi063.stdout:8/540: rename d7/d14/d1a/l3d to d7/d14/d15/d2b/d40/d63/d75/la7 0 2023-12-07T16:21:39.750 INFO:tasks.workunit.client.0.smithi063.stdout:8/541: fsync d7/d38/d73/f8a 0 2023-12-07T16:21:39.750 INFO:tasks.workunit.client.0.smithi063.stdout:8/542: stat d7/d14/d15/f46 0 2023-12-07T16:21:39.750 INFO:tasks.workunit.client.0.smithi063.stdout:8/543: truncate d7/d14/d15/d2b/f41 271760 0 2023-12-07T16:21:39.764 INFO:tasks.workunit.client.1.smithi152.stdout:1/765: dwrite dc/f63 [0,4194304] 0 2023-12-07T16:21:39.765 INFO:tasks.workunit.client.0.smithi063.stdout:0/438: rename d4/dd/de/d15/d1f/d61 to d4/dd/d26/d2b/d5e/d8e 0 2023-12-07T16:21:39.768 INFO:tasks.workunit.client.0.smithi063.stdout:0/439: mknod d4/dd/de/d15/d52/d5b/c8f 0 2023-12-07T16:21:39.768 INFO:tasks.workunit.client.0.smithi063.stdout:3/416: dread d7/d9/f46 [0,4194304] 0 2023-12-07T16:21:39.769 INFO:tasks.workunit.client.0.smithi063.stdout:3/417: read - d7/f4c zero size 2023-12-07T16:21:39.769 INFO:tasks.workunit.client.0.smithi063.stdout:3/418: getdents d7/d9/dd/d60 0 2023-12-07T16:21:39.769 INFO:tasks.workunit.client.0.smithi063.stdout:3/419: read d7/d49/d4b/f7a [558126,123964] 0 2023-12-07T16:21:39.770 INFO:tasks.workunit.client.0.smithi063.stdout:0/440: creat d4/f90 x:0 0 0 2023-12-07T16:21:39.771 INFO:tasks.workunit.client.1.smithi152.stdout:7/576: rename db/d27/d39/d63/c76 to db/d27/d39/d41/d58/d80/cb5 0 2023-12-07T16:21:39.772 INFO:tasks.workunit.client.0.smithi063.stdout:0/441: mkdir d4/dd/de/d15/d59/d43/d91 0 2023-12-07T16:21:39.773 INFO:tasks.workunit.client.0.smithi063.stdout:3/420: read d7/d4f/f55 [2944430,52346] 0 2023-12-07T16:21:39.776 INFO:tasks.workunit.client.1.smithi152.stdout:6/597: mkdir d2/d4f/d83/d85/de/d3f/da1/db5/dc1 0 2023-12-07T16:21:39.776 INFO:tasks.workunit.client.1.smithi152.stdout:0/604: mknod d0/dc/ccd 0 2023-12-07T16:21:39.776 INFO:tasks.workunit.client.1.smithi152.stdout:6/598: dread d2/d4f/d83/d85/fbe [4194304,4194304] 0 2023-12-07T16:21:39.777 INFO:tasks.workunit.client.0.smithi063.stdout:3/421: rename d7/d9/d1b/d5c/d5d to d7/d8d 0 2023-12-07T16:21:39.779 INFO:tasks.workunit.client.0.smithi063.stdout:3/422: dread d7/d49/d4b/f5e [0,4194304] 0 2023-12-07T16:21:39.779 INFO:tasks.workunit.client.0.smithi063.stdout:8/544: dwrite d7/d14/d15/f8b [0,4194304] 0 2023-12-07T16:21:39.779 INFO:tasks.workunit.client.0.smithi063.stdout:5/384: dwrite d1/d3/de/f14 [4194304,4194304] 0 2023-12-07T16:21:39.779 INFO:tasks.workunit.client.0.smithi063.stdout:5/385: write d1/d3/d3a/d5a/f66 [193555,11566] 0 2023-12-07T16:21:39.779 INFO:tasks.workunit.client.0.smithi063.stdout:2/444: dwrite d0/d21/d56/f20 [0,4194304] 0 2023-12-07T16:21:39.779 INFO:tasks.workunit.client.1.smithi152.stdout:8/629: getdents d3/d1e/d55 0 2023-12-07T16:21:39.779 INFO:tasks.workunit.client.1.smithi152.stdout:8/630: read d3/d4/d9/dc/d6f/d7a/d8a/d63/fbf [272522,127204] 0 2023-12-07T16:21:39.780 INFO:tasks.workunit.client.0.smithi063.stdout:3/423: mkdir d7/d49/d4b/d8e 0 2023-12-07T16:21:39.781 INFO:tasks.workunit.client.1.smithi152.stdout:5/753: dwrite dd/de/d14/d19/d74/fdd [0,4194304] 0 2023-12-07T16:21:39.781 INFO:tasks.workunit.client.1.smithi152.stdout:5/754: chown dd/de/d14/d19/d1a/d1b/f44 45 1 2023-12-07T16:21:39.784 INFO:tasks.workunit.client.0.smithi063.stdout:8/545: rename d7/d38/d73/d83 to d7/d14/d15/d2b/d40/da8 0 2023-12-07T16:21:39.785 INFO:tasks.workunit.client.1.smithi152.stdout:4/518: dwrite d0/d3/d6/dc/d39/d93/d67/f7b [0,4194304] 0 2023-12-07T16:21:39.787 INFO:tasks.workunit.client.0.smithi063.stdout:5/386: write d1/f2e [2150259,98594] 0 2023-12-07T16:21:39.787 INFO:tasks.workunit.client.1.smithi152.stdout:6/599: creat d2/d4f/d83/d85/d94/fc2 x:0 0 0 2023-12-07T16:21:39.789 INFO:tasks.workunit.client.1.smithi152.stdout:0/605: unlink d0/d27/d8c/l9a 0 2023-12-07T16:21:39.789 INFO:tasks.workunit.client.1.smithi152.stdout:0/606: chown d0/dc/f3c 937126455 1 2023-12-07T16:21:39.790 INFO:tasks.workunit.client.0.smithi063.stdout:2/445: rmdir d0/d21/d56/d11/d6d 39 2023-12-07T16:21:39.790 INFO:tasks.workunit.client.0.smithi063.stdout:3/424: rmdir d7/d7e 0 2023-12-07T16:21:39.790 INFO:tasks.workunit.client.0.smithi063.stdout:8/546: dread d7/d14/d15/d2b/f79 [0,4194304] 0 2023-12-07T16:21:39.790 INFO:tasks.workunit.client.0.smithi063.stdout:8/547: dread - d7/d38/d73/fa1 zero size 2023-12-07T16:21:39.790 INFO:tasks.workunit.client.0.smithi063.stdout:8/548: dread - d7/d14/d15/d2b/d40/da8/d9f/fa5 zero size 2023-12-07T16:21:39.791 INFO:tasks.workunit.client.1.smithi152.stdout:3/562: rmdir d7/d10/d1a/d25/d4b/d68 0 2023-12-07T16:21:39.792 INFO:tasks.workunit.client.0.smithi063.stdout:2/446: dread d0/d1e/f30 [0,4194304] 0 2023-12-07T16:21:39.793 INFO:tasks.workunit.client.1.smithi152.stdout:8/631: rmdir d3/d4/d9/d23/d4c/da6/db2/dc3/dcd 39 2023-12-07T16:21:39.795 INFO:tasks.workunit.client.1.smithi152.stdout:5/755: creat dd/de/d14/d1f/f106 x:0 0 0 2023-12-07T16:21:39.795 INFO:tasks.workunit.client.1.smithi152.stdout:0/607: write d0/d2f/f3f [1002667,122203] 0 2023-12-07T16:21:39.796 INFO:tasks.workunit.client.0.smithi063.stdout:3/425: rename d7/d9/l7c to d7/d9/d1b/d5c/l8f 0 2023-12-07T16:21:39.796 INFO:tasks.workunit.client.0.smithi063.stdout:3/426: fdatasync d7/d9/d2b/d41/f5a 0 2023-12-07T16:21:39.798 INFO:tasks.workunit.client.0.smithi063.stdout:8/549: creat d7/d38/d8e/fa9 x:0 0 0 2023-12-07T16:21:39.799 INFO:tasks.workunit.client.0.smithi063.stdout:8/550: stat d7/d14/f7d 0 2023-12-07T16:21:39.799 INFO:tasks.workunit.client.0.smithi063.stdout:8/551: dread - d7/d14/d15/d2b/d40/d63/d75/d98/fa3 zero size 2023-12-07T16:21:39.799 INFO:tasks.workunit.client.1.smithi152.stdout:6/600: rename d2/d4f/lc0 to d2/d4f/d83/d85/d9/lc3 0 2023-12-07T16:21:39.800 INFO:tasks.workunit.client.1.smithi152.stdout:5/756: link dd/de/d14/d19/d1a/def/c3b dd/de/d38/d3d/d6d/c107 0 2023-12-07T16:21:39.800 INFO:tasks.workunit.client.1.smithi152.stdout:5/757: write dd/d91/dbe/fc8 [777301,92855] 0 2023-12-07T16:21:39.801 INFO:tasks.workunit.client.1.smithi152.stdout:0/608: link d0/d2f/f35 d0/dc/d36/d3a/d51/d82/dae/fce 0 2023-12-07T16:21:39.802 INFO:tasks.workunit.client.0.smithi063.stdout:2/447: rename d0/d21/d39/l3f to d0/d21/d56/d11/d52/l9b 0 2023-12-07T16:21:39.802 INFO:tasks.workunit.client.0.smithi063.stdout:2/448: readlink d0/d67/d65/l84 0 2023-12-07T16:21:39.802 INFO:tasks.workunit.client.0.smithi063.stdout:3/427: rmdir d7/d9/d1b 39 2023-12-07T16:21:39.803 INFO:tasks.workunit.client.1.smithi152.stdout:6/601: creat d2/d4f/d83/d85/de/d2e/d4c/d5d/fc4 x:0 0 0 2023-12-07T16:21:39.803 INFO:tasks.workunit.client.1.smithi152.stdout:3/563: write d7/d10/d1a/d2f/f82 [4019619,5074] 0 2023-12-07T16:21:39.803 INFO:tasks.workunit.client.1.smithi152.stdout:3/564: chown d7 1229452713 1 2023-12-07T16:21:39.805 INFO:tasks.workunit.client.1.smithi152.stdout:0/609: creat d0/dc/d3d/dab/dc8/fcf x:0 0 0 2023-12-07T16:21:39.805 INFO:tasks.workunit.client.1.smithi152.stdout:0/610: write d0/dc/d36/f9c [190082,99208] 0 2023-12-07T16:21:39.805 INFO:tasks.workunit.client.1.smithi152.stdout:8/632: dread d3/d4/d9/f33 [0,4194304] 0 2023-12-07T16:21:39.805 INFO:tasks.workunit.client.0.smithi063.stdout:2/449: creat d0/d21/d56/d11/d52/f9c x:0 0 0 2023-12-07T16:21:39.806 INFO:tasks.workunit.client.1.smithi152.stdout:3/565: mknod d7/d10/d1a/d2f/d86/caf 0 2023-12-07T16:21:39.806 INFO:tasks.workunit.client.1.smithi152.stdout:3/566: chown d7/dc/d14/f87 227342 1 2023-12-07T16:21:39.806 INFO:tasks.workunit.client.1.smithi152.stdout:0/611: creat d0/dc/d3d/d73/dbf/fd0 x:0 0 0 2023-12-07T16:21:39.810 INFO:tasks.workunit.client.1.smithi152.stdout:3/567: creat d7/d10/d1a/fb0 x:0 0 0 2023-12-07T16:21:39.810 INFO:tasks.workunit.client.0.smithi063.stdout:2/450: link d0/c12 d0/d21/c9d 0 2023-12-07T16:21:39.810 INFO:tasks.workunit.client.0.smithi063.stdout:3/428: dread d7/d9/d2b/f62 [0,4194304] 0 2023-12-07T16:21:39.811 INFO:tasks.workunit.client.1.smithi152.stdout:3/568: creat d7/dc/fb1 x:0 0 0 2023-12-07T16:21:39.812 INFO:tasks.workunit.client.1.smithi152.stdout:3/569: chown d7/d10/d1a/d25/d4b 196971398 1 2023-12-07T16:21:39.812 INFO:tasks.workunit.client.0.smithi063.stdout:2/451: rename d0/d21/d56/d11/d52/d5d/f83 to d0/d21/f9e 0 2023-12-07T16:21:39.812 INFO:tasks.workunit.client.1.smithi152.stdout:3/570: mkdir d7/dc/d3e/d62/db2 0 2023-12-07T16:21:39.814 INFO:tasks.workunit.client.0.smithi063.stdout:2/452: rename d0/d21/d56/d11/d52/d5d/l74 to d0/d21/d56/d11/l9f 0 2023-12-07T16:21:39.814 INFO:tasks.workunit.client.0.smithi063.stdout:2/453: chown d0/d21/d56/d11/d52/d63/d8c 0 1 2023-12-07T16:21:39.815 INFO:tasks.workunit.client.1.smithi152.stdout:3/571: creat d7/dc/d3e/d6b/d80/da2/fb3 x:0 0 0 2023-12-07T16:21:39.815 INFO:tasks.workunit.client.1.smithi152.stdout:3/572: chown f2 805801310 1 2023-12-07T16:21:39.816 INFO:tasks.workunit.client.0.smithi063.stdout:2/454: truncate d0/f14 4103016 0 2023-12-07T16:21:39.816 INFO:tasks.workunit.client.1.smithi152.stdout:3/573: unlink d7/dc/d3e/d48/l55 0 2023-12-07T16:21:39.818 INFO:tasks.workunit.client.0.smithi063.stdout:2/455: creat d0/d21/d56/d71/fa0 x:0 0 0 2023-12-07T16:21:39.819 INFO:tasks.workunit.client.0.smithi063.stdout:2/456: symlink d0/d67/d65/la1 0 2023-12-07T16:21:39.819 INFO:tasks.workunit.client.0.smithi063.stdout:2/457: write d0/d67/d65/d6a/d8e/f91 [1023998,72368] 0 2023-12-07T16:21:39.820 INFO:tasks.workunit.client.0.smithi063.stdout:2/458: getdents d0/d67/d65/d6a 0 2023-12-07T16:21:39.820 INFO:tasks.workunit.client.0.smithi063.stdout:2/459: chown d0/d4a/l47 1908544 1 2023-12-07T16:21:39.822 INFO:tasks.workunit.client.0.smithi063.stdout:2/460: creat d0/d21/d56/fa2 x:0 0 0 2023-12-07T16:21:39.825 INFO:tasks.workunit.client.1.smithi152.stdout:6/602: dread d2/d4f/d83/d85/f74 [0,4194304] 0 2023-12-07T16:21:39.826 INFO:tasks.workunit.client.0.smithi063.stdout:8/552: dread d7/d14/d15/f68 [0,4194304] 0 2023-12-07T16:21:39.828 INFO:tasks.workunit.client.0.smithi063.stdout:8/553: mkdir d7/d14/d15/d48/daa 0 2023-12-07T16:21:39.829 INFO:tasks.workunit.client.1.smithi152.stdout:6/603: unlink d2/d4f/d83/d85/d19/d1f/l79 0 2023-12-07T16:21:39.830 INFO:tasks.workunit.client.0.smithi063.stdout:8/554: unlink d7/d14/d1a/l43 0 2023-12-07T16:21:39.831 INFO:tasks.workunit.client.1.smithi152.stdout:6/604: mknod d2/d4f/d83/d85/de/cc5 0 2023-12-07T16:21:39.831 INFO:tasks.workunit.client.0.smithi063.stdout:8/555: mknod d7/d14/d15/d2b/d40/d63/d75/d98/cab 0 2023-12-07T16:21:39.833 INFO:tasks.workunit.client.1.smithi152.stdout:6/605: link d2/d4f/d83/d85/f25 d2/fc6 0 2023-12-07T16:21:39.833 INFO:tasks.workunit.client.1.smithi152.stdout:1/766: dwrite dc/f63 [0,4194304] 0 2023-12-07T16:21:39.835 INFO:tasks.workunit.client.1.smithi152.stdout:8/633: dread d3/d1e/d55/fb8 [0,4194304] 0 2023-12-07T16:21:39.835 INFO:tasks.workunit.client.1.smithi152.stdout:6/606: getdents d2/d4f/d83/d48 0 2023-12-07T16:21:39.837 INFO:tasks.workunit.client.1.smithi152.stdout:1/767: creat dc/def/df6/f101 x:0 0 0 2023-12-07T16:21:39.837 INFO:tasks.workunit.client.1.smithi152.stdout:1/768: chown dc/d14/d18/d2d/d4a/d52 6 1 2023-12-07T16:21:39.839 INFO:tasks.workunit.client.1.smithi152.stdout:8/634: unlink d3/d4/d9/d23/d4c/lcf 0 2023-12-07T16:21:39.839 INFO:tasks.workunit.client.1.smithi152.stdout:8/635: truncate d3/d4/d9/d23/fcb 551434 0 2023-12-07T16:21:39.839 INFO:tasks.workunit.client.0.smithi063.stdout:3/429: dread f6 [4194304,4194304] 0 2023-12-07T16:21:39.839 INFO:tasks.workunit.client.0.smithi063.stdout:3/430: chown d7/d9/d2b/f8b 7371334 1 2023-12-07T16:21:39.839 INFO:tasks.workunit.client.0.smithi063.stdout:3/431: truncate d7/d21/f69 1518192 0 2023-12-07T16:21:39.842 INFO:tasks.workunit.client.0.smithi063.stdout:3/432: truncate d7/d9/dd/f6b 5696135 0 2023-12-07T16:21:39.842 INFO:tasks.workunit.client.0.smithi063.stdout:3/433: chown d7/d21/c32 0 1 2023-12-07T16:21:39.842 INFO:tasks.workunit.client.0.smithi063.stdout:0/442: dwrite d4/d25/f8d [0,4194304] 0 2023-12-07T16:21:39.845 INFO:tasks.workunit.client.1.smithi152.stdout:6/607: mkdir d2/d4f/d83/d85/d19/d1f/dc7 0 2023-12-07T16:21:39.848 INFO:tasks.workunit.client.1.smithi152.stdout:7/577: dwrite db/d27/d39/d41/d58/d80/f8d [0,4194304] 0 2023-12-07T16:21:39.848 INFO:tasks.workunit.client.0.smithi063.stdout:0/443: rmdir d4/dd/de/d15/d52/d5b/d63/d74 39 2023-12-07T16:21:39.848 INFO:tasks.workunit.client.0.smithi063.stdout:0/444: write d4/dd/de/d15/d52/d5b/f5d [785441,29733] 0 2023-12-07T16:21:39.848 INFO:tasks.workunit.client.1.smithi152.stdout:6/608: mknod d2/d4f/d83/da0/da2/cc8 0 2023-12-07T16:21:39.849 INFO:tasks.workunit.client.1.smithi152.stdout:6/609: chown d2/d4f/d83/d85/de/d2e/l3d 3195 1 2023-12-07T16:21:39.849 INFO:tasks.workunit.client.1.smithi152.stdout:4/519: dwrite d0/d3/d6/f6a [0,4194304] 0 2023-12-07T16:21:39.849 INFO:tasks.workunit.client.1.smithi152.stdout:4/520: fsync d0/d3/d6/dc/d22/f4f 0 2023-12-07T16:21:39.850 INFO:tasks.workunit.client.0.smithi063.stdout:0/445: symlink d4/dd/d26/d2b/l92 0 2023-12-07T16:21:39.852 INFO:tasks.workunit.client.0.smithi063.stdout:9/372: sync 2023-12-07T16:21:39.852 INFO:tasks.workunit.client.0.smithi063.stdout:7/378: sync 2023-12-07T16:21:39.853 INFO:tasks.workunit.client.0.smithi063.stdout:4/319: sync 2023-12-07T16:21:39.853 INFO:tasks.workunit.client.0.smithi063.stdout:4/320: truncate d1/d3/db/f38 4604898 0 2023-12-07T16:21:39.853 INFO:tasks.workunit.client.1.smithi152.stdout:1/769: dread dc/d14/d18/d79/d86/db7/ffd [0,4194304] 0 2023-12-07T16:21:39.854 INFO:tasks.workunit.client.1.smithi152.stdout:6/610: truncate d2/d4f/d83/d48/f53 3590567 0 2023-12-07T16:21:39.854 INFO:tasks.workunit.client.1.smithi152.stdout:6/611: readlink d2/d4f/d83/d85/de/d45/lb4 0 2023-12-07T16:21:39.854 INFO:tasks.workunit.client.1.smithi152.stdout:4/521: symlink d0/d3/d6/dc/d3a/d48/l97 0 2023-12-07T16:21:39.855 INFO:tasks.workunit.client.0.smithi063.stdout:0/446: creat d4/dd/de/d2d/f93 x:0 0 0 2023-12-07T16:21:39.856 INFO:tasks.workunit.client.1.smithi152.stdout:1/770: creat dc/d28/d7d/f102 x:0 0 0 2023-12-07T16:21:39.858 INFO:tasks.workunit.client.0.smithi063.stdout:7/379: unlink d2/f4e 0 2023-12-07T16:21:39.859 INFO:tasks.workunit.client.1.smithi152.stdout:6/612: unlink d2/d4f/d83/d85/f1a 0 2023-12-07T16:21:39.859 INFO:tasks.workunit.client.1.smithi152.stdout:4/522: creat d0/d3/d6/d2b/d56/f98 x:0 0 0 2023-12-07T16:21:39.861 INFO:tasks.workunit.client.0.smithi063.stdout:5/387: dwrite d1/f2a [4194304,4194304] 0 2023-12-07T16:21:39.863 INFO:tasks.workunit.client.1.smithi152.stdout:0/612: dwrite d0/dc/d36/d7d/f8a [0,4194304] 0 2023-12-07T16:21:39.864 INFO:tasks.workunit.client.1.smithi152.stdout:4/523: unlink d0/d3/d6/dc/d39/l3b 0 2023-12-07T16:21:39.868 INFO:tasks.workunit.client.0.smithi063.stdout:5/388: rename d1/d3/de/l69 to d1/d3/de/d1e/d25/l7a 0 2023-12-07T16:21:39.868 INFO:tasks.workunit.client.0.smithi063.stdout:4/321: dread d1/d3/db/f20 [0,4194304] 0 2023-12-07T16:21:39.869 INFO:tasks.workunit.client.0.smithi063.stdout:9/373: dread d0/f47 [0,4194304] 0 2023-12-07T16:21:39.870 INFO:tasks.workunit.client.0.smithi063.stdout:9/374: creat d0/d21/d64/d6a/f79 x:0 0 0 2023-12-07T16:21:39.870 INFO:tasks.workunit.client.0.smithi063.stdout:9/375: dread - d0/d13/d39/d42/f77 zero size 2023-12-07T16:21:39.872 INFO:tasks.workunit.client.1.smithi152.stdout:5/758: dwrite dd/d7b/f84 [0,4194304] 0 2023-12-07T16:21:39.872 INFO:tasks.workunit.client.1.smithi152.stdout:5/759: chown dd/d91 332227 1 2023-12-07T16:21:39.872 INFO:tasks.workunit.client.1.smithi152.stdout:5/760: fsync dd/de/d14/d19/d1a/d1b/f70 0 2023-12-07T16:21:39.873 INFO:tasks.workunit.client.0.smithi063.stdout:4/322: write d1/d3/db/f38 [2091885,100060] 0 2023-12-07T16:21:39.873 INFO:tasks.workunit.client.0.smithi063.stdout:4/323: chown d1/d3/db/l2d 69 1 2023-12-07T16:21:39.878 INFO:tasks.workunit.client.0.smithi063.stdout:4/324: rename d1/d3/db/d13/f2a to d1/d3/d3f/d44/f59 0 2023-12-07T16:21:39.886 INFO:tasks.workunit.client.1.smithi152.stdout:4/524: dread d0/d17/f79 [0,4194304] 0 2023-12-07T16:21:39.888 INFO:tasks.workunit.client.0.smithi063.stdout:5/389: dread d1/d3/de/d1e/f1d [0,4194304] 0 2023-12-07T16:21:39.888 INFO:tasks.workunit.client.0.smithi063.stdout:5/390: write d1/d3/f3b [1011203,75831] 0 2023-12-07T16:21:39.889 INFO:tasks.workunit.client.0.smithi063.stdout:2/461: dwrite d0/d1e/f90 [0,4194304] 0 2023-12-07T16:21:39.890 INFO:tasks.workunit.client.1.smithi152.stdout:3/574: dwrite d7/dc/d3e/d62/d6d/d84/f85 [0,4194304] 0 2023-12-07T16:21:39.892 INFO:tasks.workunit.client.0.smithi063.stdout:9/376: dread d0/d21/f23 [0,4194304] 0 2023-12-07T16:21:39.893 INFO:tasks.workunit.client.0.smithi063.stdout:8/556: dwrite d7/d14/f4f [0,4194304] 0 2023-12-07T16:21:39.894 INFO:tasks.workunit.client.1.smithi152.stdout:3/575: symlink d7/dc/d3e/d7d/lb4 0 2023-12-07T16:21:39.894 INFO:tasks.workunit.client.1.smithi152.stdout:3/576: getdents d7/d10/d1a/d2f/d5c 0 2023-12-07T16:21:39.894 INFO:tasks.workunit.client.0.smithi063.stdout:2/462: creat d0/d21/d56/d11/d52/d63/d8c/fa3 x:0 0 0 2023-12-07T16:21:39.895 INFO:tasks.workunit.client.0.smithi063.stdout:8/557: mkdir d7/d14/d15/dac 0 2023-12-07T16:21:39.896 INFO:tasks.workunit.client.0.smithi063.stdout:9/377: dread d0/d7/f55 [0,4194304] 0 2023-12-07T16:21:39.896 INFO:tasks.workunit.client.0.smithi063.stdout:9/378: chown d0/d13/d39/c3f 160194255 1 2023-12-07T16:21:39.896 INFO:tasks.workunit.client.0.smithi063.stdout:2/463: rmdir d0/d1e 39 2023-12-07T16:21:39.896 INFO:tasks.workunit.client.0.smithi063.stdout:2/464: write d0/d67/f55 [1519451,122144] 0 2023-12-07T16:21:39.896 INFO:tasks.workunit.client.0.smithi063.stdout:2/465: readlink d0/d4a/l72 0 2023-12-07T16:21:39.897 INFO:tasks.workunit.client.0.smithi063.stdout:8/558: write d7/d14/d1a/f5c [3619970,3838] 0 2023-12-07T16:21:39.897 INFO:tasks.workunit.client.0.smithi063.stdout:8/559: chown d7/d14/d15/f46 368410009 1 2023-12-07T16:21:39.897 INFO:tasks.workunit.client.0.smithi063.stdout:9/379: mknod d0/c7a 0 2023-12-07T16:21:39.897 INFO:tasks.workunit.client.0.smithi063.stdout:9/380: chown d0/l9 10 1 2023-12-07T16:21:39.898 INFO:tasks.workunit.client.0.smithi063.stdout:9/381: truncate d0/d13/d39/d3a/f6c 400817 0 2023-12-07T16:21:39.898 INFO:tasks.workunit.client.0.smithi063.stdout:9/382: write d0/d13/f3d [549326,15469] 0 2023-12-07T16:21:39.898 INFO:tasks.workunit.client.0.smithi063.stdout:9/383: chown d0/l66 23891564 1 2023-12-07T16:21:39.899 INFO:tasks.workunit.client.1.smithi152.stdout:3/577: dread d7/d10/d19/f23 [0,4194304] 0 2023-12-07T16:21:39.899 INFO:tasks.workunit.client.1.smithi152.stdout:3/578: truncate d7/d10/d19/f23 719251 0 2023-12-07T16:21:39.901 INFO:tasks.workunit.client.0.smithi063.stdout:4/325: dread d1/f28 [0,4194304] 0 2023-12-07T16:21:39.902 INFO:tasks.workunit.client.1.smithi152.stdout:4/525: dread d0/d17/f79 [0,4194304] 0 2023-12-07T16:21:39.903 INFO:tasks.workunit.client.1.smithi152.stdout:4/526: chown d0/d3/d6/c1b 17250 1 2023-12-07T16:21:39.903 INFO:tasks.workunit.client.1.smithi152.stdout:4/527: chown d0/d3 25167 1 2023-12-07T16:21:39.904 INFO:tasks.workunit.client.1.smithi152.stdout:4/528: getdents d0 0 2023-12-07T16:21:39.905 INFO:tasks.workunit.client.0.smithi063.stdout:8/560: rmdir d7/d14/d1a/d54 39 2023-12-07T16:21:39.910 INFO:tasks.workunit.client.1.smithi152.stdout:6/613: rename d2/d4f/d83/d85/de to d2/d4f/d83/d85/d19/d1f/dc7/dc9 0 2023-12-07T16:21:39.912 INFO:tasks.workunit.client.0.smithi063.stdout:8/561: truncate d7/d14/d15/d48/f58 1127086 0 2023-12-07T16:21:39.912 INFO:tasks.workunit.client.1.smithi152.stdout:6/614: creat d2/d4f/d83/d85/d19/fca x:0 0 0 2023-12-07T16:21:39.914 INFO:tasks.workunit.client.0.smithi063.stdout:8/562: mkdir d7/d14/d15/dac/dad 0 2023-12-07T16:21:39.914 INFO:tasks.workunit.client.0.smithi063.stdout:8/563: fsync d7/d14/d15/f2d 0 2023-12-07T16:21:39.916 INFO:tasks.workunit.client.1.smithi152.stdout:6/615: symlink d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/lcb 0 2023-12-07T16:21:39.916 INFO:tasks.workunit.client.1.smithi152.stdout:6/616: chown d2/d4f/d83/d85/l96 608225965 1 2023-12-07T16:21:39.917 INFO:tasks.workunit.client.0.smithi063.stdout:2/466: dread d0/d1e/f29 [0,4194304] 0 2023-12-07T16:21:39.917 INFO:tasks.workunit.client.0.smithi063.stdout:2/467: fdatasync d0/d21/d56/d11/f1b 0 2023-12-07T16:21:39.918 INFO:tasks.workunit.client.0.smithi063.stdout:2/468: symlink d0/d21/d56/d11/la4 0 2023-12-07T16:21:39.918 INFO:tasks.workunit.client.0.smithi063.stdout:2/469: chown d0/c28 165997346 1 2023-12-07T16:21:39.919 INFO:tasks.workunit.client.0.smithi063.stdout:8/564: dread d7/d14/d1a/f50 [0,4194304] 0 2023-12-07T16:21:39.919 INFO:tasks.workunit.client.0.smithi063.stdout:8/565: readlink d7/d14/d15/d48/l71 0 2023-12-07T16:21:39.920 INFO:tasks.workunit.client.0.smithi063.stdout:2/470: creat d0/d67/d65/fa5 x:0 0 0 2023-12-07T16:21:39.920 INFO:tasks.workunit.client.0.smithi063.stdout:7/380: dwrite d2/d21/f3f [0,4194304] 0 2023-12-07T16:21:39.920 INFO:tasks.workunit.client.0.smithi063.stdout:3/434: dwrite d7/d9/d1b/f2c [0,4194304] 0 2023-12-07T16:21:39.921 INFO:tasks.workunit.client.1.smithi152.stdout:4/529: dread d0/d3/f2a [0,4194304] 0 2023-12-07T16:21:39.921 INFO:tasks.workunit.client.1.smithi152.stdout:4/530: chown d0 1494 1 2023-12-07T16:21:39.921 INFO:tasks.workunit.client.1.smithi152.stdout:8/636: dwrite d3/d4/d9/d34/f49 [0,4194304] 0 2023-12-07T16:21:39.922 INFO:tasks.workunit.client.1.smithi152.stdout:3/579: dread d7/dc/d3e/d62/d6d/d84/f66 [0,4194304] 0 2023-12-07T16:21:39.922 INFO:tasks.workunit.client.1.smithi152.stdout:3/580: read - d7/dc/d3e/d62/d6d/d98/fae zero size 2023-12-07T16:21:39.922 INFO:tasks.workunit.client.0.smithi063.stdout:4/326: dread d1/d3/f5 [0,4194304] 0 2023-12-07T16:21:39.922 INFO:tasks.workunit.client.0.smithi063.stdout:2/471: symlink d0/d67/d65/d6a/la6 0 2023-12-07T16:21:39.922 INFO:tasks.workunit.client.0.smithi063.stdout:3/435: read f6 [5418996,96630] 0 2023-12-07T16:21:39.923 INFO:tasks.workunit.client.1.smithi152.stdout:4/531: symlink d0/d3/d6/dc/d3a/d46/d80/l99 0 2023-12-07T16:21:39.923 INFO:tasks.workunit.client.1.smithi152.stdout:4/532: fsync d0/d3/d6/dc/d3a/d48/d4c/f52 0 2023-12-07T16:21:39.925 INFO:tasks.workunit.client.0.smithi063.stdout:4/327: creat d1/d3/f5a x:0 0 0 2023-12-07T16:21:39.925 INFO:tasks.workunit.client.0.smithi063.stdout:4/328: readlink d1/d3/l19 0 2023-12-07T16:21:39.925 INFO:tasks.workunit.client.1.smithi152.stdout:4/533: write d0/d3/d6/f8a [82064,107728] 0 2023-12-07T16:21:39.926 INFO:tasks.workunit.client.0.smithi063.stdout:2/472: mknod d0/d1e/ca7 0 2023-12-07T16:21:39.926 INFO:tasks.workunit.client.0.smithi063.stdout:2/473: write d0/d21/d56/d11/d52/d63/d8c/f8f [706219,20249] 0 2023-12-07T16:21:39.927 INFO:tasks.workunit.client.1.smithi152.stdout:8/637: creat d3/fdf x:0 0 0 2023-12-07T16:21:39.927 INFO:tasks.workunit.client.0.smithi063.stdout:3/436: creat d7/d9/dd/f90 x:0 0 0 2023-12-07T16:21:39.931 INFO:tasks.workunit.client.1.smithi152.stdout:3/581: creat d7/dc/d3e/d7d/fb5 x:0 0 0 2023-12-07T16:21:39.931 INFO:tasks.workunit.client.1.smithi152.stdout:3/582: dread - d7/dc/fa9 zero size 2023-12-07T16:21:39.933 INFO:tasks.workunit.client.1.smithi152.stdout:5/761: dwrite dd/de/d14/d19/d1a/d1b/f8b [0,4194304] 0 2023-12-07T16:21:39.933 INFO:tasks.workunit.client.1.smithi152.stdout:5/762: fdatasync dd/de/d14/d19/d1a/fc7 0 2023-12-07T16:21:39.933 INFO:tasks.workunit.client.1.smithi152.stdout:3/583: creat d7/dc/d3e/d62/fb6 x:0 0 0 2023-12-07T16:21:39.936 INFO:tasks.workunit.client.0.smithi063.stdout:8/566: dread d7/d14/d15/d2b/f59 [0,4194304] 0 2023-12-07T16:21:39.936 INFO:tasks.workunit.client.0.smithi063.stdout:4/329: dread d1/d3/db/d13/f48 [0,4194304] 0 2023-12-07T16:21:39.938 INFO:tasks.workunit.client.1.smithi152.stdout:0/613: dwrite d0/dc/d3d/d4c/f64 [0,4194304] 0 2023-12-07T16:21:39.938 INFO:tasks.workunit.client.1.smithi152.stdout:0/614: write d0/d2f/f74 [840316,88262] 0 2023-12-07T16:21:39.939 INFO:tasks.workunit.client.0.smithi063.stdout:0/447: dwrite d4/dd/de/d15/d1f/f54 [0,4194304] 0 2023-12-07T16:21:39.939 INFO:tasks.workunit.client.0.smithi063.stdout:0/448: write d4/dd/de/d15/d1f/d4c/f34 [640510,65377] 0 2023-12-07T16:21:39.939 INFO:tasks.workunit.client.0.smithi063.stdout:0/449: chown d4/dd/de/d15/d52/d5b/d63/c67 23 1 2023-12-07T16:21:39.939 INFO:tasks.workunit.client.0.smithi063.stdout:8/567: getdents d7/d14/d1a 0 2023-12-07T16:21:39.939 INFO:tasks.workunit.client.0.smithi063.stdout:8/568: chown d7/d14/d1a/d54/d7e/f88 141231818 1 2023-12-07T16:21:39.939 INFO:tasks.workunit.client.0.smithi063.stdout:8/569: chown d7 342873 1 2023-12-07T16:21:39.939 INFO:tasks.workunit.client.1.smithi152.stdout:1/771: dwrite dc/d14/d18/f70 [0,4194304] 0 2023-12-07T16:21:39.942 INFO:tasks.workunit.client.0.smithi063.stdout:0/450: creat d4/dd/de/d2d/f94 x:0 0 0 2023-12-07T16:21:39.943 INFO:tasks.workunit.client.1.smithi152.stdout:0/615: creat d0/d2f/fd1 x:0 0 0 2023-12-07T16:21:39.943 INFO:tasks.workunit.client.1.smithi152.stdout:4/534: dread d0/d3/d6/f6a [0,4194304] 0 2023-12-07T16:21:39.943 INFO:tasks.workunit.client.1.smithi152.stdout:4/535: chown d0/d3/f2a 269854 1 2023-12-07T16:21:39.943 INFO:tasks.workunit.client.1.smithi152.stdout:4/536: write d0/d3/d6/dc/d39/f5e [217897,33869] 0 2023-12-07T16:21:39.943 INFO:tasks.workunit.client.1.smithi152.stdout:4/537: chown d0/d3/d6/dc/d3a/d48/f5d 4993 1 2023-12-07T16:21:39.947 INFO:tasks.workunit.client.0.smithi063.stdout:4/330: symlink d1/d3/db/d41/l5b 0 2023-12-07T16:21:39.947 INFO:tasks.workunit.client.0.smithi063.stdout:0/451: getdents d4 0 2023-12-07T16:21:39.950 INFO:tasks.workunit.client.0.smithi063.stdout:9/384: dwrite d0/d13/f5d [4194304,4194304] 0 2023-12-07T16:21:39.952 INFO:tasks.workunit.client.0.smithi063.stdout:5/391: dwrite d1/f18 [0,4194304] 0 2023-12-07T16:21:39.952 INFO:tasks.workunit.client.0.smithi063.stdout:5/392: dread - d1/d31/d56/f67 zero size 2023-12-07T16:21:39.956 INFO:tasks.workunit.client.0.smithi063.stdout:7/381: dwrite d2/d34/d5a/f66 [0,4194304] 0 2023-12-07T16:21:39.956 INFO:tasks.workunit.client.1.smithi152.stdout:1/772: mkdir dc/d14/d18/d2d/d9c/dfc/d103 0 2023-12-07T16:21:39.956 INFO:tasks.workunit.client.1.smithi152.stdout:0/616: creat d0/dc/d3d/d73/fd2 x:0 0 0 2023-12-07T16:21:39.957 INFO:tasks.workunit.client.1.smithi152.stdout:4/538: symlink d0/d3/d6/dc/d3a/d46/d4e/l9a 0 2023-12-07T16:21:39.960 INFO:tasks.workunit.client.0.smithi063.stdout:1/296: sync 2023-12-07T16:21:39.960 INFO:tasks.workunit.client.0.smithi063.stdout:1/297: write d0/dd/d10/d46/f58 [994471,7867] 0 2023-12-07T16:21:39.960 INFO:tasks.workunit.client.0.smithi063.stdout:1/298: chown d0/l66 1 1 2023-12-07T16:21:39.960 INFO:tasks.workunit.client.0.smithi063.stdout:6/469: sync 2023-12-07T16:21:39.960 INFO:tasks.workunit.client.0.smithi063.stdout:6/470: write d0/d17/d1a/d4d/d5a/f9b [442074,52071] 0 2023-12-07T16:21:39.960 INFO:tasks.workunit.client.0.smithi063.stdout:7/382: getdents d2/d34/d46/d5d 0 2023-12-07T16:21:39.962 INFO:tasks.workunit.client.0.smithi063.stdout:2/474: rmdir d0/d21/d56/d11/d52/d63/d8c 39 2023-12-07T16:21:39.965 INFO:tasks.workunit.client.0.smithi063.stdout:6/471: link d0/d17/d46/f55 d0/d17/fa9 0 2023-12-07T16:21:39.965 INFO:tasks.workunit.client.0.smithi063.stdout:6/472: getdents d0/d17/d1a/d4d/d5a/d9d 0 2023-12-07T16:21:39.969 INFO:tasks.workunit.client.1.smithi152.stdout:2/561: sync 2023-12-07T16:21:39.969 INFO:tasks.workunit.client.1.smithi152.stdout:9/677: sync 2023-12-07T16:21:39.969 INFO:tasks.workunit.client.0.smithi063.stdout:7/383: creat d2/d64/f8f x:0 0 0 2023-12-07T16:21:39.971 INFO:tasks.workunit.client.0.smithi063.stdout:6/473: creat d0/d1e/d2a/faa x:0 0 0 2023-12-07T16:21:39.976 INFO:tasks.workunit.client.1.smithi152.stdout:4/539: dread d0/d3/d6/dc/d3a/d46/d4e/f57 [0,4194304] 0 2023-12-07T16:21:39.979 INFO:tasks.workunit.client.1.smithi152.stdout:4/540: dread d0/d3/d6/d36/d85/f74 [0,4194304] 0 2023-12-07T16:21:39.980 INFO:tasks.workunit.client.1.smithi152.stdout:4/541: stat d0/d3/d6/dc/d3a/d46/d80/l99 0 2023-12-07T16:21:39.980 INFO:tasks.workunit.client.0.smithi063.stdout:6/474: dread d0/d1e/d1d/f40 [0,4194304] 0 2023-12-07T16:21:39.983 INFO:tasks.workunit.client.0.smithi063.stdout:6/475: creat d0/d1e/d1d/fab x:0 0 0 2023-12-07T16:21:39.983 INFO:tasks.workunit.client.1.smithi152.stdout:4/542: mkdir d0/d3/d6/dc/d3a/d46/d9b 0 2023-12-07T16:21:39.983 INFO:tasks.workunit.client.1.smithi152.stdout:4/543: write d0/d3/d6/dc/d3a/d48/f5d [486627,55996] 0 2023-12-07T16:21:39.984 INFO:tasks.workunit.client.1.smithi152.stdout:4/544: chown d0/d3/d6/dc/d22/l3d 15 1 2023-12-07T16:21:39.984 INFO:tasks.workunit.client.0.smithi063.stdout:6/476: creat d0/d1e/d1d/d1f/d6c/fac x:0 0 0 2023-12-07T16:21:39.989 INFO:tasks.workunit.client.0.smithi063.stdout:1/299: dread d0/dd/f1c [0,4194304] 0 2023-12-07T16:21:39.989 INFO:tasks.workunit.client.0.smithi063.stdout:2/475: dread d0/f33 [0,4194304] 0 2023-12-07T16:21:39.990 INFO:tasks.workunit.client.0.smithi063.stdout:1/300: creat d0/dd/d10/d1b/f67 x:0 0 0 2023-12-07T16:21:39.991 INFO:tasks.workunit.client.1.smithi152.stdout:6/617: dwrite d2/d4f/d83/d85/d94/f9f [0,4194304] 0 2023-12-07T16:21:39.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:39 smithi152 ceph-mon[121113]: pgmap v27: 65 pgs: 65 active+clean; 1.8 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 127 MiB/s rd, 264 MiB/s wr, 745 op/s 2023-12-07T16:21:39.993 INFO:tasks.workunit.client.0.smithi063.stdout:1/301: mkdir d0/dd/d10/d1b/d68 0 2023-12-07T16:21:39.993 INFO:tasks.workunit.client.0.smithi063.stdout:2/476: symlink d0/d67/d65/d6a/la8 0 2023-12-07T16:21:39.993 INFO:tasks.workunit.client.0.smithi063.stdout:2/477: truncate d0/d67/d65/f96 341651 0 2023-12-07T16:21:39.994 INFO:tasks.workunit.client.0.smithi063.stdout:7/384: dread d2/d34/d5a/f66 [0,4194304] 0 2023-12-07T16:21:39.995 INFO:tasks.workunit.client.0.smithi063.stdout:7/385: write d2/d2c/f3d [932650,50589] 0 2023-12-07T16:21:39.995 INFO:tasks.workunit.client.1.smithi152.stdout:6/618: symlink d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/da1/lcc 0 2023-12-07T16:21:39.996 INFO:tasks.workunit.client.1.smithi152.stdout:4/545: write d0/d3/d6/dc/d39/d93/f24 [2860586,91900] 0 2023-12-07T16:21:39.996 INFO:tasks.workunit.client.0.smithi063.stdout:1/302: creat d0/dd/d4f/f69 x:0 0 0 2023-12-07T16:21:39.996 INFO:tasks.workunit.client.0.smithi063.stdout:2/478: mkdir d0/d21/d56/d11/d52/da9 0 2023-12-07T16:21:39.998 INFO:tasks.workunit.client.1.smithi152.stdout:8/638: dwrite d3/fa4 [0,4194304] 0 2023-12-07T16:21:39.999 INFO:tasks.workunit.client.0.smithi063.stdout:7/386: creat d2/d34/d5a/d5f/d78/d7c/f90 x:0 0 0 2023-12-07T16:21:39.999 INFO:tasks.workunit.client.0.smithi063.stdout:2/479: mknod d0/d67/d65/d6a/d8e/caa 0 2023-12-07T16:21:40.001 INFO:tasks.workunit.client.1.smithi152.stdout:8/639: symlink d3/da7/le0 0 2023-12-07T16:21:40.002 INFO:tasks.workunit.client.0.smithi063.stdout:7/387: getdents d2/d34/d46/d48/d56 0 2023-12-07T16:21:40.004 INFO:tasks.workunit.client.0.smithi063.stdout:2/480: mknod d0/d67/d65/cab 0 2023-12-07T16:21:40.004 INFO:tasks.workunit.client.1.smithi152.stdout:8/640: write d3/d4/d9/dc/d6f/d7b/d7e/d85/f8c [580320,31664] 0 2023-12-07T16:21:40.004 INFO:tasks.workunit.client.1.smithi152.stdout:8/641: stat d3/d4/d9/d23/d4c/da6 0 2023-12-07T16:21:40.005 INFO:tasks.workunit.client.0.smithi063.stdout:7/388: read d2/fd [5884576,16562] 0 2023-12-07T16:21:40.005 INFO:tasks.workunit.client.1.smithi152.stdout:9/678: dread d1/f49 [0,4194304] 0 2023-12-07T16:21:40.006 INFO:tasks.workunit.client.0.smithi063.stdout:7/389: creat d2/d34/d5a/d5f/d53/f91 x:0 0 0 2023-12-07T16:21:40.006 INFO:tasks.workunit.client.0.smithi063.stdout:7/390: chown d2/d34/d5a/c5e 12210 1 2023-12-07T16:21:40.006 INFO:tasks.workunit.client.1.smithi152.stdout:9/679: truncate d1/dd/f5c 1002617 0 2023-12-07T16:21:40.006 INFO:tasks.workunit.client.1.smithi152.stdout:9/680: fdatasync d1/d9/db/d70/fde 0 2023-12-07T16:21:40.007 INFO:tasks.workunit.client.0.smithi063.stdout:7/391: creat d2/d34/d5a/d5f/d6d/f92 x:0 0 0 2023-12-07T16:21:40.008 INFO:tasks.workunit.client.0.smithi063.stdout:7/392: mkdir d2/d37/d93 0 2023-12-07T16:21:40.008 INFO:tasks.workunit.client.0.smithi063.stdout:7/393: readlink d2/d2c/l51 0 2023-12-07T16:21:40.009 INFO:tasks.workunit.client.0.smithi063.stdout:7/394: link d2/d34/f3b d2/d34/d5a/d5f/d78/d7c/f94 0 2023-12-07T16:21:40.011 INFO:tasks.workunit.client.0.smithi063.stdout:7/395: creat d2/d34/d46/d48/d56/f95 x:0 0 0 2023-12-07T16:21:40.011 INFO:tasks.workunit.client.1.smithi152.stdout:8/642: write d3/d4/d9/dc/d6f/d7b/d7e/d85/f8c [2201883,27565] 0 2023-12-07T16:21:40.012 INFO:tasks.workunit.client.0.smithi063.stdout:7/396: mkdir d2/d96 0 2023-12-07T16:21:40.013 INFO:tasks.workunit.client.1.smithi152.stdout:6/619: dread d2/d4f/d83/d85/d19/d1f/dc7/dc9/f61 [0,4194304] 0 2023-12-07T16:21:40.013 INFO:tasks.workunit.client.1.smithi152.stdout:6/620: write d2/d4f/d83/d85/d19/fca [186443,50249] 0 2023-12-07T16:21:40.013 INFO:tasks.workunit.client.1.smithi152.stdout:6/621: dread - d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/d5d/fb8 zero size 2023-12-07T16:21:40.013 INFO:tasks.workunit.client.0.smithi063.stdout:7/397: mknod d2/d34/d5a/d5f/d6d/c97 0 2023-12-07T16:21:40.014 INFO:tasks.workunit.client.0.smithi063.stdout:7/398: symlink d2/d34/d5a/l98 0 2023-12-07T16:21:40.019 INFO:tasks.workunit.client.0.smithi063.stdout:3/437: dwrite d7/d49/d4b/f6d [0,4194304] 0 2023-12-07T16:21:40.019 INFO:tasks.workunit.client.0.smithi063.stdout:2/481: dread d0/d21/d39/f4e [0,4194304] 0 2023-12-07T16:21:40.019 INFO:tasks.workunit.client.0.smithi063.stdout:2/482: chown d0/d21/d56/d71 502091250 1 2023-12-07T16:21:40.019 INFO:tasks.workunit.client.0.smithi063.stdout:3/438: dread - d7/d9/d2b/d41/f86 zero size 2023-12-07T16:21:40.019 INFO:tasks.workunit.client.1.smithi152.stdout:3/584: dwrite d7/d10/d1a/d25/d3f/f6f [0,4194304] 0 2023-12-07T16:21:40.023 INFO:tasks.workunit.client.0.smithi063.stdout:0/452: rename d4/dd/de/d2d to d4/dd/d26/d2b/d5e/d8e/d95 0 2023-12-07T16:21:40.023 INFO:tasks.workunit.client.0.smithi063.stdout:3/439: getdents d7/d49/d4b 0 2023-12-07T16:21:40.023 INFO:tasks.workunit.client.0.smithi063.stdout:3/440: creat d7/d9/d1b/d5c/f91 x:0 0 0 2023-12-07T16:21:40.023 INFO:tasks.workunit.client.0.smithi063.stdout:3/441: chown d7/d9/d1b/f2c 7 1 2023-12-07T16:21:40.023 INFO:tasks.workunit.client.0.smithi063.stdout:3/442: fsync d7/d9/d1b/f38 0 2023-12-07T16:21:40.023 INFO:tasks.workunit.client.0.smithi063.stdout:3/443: chown d7/d9/dd/l16 0 1 2023-12-07T16:21:40.024 INFO:tasks.workunit.client.0.smithi063.stdout:8/570: dwrite d7/d14/d15/f6d [0,4194304] 0 2023-12-07T16:21:40.024 INFO:tasks.workunit.client.0.smithi063.stdout:8/571: chown d7/d14/d15/dac/dad 8977194 1 2023-12-07T16:21:40.025 INFO:tasks.workunit.client.1.smithi152.stdout:3/585: truncate d7/dc/d14/f1e 2839799 0 2023-12-07T16:21:40.026 INFO:tasks.workunit.client.0.smithi063.stdout:3/444: symlink d7/d9/d2b/d41/l92 0 2023-12-07T16:21:40.026 INFO:tasks.workunit.client.1.smithi152.stdout:3/586: mknod d7/d10/d1a/d2f/d86/cb7 0 2023-12-07T16:21:40.027 INFO:tasks.workunit.client.0.smithi063.stdout:8/572: getdents d7/d14/d15/d2b/d40 0 2023-12-07T16:21:40.028 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:39 smithi063 ceph-mon[112095]: pgmap v27: 65 pgs: 65 active+clean; 1.8 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 127 MiB/s rd, 264 MiB/s wr, 745 op/s 2023-12-07T16:21:40.029 INFO:tasks.workunit.client.0.smithi063.stdout:3/445: creat d7/d49/d4b/d8e/f93 x:0 0 0 2023-12-07T16:21:40.029 INFO:tasks.workunit.client.0.smithi063.stdout:3/446: fdatasync d7/d9/d1b/d5c/f91 0 2023-12-07T16:21:40.029 INFO:tasks.workunit.client.0.smithi063.stdout:3/447: dread - d7/d9/f88 zero size 2023-12-07T16:21:40.030 INFO:tasks.workunit.client.0.smithi063.stdout:8/573: truncate d7/d14/d1a/d54/f5b 2276203 0 2023-12-07T16:21:40.030 INFO:tasks.workunit.client.0.smithi063.stdout:8/574: truncate d7/d14/d1a/f56 372983 0 2023-12-07T16:21:40.033 INFO:tasks.workunit.client.1.smithi152.stdout:3/587: mkdir d7/d10/d1a/d2f/d5c/db8 0 2023-12-07T16:21:40.033 INFO:tasks.workunit.client.1.smithi152.stdout:3/588: read d7/dc/d3e/d62/d6d/f73 [88160,2061] 0 2023-12-07T16:21:40.033 INFO:tasks.workunit.client.1.smithi152.stdout:3/589: write d7/dc/d3e/d48/f97 [526640,35198] 0 2023-12-07T16:21:40.033 INFO:tasks.workunit.client.1.smithi152.stdout:8/643: dread d3/d1e/f30 [0,4194304] 0 2023-12-07T16:21:40.033 INFO:tasks.workunit.client.0.smithi063.stdout:3/448: rename d7/d49/d4b/f6d to d7/d4f/f94 0 2023-12-07T16:21:40.034 INFO:tasks.workunit.client.0.smithi063.stdout:8/575: getdents d7/d14/d1a/d54/d7e 0 2023-12-07T16:21:40.034 INFO:tasks.workunit.client.0.smithi063.stdout:8/576: truncate d7/d14/d15/f46 4913908 0 2023-12-07T16:21:40.034 INFO:tasks.workunit.client.0.smithi063.stdout:7/399: dread d2/d21/f29 [0,4194304] 0 2023-12-07T16:21:40.034 INFO:tasks.workunit.client.0.smithi063.stdout:3/449: link d7/d21/l2f d7/d9/d1b/l95 0 2023-12-07T16:21:40.034 INFO:tasks.workunit.client.0.smithi063.stdout:3/450: fdatasync d7/d9/d1b/f2c 0 2023-12-07T16:21:40.035 INFO:tasks.workunit.client.1.smithi152.stdout:3/590: unlink d7/d10/d1a/d2f/l2c 0 2023-12-07T16:21:40.035 INFO:tasks.workunit.client.0.smithi063.stdout:8/577: rename d7/d38/d73/f8a to d7/d14/d15/d2b/fae 0 2023-12-07T16:21:40.036 INFO:tasks.workunit.client.1.smithi152.stdout:8/644: mkdir d3/d1e/d55/d83/dae/de1 0 2023-12-07T16:21:40.036 INFO:tasks.workunit.client.0.smithi063.stdout:7/400: mknod d2/d34/d5a/d5f/c99 0 2023-12-07T16:21:40.038 INFO:tasks.workunit.client.0.smithi063.stdout:3/451: getdents d7/d49 0 2023-12-07T16:21:40.038 INFO:tasks.workunit.client.0.smithi063.stdout:3/452: write d7/d9/d2b/f3d [1447787,126027] 0 2023-12-07T16:21:40.039 INFO:tasks.workunit.client.0.smithi063.stdout:7/401: mkdir d2/d34/d5a/d5f/d78/d9a 0 2023-12-07T16:21:40.039 INFO:tasks.workunit.client.0.smithi063.stdout:7/402: chown d2/d34/d46/d48/d70/l7b 496 1 2023-12-07T16:21:40.039 INFO:tasks.workunit.client.1.smithi152.stdout:3/591: symlink d7/d10/d1a/d2f/d56/d57/lb9 0 2023-12-07T16:21:40.039 INFO:tasks.workunit.client.1.smithi152.stdout:8/645: creat d3/d4/d9/d34/fe2 x:0 0 0 2023-12-07T16:21:40.040 INFO:tasks.workunit.client.1.smithi152.stdout:3/592: dread - d7/d10/d1a/d2f/d86/f8d zero size 2023-12-07T16:21:40.040 INFO:tasks.workunit.client.1.smithi152.stdout:3/593: dread - d7/dc/d3e/d6b/fac zero size 2023-12-07T16:21:40.040 INFO:tasks.workunit.client.0.smithi063.stdout:3/453: symlink d7/d9/dd/d56/l96 0 2023-12-07T16:21:40.040 INFO:tasks.workunit.client.0.smithi063.stdout:7/403: stat d2/d34/l71 0 2023-12-07T16:21:40.042 INFO:tasks.workunit.client.1.smithi152.stdout:9/681: dwrite d1/d17/d3c/d4a/d48/f56 [0,4194304] 0 2023-12-07T16:21:40.042 INFO:tasks.workunit.client.0.smithi063.stdout:3/454: symlink d7/d9/dd/d7f/l97 0 2023-12-07T16:21:40.044 INFO:tasks.workunit.client.0.smithi063.stdout:0/453: dread d4/dd/f4e [0,4194304] 0 2023-12-07T16:21:40.047 INFO:tasks.workunit.client.1.smithi152.stdout:9/682: rename d1/d9/db/l6d to d1/d9/d2d/d72/d80/le6 0 2023-12-07T16:21:40.048 INFO:tasks.workunit.client.0.smithi063.stdout:0/454: creat d4/dd/de/d15/d52/d5b/d63/d74/f96 x:0 0 0 2023-12-07T16:21:40.048 INFO:tasks.workunit.client.0.smithi063.stdout:0/455: dread - d4/d25/f7d zero size 2023-12-07T16:21:40.048 INFO:tasks.workunit.client.0.smithi063.stdout:0/456: read - d4/dd/de/d15/d52/f81 zero size 2023-12-07T16:21:40.050 INFO:tasks.workunit.client.0.smithi063.stdout:0/457: mknod d4/dd/c97 0 2023-12-07T16:21:40.050 INFO:tasks.workunit.client.0.smithi063.stdout:0/458: dread - d4/dd/de/d15/d52/d5b/d63/d74/f96 zero size 2023-12-07T16:21:40.053 INFO:tasks.workunit.client.0.smithi063.stdout:0/459: symlink d4/dd/d26/l98 0 2023-12-07T16:21:40.053 INFO:tasks.workunit.client.0.smithi063.stdout:0/460: write d4/dd/de/d15/d52/d5b/d63/d6b/f89 [311991,52345] 0 2023-12-07T16:21:40.053 INFO:tasks.workunit.client.0.smithi063.stdout:3/455: dread d7/d9/f18 [0,4194304] 0 2023-12-07T16:21:40.053 INFO:tasks.workunit.client.0.smithi063.stdout:0/461: dread - d4/dd/d26/d2b/d5e/d8e/d95/f7a zero size 2023-12-07T16:21:40.053 INFO:tasks.workunit.client.0.smithi063.stdout:0/462: truncate d4/dd/d26/d2b/d5e/f73 191163 0 2023-12-07T16:21:40.053 INFO:tasks.workunit.client.0.smithi063.stdout:8/578: dread d7/d14/d15/d57/f66 [0,4194304] 0 2023-12-07T16:21:40.054 INFO:tasks.workunit.client.1.smithi152.stdout:8/646: dread d3/d4/d9/d23/f25 [0,4194304] 0 2023-12-07T16:21:40.054 INFO:tasks.workunit.client.1.smithi152.stdout:8/647: creat d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/dd4/fe3 x:0 0 0 2023-12-07T16:21:40.054 INFO:tasks.workunit.client.1.smithi152.stdout:8/648: read - d3/d4/d9/dad/fdc zero size 2023-12-07T16:21:40.054 INFO:tasks.workunit.client.0.smithi063.stdout:3/456: symlink d7/d9/d1b/d5c/l98 0 2023-12-07T16:21:40.054 INFO:tasks.workunit.client.0.smithi063.stdout:3/457: write d7/d49/d4b/f7a [949742,67265] 0 2023-12-07T16:21:40.055 INFO:tasks.workunit.client.1.smithi152.stdout:5/763: dwrite dd/de/d14/d67/f80 [0,4194304] 0 2023-12-07T16:21:40.055 INFO:tasks.workunit.client.1.smithi152.stdout:5/764: fsync dd/f76 0 2023-12-07T16:21:40.055 INFO:tasks.workunit.client.1.smithi152.stdout:5/765: chown dd/de/d38/ca5 23501564 1 2023-12-07T16:21:40.055 INFO:tasks.workunit.client.1.smithi152.stdout:5/766: stat dd/de/d14/dc6/d7c 0 2023-12-07T16:21:40.056 INFO:tasks.workunit.client.1.smithi152.stdout:1/773: dwrite dc/d14/d18/d2d/d48/da3/d58/dde/fe2 [0,4194304] 0 2023-12-07T16:21:40.056 INFO:tasks.workunit.client.1.smithi152.stdout:1/774: dread - dc/d14/d90/dbb/fec zero size 2023-12-07T16:21:40.056 INFO:tasks.workunit.client.0.smithi063.stdout:4/331: dwrite d1/d3/f36 [0,4194304] 0 2023-12-07T16:21:40.058 INFO:tasks.workunit.client.0.smithi063.stdout:0/463: mknod d4/dd/de/c99 0 2023-12-07T16:21:40.058 INFO:tasks.workunit.client.0.smithi063.stdout:3/458: mknod d7/d9/dd/d56/c99 0 2023-12-07T16:21:40.059 INFO:tasks.workunit.client.0.smithi063.stdout:4/332: getdents d1/d3/db/d13 0 2023-12-07T16:21:40.059 INFO:tasks.workunit.client.0.smithi063.stdout:4/333: truncate d1/d3/db/d13/f33 4789309 0 2023-12-07T16:21:40.061 INFO:tasks.workunit.client.0.smithi063.stdout:0/464: symlink d4/dd/de/d15/d1f/d22/l9a 0 2023-12-07T16:21:40.061 INFO:tasks.workunit.client.0.smithi063.stdout:0/465: chown d4/f3e 7 1 2023-12-07T16:21:40.061 INFO:tasks.workunit.client.0.smithi063.stdout:0/466: truncate d4/dd/d26/d2b/d5e/d8e/d95/f7a 245940 0 2023-12-07T16:21:40.061 INFO:tasks.workunit.client.1.smithi152.stdout:8/649: rename d3/f1a to d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/fe4 0 2023-12-07T16:21:40.061 INFO:tasks.workunit.client.1.smithi152.stdout:5/767: truncate dd/de/d38/d3d/fca 2917127 0 2023-12-07T16:21:40.061 INFO:tasks.workunit.client.1.smithi152.stdout:5/768: chown dd/de/ced 135 1 2023-12-07T16:21:40.063 INFO:tasks.workunit.client.0.smithi063.stdout:3/459: link d7/d9/f27 d7/d9/d2b/d41/f9a 0 2023-12-07T16:21:40.063 INFO:tasks.workunit.client.0.smithi063.stdout:3/460: readlink d7/d4f/d53/d54/d76/l80 0 2023-12-07T16:21:40.065 INFO:tasks.workunit.client.1.smithi152.stdout:9/683: dread d1/d9/d2d/d46/f5d [0,4194304] 0 2023-12-07T16:21:40.066 INFO:tasks.workunit.client.0.smithi063.stdout:4/334: mknod d1/d3/d51/c5c 0 2023-12-07T16:21:40.066 INFO:tasks.workunit.client.0.smithi063.stdout:4/335: write d1/d3/db/d16/f37 [724584,19562] 0 2023-12-07T16:21:40.066 INFO:tasks.workunit.client.0.smithi063.stdout:9/385: dwrite d0/d7/f70 [0,4194304] 0 2023-12-07T16:21:40.066 INFO:tasks.workunit.client.0.smithi063.stdout:5/393: dwrite d1/d31/d56/f6f [0,4194304] 0 2023-12-07T16:21:40.069 INFO:tasks.workunit.client.1.smithi152.stdout:6/622: dwrite d2/d4f/d83/d85/f6a [0,4194304] 0 2023-12-07T16:21:40.070 INFO:tasks.workunit.client.0.smithi063.stdout:6/477: dwrite d0/d1e/d60/d68/d76/f77 [0,4194304] 0 2023-12-07T16:21:40.070 INFO:tasks.workunit.client.0.smithi063.stdout:4/336: mknod d1/d3/db/d41/c5d 0 2023-12-07T16:21:40.070 INFO:tasks.workunit.client.0.smithi063.stdout:4/337: dread - d1/d3/db/f56 zero size 2023-12-07T16:21:40.070 INFO:tasks.workunit.client.0.smithi063.stdout:4/338: truncate d1/d3/f4a 938034 0 2023-12-07T16:21:40.071 INFO:tasks.workunit.client.1.smithi152.stdout:5/769: link dd/f76 dd/de/d14/dc6/f108 0 2023-12-07T16:21:40.071 INFO:tasks.workunit.client.0.smithi063.stdout:2/483: dwrite d0/d1e/f9a [0,4194304] 0 2023-12-07T16:21:40.071 INFO:tasks.workunit.client.0.smithi063.stdout:2/484: truncate d0/d1e/f9a 4705357 0 2023-12-07T16:21:40.072 INFO:tasks.workunit.client.1.smithi152.stdout:2/562: dwrite d2/d1c/d2e/d57/db1/d90/f39 [0,4194304] 0 2023-12-07T16:21:40.072 INFO:tasks.workunit.client.1.smithi152.stdout:4/546: dwrite d0/d3/d6/d2b/d75/f8f [0,4194304] 0 2023-12-07T16:21:40.072 INFO:tasks.workunit.client.1.smithi152.stdout:4/547: fdatasync d0/d3/d6/dc/d39/d93/f33 0 2023-12-07T16:21:40.072 INFO:tasks.workunit.client.1.smithi152.stdout:4/548: dread - d0/d3/d6/f35 zero size 2023-12-07T16:21:40.072 INFO:tasks.workunit.client.1.smithi152.stdout:4/549: chown d0/d3/d6/d2b/d56 2 1 2023-12-07T16:21:40.072 INFO:tasks.workunit.client.1.smithi152.stdout:3/594: dwrite d7/dc/fb1 [0,4194304] 0 2023-12-07T16:21:40.073 INFO:tasks.workunit.client.1.smithi152.stdout:9/684: rmdir d1/d9/db/df/da6/da2 39 2023-12-07T16:21:40.075 INFO:tasks.workunit.client.1.smithi152.stdout:1/775: unlink dc/d14/d18/d2d/d48/da3/l25 0 2023-12-07T16:21:40.076 INFO:tasks.workunit.client.0.smithi063.stdout:5/394: symlink d1/d31/d56/d61/d5e/d6a/l7b 0 2023-12-07T16:21:40.076 INFO:tasks.workunit.client.0.smithi063.stdout:8/579: dwrite d7/d14/f7d [0,4194304] 0 2023-12-07T16:21:40.077 INFO:tasks.workunit.client.1.smithi152.stdout:8/650: dread d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/fe4 [0,4194304] 0 2023-12-07T16:21:40.077 INFO:tasks.workunit.client.1.smithi152.stdout:6/623: symlink d2/d4f/d83/d85/lcd 0 2023-12-07T16:21:40.077 INFO:tasks.workunit.client.0.smithi063.stdout:7/404: dwrite d2/d34/d46/f74 [0,4194304] 0 2023-12-07T16:21:40.078 INFO:tasks.workunit.client.0.smithi063.stdout:1/303: fsync d0/dd/d10/d1b/f67 0 2023-12-07T16:21:40.080 INFO:tasks.workunit.client.0.smithi063.stdout:4/339: unlink d1/d3/db/d13/f1c 0 2023-12-07T16:21:40.082 INFO:tasks.workunit.client.1.smithi152.stdout:5/770: symlink dd/de/d8f/l109 0 2023-12-07T16:21:40.082 INFO:tasks.workunit.client.1.smithi152.stdout:5/771: chown dd/de/d14/f63 2 1 2023-12-07T16:21:40.083 INFO:tasks.workunit.client.0.smithi063.stdout:7/405: write d2/d34/d5a/d5f/d2a/f31 [5394755,28442] 0 2023-12-07T16:21:40.083 INFO:tasks.workunit.client.0.smithi063.stdout:6/478: dread d0/d1e/d1d/d1f/f21 [0,4194304] 0 2023-12-07T16:21:40.088 INFO:tasks.workunit.client.0.smithi063.stdout:7/406: write d2/f8 [517898,123268] 0 2023-12-07T16:21:40.088 INFO:tasks.workunit.client.0.smithi063.stdout:5/395: link d1/d3/de/c4b d1/d31/d56/d61/d5e/d6a/c7c 0 2023-12-07T16:21:40.088 INFO:tasks.workunit.client.0.smithi063.stdout:2/485: getdents d0/d67/d65/d6a/d8e 0 2023-12-07T16:21:40.089 INFO:tasks.workunit.client.1.smithi152.stdout:3/595: dread d7/dc/d3e/f53 [4194304,4194304] 0 2023-12-07T16:21:40.089 INFO:tasks.workunit.client.0.smithi063.stdout:8/580: mknod d7/d14/d15/caf 0 2023-12-07T16:21:40.090 INFO:tasks.workunit.client.1.smithi152.stdout:9/685: write d1/d9/db/f33 [385927,14758] 0 2023-12-07T16:21:40.090 INFO:tasks.workunit.client.1.smithi152.stdout:9/686: fsync d1/d17/d3c/d4a/d7e/f9b 0 2023-12-07T16:21:40.090 INFO:tasks.workunit.client.1.smithi152.stdout:4/550: getdents d0/d3/d6/dc/d3a/d48 0 2023-12-07T16:21:40.094 INFO:tasks.workunit.client.1.smithi152.stdout:1/776: rmdir dc/d14/d90/da9 39 2023-12-07T16:21:40.096 INFO:tasks.workunit.client.1.smithi152.stdout:8/651: mkdir d3/d4/d9/d34/de5 0 2023-12-07T16:21:40.098 INFO:tasks.workunit.client.1.smithi152.stdout:5/772: mknod dd/de/d38/d3d/dd3/df0/c10a 0 2023-12-07T16:21:40.100 INFO:tasks.workunit.client.1.smithi152.stdout:1/777: write dc/d28/f39 [3171418,47347] 0 2023-12-07T16:21:40.102 INFO:tasks.workunit.client.1.smithi152.stdout:9/687: rmdir d1/d9/d2d/d72/d80 39 2023-12-07T16:21:40.103 INFO:tasks.workunit.client.1.smithi152.stdout:2/563: dwrite d2/d1c/d2e/d30/d33/f40 [0,4194304] 0 2023-12-07T16:21:40.103 INFO:tasks.workunit.client.1.smithi152.stdout:2/564: write d2/d1c/d2e/d57/d5b/da7/d9a/f9c [9458,82884] 0 2023-12-07T16:21:40.104 INFO:tasks.workunit.client.1.smithi152.stdout:4/551: creat d0/d3/d6/dc/d39/d93/f9c x:0 0 0 2023-12-07T16:21:40.104 INFO:tasks.workunit.client.1.smithi152.stdout:5/773: write dd/de/d38/d3d/f46 [913002,8780] 0 2023-12-07T16:21:40.105 INFO:tasks.workunit.client.0.smithi063.stdout:1/304: creat d0/dd/d19/d50/f6a x:0 0 0 2023-12-07T16:21:40.106 INFO:tasks.workunit.client.0.smithi063.stdout:4/340: creat d1/d3/d3f/d49/f5e x:0 0 0 2023-12-07T16:21:40.106 INFO:tasks.workunit.client.1.smithi152.stdout:8/652: symlink d3/d4/d9/dc/d6f/d7b/d7e/d85/le6 0 2023-12-07T16:21:40.108 INFO:tasks.workunit.client.1.smithi152.stdout:1/778: write dc/d14/d18/d2d/d48/da3/fb8 [1714916,82893] 0 2023-12-07T16:21:40.109 INFO:tasks.workunit.client.0.smithi063.stdout:5/396: truncate d1/f11 2483014 0 2023-12-07T16:21:40.110 INFO:tasks.workunit.client.1.smithi152.stdout:6/624: dwrite d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/d8b/f9c [0,4194304] 0 2023-12-07T16:21:40.110 INFO:tasks.workunit.client.1.smithi152.stdout:6/625: write d2/d4f/d83/d48/d70/f9e [5352559,105018] 0 2023-12-07T16:21:40.110 INFO:tasks.workunit.client.1.smithi152.stdout:6/626: chown d2/d4f/d83/d85/l32 772490551 1 2023-12-07T16:21:40.111 INFO:tasks.workunit.client.0.smithi063.stdout:8/581: symlink d7/d14/d15/dac/lb0 0 2023-12-07T16:21:40.111 INFO:tasks.workunit.client.0.smithi063.stdout:8/582: fdatasync d7/d14/d1a/f74 0 2023-12-07T16:21:40.113 INFO:tasks.workunit.client.1.smithi152.stdout:2/565: unlink d2/d1c/d2e/d57/db1/d90/f4b 0 2023-12-07T16:21:40.114 INFO:tasks.workunit.client.1.smithi152.stdout:2/566: chown d2/d1c/d2e/d57/db1/d90/c27 603952 1 2023-12-07T16:21:40.114 INFO:tasks.workunit.client.1.smithi152.stdout:4/552: mknod d0/d3/d6/d2b/d56/d83/c9d 0 2023-12-07T16:21:40.117 INFO:tasks.workunit.client.1.smithi152.stdout:5/774: mknod dd/d7b/c10b 0 2023-12-07T16:21:40.118 INFO:tasks.workunit.client.0.smithi063.stdout:7/407: dwrite d2/d34/d46/d48/d56/f73 [0,4194304] 0 2023-12-07T16:21:40.118 INFO:tasks.workunit.client.0.smithi063.stdout:7/408: write d2/d34/f3b [610167,65154] 0 2023-12-07T16:21:40.118 INFO:tasks.workunit.client.0.smithi063.stdout:6/479: dwrite d0/d17/f5d [0,4194304] 0 2023-12-07T16:21:40.119 INFO:tasks.workunit.client.1.smithi152.stdout:8/653: rename d3/d4/c32 to d3/d4/d9/d23/ce7 0 2023-12-07T16:21:40.119 INFO:tasks.workunit.client.1.smithi152.stdout:9/688: dread d1/f31 [0,4194304] 0 2023-12-07T16:21:40.119 INFO:tasks.workunit.client.1.smithi152.stdout:9/689: read - d1/d9/db/df/f97 zero size 2023-12-07T16:21:40.119 INFO:tasks.workunit.client.1.smithi152.stdout:9/690: chown d1/d9/db/df/da6/l45 125 1 2023-12-07T16:21:40.121 INFO:tasks.workunit.client.1.smithi152.stdout:1/779: truncate dc/d14/d18/d2d/f67 4853375 0 2023-12-07T16:21:40.121 INFO:tasks.workunit.client.1.smithi152.stdout:1/780: chown dc/d14/fb4 1 1 2023-12-07T16:21:40.121 INFO:tasks.workunit.client.1.smithi152.stdout:1/781: chown dc/d28/d4e/f61 23 1 2023-12-07T16:21:40.121 INFO:tasks.workunit.client.1.smithi152.stdout:1/782: fsync dc/d28/f43 0 2023-12-07T16:21:40.123 INFO:tasks.workunit.client.0.smithi063.stdout:5/397: getdents d1/d3 0 2023-12-07T16:21:40.128 INFO:tasks.workunit.client.0.smithi063.stdout:8/583: mknod d7/d14/d15/d48/cb1 0 2023-12-07T16:21:40.128 INFO:tasks.workunit.client.0.smithi063.stdout:8/584: write f5 [436430,75724] 0 2023-12-07T16:21:40.131 INFO:tasks.workunit.client.1.smithi152.stdout:9/691: write d1/f31 [2431962,112750] 0 2023-12-07T16:21:40.132 INFO:tasks.workunit.client.0.smithi063.stdout:0/467: rmdir d4/dd/de 39 2023-12-07T16:21:40.132 INFO:tasks.workunit.client.0.smithi063.stdout:8/585: creat d7/d14/fb2 x:0 0 0 2023-12-07T16:21:40.132 INFO:tasks.workunit.client.0.smithi063.stdout:8/586: dread - d7/d14/d1a/f77 zero size 2023-12-07T16:21:40.133 INFO:tasks.workunit.client.0.smithi063.stdout:6/480: dread d0/ff [0,4194304] 0 2023-12-07T16:21:40.133 INFO:tasks.workunit.client.0.smithi063.stdout:6/481: dread - d0/d1e/d1d/d4f/f66 zero size 2023-12-07T16:21:40.133 INFO:tasks.workunit.client.0.smithi063.stdout:6/482: rename d0 to d0/d1e/d1d/d4f/d88/dad 22 2023-12-07T16:21:40.135 INFO:tasks.workunit.client.1.smithi152.stdout:6/627: creat d2/d4f/d83/da0/fce x:0 0 0 2023-12-07T16:21:40.135 INFO:tasks.workunit.client.1.smithi152.stdout:7/578: sync 2023-12-07T16:21:40.138 INFO:tasks.workunit.client.0.smithi063.stdout:6/483: mkdir d0/d1e/d60/d68/d76/dae 0 2023-12-07T16:21:40.138 INFO:tasks.workunit.client.0.smithi063.stdout:6/484: chown d0/d17/d1a/d38/c7c 123 1 2023-12-07T16:21:40.140 INFO:tasks.workunit.client.1.smithi152.stdout:2/567: truncate d2/d1c/f69 473367 0 2023-12-07T16:21:40.140 INFO:tasks.workunit.client.0.smithi063.stdout:4/341: dwrite d1/d3/db/d16/f37 [0,4194304] 0 2023-12-07T16:21:40.142 INFO:tasks.workunit.client.0.smithi063.stdout:6/485: unlink d0/d17/d1a/f1c 0 2023-12-07T16:21:40.143 INFO:tasks.workunit.client.1.smithi152.stdout:8/654: creat d3/d4/d9/dc/d6f/d7b/d7e/fe8 x:0 0 0 2023-12-07T16:21:40.143 INFO:tasks.workunit.client.1.smithi152.stdout:8/655: write d3/da7/fb6 [1240694,55447] 0 2023-12-07T16:21:40.143 INFO:tasks.workunit.client.1.smithi152.stdout:8/656: readlink d3/d4/d9/d23/l47 0 2023-12-07T16:21:40.145 INFO:tasks.workunit.client.1.smithi152.stdout:5/775: rename dd/de/d14/d19/da3/ddf/ffb to dd/de/d14/d19/d1a/f10c 0 2023-12-07T16:21:40.147 INFO:tasks.workunit.client.0.smithi063.stdout:4/342: truncate d1/d3/db/d13/f39 3509389 0 2023-12-07T16:21:40.147 INFO:tasks.workunit.client.0.smithi063.stdout:6/486: rmdir d0/d1e/d60/d68/d76 39 2023-12-07T16:21:40.147 INFO:tasks.workunit.client.0.smithi063.stdout:4/343: readlink d1/d3/l1a 0 2023-12-07T16:21:40.148 INFO:tasks.workunit.client.1.smithi152.stdout:4/553: dwrite d0/d3/d6/d36/d85/f72 [0,4194304] 0 2023-12-07T16:21:40.149 INFO:tasks.workunit.client.0.smithi063.stdout:6/487: symlink d0/d1e/d1d/d1f/laf 0 2023-12-07T16:21:40.150 INFO:tasks.workunit.client.0.smithi063.stdout:4/344: creat d1/f5f x:0 0 0 2023-12-07T16:21:40.150 INFO:tasks.workunit.client.0.smithi063.stdout:1/305: rmdir d0/dd 39 2023-12-07T16:21:40.150 INFO:tasks.workunit.client.1.smithi152.stdout:9/692: creat d1/dd/dd6/de2/d53/fe7 x:0 0 0 2023-12-07T16:21:40.151 INFO:tasks.workunit.client.1.smithi152.stdout:6/628: stat d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/c52 0 2023-12-07T16:21:40.151 INFO:tasks.workunit.client.0.smithi063.stdout:6/488: creat d0/d17/fb0 x:0 0 0 2023-12-07T16:21:40.153 INFO:tasks.workunit.client.1.smithi152.stdout:2/568: link d2/d9/c1e d2/d1c/d2e/d57/d5b/da7/d8a/cc5 0 2023-12-07T16:21:40.153 INFO:tasks.workunit.client.1.smithi152.stdout:2/569: write d2/d1c/d2e/d57/db1/d90/fac [411391,2180] 0 2023-12-07T16:21:40.153 INFO:tasks.workunit.client.1.smithi152.stdout:2/570: stat d2/d1c/d2e/d57/f68 0 2023-12-07T16:21:40.154 INFO:tasks.workunit.client.0.smithi063.stdout:1/306: truncate d0/dd/d10/d1e/f52 1824652 0 2023-12-07T16:21:40.155 INFO:tasks.workunit.client.0.smithi063.stdout:1/307: mknod d0/dd/d10/c6b 0 2023-12-07T16:21:40.157 INFO:tasks.workunit.client.0.smithi063.stdout:1/308: symlink d0/dd/d19/d50/l6c 0 2023-12-07T16:21:40.157 INFO:tasks.workunit.client.0.smithi063.stdout:1/309: write d0/dd/f41 [240895,85454] 0 2023-12-07T16:21:40.158 INFO:tasks.workunit.client.1.smithi152.stdout:7/579: rename db/d1c/l2d to db/d27/d5e/lb6 0 2023-12-07T16:21:40.159 INFO:tasks.workunit.client.1.smithi152.stdout:7/580: chown db/d27/d39/d41/d37/f64 2583 1 2023-12-07T16:21:40.159 INFO:tasks.workunit.client.1.smithi152.stdout:7/581: truncate db/d1c/f9a 400535 0 2023-12-07T16:21:40.159 INFO:tasks.workunit.client.1.smithi152.stdout:8/657: rmdir d3/d4/d9/d34 39 2023-12-07T16:21:40.162 INFO:tasks.workunit.client.1.smithi152.stdout:3/596: write d7/d10/d1a/d2f/d5c/f7f [963952,104476] 0 2023-12-07T16:21:40.162 INFO:tasks.workunit.client.1.smithi152.stdout:3/597: chown d7/dc/d3e/d62/fb6 241702 1 2023-12-07T16:21:40.163 INFO:tasks.workunit.client.0.smithi063.stdout:1/310: link d0/dd/d10/d13/f3d d0/dd/f6d 0 2023-12-07T16:21:40.163 INFO:tasks.workunit.client.1.smithi152.stdout:9/693: truncate d1/d17/d3c/d4a/d48/f56 1802496 0 2023-12-07T16:21:40.163 INFO:tasks.workunit.client.0.smithi063.stdout:5/398: dwrite d1/f2a [0,4194304] 0 2023-12-07T16:21:40.163 INFO:tasks.workunit.client.0.smithi063.stdout:7/409: dwrite d2/d64/f8f [0,4194304] 0 2023-12-07T16:21:40.164 INFO:tasks.workunit.client.1.smithi152.stdout:6/629: truncate d2/d4f/d83/d85/d19/f22 973319 0 2023-12-07T16:21:40.164 INFO:tasks.workunit.client.1.smithi152.stdout:6/630: write d2/d4f/d83/d85/d94/fc2 [633439,99134] 0 2023-12-07T16:21:40.164 INFO:tasks.workunit.client.1.smithi152.stdout:1/783: dwrite dc/d14/d18/d2d/d4a/d52/f69 [0,4194304] 0 2023-12-07T16:21:40.164 INFO:tasks.workunit.client.1.smithi152.stdout:1/784: getdents dc/d28/d4e/de8/df0 0 2023-12-07T16:21:40.164 INFO:tasks.workunit.client.0.smithi063.stdout:1/311: symlink d0/dd/d10/d1b/d68/l6e 0 2023-12-07T16:21:40.165 INFO:tasks.workunit.client.0.smithi063.stdout:1/312: fdatasync d0/dd/f16 0 2023-12-07T16:21:40.165 INFO:tasks.workunit.client.0.smithi063.stdout:0/468: dwrite d4/dd/d26/f4f [0,4194304] 0 2023-12-07T16:21:40.165 INFO:tasks.workunit.client.1.smithi152.stdout:2/571: mknod d2/d1c/d2e/cc6 0 2023-12-07T16:21:40.168 INFO:tasks.workunit.client.1.smithi152.stdout:9/694: write d1/d9/db/d70/f98 [396122,79707] 0 2023-12-07T16:21:40.168 INFO:tasks.workunit.client.1.smithi152.stdout:9/695: fsync d1/d9/f2b 0 2023-12-07T16:21:40.168 INFO:tasks.workunit.client.1.smithi152.stdout:5/776: rename dd/l50 to dd/d91/l10d 0 2023-12-07T16:21:40.169 INFO:tasks.workunit.client.1.smithi152.stdout:5/777: chown dd/de/d14/dc6/db0/fe9 40074180 1 2023-12-07T16:21:40.169 INFO:tasks.workunit.client.1.smithi152.stdout:5/778: read - dd/de/d38/d3d/d6d/dae/de0/ffa zero size 2023-12-07T16:21:40.170 INFO:tasks.workunit.client.0.smithi063.stdout:5/399: creat d1/d3/de/d1e/d6b/f7d x:0 0 0 2023-12-07T16:21:40.170 INFO:tasks.workunit.client.0.smithi063.stdout:4/345: dread d1/d3/db/d13/f18 [0,4194304] 0 2023-12-07T16:21:40.170 INFO:tasks.workunit.client.0.smithi063.stdout:1/313: mkdir d0/dd/d10/d6f 0 2023-12-07T16:21:40.171 INFO:tasks.workunit.client.0.smithi063.stdout:4/346: symlink d1/d3/db/d16/l60 0 2023-12-07T16:21:40.172 INFO:tasks.workunit.client.1.smithi152.stdout:7/582: unlink db/d27/l62 0 2023-12-07T16:21:40.172 INFO:tasks.workunit.client.0.smithi063.stdout:8/587: dwrite d7/d14/d15/d48/fa4 [0,4194304] 0 2023-12-07T16:21:40.172 INFO:tasks.workunit.client.0.smithi063.stdout:1/314: symlink d0/dd/d4f/l70 0 2023-12-07T16:21:40.175 INFO:tasks.workunit.client.1.smithi152.stdout:4/554: dwrite d0/d3/d6/d2b/d56/f70 [0,4194304] 0 2023-12-07T16:21:40.175 INFO:tasks.workunit.client.1.smithi152.stdout:4/555: chown d0/d3/d6/d2b/d56 2862038 1 2023-12-07T16:21:40.176 INFO:tasks.workunit.client.1.smithi152.stdout:3/598: creat d7/dc/d3e/d62/d6d/fba x:0 0 0 2023-12-07T16:21:40.181 INFO:tasks.workunit.client.1.smithi152.stdout:6/631: getdents d2/d4f 0 2023-12-07T16:21:40.184 INFO:tasks.workunit.client.1.smithi152.stdout:1/785: creat dc/d14/d90/da9/df5/f104 x:0 0 0 2023-12-07T16:21:40.184 INFO:tasks.workunit.client.0.smithi063.stdout:8/588: creat d7/d14/fb3 x:0 0 0 2023-12-07T16:21:40.185 INFO:tasks.workunit.client.0.smithi063.stdout:1/315: rename d0/dd/d10/d1e to d0/dd/d19/d50/d71 0 2023-12-07T16:21:40.186 INFO:tasks.workunit.client.1.smithi152.stdout:2/572: mknod d2/d9/d51/d54/d5c/cc7 0 2023-12-07T16:21:40.190 INFO:tasks.workunit.client.1.smithi152.stdout:5/779: rename dd/de/d14/d19/d1a/d1b to dd/d91/dbe/d10e 0 2023-12-07T16:21:40.191 INFO:tasks.workunit.client.0.smithi063.stdout:8/589: rename d7/d14/d1a/d54/d7e to d7/d14/d15/db4 0 2023-12-07T16:21:40.192 INFO:tasks.workunit.client.1.smithi152.stdout:7/583: creat db/d68/d87/fb7 x:0 0 0 2023-12-07T16:21:40.196 INFO:tasks.workunit.client.1.smithi152.stdout:4/556: symlink d0/d3/d6/d36/d85/l9e 0 2023-12-07T16:21:40.196 INFO:tasks.workunit.client.1.smithi152.stdout:8/658: dwrite d3/d4/d9/d34/f42 [0,4194304] 0 2023-12-07T16:21:40.196 INFO:tasks.workunit.client.0.smithi063.stdout:8/590: write d7/d14/d1a/d54/f5b [247860,15461] 0 2023-12-07T16:21:40.196 INFO:tasks.workunit.client.0.smithi063.stdout:1/316: mkdir d0/dd/d19/d50/d72 0 2023-12-07T16:21:40.196 INFO:tasks.workunit.client.0.smithi063.stdout:1/317: truncate d0/dd/d1f/f4e 5322916 0 2023-12-07T16:21:40.197 INFO:tasks.workunit.client.1.smithi152.stdout:3/599: truncate d7/d10/d1a/d2f/d56/d57/faa 997628 0 2023-12-07T16:21:40.198 INFO:tasks.workunit.client.1.smithi152.stdout:3/600: write d7/d10/d1a/f72 [1227399,6725] 0 2023-12-07T16:21:40.198 INFO:tasks.workunit.client.1.smithi152.stdout:3/601: chown d7/dc/d3e/d7d/lb4 146332 1 2023-12-07T16:21:40.199 INFO:tasks.workunit.client.0.smithi063.stdout:1/318: creat d0/dd/d10/d46/f73 x:0 0 0 2023-12-07T16:21:40.199 INFO:tasks.workunit.client.1.smithi152.stdout:6/632: link d2/d4f/d83/d85/d19/d1f/dc7/dc9/fa3 d2/d4f/d83/d85/d19/d1f/d60/fcf 0 2023-12-07T16:21:40.200 INFO:tasks.workunit.client.0.smithi063.stdout:1/319: truncate d0/dd/d19/d50/d71/f31 2655603 0 2023-12-07T16:21:40.202 INFO:tasks.workunit.client.1.smithi152.stdout:2/573: creat d2/d1c/fc8 x:0 0 0 2023-12-07T16:21:40.202 INFO:tasks.workunit.client.1.smithi152.stdout:2/574: fdatasync d2/d56/da0/fa5 0 2023-12-07T16:21:40.202 INFO:tasks.workunit.client.0.smithi063.stdout:0/469: dwrite d4/dd/d26/f4f [0,4194304] 0 2023-12-07T16:21:40.202 INFO:tasks.workunit.client.0.smithi063.stdout:4/347: rmdir d1/d3/db 39 2023-12-07T16:21:40.202 INFO:tasks.workunit.client.0.smithi063.stdout:4/348: chown d1/d3/db/d16/c21 9783274 1 2023-12-07T16:21:40.203 INFO:tasks.workunit.client.0.smithi063.stdout:5/400: dwrite d1/d3/de/d1e/d6b/f7d [0,4194304] 0 2023-12-07T16:21:40.203 INFO:tasks.workunit.client.0.smithi063.stdout:5/401: readlink d1/l52 0 2023-12-07T16:21:40.204 INFO:tasks.workunit.client.1.smithi152.stdout:9/696: dwrite d1/d9/d2d/d65/fbb [0,4194304] 0 2023-12-07T16:21:40.204 INFO:tasks.workunit.client.1.smithi152.stdout:9/697: readlink d1/d9/db/df/l54 0 2023-12-07T16:21:40.204 INFO:tasks.workunit.client.1.smithi152.stdout:9/698: truncate d1/d9/db/df/fbd 614011 0 2023-12-07T16:21:40.204 INFO:tasks.workunit.client.1.smithi152.stdout:7/584: creat db/d27/d39/d63/fb8 x:0 0 0 2023-12-07T16:21:40.205 INFO:tasks.workunit.client.0.smithi063.stdout:0/470: mkdir d4/dd/de/d15/d52/d5b/d63/d9b 0 2023-12-07T16:21:40.206 INFO:tasks.workunit.client.1.smithi152.stdout:4/557: creat d0/d3/d6/d2b/d75/f9f x:0 0 0 2023-12-07T16:21:40.206 INFO:tasks.workunit.client.1.smithi152.stdout:4/558: write d0/d3/d6/d36/d85/f94 [183362,25683] 0 2023-12-07T16:21:40.207 INFO:tasks.workunit.client.0.smithi063.stdout:4/349: link d1/d3/d3f/d44/f4c d1/d3/d3f/d49/f61 0 2023-12-07T16:21:40.208 INFO:tasks.workunit.client.1.smithi152.stdout:0/617: sync 2023-12-07T16:21:40.210 INFO:tasks.workunit.client.0.smithi063.stdout:0/471: getdents d4/dd/d26/d2b 0 2023-12-07T16:21:40.210 INFO:tasks.workunit.client.1.smithi152.stdout:8/659: creat d3/d1e/d55/fe9 x:0 0 0 2023-12-07T16:21:40.211 INFO:tasks.workunit.client.1.smithi152.stdout:5/780: getdents dd/de/d14/d19/da3/ddf 0 2023-12-07T16:21:40.211 INFO:tasks.workunit.client.1.smithi152.stdout:4/559: write d0/d3/d6/dc/d39/d93/f6c [1702004,77097] 0 2023-12-07T16:21:40.212 INFO:tasks.workunit.client.0.smithi063.stdout:4/350: mkdir d1/d3/db/d13/d62 0 2023-12-07T16:21:40.212 INFO:tasks.workunit.client.0.smithi063.stdout:4/351: readlink d1/d3/db/d2c/l40 0 2023-12-07T16:21:40.213 INFO:tasks.workunit.client.0.smithi063.stdout:0/472: write d4/dd/de/f20 [3062551,12446] 0 2023-12-07T16:21:40.213 INFO:tasks.workunit.client.0.smithi063.stdout:0/473: chown d4/dd/de/d15/d52/d5b/d63/d6b/f89 7551 1 2023-12-07T16:21:40.214 INFO:tasks.workunit.client.1.smithi152.stdout:3/602: link d7/c64 d7/d10/d1a/d25/d78/cbb 0 2023-12-07T16:21:40.214 INFO:tasks.workunit.client.1.smithi152.stdout:3/603: dread - d7/dc/d3e/d6b/d80/da2/fb3 zero size 2023-12-07T16:21:40.215 INFO:tasks.workunit.client.0.smithi063.stdout:0/474: rmdir d4/dd/de 39 2023-12-07T16:21:40.216 INFO:tasks.workunit.client.1.smithi152.stdout:6/633: rename d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/cb9 to d2/d4f/d83/d48/da8/cd0 0 2023-12-07T16:21:40.216 INFO:tasks.workunit.client.1.smithi152.stdout:6/634: chown d2/f5 0 1 2023-12-07T16:21:40.216 INFO:tasks.workunit.client.1.smithi152.stdout:6/635: chown d2/d4f/d83/f99 102 1 2023-12-07T16:21:40.217 INFO:tasks.workunit.client.1.smithi152.stdout:6/636: read d2/f2a [2892923,83687] 0 2023-12-07T16:21:40.217 INFO:tasks.workunit.client.1.smithi152.stdout:1/786: dwrite dc/fd [4194304,4194304] 0 2023-12-07T16:21:40.218 INFO:tasks.workunit.client.1.smithi152.stdout:1/787: truncate dc/d14/f84 632301 0 2023-12-07T16:21:40.218 INFO:tasks.workunit.client.0.smithi063.stdout:0/475: dread d4/dd/de/d15/f3d [0,4194304] 0 2023-12-07T16:21:40.218 INFO:tasks.workunit.client.1.smithi152.stdout:1/788: read dc/d14/d18/f70 [2454272,96738] 0 2023-12-07T16:21:40.221 INFO:tasks.workunit.client.1.smithi152.stdout:2/575: unlink d2/d1c/d2e/d5d/fc1 0 2023-12-07T16:21:40.221 INFO:tasks.workunit.client.1.smithi152.stdout:2/576: stat d2/d1c/d2e/d30/d33/c2c 0 2023-12-07T16:21:40.222 INFO:tasks.workunit.client.0.smithi063.stdout:0/476: getdents d4/dd/de/d15/d59 0 2023-12-07T16:21:40.222 INFO:tasks.workunit.client.0.smithi063.stdout:0/477: fsync d4/dd/f44 0 2023-12-07T16:21:40.224 INFO:tasks.workunit.client.0.smithi063.stdout:0/478: link d4/d25/f4b d4/dd/d26/d2b/d5e/d8e/f9c 0 2023-12-07T16:21:40.224 INFO:tasks.workunit.client.0.smithi063.stdout:0/479: stat d4/dd/de/d15/d1f/d4c/f34 0 2023-12-07T16:21:40.225 INFO:tasks.workunit.client.1.smithi152.stdout:9/699: mkdir d1/d9/db/df/d42/de8 0 2023-12-07T16:21:40.225 INFO:tasks.workunit.client.1.smithi152.stdout:7/585: creat db/d27/d39/fb9 x:0 0 0 2023-12-07T16:21:40.225 INFO:tasks.workunit.client.1.smithi152.stdout:0/618: chown d0/d2f/l55 126966 1 2023-12-07T16:21:40.225 INFO:tasks.workunit.client.0.smithi063.stdout:0/480: symlink d4/dd/de/d15/d52/d5b/d63/d9b/l9d 0 2023-12-07T16:21:40.225 INFO:tasks.workunit.client.0.smithi063.stdout:0/481: readlink d4/dd/de/d15/d59/d43/l75 0 2023-12-07T16:21:40.228 INFO:tasks.workunit.client.0.smithi063.stdout:1/320: dwrite d0/dd/d10/d13/f60 [0,4194304] 0 2023-12-07T16:21:40.228 INFO:tasks.workunit.client.0.smithi063.stdout:1/321: write d0/dd/d19/d50/d71/f52 [2740558,52034] 0 2023-12-07T16:21:40.228 INFO:tasks.workunit.client.0.smithi063.stdout:8/591: dwrite d7/d14/d15/db4/f88 [0,4194304] 0 2023-12-07T16:21:40.228 INFO:tasks.workunit.client.0.smithi063.stdout:8/592: stat d7/d14/d15/dac 0 2023-12-07T16:21:40.229 INFO:tasks.workunit.client.1.smithi152.stdout:5/781: symlink dd/de/d14/d1f/l10f 0 2023-12-07T16:21:40.229 INFO:tasks.workunit.client.1.smithi152.stdout:4/560: creat d0/d81/fa0 x:0 0 0 2023-12-07T16:21:40.230 INFO:tasks.workunit.client.1.smithi152.stdout:3/604: creat d7/d10/d1a/d25/d78/fbc x:0 0 0 2023-12-07T16:21:40.230 INFO:tasks.workunit.client.1.smithi152.stdout:3/605: write d7/dc/d3e/f5e [407723,99348] 0 2023-12-07T16:21:40.232 INFO:tasks.workunit.client.1.smithi152.stdout:1/789: truncate dc/f36 119410 0 2023-12-07T16:21:40.233 INFO:tasks.workunit.client.0.smithi063.stdout:1/322: creat d0/dd/d10/d1b/f74 x:0 0 0 2023-12-07T16:21:40.234 INFO:tasks.workunit.client.1.smithi152.stdout:2/577: symlink d2/d56/da0/lc9 0 2023-12-07T16:21:40.236 INFO:tasks.workunit.client.0.smithi063.stdout:4/352: rename d1/d3/db/d13 to d1/d3/db/d2c/d63 0 2023-12-07T16:21:40.236 INFO:tasks.workunit.client.0.smithi063.stdout:4/353: write d1/d3/d3f/d49/f61 [806152,93265] 0 2023-12-07T16:21:40.236 INFO:tasks.workunit.client.0.smithi063.stdout:4/354: chown d1/d3/d3f/d49/f61 11536 1 2023-12-07T16:21:40.236 INFO:tasks.workunit.client.0.smithi063.stdout:4/355: chown d1/d3 17 1 2023-12-07T16:21:40.237 INFO:tasks.workunit.client.1.smithi152.stdout:9/700: mkdir d1/d9/db/df/da6/da2/de9 0 2023-12-07T16:21:40.239 INFO:tasks.workunit.client.1.smithi152.stdout:7/586: rename db/c40 to db/d27/d5e/cba 0 2023-12-07T16:21:40.239 INFO:tasks.workunit.client.1.smithi152.stdout:7/587: chown db/d1c 1430399 1 2023-12-07T16:21:40.239 INFO:tasks.workunit.client.0.smithi063.stdout:1/323: mkdir d0/dd/d1f/d75 0 2023-12-07T16:21:40.239 INFO:tasks.workunit.client.0.smithi063.stdout:8/593: mknod d7/d38/cb5 0 2023-12-07T16:21:40.239 INFO:tasks.workunit.client.0.smithi063.stdout:0/482: rename d4/dd/f4e to d4/d25/f9e 0 2023-12-07T16:21:40.241 INFO:tasks.workunit.client.0.smithi063.stdout:1/324: symlink d0/dd/d10/d13/l76 0 2023-12-07T16:21:40.241 INFO:tasks.workunit.client.1.smithi152.stdout:8/660: link d3/da7/laa d3/d4/d9/d23/d4c/da6/db2/dc3/lea 0 2023-12-07T16:21:40.244 INFO:tasks.workunit.client.0.smithi063.stdout:0/483: mknod d4/dd/de/d15/d1f/d22/c9f 0 2023-12-07T16:21:40.245 INFO:tasks.workunit.client.0.smithi063.stdout:8/594: dread d7/d14/f9e [0,4194304] 0 2023-12-07T16:21:40.247 INFO:tasks.workunit.client.1.smithi152.stdout:0/619: dwrite d0/d2f/f74 [0,4194304] 0 2023-12-07T16:21:40.247 INFO:tasks.workunit.client.1.smithi152.stdout:0/620: write d0/d2f/fd1 [875131,80750] 0 2023-12-07T16:21:40.260 INFO:tasks.workunit.client.0.smithi063.stdout:0/484: rmdir d4/dd/d26/d2b/d5e/d8e 39 2023-12-07T16:21:40.261 INFO:tasks.workunit.client.0.smithi063.stdout:8/595: mkdir d7/db6 0 2023-12-07T16:21:40.261 INFO:tasks.workunit.client.0.smithi063.stdout:0/485: rmdir d4/dd/d26/d2b 39 2023-12-07T16:21:40.263 INFO:tasks.workunit.client.0.smithi063.stdout:0/486: read d4/d25/f4b [40938,54466] 0 2023-12-07T16:21:40.264 INFO:tasks.workunit.client.0.smithi063.stdout:0/487: getdents d4/dd/d26 0 2023-12-07T16:21:40.264 INFO:tasks.workunit.client.0.smithi063.stdout:0/488: fsync d4/dd/de/d15/f8c 0 2023-12-07T16:21:40.265 INFO:tasks.workunit.client.0.smithi063.stdout:0/489: mknod d4/dd/d26/d2b/ca0 0 2023-12-07T16:21:40.267 INFO:tasks.workunit.client.0.smithi063.stdout:0/490: getdents d4/dd/de 0 2023-12-07T16:21:40.282 INFO:tasks.workunit.client.1.smithi152.stdout:4/561: creat d0/d3/d6/d2b/fa1 x:0 0 0 2023-12-07T16:21:40.283 INFO:tasks.workunit.client.1.smithi152.stdout:3/606: mknod d7/dc/d3e/d48/cbd 0 2023-12-07T16:21:40.286 INFO:tasks.workunit.client.1.smithi152.stdout:2/578: creat d2/d9/d51/d54/fca x:0 0 0 2023-12-07T16:21:40.287 INFO:tasks.workunit.client.1.smithi152.stdout:9/701: mknod d1/d9/d4f/cea 0 2023-12-07T16:21:40.290 INFO:tasks.workunit.client.1.smithi152.stdout:5/782: rename dd/de/d14/d1f/d49/ld5 to dd/de/d14/d19/d1a/def/l110 0 2023-12-07T16:21:40.290 INFO:tasks.workunit.client.1.smithi152.stdout:2/579: fsync d2/d1c/fc8 0 2023-12-07T16:21:40.291 INFO:tasks.workunit.client.1.smithi152.stdout:8/661: creat d3/d4/d9/dc/feb x:0 0 0 2023-12-07T16:21:40.291 INFO:tasks.workunit.client.1.smithi152.stdout:8/662: write d3/fdf [810884,37724] 0 2023-12-07T16:21:40.294 INFO:tasks.workunit.client.1.smithi152.stdout:0/621: symlink d0/dc/d3d/d73/dbf/ld3 0 2023-12-07T16:21:40.295 INFO:tasks.workunit.client.1.smithi152.stdout:3/607: mkdir d7/dc/d3e/d48/dbe 0 2023-12-07T16:21:40.300 INFO:tasks.workunit.client.1.smithi152.stdout:9/702: link d1/d17/l92 d1/d17/d3c/d4a/leb 0 2023-12-07T16:21:40.300 INFO:tasks.workunit.client.1.smithi152.stdout:1/790: rename dc/d14/d18/d2d/d4a/le3 to dc/d14/d18/d2d/d48/da3/d58/dde/l105 0 2023-12-07T16:21:40.300 INFO:tasks.workunit.client.0.smithi063.stdout:4/356: dwrite d1/d3/db/d2c/d63/f18 [0,4194304] 0 2023-12-07T16:21:40.302 INFO:tasks.workunit.client.1.smithi152.stdout:5/783: mknod dd/de/d14/d19/da3/ddf/c111 0 2023-12-07T16:21:40.304 INFO:tasks.workunit.client.0.smithi063.stdout:4/357: mkdir d1/d3/d3f/d49/d64 0 2023-12-07T16:21:40.304 INFO:tasks.workunit.client.0.smithi063.stdout:1/325: dwrite d0/dd/f39 [4194304,4194304] 0 2023-12-07T16:21:40.304 INFO:tasks.workunit.client.0.smithi063.stdout:1/326: chown d0/dd/d55/c57 166 1 2023-12-07T16:21:40.305 INFO:tasks.workunit.client.1.smithi152.stdout:3/608: mkdir d7/d10/d1a/d2f/d5c/dbf 0 2023-12-07T16:21:40.305 INFO:tasks.workunit.client.1.smithi152.stdout:3/609: stat d7/dc 0 2023-12-07T16:21:40.305 INFO:tasks.workunit.client.1.smithi152.stdout:3/610: fsync d7/d10/d1a/d25/d4b/fa4 0 2023-12-07T16:21:40.305 INFO:tasks.workunit.client.1.smithi152.stdout:7/588: dwrite db/d27/d39/f22 [0,4194304] 0 2023-12-07T16:21:40.307 INFO:tasks.workunit.client.1.smithi152.stdout:0/622: rename d0/c39 to d0/d2f/d30/d6e/d77/cd4 0 2023-12-07T16:21:40.308 INFO:tasks.workunit.client.0.smithi063.stdout:4/358: link d1/d3/d3f/d49/f5e d1/d3/d51/f65 0 2023-12-07T16:21:40.308 INFO:tasks.workunit.client.0.smithi063.stdout:1/327: write d0/dd/d19/d50/d71/f31 [147449,82882] 0 2023-12-07T16:21:40.309 INFO:tasks.workunit.client.0.smithi063.stdout:1/328: write d0/dd/d19/d50/d71/f2e [1950647,46853] 0 2023-12-07T16:21:40.314 INFO:tasks.workunit.client.0.smithi063.stdout:1/329: mknod d0/dd/d55/c77 0 2023-12-07T16:21:40.314 INFO:tasks.workunit.client.0.smithi063.stdout:1/330: fdatasync d0/dd/d19/d50/d71/f64 0 2023-12-07T16:21:40.315 INFO:tasks.workunit.client.0.smithi063.stdout:1/331: dread - d0/dd/d19/d50/d71/f64 zero size 2023-12-07T16:21:40.315 INFO:tasks.workunit.client.0.smithi063.stdout:1/332: chown d0/dd/d10/d46 994 1 2023-12-07T16:21:40.315 INFO:tasks.workunit.client.0.smithi063.stdout:8/596: dwrite d7/d14/d15/d2b/fae [0,4194304] 0 2023-12-07T16:21:40.315 INFO:tasks.workunit.client.1.smithi152.stdout:0/623: mknod d0/dc/d3d/dab/cd5 0 2023-12-07T16:21:40.315 INFO:tasks.workunit.client.1.smithi152.stdout:3/611: unlink d7/dc/d3e/d48/f97 0 2023-12-07T16:21:40.315 INFO:tasks.workunit.client.1.smithi152.stdout:7/589: write db/d68/d87/f8c [3708380,105686] 0 2023-12-07T16:21:40.315 INFO:tasks.workunit.client.1.smithi152.stdout:3/612: readlink d7/dc/d3e/d62/d6d/d84/l9d 0 2023-12-07T16:21:40.315 INFO:tasks.workunit.client.1.smithi152.stdout:7/590: stat db/d27/d4d/f69 0 2023-12-07T16:21:40.316 INFO:tasks.workunit.client.1.smithi152.stdout:3/613: dread - d7/dc/d14/f87 zero size 2023-12-07T16:21:40.316 INFO:tasks.workunit.client.1.smithi152.stdout:0/624: write d0/f9 [1353629,128375] 0 2023-12-07T16:21:40.316 INFO:tasks.workunit.client.1.smithi152.stdout:0/625: stat d0/d27/l2a 0 2023-12-07T16:21:40.316 INFO:tasks.workunit.client.1.smithi152.stdout:1/791: dread dc/d14/d18/d2d/d4a/d52/f69 [0,4194304] 0 2023-12-07T16:21:40.316 INFO:tasks.workunit.client.1.smithi152.stdout:7/591: link db/d27/fa7 db/d27/d5e/d45/fbb 0 2023-12-07T16:21:40.317 INFO:tasks.workunit.client.1.smithi152.stdout:7/592: fdatasync db/d27/d39/f9f 0 2023-12-07T16:21:40.317 INFO:tasks.workunit.client.1.smithi152.stdout:7/593: write db/d27/f9d [43173,115283] 0 2023-12-07T16:21:40.317 INFO:tasks.workunit.client.0.smithi063.stdout:8/597: unlink d7/d38/l5e 0 2023-12-07T16:21:40.318 INFO:tasks.workunit.client.1.smithi152.stdout:3/614: mkdir d7/d10/d1a/dc0 0 2023-12-07T16:21:40.321 INFO:tasks.workunit.client.1.smithi152.stdout:1/792: rmdir dc/d14/d18/d2d/d4a 39 2023-12-07T16:21:40.322 INFO:tasks.workunit.client.1.smithi152.stdout:2/580: dwrite d2/d1c/d2e/d30/d42/f92 [4194304,4194304] 0 2023-12-07T16:21:40.323 INFO:tasks.workunit.client.1.smithi152.stdout:7/594: creat db/d68/fbc x:0 0 0 2023-12-07T16:21:40.323 INFO:tasks.workunit.client.1.smithi152.stdout:7/595: fsync db/d27/d4d/fb0 0 2023-12-07T16:21:40.324 INFO:tasks.workunit.client.1.smithi152.stdout:1/793: rename dc/d28/d7d/da4/fb0 to dc/d14/d90/da9/df5/f106 0 2023-12-07T16:21:40.325 INFO:tasks.workunit.client.1.smithi152.stdout:1/794: symlink dc/d28/d4e/de8/l107 0 2023-12-07T16:21:40.325 INFO:tasks.workunit.client.1.smithi152.stdout:1/795: chown dc/d14/d18/d2d/d48/l6c 1004 1 2023-12-07T16:21:40.326 INFO:tasks.workunit.client.1.smithi152.stdout:7/596: dread db/d27/d39/d41/d58/f59 [0,4194304] 0 2023-12-07T16:21:40.326 INFO:tasks.workunit.client.1.smithi152.stdout:7/597: readlink db/d27/d39/l2a 0 2023-12-07T16:21:40.326 INFO:tasks.workunit.client.1.smithi152.stdout:7/598: chown db/d1c/f51 18698243 1 2023-12-07T16:21:40.331 INFO:tasks.workunit.client.1.smithi152.stdout:8/663: dwrite d3/d4/d9/d23/f45 [0,4194304] 0 2023-12-07T16:21:40.332 INFO:tasks.workunit.client.1.smithi152.stdout:1/796: unlink dc/d14/l24 0 2023-12-07T16:21:40.335 INFO:tasks.workunit.client.1.smithi152.stdout:1/797: symlink dc/l108 0 2023-12-07T16:21:40.337 INFO:tasks.workunit.client.1.smithi152.stdout:1/798: creat dc/d14/d90/dbb/f109 x:0 0 0 2023-12-07T16:21:40.337 INFO:tasks.workunit.client.1.smithi152.stdout:1/799: fsync dc/f63 0 2023-12-07T16:21:40.338 INFO:tasks.workunit.client.1.smithi152.stdout:1/800: symlink dc/d14/d18/d2d/d9c/db2/l10a 0 2023-12-07T16:21:40.338 INFO:tasks.workunit.client.1.smithi152.stdout:5/784: dwrite dd/de/d17/f33 [0,4194304] 0 2023-12-07T16:21:40.339 INFO:tasks.workunit.client.1.smithi152.stdout:9/703: dwrite d1/d9/d2d/f96 [0,4194304] 0 2023-12-07T16:21:40.339 INFO:tasks.workunit.client.1.smithi152.stdout:1/801: unlink dc/d14/d18/d64/l66 0 2023-12-07T16:21:40.340 INFO:tasks.workunit.client.1.smithi152.stdout:1/802: truncate dc/d14/d18/d79/d86/db7/fd0 519553 0 2023-12-07T16:21:40.341 INFO:tasks.workunit.client.0.smithi063.stdout:4/359: rmdir d1/d3/d3f/d49 39 2023-12-07T16:21:40.343 INFO:tasks.workunit.client.1.smithi152.stdout:5/785: rmdir dd/de/d38/d3d/dd3 39 2023-12-07T16:21:40.344 INFO:tasks.workunit.client.0.smithi063.stdout:1/333: dread d0/dd/f6d [0,4194304] 0 2023-12-07T16:21:40.346 INFO:tasks.workunit.client.1.smithi152.stdout:9/704: rmdir d1/d17/d4e 39 2023-12-07T16:21:40.346 INFO:tasks.workunit.client.0.smithi063.stdout:1/334: mknod d0/dd/d10/c78 0 2023-12-07T16:21:40.347 INFO:tasks.workunit.client.1.smithi152.stdout:1/803: unlink dc/d14/d18/d2d/c7b 0 2023-12-07T16:21:40.347 INFO:tasks.workunit.client.0.smithi063.stdout:1/335: mkdir d0/dd/d10/d13/d2f/d79 0 2023-12-07T16:21:40.347 INFO:tasks.workunit.client.1.smithi152.stdout:5/786: mkdir dd/de/d38/d3d/d6d/dae/d112 0 2023-12-07T16:21:40.348 INFO:tasks.workunit.client.0.smithi063.stdout:1/336: creat d0/dd/d10/d6f/f7a x:0 0 0 2023-12-07T16:21:40.348 INFO:tasks.workunit.client.0.smithi063.stdout:1/337: chown d0/dd/f41 112332 1 2023-12-07T16:21:40.348 INFO:tasks.workunit.client.0.smithi063.stdout:1/338: chown d0/dd/d1f/c23 1020612038 1 2023-12-07T16:21:40.351 INFO:tasks.workunit.client.1.smithi152.stdout:1/804: mknod dc/d14/d18/d64/c10b 0 2023-12-07T16:21:40.351 INFO:tasks.workunit.client.1.smithi152.stdout:1/805: truncate dc/d14/d18/d64/faf 971114 0 2023-12-07T16:21:40.353 INFO:tasks.workunit.client.1.smithi152.stdout:9/705: symlink d1/d17/d58/lec 0 2023-12-07T16:21:40.354 INFO:tasks.workunit.client.1.smithi152.stdout:1/806: truncate dc/d14/d18/d79/d86/db7/fc6 3466473 0 2023-12-07T16:21:40.355 INFO:tasks.workunit.client.1.smithi152.stdout:1/807: write dc/d28/f5e [627820,55178] 0 2023-12-07T16:21:40.356 INFO:tasks.workunit.client.1.smithi152.stdout:9/706: creat d1/d9/db/fed x:0 0 0 2023-12-07T16:21:40.356 INFO:tasks.workunit.client.1.smithi152.stdout:9/707: write d1/d9/d4f/fc4 [673296,100147] 0 2023-12-07T16:21:40.359 INFO:tasks.workunit.client.1.smithi152.stdout:5/787: dread dd/de/d14/f3f [0,4194304] 0 2023-12-07T16:21:40.364 INFO:tasks.workunit.client.1.smithi152.stdout:3/615: dwrite d7/d10/d1a/d2f/f18 [0,4194304] 0 2023-12-07T16:21:40.364 INFO:tasks.workunit.client.1.smithi152.stdout:3/616: fsync d7/d10/d1a/d25/d3f/f46 0 2023-12-07T16:21:40.364 INFO:tasks.workunit.client.1.smithi152.stdout:3/617: fsync d7/d10/d1a/d2f/f1d 0 2023-12-07T16:21:40.367 INFO:tasks.workunit.client.0.smithi063.stdout:8/598: dwrite d7/d38/d8e/fa9 [0,4194304] 0 2023-12-07T16:21:40.368 INFO:tasks.workunit.client.1.smithi152.stdout:3/618: write d7/dc/d3e/d62/d6d/d84/f85 [1357198,124691] 0 2023-12-07T16:21:40.372 INFO:tasks.workunit.client.1.smithi152.stdout:1/808: dread dc/d28/d4e/f61 [0,4194304] 0 2023-12-07T16:21:40.372 INFO:tasks.workunit.client.1.smithi152.stdout:3/619: creat d7/d10/d1a/fc1 x:0 0 0 2023-12-07T16:21:40.372 INFO:tasks.workunit.client.0.smithi063.stdout:8/599: read d7/d14/d15/d48/f58 [897729,8399] 0 2023-12-07T16:21:40.373 INFO:tasks.workunit.client.0.smithi063.stdout:8/600: truncate d7/d14/d15/d48/fa4 2610918 0 2023-12-07T16:21:40.373 INFO:tasks.workunit.client.0.smithi063.stdout:8/601: chown d7/d14/d15/d2b/d40/d63/c9c 1175 1 2023-12-07T16:21:40.374 INFO:tasks.workunit.client.1.smithi152.stdout:1/809: link dc/d14/d18/d2d/d4a/d52/f69 dc/d14/d18/d2d/f10c 0 2023-12-07T16:21:40.375 INFO:tasks.workunit.client.0.smithi063.stdout:8/602: mknod d7/d14/d15/d2b/d40/da8/cb7 0 2023-12-07T16:21:40.377 INFO:tasks.workunit.client.1.smithi152.stdout:8/664: dwrite d3/d4/d9/dad/fdc [0,4194304] 0 2023-12-07T16:21:40.377 INFO:tasks.workunit.client.1.smithi152.stdout:8/665: dread - d3/d4/d9/dc/d6f/d7a/d8a/d63/fd1 zero size 2023-12-07T16:21:40.377 INFO:tasks.workunit.client.1.smithi152.stdout:8/666: stat d3/d4/f35 0 2023-12-07T16:21:40.377 INFO:tasks.workunit.client.1.smithi152.stdout:0/626: dwrite d0/d27/f59 [0,4194304] 0 2023-12-07T16:21:40.385 INFO:tasks.workunit.client.1.smithi152.stdout:8/667: link d3/d4/d9/dc/d6f/d7a/fa8 d3/fec 0 2023-12-07T16:21:40.385 INFO:tasks.workunit.client.1.smithi152.stdout:0/627: creat d0/d27/d11/d68/fd6 x:0 0 0 2023-12-07T16:21:40.385 INFO:tasks.workunit.client.0.smithi063.stdout:4/360: dwrite d1/d3/d3f/d49/f61 [0,4194304] 0 2023-12-07T16:21:40.386 INFO:tasks.workunit.client.1.smithi152.stdout:8/668: mknod d3/d4/d9/dc/d6f/d7a/d8a/ced 0 2023-12-07T16:21:40.386 INFO:tasks.workunit.client.1.smithi152.stdout:8/669: chown d3/d1e/d55/d83/dc5 3534893 1 2023-12-07T16:21:40.388 INFO:tasks.workunit.client.1.smithi152.stdout:8/670: creat d3/d1e/d55/d83/dc5/fee x:0 0 0 2023-12-07T16:21:40.389 INFO:tasks.workunit.client.1.smithi152.stdout:8/671: creat d3/d1e/d55/d83/dae/fef x:0 0 0 2023-12-07T16:21:40.392 INFO:tasks.workunit.client.1.smithi152.stdout:8/672: mkdir d3/d1e/d55/d83/dc5/df0 0 2023-12-07T16:21:40.394 INFO:tasks.workunit.client.1.smithi152.stdout:8/673: creat d3/d1e/d55/d83/dde/ff1 x:0 0 0 2023-12-07T16:21:40.396 INFO:tasks.workunit.client.0.smithi063.stdout:4/361: dread d1/d3/db/f20 [0,4194304] 0 2023-12-07T16:21:40.396 INFO:tasks.workunit.client.0.smithi063.stdout:4/362: truncate d1/d3/d51/f65 774843 0 2023-12-07T16:21:40.396 INFO:tasks.workunit.client.0.smithi063.stdout:4/363: write d1/d3/db/f4f [92396,92396] 0 2023-12-07T16:21:40.401 INFO:tasks.workunit.client.1.smithi152.stdout:8/674: write d3/d4/d9/d23/f45 [3950462,78474] 0 2023-12-07T16:21:40.402 INFO:tasks.workunit.client.1.smithi152.stdout:8/675: rename d3/d4/d9/d23/d4c/c75 to d3/d1e/cf2 0 2023-12-07T16:21:40.402 INFO:tasks.workunit.client.1.smithi152.stdout:8/676: dread - d3/d1e/d55/d83/dc5/fee zero size 2023-12-07T16:21:40.402 INFO:tasks.workunit.client.1.smithi152.stdout:8/677: truncate d3/d1e/d55/fe9 108032 0 2023-12-07T16:21:40.403 INFO:tasks.workunit.client.1.smithi152.stdout:8/678: mkdir d3/d4/d9/dad/db3/df3 0 2023-12-07T16:21:40.408 INFO:tasks.workunit.client.0.smithi063.stdout:4/364: dread d1/d3/d3f/d49/f61 [0,4194304] 0 2023-12-07T16:21:40.408 INFO:tasks.workunit.client.0.smithi063.stdout:4/365: fsync d1/d3/db/f56 0 2023-12-07T16:21:40.412 INFO:tasks.workunit.client.0.smithi063.stdout:1/339: dwrite d0/dd/d1f/f5b [0,4194304] 0 2023-12-07T16:21:40.412 INFO:tasks.workunit.client.0.smithi063.stdout:1/340: truncate d0/dd/d10/d1b/f67 289234 0 2023-12-07T16:21:40.413 INFO:tasks.workunit.client.1.smithi152.stdout:9/708: dwrite d1/d9/db/df/d42/fbe [0,4194304] 0 2023-12-07T16:21:40.413 INFO:tasks.workunit.client.1.smithi152.stdout:3/620: dwrite d7/dc/d3e/d62/d6d/f73 [0,4194304] 0 2023-12-07T16:21:40.413 INFO:tasks.workunit.client.1.smithi152.stdout:5/788: dwrite dd/de/d14/d1f/f20 [0,4194304] 0 2023-12-07T16:21:40.413 INFO:tasks.workunit.client.1.smithi152.stdout:5/789: dread - dd/d91/dbe/d10e/f104 zero size 2023-12-07T16:21:40.413 INFO:tasks.workunit.client.1.smithi152.stdout:1/810: dwrite dc/d14/d18/d79/d86/db7/fd0 [0,4194304] 0 2023-12-07T16:21:40.416 INFO:tasks.workunit.client.1.smithi152.stdout:8/679: dread d3/d4/d9/dc/d6f/d7a/d8a/f31 [0,4194304] 0 2023-12-07T16:21:40.416 INFO:tasks.workunit.client.1.smithi152.stdout:0/628: dwrite d0/d2f/d30/d6e/d77/fa6 [0,4194304] 0 2023-12-07T16:21:40.417 INFO:tasks.workunit.client.0.smithi063.stdout:1/341: mknod d0/dd/d19/c7b 0 2023-12-07T16:21:40.418 INFO:tasks.workunit.client.1.smithi152.stdout:5/790: mkdir dd/d91/dbe/d10e/d113 0 2023-12-07T16:21:40.418 INFO:tasks.workunit.client.1.smithi152.stdout:9/709: write d1/d9/d2d/d65/f73 [3203660,116492] 0 2023-12-07T16:21:40.423 INFO:tasks.workunit.client.0.smithi063.stdout:1/342: creat d0/dd/d10/d13/d2f/f7c x:0 0 0 2023-12-07T16:21:40.423 INFO:tasks.workunit.client.1.smithi152.stdout:1/811: rename dc/c3e to dc/d14/d90/da9/c10d 0 2023-12-07T16:21:40.423 INFO:tasks.workunit.client.1.smithi152.stdout:1/812: write dc/d14/d18/d2d/f33 [5184141,52178] 0 2023-12-07T16:21:40.424 INFO:tasks.workunit.client.0.smithi063.stdout:4/366: dread d1/d3/db/d2c/d63/f39 [0,4194304] 0 2023-12-07T16:21:40.424 INFO:tasks.workunit.client.0.smithi063.stdout:8/603: fsync d7/d14/d15/d48/fa4 0 2023-12-07T16:21:40.425 INFO:tasks.workunit.client.1.smithi152.stdout:3/621: dread d7/dc/d3e/d7d/f99 [0,4194304] 0 2023-12-07T16:21:40.425 INFO:tasks.workunit.client.1.smithi152.stdout:3/622: chown d7/d10/d41/d61 418 1 2023-12-07T16:21:40.425 INFO:tasks.workunit.client.1.smithi152.stdout:3/623: chown d7/d10/d1a/fc1 229 1 2023-12-07T16:21:40.426 INFO:tasks.workunit.client.0.smithi063.stdout:8/604: rename d7/d14/d1a/f89 to d7/d14/d15/d57/fb8 0 2023-12-07T16:21:40.426 INFO:tasks.workunit.client.0.smithi063.stdout:8/605: fdatasync d7/d14/d15/db4/f88 0 2023-12-07T16:21:40.426 INFO:tasks.workunit.client.0.smithi063.stdout:8/606: stat d7/d14/d15/d2b/d40/d63/l9b 0 2023-12-07T16:21:40.428 INFO:tasks.workunit.client.0.smithi063.stdout:1/343: dread d0/dd/d10/d1b/f51 [0,4194304] 0 2023-12-07T16:21:40.428 INFO:tasks.workunit.client.0.smithi063.stdout:1/344: chown d0/c5c 362776406 1 2023-12-07T16:21:40.428 INFO:tasks.workunit.client.0.smithi063.stdout:1/345: write d0/dd/d10/f62 [1026869,54204] 0 2023-12-07T16:21:40.428 INFO:tasks.workunit.client.0.smithi063.stdout:1/346: getdents d0/dd/d10/d13/d2f/d79 0 2023-12-07T16:21:40.428 INFO:tasks.workunit.client.0.smithi063.stdout:8/607: write d7/d14/f4f [266391,29513] 0 2023-12-07T16:21:40.428 INFO:tasks.workunit.client.0.smithi063.stdout:8/608: readlink d7/d38/l3f 0 2023-12-07T16:21:40.428 INFO:tasks.workunit.client.0.smithi063.stdout:8/609: chown d7/d14/d15/l52 2 1 2023-12-07T16:21:40.429 INFO:tasks.workunit.client.1.smithi152.stdout:3/624: write d7/dc/d3e/f53 [7219461,30794] 0 2023-12-07T16:21:40.432 INFO:tasks.workunit.client.1.smithi152.stdout:9/710: dread d1/d9/d2d/d65/f73 [4194304,4194304] 0 2023-12-07T16:21:40.433 INFO:tasks.workunit.client.1.smithi152.stdout:5/791: mkdir dd/de/d14/d19/da3/d114 0 2023-12-07T16:21:40.437 INFO:tasks.workunit.client.1.smithi152.stdout:8/680: rename d3/d4/d9/dc/c12 to d3/d4/d9/cf4 0 2023-12-07T16:21:40.438 INFO:tasks.workunit.client.0.smithi063.stdout:8/610: dread d7/d38/d73/f8d [0,4194304] 0 2023-12-07T16:21:40.438 INFO:tasks.workunit.client.0.smithi063.stdout:8/611: chown d7/d14/d15/d2b/d40/d63/d75/f80 13518 1 2023-12-07T16:21:40.439 INFO:tasks.workunit.client.1.smithi152.stdout:1/813: symlink dc/d14/d90/dbb/l10e 0 2023-12-07T16:21:40.441 INFO:tasks.workunit.client.1.smithi152.stdout:9/711: creat d1/d17/d3c/d4a/d48/fee x:0 0 0 2023-12-07T16:21:40.441 INFO:tasks.workunit.client.1.smithi152.stdout:0/629: dwrite d0/dc/d36/d7d/d92/fa9 [0,4194304] 0 2023-12-07T16:21:40.442 INFO:tasks.workunit.client.1.smithi152.stdout:5/792: creat dd/ddb/f115 x:0 0 0 2023-12-07T16:21:40.442 INFO:tasks.workunit.client.1.smithi152.stdout:5/793: read - dd/d7b/fc1 zero size 2023-12-07T16:21:40.442 INFO:tasks.workunit.client.1.smithi152.stdout:5/794: getdents dd/d91/dbe/d10e/dda 0 2023-12-07T16:21:40.443 INFO:tasks.workunit.client.0.smithi063.stdout:8/612: mknod d7/d14/d15/cb9 0 2023-12-07T16:21:40.445 INFO:tasks.workunit.client.0.smithi063.stdout:8/613: link d7/d14/d15/d2b/d40/da8/c94 d7/d14/cba 0 2023-12-07T16:21:40.446 INFO:tasks.workunit.client.0.smithi063.stdout:8/614: mkdir d7/d14/d15/dac/dad/dbb 0 2023-12-07T16:21:40.447 INFO:tasks.workunit.client.1.smithi152.stdout:1/814: creat dc/d14/d18/d64/d8a/f10f x:0 0 0 2023-12-07T16:21:40.447 INFO:tasks.workunit.client.1.smithi152.stdout:3/625: rename d7/dc/d3e/d48 to d7/dc/d3e/d6b/d80/dc2 0 2023-12-07T16:21:40.447 INFO:tasks.workunit.client.1.smithi152.stdout:3/626: chown d7/d10/d1a/d2f/d56/d57/faa 96972821 1 2023-12-07T16:21:40.447 INFO:tasks.workunit.client.1.smithi152.stdout:3/627: stat d7/d10/d19/f23 0 2023-12-07T16:21:40.447 INFO:tasks.workunit.client.1.smithi152.stdout:3/628: write d7/d10/d41/f6e [792412,52426] 0 2023-12-07T16:21:40.448 INFO:tasks.workunit.client.0.smithi063.stdout:8/615: creat d7/d14/d1a/d54/fbc x:0 0 0 2023-12-07T16:21:40.450 INFO:tasks.workunit.client.0.smithi063.stdout:8/616: symlink d7/d14/d15/d57/lbd 0 2023-12-07T16:21:40.450 INFO:tasks.workunit.client.1.smithi152.stdout:5/795: creat dd/d91/dbe/d10e/f116 x:0 0 0 2023-12-07T16:21:40.452 INFO:tasks.workunit.client.1.smithi152.stdout:1/815: symlink dc/d14/d18/d79/d86/db7/l110 0 2023-12-07T16:21:40.452 INFO:tasks.workunit.client.0.smithi063.stdout:8/617: link d7/d38/d8e/f91 d7/fbe 0 2023-12-07T16:21:40.452 INFO:tasks.workunit.client.1.smithi152.stdout:1/816: write dc/f23 [6104624,8118] 0 2023-12-07T16:21:40.453 INFO:tasks.workunit.client.1.smithi152.stdout:3/629: symlink d7/d10/d19/lc3 0 2023-12-07T16:21:40.453 INFO:tasks.workunit.client.1.smithi152.stdout:8/681: dread d3/d4/f5c [4194304,4194304] 0 2023-12-07T16:21:40.453 INFO:tasks.workunit.client.1.smithi152.stdout:8/682: write d3/d4/d9/dc/d6f/d7a/d8a/d63/d67/dd4/fe3 [681381,118836] 0 2023-12-07T16:21:40.453 INFO:tasks.workunit.client.1.smithi152.stdout:3/630: write d7/d10/d1a/d25/f9a [377662,110602] 0 2023-12-07T16:21:40.456 INFO:tasks.workunit.client.1.smithi152.stdout:5/796: link dd/de/d14/d1f/d49/fe1 dd/de/d14/d19/da3/ddf/f117 0 2023-12-07T16:21:40.459 INFO:tasks.workunit.client.1.smithi152.stdout:5/797: write dd/de/f31 [1575065,112099] 0 2023-12-07T16:21:40.459 INFO:tasks.workunit.client.1.smithi152.stdout:1/817: symlink dc/d14/d18/de9/l111 0 2023-12-07T16:21:40.459 INFO:tasks.workunit.client.1.smithi152.stdout:1/818: write dc/d14/d18/d64/faf [493355,44085] 0 2023-12-07T16:21:40.463 INFO:tasks.workunit.client.0.smithi063.stdout:1/347: dwrite d0/dd/d19/d50/d71/f2e [0,4194304] 0 2023-12-07T16:21:40.463 INFO:tasks.workunit.client.0.smithi063.stdout:1/348: readlink d0/dd/d1f/l35 0 2023-12-07T16:21:40.463 INFO:tasks.workunit.client.0.smithi063.stdout:4/367: dwrite d1/d3/db/f4f [0,4194304] 0 2023-12-07T16:21:40.464 INFO:tasks.workunit.client.0.smithi063.stdout:4/368: chown d1/d3/d3f/d49/d64 51 1 2023-12-07T16:21:40.464 INFO:tasks.workunit.client.1.smithi152.stdout:0/630: dwrite d0/dc/d36/d3a/d51/d82/fac [0,4194304] 0 2023-12-07T16:21:40.466 INFO:tasks.workunit.client.0.smithi063.stdout:1/349: read d0/dd/d10/d1b/f67 [254811,64461] 0 2023-12-07T16:21:40.466 INFO:tasks.workunit.client.0.smithi063.stdout:1/350: chown d0/d47 1798 1 2023-12-07T16:21:40.466 INFO:tasks.workunit.client.1.smithi152.stdout:8/683: rename d3/d4/d9/dc/d6f/d7a/d8a/d63 to d3/d4/d9/dc/d6f/d7b/d7e/df5 0 2023-12-07T16:21:40.467 INFO:tasks.workunit.client.0.smithi063.stdout:4/369: mkdir d1/d3/db/d16/d66 0 2023-12-07T16:21:40.468 INFO:tasks.workunit.client.0.smithi063.stdout:8/618: dread d7/d14/d15/d57/f6f [0,4194304] 0 2023-12-07T16:21:40.468 INFO:tasks.workunit.client.0.smithi063.stdout:8/619: chown d7/d14/d15/d2b/f41 432209 1 2023-12-07T16:21:40.470 INFO:tasks.workunit.client.1.smithi152.stdout:1/819: symlink dc/d28/d4e/de8/df0/l112 0 2023-12-07T16:21:40.471 INFO:tasks.workunit.client.1.smithi152.stdout:1/820: stat dc/d14/d68/ca8 0 2023-12-07T16:21:40.471 INFO:tasks.workunit.client.0.smithi063.stdout:4/370: creat d1/d3/db/d2c/d63/d62/f67 x:0 0 0 2023-12-07T16:21:40.471 INFO:tasks.workunit.client.0.smithi063.stdout:8/620: symlink d7/d38/d8e/lbf 0 2023-12-07T16:21:40.473 INFO:tasks.workunit.client.0.smithi063.stdout:4/371: rename d1/f5f to d1/d3/f68 0 2023-12-07T16:21:40.474 INFO:tasks.workunit.client.1.smithi152.stdout:0/631: mkdir d0/d27/dd7 0 2023-12-07T16:21:40.475 INFO:tasks.workunit.client.0.smithi063.stdout:4/372: mknod d1/d3/d51/c69 0 2023-12-07T16:21:40.476 INFO:tasks.workunit.client.1.smithi152.stdout:8/684: symlink d3/d1e/lf6 0 2023-12-07T16:21:40.476 INFO:tasks.workunit.client.1.smithi152.stdout:3/631: dwrite d7/dc/d3e/d7d/fa1 [4194304,4194304] 0 2023-12-07T16:21:40.478 INFO:tasks.workunit.client.1.smithi152.stdout:1/821: creat dc/d14/d18/d2d/d91/f113 x:0 0 0 2023-12-07T16:21:40.480 INFO:tasks.workunit.client.1.smithi152.stdout:2/581: sync 2023-12-07T16:21:40.480 INFO:tasks.workunit.client.1.smithi152.stdout:4/562: sync 2023-12-07T16:21:40.480 INFO:tasks.workunit.client.1.smithi152.stdout:6/637: sync 2023-12-07T16:21:40.480 INFO:tasks.workunit.client.1.smithi152.stdout:7/599: sync 2023-12-07T16:21:40.481 INFO:tasks.workunit.client.1.smithi152.stdout:0/632: creat d0/dc/d3d/dab/dc8/fd8 x:0 0 0 2023-12-07T16:21:40.481 INFO:tasks.workunit.client.0.smithi063.stdout:1/351: dwrite d0/dd/d10/d1b/f2b [0,4194304] 0 2023-12-07T16:21:40.481 INFO:tasks.workunit.client.0.smithi063.stdout:1/352: read - d0/dd/d1f/f65 zero size 2023-12-07T16:21:40.481 INFO:tasks.workunit.client.0.smithi063.stdout:1/353: fdatasync d0/dd/d10/d46/f73 0 2023-12-07T16:21:40.483 INFO:tasks.workunit.client.1.smithi152.stdout:7/600: write db/d1c/f28 [1915904,105552] 0 2023-12-07T16:21:40.483 INFO:tasks.workunit.client.1.smithi152.stdout:7/601: dread - db/d1c/fa8 zero size 2023-12-07T16:21:40.484 INFO:tasks.workunit.client.0.smithi063.stdout:4/373: dread d1/d3/db/f20 [0,4194304] 0 2023-12-07T16:21:40.484 INFO:tasks.workunit.client.0.smithi063.stdout:4/374: chown d1/d3/db/d41 161 1 2023-12-07T16:21:40.485 INFO:tasks.workunit.client.1.smithi152.stdout:8/685: unlink d3/d1e/d55/fdd 0 2023-12-07T16:21:40.485 INFO:tasks.workunit.client.0.smithi063.stdout:1/354: rename d0/dd/d10/f62 to d0/dd/d10/d13/d2f/d79/f7d 0 2023-12-07T16:21:40.485 INFO:tasks.workunit.client.0.smithi063.stdout:4/375: read d1/d3/db/f4f [3881229,98046] 0 2023-12-07T16:21:40.488 INFO:tasks.workunit.client.1.smithi152.stdout:3/632: creat d7/dc/d3e/d6b/d80/da2/fc4 x:0 0 0 2023-12-07T16:21:40.489 INFO:tasks.workunit.client.1.smithi152.stdout:1/822: creat dc/d14/d18/d64/f114 x:0 0 0 2023-12-07T16:21:40.490 INFO:tasks.workunit.client.1.smithi152.stdout:1/823: write dc/d14/f2b [1310654,62689] 0 2023-12-07T16:21:40.492 INFO:tasks.workunit.client.1.smithi152.stdout:6/638: creat d2/d4f/d83/d48/d70/da7/db7/fd1 x:0 0 0 2023-12-07T16:21:40.496 INFO:tasks.workunit.client.1.smithi152.stdout:4/563: symlink d0/d3/d6/dc/d22/la2 0 2023-12-07T16:21:40.498 INFO:tasks.workunit.client.1.smithi152.stdout:0/633: rename d0/d2f/d30/d6e/d77/cd4 to d0/d2f/d30/d6e/d77/cd9 0 2023-12-07T16:21:40.498 INFO:tasks.workunit.client.1.smithi152.stdout:0/634: fdatasync d0/dc/d3d/d4c/f64 0 2023-12-07T16:21:40.498 INFO:tasks.workunit.client.1.smithi152.stdout:0/635: write d0/d2f/d30/d6e/d77/f88 [619282,74523] 0 2023-12-07T16:21:40.498 INFO:tasks.workunit.client.1.smithi152.stdout:8/686: mkdir d3/d4/d9/df7 0 2023-12-07T16:21:40.503 INFO:tasks.workunit.client.1.smithi152.stdout:1/824: unlink dc/d14/d18/d64/f89 0 2023-12-07T16:21:40.505 INFO:tasks.workunit.client.1.smithi152.stdout:6/639: creat d2/d4f/d83/d48/d70/da7/db7/fd2 x:0 0 0 2023-12-07T16:21:40.508 INFO:tasks.workunit.client.1.smithi152.stdout:6/640: write d2/d4f/d83/d85/d19/d1f/f47 [898413,35383] 0 2023-12-07T16:21:40.509 INFO:tasks.workunit.client.1.smithi152.stdout:0/636: mknod d0/dc/d36/d7d/d92/cda 0 2023-12-07T16:21:40.509 INFO:tasks.workunit.client.1.smithi152.stdout:6/641: stat d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/d8b 0 2023-12-07T16:21:40.509 INFO:tasks.workunit.client.1.smithi152.stdout:0/637: fsync d0/dc/f79 0 2023-12-07T16:21:40.509 INFO:tasks.workunit.client.1.smithi152.stdout:0/638: write d0/dc/d3d/d73/dbf/fd0 [28960,90619] 0 2023-12-07T16:21:40.509 INFO:tasks.workunit.client.1.smithi152.stdout:8/687: mknod d3/d4/d9/dc/d6f/cf8 0 2023-12-07T16:21:40.509 INFO:tasks.workunit.client.0.smithi063.stdout:3/461: sync 2023-12-07T16:21:40.509 INFO:tasks.workunit.client.0.smithi063.stdout:3/462: chown d7/d9/dd/d56/c99 3 1 2023-12-07T16:21:40.510 INFO:tasks.workunit.client.1.smithi152.stdout:4/564: dread d0/d3/d6/dc/d39/d93/f40 [0,4194304] 0 2023-12-07T16:21:40.510 INFO:tasks.workunit.client.1.smithi152.stdout:1/825: symlink dc/l115 0 2023-12-07T16:21:40.510 INFO:tasks.workunit.client.1.smithi152.stdout:1/826: read - dc/d14/d18/d64/d8a/f10f zero size 2023-12-07T16:21:40.511 INFO:tasks.workunit.client.1.smithi152.stdout:1/827: chown dc/d14/d18/d64/f8f 4 1 2023-12-07T16:21:40.511 INFO:tasks.workunit.client.1.smithi152.stdout:9/712: truncate d1/d9/d2d/d65/f73 6035145 0 2023-12-07T16:21:40.512 INFO:tasks.workunit.client.1.smithi152.stdout:6/642: mknod d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/d8b/cd3 0 2023-12-07T16:21:40.514 INFO:tasks.workunit.client.1.smithi152.stdout:0/639: rename d0/ca8 to d0/d27/d11/cdb 0 2023-12-07T16:21:40.515 INFO:tasks.workunit.client.1.smithi152.stdout:8/688: mknod d3/d1e/cf9 0 2023-12-07T16:21:40.515 INFO:tasks.workunit.client.0.smithi063.stdout:3/463: write d7/d4f/d53/d54/d76/f83 [751099,121299] 0 2023-12-07T16:21:40.516 INFO:tasks.workunit.client.1.smithi152.stdout:4/565: write d0/d3/d6/dc/d22/f4d [1031409,2267] 0 2023-12-07T16:21:40.520 INFO:tasks.workunit.client.1.smithi152.stdout:1/828: link dc/d14/d18/de9/ff3 dc/d28/d4e/f116 0 2023-12-07T16:21:40.520 INFO:tasks.workunit.client.1.smithi152.stdout:9/713: mknod d1/d9/d2d/d46/cef 0 2023-12-07T16:21:40.522 INFO:tasks.workunit.client.1.smithi152.stdout:6/643: mknod d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/d8b/cd4 0 2023-12-07T16:21:40.523 INFO:tasks.workunit.client.1.smithi152.stdout:0/640: symlink d0/d2f/d30/d6e/d77/d9f/dcb/ldc 0 2023-12-07T16:21:40.523 INFO:tasks.workunit.client.0.smithi063.stdout:3/464: dread d7/d9/dd/f66 [4194304,4194304] 0 2023-12-07T16:21:40.524 INFO:tasks.workunit.client.1.smithi152.stdout:0/641: write d0/dc/d3d/f53 [4604466,121931] 0 2023-12-07T16:21:40.524 INFO:tasks.workunit.client.1.smithi152.stdout:0/642: chown d0/dc/d3d/f5b 622995 1 2023-12-07T16:21:40.524 INFO:tasks.workunit.client.1.smithi152.stdout:8/689: mknod d3/d4/d9/dc/d6f/d7a/d8a/d66/d9b/cfa 0 2023-12-07T16:21:40.525 INFO:tasks.workunit.client.1.smithi152.stdout:3/633: dwrite d7/dc/d14/f69 [0,4194304] 0 2023-12-07T16:21:40.525 INFO:tasks.workunit.client.1.smithi152.stdout:7/602: dwrite db/d27/f3b [0,4194304] 0 2023-12-07T16:21:40.525 INFO:tasks.workunit.client.1.smithi152.stdout:3/634: fdatasync d7/dc/fa9 0 2023-12-07T16:21:40.525 INFO:tasks.workunit.client.1.smithi152.stdout:2/582: dwrite d2/ff [0,4194304] 0 2023-12-07T16:21:40.525 INFO:tasks.workunit.client.1.smithi152.stdout:4/566: symlink d0/d3/d6/dc/d39/d93/la3 0 2023-12-07T16:21:40.526 INFO:tasks.workunit.client.0.smithi063.stdout:3/465: read f6 [7431706,18728] 0 2023-12-07T16:21:40.526 INFO:tasks.workunit.client.0.smithi063.stdout:4/376: dwrite d1/d3/db/d2c/d63/f18 [0,4194304] 0 2023-12-07T16:21:40.526 INFO:tasks.workunit.client.0.smithi063.stdout:4/377: fdatasync d1/f34 0 2023-12-07T16:21:40.527 INFO:tasks.workunit.client.1.smithi152.stdout:6/644: dread d2/d4f/d83/d85/f25 [0,4194304] 0 2023-12-07T16:21:40.527 INFO:tasks.workunit.client.1.smithi152.stdout:1/829: mknod dc/d14/d18/d79/d86/db7/c117 0 2023-12-07T16:21:40.527 INFO:tasks.workunit.client.1.smithi152.stdout:1/830: chown dc/d14/d18/d2d/d48/da3/d58 0 1 2023-12-07T16:21:40.529 INFO:tasks.workunit.client.0.smithi063.stdout:3/466: mknod d7/d8d/c9b 0 2023-12-07T16:21:40.529 INFO:tasks.workunit.client.0.smithi063.stdout:3/467: truncate d7/d9/d2b/d41/f86 506445 0 2023-12-07T16:21:40.529 INFO:tasks.workunit.client.0.smithi063.stdout:4/378: unlink d1/d3/c53 0 2023-12-07T16:21:40.529 INFO:tasks.workunit.client.0.smithi063.stdout:4/379: write d1/d3/db/d2c/d63/d62/f67 [575685,5014] 0 2023-12-07T16:21:40.529 INFO:tasks.workunit.client.0.smithi063.stdout:4/380: stat d1/d3/db/d16/c21 0 2023-12-07T16:21:40.530 INFO:tasks.workunit.client.1.smithi152.stdout:4/567: write d0/d17/f79 [2152976,96806] 0 2023-12-07T16:21:40.532 INFO:tasks.workunit.client.1.smithi152.stdout:8/690: link d3/d4/d9/d23/d4c/ld9 d3/d1e/d55/d83/dae/db1/lfb 0 2023-12-07T16:21:40.532 INFO:tasks.workunit.client.1.smithi152.stdout:8/691: chown d3/d4/d9/dc/f20 31 1 2023-12-07T16:21:40.532 INFO:tasks.workunit.client.1.smithi152.stdout:0/643: getdents d0/dc/d3d/dab/dc8 0 2023-12-07T16:21:40.535 INFO:tasks.workunit.client.1.smithi152.stdout:8/692: write d3/d1e/d55/f64 [667752,81903] 0 2023-12-07T16:21:40.536 INFO:tasks.workunit.client.1.smithi152.stdout:7/603: mkdir db/d1c/dbd 0 2023-12-07T16:21:40.536 INFO:tasks.workunit.client.1.smithi152.stdout:7/604: write db/d27/f56 [782713,2104] 0 2023-12-07T16:21:40.538 INFO:tasks.workunit.client.1.smithi152.stdout:3/635: rename d7/d10/d1a/d25/d4b/f4d to d7/d10/d1a/d25/d78/fc5 0 2023-12-07T16:21:40.539 INFO:tasks.workunit.client.1.smithi152.stdout:6/645: truncate d2/d4f/d83/d85/f6a 1071083 0 2023-12-07T16:21:40.539 INFO:tasks.workunit.client.1.smithi152.stdout:7/605: read db/d27/f3d [295936,21346] 0 2023-12-07T16:21:40.541 INFO:tasks.workunit.client.1.smithi152.stdout:1/831: symlink dc/d14/d18/d2d/d91/l118 0 2023-12-07T16:21:40.541 INFO:tasks.workunit.client.0.smithi063.stdout:4/381: dread d1/d3/db/f3e [0,4194304] 0 2023-12-07T16:21:40.543 INFO:tasks.workunit.client.1.smithi152.stdout:8/693: mknod d3/d4/d9/dc/d6f/d7b/d7e/df5/cfc 0 2023-12-07T16:21:40.543 INFO:tasks.workunit.client.1.smithi152.stdout:8/694: fsync d3/d4/d9/d34/fe2 0 2023-12-07T16:21:40.545 INFO:tasks.workunit.client.1.smithi152.stdout:2/583: rename d2/dba/dbc to d2/d1c/d2e/d57/d5b/da7/d9a/dcb 0 2023-12-07T16:21:40.546 INFO:tasks.workunit.client.1.smithi152.stdout:9/714: dwrite d1/d9/db/df/f97 [0,4194304] 0 2023-12-07T16:21:40.546 INFO:tasks.workunit.client.1.smithi152.stdout:9/715: write d1/f76 [196688,39201] 0 2023-12-07T16:21:40.546 INFO:tasks.workunit.client.1.smithi152.stdout:9/716: write d1/d9/d4f/d83/fab [530172,25830] 0 2023-12-07T16:21:40.547 INFO:tasks.workunit.client.1.smithi152.stdout:3/636: mknod d7/dc/d3e/d62/d6d/d98/cc6 0 2023-12-07T16:21:40.547 INFO:tasks.workunit.client.1.smithi152.stdout:3/637: read - d7/d10/d1a/fc1 zero size 2023-12-07T16:21:40.547 INFO:tasks.workunit.client.1.smithi152.stdout:3/638: write d7/d10/d1a/d2f/d5c/f7f [1483435,97794] 0 2023-12-07T16:21:40.548 INFO:tasks.workunit.client.1.smithi152.stdout:6/646: truncate d2/d4f/d83/d85/f74 631239 0 2023-12-07T16:21:40.548 INFO:tasks.workunit.client.1.smithi152.stdout:6/647: truncate d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/f82 782092 0 2023-12-07T16:21:40.549 INFO:tasks.workunit.client.1.smithi152.stdout:1/832: rmdir dc/d14/d18/d2d/d9c 39 2023-12-07T16:21:40.552 INFO:tasks.workunit.client.1.smithi152.stdout:8/695: creat d3/d4/d9/dc/d6f/d7b/d7e/ffd x:0 0 0 2023-12-07T16:21:40.553 INFO:tasks.workunit.client.1.smithi152.stdout:7/606: rename db/d27/d39/d41/d58/d80/l86 to db/d68/lbe 0 2023-12-07T16:21:40.554 INFO:tasks.workunit.client.0.smithi063.stdout:4/382: rmdir d1 39 2023-12-07T16:21:40.554 INFO:tasks.workunit.client.1.smithi152.stdout:2/584: creat d2/d1c/d2e/d30/d42/fcc x:0 0 0 2023-12-07T16:21:40.554 INFO:tasks.workunit.client.1.smithi152.stdout:2/585: chown d2/d1c/d2e/d30/d33/d86 1617 1 2023-12-07T16:21:40.556 INFO:tasks.workunit.client.0.smithi063.stdout:4/383: rename d1/d3/d3f/d44/f58 to d1/d3/db/d41/f6a 0 2023-12-07T16:21:40.556 INFO:tasks.workunit.client.0.smithi063.stdout:4/384: write d1/d3/db/d41/f46 [49927,104816] 0 2023-12-07T16:21:40.557 INFO:tasks.workunit.client.0.smithi063.stdout:4/385: creat d1/d3/db/d41/f6b x:0 0 0 2023-12-07T16:21:40.558 INFO:tasks.workunit.client.1.smithi152.stdout:8/696: write d3/d1e/f30 [5470853,108262] 0 2023-12-07T16:21:40.558 INFO:tasks.workunit.client.1.smithi152.stdout:8/697: read - d3/d4/d9/dc/d6f/d7b/d7e/ffd zero size 2023-12-07T16:21:40.559 INFO:tasks.workunit.client.0.smithi063.stdout:4/386: read d1/d3/db/d2c/d63/f48 [2810315,53158] 0 2023-12-07T16:21:40.559 INFO:tasks.workunit.client.1.smithi152.stdout:9/717: rmdir d1/d9/db/df/d42 39 2023-12-07T16:21:40.559 INFO:tasks.workunit.client.1.smithi152.stdout:9/718: write d1/d17/d3c/d4a/d7e/fc5 [128106,107615] 0 2023-12-07T16:21:40.560 INFO:tasks.workunit.client.1.smithi152.stdout:9/719: write d1/d9/db/f33 [4821041,120023] 0 2023-12-07T16:21:40.560 INFO:tasks.workunit.client.1.smithi152.stdout:9/720: fdatasync d1/d9/d2d/f84 0 2023-12-07T16:21:40.560 INFO:tasks.workunit.client.0.smithi063.stdout:4/387: creat d1/d3/d3f/d44/f6c x:0 0 0 2023-12-07T16:21:40.560 INFO:tasks.workunit.client.0.smithi063.stdout:4/388: write d1/d3/d3f/d44/f6c [820694,49013] 0 2023-12-07T16:21:40.561 INFO:tasks.workunit.client.1.smithi152.stdout:6/648: symlink d2/d4f/d83/da0/ld5 0 2023-12-07T16:21:40.561 INFO:tasks.workunit.client.1.smithi152.stdout:6/649: fdatasync d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/f4e 0 2023-12-07T16:21:40.561 INFO:tasks.workunit.client.1.smithi152.stdout:8/698: dread d3/d4/d9/dc/d6f/d7b/d7e/df5/d67/d7d/f87 [0,4194304] 0 2023-12-07T16:21:40.563 INFO:tasks.workunit.client.1.smithi152.stdout:1/833: rename dc/d28/d7d/da4 to dc/d14/d18/d2d/d4a/d119 0 2023-12-07T16:21:40.564 INFO:tasks.workunit.client.1.smithi152.stdout:7/607: symlink db/d27/d39/d41/d58/lbf 0 2023-12-07T16:21:40.564 INFO:tasks.workunit.client.1.smithi152.stdout:1/834: write dc/d14/d18/f70 [1125442,11948] 0 2023-12-07T16:21:40.565 INFO:tasks.workunit.client.1.smithi152.stdout:6/650: rmdir d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/da1 39 2023-12-07T16:21:40.566 INFO:tasks.workunit.client.1.smithi152.stdout:8/699: mknod d3/d4/d9/dc/d6f/d7b/d7e/df5/d67/cfe 0 2023-12-07T16:21:40.569 INFO:tasks.workunit.client.1.smithi152.stdout:2/586: rename d2/d9/d51/fb0 to d2/d1c/d2e/d57/db1/fcd 0 2023-12-07T16:21:40.569 INFO:tasks.workunit.client.1.smithi152.stdout:7/608: stat db/c20 0 2023-12-07T16:21:40.569 INFO:tasks.workunit.client.1.smithi152.stdout:2/587: fdatasync d2/d1c/d52/f99 0 2023-12-07T16:21:40.569 INFO:tasks.workunit.client.1.smithi152.stdout:2/588: stat d2/l12 0 2023-12-07T16:21:40.570 INFO:tasks.workunit.client.1.smithi152.stdout:6/651: mknod d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/da1/db5/cd6 0 2023-12-07T16:21:40.572 INFO:tasks.workunit.client.1.smithi152.stdout:9/721: rename d1/d9/d2d/d72/d80/lb4 to d1/d9/d2d/d65/lf0 0 2023-12-07T16:21:40.572 INFO:tasks.workunit.client.1.smithi152.stdout:2/589: write d2/f8 [507116,94967] 0 2023-12-07T16:21:40.573 INFO:tasks.workunit.client.1.smithi152.stdout:7/609: symlink db/d27/lc0 0 2023-12-07T16:21:40.573 INFO:tasks.workunit.client.1.smithi152.stdout:2/590: dread - d2/d9/d51/d54/fca zero size 2023-12-07T16:21:40.573 INFO:tasks.workunit.client.1.smithi152.stdout:2/591: fdatasync d2/d9/d51/f63 0 2023-12-07T16:21:40.573 INFO:tasks.workunit.client.1.smithi152.stdout:3/639: dwrite d7/d10/d1a/d2f/d86/f8d [0,4194304] 0 2023-12-07T16:21:40.573 INFO:tasks.workunit.client.1.smithi152.stdout:3/640: dread - d7/dc/d3e/d6b/d80/da2/fc4 zero size 2023-12-07T16:21:40.575 INFO:tasks.workunit.client.1.smithi152.stdout:9/722: symlink d1/d17/d4e/d5a/ddd/lf1 0 2023-12-07T16:21:40.578 INFO:tasks.workunit.client.1.smithi152.stdout:7/610: rmdir db/d1c/dbd 0 2023-12-07T16:21:40.578 INFO:tasks.workunit.client.1.smithi152.stdout:7/611: fdatasync db/d27/f91 0 2023-12-07T16:21:40.579 INFO:tasks.workunit.client.1.smithi152.stdout:4/568: dwrite d0/d3/d6/dc/d22/f4d [0,4194304] 0 2023-12-07T16:21:40.579 INFO:tasks.workunit.client.1.smithi152.stdout:2/592: rename d2/d1c/d2e/d57/d5b/da7/d9a/f9c to d2/d1c/d2e/d30/d42/d84/fce 0 2023-12-07T16:21:40.579 INFO:tasks.workunit.client.1.smithi152.stdout:0/644: dwrite d0/fa4 [0,4194304] 0 2023-12-07T16:21:40.579 INFO:tasks.workunit.client.1.smithi152.stdout:0/645: fdatasync d0/d27/f2b 0 2023-12-07T16:21:40.582 INFO:tasks.workunit.client.1.smithi152.stdout:3/641: unlink d7/d10/d1a/f43 0 2023-12-07T16:21:40.582 INFO:tasks.workunit.client.1.smithi152.stdout:4/569: dread d0/d3/d6/dc/d39/f5e [0,4194304] 0 2023-12-07T16:21:40.586 INFO:tasks.workunit.client.0.smithi063.stdout:4/389: dread d1/d3/f36 [0,4194304] 0 2023-12-07T16:21:40.586 INFO:tasks.workunit.client.1.smithi152.stdout:9/723: creat d1/d17/d4e/ff2 x:0 0 0 2023-12-07T16:21:40.586 INFO:tasks.workunit.client.1.smithi152.stdout:3/642: write d7/d10/f91 [34351,94904] 0 2023-12-07T16:21:40.586 INFO:tasks.workunit.client.1.smithi152.stdout:3/643: chown d7/d10/d1a/c4c 233115132 1 2023-12-07T16:21:40.587 INFO:tasks.workunit.client.1.smithi152.stdout:3/644: stat d7/d10/d1a/dc0 0 2023-12-07T16:21:40.588 INFO:tasks.workunit.client.1.smithi152.stdout:7/612: link db/d27/d39/d41/d58/f55 db/d27/d39/d63/fc1 0 2023-12-07T16:21:40.589 INFO:tasks.workunit.client.0.smithi063.stdout:4/390: link d1/d3/db/d2c/d63/f18 d1/f6d 0 2023-12-07T16:21:40.589 INFO:tasks.workunit.client.1.smithi152.stdout:2/593: symlink d2/d1c/d2e/d30/d42/d91/lcf 0 2023-12-07T16:21:40.589 INFO:tasks.workunit.client.0.smithi063.stdout:4/391: mknod d1/c6e 0 2023-12-07T16:21:40.590 INFO:tasks.workunit.client.0.smithi063.stdout:4/392: chown d1/d3/db/f4f 29864596 1 2023-12-07T16:21:40.590 INFO:tasks.workunit.client.0.smithi063.stdout:4/393: rmdir d1/d3/db/d2c/d63/d62 39 2023-12-07T16:21:40.591 INFO:tasks.workunit.client.1.smithi152.stdout:0/646: link d0/d27/f2b d0/dc/d3d/d4c/fdd 0 2023-12-07T16:21:40.591 INFO:tasks.workunit.client.0.smithi063.stdout:4/394: symlink d1/l6f 0 2023-12-07T16:21:40.592 INFO:tasks.workunit.client.1.smithi152.stdout:3/645: creat d7/d10/d1a/d2f/d5c/dbf/fc7 x:0 0 0 2023-12-07T16:21:40.592 INFO:tasks.workunit.client.1.smithi152.stdout:3/646: chown d7/f52 2 1 2023-12-07T16:21:40.592 INFO:tasks.workunit.client.0.smithi063.stdout:4/395: creat d1/d3/d3f/d44/f70 x:0 0 0 2023-12-07T16:21:40.593 INFO:tasks.workunit.client.1.smithi152.stdout:7/613: mknod db/d27/d39/d41/cc2 0 2023-12-07T16:21:40.593 INFO:tasks.workunit.client.0.smithi063.stdout:4/396: rmdir d1/d3/db/d2c/d63 39 2023-12-07T16:21:40.594 INFO:tasks.workunit.client.1.smithi152.stdout:7/614: write db/d27/d39/d41/d37/f64 [22828,79302] 0 2023-12-07T16:21:40.594 INFO:tasks.workunit.client.1.smithi152.stdout:7/615: stat db/d27/d39/d41/d58/d80/dac 0 2023-12-07T16:21:40.595 INFO:tasks.workunit.client.1.smithi152.stdout:2/594: creat d2/d1c/d2e/d57/d5b/da7/d9a/da6/dbb/fd0 x:0 0 0 2023-12-07T16:21:40.596 INFO:tasks.workunit.client.1.smithi152.stdout:7/616: read db/d27/d5e/d45/f4c [1186379,7249] 0 2023-12-07T16:21:40.596 INFO:tasks.workunit.client.1.smithi152.stdout:0/647: creat d0/dc/d3d/fde x:0 0 0 2023-12-07T16:21:40.596 INFO:tasks.workunit.client.1.smithi152.stdout:0/648: write d0/dc/d3d/d4c/fdd [261795,75512] 0 2023-12-07T16:21:40.598 INFO:tasks.workunit.client.1.smithi152.stdout:3/647: creat d7/dc/d3e/d6b/d80/dc2/fc8 x:0 0 0 2023-12-07T16:21:40.598 INFO:tasks.workunit.client.1.smithi152.stdout:3/648: fsync d7/f5a 0 2023-12-07T16:21:40.600 INFO:tasks.workunit.client.1.smithi152.stdout:7/617: creat db/d27/d5e/d45/fc3 x:0 0 0 2023-12-07T16:21:40.600 INFO:tasks.workunit.client.1.smithi152.stdout:7/618: write db/d27/d39/d63/fb8 [757287,63922] 0 2023-12-07T16:21:40.600 INFO:tasks.workunit.client.1.smithi152.stdout:3/649: unlink d7/d10/d1a/d2f/d86/caf 0 2023-12-07T16:21:40.601 INFO:tasks.workunit.client.1.smithi152.stdout:1/835: dwrite dc/d14/d18/d45/fcb [0,4194304] 0 2023-12-07T16:21:40.603 INFO:tasks.workunit.client.1.smithi152.stdout:8/700: dwrite d3/d4/d9/dc/d6f/d7a/d8a/f28 [4194304,4194304] 0 2023-12-07T16:21:40.605 INFO:tasks.workunit.client.1.smithi152.stdout:7/619: link db/d27/d39/d41/d58/d80/cb5 db/d27/d5e/cc4 0 2023-12-07T16:21:40.605 INFO:tasks.workunit.client.1.smithi152.stdout:3/650: creat d7/dc/fc9 x:0 0 0 2023-12-07T16:21:40.606 INFO:tasks.workunit.client.1.smithi152.stdout:1/836: symlink dc/d14/d18/d2d/d9c/l11a 0 2023-12-07T16:21:40.607 INFO:tasks.workunit.client.1.smithi152.stdout:7/620: unlink db/d27/d39/d41/d58/d80/dac/fb1 0 2023-12-07T16:21:40.612 INFO:tasks.workunit.client.1.smithi152.stdout:1/837: creat dc/d14/d18/d2d/d48/da3/dbf/f11b x:0 0 0 2023-12-07T16:21:40.612 INFO:tasks.workunit.client.1.smithi152.stdout:1/838: mknod dc/d14/d18/d2d/d48/da3/d58/c11c 0 2023-12-07T16:21:40.613 INFO:tasks.workunit.client.1.smithi152.stdout:1/839: creat dc/d14/dfe/f11d x:0 0 0 2023-12-07T16:21:40.613 INFO:tasks.workunit.client.1.smithi152.stdout:1/840: dread - dc/def/df6/f101 zero size 2023-12-07T16:21:40.614 INFO:tasks.workunit.client.1.smithi152.stdout:1/841: mknod dc/d14/c11e 0 2023-12-07T16:21:40.615 INFO:tasks.workunit.client.1.smithi152.stdout:1/842: unlink dc/f23 0 2023-12-07T16:21:40.616 INFO:tasks.workunit.client.1.smithi152.stdout:1/843: truncate dc/d14/d18/d2d/d9c/fce 461246 0 2023-12-07T16:21:40.616 INFO:tasks.workunit.client.1.smithi152.stdout:1/844: rename dc to dc/d28/d7d/d11f 22 2023-12-07T16:21:40.616 INFO:tasks.workunit.client.1.smithi152.stdout:1/845: fsync dc/d14/d18/d45/fcb 0 2023-12-07T16:21:40.616 INFO:tasks.workunit.client.1.smithi152.stdout:1/846: chown dc/d14/d18/d2d/d48/da3/f92 13 1 2023-12-07T16:21:40.616 INFO:tasks.workunit.client.1.smithi152.stdout:1/847: chown dc/d14/d18/d2d/d9c/fce 28395436 1 2023-12-07T16:21:40.617 INFO:tasks.workunit.client.1.smithi152.stdout:1/848: creat dc/d14/d90/da9/f120 x:0 0 0 2023-12-07T16:21:40.617 INFO:tasks.workunit.client.1.smithi152.stdout:1/849: write dc/d28/f5e [1970452,71301] 0 2023-12-07T16:21:40.617 INFO:tasks.workunit.client.1.smithi152.stdout:1/850: stat dc/d14/d18/d2d/d48/fc2 0 2023-12-07T16:21:40.617 INFO:tasks.workunit.client.1.smithi152.stdout:1/851: read - dc/d14/d18/d79/d86/fd5 zero size 2023-12-07T16:21:40.666 INFO:tasks.workunit.client.1.smithi152.stdout:0/649: dread d0/dc/d36/d3a/d69/fad [0,4194304] 0 2023-12-07T16:21:40.668 INFO:tasks.workunit.client.1.smithi152.stdout:1/852: dread dc/d14/d18/d79/d86/fa0 [0,4194304] 0 2023-12-07T16:21:40.671 INFO:tasks.workunit.client.0.smithi063.stdout:4/397: write d1/d3/db/f4f [3579872,122130] 0 2023-12-07T16:21:40.671 INFO:tasks.workunit.client.1.smithi152.stdout:6/652: dwrite d2/d4f/d83/d85/d19/f46 [0,4194304] 0 2023-12-07T16:21:40.671 INFO:tasks.workunit.client.1.smithi152.stdout:6/653: chown d2/d4f/d83/d85/d19/d1f/f20 5 1 2023-12-07T16:21:40.673 INFO:tasks.workunit.client.0.smithi063.stdout:4/398: mknod d1/d3/d3f/d49/d64/c71 0 2023-12-07T16:21:40.673 INFO:tasks.workunit.client.0.smithi063.stdout:4/399: dread - d1/d3/d3f/d44/f70 zero size 2023-12-07T16:21:40.673 INFO:tasks.workunit.client.0.smithi063.stdout:4/400: read - d1/d3/f5a zero size 2023-12-07T16:21:40.674 INFO:tasks.workunit.client.0.smithi063.stdout:4/401: creat d1/d3/db/f72 x:0 0 0 2023-12-07T16:21:40.674 INFO:tasks.workunit.client.0.smithi063.stdout:4/402: dread - d1/d3/db/d41/f6a zero size 2023-12-07T16:21:40.674 INFO:tasks.workunit.client.0.smithi063.stdout:4/403: truncate d1/d3/db/d2c/d63/d62/f67 748190 0 2023-12-07T16:21:40.675 INFO:tasks.workunit.client.1.smithi152.stdout:0/650: creat d0/dc/d26/fdf x:0 0 0 2023-12-07T16:21:40.678 INFO:tasks.workunit.client.0.smithi063.stdout:4/404: fsync d1/d3/db/f72 0 2023-12-07T16:21:40.680 INFO:tasks.workunit.client.1.smithi152.stdout:1/853: stat dc/d14/d18/d64/lab 0 2023-12-07T16:21:40.684 INFO:tasks.workunit.client.1.smithi152.stdout:6/654: mknod d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/cd7 0 2023-12-07T16:21:40.688 INFO:tasks.workunit.client.1.smithi152.stdout:1/854: creat dc/d28/d4e/de8/f121 x:0 0 0 2023-12-07T16:21:40.688 INFO:tasks.workunit.client.1.smithi152.stdout:1/855: stat dc/d14/d18/d2d/d48/da3/d58/dc9 0 2023-12-07T16:21:40.689 INFO:tasks.workunit.client.1.smithi152.stdout:8/701: dwrite d3/da7/fb6 [0,4194304] 0 2023-12-07T16:21:40.689 INFO:tasks.workunit.client.1.smithi152.stdout:6/655: mkdir d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/da1/db5/dc1/dd8 0 2023-12-07T16:21:40.690 INFO:tasks.workunit.client.1.smithi152.stdout:2/595: dwrite d2/d9/f1b [0,4194304] 0 2023-12-07T16:21:40.691 INFO:tasks.workunit.client.1.smithi152.stdout:9/724: dwrite d1/d9/f35 [0,4194304] 0 2023-12-07T16:21:40.694 INFO:tasks.workunit.client.1.smithi152.stdout:2/596: write d2/d1c/d2e/f7f [1041133,67125] 0 2023-12-07T16:21:40.699 INFO:tasks.workunit.client.1.smithi152.stdout:1/856: symlink dc/d14/d18/d2d/d48/da3/l122 0 2023-12-07T16:21:40.705 INFO:tasks.workunit.client.1.smithi152.stdout:9/725: dread d1/dd/dd6/de2/d53/f7a [0,4194304] 0 2023-12-07T16:21:40.705 INFO:tasks.workunit.client.1.smithi152.stdout:9/726: dread - d1/d17/d4e/ff2 zero size 2023-12-07T16:21:40.707 INFO:tasks.workunit.client.1.smithi152.stdout:1/857: dread dc/d14/d18/f2c [0,4194304] 0 2023-12-07T16:21:40.708 INFO:tasks.workunit.client.1.smithi152.stdout:2/597: dread d2/d56/da0/fad [0,4194304] 0 2023-12-07T16:21:40.708 INFO:tasks.workunit.client.1.smithi152.stdout:2/598: fsync d2/d1c/d2e/d57/f6e 0 2023-12-07T16:21:40.709 INFO:tasks.workunit.client.1.smithi152.stdout:8/702: unlink d3/da7/lac 0 2023-12-07T16:21:40.710 INFO:tasks.workunit.client.1.smithi152.stdout:9/727: creat d1/d9/d2d/d72/ff3 x:0 0 0 2023-12-07T16:21:40.712 INFO:tasks.workunit.client.1.smithi152.stdout:1/858: link dc/d14/d68/fc0 dc/d14/d18/d79/f123 0 2023-12-07T16:21:40.712 INFO:tasks.workunit.client.1.smithi152.stdout:1/859: dread - dc/d14/d18/d2d/d91/f113 zero size 2023-12-07T16:21:40.713 INFO:tasks.workunit.client.1.smithi152.stdout:2/599: getdents d2/d1c/d2e/d30 0 2023-12-07T16:21:40.716 INFO:tasks.workunit.client.1.smithi152.stdout:9/728: rmdir d1/d9/d2d 39 2023-12-07T16:21:40.716 INFO:tasks.workunit.client.1.smithi152.stdout:1/860: creat dc/def/f124 x:0 0 0 2023-12-07T16:21:40.722 INFO:tasks.workunit.client.1.smithi152.stdout:8/703: dwrite d3/d4/d9/dc/feb [0,4194304] 0 2023-12-07T16:21:40.726 INFO:tasks.workunit.client.1.smithi152.stdout:8/704: link d3/d4/d9/d23/d4c/da6/db2/dc3/lea d3/d1e/d55/d83/dde/lff 0 2023-12-07T16:21:40.727 INFO:tasks.workunit.client.1.smithi152.stdout:8/705: symlink d3/d4/d9/dc/d6f/d7b/l100 0 2023-12-07T16:21:40.728 INFO:tasks.workunit.client.1.smithi152.stdout:8/706: mkdir d3/d4/d9/dc/d6f/d7a/d101 0 2023-12-07T16:21:40.728 INFO:tasks.workunit.client.1.smithi152.stdout:9/729: dwrite d1/d17/d58/d86/fe1 [0,4194304] 0 2023-12-07T16:21:40.730 INFO:tasks.workunit.client.1.smithi152.stdout:8/707: rename d3/d4/d9/l41 to d3/d4/d9/dc/d6f/d7b/d7e/df5/l102 0 2023-12-07T16:21:40.733 INFO:tasks.workunit.client.1.smithi152.stdout:9/730: mknod d1/d17/d3c/d4a/d48/cf4 0 2023-12-07T16:21:40.735 INFO:tasks.workunit.client.1.smithi152.stdout:8/708: dread d3/d1e/d55/fb8 [0,4194304] 0 2023-12-07T16:21:40.735 INFO:tasks.workunit.client.1.smithi152.stdout:9/731: link d1/d17/d3c/d4a/l7d d1/d9/d2d/d46/d9a/lf5 0 2023-12-07T16:21:40.735 INFO:tasks.workunit.client.1.smithi152.stdout:1/861: rmdir dc/d14/d18/d2d 39 2023-12-07T16:21:40.736 INFO:tasks.workunit.client.1.smithi152.stdout:9/732: write d1/d17/d3c/fa0 [1161827,97367] 0 2023-12-07T16:21:40.736 INFO:tasks.workunit.client.1.smithi152.stdout:8/709: creat d3/d4/d9/dc/d6f/d7b/d7e/d85/f103 x:0 0 0 2023-12-07T16:21:40.737 INFO:tasks.workunit.client.1.smithi152.stdout:1/862: creat dc/d14/d18/d2d/d48/f125 x:0 0 0 2023-12-07T16:21:40.737 INFO:tasks.workunit.client.1.smithi152.stdout:1/863: write dc/d14/d18/d64/faf [1128645,40367] 0 2023-12-07T16:21:40.738 INFO:tasks.workunit.client.1.smithi152.stdout:9/733: rmdir d1/d9 39 2023-12-07T16:21:40.738 INFO:tasks.workunit.client.1.smithi152.stdout:9/734: dread - d1/dd/dd6/de2/d53/fe7 zero size 2023-12-07T16:21:40.738 INFO:tasks.workunit.client.1.smithi152.stdout:9/735: dread - d1/d9/d4f/daf/fc2 zero size 2023-12-07T16:21:40.738 INFO:tasks.workunit.client.1.smithi152.stdout:9/736: write d1/d9/db/fed [303209,63927] 0 2023-12-07T16:21:40.739 INFO:tasks.workunit.client.1.smithi152.stdout:9/737: truncate d1/d17/d4e/ff2 52646 0 2023-12-07T16:21:40.739 INFO:tasks.workunit.client.1.smithi152.stdout:9/738: write d1/d9/db/df/f50 [535332,59561] 0 2023-12-07T16:21:40.739 INFO:tasks.workunit.client.1.smithi152.stdout:8/710: rename d3/d4/d9/dc/d6f/d7b/dbd/dcc to d3/d1e/d55/d83/dc5/d104 0 2023-12-07T16:21:40.743 INFO:tasks.workunit.client.1.smithi152.stdout:5/798: sync 2023-12-07T16:21:40.743 INFO:tasks.workunit.client.1.smithi152.stdout:5/799: readlink dd/de/d14/d19/d74/l75 0 2023-12-07T16:21:40.744 INFO:tasks.workunit.client.1.smithi152.stdout:5/800: fdatasync dd/de/d17/f7f 0 2023-12-07T16:21:40.744 INFO:tasks.workunit.client.1.smithi152.stdout:2/600: truncate d2/d1c/d2e/f7f 1814249 0 2023-12-07T16:21:40.744 INFO:tasks.workunit.client.1.smithi152.stdout:5/801: truncate dd/de/d14/f42 879440 0 2023-12-07T16:21:40.751 INFO:tasks.workunit.client.1.smithi152.stdout:2/601: creat d2/d1c/d2e/d57/d5b/da7/d9a/dcb/fd1 x:0 0 0 2023-12-07T16:21:40.753 INFO:tasks.workunit.client.1.smithi152.stdout:5/802: getdents dd/de/d8f/dc9 0 2023-12-07T16:21:40.755 INFO:tasks.workunit.client.1.smithi152.stdout:2/602: unlink d2/d1c/d2e/d57/f6e 0 2023-12-07T16:21:40.756 INFO:tasks.workunit.client.1.smithi152.stdout:5/803: creat dd/de/d14/d19/d1a/f118 x:0 0 0 2023-12-07T16:21:40.757 INFO:tasks.workunit.client.1.smithi152.stdout:8/711: rmdir d3/d4/d9/dc/d6f/d7a 39 2023-12-07T16:21:40.758 INFO:tasks.workunit.client.1.smithi152.stdout:2/603: creat d2/d1c/fd2 x:0 0 0 2023-12-07T16:21:40.759 INFO:tasks.workunit.client.1.smithi152.stdout:5/804: rename dd/de/d38/f43 to dd/de/d8f/df2/f119 0 2023-12-07T16:21:40.760 INFO:tasks.workunit.client.1.smithi152.stdout:5/805: write dd/f40 [1246128,127894] 0 2023-12-07T16:21:40.760 INFO:tasks.workunit.client.1.smithi152.stdout:8/712: link d3/d1e/d40/l5a d3/d4/d9/dc/d6f/d7a/d101/l105 0 2023-12-07T16:21:40.761 INFO:tasks.workunit.client.1.smithi152.stdout:2/604: symlink d2/d1c/d2e/d30/d42/d84/ld3 0 2023-12-07T16:21:40.762 INFO:tasks.workunit.client.1.smithi152.stdout:5/806: mkdir dd/de/d14/d19/d1a/def/d11a 0 2023-12-07T16:21:40.764 INFO:tasks.workunit.client.1.smithi152.stdout:2/605: stat d2/d1c/d2e/d57/d5b/da7/la3 0 2023-12-07T16:21:40.764 INFO:tasks.workunit.client.1.smithi152.stdout:2/606: dread - d2/d1c/d52/f6b zero size 2023-12-07T16:21:40.764 INFO:tasks.workunit.client.1.smithi152.stdout:2/607: write d2/d1c/d2e/d57/d5b/da7/d9a/da6/dbb/fd0 [67483,87505] 0 2023-12-07T16:21:40.764 INFO:tasks.workunit.client.1.smithi152.stdout:6/656: dwrite d2/d4f/d83/d85/fc [0,4194304] 0 2023-12-07T16:21:40.765 INFO:tasks.workunit.client.1.smithi152.stdout:5/807: mknod dd/de/d14/d19/c11b 0 2023-12-07T16:21:40.765 INFO:tasks.workunit.client.1.smithi152.stdout:1/864: dwrite dc/d14/d90/da9/df5/fff [0,4194304] 0 2023-12-07T16:21:40.765 INFO:tasks.workunit.client.1.smithi152.stdout:1/865: truncate dc/d28/d7d/f102 124459 0 2023-12-07T16:21:40.765 INFO:tasks.workunit.client.1.smithi152.stdout:2/608: getdents d2/d1c/d2e/d57/d5b/da7/d8a 0 2023-12-07T16:21:40.766 INFO:tasks.workunit.client.1.smithi152.stdout:2/609: fdatasync d2/d1c/d2e/d57/db1/d90/f36 0 2023-12-07T16:21:40.766 INFO:tasks.workunit.client.0.smithi063.stdout:9/386: sync 2023-12-07T16:21:40.766 INFO:tasks.workunit.client.0.smithi063.stdout:6/489: sync 2023-12-07T16:21:40.766 INFO:tasks.workunit.client.0.smithi063.stdout:7/410: sync 2023-12-07T16:21:40.766 INFO:tasks.workunit.client.0.smithi063.stdout:5/402: sync 2023-12-07T16:21:40.766 INFO:tasks.workunit.client.0.smithi063.stdout:2/486: sync 2023-12-07T16:21:40.766 INFO:tasks.workunit.client.0.smithi063.stdout:2/487: fsync d0/f4b 0 2023-12-07T16:21:40.767 INFO:tasks.workunit.client.0.smithi063.stdout:5/403: fdatasync d1/d31/d56/d61/d5e/f75 0 2023-12-07T16:21:40.767 INFO:tasks.workunit.client.0.smithi063.stdout:0/491: sync 2023-12-07T16:21:40.767 INFO:tasks.workunit.client.0.smithi063.stdout:6/490: write d0/d17/d1a/f74 [1745266,56478] 0 2023-12-07T16:21:40.768 INFO:tasks.workunit.client.0.smithi063.stdout:7/411: mkdir d2/d34/d5a/d5f/d78/d7c/d9b 0 2023-12-07T16:21:40.768 INFO:tasks.workunit.client.0.smithi063.stdout:7/412: readlink d2/d34/l7f 0 2023-12-07T16:21:40.768 INFO:tasks.workunit.client.1.smithi152.stdout:7/621: sync 2023-12-07T16:21:40.768 INFO:tasks.workunit.client.1.smithi152.stdout:0/651: sync 2023-12-07T16:21:40.768 INFO:tasks.workunit.client.1.smithi152.stdout:3/651: sync 2023-12-07T16:21:40.768 INFO:tasks.workunit.client.1.smithi152.stdout:3/652: write d7/dc/f33 [1344365,64646] 0 2023-12-07T16:21:40.769 INFO:tasks.workunit.client.1.smithi152.stdout:4/570: sync 2023-12-07T16:21:40.770 INFO:tasks.workunit.client.0.smithi063.stdout:9/387: symlink d0/d13/d39/d42/l7b 0 2023-12-07T16:21:40.770 INFO:tasks.workunit.client.0.smithi063.stdout:2/488: link d0/d67/d5b/l87 d0/d21/d56/d71/lac 0 2023-12-07T16:21:40.771 INFO:tasks.workunit.client.0.smithi063.stdout:2/489: stat d0/d67/d65/f96 0 2023-12-07T16:21:40.771 INFO:tasks.workunit.client.1.smithi152.stdout:3/653: write d7/dc/d3e/d62/d6d/d84/f85 [12161,82144] 0 2023-12-07T16:21:40.771 INFO:tasks.workunit.client.1.smithi152.stdout:7/622: read db/d27/d5e/f84 [1130912,99899] 0 2023-12-07T16:21:40.771 INFO:tasks.workunit.client.1.smithi152.stdout:3/654: readlink d7/dc/d3e/d6b/d80/dc2/l79 0 2023-12-07T16:21:40.772 INFO:tasks.workunit.client.0.smithi063.stdout:0/492: mkdir d4/dd/de/d15/d1f/d4c/da1 0 2023-12-07T16:21:40.772 INFO:tasks.workunit.client.1.smithi152.stdout:6/657: unlink d2/d4f/d83/d85/fbe 0 2023-12-07T16:21:40.772 INFO:tasks.workunit.client.0.smithi063.stdout:2/490: write d0/f10 [724342,80655] 0 2023-12-07T16:21:40.773 INFO:tasks.workunit.client.0.smithi063.stdout:6/491: unlink d0/d17/d1a/d4d/d5a/f9b 0 2023-12-07T16:21:40.775 INFO:tasks.workunit.client.1.smithi152.stdout:5/808: mknod dd/c11c 0 2023-12-07T16:21:40.775 INFO:tasks.workunit.client.0.smithi063.stdout:7/413: mknod d2/d34/d5a/d5f/d78/c9c 0 2023-12-07T16:21:40.776 INFO:tasks.workunit.client.0.smithi063.stdout:9/388: truncate d0/d7/f2a 9135078 0 2023-12-07T16:21:40.779 INFO:tasks.workunit.client.1.smithi152.stdout:1/866: rename dc/d14/d90/lc7 to dc/d14/d18/d2d/d4a/d119/l126 0 2023-12-07T16:21:40.779 INFO:tasks.workunit.client.0.smithi063.stdout:0/493: unlink d4/dd/de/f19 0 2023-12-07T16:21:40.779 INFO:tasks.workunit.client.0.smithi063.stdout:0/494: chown d4/dd/d26/f4f 3435 1 2023-12-07T16:21:40.779 INFO:tasks.workunit.client.0.smithi063.stdout:7/414: unlink d2/d34/l7f 0 2023-12-07T16:21:40.780 INFO:tasks.workunit.client.0.smithi063.stdout:9/389: rename d0/d13/c28 to d0/d13/d39/d42/c7c 0 2023-12-07T16:21:40.780 INFO:tasks.workunit.client.0.smithi063.stdout:9/390: read - d0/d13/d39/d42/d57/f76 zero size 2023-12-07T16:21:40.781 INFO:tasks.workunit.client.0.smithi063.stdout:9/391: chown d0/d7/f55 199 1 2023-12-07T16:21:40.781 INFO:tasks.workunit.client.0.smithi063.stdout:6/492: dread d0/d54/f56 [0,4194304] 0 2023-12-07T16:21:40.782 INFO:tasks.workunit.client.0.smithi063.stdout:0/495: symlink d4/dd/de/la2 0 2023-12-07T16:21:40.783 INFO:tasks.workunit.client.0.smithi063.stdout:7/415: symlink d2/d64/l9d 0 2023-12-07T16:21:40.784 INFO:tasks.workunit.client.0.smithi063.stdout:0/496: write d4/dd/de/d15/d52/d5b/f5d [66126,37311] 0 2023-12-07T16:21:40.785 INFO:tasks.workunit.client.0.smithi063.stdout:5/404: dread d1/d3/de/f1f [4194304,4194304] 0 2023-12-07T16:21:40.787 INFO:tasks.workunit.client.0.smithi063.stdout:7/416: truncate d2/d64/f8f 1139543 0 2023-12-07T16:21:40.787 INFO:tasks.workunit.client.1.smithi152.stdout:0/652: mkdir d0/d2f/d30/d6e/de0 0 2023-12-07T16:21:40.787 INFO:tasks.workunit.client.1.smithi152.stdout:3/655: creat d7/d10/d1a/d25/d4b/fca x:0 0 0 2023-12-07T16:21:40.787 INFO:tasks.workunit.client.1.smithi152.stdout:7/623: dread db/f18 [0,4194304] 0 2023-12-07T16:21:40.787 INFO:tasks.workunit.client.1.smithi152.stdout:2/610: dwrite d2/d1c/d2e/d57/db1/d90/f39 [0,4194304] 0 2023-12-07T16:21:40.788 INFO:tasks.workunit.client.1.smithi152.stdout:2/611: chown d2/d1c/d2e/d57/db1/d90/c7d 3 1 2023-12-07T16:21:40.788 INFO:tasks.workunit.client.0.smithi063.stdout:0/497: mknod d4/dd/de/d15/d52/d5b/d63/ca3 0 2023-12-07T16:21:40.789 INFO:tasks.workunit.client.1.smithi152.stdout:6/658: unlink d2/d4f/d83/d85/d19/d1f/dc7/dc9/l67 0 2023-12-07T16:21:40.791 INFO:tasks.workunit.client.0.smithi063.stdout:6/493: rename d0/d1e/d29/l4e to d0/lb1 0 2023-12-07T16:21:40.791 INFO:tasks.workunit.client.0.smithi063.stdout:5/405: write d1/d3/de/d1e/f1d [1912369,84185] 0 2023-12-07T16:21:40.794 INFO:tasks.workunit.client.0.smithi063.stdout:7/417: creat d2/d34/d5a/d5f/f9e x:0 0 0 2023-12-07T16:21:40.795 INFO:tasks.workunit.client.1.smithi152.stdout:4/571: rename d0/d3/d6/f2e to d0/d81/fa4 0 2023-12-07T16:21:40.795 INFO:tasks.workunit.client.1.smithi152.stdout:4/572: chown d0/d3/d6/dc/d39/d93/la3 5 1 2023-12-07T16:21:40.795 INFO:tasks.workunit.client.0.smithi063.stdout:5/406: rmdir d1/d31 39 2023-12-07T16:21:40.795 INFO:tasks.workunit.client.0.smithi063.stdout:6/494: write d0/ff [4062060,38552] 0 2023-12-07T16:21:40.796 INFO:tasks.workunit.client.1.smithi152.stdout:0/653: mknod d0/d27/d8c/ce1 0 2023-12-07T16:21:40.797 INFO:tasks.workunit.client.1.smithi152.stdout:3/656: mkdir d7/d10/d1a/dcb 0 2023-12-07T16:21:40.797 INFO:tasks.workunit.client.0.smithi063.stdout:7/418: rename d2/d37/d93 to d2/d34/d5a/d5f/d53/d9f 0 2023-12-07T16:21:40.797 INFO:tasks.workunit.client.1.smithi152.stdout:7/624: mknod db/d27/d5e/cc5 0 2023-12-07T16:21:40.798 INFO:tasks.workunit.client.0.smithi063.stdout:5/407: mkdir d1/d31/d56/d61/d5e/d6a/d7e 0 2023-12-07T16:21:40.798 INFO:tasks.workunit.client.0.smithi063.stdout:5/408: fdatasync d1/d31/d56/f67 0 2023-12-07T16:21:40.799 INFO:tasks.workunit.client.1.smithi152.stdout:2/612: symlink d2/d1c/d2e/d30/d42/d84/ld4 0 2023-12-07T16:21:40.800 INFO:tasks.workunit.client.1.smithi152.stdout:6/659: truncate d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/f40 1433065 0 2023-12-07T16:21:40.800 INFO:tasks.workunit.client.0.smithi063.stdout:5/409: dread d1/d3/de/d1e/f27 [0,4194304] 0 2023-12-07T16:21:40.801 INFO:tasks.workunit.client.1.smithi152.stdout:4/573: creat d0/d3/d6/dc/d3a/fa5 x:0 0 0 2023-12-07T16:21:40.801 INFO:tasks.workunit.client.1.smithi152.stdout:4/574: readlink d0/d3/d6/l51 0 2023-12-07T16:21:40.801 INFO:tasks.workunit.client.0.smithi063.stdout:6/495: rename d0/f19 to d0/d1e/d60/d68/d76/da4/fb2 0 2023-12-07T16:21:40.802 INFO:tasks.workunit.client.0.smithi063.stdout:5/410: unlink d1/d3/de/d1e/d25/c5d 0 2023-12-07T16:21:40.802 INFO:tasks.workunit.client.0.smithi063.stdout:7/419: write d2/d34/f54 [3791857,107107] 0 2023-12-07T16:21:40.803 INFO:tasks.workunit.client.1.smithi152.stdout:5/809: rename dd/de/d14/d19/da3/ddf/lff to dd/d91/dbe/l11d 0 2023-12-07T16:21:40.803 INFO:tasks.workunit.client.0.smithi063.stdout:5/411: rename d1/d3/d3a/f4c to d1/d3/d3a/d5a/f7f 0 2023-12-07T16:21:40.803 INFO:tasks.workunit.client.0.smithi063.stdout:5/412: fdatasync d1/d3/de/f16 0 2023-12-07T16:21:40.804 INFO:tasks.workunit.client.1.smithi152.stdout:0/654: getdents d0/d2f/d30/d6e/d77/d9f/dcb 0 2023-12-07T16:21:40.804 INFO:tasks.workunit.client.0.smithi063.stdout:7/420: mkdir d2/d37/da0 0 2023-12-07T16:21:40.805 INFO:tasks.workunit.client.1.smithi152.stdout:1/867: dwrite dc/d14/d18/d2d/d4a/d52/f69 [4194304,4194304] 0 2023-12-07T16:21:40.805 INFO:tasks.workunit.client.1.smithi152.stdout:3/657: creat d7/d10/d1a/d25/fcc x:0 0 0 2023-12-07T16:21:40.806 INFO:tasks.workunit.client.0.smithi063.stdout:2/491: dwrite d0/d21/d56/d11/d52/d63/f6b [0,4194304] 0 2023-12-07T16:21:40.806 INFO:tasks.workunit.client.0.smithi063.stdout:9/392: dwrite d0/f73 [0,4194304] 0 2023-12-07T16:21:40.806 INFO:tasks.workunit.client.0.smithi063.stdout:6/496: creat d0/d1e/d1d/d1f/d4b/fb3 x:0 0 0 2023-12-07T16:21:40.806 INFO:tasks.workunit.client.0.smithi063.stdout:6/497: chown d0/d1e/d60/d68/f7e 3864 1 2023-12-07T16:21:40.806 INFO:tasks.workunit.client.0.smithi063.stdout:9/393: write d0/f67 [2086543,78077] 0 2023-12-07T16:21:40.807 INFO:tasks.workunit.client.0.smithi063.stdout:9/394: truncate d0/d21/d64/f4c 1580060 0 2023-12-07T16:21:40.807 INFO:tasks.workunit.client.0.smithi063.stdout:5/413: creat d1/d3/f80 x:0 0 0 2023-12-07T16:21:40.808 INFO:tasks.workunit.client.0.smithi063.stdout:7/421: mknod d2/d64/ca1 0 2023-12-07T16:21:40.809 INFO:tasks.workunit.client.1.smithi152.stdout:7/625: truncate db/d27/d39/d41/d37/f67 3725983 0 2023-12-07T16:21:40.809 INFO:tasks.workunit.client.1.smithi152.stdout:7/626: write db/d27/fa4 [973968,85740] 0 2023-12-07T16:21:40.810 INFO:tasks.workunit.client.0.smithi063.stdout:6/498: dread d0/d17/fa9 [0,4194304] 0 2023-12-07T16:21:40.810 INFO:tasks.workunit.client.0.smithi063.stdout:6/499: chown d0/d1e/d1d/d1f/c8d 161944808 1 2023-12-07T16:21:40.811 INFO:tasks.workunit.client.1.smithi152.stdout:2/613: creat d2/d1c/d2e/d30/d33/fd5 x:0 0 0 2023-12-07T16:21:40.811 INFO:tasks.workunit.client.1.smithi152.stdout:2/614: truncate d2/d9/f2f 2189302 0 2023-12-07T16:21:40.812 INFO:tasks.workunit.client.0.smithi063.stdout:0/498: getdents d4/dd/de 0 2023-12-07T16:21:40.817 INFO:tasks.workunit.client.1.smithi152.stdout:6/660: creat d2/d4f/d83/d48/d70/fd9 x:0 0 0 2023-12-07T16:21:40.817 INFO:tasks.workunit.client.1.smithi152.stdout:4/575: creat d0/d3/d6/d2b/d56/d83/fa6 x:0 0 0 2023-12-07T16:21:40.818 INFO:tasks.workunit.client.1.smithi152.stdout:5/810: getdents dd/de/d14/d19/d74 0 2023-12-07T16:21:40.821 INFO:tasks.workunit.client.0.smithi063.stdout:9/395: creat d0/d13/d6f/f7d x:0 0 0 2023-12-07T16:21:40.821 INFO:tasks.workunit.client.1.smithi152.stdout:0/655: unlink d0/d27/d11/cdb 0 2023-12-07T16:21:40.823 INFO:tasks.workunit.client.1.smithi152.stdout:1/868: rename dc/d28/f55 to dc/d14/d90/da9/df5/f127 0 2023-12-07T16:21:40.823 INFO:tasks.workunit.client.1.smithi152.stdout:3/658: creat d7/dc/d3e/d62/d6d/d98/fcd x:0 0 0 2023-12-07T16:21:40.824 INFO:tasks.workunit.client.1.smithi152.stdout:7/627: mknod db/d1c/cc6 0 2023-12-07T16:21:40.827 INFO:tasks.workunit.client.1.smithi152.stdout:4/576: truncate d0/d17/f79 714787 0 2023-12-07T16:21:40.827 INFO:tasks.workunit.client.1.smithi152.stdout:4/577: chown d0/d3/d6/dc/c59 14932 1 2023-12-07T16:21:40.828 INFO:tasks.workunit.client.0.smithi063.stdout:7/422: rename d2/d34/d5a/d5f/d61/c65 to d2/d34/d5a/d5f/d78/d7c/d9b/ca2 0 2023-12-07T16:21:40.829 INFO:tasks.workunit.client.1.smithi152.stdout:7/628: write db/f5d [3519090,120593] 0 2023-12-07T16:21:40.829 INFO:tasks.workunit.client.1.smithi152.stdout:7/629: chown db/d27/c6c 22864 1 2023-12-07T16:21:40.830 INFO:tasks.workunit.client.0.smithi063.stdout:9/396: creat d0/d13/f7e x:0 0 0 2023-12-07T16:21:40.830 INFO:tasks.workunit.client.0.smithi063.stdout:9/397: truncate d0/d21/f71 275633 0 2023-12-07T16:21:40.831 INFO:tasks.workunit.client.1.smithi152.stdout:0/656: rename d0/d27/c5d to d0/d27/ce2 0 2023-12-07T16:21:40.833 INFO:tasks.workunit.client.1.smithi152.stdout:1/869: mknod dc/def/df6/c128 0 2023-12-07T16:21:40.835 INFO:tasks.workunit.client.1.smithi152.stdout:3/659: mknod d7/dc/d3e/d7d/cce 0 2023-12-07T16:21:40.839 INFO:tasks.workunit.client.0.smithi063.stdout:0/499: rename d4/dd/d26/c46 to d4/dd/de/d15/d59/ca4 0 2023-12-07T16:21:40.839 INFO:tasks.workunit.client.0.smithi063.stdout:5/414: getdents d1/d3/de/d1e/d25 0 2023-12-07T16:21:40.839 INFO:tasks.workunit.client.1.smithi152.stdout:4/578: creat d0/d3/d6/dc/d3a/d46/d80/fa7 x:0 0 0 2023-12-07T16:21:40.840 INFO:tasks.workunit.client.1.smithi152.stdout:2/615: dwrite d2/d1c/d2e/d5d/f7c [0,4194304] 0 2023-12-07T16:21:40.843 INFO:tasks.workunit.client.0.smithi063.stdout:2/492: dwrite d0/d21/f45 [0,4194304] 0 2023-12-07T16:21:40.844 INFO:tasks.workunit.client.0.smithi063.stdout:5/415: rename d1/d3/de/c59 to d1/d31/d56/d61/d5e/c81 0 2023-12-07T16:21:40.844 INFO:tasks.workunit.client.0.smithi063.stdout:5/416: chown d1/d3/de/d1e/d25/f53 61 1 2023-12-07T16:21:40.847 INFO:tasks.workunit.client.1.smithi152.stdout:7/630: truncate db/d27/d39/d41/f60 3050970 0 2023-12-07T16:21:40.847 INFO:tasks.workunit.client.1.smithi152.stdout:7/631: getdents db/d27/d5e/d45/da9 0 2023-12-07T16:21:40.850 INFO:tasks.workunit.client.0.smithi063.stdout:5/417: creat d1/d31/d56/d61/d5e/f82 x:0 0 0 2023-12-07T16:21:40.851 INFO:tasks.workunit.client.1.smithi152.stdout:0/657: symlink d0/dc/d3d/dab/le3 0 2023-12-07T16:21:40.851 INFO:tasks.workunit.client.1.smithi152.stdout:3/660: rename d7/dc/d3e/d6b/d80/da2 to d7/d10/d1a/d25/d3f/dcf 0 2023-12-07T16:21:40.853 INFO:tasks.workunit.client.1.smithi152.stdout:4/579: rmdir d0/d3/d6/dc 39 2023-12-07T16:21:40.853 INFO:tasks.workunit.client.1.smithi152.stdout:4/580: write d0/d3/d6/d36/d85/f94 [490867,108549] 0 2023-12-07T16:21:40.855 INFO:tasks.workunit.client.1.smithi152.stdout:4/581: write d0/d3/d6/f6a [1485865,106293] 0 2023-12-07T16:21:40.855 INFO:tasks.workunit.client.1.smithi152.stdout:4/582: chown d0/d3/d6/dc/d3a/d46/d4e/c7d 24 1 2023-12-07T16:21:40.857 INFO:tasks.workunit.client.0.smithi063.stdout:5/418: rename d1/d3/d3a/l74 to d1/l83 0 2023-12-07T16:21:40.859 INFO:tasks.workunit.client.1.smithi152.stdout:2/616: symlink d2/d1c/d52/da8/ld6 0 2023-12-07T16:21:40.861 INFO:tasks.workunit.client.1.smithi152.stdout:7/632: creat db/d27/d39/d41/d58/da5/fc7 x:0 0 0 2023-12-07T16:21:40.862 INFO:tasks.workunit.client.1.smithi152.stdout:3/661: mkdir d7/d10/dd0 0 2023-12-07T16:21:40.863 INFO:tasks.workunit.client.1.smithi152.stdout:4/583: creat d0/d3/d6/dc/d3a/d48/d4c/fa8 x:0 0 0 2023-12-07T16:21:40.863 INFO:tasks.workunit.client.1.smithi152.stdout:4/584: chown d0/d3/d6/d2b/c69 1970 1 2023-12-07T16:21:40.865 INFO:tasks.workunit.client.1.smithi152.stdout:2/617: mknod d2/d1c/d2e/d57/cd7 0 2023-12-07T16:21:40.867 INFO:tasks.workunit.client.0.smithi063.stdout:7/423: dwrite d2/d34/d46/f74 [0,4194304] 0 2023-12-07T16:21:40.867 INFO:tasks.workunit.client.0.smithi063.stdout:7/424: chown d2/d34/d5a/d5f/d2a/d7e/f86 3365049 1 2023-12-07T16:21:40.867 INFO:tasks.workunit.client.0.smithi063.stdout:7/425: stat d2/d34/f3b 0 2023-12-07T16:21:40.867 INFO:tasks.workunit.client.1.smithi152.stdout:7/633: unlink db/d27/d39/l89 0 2023-12-07T16:21:40.868 INFO:tasks.workunit.client.1.smithi152.stdout:3/662: rmdir d7/dc/d3e/d62/d6d/d81 39 2023-12-07T16:21:40.868 INFO:tasks.workunit.client.1.smithi152.stdout:3/663: write d7/d10/d1a/d25/f27 [1237664,116413] 0 2023-12-07T16:21:40.870 INFO:tasks.workunit.client.1.smithi152.stdout:4/585: creat d0/d17/d7f/fa9 x:0 0 0 2023-12-07T16:21:40.871 INFO:tasks.workunit.client.1.smithi152.stdout:7/634: symlink db/d68/d87/lc8 0 2023-12-07T16:21:40.879 INFO:tasks.workunit.client.1.smithi152.stdout:2/618: dread d2/d1c/d2e/d57/db1/d90/f39 [0,4194304] 0 2023-12-07T16:21:40.879 INFO:tasks.workunit.client.1.smithi152.stdout:4/586: rename d0/d3/d6/dc/d39/d93/d67 to d0/daa 0 2023-12-07T16:21:40.879 INFO:tasks.workunit.client.1.smithi152.stdout:2/619: fdatasync d2/d9/d51/d54/fb4 0 2023-12-07T16:21:40.879 INFO:tasks.workunit.client.1.smithi152.stdout:2/620: dread - d2/d1c/d52/f6b zero size 2023-12-07T16:21:40.879 INFO:tasks.workunit.client.1.smithi152.stdout:7/635: mkdir db/d27/d4d/dc9 0 2023-12-07T16:21:40.879 INFO:tasks.workunit.client.1.smithi152.stdout:7/636: chown db/d27/fa4 1757172 1 2023-12-07T16:21:40.879 INFO:tasks.workunit.client.1.smithi152.stdout:7/637: read - db/d27/d5e/d45/f81 zero size 2023-12-07T16:21:40.879 INFO:tasks.workunit.client.1.smithi152.stdout:2/621: write d2/d1c/d2e/d57/f68 [906169,10674] 0 2023-12-07T16:21:40.880 INFO:tasks.workunit.client.1.smithi152.stdout:3/664: mknod d7/cd1 0 2023-12-07T16:21:40.880 INFO:tasks.workunit.client.1.smithi152.stdout:3/665: write d7/dc/d3e/d62/d6d/fba [701192,18881] 0 2023-12-07T16:21:40.880 INFO:tasks.workunit.client.1.smithi152.stdout:4/587: truncate d0/d3/f2d 1805712 0 2023-12-07T16:21:40.881 INFO:tasks.workunit.client.1.smithi152.stdout:7/638: rmdir db/d27/d39/d41 39 2023-12-07T16:21:40.881 INFO:tasks.workunit.client.1.smithi152.stdout:7/639: chown f8 80 1 2023-12-07T16:21:40.881 INFO:tasks.workunit.client.1.smithi152.stdout:7/640: fdatasync db/d27/d5e/f48 0 2023-12-07T16:21:40.881 INFO:tasks.workunit.client.1.smithi152.stdout:4/588: read d0/d81/fa4 [2781266,68472] 0 2023-12-07T16:21:40.882 INFO:tasks.workunit.client.1.smithi152.stdout:2/622: creat d2/fd8 x:0 0 0 2023-12-07T16:21:40.887 INFO:tasks.workunit.client.1.smithi152.stdout:6/661: dwrite d2/d4f/d83/d48/d70/da7/db7/fd1 [0,4194304] 0 2023-12-07T16:21:40.889 INFO:tasks.workunit.client.1.smithi152.stdout:2/623: dread d2/d1c/d2e/f44 [0,4194304] 0 2023-12-07T16:21:40.890 INFO:tasks.workunit.client.1.smithi152.stdout:2/624: fdatasync d2/f5a 0 2023-12-07T16:21:40.890 INFO:tasks.workunit.client.1.smithi152.stdout:1/870: dwrite dc/d14/d90/fac [0,4194304] 0 2023-12-07T16:21:40.890 INFO:tasks.workunit.client.1.smithi152.stdout:1/871: write dc/d28/d4e/de8/f121 [34881,63373] 0 2023-12-07T16:21:40.891 INFO:tasks.workunit.client.1.smithi152.stdout:5/811: dwrite f8 [0,4194304] 0 2023-12-07T16:21:40.892 INFO:tasks.workunit.client.1.smithi152.stdout:5/812: readlink dd/de/d38/d3d/la2 0 2023-12-07T16:21:40.892 INFO:tasks.workunit.client.1.smithi152.stdout:5/813: chown dd/l5c 115155 1 2023-12-07T16:21:40.892 INFO:tasks.workunit.client.1.smithi152.stdout:5/814: chown dd/de/d38 59798 1 2023-12-07T16:21:40.892 INFO:tasks.workunit.client.1.smithi152.stdout:3/666: dread d7/d10/d1a/d2f/f26 [0,4194304] 0 2023-12-07T16:21:40.892 INFO:tasks.workunit.client.1.smithi152.stdout:3/667: fdatasync d7/d10/d1a/d2f/f18 0 2023-12-07T16:21:40.893 INFO:tasks.workunit.client.0.smithi063.stdout:6/500: dwrite d0/d17/d1a/f4c [0,4194304] 0 2023-12-07T16:21:40.893 INFO:tasks.workunit.client.0.smithi063.stdout:9/398: dwrite d0/f1a [4194304,4194304] 0 2023-12-07T16:21:40.893 INFO:tasks.workunit.client.0.smithi063.stdout:9/399: fdatasync d0/d13/d39/d42/f77 0 2023-12-07T16:21:40.893 INFO:tasks.workunit.client.0.smithi063.stdout:2/493: dwrite d0/d21/d56/d11/f58 [0,4194304] 0 2023-12-07T16:21:40.899 INFO:tasks.workunit.client.0.smithi063.stdout:5/419: dwrite d1/d31/d56/f67 [0,4194304] 0 2023-12-07T16:21:40.899 INFO:tasks.workunit.client.0.smithi063.stdout:5/420: truncate d1/f32 4690167 0 2023-12-07T16:21:40.899 INFO:tasks.workunit.client.0.smithi063.stdout:5/421: fsync d1/d3/de/f14 0 2023-12-07T16:21:40.900 INFO:tasks.workunit.client.0.smithi063.stdout:7/426: dwrite d2/d2c/f75 [0,4194304] 0 2023-12-07T16:21:40.903 INFO:tasks.workunit.client.0.smithi063.stdout:5/422: creat d1/d31/d56/d61/d5e/d6a/d7e/f84 x:0 0 0 2023-12-07T16:21:40.905 INFO:tasks.workunit.client.0.smithi063.stdout:7/427: rmdir d2/d34/d46/d48 39 2023-12-07T16:21:40.907 INFO:tasks.workunit.client.0.smithi063.stdout:7/428: getdents d2/d34/d46/d48/d56 0 2023-12-07T16:21:40.909 INFO:tasks.workunit.client.0.smithi063.stdout:6/501: dread d0/d1e/d29/f36 [0,4194304] 0 2023-12-07T16:21:40.909 INFO:tasks.workunit.client.0.smithi063.stdout:7/429: rename d2/d34/d46/d5d to d2/d34/d5a/d5f/d53/da3 0 2023-12-07T16:21:40.910 INFO:tasks.workunit.client.0.smithi063.stdout:7/430: creat d2/d34/d5a/fa4 x:0 0 0 2023-12-07T16:21:40.922 INFO:tasks.workunit.client.0.smithi063.stdout:6/502: dread d0/d1e/d60/d68/d69/d7d/f86 [0,4194304] 0 2023-12-07T16:21:40.932 INFO:tasks.workunit.client.0.smithi063.stdout:2/494: dread d0/d21/d39/f4e [0,4194304] 0 2023-12-07T16:21:40.932 INFO:tasks.workunit.client.0.smithi063.stdout:2/495: read - d0/d21/d56/d11/f94 zero size 2023-12-07T16:21:40.932 INFO:tasks.workunit.client.0.smithi063.stdout:2/496: chown d0/d4a/f5e 50 1 2023-12-07T16:21:40.932 INFO:tasks.workunit.client.0.smithi063.stdout:2/497: stat d0/d21/d56/d11 0 2023-12-07T16:21:40.932 INFO:tasks.workunit.client.0.smithi063.stdout:2/498: readlink d0/d67/d65/d6a/la6 0 2023-12-07T16:21:40.933 INFO:tasks.workunit.client.0.smithi063.stdout:2/499: rmdir d0/d21/d56/d11 39 2023-12-07T16:21:40.934 INFO:tasks.workunit.client.0.smithi063.stdout:2/500: truncate d0/d1e/f3e 1007662 0 2023-12-07T16:21:40.938 INFO:tasks.workunit.client.0.smithi063.stdout:9/400: dwrite d0/d13/f5d [4194304,4194304] 0 2023-12-07T16:21:40.939 INFO:tasks.workunit.client.0.smithi063.stdout:9/401: getdents d0/d13 0 2023-12-07T16:21:40.941 INFO:tasks.workunit.client.0.smithi063.stdout:9/402: creat d0/d13/d39/d3a/d78/f7f x:0 0 0 2023-12-07T16:21:40.943 INFO:tasks.workunit.client.0.smithi063.stdout:2/501: dread d0/d1e/f90 [0,4194304] 0 2023-12-07T16:21:40.944 INFO:tasks.workunit.client.0.smithi063.stdout:2/502: getdents d0/d67 0 2023-12-07T16:21:40.947 INFO:tasks.workunit.client.0.smithi063.stdout:6/503: dwrite d0/d17/d1a/d38/f62 [0,4194304] 0 2023-12-07T16:21:40.948 INFO:tasks.workunit.client.0.smithi063.stdout:5/423: dwrite d1/d3/de/d1e/f1d [0,4194304] 0 2023-12-07T16:21:40.949 INFO:tasks.workunit.client.1.smithi152.stdout:7/641: rename db/d27/d39/d41/d58/f8a to db/d27/d39/d41/d58/da5/fca 0 2023-12-07T16:21:40.949 INFO:tasks.workunit.client.1.smithi152.stdout:7/642: truncate db/d27/d5e/d45/fab 499527 0 2023-12-07T16:21:40.951 INFO:tasks.workunit.client.0.smithi063.stdout:9/403: dread d0/d13/f49 [0,4194304] 0 2023-12-07T16:21:40.951 INFO:tasks.workunit.client.0.smithi063.stdout:9/404: dread - d0/d21/d64/d6a/f79 zero size 2023-12-07T16:21:40.954 INFO:tasks.workunit.client.1.smithi152.stdout:6/662: creat d2/d4f/d83/d85/d65/fda x:0 0 0 2023-12-07T16:21:40.956 INFO:tasks.workunit.client.0.smithi063.stdout:6/504: dread d0/ff [0,4194304] 0 2023-12-07T16:21:40.957 INFO:tasks.workunit.client.1.smithi152.stdout:2/625: mkdir d2/d1c/d2e/d5d/dab/dd9 0 2023-12-07T16:21:40.959 INFO:tasks.workunit.client.0.smithi063.stdout:6/505: symlink d0/d1e/d60/d68/d78/d9c/d9f/lb4 0 2023-12-07T16:21:40.961 INFO:tasks.workunit.client.0.smithi063.stdout:6/506: unlink d0/d1e/cc 0 2023-12-07T16:21:40.962 INFO:tasks.workunit.client.1.smithi152.stdout:1/872: creat dc/d14/d18/d79/d86/f129 x:0 0 0 2023-12-07T16:21:40.963 INFO:tasks.workunit.client.0.smithi063.stdout:9/405: dread d0/f31 [0,4194304] 0 2023-12-07T16:21:40.964 INFO:tasks.workunit.client.0.smithi063.stdout:9/406: dread - d0/d13/f40 zero size 2023-12-07T16:21:40.964 INFO:tasks.workunit.client.0.smithi063.stdout:9/407: chown d0/d13/l72 22228 1 2023-12-07T16:21:40.964 INFO:tasks.workunit.client.0.smithi063.stdout:5/424: dread d1/d3/f35 [0,4194304] 0 2023-12-07T16:21:40.965 INFO:tasks.workunit.client.0.smithi063.stdout:6/507: rename d0/d1e/d60/d68/d78/d9c/d9f/lb4 to d0/d1e/d60/d68/d76/lb5 0 2023-12-07T16:21:40.967 INFO:tasks.workunit.client.0.smithi063.stdout:9/408: write d0/d21/d64/d6a/f75 [360270,112248] 0 2023-12-07T16:21:40.967 INFO:tasks.workunit.client.0.smithi063.stdout:9/409: write d0/d21/d64/d6a/f79 [208384,9389] 0 2023-12-07T16:21:40.967 INFO:tasks.workunit.client.0.smithi063.stdout:5/425: unlink d1/d3/f17 0 2023-12-07T16:21:40.967 INFO:tasks.workunit.client.0.smithi063.stdout:5/426: dread - d1/d3/d3a/d5a/f7f zero size 2023-12-07T16:21:40.971 INFO:tasks.workunit.client.1.smithi152.stdout:5/815: mkdir dd/de/d38/d3d/dd3/d11e 0 2023-12-07T16:21:40.971 INFO:tasks.workunit.client.1.smithi152.stdout:9/739: sync 2023-12-07T16:21:40.972 INFO:tasks.workunit.client.0.smithi063.stdout:2/503: dwrite d0/d4a/f5e [0,4194304] 0 2023-12-07T16:21:40.972 INFO:tasks.workunit.client.0.smithi063.stdout:2/504: readlink d0/d67/d5b/l87 0 2023-12-07T16:21:40.973 INFO:tasks.workunit.client.1.smithi152.stdout:3/668: creat d7/d10/d1a/d25/fd2 x:0 0 0 2023-12-07T16:21:40.975 INFO:tasks.workunit.client.1.smithi152.stdout:4/589: rename d0/d3/d6/dc/d22/l50 to d0/d3/d6/dc/d3a/d46/d80/lab 0 2023-12-07T16:21:40.975 INFO:tasks.workunit.client.1.smithi152.stdout:4/590: truncate d0/d3/d6/dc/d3a/d48/f5d 1204424 0 2023-12-07T16:21:40.976 INFO:tasks.workunit.client.0.smithi063.stdout:2/505: mkdir d0/d21/d56/d11/d52/dad 0 2023-12-07T16:21:40.976 INFO:tasks.workunit.client.0.smithi063.stdout:2/506: dread - d0/d21/d56/f70 zero size 2023-12-07T16:21:40.977 INFO:tasks.workunit.client.0.smithi063.stdout:2/507: write d0/d1e/f3e [662941,75260] 0 2023-12-07T16:21:40.977 INFO:tasks.workunit.client.0.smithi063.stdout:2/508: write d0/f10 [5745456,64742] 0 2023-12-07T16:21:40.978 INFO:tasks.workunit.client.1.smithi152.stdout:6/663: unlink d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/c52 0 2023-12-07T16:21:40.983 INFO:tasks.workunit.client.1.smithi152.stdout:2/626: mkdir d2/d1c/d2e/d5d/dab/dd9/dda 0 2023-12-07T16:21:40.985 INFO:tasks.workunit.client.1.smithi152.stdout:5/816: symlink dd/d7b/l11f 0 2023-12-07T16:21:40.985 INFO:tasks.workunit.client.1.smithi152.stdout:5/817: write dd/de/d8f/dc9/ffd [1014309,47040] 0 2023-12-07T16:21:40.986 INFO:tasks.workunit.client.1.smithi152.stdout:7/643: dwrite db/d27/d4d/f6d [0,4194304] 0 2023-12-07T16:21:40.986 INFO:tasks.workunit.client.1.smithi152.stdout:9/740: mknod d1/d9/d2d/d46/d9a/cf6 0 2023-12-07T16:21:40.986 INFO:tasks.workunit.client.0.smithi063.stdout:5/427: write d1/f2a [6708623,66641] 0 2023-12-07T16:21:40.986 INFO:tasks.workunit.client.0.smithi063.stdout:6/508: dread d0/d1e/d60/d68/d76/da4/fb2 [0,4194304] 0 2023-12-07T16:21:40.988 INFO:tasks.workunit.client.0.smithi063.stdout:6/509: mknod d0/d17/d1a/d4d/d5a/d9d/cb6 0 2023-12-07T16:21:40.988 INFO:tasks.workunit.client.1.smithi152.stdout:3/669: getdents d7/dc/d3e/d6b/d80/dc2 0 2023-12-07T16:21:40.988 INFO:tasks.workunit.client.1.smithi152.stdout:3/670: chown d7/d10/d1a/d25/f76 0 1 2023-12-07T16:21:40.988 INFO:tasks.workunit.client.1.smithi152.stdout:3/671: readlink d7/d10/l36 0 2023-12-07T16:21:40.989 INFO:tasks.workunit.client.1.smithi152.stdout:3/672: chown d7/d10/d1a/d2f/f1d 42331 1 2023-12-07T16:21:40.989 INFO:tasks.workunit.client.1.smithi152.stdout:4/591: rmdir d0/d3/d6/d2b/d56/d83 39 2023-12-07T16:21:40.989 INFO:tasks.workunit.client.1.smithi152.stdout:4/592: stat d0/daa/f47 0 2023-12-07T16:21:40.989 INFO:tasks.workunit.client.1.smithi152.stdout:4/593: dread - d0/d3/d6/f35 zero size 2023-12-07T16:21:40.991 INFO:tasks.workunit.client.0.smithi063.stdout:5/428: link d1/d3/de/f14 d1/d3/d3a/d5a/f85 0 2023-12-07T16:21:40.991 INFO:tasks.workunit.client.0.smithi063.stdout:5/429: chown d1/d3/f35 24846337 1 2023-12-07T16:21:40.991 INFO:tasks.workunit.client.0.smithi063.stdout:5/430: dread - d1/d31/d56/f73 zero size 2023-12-07T16:21:40.991 INFO:tasks.workunit.client.1.smithi152.stdout:6/664: creat d2/d4f/d83/d48/d70/fdb x:0 0 0 2023-12-07T16:21:40.992 INFO:tasks.workunit.client.0.smithi063.stdout:6/510: creat d0/d79/d94/fb7 x:0 0 0 2023-12-07T16:21:40.994 INFO:tasks.workunit.client.0.smithi063.stdout:6/511: mkdir d0/d1e/d60/d68/d78/d9c/d9f/db8 0 2023-12-07T16:21:40.995 INFO:tasks.workunit.client.1.smithi152.stdout:2/627: link d2/d9/d51/d54/d5c/la1 d2/d1c/d2e/d57/db1/d90/ldb 0 2023-12-07T16:21:40.996 INFO:tasks.workunit.client.1.smithi152.stdout:5/818: symlink dd/l120 0 2023-12-07T16:21:40.998 INFO:tasks.workunit.client.0.smithi063.stdout:5/431: dread d1/d3/f3b [0,4194304] 0 2023-12-07T16:21:40.998 INFO:tasks.workunit.client.0.smithi063.stdout:5/432: write d1/d31/d56/d61/d5e/f75 [270215,41917] 0 2023-12-07T16:21:40.998 INFO:tasks.workunit.client.0.smithi063.stdout:6/512: mkdir d0/d79/db9 0 2023-12-07T16:21:40.999 INFO:tasks.workunit.client.1.smithi152.stdout:6/665: write d2/d4f/d83/d85/d94/f9f [3867748,61924] 0 2023-12-07T16:21:41.000 INFO:tasks.workunit.client.0.smithi063.stdout:5/433: rmdir d1/d3/de/d1e/d6b/d79 0 2023-12-07T16:21:41.001 INFO:tasks.workunit.client.1.smithi152.stdout:7/644: mkdir db/d27/d39/d41/dcb 0 2023-12-07T16:21:41.002 INFO:tasks.workunit.client.0.smithi063.stdout:6/513: link d0/d1e/f24 d0/d1e/d60/d68/d76/dae/fba 0 2023-12-07T16:21:41.003 INFO:tasks.workunit.client.1.smithi152.stdout:9/741: creat d1/d9/ff7 x:0 0 0 2023-12-07T16:21:41.003 INFO:tasks.workunit.client.1.smithi152.stdout:9/742: write d1/d17/d58/d86/fb8 [249719,130129] 0 2023-12-07T16:21:41.004 INFO:tasks.workunit.client.0.smithi063.stdout:5/434: read d1/d3/de/d1e/f24 [1191686,60967] 0 2023-12-07T16:21:41.004 INFO:tasks.workunit.client.0.smithi063.stdout:6/514: mknod d0/d79/d94/cbb 0 2023-12-07T16:21:41.004 INFO:tasks.workunit.client.1.smithi152.stdout:3/673: rmdir d7/d10/d1a/d25/d78 39 2023-12-07T16:21:41.005 INFO:tasks.workunit.client.0.smithi063.stdout:5/435: truncate d1/d31/d56/d61/f64 106951 0 2023-12-07T16:21:41.005 INFO:tasks.workunit.client.0.smithi063.stdout:5/436: write d1/f2e [4330325,12836] 0 2023-12-07T16:21:41.005 INFO:tasks.workunit.client.1.smithi152.stdout:7/645: mknod db/d27/d39/d41/d58/ccc 0 2023-12-07T16:21:41.007 INFO:tasks.workunit.client.1.smithi152.stdout:3/674: creat d7/dc/d3e/d6b/fd3 x:0 0 0 2023-12-07T16:21:41.010 INFO:tasks.workunit.client.1.smithi152.stdout:7/646: mknod db/d27/d5e/d45/da9/ccd 0 2023-12-07T16:21:41.010 INFO:tasks.workunit.client.1.smithi152.stdout:7/647: truncate db/d27/d4d/f69 991370 0 2023-12-07T16:21:41.010 INFO:tasks.workunit.client.1.smithi152.stdout:1/873: dwrite dc/d14/d18/fe4 [0,4194304] 0 2023-12-07T16:21:41.010 INFO:tasks.workunit.client.1.smithi152.stdout:1/874: truncate dc/def/f124 438976 0 2023-12-07T16:21:41.010 INFO:tasks.workunit.client.1.smithi152.stdout:5/819: dread dd/de/d14/d19/d1a/def/f69 [0,4194304] 0 2023-12-07T16:21:41.010 INFO:tasks.workunit.client.1.smithi152.stdout:9/743: dread d1/d9/d4f/fc4 [0,4194304] 0 2023-12-07T16:21:41.011 INFO:tasks.workunit.client.1.smithi152.stdout:9/744: write d1/d9/d4f/daf/fc2 [908296,14650] 0 2023-12-07T16:21:41.014 INFO:tasks.workunit.client.0.smithi063.stdout:6/515: dread d0/d1e/d1d/d1f/f21 [4194304,4194304] 0 2023-12-07T16:21:41.014 INFO:tasks.workunit.client.0.smithi063.stdout:6/516: write d0/d79/d94/fb7 [634562,102652] 0 2023-12-07T16:21:41.014 INFO:tasks.workunit.client.1.smithi152.stdout:7/648: creat db/d27/d5e/d45/da9/fce x:0 0 0 2023-12-07T16:21:41.015 INFO:tasks.workunit.client.1.smithi152.stdout:7/649: fdatasync db/d27/f3d 0 2023-12-07T16:21:41.018 INFO:tasks.workunit.client.1.smithi152.stdout:5/820: creat dd/de/d38/d3d/d6d/dae/f121 x:0 0 0 2023-12-07T16:21:41.018 INFO:tasks.workunit.client.1.smithi152.stdout:5/821: write dd/de/d38/f79 [4626794,74359] 0 2023-12-07T16:21:41.018 INFO:tasks.workunit.client.1.smithi152.stdout:5/822: dread - dd/de/d14/d19/d1a/f118 zero size 2023-12-07T16:21:41.020 INFO:tasks.workunit.client.1.smithi152.stdout:5/823: mkdir dd/de/d38/d3d/d6d/dae/d112/d122 0 2023-12-07T16:21:41.020 INFO:tasks.workunit.client.1.smithi152.stdout:8/713: sync 2023-12-07T16:21:41.020 INFO:tasks.workunit.client.1.smithi152.stdout:8/714: dread - d3/d4/d9/dc/d6f/d7a/d8a/f62 zero size 2023-12-07T16:21:41.021 INFO:tasks.workunit.client.1.smithi152.stdout:8/715: mkdir d3/d4/d9/d23/d4c/da6/d106 0 2023-12-07T16:21:41.021 INFO:tasks.workunit.client.1.smithi152.stdout:8/716: readlink d3/d4/d9/dc/d6f/d7a/d101/l105 0 2023-12-07T16:21:41.022 INFO:tasks.workunit.client.0.smithi063.stdout:6/517: write d0/fe [1570437,90319] 0 2023-12-07T16:21:41.022 INFO:tasks.workunit.client.1.smithi152.stdout:3/675: write d7/dc/d14/f39 [303826,5856] 0 2023-12-07T16:21:41.022 INFO:tasks.workunit.client.1.smithi152.stdout:3/676: chown d7/d10/d1a/d2f/f1d 14157670 1 2023-12-07T16:21:41.023 INFO:tasks.workunit.client.1.smithi152.stdout:9/745: dread d1/d17/d3c/d4a/d48/f56 [0,4194304] 0 2023-12-07T16:21:41.024 INFO:tasks.workunit.client.0.smithi063.stdout:9/410: dwrite d0/f1a [0,4194304] 0 2023-12-07T16:21:41.024 INFO:tasks.workunit.client.0.smithi063.stdout:9/411: read d0/d7/f55 [206248,26227] 0 2023-12-07T16:21:41.025 INFO:tasks.workunit.client.1.smithi152.stdout:3/677: mkdir d7/d10/d1a/d25/d78/dd4 0 2023-12-07T16:21:41.025 INFO:tasks.workunit.client.0.smithi063.stdout:9/412: write d0/d13/f3d [259992,124974] 0 2023-12-07T16:21:41.025 INFO:tasks.workunit.client.0.smithi063.stdout:9/413: stat d0/d13/d39/f48 0 2023-12-07T16:21:41.025 INFO:tasks.workunit.client.0.smithi063.stdout:2/509: dwrite d0/d21/d39/f51 [0,4194304] 0 2023-12-07T16:21:41.027 INFO:tasks.workunit.client.1.smithi152.stdout:5/824: rmdir dd/d91/dbe/d10e/dda 0 2023-12-07T16:21:41.027 INFO:tasks.workunit.client.1.smithi152.stdout:5/825: write dd/d91/dbe/d10e/f116 [246100,11728] 0 2023-12-07T16:21:41.028 INFO:tasks.workunit.client.1.smithi152.stdout:9/746: mkdir d1/d9/db/df/d42/de8/df8 0 2023-12-07T16:21:41.028 INFO:tasks.workunit.client.1.smithi152.stdout:9/747: chown d1/d9/db/df/c22 860414 1 2023-12-07T16:21:41.028 INFO:tasks.workunit.client.1.smithi152.stdout:9/748: chown c0 12 1 2023-12-07T16:21:41.028 INFO:tasks.workunit.client.1.smithi152.stdout:7/650: dread db/d27/f3d [0,4194304] 0 2023-12-07T16:21:41.028 INFO:tasks.workunit.client.1.smithi152.stdout:8/717: write d3/d4/d9/dc/feb [4013534,86649] 0 2023-12-07T16:21:41.030 INFO:tasks.workunit.client.1.smithi152.stdout:9/749: creat d1/d9/d2d/d65/ff9 x:0 0 0 2023-12-07T16:21:41.030 INFO:tasks.workunit.client.1.smithi152.stdout:8/718: dread d3/d4/d9/dc/d6f/d7b/d7e/df5/d67/d7d/f87 [0,4194304] 0 2023-12-07T16:21:41.031 INFO:tasks.workunit.client.1.smithi152.stdout:5/826: dread dd/d91/fa1 [0,4194304] 0 2023-12-07T16:21:41.032 INFO:tasks.workunit.client.1.smithi152.stdout:9/750: mknod d1/d9/d2d/d65/cfa 0 2023-12-07T16:21:41.034 INFO:tasks.workunit.client.1.smithi152.stdout:8/719: unlink d3/c76 0 2023-12-07T16:21:41.035 INFO:tasks.workunit.client.1.smithi152.stdout:5/827: mkdir dd/de/d17/d123 0 2023-12-07T16:21:41.035 INFO:tasks.workunit.client.1.smithi152.stdout:5/828: chown dd/de/d14/d19/d74/fdd 326716 1 2023-12-07T16:21:41.035 INFO:tasks.workunit.client.1.smithi152.stdout:5/829: chown dd/de/d14/d19/d1a/fc7 33 1 2023-12-07T16:21:41.037 INFO:tasks.workunit.client.1.smithi152.stdout:8/720: link d3/d4/d9/f38 d3/d1e/d55/d83/f107 0 2023-12-07T16:21:41.037 INFO:tasks.workunit.client.1.smithi152.stdout:5/830: creat dd/de/d14/d1f/f124 x:0 0 0 2023-12-07T16:21:41.040 INFO:tasks.workunit.client.1.smithi152.stdout:8/721: creat d3/d1e/d55/d83/f108 x:0 0 0 2023-12-07T16:21:41.040 INFO:tasks.workunit.client.1.smithi152.stdout:4/594: dwrite d0/d3/d6/d2b/fa1 [0,4194304] 0 2023-12-07T16:21:41.042 INFO:tasks.workunit.client.1.smithi152.stdout:5/831: symlink dd/de/d14/d19/d7a/l125 0 2023-12-07T16:21:41.042 INFO:tasks.workunit.client.1.smithi152.stdout:5/832: write dd/de/d14/d19/d1a/f118 [856190,117322] 0 2023-12-07T16:21:41.042 INFO:tasks.workunit.client.1.smithi152.stdout:5/833: fdatasync dd/de/d14/d1f/f20 0 2023-12-07T16:21:41.044 INFO:tasks.workunit.client.1.smithi152.stdout:6/666: dwrite d2/d4f/d83/d85/f6a [0,4194304] 0 2023-12-07T16:21:41.044 INFO:tasks.workunit.client.1.smithi152.stdout:8/722: rename d3/d4/d9/dc/d6f/d7b/d7e/df5/lce to d3/d4/d9/dc/d6f/d7b/d7e/l109 0 2023-12-07T16:21:41.044 INFO:tasks.workunit.client.1.smithi152.stdout:8/723: truncate d3/d4/d9/dc/d6f/fc9 677202 0 2023-12-07T16:21:41.046 INFO:tasks.workunit.client.0.smithi063.stdout:9/414: dread d0/d13/f5d [4194304,4194304] 0 2023-12-07T16:21:41.046 INFO:tasks.workunit.client.0.smithi063.stdout:9/415: readlink d0/l27 0 2023-12-07T16:21:41.046 INFO:tasks.workunit.client.0.smithi063.stdout:9/416: fsync d0/d7/f6d 0 2023-12-07T16:21:41.047 INFO:tasks.workunit.client.0.smithi063.stdout:9/417: symlink d0/d13/d39/d3a/d78/l80 0 2023-12-07T16:21:41.049 INFO:tasks.workunit.client.1.smithi152.stdout:7/651: dread db/d27/d39/d63/f77 [0,4194304] 0 2023-12-07T16:21:41.051 INFO:tasks.workunit.client.1.smithi152.stdout:0/658: sync 2023-12-07T16:21:41.051 INFO:tasks.workunit.client.1.smithi152.stdout:4/595: rename d0/d81/fa4 to d0/d3/d6/dc/d3a/d46/fac 0 2023-12-07T16:21:41.058 INFO:tasks.workunit.client.1.smithi152.stdout:7/652: symlink db/d27/d39/d41/dcb/lcf 0 2023-12-07T16:21:41.061 INFO:tasks.workunit.client.1.smithi152.stdout:2/628: dwrite d2/d1c/fc8 [0,4194304] 0 2023-12-07T16:21:41.062 INFO:tasks.workunit.client.1.smithi152.stdout:5/834: rename dd/de/d14/d1f/d49/f73 to dd/de/d14/d19/d74/f126 0 2023-12-07T16:21:41.062 INFO:tasks.workunit.client.1.smithi152.stdout:5/835: chown dd/d7b/fc1 24554 1 2023-12-07T16:21:41.062 INFO:tasks.workunit.client.1.smithi152.stdout:5/836: fsync dd/ddb/f115 0 2023-12-07T16:21:41.062 INFO:tasks.workunit.client.1.smithi152.stdout:5/837: write dd/de/d14/d19/d1a/def/f69 [5060188,50739] 0 2023-12-07T16:21:41.062 INFO:tasks.workunit.client.1.smithi152.stdout:5/838: chown dd/de/d38/d3d/d6d 0 1 2023-12-07T16:21:41.063 INFO:tasks.workunit.client.1.smithi152.stdout:4/596: mkdir d0/d3/d6/dc/d3a/d46/dad 0 2023-12-07T16:21:41.065 INFO:tasks.workunit.client.1.smithi152.stdout:7/653: mkdir db/d1c/dd0 0 2023-12-07T16:21:41.065 INFO:tasks.workunit.client.0.smithi063.stdout:5/437: dwrite d1/d31/d56/f73 [0,4194304] 0 2023-12-07T16:21:41.068 INFO:tasks.workunit.client.0.smithi063.stdout:2/510: getdents d0/d21/d56/d11/d52 0 2023-12-07T16:21:41.070 INFO:tasks.workunit.client.0.smithi063.stdout:2/511: read d0/d67/d5b/f78 [641893,63354] 0 2023-12-07T16:21:41.070 INFO:tasks.workunit.client.0.smithi063.stdout:2/512: readlink d0/d1e/l86 0 2023-12-07T16:21:41.070 INFO:tasks.workunit.client.1.smithi152.stdout:2/629: link d2/d1c/d2e/d5d/c60 d2/d1c/d2e/d57/db1/d90/cdc 0 2023-12-07T16:21:41.070 INFO:tasks.workunit.client.1.smithi152.stdout:2/630: getdents d2/d1c/d2e/d57/d5b/da7/d8a 0 2023-12-07T16:21:41.071 INFO:tasks.workunit.client.1.smithi152.stdout:2/631: write f1 [5458672,93070] 0 2023-12-07T16:21:41.072 INFO:tasks.workunit.client.1.smithi152.stdout:5/839: unlink dd/de/d14/d19/d1a/def/ld4 0 2023-12-07T16:21:41.073 INFO:tasks.workunit.client.1.smithi152.stdout:4/597: symlink d0/d3/d6/d2b/d56/d83/lae 0 2023-12-07T16:21:41.073 INFO:tasks.workunit.client.1.smithi152.stdout:4/598: chown d0/f1 156 1 2023-12-07T16:21:41.074 INFO:tasks.workunit.client.1.smithi152.stdout:7/654: creat db/d27/d39/d41/d58/d80/fd1 x:0 0 0 2023-12-07T16:21:41.075 INFO:tasks.workunit.client.1.smithi152.stdout:7/655: read db/d27/d5e/d45/f82 [840874,83724] 0 2023-12-07T16:21:41.075 INFO:tasks.workunit.client.1.smithi152.stdout:2/632: mkdir d2/d1c/d2e/d57/d5b/da7/ddd 0 2023-12-07T16:21:41.076 INFO:tasks.workunit.client.0.smithi063.stdout:2/513: creat d0/d1e/fae x:0 0 0 2023-12-07T16:21:41.076 INFO:tasks.workunit.client.0.smithi063.stdout:2/514: read - d0/d21/d56/fa2 zero size 2023-12-07T16:21:41.076 INFO:tasks.workunit.client.0.smithi063.stdout:2/515: write d0/d21/d56/d11/f94 [220787,78255] 0 2023-12-07T16:21:41.077 INFO:tasks.workunit.client.0.smithi063.stdout:2/516: chown d0/d67/c53 467818409 1 2023-12-07T16:21:41.078 INFO:tasks.workunit.client.1.smithi152.stdout:5/840: getdents dd/de/d38/d3d/d6d 0 2023-12-07T16:21:41.078 INFO:tasks.workunit.client.0.smithi063.stdout:5/438: symlink d1/l86 0 2023-12-07T16:21:41.078 INFO:tasks.workunit.client.0.smithi063.stdout:5/439: chown d1/d31/d56/d61/d5e/f75 5413 1 2023-12-07T16:21:41.079 INFO:tasks.workunit.client.1.smithi152.stdout:3/678: dwrite d7/d10/d41/f8b [0,4194304] 0 2023-12-07T16:21:41.079 INFO:tasks.workunit.client.1.smithi152.stdout:5/841: write dd/f40 [195847,124563] 0 2023-12-07T16:21:41.080 INFO:tasks.workunit.client.0.smithi063.stdout:2/517: truncate d0/d1e/f76 3377196 0 2023-12-07T16:21:41.080 INFO:tasks.workunit.client.0.smithi063.stdout:9/418: dwrite d0/d13/f49 [0,4194304] 0 2023-12-07T16:21:41.080 INFO:tasks.workunit.client.1.smithi152.stdout:0/659: dwrite d0/d2f/f74 [0,4194304] 0 2023-12-07T16:21:41.080 INFO:tasks.workunit.client.1.smithi152.stdout:2/633: truncate d2/d1c/d2e/d30/d42/f6d 2831891 0 2023-12-07T16:21:41.080 INFO:tasks.workunit.client.1.smithi152.stdout:6/667: dwrite d2/d4f/d83/d48/d70/fd9 [0,4194304] 0 2023-12-07T16:21:41.081 INFO:tasks.workunit.client.1.smithi152.stdout:4/599: creat d0/d3/d6/dc/d22/faf x:0 0 0 2023-12-07T16:21:41.081 INFO:tasks.workunit.client.1.smithi152.stdout:9/751: dwrite d1/d9/f20 [4194304,4194304] 0 2023-12-07T16:21:41.081 INFO:tasks.workunit.client.0.smithi063.stdout:5/440: symlink d1/d31/d56/l87 0 2023-12-07T16:21:41.082 INFO:tasks.workunit.client.0.smithi063.stdout:2/518: read d0/d21/d39/f51 [2596313,65448] 0 2023-12-07T16:21:41.082 INFO:tasks.workunit.client.0.smithi063.stdout:2/519: chown d0/d67/d65/fa5 1 1 2023-12-07T16:21:41.082 INFO:tasks.workunit.client.0.smithi063.stdout:6/518: dwrite d0/d17/d46/f55 [0,4194304] 0 2023-12-07T16:21:41.082 INFO:tasks.workunit.client.0.smithi063.stdout:6/519: chown d0/d1e/d1d 61648893 1 2023-12-07T16:21:41.082 INFO:tasks.workunit.client.0.smithi063.stdout:9/419: creat d0/d13/d39/d3a/f81 x:0 0 0 2023-12-07T16:21:41.083 INFO:tasks.workunit.client.1.smithi152.stdout:2/634: write d2/d56/da0/fad [1807269,93649] 0 2023-12-07T16:21:41.084 INFO:tasks.workunit.client.0.smithi063.stdout:2/520: truncate d0/d67/f55 683579 0 2023-12-07T16:21:41.084 INFO:tasks.workunit.client.0.smithi063.stdout:2/521: fsync d0/d1e/f3e 0 2023-12-07T16:21:41.085 INFO:tasks.workunit.client.1.smithi152.stdout:5/842: creat dd/d91/f127 x:0 0 0 2023-12-07T16:21:41.090 INFO:tasks.workunit.client.0.smithi063.stdout:6/520: rename d0/d17/d1a/d4d/d5a/d9d/cb6 to d0/d1e/d60/d68/d69/d7d/cbc 0 2023-12-07T16:21:41.090 INFO:tasks.workunit.client.0.smithi063.stdout:9/420: rename d0/d13/d39/d3a/d78 to d0/d13/d39/d3a/d78/d82 22 2023-12-07T16:21:41.090 INFO:tasks.workunit.client.0.smithi063.stdout:9/421: dread - d0/d13/f40 zero size 2023-12-07T16:21:41.090 INFO:tasks.workunit.client.0.smithi063.stdout:6/521: write d0/d1e/d1d/d1f/d6c/f90 [605365,20181] 0 2023-12-07T16:21:41.090 INFO:tasks.workunit.client.1.smithi152.stdout:5/843: dread dd/de/d14/d19/f8c [0,4194304] 0 2023-12-07T16:21:41.091 INFO:tasks.workunit.client.0.smithi063.stdout:5/441: dread d1/d31/f33 [0,4194304] 0 2023-12-07T16:21:41.091 INFO:tasks.workunit.client.0.smithi063.stdout:2/522: unlink d0/d67/d65/d6a/d8e/caa 0 2023-12-07T16:21:41.092 INFO:tasks.workunit.client.1.smithi152.stdout:0/660: dread d0/d2f/f3f [0,4194304] 0 2023-12-07T16:21:41.092 INFO:tasks.workunit.client.1.smithi152.stdout:4/600: symlink d0/d3/d6/dc/d3a/d46/d80/lb0 0 2023-12-07T16:21:41.092 INFO:tasks.workunit.client.1.smithi152.stdout:4/601: fsync d0/d3/d6/dc/d39/d93/f9c 0 2023-12-07T16:21:41.094 INFO:tasks.workunit.client.0.smithi063.stdout:9/422: link d0/d13/c35 d0/d7/c83 0 2023-12-07T16:21:41.095 INFO:tasks.workunit.client.0.smithi063.stdout:6/522: mknod d0/d1e/d60/d68/d76/cbd 0 2023-12-07T16:21:41.095 INFO:tasks.workunit.client.0.smithi063.stdout:6/523: truncate d0/d17/d1a/d38/f75 4676408 0 2023-12-07T16:21:41.096 INFO:tasks.workunit.client.0.smithi063.stdout:2/523: mkdir d0/d21/d56/d11/d52/da9/daf 0 2023-12-07T16:21:41.098 INFO:tasks.workunit.client.1.smithi152.stdout:9/752: symlink d1/d9/d4f/lfb 0 2023-12-07T16:21:41.098 INFO:tasks.workunit.client.1.smithi152.stdout:9/753: chown d1/d9/db/df/c22 63 1 2023-12-07T16:21:41.098 INFO:tasks.workunit.client.1.smithi152.stdout:9/754: write d1/f76 [877423,88404] 0 2023-12-07T16:21:41.100 INFO:tasks.workunit.client.0.smithi063.stdout:9/423: mknod d0/d21/c84 0 2023-12-07T16:21:41.100 INFO:tasks.workunit.client.0.smithi063.stdout:9/424: write d0/d13/d39/d42/d57/f76 [800440,123404] 0 2023-12-07T16:21:41.100 INFO:tasks.workunit.client.0.smithi063.stdout:2/524: mkdir d0/d21/d56/d11/db0 0 2023-12-07T16:21:41.101 INFO:tasks.workunit.client.1.smithi152.stdout:7/656: dwrite db/d27/d39/d41/f4f [0,4194304] 0 2023-12-07T16:21:41.101 INFO:tasks.workunit.client.1.smithi152.stdout:7/657: fsync db/d27/f3b 0 2023-12-07T16:21:41.102 INFO:tasks.workunit.client.1.smithi152.stdout:2/635: creat d2/d1c/d2e/d57/fde x:0 0 0 2023-12-07T16:21:41.102 INFO:tasks.workunit.client.1.smithi152.stdout:2/636: dread - d2/d1c/d2e/d30/d42/fcc zero size 2023-12-07T16:21:41.102 INFO:tasks.workunit.client.1.smithi152.stdout:2/637: chown d2/d1c/d2e 12 1 2023-12-07T16:21:41.104 INFO:tasks.workunit.client.0.smithi063.stdout:9/425: mkdir d0/d21/d64/d6a/d85 0 2023-12-07T16:21:41.104 INFO:tasks.workunit.client.0.smithi063.stdout:9/426: write d0/d13/d39/f48 [1009766,75348] 0 2023-12-07T16:21:41.104 INFO:tasks.workunit.client.0.smithi063.stdout:2/525: creat d0/d4a/fb1 x:0 0 0 2023-12-07T16:21:41.105 INFO:tasks.workunit.client.0.smithi063.stdout:2/526: truncate d0/d21/d56/d71/fa0 34302 0 2023-12-07T16:21:41.105 INFO:tasks.workunit.client.0.smithi063.stdout:2/527: read - d0/d21/d56/d11/f99 zero size 2023-12-07T16:21:41.109 INFO:tasks.workunit.client.0.smithi063.stdout:2/528: mkdir d0/d21/db2 0 2023-12-07T16:21:41.111 INFO:tasks.workunit.client.1.smithi152.stdout:8/724: rmdir d3/d4/d9/dc 39 2023-12-07T16:21:41.111 INFO:tasks.workunit.client.1.smithi152.stdout:8/725: read - d3/d1e/fd0 zero size 2023-12-07T16:21:41.111 INFO:tasks.workunit.client.0.smithi063.stdout:2/529: rmdir d0/d21/d56/d11/d52/d63 39 2023-12-07T16:21:41.112 INFO:tasks.workunit.client.0.smithi063.stdout:2/530: write d0/d21/d56/d71/fa0 [263032,26704] 0 2023-12-07T16:21:41.112 INFO:tasks.workunit.client.0.smithi063.stdout:5/442: dread d1/d31/d56/f73 [0,4194304] 0 2023-12-07T16:21:41.113 INFO:tasks.workunit.client.0.smithi063.stdout:2/531: mkdir d0/d67/d5b/db3 0 2023-12-07T16:21:41.115 INFO:tasks.workunit.client.0.smithi063.stdout:5/443: link d1/d3/de/d1e/f27 d1/d3/de/d1e/d6b/f88 0 2023-12-07T16:21:41.120 INFO:tasks.workunit.client.0.smithi063.stdout:2/532: unlink d0/d21/d56/d11/d52/l60 0 2023-12-07T16:21:41.120 INFO:tasks.workunit.client.1.smithi152.stdout:5/844: getdents dd/de/d38/d3d/d6d/dae/d112 0 2023-12-07T16:21:41.122 INFO:tasks.workunit.client.1.smithi152.stdout:0/661: creat d0/dc/d36/d3a/fe4 x:0 0 0 2023-12-07T16:21:41.123 INFO:tasks.workunit.client.1.smithi152.stdout:6/668: dwrite d2/d4f/d83/d85/d94/fb1 [0,4194304] 0 2023-12-07T16:21:41.123 INFO:tasks.workunit.client.1.smithi152.stdout:6/669: truncate d2/d4f/d83/d48/d70/fdb 978104 0 2023-12-07T16:21:41.123 INFO:tasks.workunit.client.1.smithi152.stdout:6/670: fsync d2/d4f/d83/d85/d19/d1f/dc7/dc9/fa3 0 2023-12-07T16:21:41.123 INFO:tasks.workunit.client.1.smithi152.stdout:6/671: dread - d2/d4f/d83/d85/d19/d1f/dc7/dc9/fbc zero size 2023-12-07T16:21:41.123 INFO:tasks.workunit.client.1.smithi152.stdout:6/672: chown d2/d4f/d83/d85/f89 13534489 1 2023-12-07T16:21:41.124 INFO:tasks.workunit.client.1.smithi152.stdout:4/602: mkdir d0/d3/d6/d2b/db1 0 2023-12-07T16:21:41.124 INFO:tasks.workunit.client.0.smithi063.stdout:5/444: write d1/d3/de/d1e/d6b/f7d [3592979,92000] 0 2023-12-07T16:21:41.125 INFO:tasks.workunit.client.1.smithi152.stdout:6/673: read d2/d4f/d83/d85/d19/d1f/dc7/dc9/fa4 [1265579,33921] 0 2023-12-07T16:21:41.126 INFO:tasks.workunit.client.1.smithi152.stdout:7/658: symlink db/d27/d39/ld2 0 2023-12-07T16:21:41.126 INFO:tasks.workunit.client.0.smithi063.stdout:5/445: write d1/d3/de/d1e/f47 [739631,108302] 0 2023-12-07T16:21:41.127 INFO:tasks.workunit.client.1.smithi152.stdout:2/638: mknod d2/dba/cdf 0 2023-12-07T16:21:41.127 INFO:tasks.workunit.client.0.smithi063.stdout:8/621: sync 2023-12-07T16:21:41.128 INFO:tasks.workunit.client.1.smithi152.stdout:8/726: symlink d3/d1e/d55/d83/dc5/df0/l10a 0 2023-12-07T16:21:41.128 INFO:tasks.workunit.client.1.smithi152.stdout:8/727: fdatasync d3/d4/d9/dc/d6f/d7b/d7e/d85/fd8 0 2023-12-07T16:21:41.128 INFO:tasks.workunit.client.0.smithi063.stdout:5/446: read d1/d31/d56/d61/f58 [31532,71272] 0 2023-12-07T16:21:41.129 INFO:tasks.workunit.client.0.smithi063.stdout:8/622: unlink d7/d14/d15/d2b/c32 0 2023-12-07T16:21:41.130 INFO:tasks.workunit.client.1.smithi152.stdout:3/679: dwrite d7/f8 [8388608,4194304] 0 2023-12-07T16:21:41.130 INFO:tasks.workunit.client.1.smithi152.stdout:3/680: dread - d7/dc/fa9 zero size 2023-12-07T16:21:41.130 INFO:tasks.workunit.client.1.smithi152.stdout:3/681: readlink d7/dc/d3e/d62/l94 0 2023-12-07T16:21:41.131 INFO:tasks.workunit.client.0.smithi063.stdout:6/524: dwrite d0/d17/d1a/d4d/f8e [0,4194304] 0 2023-12-07T16:21:41.131 INFO:tasks.workunit.client.0.smithi063.stdout:5/447: getdents d1/d31/d56/d61 0 2023-12-07T16:21:41.131 INFO:tasks.workunit.client.0.smithi063.stdout:6/525: fsync d0/d1e/d1d/d1f/d6c/fac 0 2023-12-07T16:21:41.131 INFO:tasks.workunit.client.0.smithi063.stdout:6/526: truncate d0/d17/d95/fa7 559747 0 2023-12-07T16:21:41.132 INFO:tasks.workunit.client.1.smithi152.stdout:5/845: symlink dd/de/d14/d19/d1a/def/l128 0 2023-12-07T16:21:41.132 INFO:tasks.workunit.client.1.smithi152.stdout:5/846: chown dd/de/d17/fce 4 1 2023-12-07T16:21:41.132 INFO:tasks.workunit.client.1.smithi152.stdout:5/847: dread - dd/de/d14/d1f/d49/fe1 zero size 2023-12-07T16:21:41.133 INFO:tasks.workunit.client.1.smithi152.stdout:0/662: creat d0/dc/d36/d3a/d69/fe5 x:0 0 0 2023-12-07T16:21:41.135 INFO:tasks.workunit.client.0.smithi063.stdout:5/448: truncate d1/d31/d56/f67 3216234 0 2023-12-07T16:21:41.137 INFO:tasks.workunit.client.0.smithi063.stdout:6/527: creat d0/d79/db9/fbe x:0 0 0 2023-12-07T16:21:41.139 INFO:tasks.workunit.client.1.smithi152.stdout:4/603: creat d0/d3/d6/d2b/d75/fb2 x:0 0 0 2023-12-07T16:21:41.143 INFO:tasks.workunit.client.0.smithi063.stdout:6/528: link d0/d17/d1a/f4c d0/d17/d46/fbf 0 2023-12-07T16:21:41.143 INFO:tasks.workunit.client.0.smithi063.stdout:6/529: readlink d0/d1e/d1d/d1f/l44 0 2023-12-07T16:21:41.143 INFO:tasks.workunit.client.0.smithi063.stdout:6/530: write d0/d1e/d1d/d1f/d4b/fb3 [926195,64794] 0 2023-12-07T16:21:41.144 INFO:tasks.workunit.client.1.smithi152.stdout:6/674: rmdir d2/d4f/d83/d58 39 2023-12-07T16:21:41.144 INFO:tasks.workunit.client.1.smithi152.stdout:9/755: dwrite d1/d17/d58/d86/fe1 [4194304,4194304] 0 2023-12-07T16:21:41.145 INFO:tasks.workunit.client.1.smithi152.stdout:7/659: getdents db/d27/d39/d41/d58/d80 0 2023-12-07T16:21:41.145 INFO:tasks.workunit.client.0.smithi063.stdout:2/533: dwrite d0/d4a/fb1 [0,4194304] 0 2023-12-07T16:21:41.146 INFO:tasks.workunit.client.1.smithi152.stdout:2/639: creat d2/fe0 x:0 0 0 2023-12-07T16:21:41.146 INFO:tasks.workunit.client.1.smithi152.stdout:2/640: dread - d2/d1c/d2e/d57/fb8 zero size 2023-12-07T16:21:41.147 INFO:tasks.workunit.client.0.smithi063.stdout:6/531: rename d0/d1e/d60/d68/f7e to d0/d17/d1a/d4d/d5a/fc0 0 2023-12-07T16:21:41.147 INFO:tasks.workunit.client.0.smithi063.stdout:9/427: getdents d0/d21/d64/d6a 0 2023-12-07T16:21:41.149 INFO:tasks.workunit.client.1.smithi152.stdout:3/682: creat d7/d10/d1a/d25/fd5 x:0 0 0 2023-12-07T16:21:41.150 INFO:tasks.workunit.client.1.smithi152.stdout:6/675: dread d2/d4f/d83/d85/d19/fca [0,4194304] 0 2023-12-07T16:21:41.151 INFO:tasks.workunit.client.1.smithi152.stdout:5/848: truncate dd/de/d17/f7f 2483973 0 2023-12-07T16:21:41.153 INFO:tasks.workunit.client.1.smithi152.stdout:4/604: getdents d0/d3/d6/d36 0 2023-12-07T16:21:41.153 INFO:tasks.workunit.client.1.smithi152.stdout:4/605: write d0/d3/d6/dc/d3a/d46/d80/fa7 [124740,66447] 0 2023-12-07T16:21:41.153 INFO:tasks.workunit.client.0.smithi063.stdout:6/532: write d0/f8 [973265,42085] 0 2023-12-07T16:21:41.155 INFO:tasks.workunit.client.1.smithi152.stdout:9/756: creat d1/d9/d2d/d72/d80/da4/ffc x:0 0 0 2023-12-07T16:21:41.156 INFO:tasks.workunit.client.1.smithi152.stdout:7/660: creat db/d27/d39/fd3 x:0 0 0 2023-12-07T16:21:41.156 INFO:tasks.workunit.client.1.smithi152.stdout:7/661: chown db/f18 1030644010 1 2023-12-07T16:21:41.156 INFO:tasks.workunit.client.1.smithi152.stdout:7/662: stat db/d27/d5e/d45 0 2023-12-07T16:21:41.157 INFO:tasks.workunit.client.1.smithi152.stdout:7/663: fsync db/d27/d5e/f54 0 2023-12-07T16:21:41.157 INFO:tasks.workunit.client.1.smithi152.stdout:2/641: getdents d2/d9/d51 0 2023-12-07T16:21:41.157 INFO:tasks.workunit.client.1.smithi152.stdout:2/642: truncate d2/d9/f2f 2651754 0 2023-12-07T16:21:41.159 INFO:tasks.workunit.client.0.smithi063.stdout:2/534: dread d0/d21/d56/f17 [0,4194304] 0 2023-12-07T16:21:41.159 INFO:tasks.workunit.client.0.smithi063.stdout:2/535: chown d0/d21/c2c 104 1 2023-12-07T16:21:41.159 INFO:tasks.workunit.client.0.smithi063.stdout:2/536: readlink d0/l2 0 2023-12-07T16:21:41.159 INFO:tasks.workunit.client.1.smithi152.stdout:3/683: mknod d7/d10/d1a/dc0/cd6 0 2023-12-07T16:21:41.159 INFO:tasks.workunit.client.1.smithi152.stdout:6/676: creat d2/d4f/d83/d48/d70/d81/fdc x:0 0 0 2023-12-07T16:21:41.159 INFO:tasks.workunit.client.1.smithi152.stdout:6/677: write d2/d4f/d83/d85/d65/fda [922958,6362] 0 2023-12-07T16:21:41.160 INFO:tasks.workunit.client.1.smithi152.stdout:6/678: dread - d2/d4f/d83/d85/f80 zero size 2023-12-07T16:21:41.160 INFO:tasks.workunit.client.1.smithi152.stdout:5/849: mkdir dd/de/d17/d123/d129 0 2023-12-07T16:21:41.160 INFO:tasks.workunit.client.1.smithi152.stdout:5/850: truncate dd/d7b/dbf/fc3 206509 0 2023-12-07T16:21:41.161 INFO:tasks.workunit.client.1.smithi152.stdout:7/664: mkdir db/d1c/dd4 0 2023-12-07T16:21:41.162 INFO:tasks.workunit.client.1.smithi152.stdout:7/665: stat db/d27/d39/d41/d58/d80/fd1 0 2023-12-07T16:21:41.162 INFO:tasks.workunit.client.1.smithi152.stdout:7/666: truncate db/d1c/f94 892668 0 2023-12-07T16:21:41.163 INFO:tasks.workunit.client.1.smithi152.stdout:5/851: read dd/d91/dbe/d10e/f8b [3850819,88697] 0 2023-12-07T16:21:41.164 INFO:tasks.workunit.client.1.smithi152.stdout:3/684: mknod d7/dc/d3e/cd7 0 2023-12-07T16:21:41.164 INFO:tasks.workunit.client.1.smithi152.stdout:3/685: write d7/d10/d1a/d25/d3f/dcf/fb3 [927059,8712] 0 2023-12-07T16:21:41.164 INFO:tasks.workunit.client.1.smithi152.stdout:3/686: chown d7/dc/d3e/d62 1 1 2023-12-07T16:21:41.166 INFO:tasks.workunit.client.0.smithi063.stdout:9/428: creat d0/f86 x:0 0 0 2023-12-07T16:21:41.166 INFO:tasks.workunit.client.0.smithi063.stdout:9/429: dread - d0/d13/d39/d3a/f74 zero size 2023-12-07T16:21:41.166 INFO:tasks.workunit.client.0.smithi063.stdout:9/430: stat d0 0 2023-12-07T16:21:41.167 INFO:tasks.workunit.client.1.smithi152.stdout:6/679: creat d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/d55/fdd x:0 0 0 2023-12-07T16:21:41.168 INFO:tasks.workunit.client.1.smithi152.stdout:6/680: chown d2/d4f/d83/d85/d19/d1f/d60/fcf 90066564 1 2023-12-07T16:21:41.169 INFO:tasks.workunit.client.0.smithi063.stdout:2/537: creat d0/d21/d56/d11/fb4 x:0 0 0 2023-12-07T16:21:41.169 INFO:tasks.workunit.client.0.smithi063.stdout:6/533: creat d0/d1e/d1d/d1f/d4b/fc1 x:0 0 0 2023-12-07T16:21:41.171 INFO:tasks.workunit.client.0.smithi063.stdout:9/431: rmdir d0/d21 39 2023-12-07T16:21:41.171 INFO:tasks.workunit.client.0.smithi063.stdout:9/432: chown d0/d13/d39/d42/d57/l65 482386 1 2023-12-07T16:21:41.171 INFO:tasks.workunit.client.0.smithi063.stdout:9/433: fsync d0/f67 0 2023-12-07T16:21:41.173 INFO:tasks.workunit.client.0.smithi063.stdout:2/538: getdents d0/d67/d65/d6a/d8e 0 2023-12-07T16:21:41.175 INFO:tasks.workunit.client.1.smithi152.stdout:7/667: symlink db/d68/d87/ld5 0 2023-12-07T16:21:41.175 INFO:tasks.workunit.client.1.smithi152.stdout:4/606: dwrite d0/d3/d6/f8a [0,4194304] 0 2023-12-07T16:21:41.177 INFO:tasks.workunit.client.0.smithi063.stdout:2/539: getdents d0/d21/d56/d11/d6d 0 2023-12-07T16:21:41.177 INFO:tasks.workunit.client.0.smithi063.stdout:2/540: write d0/d4a/f6e [811681,109846] 0 2023-12-07T16:21:41.181 INFO:tasks.workunit.client.0.smithi063.stdout:8/623: dwrite d7/d14/d15/d2b/d40/f62 [0,4194304] 0 2023-12-07T16:21:41.182 INFO:tasks.workunit.client.1.smithi152.stdout:8/728: dwrite d3/d1e/f9c [0,4194304] 0 2023-12-07T16:21:41.184 INFO:tasks.workunit.client.1.smithi152.stdout:0/663: dwrite d0/dc/f79 [0,4194304] 0 2023-12-07T16:21:41.184 INFO:tasks.workunit.client.1.smithi152.stdout:0/664: truncate d0/dc/d3d/dab/dc8/fd8 456407 0 2023-12-07T16:21:41.185 INFO:tasks.workunit.client.1.smithi152.stdout:5/852: dread dd/ddb/fe7 [0,4194304] 0 2023-12-07T16:21:41.189 INFO:tasks.workunit.client.1.smithi152.stdout:4/607: dread d0/d3/d6/d2b/fa1 [0,4194304] 0 2023-12-07T16:21:41.189 INFO:tasks.workunit.client.1.smithi152.stdout:7/668: creat db/d27/d5e/fd6 x:0 0 0 2023-12-07T16:21:41.190 INFO:tasks.workunit.client.1.smithi152.stdout:8/729: creat d3/d1e/d43/f10b x:0 0 0 2023-12-07T16:21:41.190 INFO:tasks.workunit.client.1.smithi152.stdout:8/730: stat d3/d4/d9/d23/ca5 0 2023-12-07T16:21:41.190 INFO:tasks.workunit.client.1.smithi152.stdout:8/731: read - d3/d4/d9/d23/fb9 zero size 2023-12-07T16:21:41.192 INFO:tasks.workunit.client.1.smithi152.stdout:0/665: truncate d0/d27/f10 694045 0 2023-12-07T16:21:41.192 INFO:tasks.workunit.client.1.smithi152.stdout:5/853: creat dd/de/d38/d3d/d6d/dae/f12a x:0 0 0 2023-12-07T16:21:41.193 INFO:tasks.workunit.client.1.smithi152.stdout:3/687: rmdir d7/d10/d1a/d25/d8e 0 2023-12-07T16:21:41.197 INFO:tasks.workunit.client.0.smithi063.stdout:8/624: dread d7/d14/d15/d48/fa4 [0,4194304] 0 2023-12-07T16:21:41.197 INFO:tasks.workunit.client.0.smithi063.stdout:8/625: chown d7/d38/d73/f7c 3 1 2023-12-07T16:21:41.199 INFO:tasks.workunit.client.1.smithi152.stdout:7/669: getdents db/d27/d39/d41 0 2023-12-07T16:21:41.200 INFO:tasks.workunit.client.1.smithi152.stdout:4/608: symlink d0/d3/d6/dc/d22/lb3 0 2023-12-07T16:21:41.200 INFO:tasks.workunit.client.1.smithi152.stdout:4/609: read d0/d3/d6/dc/d39/d93/f40 [2074011,121448] 0 2023-12-07T16:21:41.205 INFO:tasks.workunit.client.1.smithi152.stdout:8/732: creat d3/d4/d9/dc/d6f/d7a/f10c x:0 0 0 2023-12-07T16:21:41.205 INFO:tasks.workunit.client.1.smithi152.stdout:0/666: mkdir d0/d27/de6 0 2023-12-07T16:21:41.205 INFO:tasks.workunit.client.1.smithi152.stdout:8/733: chown d3/d1e/d55/d83/f107 6 1 2023-12-07T16:21:41.205 INFO:tasks.workunit.client.1.smithi152.stdout:8/734: stat d3/d1e/d55 0 2023-12-07T16:21:41.206 INFO:tasks.workunit.client.0.smithi063.stdout:2/541: dread d0/d4a/fb1 [0,4194304] 0 2023-12-07T16:21:41.206 INFO:tasks.workunit.client.1.smithi152.stdout:5/854: symlink dd/de/d14/dc6/d7c/l12b 0 2023-12-07T16:21:41.208 INFO:tasks.workunit.client.0.smithi063.stdout:2/542: dread d0/d67/d65/f96 [0,4194304] 0 2023-12-07T16:21:41.208 INFO:tasks.workunit.client.0.smithi063.stdout:1/355: sync 2023-12-07T16:21:41.208 INFO:tasks.workunit.client.1.smithi152.stdout:3/688: mknod d7/dc/d3e/d6b/cd8 0 2023-12-07T16:21:41.208 INFO:tasks.workunit.client.1.smithi152.stdout:7/670: truncate db/f61 5025940 0 2023-12-07T16:21:41.210 INFO:tasks.workunit.client.0.smithi063.stdout:2/543: unlink d0/d21/d39/c62 0 2023-12-07T16:21:41.211 INFO:tasks.workunit.client.0.smithi063.stdout:1/356: creat d0/dd/d19/d50/d71/f7e x:0 0 0 2023-12-07T16:21:41.212 INFO:tasks.workunit.client.1.smithi152.stdout:4/610: link d0/d3/d6/dc/f10 d0/d3/fb4 0 2023-12-07T16:21:41.212 INFO:tasks.workunit.client.1.smithi152.stdout:0/667: creat d0/dc/d3d/d73/dbf/fe7 x:0 0 0 2023-12-07T16:21:41.212 INFO:tasks.workunit.client.1.smithi152.stdout:0/668: chown d0/d2f/f52 429306443 1 2023-12-07T16:21:41.212 INFO:tasks.workunit.client.1.smithi152.stdout:8/735: rmdir d3/d4/d9/dc/d6f/d7b/d7e/d85 39 2023-12-07T16:21:41.212 INFO:tasks.workunit.client.1.smithi152.stdout:8/736: truncate d3/d4/d9/dc/f20 1651102 0 2023-12-07T16:21:41.213 INFO:tasks.workunit.client.0.smithi063.stdout:2/544: symlink d0/d67/d65/d6a/d8e/lb5 0 2023-12-07T16:21:41.213 INFO:tasks.workunit.client.0.smithi063.stdout:1/357: symlink d0/dd/d1f/d75/l7f 0 2023-12-07T16:21:41.213 INFO:tasks.workunit.client.1.smithi152.stdout:5/855: mknod dd/de/d14/d19/d1a/dcc/dd0/c12c 0 2023-12-07T16:21:41.213 INFO:tasks.workunit.client.1.smithi152.stdout:5/856: readlink dd/de/d14/d19/d74/l75 0 2023-12-07T16:21:41.214 INFO:tasks.workunit.client.0.smithi063.stdout:2/545: mknod d0/d67/d65/d6a/d8e/cb6 0 2023-12-07T16:21:41.214 INFO:tasks.workunit.client.0.smithi063.stdout:2/546: stat d0/d4a 0 2023-12-07T16:21:41.214 INFO:tasks.workunit.client.0.smithi063.stdout:2/547: dread - d0/d4a/f7c zero size 2023-12-07T16:21:41.215 INFO:tasks.workunit.client.0.smithi063.stdout:2/548: readlink d0/d1e/l7f 0 2023-12-07T16:21:41.215 INFO:tasks.workunit.client.0.smithi063.stdout:2/549: stat d0/d67/d65/d6a/d8e/f91 0 2023-12-07T16:21:41.216 INFO:tasks.workunit.client.1.smithi152.stdout:3/689: creat d7/d10/fd9 x:0 0 0 2023-12-07T16:21:41.216 INFO:tasks.workunit.client.0.smithi063.stdout:1/358: dread d0/dd/f41 [0,4194304] 0 2023-12-07T16:21:41.218 INFO:tasks.workunit.client.1.smithi152.stdout:0/669: symlink d0/dc/d36/d7d/d92/le8 0 2023-12-07T16:21:41.218 INFO:tasks.workunit.client.0.smithi063.stdout:1/359: mkdir d0/dd/d19/d50/d72/d80 0 2023-12-07T16:21:41.218 INFO:tasks.workunit.client.0.smithi063.stdout:1/360: readlink d0/dd/d10/l15 0 2023-12-07T16:21:41.219 INFO:tasks.workunit.client.0.smithi063.stdout:1/361: symlink d0/dd/d10/d46/l81 0 2023-12-07T16:21:41.219 INFO:tasks.workunit.client.1.smithi152.stdout:8/737: symlink d3/d4/d9/d23/d4c/da6/db2/dd6/l10d 0 2023-12-07T16:21:41.220 INFO:tasks.workunit.client.0.smithi063.stdout:1/362: creat d0/dd/d10/d1b/f82 x:0 0 0 2023-12-07T16:21:41.220 INFO:tasks.workunit.client.1.smithi152.stdout:3/690: write d7/f8 [11101956,78263] 0 2023-12-07T16:21:41.222 INFO:tasks.workunit.client.1.smithi152.stdout:5/857: mknod dd/de/d38/d3d/dd3/d11e/c12d 0 2023-12-07T16:21:41.222 INFO:tasks.workunit.client.0.smithi063.stdout:1/363: creat d0/dd/d19/d50/d72/f83 x:0 0 0 2023-12-07T16:21:41.224 INFO:tasks.workunit.client.0.smithi063.stdout:1/364: rmdir d0/dd/d1f 39 2023-12-07T16:21:41.224 INFO:tasks.workunit.client.0.smithi063.stdout:1/365: chown d0/dd/f3b 6030779 1 2023-12-07T16:21:41.224 INFO:tasks.workunit.client.0.smithi063.stdout:2/550: dread d0/f10 [4194304,4194304] 0 2023-12-07T16:21:41.225 INFO:tasks.workunit.client.1.smithi152.stdout:8/738: read d3/d4/d9/dc/d6f/d7b/d7e/fa1 [823678,40971] 0 2023-12-07T16:21:41.225 INFO:tasks.workunit.client.1.smithi152.stdout:8/739: fdatasync d3/d4/d9/dad/fdc 0 2023-12-07T16:21:41.226 INFO:tasks.workunit.client.0.smithi063.stdout:1/366: unlink d0/dd/d19/d50/d71/f2e 0 2023-12-07T16:21:41.226 INFO:tasks.workunit.client.0.smithi063.stdout:1/367: dread - d0/dd/d19/d50/f6a zero size 2023-12-07T16:21:41.226 INFO:tasks.workunit.client.0.smithi063.stdout:1/368: read d0/dd/d19/d50/d71/f52 [2582909,37397] 0 2023-12-07T16:21:41.228 INFO:tasks.workunit.client.1.smithi152.stdout:8/740: unlink d3/d4/d9/dc/d6f/fc9 0 2023-12-07T16:21:41.229 INFO:tasks.workunit.client.1.smithi152.stdout:5/858: link dd/de/d14/dc6/fb1 dd/d91/dbe/f12e 0 2023-12-07T16:21:41.233 INFO:tasks.workunit.client.0.smithi063.stdout:1/369: link d0/dd/d19/c2d d0/dd/c84 0 2023-12-07T16:21:41.233 INFO:tasks.workunit.client.0.smithi063.stdout:1/370: chown d0/dd/d19/d50/d71/l30 1228634 1 2023-12-07T16:21:41.236 INFO:tasks.workunit.client.1.smithi152.stdout:5/859: unlink dd/de/d38/d3d/fca 0 2023-12-07T16:21:41.236 INFO:tasks.workunit.client.0.smithi063.stdout:1/371: unlink d0/dd/d19/d50/d71/l30 0 2023-12-07T16:21:41.238 INFO:tasks.workunit.client.1.smithi152.stdout:9/757: dwrite d1/d9/f2b [0,4194304] 0 2023-12-07T16:21:41.238 INFO:tasks.workunit.client.1.smithi152.stdout:2/643: dwrite d2/d1c/d2e/d57/d5b/da7/f88 [0,4194304] 0 2023-12-07T16:21:41.239 INFO:tasks.workunit.client.1.smithi152.stdout:5/860: creat dd/de/d14/d19/da3/ddf/f12f x:0 0 0 2023-12-07T16:21:41.239 INFO:tasks.workunit.client.1.smithi152.stdout:5/861: write dd/de/d8f/dc9/ffd [1339918,10211] 0 2023-12-07T16:21:41.246 INFO:tasks.workunit.client.0.smithi063.stdout:6/534: dwrite d0/d1e/d2a/faa [0,4194304] 0 2023-12-07T16:21:41.246 INFO:tasks.workunit.client.1.smithi152.stdout:6/681: dwrite d2/d4f/d83/d48/d70/fd9 [0,4194304] 0 2023-12-07T16:21:41.250 INFO:tasks.workunit.client.0.smithi063.stdout:9/434: dwrite d0/d13/d39/d3a/f4d [0,4194304] 0 2023-12-07T16:21:41.250 INFO:tasks.workunit.client.0.smithi063.stdout:8/626: dwrite d7/d14/d15/d2b/f59 [0,4194304] 0 2023-12-07T16:21:41.250 INFO:tasks.workunit.client.0.smithi063.stdout:6/535: mknod d0/d1e/d20/d4a/cc2 0 2023-12-07T16:21:41.250 INFO:tasks.workunit.client.0.smithi063.stdout:1/372: dread d0/dd/d19/d50/d71/f2c [0,4194304] 0 2023-12-07T16:21:41.251 INFO:tasks.workunit.client.1.smithi152.stdout:4/611: dwrite d0/d3/d6/dc/d39/f5e [0,4194304] 0 2023-12-07T16:21:41.251 INFO:tasks.workunit.client.0.smithi063.stdout:9/435: symlink d0/d13/d6f/l87 0 2023-12-07T16:21:41.251 INFO:tasks.workunit.client.0.smithi063.stdout:9/436: chown d0/l27 102411020 1 2023-12-07T16:21:41.252 INFO:tasks.workunit.client.0.smithi063.stdout:8/627: mknod d7/d14/d1a/cc0 0 2023-12-07T16:21:41.253 INFO:tasks.workunit.client.0.smithi063.stdout:6/536: symlink d0/d17/d1a/d4d/d5a/d9d/lc3 0 2023-12-07T16:21:41.253 INFO:tasks.workunit.client.1.smithi152.stdout:9/758: unlink d1/d9/d2d/d72/d80/le5 0 2023-12-07T16:21:41.254 INFO:tasks.workunit.client.0.smithi063.stdout:1/373: creat d0/dd/d10/f85 x:0 0 0 2023-12-07T16:21:41.254 INFO:tasks.workunit.client.1.smithi152.stdout:2/644: rmdir d2/d1c/d2e/d57/d5b/da7/d9a/da6/dbb 39 2023-12-07T16:21:41.255 INFO:tasks.workunit.client.1.smithi152.stdout:0/670: dwrite d0/f5 [8388608,4194304] 0 2023-12-07T16:21:41.256 INFO:tasks.workunit.client.0.smithi063.stdout:9/437: mknod d0/d13/c88 0 2023-12-07T16:21:41.256 INFO:tasks.workunit.client.0.smithi063.stdout:9/438: readlink d0/d13/d39/d3a/l6b 0 2023-12-07T16:21:41.257 INFO:tasks.workunit.client.0.smithi063.stdout:8/628: truncate d7/d14/d1a/f31 3816336 0 2023-12-07T16:21:41.257 INFO:tasks.workunit.client.0.smithi063.stdout:8/629: write d7/d14/d1a/d54/f5b [2616871,3810] 0 2023-12-07T16:21:41.257 INFO:tasks.workunit.client.0.smithi063.stdout:8/630: rmdir d7/d14/d15/dac 39 2023-12-07T16:21:41.257 INFO:tasks.workunit.client.0.smithi063.stdout:6/537: write d0/d1e/d1d/d4f/f66 [539999,98818] 0 2023-12-07T16:21:41.258 INFO:tasks.workunit.client.1.smithi152.stdout:9/759: creat d1/d9/ffd x:0 0 0 2023-12-07T16:21:41.258 INFO:tasks.workunit.client.1.smithi152.stdout:0/671: mkdir d0/dc/d36/d7d/d92/de9 0 2023-12-07T16:21:41.260 INFO:tasks.workunit.client.0.smithi063.stdout:8/631: rmdir d7/d14/d15/dac/dad/dbb 0 2023-12-07T16:21:41.264 INFO:tasks.workunit.client.1.smithi152.stdout:9/760: dread d1/d17/d3c/d4a/d48/f56 [0,4194304] 0 2023-12-07T16:21:41.273 INFO:tasks.workunit.client.1.smithi152.stdout:6/682: dread d2/d4f/d83/d85/d19/f46 [0,4194304] 0 2023-12-07T16:21:41.288 INFO:tasks.workunit.client.1.smithi152.stdout:3/691: dwrite d7/d10/d1a/d25/f6a [0,4194304] 0 2023-12-07T16:21:41.288 INFO:tasks.workunit.client.1.smithi152.stdout:3/692: chown d7/c63 0 1 2023-12-07T16:21:41.290 INFO:tasks.workunit.client.1.smithi152.stdout:3/693: rmdir d7/dc/d3e/d62/d6d/d84 39 2023-12-07T16:21:41.290 INFO:tasks.workunit.client.0.smithi063.stdout:6/538: dread d0/d17/d46/f55 [0,4194304] 0 2023-12-07T16:21:41.290 INFO:tasks.workunit.client.0.smithi063.stdout:6/539: readlink d0/d17/l23 0 2023-12-07T16:21:41.294 INFO:tasks.workunit.client.1.smithi152.stdout:7/671: dwrite db/f61 [4194304,4194304] 0 2023-12-07T16:21:41.296 INFO:tasks.workunit.client.1.smithi152.stdout:3/694: rename d7/dc/d3e to d7/d10/d1a/d2f/d86/dda 0 2023-12-07T16:21:41.300 INFO:tasks.workunit.client.1.smithi152.stdout:3/695: read d7/d10/d1a/d2f/f22 [2253290,47968] 0 2023-12-07T16:21:41.300 INFO:tasks.workunit.client.1.smithi152.stdout:3/696: fsync d7/d10/d19/fa0 0 2023-12-07T16:21:41.303 INFO:tasks.workunit.client.1.smithi152.stdout:3/697: rename d7/d10/d1a/d2f/d86/dda/d6b/d80/dc2/l79 to d7/d10/d1a/d25/d4b/ldb 0 2023-12-07T16:21:41.306 INFO:tasks.workunit.client.1.smithi152.stdout:8/741: dwrite d3/d4/d9/f38 [0,4194304] 0 2023-12-07T16:21:41.308 INFO:tasks.workunit.client.1.smithi152.stdout:8/742: mknod d3/d4/d9/d23/d4c/da6/db2/dd6/c10e 0 2023-12-07T16:21:41.309 INFO:tasks.workunit.client.1.smithi152.stdout:4/612: fsync d0/d3/fb4 0 2023-12-07T16:21:41.309 INFO:tasks.workunit.client.0.smithi063.stdout:2/551: dwrite d0/d1e/fae [0,4194304] 0 2023-12-07T16:21:41.327 INFO:tasks.workunit.client.1.smithi152.stdout:8/743: dread d3/d4/d9/dc/d6f/d7a/d8a/f37 [0,4194304] 0 2023-12-07T16:21:41.329 INFO:tasks.workunit.client.1.smithi152.stdout:6/683: dwrite d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/fa5 [0,4194304] 0 2023-12-07T16:21:41.329 INFO:tasks.workunit.client.1.smithi152.stdout:8/744: creat d3/d1e/d40/d74/f10f x:0 0 0 2023-12-07T16:21:41.331 INFO:tasks.workunit.client.1.smithi152.stdout:9/761: dwrite d1/d9/d2d/d72/d80/da4/fa5 [0,4194304] 0 2023-12-07T16:21:41.331 INFO:tasks.workunit.client.1.smithi152.stdout:0/672: dwrite d0/dc/d3d/d73/dbf/fe7 [0,4194304] 0 2023-12-07T16:21:41.332 INFO:tasks.workunit.client.1.smithi152.stdout:0/673: getdents d0/dc/d3d/d73/dbf/dc9 0 2023-12-07T16:21:41.332 INFO:tasks.workunit.client.1.smithi152.stdout:1/875: sync 2023-12-07T16:21:41.332 INFO:tasks.workunit.client.1.smithi152.stdout:1/876: chown dc/d14/d18/d2d/d9c/db2 37729 1 2023-12-07T16:21:41.332 INFO:tasks.workunit.client.1.smithi152.stdout:1/877: stat dc/d14/d18/d45/l49 0 2023-12-07T16:21:41.332 INFO:tasks.workunit.client.1.smithi152.stdout:7/672: dwrite db/d27/d5e/d45/fbb [0,4194304] 0 2023-12-07T16:21:41.332 INFO:tasks.workunit.client.1.smithi152.stdout:6/684: link d2/d4f/d83/d48/c6d d2/d4f/d83/da0/da2/cde 0 2023-12-07T16:21:41.333 INFO:tasks.workunit.client.0.smithi063.stdout:9/439: dwrite d0/d13/d39/d42/f50 [0,4194304] 0 2023-12-07T16:21:41.333 INFO:tasks.workunit.client.0.smithi063.stdout:9/440: truncate d0/d7/f6d 285840 0 2023-12-07T16:21:41.333 INFO:tasks.workunit.client.1.smithi152.stdout:1/878: write dc/d14/fd3 [3047197,36438] 0 2023-12-07T16:21:41.334 INFO:tasks.workunit.client.1.smithi152.stdout:1/879: truncate dc/d14/d18/d64/f8f 703632 0 2023-12-07T16:21:41.334 INFO:tasks.workunit.client.1.smithi152.stdout:0/674: write d0/dc/f3c [2436960,97360] 0 2023-12-07T16:21:41.334 INFO:tasks.workunit.client.1.smithi152.stdout:0/675: rename d0 to d0/dc/d36/d3a/d51/d82/dea 22 2023-12-07T16:21:41.336 INFO:tasks.workunit.client.1.smithi152.stdout:8/745: creat d3/d4/d9/d23/d4c/da6/f110 x:0 0 0 2023-12-07T16:21:41.336 INFO:tasks.workunit.client.1.smithi152.stdout:7/673: dread db/d27/d39/d41/d58/f59 [0,4194304] 0 2023-12-07T16:21:41.337 INFO:tasks.workunit.client.0.smithi063.stdout:6/540: dwrite d0/d1e/f81 [0,4194304] 0 2023-12-07T16:21:41.337 INFO:tasks.workunit.client.0.smithi063.stdout:6/541: chown d0/d54/f56 788 1 2023-12-07T16:21:41.337 INFO:tasks.workunit.client.0.smithi063.stdout:6/542: chown d0/d1e/d1d/d1f/d4b 1492 1 2023-12-07T16:21:41.337 INFO:tasks.workunit.client.1.smithi152.stdout:2/645: dwrite d2/d9/f2f [0,4194304] 0 2023-12-07T16:21:41.341 INFO:tasks.workunit.client.1.smithi152.stdout:2/646: write d2/d1c/d2e/d57/db1/d90/f2a [1873460,89314] 0 2023-12-07T16:21:41.343 INFO:tasks.workunit.client.0.smithi063.stdout:6/543: write d0/d79/f8f [312119,7510] 0 2023-12-07T16:21:41.343 INFO:tasks.workunit.client.0.smithi063.stdout:6/544: fsync d0/d17/f5d 0 2023-12-07T16:21:41.343 INFO:tasks.workunit.client.0.smithi063.stdout:6/545: fdatasync d0/d1e/f63 0 2023-12-07T16:21:41.343 INFO:tasks.workunit.client.1.smithi152.stdout:6/685: creat d2/d4f/d83/d48/d70/d81/fdf x:0 0 0 2023-12-07T16:21:41.343 INFO:tasks.workunit.client.1.smithi152.stdout:6/686: readlink d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/d55/l97 0 2023-12-07T16:21:41.344 INFO:tasks.workunit.client.1.smithi152.stdout:1/880: stat dc/d14/d18/d2d/d48/da3/c60 0 2023-12-07T16:21:41.347 INFO:tasks.workunit.client.1.smithi152.stdout:7/674: unlink db/d27/d39/d41/d58/d80/f8d 0 2023-12-07T16:21:41.349 INFO:tasks.workunit.client.0.smithi063.stdout:2/552: dwrite d0/d67/f82 [0,4194304] 0 2023-12-07T16:21:41.350 INFO:tasks.workunit.client.1.smithi152.stdout:2/647: mknod d2/d56/ce1 0 2023-12-07T16:21:41.353 INFO:tasks.workunit.client.1.smithi152.stdout:4/613: dwrite d0/d3/d6/d2b/d56/f98 [0,4194304] 0 2023-12-07T16:21:41.353 INFO:tasks.workunit.client.1.smithi152.stdout:9/762: dread d1/d9/db/f33 [0,4194304] 0 2023-12-07T16:21:41.353 INFO:tasks.workunit.client.1.smithi152.stdout:9/763: stat d1/d17/d58/d86/f87 0 2023-12-07T16:21:41.353 INFO:tasks.workunit.client.1.smithi152.stdout:4/614: fsync d0/d3/d6/dc/f10 0 2023-12-07T16:21:41.353 INFO:tasks.workunit.client.1.smithi152.stdout:6/687: rename d2/d4f/d83/d85/d94/c7a to d2/d4f/d83/d92/ce0 0 2023-12-07T16:21:41.354 INFO:tasks.workunit.client.1.smithi152.stdout:7/675: mknod db/d27/d39/d41/d37/cd7 0 2023-12-07T16:21:41.356 INFO:tasks.workunit.client.1.smithi152.stdout:2/648: creat d2/d1c/d2e/d57/d5b/fe2 x:0 0 0 2023-12-07T16:21:41.359 INFO:tasks.workunit.client.1.smithi152.stdout:4/615: unlink d0/d3/d6/dc/d39/d93/f40 0 2023-12-07T16:21:41.359 INFO:tasks.workunit.client.1.smithi152.stdout:4/616: dread - d0/d17/d7f/fa9 zero size 2023-12-07T16:21:41.360 INFO:tasks.workunit.client.1.smithi152.stdout:8/746: dwrite d3/d4/d9/dc/d6f/d7b/d7e/df5/f91 [0,4194304] 0 2023-12-07T16:21:41.360 INFO:tasks.workunit.client.1.smithi152.stdout:8/747: write d3/d1e/d55/d83/f108 [339642,795] 0 2023-12-07T16:21:41.360 INFO:tasks.workunit.client.1.smithi152.stdout:9/764: mknod d1/d17/d4e/d5a/ddd/cfe 0 2023-12-07T16:21:41.360 INFO:tasks.workunit.client.1.smithi152.stdout:9/765: chown d1/dd/dd6/de2/c5b 349366 1 2023-12-07T16:21:41.361 INFO:tasks.workunit.client.1.smithi152.stdout:6/688: symlink d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/d55/le1 0 2023-12-07T16:21:41.362 INFO:tasks.workunit.client.1.smithi152.stdout:6/689: stat d2/d4f/d83/d48/d70 0 2023-12-07T16:21:41.362 INFO:tasks.workunit.client.1.smithi152.stdout:6/690: readlink d2/d4f/d83/d85/d94/l75 0 2023-12-07T16:21:41.363 INFO:tasks.workunit.client.0.smithi063.stdout:9/441: dwrite d0/d13/d39/f51 [0,4194304] 0 2023-12-07T16:21:41.363 INFO:tasks.workunit.client.1.smithi152.stdout:2/649: mkdir d2/d9/d51/d54/de3 0 2023-12-07T16:21:41.363 INFO:tasks.workunit.client.1.smithi152.stdout:7/676: write db/d27/d39/d41/d37/f38 [770644,35485] 0 2023-12-07T16:21:41.365 INFO:tasks.workunit.client.1.smithi152.stdout:4/617: creat d0/d3/d6/d2b/fb5 x:0 0 0 2023-12-07T16:21:41.366 INFO:tasks.workunit.client.1.smithi152.stdout:9/766: rmdir d1/d9/db/df 39 2023-12-07T16:21:41.367 INFO:tasks.workunit.client.1.smithi152.stdout:2/650: creat d2/d1c/d2e/d5d/dab/dd9/fe4 x:0 0 0 2023-12-07T16:21:41.368 INFO:tasks.workunit.client.1.smithi152.stdout:8/748: write d3/d4/d9/d23/f45 [16487,102782] 0 2023-12-07T16:21:41.369 INFO:tasks.workunit.client.1.smithi152.stdout:4/618: symlink d0/d81/lb6 0 2023-12-07T16:21:41.372 INFO:tasks.workunit.client.1.smithi152.stdout:9/767: mkdir d1/dd/dd6/de2/d53/dff 0 2023-12-07T16:21:41.374 INFO:tasks.workunit.client.1.smithi152.stdout:8/749: creat d3/d4/d4b/f111 x:0 0 0 2023-12-07T16:21:41.378 INFO:tasks.workunit.client.1.smithi152.stdout:6/691: dwrite d2/d4f/d83/d85/d19/d1f/d60/fcf [0,4194304] 0 2023-12-07T16:21:41.379 INFO:tasks.workunit.client.0.smithi063.stdout:6/546: rmdir d0/d1e 39 2023-12-07T16:21:41.379 INFO:tasks.workunit.client.0.smithi063.stdout:6/547: stat d0/d17/d95/fa7 0 2023-12-07T16:21:41.381 INFO:tasks.workunit.client.1.smithi152.stdout:9/768: rename d1/d9/db/df/cbc to d1/d9/db/df/dd4/c100 0 2023-12-07T16:21:41.382 INFO:tasks.workunit.client.1.smithi152.stdout:2/651: dread d2/d1c/d2e/d57/db1/d90/f36 [0,4194304] 0 2023-12-07T16:21:41.383 INFO:tasks.workunit.client.0.smithi063.stdout:2/553: creat d0/d1e/fb7 x:0 0 0 2023-12-07T16:21:41.384 INFO:tasks.workunit.client.1.smithi152.stdout:8/750: creat d3/d4/d9/dc/d6f/d7b/d7e/d85/f112 x:0 0 0 2023-12-07T16:21:41.384 INFO:tasks.workunit.client.1.smithi152.stdout:8/751: read d3/d4/d9/dc/d6f/d7b/d7e/fa1 [120618,32486] 0 2023-12-07T16:21:41.384 INFO:tasks.workunit.client.0.smithi063.stdout:9/442: mknod d0/d13/d39/d42/d57/c89 0 2023-12-07T16:21:41.384 INFO:tasks.workunit.client.0.smithi063.stdout:6/548: chown d0/d1e/d60/d68/d78 0 1 2023-12-07T16:21:41.388 INFO:tasks.workunit.client.0.smithi063.stdout:3/468: sync 2023-12-07T16:21:41.388 INFO:tasks.workunit.client.0.smithi063.stdout:4/405: sync 2023-12-07T16:21:41.388 INFO:tasks.workunit.client.0.smithi063.stdout:3/469: readlink d7/d9/dd/l16 0 2023-12-07T16:21:41.388 INFO:tasks.workunit.client.0.smithi063.stdout:3/470: chown d7/d9/d2b/d41/f9a 963 1 2023-12-07T16:21:41.388 INFO:tasks.workunit.client.0.smithi063.stdout:3/471: chown d7/d9/d1b/d5c 4 1 2023-12-07T16:21:41.388 INFO:tasks.workunit.client.0.smithi063.stdout:3/472: chown d7/d4f/d53/d54/d76 150 1 2023-12-07T16:21:41.388 INFO:tasks.workunit.client.0.smithi063.stdout:3/473: write d7/d9/f12 [4955890,17841] 0 2023-12-07T16:21:41.388 INFO:tasks.workunit.client.0.smithi063.stdout:7/431: sync 2023-12-07T16:21:41.388 INFO:tasks.workunit.client.0.smithi063.stdout:7/432: chown d2/d21/c33 12067456 1 2023-12-07T16:21:41.390 INFO:tasks.workunit.client.0.smithi063.stdout:4/406: dread d1/d3/db/d41/f46 [0,4194304] 0 2023-12-07T16:21:41.390 INFO:tasks.workunit.client.0.smithi063.stdout:4/407: chown d1/d3/d3f/d49/d64 696393187 1 2023-12-07T16:21:41.390 INFO:tasks.workunit.client.0.smithi063.stdout:4/408: write d1/d3/d3f/d44/f4c [4222108,51417] 0 2023-12-07T16:21:41.390 INFO:tasks.workunit.client.0.smithi063.stdout:4/409: chown d1/d3/d3f 52432082 1 2023-12-07T16:21:41.391 INFO:tasks.workunit.client.1.smithi152.stdout:9/769: mkdir d1/d9/d4f/d83/d101 0 2023-12-07T16:21:41.392 INFO:tasks.workunit.client.1.smithi152.stdout:2/652: mknod d2/d1c/d2e/d57/d5b/da7/d9a/da6/ce5 0 2023-12-07T16:21:41.395 INFO:tasks.workunit.client.1.smithi152.stdout:2/653: creat d2/d9/fe6 x:0 0 0 2023-12-07T16:21:41.396 INFO:tasks.workunit.client.1.smithi152.stdout:4/619: dwrite d0/d17/d7f/f86 [0,4194304] 0 2023-12-07T16:21:41.399 INFO:tasks.workunit.client.1.smithi152.stdout:2/654: write d2/d1c/d2e/fa2 [914573,117891] 0 2023-12-07T16:21:41.400 INFO:tasks.workunit.client.1.smithi152.stdout:2/655: chown d2/l12 36347 1 2023-12-07T16:21:41.405 INFO:tasks.workunit.client.1.smithi152.stdout:9/770: dread d1/d17/d3c/d4a/d48/f59 [0,4194304] 0 2023-12-07T16:21:41.406 INFO:tasks.workunit.client.1.smithi152.stdout:9/771: readlink d1/l3 0 2023-12-07T16:21:41.406 INFO:tasks.workunit.client.1.smithi152.stdout:9/772: stat d1/d17/d3c/d4a/d48 0 2023-12-07T16:21:41.406 INFO:tasks.workunit.client.0.smithi063.stdout:7/433: dread d2/d34/d5a/d5f/f15 [0,4194304] 0 2023-12-07T16:21:41.411 INFO:tasks.workunit.client.0.smithi063.stdout:3/474: dread d7/d9/d1b/f2c [0,4194304] 0 2023-12-07T16:21:41.411 INFO:tasks.workunit.client.0.smithi063.stdout:3/475: chown d7/d49/d4b 8 1 2023-12-07T16:21:41.413 INFO:tasks.workunit.client.0.smithi063.stdout:3/476: read d7/d9/f27 [3057369,68761] 0 2023-12-07T16:21:41.414 INFO:tasks.workunit.client.1.smithi152.stdout:9/773: write d1/dd/f5c [701414,41774] 0 2023-12-07T16:21:41.414 INFO:tasks.workunit.client.1.smithi152.stdout:9/774: getdents d1/d9/d4f/d83/d101 0 2023-12-07T16:21:41.415 INFO:tasks.workunit.client.1.smithi152.stdout:4/620: dwrite d0/d3/f7 [4194304,4194304] 0 2023-12-07T16:21:41.415 INFO:tasks.workunit.client.1.smithi152.stdout:4/621: truncate d0/d3/d6/d2b/d56/f98 4559635 0 2023-12-07T16:21:41.415 INFO:tasks.workunit.client.1.smithi152.stdout:6/692: dwrite d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/d8b/f9c [0,4194304] 0 2023-12-07T16:21:41.416 INFO:tasks.workunit.client.1.smithi152.stdout:4/622: mkdir d0/d3/d6/dc/db7 0 2023-12-07T16:21:41.417 INFO:tasks.workunit.client.1.smithi152.stdout:6/693: creat d2/d4f/d83/d48/da8/fe2 x:0 0 0 2023-12-07T16:21:41.417 INFO:tasks.workunit.client.1.smithi152.stdout:6/694: fsync d2/d4f/d83/d85/d19/d1f/dc7/dc9/fa3 0 2023-12-07T16:21:41.418 INFO:tasks.workunit.client.1.smithi152.stdout:4/623: symlink d0/d3/d6/d2b/d56/lb8 0 2023-12-07T16:21:41.419 INFO:tasks.workunit.client.1.smithi152.stdout:6/695: mknod d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/d5d/ce3 0 2023-12-07T16:21:41.420 INFO:tasks.workunit.client.1.smithi152.stdout:6/696: creat d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/fe4 x:0 0 0 2023-12-07T16:21:41.420 INFO:tasks.workunit.client.1.smithi152.stdout:4/624: creat d0/d3/d6/dc/d39/d93/d7c/fb9 x:0 0 0 2023-12-07T16:21:41.421 INFO:tasks.workunit.client.1.smithi152.stdout:6/697: mknod d2/d4f/d83/d48/ce5 0 2023-12-07T16:21:41.422 INFO:tasks.workunit.client.1.smithi152.stdout:4/625: getdents d0/d17/d7f 0 2023-12-07T16:21:41.423 INFO:tasks.workunit.client.1.smithi152.stdout:6/698: mknod d2/d4f/d83/d48/d70/ce6 0 2023-12-07T16:21:41.423 INFO:tasks.workunit.client.1.smithi152.stdout:6/699: chown d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/d55/l97 627566 1 2023-12-07T16:21:41.425 INFO:tasks.workunit.client.1.smithi152.stdout:4/626: rename d0/d3/d6/d2b/d56/d83/fa6 to d0/daa/fba 0 2023-12-07T16:21:41.426 INFO:tasks.workunit.client.0.smithi063.stdout:9/443: unlink d0/f67 0 2023-12-07T16:21:41.429 INFO:tasks.workunit.client.0.smithi063.stdout:2/554: mknod d0/d1e/cb8 0 2023-12-07T16:21:41.431 INFO:tasks.workunit.client.0.smithi063.stdout:4/410: mkdir d1/d3/db/d73 0 2023-12-07T16:21:41.431 INFO:tasks.workunit.client.1.smithi152.stdout:4/627: mknod d0/d17/cbb 0 2023-12-07T16:21:41.431 INFO:tasks.workunit.client.1.smithi152.stdout:4/628: stat d0/d3/f95 0 2023-12-07T16:21:41.432 INFO:tasks.workunit.client.0.smithi063.stdout:7/434: mknod d2/d34/d46/d48/d70/ca5 0 2023-12-07T16:21:41.433 INFO:tasks.workunit.client.0.smithi063.stdout:4/411: write d1/f28 [965324,72612] 0 2023-12-07T16:21:41.433 INFO:tasks.workunit.client.1.smithi152.stdout:4/629: mknod d0/d3/d6/dc/d3a/d46/d4e/cbc 0 2023-12-07T16:21:41.433 INFO:tasks.workunit.client.1.smithi152.stdout:4/630: stat d0/d17/d7f 0 2023-12-07T16:21:41.433 INFO:tasks.workunit.client.1.smithi152.stdout:4/631: readlink d0/d3/l5a 0 2023-12-07T16:21:41.436 INFO:tasks.workunit.client.0.smithi063.stdout:3/477: truncate d7/d9/dd/f42 2856640 0 2023-12-07T16:21:41.436 INFO:tasks.workunit.client.1.smithi152.stdout:3/698: sync 2023-12-07T16:21:41.436 INFO:tasks.workunit.client.1.smithi152.stdout:5/862: sync 2023-12-07T16:21:41.437 INFO:tasks.workunit.client.0.smithi063.stdout:2/555: mkdir d0/d21/d56/d11/d52/d63/d8c/db9 0 2023-12-07T16:21:41.439 INFO:tasks.workunit.client.0.smithi063.stdout:4/412: creat d1/d3/d3f/d49/d64/f74 x:0 0 0 2023-12-07T16:21:41.440 INFO:tasks.workunit.client.0.smithi063.stdout:7/435: read d2/f1a [4006233,113812] 0 2023-12-07T16:21:41.440 INFO:tasks.workunit.client.0.smithi063.stdout:6/549: dread d0/d1e/d1d/f3d [0,4194304] 0 2023-12-07T16:21:41.440 INFO:tasks.workunit.client.0.smithi063.stdout:3/478: rmdir d7/d4f 39 2023-12-07T16:21:41.440 INFO:tasks.workunit.client.0.smithi063.stdout:3/479: readlink d7/d21/l5f 0 2023-12-07T16:21:41.442 INFO:tasks.workunit.client.1.smithi152.stdout:5/863: write dd/d91/dbe/d10e/f8b [1613118,13865] 0 2023-12-07T16:21:41.442 INFO:tasks.workunit.client.1.smithi152.stdout:5/864: chown dd/de/d14/d67/f80 67848 1 2023-12-07T16:21:41.442 INFO:tasks.workunit.client.1.smithi152.stdout:4/632: dread d0/d3/f7 [4194304,4194304] 0 2023-12-07T16:21:41.442 INFO:tasks.workunit.client.0.smithi063.stdout:2/556: dread d0/d21/d56/d11/f89 [0,4194304] 0 2023-12-07T16:21:41.442 INFO:tasks.workunit.client.0.smithi063.stdout:2/557: stat d0/l2 0 2023-12-07T16:21:41.442 INFO:tasks.workunit.client.0.smithi063.stdout:7/436: write d2/f5 [479918,93506] 0 2023-12-07T16:21:41.443 INFO:tasks.workunit.client.0.smithi063.stdout:7/437: fsync d2/d34/f3c 0 2023-12-07T16:21:41.443 INFO:tasks.workunit.client.0.smithi063.stdout:7/438: fdatasync d2/f26 0 2023-12-07T16:21:41.443 INFO:tasks.workunit.client.0.smithi063.stdout:7/439: fsync d2/d34/d5a/d5f/d78/d7c/f94 0 2023-12-07T16:21:41.443 INFO:tasks.workunit.client.0.smithi063.stdout:7/440: write d2/d34/f3b [884428,39069] 0 2023-12-07T16:21:41.443 INFO:tasks.workunit.client.0.smithi063.stdout:7/441: stat d2/d34/d5a/d5f/d2a/f4a 0 2023-12-07T16:21:41.443 INFO:tasks.workunit.client.0.smithi063.stdout:6/550: write d0/d17/d1a/f74 [937112,36550] 0 2023-12-07T16:21:41.443 INFO:tasks.workunit.client.1.smithi152.stdout:6/700: dwrite d2/d4f/d83/d48/f8d [0,4194304] 0 2023-12-07T16:21:41.444 INFO:tasks.workunit.client.1.smithi152.stdout:5/865: rename dd/de/d14/d1f/d49/f9e to dd/de/d8f/dc9/f130 0 2023-12-07T16:21:41.444 INFO:tasks.workunit.client.1.smithi152.stdout:5/866: write dd/fab [530689,6994] 0 2023-12-07T16:21:41.445 INFO:tasks.workunit.client.1.smithi152.stdout:4/633: truncate d0/d3/d6/dc/d3a/d46/d4e/f57 2050129 0 2023-12-07T16:21:41.445 INFO:tasks.workunit.client.1.smithi152.stdout:4/634: readlink d0/d3/d6/l8e 0 2023-12-07T16:21:41.445 INFO:tasks.workunit.client.1.smithi152.stdout:4/635: dread - d0/d81/fa0 zero size 2023-12-07T16:21:41.445 INFO:tasks.workunit.client.1.smithi152.stdout:4/636: fsync d0/d3/d6/d2b/d56/f98 0 2023-12-07T16:21:41.447 INFO:tasks.workunit.client.1.smithi152.stdout:6/701: truncate d2/d4f/d83/d85/d19/d1f/d60/fcf 2337050 0 2023-12-07T16:21:41.447 INFO:tasks.workunit.client.1.smithi152.stdout:6/702: chown d2/d4f/d83/d85/d9/c87 1962 1 2023-12-07T16:21:41.447 INFO:tasks.workunit.client.1.smithi152.stdout:6/703: truncate d2/d4f/d83/d85/d19/f46 5175343 0 2023-12-07T16:21:41.448 INFO:tasks.workunit.client.0.smithi063.stdout:2/558: dread d0/d21/d56/d11/d52/d63/d8c/f8f [0,4194304] 0 2023-12-07T16:21:41.448 INFO:tasks.workunit.client.0.smithi063.stdout:2/559: chown d0/d67 405869 1 2023-12-07T16:21:41.449 INFO:tasks.workunit.client.1.smithi152.stdout:5/867: truncate dd/de/f13 584871 0 2023-12-07T16:21:41.450 INFO:tasks.workunit.client.1.smithi152.stdout:4/637: unlink d0/d3/d6/d2b/d56/d83/c9d 0 2023-12-07T16:21:41.452 INFO:tasks.workunit.client.0.smithi063.stdout:0/500: sync 2023-12-07T16:21:41.453 INFO:tasks.workunit.client.1.smithi152.stdout:6/704: unlink d2/d4f/d83/d85/d19/c7f 0 2023-12-07T16:21:41.455 INFO:tasks.workunit.client.1.smithi152.stdout:5/868: symlink dd/de/d14/l131 0 2023-12-07T16:21:41.455 INFO:tasks.workunit.client.1.smithi152.stdout:5/869: fdatasync dd/de/d38/d3d/d6d/dae/f121 0 2023-12-07T16:21:41.455 INFO:tasks.workunit.client.1.smithi152.stdout:5/870: write dd/de/d14/d19/d1a/f118 [1727559,86550] 0 2023-12-07T16:21:41.455 INFO:tasks.workunit.client.1.smithi152.stdout:5/871: fdatasync dd/de/d38/d3d/f41 0 2023-12-07T16:21:41.455 INFO:tasks.workunit.client.1.smithi152.stdout:5/872: chown dd/de/d14/d19/d1a/def/cf8 10721385 1 2023-12-07T16:21:41.457 INFO:tasks.workunit.client.1.smithi152.stdout:3/699: dwrite d7/dc/d14/f15 [4194304,4194304] 0 2023-12-07T16:21:41.457 INFO:tasks.workunit.client.1.smithi152.stdout:3/700: chown d7/d10/dd0 64 1 2023-12-07T16:21:41.457 INFO:tasks.workunit.client.1.smithi152.stdout:4/638: creat d0/d3/d6/dc/db7/fbd x:0 0 0 2023-12-07T16:21:41.460 INFO:tasks.workunit.client.1.smithi152.stdout:3/701: rename d7/d10/d1a/d25/d4b/fca to d7/d10/d41/fdc 0 2023-12-07T16:21:41.469 INFO:tasks.workunit.client.1.smithi152.stdout:5/873: write dd/d7b/dbf/fc3 [738670,58952] 0 2023-12-07T16:21:41.470 INFO:tasks.workunit.client.1.smithi152.stdout:4/639: dread d0/d3/d6/f26 [0,4194304] 0 2023-12-07T16:21:41.482 INFO:tasks.workunit.client.1.smithi152.stdout:6/705: dread d2/d4f/d83/d85/d9/f35 [0,4194304] 0 2023-12-07T16:21:41.489 INFO:tasks.workunit.client.1.smithi152.stdout:3/702: dwrite f2 [0,4194304] 0 2023-12-07T16:21:41.489 INFO:tasks.workunit.client.1.smithi152.stdout:3/703: chown d7/d10/d1a/d2f/d5c/dbf 1643159 1 2023-12-07T16:21:41.493 INFO:tasks.workunit.client.1.smithi152.stdout:5/874: dwrite dd/de/d38/d3d/d6d/dae/f12a [0,4194304] 0 2023-12-07T16:21:41.497 INFO:tasks.workunit.client.1.smithi152.stdout:5/875: link dd/de/d14/dc6/db0/fb6 dd/de/f132 0 2023-12-07T16:21:41.497 INFO:tasks.workunit.client.1.smithi152.stdout:5/876: fsync dd/d7b/dbf/f102 0 2023-12-07T16:21:41.497 INFO:tasks.workunit.client.1.smithi152.stdout:5/877: stat dd/de/d38/d3d 0 2023-12-07T16:21:41.498 INFO:tasks.workunit.client.1.smithi152.stdout:5/878: creat dd/de/d14/d19/d7a/f133 x:0 0 0 2023-12-07T16:21:41.502 INFO:tasks.workunit.client.1.smithi152.stdout:4/640: dwrite d0/d17/f79 [0,4194304] 0 2023-12-07T16:21:41.504 INFO:tasks.workunit.client.1.smithi152.stdout:4/641: rename d0/d3/d6/dc/d39/d93/f90 to d0/d3/fbe 0 2023-12-07T16:21:41.505 INFO:tasks.workunit.client.1.smithi152.stdout:3/704: dwrite d7/d10/d1a/d25/fd5 [0,4194304] 0 2023-12-07T16:21:41.506 INFO:tasks.workunit.client.1.smithi152.stdout:4/642: write d0/d3/d6/dc/d39/d93/f24 [786315,53130] 0 2023-12-07T16:21:41.507 INFO:tasks.workunit.client.1.smithi152.stdout:3/705: mkdir d7/d10/d1a/d2f/d5c/ddd 0 2023-12-07T16:21:41.508 INFO:tasks.workunit.client.1.smithi152.stdout:3/706: chown d7/dc/l13 262068 1 2023-12-07T16:21:41.508 INFO:tasks.workunit.client.1.smithi152.stdout:3/707: chown d7/d10/d1a/d2f/d86/dda/d62 49532 1 2023-12-07T16:21:41.508 INFO:tasks.workunit.client.1.smithi152.stdout:4/643: mknod d0/d3/d6/dc/db7/cbf 0 2023-12-07T16:21:41.509 INFO:tasks.workunit.client.1.smithi152.stdout:3/708: stat d7/dc/d14/l2d 0 2023-12-07T16:21:41.509 INFO:tasks.workunit.client.1.smithi152.stdout:5/879: truncate dd/de/d38/d3d/d6d/dae/f12a 3245366 0 2023-12-07T16:21:41.510 INFO:tasks.workunit.client.1.smithi152.stdout:5/880: read dd/d91/dbe/d10e/f44 [1404660,11451] 0 2023-12-07T16:21:41.510 INFO:tasks.workunit.client.1.smithi152.stdout:4/644: symlink d0/d3/d6/d2b/d56/lc0 0 2023-12-07T16:21:41.511 INFO:tasks.workunit.client.1.smithi152.stdout:4/645: stat d0/d3/d6/dc/d3a/d46/d9b 0 2023-12-07T16:21:41.511 INFO:tasks.workunit.client.1.smithi152.stdout:3/709: creat d7/d10/d1a/d2f/d56/fde x:0 0 0 2023-12-07T16:21:41.514 INFO:tasks.workunit.client.1.smithi152.stdout:5/881: link dd/de/d14/d19/d1a/def/cf8 dd/de/d14/d19/d7a/da6/c134 0 2023-12-07T16:21:41.514 INFO:tasks.workunit.client.1.smithi152.stdout:5/882: getdents dd/de/d14/d19/da3/d114 0 2023-12-07T16:21:41.514 INFO:tasks.workunit.client.1.smithi152.stdout:5/883: rename dd/de/d38/d3d to dd/de/d38/d3d/d6d/dae/de0/d135 22 2023-12-07T16:21:41.514 INFO:tasks.workunit.client.1.smithi152.stdout:5/884: write dd/de/d14/dc6/ff6 [595580,119032] 0 2023-12-07T16:21:41.514 INFO:tasks.workunit.client.1.smithi152.stdout:3/710: truncate d7/f32 10623672 0 2023-12-07T16:21:41.515 INFO:tasks.workunit.client.1.smithi152.stdout:5/885: rmdir dd/de/d14/d19/d1a/dcc/dd0 39 2023-12-07T16:21:41.518 INFO:tasks.workunit.client.1.smithi152.stdout:3/711: creat d7/d10/d1a/d25/d3f/fdf x:0 0 0 2023-12-07T16:21:41.520 INFO:tasks.workunit.client.1.smithi152.stdout:5/886: rename dd/d91/dbe/d10e/f8b to dd/de/d14/d19/d1a/def/f136 0 2023-12-07T16:21:41.521 INFO:tasks.workunit.client.0.smithi063.stdout:4/413: mknod d1/d3/db/d16/d66/c75 0 2023-12-07T16:21:41.522 INFO:tasks.workunit.client.1.smithi152.stdout:5/887: creat dd/de/d14/dc6/f137 x:0 0 0 2023-12-07T16:21:41.522 INFO:tasks.workunit.client.1.smithi152.stdout:5/888: write dd/de/d14/d19/f23 [3761699,40363] 0 2023-12-07T16:21:41.524 INFO:tasks.workunit.client.0.smithi063.stdout:3/480: rename d7/d21/l5f to d7/d4f/d53/l9c 0 2023-12-07T16:21:41.525 INFO:tasks.workunit.client.0.smithi063.stdout:7/442: symlink d2/d34/d5a/d5f/d53/d9f/la6 0 2023-12-07T16:21:41.525 INFO:tasks.workunit.client.0.smithi063.stdout:7/443: dread - d2/d34/d46/d48/d56/f7d zero size 2023-12-07T16:21:41.527 INFO:tasks.workunit.client.0.smithi063.stdout:2/560: mknod d0/d4a/cba 0 2023-12-07T16:21:41.527 INFO:tasks.workunit.client.0.smithi063.stdout:3/481: write d7/d49/d4b/f5e [43671,31071] 0 2023-12-07T16:21:41.527 INFO:tasks.workunit.client.1.smithi152.stdout:3/712: write d7/f8 [5179246,108578] 0 2023-12-07T16:21:41.528 INFO:tasks.workunit.client.1.smithi152.stdout:3/713: mknod d7/d10/d1a/d2f/d86/dda/d62/d6d/ce0 0 2023-12-07T16:21:41.528 INFO:tasks.workunit.client.1.smithi152.stdout:3/714: chown d7/dc/fb1 63138 1 2023-12-07T16:21:41.528 INFO:tasks.workunit.client.1.smithi152.stdout:3/715: readlink d7/d10/l36 0 2023-12-07T16:21:41.529 INFO:tasks.workunit.client.0.smithi063.stdout:0/501: unlink d4/dd/f44 0 2023-12-07T16:21:41.529 INFO:tasks.workunit.client.1.smithi152.stdout:3/716: truncate d7/d10/d41/f6e 251833 0 2023-12-07T16:21:41.531 INFO:tasks.workunit.client.1.smithi152.stdout:3/717: rmdir d7/d10/d1a/d2f/d86/dda/d6b 39 2023-12-07T16:21:41.532 INFO:tasks.workunit.client.1.smithi152.stdout:4/646: dwrite d0/d3/d6/d2b/d56/f70 [0,4194304] 0 2023-12-07T16:21:41.533 INFO:tasks.workunit.client.1.smithi152.stdout:3/718: unlink d7/d10/d1a/d25/f9a 0 2023-12-07T16:21:41.533 INFO:tasks.workunit.client.1.smithi152.stdout:3/719: write d7/d10/d1a/d25/f27 [1941009,39259] 0 2023-12-07T16:21:41.533 INFO:tasks.workunit.client.0.smithi063.stdout:4/414: read d1/d3/d3f/d49/f5e [149203,75475] 0 2023-12-07T16:21:41.534 INFO:tasks.workunit.client.0.smithi063.stdout:8/632: sync 2023-12-07T16:21:41.534 INFO:tasks.workunit.client.0.smithi063.stdout:5/449: sync 2023-12-07T16:21:41.534 INFO:tasks.workunit.client.0.smithi063.stdout:1/374: sync 2023-12-07T16:21:41.535 INFO:tasks.workunit.client.0.smithi063.stdout:7/444: creat d2/d34/fa7 x:0 0 0 2023-12-07T16:21:41.538 INFO:tasks.workunit.client.0.smithi063.stdout:6/551: truncate d0/d1e/d1d/f27 1277469 0 2023-12-07T16:21:41.540 INFO:tasks.workunit.client.0.smithi063.stdout:3/482: mknod d7/d4f/d53/c9d 0 2023-12-07T16:21:41.542 INFO:tasks.workunit.client.1.smithi152.stdout:3/720: mknod d7/d10/d1a/d2f/d86/dda/ce1 0 2023-12-07T16:21:41.542 INFO:tasks.workunit.client.0.smithi063.stdout:4/415: creat d1/d3/db/d16/d66/f76 x:0 0 0 2023-12-07T16:21:41.544 INFO:tasks.workunit.client.1.smithi152.stdout:3/721: write d7/d10/d1a/d25/d78/fc5 [718478,131012] 0 2023-12-07T16:21:41.546 INFO:tasks.workunit.client.0.smithi063.stdout:8/633: rmdir d7/d14/d15/d93 0 2023-12-07T16:21:41.548 INFO:tasks.workunit.client.0.smithi063.stdout:7/445: mknod d2/d34/d5a/d5f/d6d/ca8 0 2023-12-07T16:21:41.548 INFO:tasks.workunit.client.0.smithi063.stdout:1/375: write d0/dd/f16 [2626941,91190] 0 2023-12-07T16:21:41.554 INFO:tasks.workunit.client.0.smithi063.stdout:1/376: read d0/dd/f3b [3268051,31203] 0 2023-12-07T16:21:41.556 INFO:tasks.workunit.client.0.smithi063.stdout:3/483: creat d7/d9/f9e x:0 0 0 2023-12-07T16:21:41.556 INFO:tasks.workunit.client.0.smithi063.stdout:2/561: rename d0/d4a to d0/d21/d56/d11/d52/d5d/dbb 0 2023-12-07T16:21:41.556 INFO:tasks.workunit.client.0.smithi063.stdout:2/562: chown d0/d1e/f29 246894485 1 2023-12-07T16:21:41.556 INFO:tasks.workunit.client.0.smithi063.stdout:8/634: mknod d7/d14/d15/dac/cc1 0 2023-12-07T16:21:41.559 INFO:tasks.workunit.client.0.smithi063.stdout:6/552: unlink d0/d1e/d1d/l33 0 2023-12-07T16:21:41.560 INFO:tasks.workunit.client.0.smithi063.stdout:6/553: stat d0/d1e/d1d/d4f 0 2023-12-07T16:21:41.561 INFO:tasks.workunit.client.0.smithi063.stdout:3/484: creat d7/d9/d2b/f9f x:0 0 0 2023-12-07T16:21:41.561 INFO:tasks.workunit.client.0.smithi063.stdout:3/485: stat d7/d9/d2b/d41/f9a 0 2023-12-07T16:21:41.561 INFO:tasks.workunit.client.0.smithi063.stdout:3/486: fdatasync d7/d9/dd/d56/f8c 0 2023-12-07T16:21:41.563 INFO:tasks.workunit.client.0.smithi063.stdout:6/554: creat d0/d1e/d60/d68/d76/da4/fc4 x:0 0 0 2023-12-07T16:21:41.564 INFO:tasks.workunit.client.0.smithi063.stdout:7/446: dread d2/d34/d5a/d5f/d2a/f31 [0,4194304] 0 2023-12-07T16:21:41.565 INFO:tasks.workunit.client.0.smithi063.stdout:7/447: creat d2/d2c/fa9 x:0 0 0 2023-12-07T16:21:41.568 INFO:tasks.workunit.client.0.smithi063.stdout:7/448: creat d2/d34/d5a/d5f/d78/d7c/d9b/faa x:0 0 0 2023-12-07T16:21:41.569 INFO:tasks.workunit.client.0.smithi063.stdout:1/377: dread d0/dd/d1f/f4e [0,4194304] 0 2023-12-07T16:21:41.570 INFO:tasks.workunit.client.0.smithi063.stdout:8/635: dread d7/d14/d1a/f51 [0,4194304] 0 2023-12-07T16:21:41.572 INFO:tasks.workunit.client.0.smithi063.stdout:8/636: symlink d7/d14/d15/dac/dad/lc2 0 2023-12-07T16:21:41.573 INFO:tasks.workunit.client.0.smithi063.stdout:1/378: write d0/dd/d10/d13/f60 [1222266,126392] 0 2023-12-07T16:21:41.575 INFO:tasks.workunit.client.0.smithi063.stdout:1/379: creat d0/dd/d19/d50/d71/f86 x:0 0 0 2023-12-07T16:21:41.576 INFO:tasks.workunit.client.1.smithi152.stdout:4/647: dwrite d0/d3/d6/d2b/d75/f8f [0,4194304] 0 2023-12-07T16:21:41.578 INFO:tasks.workunit.client.0.smithi063.stdout:7/449: dread d2/f36 [0,4194304] 0 2023-12-07T16:21:41.581 INFO:tasks.workunit.client.1.smithi152.stdout:4/648: write d0/d3/d6/f6a [1201306,103466] 0 2023-12-07T16:21:41.586 INFO:tasks.workunit.client.0.smithi063.stdout:1/380: dread d0/dd/f1c [0,4194304] 0 2023-12-07T16:21:41.588 INFO:tasks.workunit.client.0.smithi063.stdout:1/381: symlink d0/dd/d19/d50/l87 0 2023-12-07T16:21:41.588 INFO:tasks.workunit.client.0.smithi063.stdout:1/382: chown d0/dd/f39 0 1 2023-12-07T16:21:41.590 INFO:tasks.workunit.client.0.smithi063.stdout:8/637: dread d7/d14/d15/f68 [0,4194304] 0 2023-12-07T16:21:41.590 INFO:tasks.workunit.client.0.smithi063.stdout:8/638: write d7/d14/d15/d2b/d40/d63/d75/d98/fa3 [506625,118161] 0 2023-12-07T16:21:41.592 INFO:tasks.workunit.client.0.smithi063.stdout:8/639: creat d7/d14/d15/db4/fc3 x:0 0 0 2023-12-07T16:21:41.595 INFO:tasks.workunit.client.0.smithi063.stdout:8/640: mkdir d7/d14/d15/d2b/d40/d63/d75/d98/dc4 0 2023-12-07T16:21:41.597 INFO:tasks.workunit.client.0.smithi063.stdout:8/641: mkdir d7/d14/d15/dac/dc5 0 2023-12-07T16:21:41.600 INFO:tasks.workunit.client.0.smithi063.stdout:8/642: dread d7/d14/d1a/f33 [0,4194304] 0 2023-12-07T16:21:41.601 INFO:tasks.workunit.client.0.smithi063.stdout:8/643: unlink d7/l25 0 2023-12-07T16:21:41.602 INFO:tasks.workunit.client.0.smithi063.stdout:8/644: rmdir d7/d14/d15/dac/dc5 0 2023-12-07T16:21:41.605 INFO:tasks.workunit.client.0.smithi063.stdout:8/645: rename d7/d14/d1a/f74 to d7/d14/d15/dac/fc6 0 2023-12-07T16:21:41.605 INFO:tasks.workunit.client.0.smithi063.stdout:8/646: fdatasync d7/d14/d1a/f22 0 2023-12-07T16:21:41.605 INFO:tasks.workunit.client.0.smithi063.stdout:8/647: chown d7/d14/d15/d2b/d40/d63/d75/d98/fa3 126 1 2023-12-07T16:21:41.605 INFO:tasks.workunit.client.0.smithi063.stdout:8/648: creat d7/d14/d15/d2b/d40/d63/fc7 x:0 0 0 2023-12-07T16:21:41.607 INFO:tasks.workunit.client.0.smithi063.stdout:8/649: creat d7/d14/d1a/fc8 x:0 0 0 2023-12-07T16:21:41.607 INFO:tasks.workunit.client.0.smithi063.stdout:0/502: dwrite d4/dd/d26/d2b/d5e/f65 [0,4194304] 0 2023-12-07T16:21:41.607 INFO:tasks.workunit.client.0.smithi063.stdout:4/416: dwrite d1/d3/f68 [0,4194304] 0 2023-12-07T16:21:41.607 INFO:tasks.workunit.client.0.smithi063.stdout:8/650: creat d7/d14/d1a/fc9 x:0 0 0 2023-12-07T16:21:41.611 INFO:tasks.workunit.client.1.smithi152.stdout:3/722: dwrite d7/d10/d1a/fb0 [0,4194304] 0 2023-12-07T16:21:41.611 INFO:tasks.workunit.client.1.smithi152.stdout:3/723: write d7/d10/d1a/d25/d78/fc5 [1595596,93242] 0 2023-12-07T16:21:41.612 INFO:tasks.workunit.client.0.smithi063.stdout:0/503: write d4/f3e [3886616,37733] 0 2023-12-07T16:21:41.612 INFO:tasks.workunit.client.0.smithi063.stdout:6/555: dwrite d0/d1e/d1d/f3d [0,4194304] 0 2023-12-07T16:21:41.612 INFO:tasks.workunit.client.0.smithi063.stdout:6/556: chown d0/d79/d94 939483 1 2023-12-07T16:21:41.612 INFO:tasks.workunit.client.0.smithi063.stdout:8/651: symlink d7/lca 0 2023-12-07T16:21:41.612 INFO:tasks.workunit.client.0.smithi063.stdout:8/652: chown d7/d14/d15/d2b/f79 216746 1 2023-12-07T16:21:41.612 INFO:tasks.workunit.client.0.smithi063.stdout:8/653: chown f5 0 1 2023-12-07T16:21:41.613 INFO:tasks.workunit.client.0.smithi063.stdout:3/487: dwrite d7/fc [4194304,4194304] 0 2023-12-07T16:21:41.613 INFO:tasks.workunit.client.0.smithi063.stdout:1/383: dwrite d0/dd/d1f/f5b [0,4194304] 0 2023-12-07T16:21:41.613 INFO:tasks.workunit.client.0.smithi063.stdout:7/450: dwrite d2/d34/d5a/fa4 [0,4194304] 0 2023-12-07T16:21:41.615 INFO:tasks.workunit.client.0.smithi063.stdout:6/557: mknod d0/d1e/d60/d68/cc5 0 2023-12-07T16:21:41.617 INFO:tasks.workunit.client.0.smithi063.stdout:3/488: symlink d7/d9/d1b/d5c/la0 0 2023-12-07T16:21:41.617 INFO:tasks.workunit.client.0.smithi063.stdout:3/489: truncate d7/d9/d2b/d41/f86 884455 0 2023-12-07T16:21:41.617 INFO:tasks.workunit.client.0.smithi063.stdout:3/490: write d7/d49/d4b/f5e [1212608,54142] 0 2023-12-07T16:21:41.621 INFO:tasks.workunit.client.1.smithi152.stdout:3/724: truncate d7/d10/d1a/d2f/f26 2290050 0 2023-12-07T16:21:41.621 INFO:tasks.workunit.client.1.smithi152.stdout:3/725: write d7/d10/d1a/d2f/d86/dda/d7d/fa5 [202389,15243] 0 2023-12-07T16:21:41.621 INFO:tasks.workunit.client.1.smithi152.stdout:4/649: truncate d0/d17/f79 3502564 0 2023-12-07T16:21:41.621 INFO:tasks.workunit.client.1.smithi152.stdout:4/650: dread - d0/d17/d7f/fa9 zero size 2023-12-07T16:21:41.621 INFO:tasks.workunit.client.1.smithi152.stdout:4/651: dread - d0/d3/d6/d2b/d75/f9f zero size 2023-12-07T16:21:41.625 INFO:tasks.workunit.client.0.smithi063.stdout:4/417: dwrite d1/f34 [0,4194304] 0 2023-12-07T16:21:41.625 INFO:tasks.workunit.client.0.smithi063.stdout:4/418: dread - d1/d3/f5a zero size 2023-12-07T16:21:41.625 INFO:tasks.workunit.client.0.smithi063.stdout:4/419: fdatasync d1/d3/d3f/d49/f61 0 2023-12-07T16:21:41.625 INFO:tasks.workunit.client.1.smithi152.stdout:4/652: dread d0/d3/d6/f1d [0,4194304] 0 2023-12-07T16:21:41.625 INFO:tasks.workunit.client.1.smithi152.stdout:4/653: chown d0/d17/d7f/fa9 6311 1 2023-12-07T16:21:41.626 INFO:tasks.workunit.client.1.smithi152.stdout:4/654: dread - d0/d3/d6/f35 zero size 2023-12-07T16:21:41.627 INFO:tasks.workunit.client.0.smithi063.stdout:6/558: mkdir d0/d1e/d60/d68/d76/da4/dc6 0 2023-12-07T16:21:41.627 INFO:tasks.workunit.client.1.smithi152.stdout:3/726: dread d7/d10/d1a/f72 [0,4194304] 0 2023-12-07T16:21:41.629 INFO:tasks.workunit.client.1.smithi152.stdout:4/655: dread d0/d3/d6/dc/d3a/d46/d80/fa7 [0,4194304] 0 2023-12-07T16:21:41.629 INFO:tasks.workunit.client.1.smithi152.stdout:3/727: mknod d7/d10/d1a/d25/d3f/dcf/dab/ce2 0 2023-12-07T16:21:41.629 INFO:tasks.workunit.client.0.smithi063.stdout:3/491: unlink d7/d9/f84 0 2023-12-07T16:21:41.630 INFO:tasks.workunit.client.1.smithi152.stdout:0/676: sync 2023-12-07T16:21:41.630 INFO:tasks.workunit.client.1.smithi152.stdout:4/656: symlink d0/d3/d6/dc/d22/lc1 0 2023-12-07T16:21:41.630 INFO:tasks.workunit.client.1.smithi152.stdout:4/657: write d0/d3/d6/d36/f44 [1670036,105642] 0 2023-12-07T16:21:41.632 INFO:tasks.workunit.client.1.smithi152.stdout:0/677: link d0/c8 d0/d27/ceb 0 2023-12-07T16:21:41.634 INFO:tasks.workunit.client.0.smithi063.stdout:4/420: creat d1/d3/db/d2c/f77 x:0 0 0 2023-12-07T16:21:41.634 INFO:tasks.workunit.client.1.smithi152.stdout:4/658: creat d0/d17/d7f/fc2 x:0 0 0 2023-12-07T16:21:41.634 INFO:tasks.workunit.client.1.smithi152.stdout:4/659: stat d0/d3/d6/dc/d22/lb3 0 2023-12-07T16:21:41.640 INFO:tasks.workunit.client.0.smithi063.stdout:6/559: creat d0/d17/d46/fc7 x:0 0 0 2023-12-07T16:21:41.640 INFO:tasks.workunit.client.0.smithi063.stdout:3/492: creat d7/d4f/d53/fa1 x:0 0 0 2023-12-07T16:21:41.640 INFO:tasks.workunit.client.0.smithi063.stdout:3/493: chown d7/d9/d2b/d41/f86 668 1 2023-12-07T16:21:41.640 INFO:tasks.workunit.client.0.smithi063.stdout:3/494: chown d7/d49/d4b/l70 46 1 2023-12-07T16:21:41.640 INFO:tasks.workunit.client.0.smithi063.stdout:3/495: chown d7/d21/c3b 1622718976 1 2023-12-07T16:21:41.643 INFO:tasks.workunit.client.1.smithi152.stdout:0/678: dread d0/d2f/f3f [0,4194304] 0 2023-12-07T16:21:41.644 INFO:tasks.workunit.client.0.smithi063.stdout:4/421: getdents d1/d3/d3f 0 2023-12-07T16:21:41.644 INFO:tasks.workunit.client.1.smithi152.stdout:0/679: rename d0/dc/d36/d3a/fe4 to d0/dc/d36/d7d/d92/de9/fec 0 2023-12-07T16:21:41.644 INFO:tasks.workunit.client.1.smithi152.stdout:0/680: readlink d0/dc/d3d/l7f 0 2023-12-07T16:21:41.646 INFO:tasks.workunit.client.1.smithi152.stdout:0/681: link d0/d27/d11/c13 d0/dc/d36/ced 0 2023-12-07T16:21:41.646 INFO:tasks.workunit.client.1.smithi152.stdout:0/682: chown d0/dc/d36/d3a 0 1 2023-12-07T16:21:41.646 INFO:tasks.workunit.client.1.smithi152.stdout:0/683: chown d0/dc/d36/d3a/d51/d82/fb9 6 1 2023-12-07T16:21:41.647 INFO:tasks.workunit.client.0.smithi063.stdout:6/560: creat d0/d17/d1a/fc8 x:0 0 0 2023-12-07T16:21:41.648 INFO:tasks.workunit.client.0.smithi063.stdout:3/496: mknod d7/d4f/d53/d72/d7d/ca2 0 2023-12-07T16:21:41.649 INFO:tasks.workunit.client.1.smithi152.stdout:0/684: write d0/dc/d3d/d4c/f64 [3656343,4489] 0 2023-12-07T16:21:41.650 INFO:tasks.workunit.client.0.smithi063.stdout:4/422: unlink d1/d3/db/f72 0 2023-12-07T16:21:41.651 INFO:tasks.workunit.client.1.smithi152.stdout:0/685: dread d0/dc/d36/d3a/d51/f7a [0,4194304] 0 2023-12-07T16:21:41.651 INFO:tasks.workunit.client.0.smithi063.stdout:3/497: unlink d7/d9/dd/f6b 0 2023-12-07T16:21:41.652 INFO:tasks.workunit.client.0.smithi063.stdout:4/423: creat d1/d3/db/d73/f78 x:0 0 0 2023-12-07T16:21:41.653 INFO:tasks.workunit.client.0.smithi063.stdout:3/498: mknod d7/ca3 0 2023-12-07T16:21:41.655 INFO:tasks.workunit.client.0.smithi063.stdout:0/504: dwrite d4/dd/d26/d2b/d5e/d8e/d95/f94 [0,4194304] 0 2023-12-07T16:21:41.655 INFO:tasks.workunit.client.0.smithi063.stdout:0/505: write d4/dd/d26/d2b/d5e/f88 [173765,19287] 0 2023-12-07T16:21:41.655 INFO:tasks.workunit.client.0.smithi063.stdout:4/424: link d1/d3/db/d2c/d63/c3d d1/d3/db/d41/c79 0 2023-12-07T16:21:41.656 INFO:tasks.workunit.client.0.smithi063.stdout:4/425: read d1/f34 [597754,28021] 0 2023-12-07T16:21:41.657 INFO:tasks.workunit.client.0.smithi063.stdout:3/499: truncate d7/d9/d2b/d41/f9a 3044835 0 2023-12-07T16:21:41.657 INFO:tasks.workunit.client.0.smithi063.stdout:3/500: read d7/d9/d2b/f62 [29707,19400] 0 2023-12-07T16:21:41.663 INFO:tasks.workunit.client.0.smithi063.stdout:0/506: mkdir d4/dd/de/d15/d59/da5 0 2023-12-07T16:21:41.664 INFO:tasks.workunit.client.1.smithi152.stdout:3/728: dwrite d7/d10/d1a/d25/fcc [0,4194304] 0 2023-12-07T16:21:41.667 INFO:tasks.workunit.client.0.smithi063.stdout:0/507: symlink d4/dd/de/d15/d59/da5/la6 0 2023-12-07T16:21:41.667 INFO:tasks.workunit.client.0.smithi063.stdout:0/508: chown d4/dd/de/d15/d1f/l57 6779 1 2023-12-07T16:21:41.668 INFO:tasks.workunit.client.1.smithi152.stdout:3/729: creat d7/d10/d19/fe3 x:0 0 0 2023-12-07T16:21:41.669 INFO:tasks.workunit.client.0.smithi063.stdout:3/501: dread d7/d21/f69 [0,4194304] 0 2023-12-07T16:21:41.669 INFO:tasks.workunit.client.0.smithi063.stdout:3/502: write d7/d4f/d53/d54/d76/f83 [8360841,116526] 0 2023-12-07T16:21:41.669 INFO:tasks.workunit.client.0.smithi063.stdout:3/503: chown d7/d49/d4b/d8e 871 1 2023-12-07T16:21:41.669 INFO:tasks.workunit.client.0.smithi063.stdout:9/444: sync 2023-12-07T16:21:41.669 INFO:tasks.workunit.client.0.smithi063.stdout:9/445: readlink d0/d13/d39/d3a/d78/l80 0 2023-12-07T16:21:41.670 INFO:tasks.workunit.client.1.smithi152.stdout:3/730: creat d7/d10/d1a/d2f/d86/fe4 x:0 0 0 2023-12-07T16:21:41.670 INFO:tasks.workunit.client.1.smithi152.stdout:3/731: write d7/d10/d1a/d2f/d86/dda/d6b/d80/dc2/fc8 [843745,50055] 0 2023-12-07T16:21:41.671 INFO:tasks.workunit.client.0.smithi063.stdout:0/509: link d4/dd/de/d15/d1f/d22/l9a d4/dd/de/d15/d59/da5/la7 0 2023-12-07T16:21:41.671 INFO:tasks.workunit.client.0.smithi063.stdout:0/510: fdatasync d4/d25/f8d 0 2023-12-07T16:21:41.671 INFO:tasks.workunit.client.0.smithi063.stdout:1/384: dwrite d0/dd/d19/f43 [0,4194304] 0 2023-12-07T16:21:41.671 INFO:tasks.workunit.client.0.smithi063.stdout:1/385: chown d0/dd/d19/d50/d71/f52 0 1 2023-12-07T16:21:41.671 INFO:tasks.workunit.client.0.smithi063.stdout:3/504: creat d7/d49/d4b/d8e/fa4 x:0 0 0 2023-12-07T16:21:41.672 INFO:tasks.workunit.client.0.smithi063.stdout:9/446: creat d0/d13/d39/d3a/d78/f8a x:0 0 0 2023-12-07T16:21:41.673 INFO:tasks.workunit.client.0.smithi063.stdout:9/447: chown d0/d21/d64/d6a/f75 8 1 2023-12-07T16:21:41.674 INFO:tasks.workunit.client.0.smithi063.stdout:9/448: write d0/d21/f23 [420532,54953] 0 2023-12-07T16:21:41.674 INFO:tasks.workunit.client.0.smithi063.stdout:9/449: fdatasync d0/d21/f71 0 2023-12-07T16:21:41.674 INFO:tasks.workunit.client.0.smithi063.stdout:0/511: mkdir d4/dd/de/d15/d52/d5b/d63/d6b/da8 0 2023-12-07T16:21:41.677 INFO:tasks.workunit.client.0.smithi063.stdout:1/386: getdents d0/dd/d55 0 2023-12-07T16:21:41.678 INFO:tasks.workunit.client.0.smithi063.stdout:3/505: mknod d7/d9/ca5 0 2023-12-07T16:21:41.680 INFO:tasks.workunit.client.0.smithi063.stdout:9/450: rename d0/d13/d39/c41 to d0/d13/c8b 0 2023-12-07T16:21:41.681 INFO:tasks.workunit.client.0.smithi063.stdout:0/512: creat d4/dd/de/d15/d52/d5b/fa9 x:0 0 0 2023-12-07T16:21:41.682 INFO:tasks.workunit.client.0.smithi063.stdout:1/387: rmdir d0/dd/d4f 39 2023-12-07T16:21:41.683 INFO:tasks.workunit.client.0.smithi063.stdout:9/451: symlink d0/d13/d39/l8c 0 2023-12-07T16:21:41.684 INFO:tasks.workunit.client.1.smithi152.stdout:3/732: dread d7/d10/d41/f8b [0,4194304] 0 2023-12-07T16:21:41.684 INFO:tasks.workunit.client.1.smithi152.stdout:3/733: stat d7/d10/d1a/d25/d78/dd4 0 2023-12-07T16:21:41.684 INFO:tasks.workunit.client.0.smithi063.stdout:0/513: unlink d4/l8 0 2023-12-07T16:21:41.685 INFO:tasks.workunit.client.0.smithi063.stdout:4/426: dwrite d1/d3/f4e [0,4194304] 0 2023-12-07T16:21:41.686 INFO:tasks.workunit.client.0.smithi063.stdout:6/561: dwrite d0/d1e/d1d/d1f/d6c/fa8 [0,4194304] 0 2023-12-07T16:21:41.686 INFO:tasks.workunit.client.1.smithi152.stdout:3/734: creat d7/d10/d1a/d2f/d5c/ddd/fe5 x:0 0 0 2023-12-07T16:21:41.686 INFO:tasks.workunit.client.1.smithi152.stdout:3/735: readlink d7/d10/d1a/d2f/l9b 0 2023-12-07T16:21:41.686 INFO:tasks.workunit.client.1.smithi152.stdout:0/686: dwrite d0/d2f/f52 [0,4194304] 0 2023-12-07T16:21:41.687 INFO:tasks.workunit.client.0.smithi063.stdout:1/388: rename d0/dd/d10/d46/l54 to d0/dd/d19/d50/d71/l88 0 2023-12-07T16:21:41.688 INFO:tasks.workunit.client.0.smithi063.stdout:9/452: mkdir d0/d8d 0 2023-12-07T16:21:41.688 INFO:tasks.workunit.client.0.smithi063.stdout:9/453: read - d0/d13/d39/d3a/d78/f8a zero size 2023-12-07T16:21:41.689 INFO:tasks.workunit.client.0.smithi063.stdout:3/506: dread d7/ff [0,4194304] 0 2023-12-07T16:21:41.689 INFO:tasks.workunit.client.0.smithi063.stdout:3/507: write d7/d4f/d53/fa1 [531619,76919] 0 2023-12-07T16:21:41.690 INFO:tasks.workunit.client.0.smithi063.stdout:0/514: truncate d4/d25/f9e 1690417 0 2023-12-07T16:21:41.690 INFO:tasks.workunit.client.1.smithi152.stdout:0/687: link d0/dc/d3d/l7f d0/dc/d3d/d73/dbf/dc9/lee 0 2023-12-07T16:21:41.692 INFO:tasks.workunit.client.1.smithi152.stdout:0/688: creat d0/d27/fef x:0 0 0 2023-12-07T16:21:41.693 INFO:tasks.workunit.client.1.smithi152.stdout:0/689: symlink d0/dc/d26/lf0 0 2023-12-07T16:21:41.694 INFO:tasks.workunit.client.0.smithi063.stdout:4/427: getdents d1/d3/db/d2c 0 2023-12-07T16:21:41.695 INFO:tasks.workunit.client.1.smithi152.stdout:0/690: mknod d0/dc/d26/cf1 0 2023-12-07T16:21:41.699 INFO:tasks.workunit.client.0.smithi063.stdout:9/454: mknod d0/d21/d64/d6a/c8e 0 2023-12-07T16:21:41.702 INFO:tasks.workunit.client.0.smithi063.stdout:4/428: write d1/d3/d3f/d49/f61 [461779,77671] 0 2023-12-07T16:21:41.702 INFO:tasks.workunit.client.0.smithi063.stdout:3/508: mknod d7/d9/d2b/ca6 0 2023-12-07T16:21:41.702 INFO:tasks.workunit.client.0.smithi063.stdout:3/509: read d7/d9/d2b/f62 [21697,64141] 0 2023-12-07T16:21:41.702 INFO:tasks.workunit.client.0.smithi063.stdout:3/510: chown d7/d21/f69 50225234 1 2023-12-07T16:21:41.703 INFO:tasks.workunit.client.0.smithi063.stdout:0/515: symlink d4/dd/de/d15/d59/laa 0 2023-12-07T16:21:41.705 INFO:tasks.workunit.client.0.smithi063.stdout:9/455: dread d0/d7/f55 [0,4194304] 0 2023-12-07T16:21:41.705 INFO:tasks.workunit.client.0.smithi063.stdout:9/456: chown d0/d13/d6f/l87 177 1 2023-12-07T16:21:41.705 INFO:tasks.workunit.client.0.smithi063.stdout:9/457: fdatasync d0/d21/d64/d6a/f79 0 2023-12-07T16:21:41.705 INFO:tasks.workunit.client.0.smithi063.stdout:9/458: readlink d0/d21/l3c 0 2023-12-07T16:21:41.705 INFO:tasks.workunit.client.0.smithi063.stdout:6/562: unlink d0/d1e/d1d/l2b 0 2023-12-07T16:21:41.707 INFO:tasks.workunit.client.0.smithi063.stdout:3/511: write d7/d9/dd/f42 [2202218,115431] 0 2023-12-07T16:21:41.708 INFO:tasks.workunit.client.0.smithi063.stdout:4/429: rmdir d1/d3/db/d16/d66 39 2023-12-07T16:21:41.709 INFO:tasks.workunit.client.0.smithi063.stdout:0/516: mknod d4/dd/de/d15/d1f/d22/cab 0 2023-12-07T16:21:41.710 INFO:tasks.workunit.client.0.smithi063.stdout:9/459: mkdir d0/d21/d64/d6a/d8f 0 2023-12-07T16:21:41.710 INFO:tasks.workunit.client.0.smithi063.stdout:4/430: write d1/d3/db/f3e [1367893,5836] 0 2023-12-07T16:21:41.711 INFO:tasks.workunit.client.0.smithi063.stdout:6/563: creat d0/d1e/d60/d68/fc9 x:0 0 0 2023-12-07T16:21:41.711 INFO:tasks.workunit.client.0.smithi063.stdout:6/564: dread - d0/d17/d46/fc7 zero size 2023-12-07T16:21:41.712 INFO:tasks.workunit.client.1.smithi152.stdout:3/736: dwrite d7/d10/d1a/d2f/d86/dda/d6b/d80/dc2/fc8 [0,4194304] 0 2023-12-07T16:21:41.712 INFO:tasks.workunit.client.1.smithi152.stdout:3/737: dread - d7/d10/d1a/d2f/d86/dda/d6b/fd3 zero size 2023-12-07T16:21:41.712 INFO:tasks.workunit.client.1.smithi152.stdout:3/738: truncate d7/d10/d1a/d2f/d86/dda/d62/fb6 539376 0 2023-12-07T16:21:41.713 INFO:tasks.workunit.client.0.smithi063.stdout:0/517: symlink d4/dd/d26/d2b/lac 0 2023-12-07T16:21:41.714 INFO:tasks.workunit.client.1.smithi152.stdout:3/739: mkdir d7/d10/d1a/d2f/d86/dda/d62/d6d/d81/de6 0 2023-12-07T16:21:41.715 INFO:tasks.workunit.client.0.smithi063.stdout:4/431: creat d1/d3/db/d16/f7a x:0 0 0 2023-12-07T16:21:41.715 INFO:tasks.workunit.client.1.smithi152.stdout:3/740: symlink d7/d10/d1a/le7 0 2023-12-07T16:21:41.716 INFO:tasks.workunit.client.0.smithi063.stdout:6/565: symlink d0/d1e/d1d/d1f/d4b/lca 0 2023-12-07T16:21:41.718 INFO:tasks.workunit.client.0.smithi063.stdout:4/432: symlink d1/d3/db/d2c/d63/d62/l7b 0 2023-12-07T16:21:41.718 INFO:tasks.workunit.client.1.smithi152.stdout:3/741: mkdir d7/d10/d1a/de8 0 2023-12-07T16:21:41.719 INFO:tasks.workunit.client.1.smithi152.stdout:3/742: readlink d7/d10/d19/lc3 0 2023-12-07T16:21:41.719 INFO:tasks.workunit.client.1.smithi152.stdout:3/743: fsync d7/d10/d1a/d2f/d86/f8d 0 2023-12-07T16:21:41.721 INFO:tasks.workunit.client.1.smithi152.stdout:3/744: mknod d7/d10/d1a/ce9 0 2023-12-07T16:21:41.721 INFO:tasks.workunit.client.1.smithi152.stdout:3/745: chown d7/d10/d1a/d25/d78/f8a 17597 1 2023-12-07T16:21:41.724 INFO:tasks.workunit.client.0.smithi063.stdout:0/518: dread d4/dd/de/d15/f18 [0,4194304] 0 2023-12-07T16:21:41.725 INFO:tasks.workunit.client.0.smithi063.stdout:6/566: creat d0/d1e/d60/d68/d76/fcb x:0 0 0 2023-12-07T16:21:41.725 INFO:tasks.workunit.client.0.smithi063.stdout:1/389: dwrite d0/dd/d10/f85 [0,4194304] 0 2023-12-07T16:21:41.725 INFO:tasks.workunit.client.0.smithi063.stdout:1/390: readlink d0/dd/d10/d46/l81 0 2023-12-07T16:21:41.727 INFO:tasks.workunit.client.0.smithi063.stdout:0/519: creat d4/dd/d26/d2b/d5e/d8e/d95/d68/fad x:0 0 0 2023-12-07T16:21:41.728 INFO:tasks.workunit.client.1.smithi152.stdout:0/691: dwrite d0/fa4 [0,4194304] 0 2023-12-07T16:21:41.728 INFO:tasks.workunit.client.0.smithi063.stdout:6/567: mkdir d0/d1e/d60/d68/d76/da4/dcc 0 2023-12-07T16:21:41.729 INFO:tasks.workunit.client.1.smithi152.stdout:0/692: mknod d0/dc/d36/d3a/dca/cf2 0 2023-12-07T16:21:41.729 INFO:tasks.workunit.client.1.smithi152.stdout:0/693: dread - d0/dc/d3d/fde zero size 2023-12-07T16:21:41.731 INFO:tasks.workunit.client.0.smithi063.stdout:1/391: creat d0/dd/d10/d13/d2f/f89 x:0 0 0 2023-12-07T16:21:41.731 INFO:tasks.workunit.client.0.smithi063.stdout:1/392: chown d0/dd 950262 1 2023-12-07T16:21:41.731 INFO:tasks.workunit.client.1.smithi152.stdout:0/694: creat d0/d2f/d30/d6e/d77/ff3 x:0 0 0 2023-12-07T16:21:41.731 INFO:tasks.workunit.client.1.smithi152.stdout:0/695: dread - d0/dc/d36/d3a/d51/d82/fb9 zero size 2023-12-07T16:21:41.733 INFO:tasks.workunit.client.1.smithi152.stdout:0/696: unlink d0/dc/d36/d7d/cc5 0 2023-12-07T16:21:41.733 INFO:tasks.workunit.client.1.smithi152.stdout:0/697: write d0/dc/d36/d3a/d69/f99 [419544,73757] 0 2023-12-07T16:21:41.734 INFO:tasks.workunit.client.1.smithi152.stdout:3/746: dread d7/f5d [0,4194304] 0 2023-12-07T16:21:41.734 INFO:tasks.workunit.client.0.smithi063.stdout:0/520: creat d4/dd/de/d15/d52/d5b/fae x:0 0 0 2023-12-07T16:21:41.734 INFO:tasks.workunit.client.0.smithi063.stdout:0/521: chown d4/dd/d26/d2b/d5e/d8e/d95/d68 150869 1 2023-12-07T16:21:41.734 INFO:tasks.workunit.client.0.smithi063.stdout:6/568: symlink d0/d54/lcd 0 2023-12-07T16:21:41.735 INFO:tasks.workunit.client.1.smithi152.stdout:3/747: mknod d7/d10/d1a/d25/d78/cea 0 2023-12-07T16:21:41.737 INFO:tasks.workunit.client.0.smithi063.stdout:9/460: write d0/d13/d39/d42/d57/f76 [565638,58100] 0 2023-12-07T16:21:41.740 INFO:tasks.workunit.client.0.smithi063.stdout:9/461: rename d0/d21/c84 to d0/d13/d39/d42/d57/c90 0 2023-12-07T16:21:41.742 INFO:tasks.workunit.client.0.smithi063.stdout:9/462: link d0/d13/d39/c5b d0/d21/d64/d6a/c91 0 2023-12-07T16:21:41.743 INFO:tasks.workunit.client.1.smithi152.stdout:3/748: write d7/d10/d1a/d2f/d86/f8d [199597,37148] 0 2023-12-07T16:21:41.745 INFO:tasks.workunit.client.0.smithi063.stdout:9/463: mkdir d0/d21/d64/d6a/d8f/d92 0 2023-12-07T16:21:41.746 INFO:tasks.workunit.client.1.smithi152.stdout:3/749: read d7/f5a [1171874,33712] 0 2023-12-07T16:21:41.746 INFO:tasks.workunit.client.0.smithi063.stdout:9/464: symlink d0/l93 0 2023-12-07T16:21:41.748 INFO:tasks.workunit.client.1.smithi152.stdout:0/698: dread d0/dc/d3d/d73/dbf/fe7 [0,4194304] 0 2023-12-07T16:21:41.749 INFO:tasks.workunit.client.0.smithi063.stdout:3/512: dwrite d7/d49/d4b/d8e/fa4 [0,4194304] 0 2023-12-07T16:21:41.749 INFO:tasks.workunit.client.0.smithi063.stdout:3/513: write d7/d8d/f81 [925363,57551] 0 2023-12-07T16:21:41.749 INFO:tasks.workunit.client.0.smithi063.stdout:9/465: symlink d0/l94 0 2023-12-07T16:21:41.751 INFO:tasks.workunit.client.1.smithi152.stdout:0/699: mknod d0/dc/d3d/d73/dbf/dc9/cf4 0 2023-12-07T16:21:41.751 INFO:tasks.workunit.client.1.smithi152.stdout:0/700: chown d0/dc/d26/fdf 291 1 2023-12-07T16:21:41.753 INFO:tasks.workunit.client.1.smithi152.stdout:0/701: symlink d0/dc/d36/d7d/d92/de9/lf5 0 2023-12-07T16:21:41.754 INFO:tasks.workunit.client.0.smithi063.stdout:6/569: dread d0/d54/f5f [0,4194304] 0 2023-12-07T16:21:41.754 INFO:tasks.workunit.client.0.smithi063.stdout:6/570: write d0/d1e/d60/d68/d76/fcb [199456,65767] 0 2023-12-07T16:21:41.755 INFO:tasks.workunit.client.1.smithi152.stdout:0/702: rmdir d0/d27 39 2023-12-07T16:21:41.755 INFO:tasks.workunit.client.1.smithi152.stdout:0/703: fsync d0/dc/d36/d3a/d69/fad 0 2023-12-07T16:21:41.757 INFO:tasks.workunit.client.0.smithi063.stdout:4/433: dwrite d1/d3/d3f/d44/f6c [0,4194304] 0 2023-12-07T16:21:41.757 INFO:tasks.workunit.client.1.smithi152.stdout:0/704: symlink d0/dc/d36/d3a/d69/lf6 0 2023-12-07T16:21:41.757 INFO:tasks.workunit.client.0.smithi063.stdout:3/514: rename d7/d4f/d53/f82 to d7/d9/dd/d56/fa7 0 2023-12-07T16:21:41.760 INFO:tasks.workunit.client.0.smithi063.stdout:9/466: truncate d0/d13/d39/f48 280268 0 2023-12-07T16:21:41.764 INFO:tasks.workunit.client.0.smithi063.stdout:6/571: creat d0/d1e/d20/d4a/fce x:0 0 0 2023-12-07T16:21:41.764 INFO:tasks.workunit.client.0.smithi063.stdout:6/572: chown d0/d1e/d60/d68/d69/d7d/f80 592089 1 2023-12-07T16:21:41.764 INFO:tasks.workunit.client.0.smithi063.stdout:4/434: write d1/d3/db/d2c/d63/f18 [1080045,89904] 0 2023-12-07T16:21:41.770 INFO:tasks.workunit.client.0.smithi063.stdout:3/515: creat d7/d8d/fa8 x:0 0 0 2023-12-07T16:21:41.770 INFO:tasks.workunit.client.0.smithi063.stdout:6/573: creat d0/d79/db9/fcf x:0 0 0 2023-12-07T16:21:41.772 INFO:tasks.workunit.client.0.smithi063.stdout:6/574: creat d0/d1e/d1d/d4f/d88/fd0 x:0 0 0 2023-12-07T16:21:41.773 INFO:tasks.workunit.client.0.smithi063.stdout:6/575: link d0/d17/d1a/d4d/d5a/l71 d0/d17/d1a/d38/ld1 0 2023-12-07T16:21:41.773 INFO:tasks.workunit.client.0.smithi063.stdout:6/576: readlink d0/d1e/d1d/d1f/d4b/l6a 0 2023-12-07T16:21:41.775 INFO:tasks.workunit.client.1.smithi152.stdout:1/881: sync 2023-12-07T16:21:41.778 INFO:tasks.workunit.client.0.smithi063.stdout:0/522: dwrite d4/dd/d26/d2b/d5e/d8e/f8b [0,4194304] 0 2023-12-07T16:21:41.778 INFO:tasks.workunit.client.0.smithi063.stdout:0/523: stat d4/dd/de/d15/d52/f53 0 2023-12-07T16:21:41.779 INFO:tasks.workunit.client.1.smithi152.stdout:3/750: dwrite d7/dc/d14/f39 [0,4194304] 0 2023-12-07T16:21:41.781 INFO:tasks.workunit.client.1.smithi152.stdout:3/751: creat d7/d10/d1a/d2f/d86/dda/d6b/d80/dc2/feb x:0 0 0 2023-12-07T16:21:41.783 INFO:tasks.workunit.client.0.smithi063.stdout:4/435: dread d1/d3/d3f/d49/f61 [0,4194304] 0 2023-12-07T16:21:41.784 INFO:tasks.workunit.client.1.smithi152.stdout:3/752: creat d7/d10/d1a/d2f/d86/dda/d6b/d80/dc2/fec x:0 0 0 2023-12-07T16:21:41.784 INFO:tasks.workunit.client.0.smithi063.stdout:0/524: rename d4/l1a to d4/dd/laf 0 2023-12-07T16:21:41.784 INFO:tasks.workunit.client.1.smithi152.stdout:3/753: rmdir d7/d10/d1a/d25/d4b 39 2023-12-07T16:21:41.785 INFO:tasks.workunit.client.0.smithi063.stdout:4/436: link d1/d3/db/d2c/l40 d1/l7c 0 2023-12-07T16:21:41.788 INFO:tasks.workunit.client.1.smithi152.stdout:0/705: dwrite d0/dc/d36/d7d/f8a [0,4194304] 0 2023-12-07T16:21:41.788 INFO:tasks.workunit.client.1.smithi152.stdout:0/706: chown d0/d27/d8c 22 1 2023-12-07T16:21:41.791 INFO:tasks.workunit.client.0.smithi063.stdout:0/525: link d4/dd/de/d15/d1f/f4a d4/dd/de/d15/d1f/d22/fb0 0 2023-12-07T16:21:41.791 INFO:tasks.workunit.client.0.smithi063.stdout:4/437: rename d1/d3/db/f38 to d1/d3/db/d16/d66/f7d 0 2023-12-07T16:21:41.792 INFO:tasks.workunit.client.0.smithi063.stdout:0/526: symlink d4/dd/de/d15/d52/d5b/d63/d74/lb1 0 2023-12-07T16:21:41.793 INFO:tasks.workunit.client.0.smithi063.stdout:4/438: read d1/d3/db/d16/f37 [1687263,126791] 0 2023-12-07T16:21:41.795 INFO:tasks.workunit.client.0.smithi063.stdout:4/439: creat d1/d3/db/d2c/d63/d62/f7e x:0 0 0 2023-12-07T16:21:41.795 INFO:tasks.workunit.client.1.smithi152.stdout:1/882: dread dc/d14/d18/d2d/d48/da3/d58/dde/fe2 [0,4194304] 0 2023-12-07T16:21:41.797 INFO:tasks.workunit.client.1.smithi152.stdout:1/883: rmdir dc/d14/d18/d79/d86 39 2023-12-07T16:21:41.799 INFO:tasks.workunit.client.0.smithi063.stdout:5/450: sync 2023-12-07T16:21:41.799 INFO:tasks.workunit.client.0.smithi063.stdout:5/451: truncate d1/d3/f3b 1870962 0 2023-12-07T16:21:41.799 INFO:tasks.workunit.client.0.smithi063.stdout:5/452: write d1/d3/d3a/f77 [91893,102945] 0 2023-12-07T16:21:41.800 INFO:tasks.workunit.client.1.smithi152.stdout:1/884: getdents dc/d14/d18/d79/d86 0 2023-12-07T16:21:41.800 INFO:tasks.workunit.client.0.smithi063.stdout:3/516: dwrite d7/d4f/f94 [4194304,4194304] 0 2023-12-07T16:21:41.801 INFO:tasks.workunit.client.0.smithi063.stdout:6/577: dwrite d0/d17/d46/f55 [0,4194304] 0 2023-12-07T16:21:41.801 INFO:tasks.workunit.client.0.smithi063.stdout:6/578: fdatasync d0/d1e/d60/d68/d76/da4/fb2 0 2023-12-07T16:21:41.801 INFO:tasks.workunit.client.0.smithi063.stdout:2/563: sync 2023-12-07T16:21:41.801 INFO:tasks.workunit.client.0.smithi063.stdout:7/451: sync 2023-12-07T16:21:41.801 INFO:tasks.workunit.client.0.smithi063.stdout:2/564: readlink d0/l1d 0 2023-12-07T16:21:41.801 INFO:tasks.workunit.client.0.smithi063.stdout:2/565: readlink d0/d21/l24 0 2023-12-07T16:21:41.801 INFO:tasks.workunit.client.0.smithi063.stdout:8/654: sync 2023-12-07T16:21:41.802 INFO:tasks.workunit.client.1.smithi152.stdout:1/885: truncate dc/d14/fb4 7069070 0 2023-12-07T16:21:41.802 INFO:tasks.workunit.client.1.smithi152.stdout:1/886: chown dc/d14/d18/d79/d86/fea 30448 1 2023-12-07T16:21:41.802 INFO:tasks.workunit.client.1.smithi152.stdout:1/887: truncate dc/d14/f84 1356944 0 2023-12-07T16:21:41.807 INFO:tasks.workunit.client.0.smithi063.stdout:3/517: creat d7/d9/dd/fa9 x:0 0 0 2023-12-07T16:21:41.807 INFO:tasks.workunit.client.0.smithi063.stdout:6/579: stat d0/d1e/d60/d68/d76/lb5 0 2023-12-07T16:21:41.807 INFO:tasks.workunit.client.0.smithi063.stdout:7/452: mkdir d2/d34/d5a/d5f/d53/dab 0 2023-12-07T16:21:41.807 INFO:tasks.workunit.client.0.smithi063.stdout:8/655: symlink d7/d14/d15/d48/lcb 0 2023-12-07T16:21:41.808 INFO:tasks.workunit.client.1.smithi152.stdout:1/888: rename dc/d14/d18/d2d/d48/da3/c6e to dc/d28/d4e/c12a 0 2023-12-07T16:21:41.810 INFO:tasks.workunit.client.1.smithi152.stdout:1/889: mkdir dc/d14/d18/de9/d12b 0 2023-12-07T16:21:41.810 INFO:tasks.workunit.client.1.smithi152.stdout:1/890: truncate dc/d14/d18/d2d/d48/da3/fb8 2558034 0 2023-12-07T16:21:41.810 INFO:tasks.workunit.client.1.smithi152.stdout:1/891: truncate dc/d14/d18/d79/fa1 4962132 0 2023-12-07T16:21:41.810 INFO:tasks.workunit.client.0.smithi063.stdout:3/518: rename d7/d9/d1b/d5c/l98 to d7/d4f/d53/d54/d76/laa 0 2023-12-07T16:21:41.811 INFO:tasks.workunit.client.0.smithi063.stdout:3/519: chown d7/d4f/c7b 12 1 2023-12-07T16:21:41.811 INFO:tasks.workunit.client.0.smithi063.stdout:6/580: symlink d0/d1e/d60/d68/d69/ld2 0 2023-12-07T16:21:41.812 INFO:tasks.workunit.client.0.smithi063.stdout:8/656: creat d7/db6/fcc x:0 0 0 2023-12-07T16:21:41.814 INFO:tasks.workunit.client.1.smithi152.stdout:1/892: dread dc/d14/d18/d45/fc5 [0,4194304] 0 2023-12-07T16:21:41.814 INFO:tasks.workunit.client.1.smithi152.stdout:1/893: write dc/d14/d18/d2d/d9c/fce [589545,19893] 0 2023-12-07T16:21:41.821 INFO:tasks.workunit.client.1.smithi152.stdout:1/894: symlink dc/d14/d18/d2d/d48/da3/d58/dc9/l12c 0 2023-12-07T16:21:41.821 INFO:tasks.workunit.client.1.smithi152.stdout:1/895: dread - dc/d14/d18/d79/d86/f129 zero size 2023-12-07T16:21:41.824 INFO:tasks.workunit.client.1.smithi152.stdout:0/707: dwrite d0/dc/d3d/d4c/f84 [0,4194304] 0 2023-12-07T16:21:41.824 INFO:tasks.workunit.client.1.smithi152.stdout:0/708: dread - d0/dc/d3d/d4c/fa5 zero size 2023-12-07T16:21:41.824 INFO:tasks.workunit.client.1.smithi152.stdout:0/709: chown d0/d2f/d30 25430 1 2023-12-07T16:21:41.824 INFO:tasks.workunit.client.1.smithi152.stdout:0/710: stat d0/d27/f59 0 2023-12-07T16:21:41.824 INFO:tasks.workunit.client.1.smithi152.stdout:0/711: write d0/dc/d36/d3a/f85 [670291,37959] 0 2023-12-07T16:21:41.824 INFO:tasks.workunit.client.1.smithi152.stdout:0/712: chown d0/d2f/d30 59258540 1 2023-12-07T16:21:41.828 INFO:tasks.workunit.client.1.smithi152.stdout:1/896: write dc/d14/f84 [739054,6303] 0 2023-12-07T16:21:41.830 INFO:tasks.workunit.client.1.smithi152.stdout:1/897: mkdir dc/d14/d18/de9/d12d 0 2023-12-07T16:21:41.832 INFO:tasks.workunit.client.1.smithi152.stdout:1/898: mknod dc/d14/d90/da9/df5/c12e 0 2023-12-07T16:21:41.833 INFO:tasks.workunit.client.0.smithi063.stdout:7/453: dread d2/d21/f49 [0,4194304] 0 2023-12-07T16:21:41.834 INFO:tasks.workunit.client.1.smithi152.stdout:1/899: truncate dc/d14/fd8 112112 0 2023-12-07T16:21:41.835 INFO:tasks.workunit.client.1.smithi152.stdout:1/900: mkdir dc/d12f 0 2023-12-07T16:21:41.835 INFO:tasks.workunit.client.1.smithi152.stdout:1/901: readlink dc/d14/d18/d2d/d91/l118 0 2023-12-07T16:21:41.835 INFO:tasks.workunit.client.1.smithi152.stdout:1/902: chown dc/d14/d18/d2d/d4a/cca 138500 1 2023-12-07T16:21:41.835 INFO:tasks.workunit.client.1.smithi152.stdout:1/903: write dc/d28/d7d/f102 [400564,27987] 0 2023-12-07T16:21:41.862 INFO:tasks.workunit.client.0.smithi063.stdout:6/581: dwrite d0/ff [0,4194304] 0 2023-12-07T16:21:41.864 INFO:tasks.workunit.client.0.smithi063.stdout:6/582: unlink d0/f8 0 2023-12-07T16:21:41.864 INFO:tasks.workunit.client.0.smithi063.stdout:6/583: chown d0/d1e/d60/d68/d69/d7d/f80 13 1 2023-12-07T16:21:41.869 INFO:tasks.workunit.client.1.smithi152.stdout:3/754: dwrite d7/d10/d19/f4a [0,4194304] 0 2023-12-07T16:21:41.871 INFO:tasks.workunit.client.0.smithi063.stdout:0/527: dwrite d4/dd/d26/d2b/d5e/d8e/f9c [0,4194304] 0 2023-12-07T16:21:41.875 INFO:tasks.workunit.client.0.smithi063.stdout:0/528: creat d4/dd/de/d15/d59/da5/fb2 x:0 0 0 2023-12-07T16:21:41.876 INFO:tasks.workunit.client.0.smithi063.stdout:3/520: dwrite d7/d4f/d53/fa1 [0,4194304] 0 2023-12-07T16:21:41.876 INFO:tasks.workunit.client.0.smithi063.stdout:7/454: dwrite d2/d64/f8f [0,4194304] 0 2023-12-07T16:21:41.876 INFO:tasks.workunit.client.0.smithi063.stdout:2/566: dwrite d0/d21/d56/d11/d52/d5d/f5f [0,4194304] 0 2023-12-07T16:21:41.876 INFO:tasks.workunit.client.1.smithi152.stdout:0/713: dwrite d0/dc/d3d/dab/dc8/fd8 [0,4194304] 0 2023-12-07T16:21:41.877 INFO:tasks.workunit.client.0.smithi063.stdout:5/453: dwrite d1/d3/de/f10 [0,4194304] 0 2023-12-07T16:21:41.877 INFO:tasks.workunit.client.0.smithi063.stdout:6/584: dread d0/d1e/d60/d68/f70 [0,4194304] 0 2023-12-07T16:21:41.877 INFO:tasks.workunit.client.0.smithi063.stdout:0/529: mkdir d4/dd/de/d15/d1f/d4c/da1/db3 0 2023-12-07T16:21:41.877 INFO:tasks.workunit.client.1.smithi152.stdout:1/904: dwrite dc/d14/d18/d45/fc5 [0,4194304] 0 2023-12-07T16:21:41.878 INFO:tasks.workunit.client.0.smithi063.stdout:8/657: dwrite d7/f7f [0,4194304] 0 2023-12-07T16:21:41.879 INFO:tasks.workunit.client.0.smithi063.stdout:0/530: read d4/dd/de/d15/f21 [3958622,114244] 0 2023-12-07T16:21:41.880 INFO:tasks.workunit.client.0.smithi063.stdout:0/531: stat d4/f8a 0 2023-12-07T16:21:41.880 INFO:tasks.workunit.client.0.smithi063.stdout:0/532: chown d4/dd/de/d15/d1f/d4c/f34 34 1 2023-12-07T16:21:41.880 INFO:tasks.workunit.client.0.smithi063.stdout:6/585: write d0/fe [3232821,99654] 0 2023-12-07T16:21:41.881 INFO:tasks.workunit.client.0.smithi063.stdout:3/521: creat d7/d9/dd/d7f/fab x:0 0 0 2023-12-07T16:21:41.882 INFO:tasks.workunit.client.1.smithi152.stdout:0/714: rename d0/d2f to d0/d27/d8c/df7 0 2023-12-07T16:21:41.888 INFO:tasks.workunit.client.1.smithi152.stdout:1/905: creat dc/d14/d18/d2d/d9c/dfc/f130 x:0 0 0 2023-12-07T16:21:41.889 INFO:tasks.workunit.client.0.smithi063.stdout:2/567: link d0/d21/d56/d11/d52/d63/f6b d0/d21/d56/d11/d52/da9/daf/fbc 0 2023-12-07T16:21:41.889 INFO:tasks.workunit.client.0.smithi063.stdout:2/568: readlink d0/d21/d56/l88 0 2023-12-07T16:21:41.889 INFO:tasks.workunit.client.0.smithi063.stdout:8/658: dread d7/d38/d8e/f91 [0,4194304] 0 2023-12-07T16:21:41.889 INFO:tasks.workunit.client.0.smithi063.stdout:8/659: fdatasync d7/d38/f70 0 2023-12-07T16:21:41.889 INFO:tasks.workunit.client.0.smithi063.stdout:5/454: creat d1/d3/d3a/f89 x:0 0 0 2023-12-07T16:21:41.889 INFO:tasks.workunit.client.0.smithi063.stdout:5/455: fsync d1/d3/f3b 0 2023-12-07T16:21:41.890 INFO:tasks.workunit.client.1.smithi152.stdout:0/715: getdents d0/d27/d11 0 2023-12-07T16:21:41.892 INFO:tasks.workunit.client.0.smithi063.stdout:7/455: dread d2/d2c/f68 [0,4194304] 0 2023-12-07T16:21:41.893 INFO:tasks.workunit.client.0.smithi063.stdout:6/586: mknod d0/d17/cd3 0 2023-12-07T16:21:41.894 INFO:tasks.workunit.client.0.smithi063.stdout:6/587: write d0/d79/fa0 [962121,39334] 0 2023-12-07T16:21:41.894 INFO:tasks.workunit.client.0.smithi063.stdout:6/588: readlink d0/d1e/d1d/d1f/l44 0 2023-12-07T16:21:41.894 INFO:tasks.workunit.client.0.smithi063.stdout:3/522: rename d7/d49/d4b/d8e/f93 to d7/d9/dd/d7f/fac 0 2023-12-07T16:21:41.894 INFO:tasks.workunit.client.0.smithi063.stdout:3/523: truncate d7/d9/f46 4641717 0 2023-12-07T16:21:41.894 INFO:tasks.workunit.client.0.smithi063.stdout:3/524: truncate d7/d49/d4b/f7a 1526116 0 2023-12-07T16:21:41.894 INFO:tasks.workunit.client.1.smithi152.stdout:1/906: rename dc/d14/d90/da9/df5/f127 to dc/def/f131 0 2023-12-07T16:21:41.894 INFO:tasks.workunit.client.1.smithi152.stdout:1/907: truncate dc/d14/d18/de9/ff3 780813 0 2023-12-07T16:21:41.895 INFO:tasks.workunit.client.0.smithi063.stdout:8/660: creat d7/d14/d15/db4/fcd x:0 0 0 2023-12-07T16:21:41.895 INFO:tasks.workunit.client.1.smithi152.stdout:0/716: creat d0/dc/d3d/d4c/ff8 x:0 0 0 2023-12-07T16:21:41.896 INFO:tasks.workunit.client.1.smithi152.stdout:1/908: truncate dc/fd 2420169 0 2023-12-07T16:21:41.897 INFO:tasks.workunit.client.0.smithi063.stdout:0/533: dwrite d4/dd/de/d15/d52/f53 [0,4194304] 0 2023-12-07T16:21:41.898 INFO:tasks.workunit.client.0.smithi063.stdout:0/534: fdatasync d4/dd/d26/d2b/d5e/f64 0 2023-12-07T16:21:41.898 INFO:tasks.workunit.client.0.smithi063.stdout:0/535: dread - d4/dd/d26/d2b/d5e/d8e/d95/d68/fad zero size 2023-12-07T16:21:41.898 INFO:tasks.workunit.client.1.smithi152.stdout:1/909: rename dc/d14/d18/d2d/d48/da3/d58/c5c to dc/d14/d18/d2d/d9c/dfc/d103/c132 0 2023-12-07T16:21:41.899 INFO:tasks.workunit.client.1.smithi152.stdout:1/910: fsync dc/d14/d18/d64/f8f 0 2023-12-07T16:21:41.899 INFO:tasks.workunit.client.1.smithi152.stdout:1/911: truncate dc/d28/d4e/f99 4647427 0 2023-12-07T16:21:41.899 INFO:tasks.workunit.client.0.smithi063.stdout:7/456: rename d2/d34/d5a/d5f/f15 to d2/d34/d5a/d5f/d53/fac 0 2023-12-07T16:21:41.899 INFO:tasks.workunit.client.0.smithi063.stdout:7/457: fsync d2/d34/d46/d48/f4c 0 2023-12-07T16:21:41.899 INFO:tasks.workunit.client.0.smithi063.stdout:2/569: dread d0/d1e/fae [0,4194304] 0 2023-12-07T16:21:41.900 INFO:tasks.workunit.client.0.smithi063.stdout:7/458: chown d2/d2c/c85 1399 1 2023-12-07T16:21:41.900 INFO:tasks.workunit.client.0.smithi063.stdout:3/525: creat d7/d49/d4b/fad x:0 0 0 2023-12-07T16:21:41.901 INFO:tasks.workunit.client.1.smithi152.stdout:1/912: unlink dc/d14/d90/dbb/cee 0 2023-12-07T16:21:41.901 INFO:tasks.workunit.client.1.smithi152.stdout:1/913: fsync dc/f63 0 2023-12-07T16:21:41.901 INFO:tasks.workunit.client.1.smithi152.stdout:1/914: chown dc/d14/d18/d64/d8a/feb 394 1 2023-12-07T16:21:41.902 INFO:tasks.workunit.client.0.smithi063.stdout:8/661: rename d7/d14/d1a/d54 to d7/d14/d1a/dce 0 2023-12-07T16:21:41.903 INFO:tasks.workunit.client.1.smithi152.stdout:1/915: truncate dc/d14/d68/f6b 126221 0 2023-12-07T16:21:41.903 INFO:tasks.workunit.client.1.smithi152.stdout:7/677: sync 2023-12-07T16:21:41.903 INFO:tasks.workunit.client.1.smithi152.stdout:7/678: chown db/f18 1 1 2023-12-07T16:21:41.903 INFO:tasks.workunit.client.1.smithi152.stdout:7/679: write db/d27/d39/d41/d37/f64 [530357,4917] 0 2023-12-07T16:21:41.903 INFO:tasks.workunit.client.1.smithi152.stdout:7/680: dread - db/d27/d39/f9f zero size 2023-12-07T16:21:41.903 INFO:tasks.workunit.client.1.smithi152.stdout:8/752: sync 2023-12-07T16:21:41.904 INFO:tasks.workunit.client.0.smithi063.stdout:2/570: dread d0/d21/d56/f17 [0,4194304] 0 2023-12-07T16:21:41.905 INFO:tasks.workunit.client.0.smithi063.stdout:3/526: write d7/d9/d2b/d41/f5a [415132,13155] 0 2023-12-07T16:21:41.905 INFO:tasks.workunit.client.1.smithi152.stdout:6/706: sync 2023-12-07T16:21:41.905 INFO:tasks.workunit.client.1.smithi152.stdout:2/656: sync 2023-12-07T16:21:41.905 INFO:tasks.workunit.client.1.smithi152.stdout:5/889: sync 2023-12-07T16:21:41.905 INFO:tasks.workunit.client.1.smithi152.stdout:2/657: stat d2/d1c/d2e/f3e 0 2023-12-07T16:21:41.905 INFO:tasks.workunit.client.1.smithi152.stdout:9/775: sync 2023-12-07T16:21:41.906 INFO:tasks.workunit.client.1.smithi152.stdout:4/660: sync 2023-12-07T16:21:41.906 INFO:tasks.workunit.client.1.smithi152.stdout:8/753: truncate d3/d4/d9/dc/d6f/d7a/d8a/f37 1954746 0 2023-12-07T16:21:41.907 INFO:tasks.workunit.client.1.smithi152.stdout:2/658: mkdir d2/d1c/d2e/d57/d5b/da7/d9a/da6/de7 0 2023-12-07T16:21:41.908 INFO:tasks.workunit.client.1.smithi152.stdout:2/659: truncate d2/f5a 1544237 0 2023-12-07T16:21:41.910 INFO:tasks.workunit.client.1.smithi152.stdout:6/707: creat d2/d4f/d83/d85/d19/d1f/dc7/fe7 x:0 0 0 2023-12-07T16:21:41.910 INFO:tasks.workunit.client.1.smithi152.stdout:6/708: write d2/d4f/d83/d48/d70/da7/db7/fd2 [942392,120438] 0 2023-12-07T16:21:41.910 INFO:tasks.workunit.client.0.smithi063.stdout:2/571: write d0/d21/d56/d11/f23 [186225,103452] 0 2023-12-07T16:21:41.911 INFO:tasks.workunit.client.1.smithi152.stdout:2/660: mkdir d2/d1c/d2e/d5d/de8 0 2023-12-07T16:21:41.912 INFO:tasks.workunit.client.0.smithi063.stdout:2/572: write d0/d21/d56/d11/d52/d5d/dbb/fb1 [268249,21687] 0 2023-12-07T16:21:41.912 INFO:tasks.workunit.client.0.smithi063.stdout:2/573: write d0/d21/d56/d11/d52/d5d/dbb/f7c [129194,17925] 0 2023-12-07T16:21:41.913 INFO:tasks.workunit.client.1.smithi152.stdout:6/709: rename d2/d4f/d83/d85/d19/f46 to d2/d4f/d83/d48/d70/d81/fe8 0 2023-12-07T16:21:41.913 INFO:tasks.workunit.client.1.smithi152.stdout:6/710: dread - d2/d4f/d83/d85/d19/d1f/dc7/dc9/fbc zero size 2023-12-07T16:21:41.914 INFO:tasks.workunit.client.1.smithi152.stdout:6/711: fsync d2/d4f/d83/d85/d65/fda 0 2023-12-07T16:21:41.914 INFO:tasks.workunit.client.1.smithi152.stdout:9/776: creat d1/d9/d2d/d72/d80/da4/f102 x:0 0 0 2023-12-07T16:21:41.914 INFO:tasks.workunit.client.1.smithi152.stdout:0/717: dread d0/f5 [0,4194304] 0 2023-12-07T16:21:41.915 INFO:tasks.workunit.client.1.smithi152.stdout:2/661: unlink d2/d1c/c7e 0 2023-12-07T16:21:41.915 INFO:tasks.workunit.client.1.smithi152.stdout:6/712: getdents d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/d55 0 2023-12-07T16:21:41.918 INFO:tasks.workunit.client.0.smithi063.stdout:0/536: chown d4/d25/l36 1727568 1 2023-12-07T16:21:41.919 INFO:tasks.workunit.client.0.smithi063.stdout:6/589: mknod d0/d1e/d29/cd4 0 2023-12-07T16:21:41.921 INFO:tasks.workunit.client.1.smithi152.stdout:9/777: rename d1/d9/d2d/cb6 to d1/d9/db/df/da6/c103 0 2023-12-07T16:21:41.921 INFO:tasks.workunit.client.1.smithi152.stdout:9/778: fsync d1/d9/f35 0 2023-12-07T16:21:41.921 INFO:tasks.workunit.client.1.smithi152.stdout:9/779: fdatasync d1/d17/fb7 0 2023-12-07T16:21:41.923 INFO:tasks.workunit.client.0.smithi063.stdout:7/459: rename d2/f26 to d2/d34/d5a/d5f/d78/d7c/d9b/fad 0 2023-12-07T16:21:41.926 INFO:tasks.workunit.client.1.smithi152.stdout:9/780: symlink d1/d17/d3c/d4a/d48/d8c/l104 0 2023-12-07T16:21:41.927 INFO:tasks.workunit.client.0.smithi063.stdout:8/662: getdents d7/d14/d15/d2b/d40/d63 0 2023-12-07T16:21:41.928 INFO:tasks.workunit.client.0.smithi063.stdout:3/527: symlink d7/d4f/d53/d54/lae 0 2023-12-07T16:21:41.929 INFO:tasks.workunit.client.1.smithi152.stdout:8/754: dread d3/da7/fb6 [0,4194304] 0 2023-12-07T16:21:41.929 INFO:tasks.workunit.client.1.smithi152.stdout:8/755: write d3/fdf [836378,48727] 0 2023-12-07T16:21:41.929 INFO:tasks.workunit.client.1.smithi152.stdout:1/916: dwrite dc/d14/d90/dbb/f109 [0,4194304] 0 2023-12-07T16:21:41.929 INFO:tasks.workunit.client.1.smithi152.stdout:1/917: stat dc/d14/l5f 0 2023-12-07T16:21:41.930 INFO:tasks.workunit.client.1.smithi152.stdout:2/662: rename d2/d9/fe6 to d2/d1c/d2e/d30/d33/fe9 0 2023-12-07T16:21:41.930 INFO:tasks.workunit.client.0.smithi063.stdout:2/574: creat d0/d21/d56/fbd x:0 0 0 2023-12-07T16:21:41.931 INFO:tasks.workunit.client.0.smithi063.stdout:6/590: symlink d0/d1e/d60/d68/d76/da4/dcc/ld5 0 2023-12-07T16:21:41.931 INFO:tasks.workunit.client.0.smithi063.stdout:6/591: stat d0/d1e/d1d/d1f/d4b/lca 0 2023-12-07T16:21:41.931 INFO:tasks.workunit.client.0.smithi063.stdout:6/592: chown d0/d1e/d1d/d1f/d4b/fb3 9 1 2023-12-07T16:21:41.933 INFO:tasks.workunit.client.0.smithi063.stdout:7/460: getdents d2/d34/d5a/d5f/d6d 0 2023-12-07T16:21:41.934 INFO:tasks.workunit.client.1.smithi152.stdout:9/781: rmdir d1/dd/dd6 39 2023-12-07T16:21:41.935 INFO:tasks.workunit.client.0.smithi063.stdout:0/537: rename d4/dd/de/d15/d52/d5b/d63/d6b/f89 to d4/dd/d26/d2b/d5e/d8e/d95/fb4 0 2023-12-07T16:21:41.935 INFO:tasks.workunit.client.1.smithi152.stdout:1/918: read dc/f36 [59979,125410] 0 2023-12-07T16:21:41.940 INFO:tasks.workunit.client.0.smithi063.stdout:0/538: getdents d4/dd/de/d15 0 2023-12-07T16:21:41.940 INFO:tasks.workunit.client.1.smithi152.stdout:2/663: creat d2/d9/d51/fea x:0 0 0 2023-12-07T16:21:41.941 INFO:tasks.workunit.client.0.smithi063.stdout:2/575: rename d0/d1e to d0/d21/d56/d11/d52/da9/dbe 0 2023-12-07T16:21:41.941 INFO:tasks.workunit.client.0.smithi063.stdout:2/576: write d0/d21/d56/d11/d52/da9/daf/fbc [4498832,64992] 0 2023-12-07T16:21:41.943 INFO:tasks.workunit.client.1.smithi152.stdout:7/681: dwrite db/d27/d39/d63/f77 [0,4194304] 0 2023-12-07T16:21:41.943 INFO:tasks.workunit.client.1.smithi152.stdout:9/782: rename d1/d17/d3c/d4a/l7d to d1/dd/dd6/de2/d53/dff/l105 0 2023-12-07T16:21:41.943 INFO:tasks.workunit.client.0.smithi063.stdout:3/528: truncate f6 7828351 0 2023-12-07T16:21:41.945 INFO:tasks.workunit.client.0.smithi063.stdout:7/461: dread d2/d34/f54 [0,4194304] 0 2023-12-07T16:21:41.945 INFO:tasks.workunit.client.1.smithi152.stdout:1/919: symlink dc/d28/d4e/de8/l133 0 2023-12-07T16:21:41.946 INFO:tasks.workunit.client.1.smithi152.stdout:2/664: symlink d2/d1c/d2e/d30/d42/leb 0 2023-12-07T16:21:41.946 INFO:tasks.workunit.client.1.smithi152.stdout:2/665: stat d2/d1c/d2e/d57/c5e 0 2023-12-07T16:21:41.947 INFO:tasks.workunit.client.0.smithi063.stdout:6/593: rename d0/d17/d1a/d4d to d0/d17/d95/dd6 0 2023-12-07T16:21:41.948 INFO:tasks.workunit.client.1.smithi152.stdout:0/718: dwrite d0/d27/d8c/df7/f74 [0,4194304] 0 2023-12-07T16:21:41.950 INFO:tasks.workunit.client.1.smithi152.stdout:0/719: write d0/d27/d8c/df7/f74 [1813421,1433] 0 2023-12-07T16:21:41.950 INFO:tasks.workunit.client.0.smithi063.stdout:3/529: getdents d7/d4f/d53/d54/d76 0 2023-12-07T16:21:41.950 INFO:tasks.workunit.client.0.smithi063.stdout:3/530: dread - d7/d9/dd/d56/fa7 zero size 2023-12-07T16:21:41.953 INFO:tasks.workunit.client.1.smithi152.stdout:7/682: rename db/d27/d39/d41/d37/f38 to db/d1c/fd8 0 2023-12-07T16:21:41.953 INFO:tasks.workunit.client.1.smithi152.stdout:9/783: creat d1/d9/db/df/da6/da2/de9/f106 x:0 0 0 2023-12-07T16:21:41.955 INFO:tasks.workunit.client.0.smithi063.stdout:2/577: write d0/f16 [2946707,30100] 0 2023-12-07T16:21:41.955 INFO:tasks.workunit.client.1.smithi152.stdout:2/666: creat d2/d1c/d2e/d57/d5b/da7/d9a/da6/fec x:0 0 0 2023-12-07T16:21:41.956 INFO:tasks.workunit.client.0.smithi063.stdout:3/531: mknod d7/d49/d4b/d8e/caf 0 2023-12-07T16:21:41.961 INFO:tasks.workunit.client.0.smithi063.stdout:2/578: symlink d0/d21/d56/d11/d52/d63/lbf 0 2023-12-07T16:21:41.961 INFO:tasks.workunit.client.1.smithi152.stdout:7/683: symlink db/d27/d39/d41/d58/ld9 0 2023-12-07T16:21:41.961 INFO:tasks.workunit.client.1.smithi152.stdout:7/684: chown db/d1c/f51 515753739 1 2023-12-07T16:21:41.961 INFO:tasks.workunit.client.1.smithi152.stdout:7/685: chown db/d1c/f10 5849 1 2023-12-07T16:21:41.962 INFO:tasks.workunit.client.1.smithi152.stdout:9/784: mkdir d1/d9/d4f/d83/d101/d107 0 2023-12-07T16:21:41.962 INFO:tasks.workunit.client.1.smithi152.stdout:9/785: dread - d1/d9/d2d/d72/d80/da4/f102 zero size 2023-12-07T16:21:41.963 INFO:tasks.workunit.client.1.smithi152.stdout:7/686: mknod db/d27/d39/cda 0 2023-12-07T16:21:41.963 INFO:tasks.workunit.client.1.smithi152.stdout:7/687: write db/d27/d39/d63/f70 [2737746,27954] 0 2023-12-07T16:21:41.965 INFO:tasks.workunit.client.1.smithi152.stdout:9/786: symlink d1/d9/db/df/d42/de8/df8/l108 0 2023-12-07T16:21:41.966 INFO:tasks.workunit.client.0.smithi063.stdout:3/532: mkdir d7/d49/db0 0 2023-12-07T16:21:41.966 INFO:tasks.workunit.client.1.smithi152.stdout:7/688: mkdir db/d1c/dd0/ddb 0 2023-12-07T16:21:41.966 INFO:tasks.workunit.client.1.smithi152.stdout:4/661: dwrite d0/d3/d6/d2b/d56/f98 [0,4194304] 0 2023-12-07T16:21:41.966 INFO:tasks.workunit.client.1.smithi152.stdout:4/662: write d0/d3/d6/dc/d3a/d46/d4e/f84 [337364,110792] 0 2023-12-07T16:21:41.968 INFO:tasks.workunit.client.0.smithi063.stdout:0/539: rename d4/dd/de/d15/d52 to d4/dd/d26/d2b/db5 0 2023-12-07T16:21:41.969 INFO:tasks.workunit.client.1.smithi152.stdout:6/713: dwrite d2/d4f/d83/d48/d70/d81/fdf [0,4194304] 0 2023-12-07T16:21:41.969 INFO:tasks.workunit.client.1.smithi152.stdout:7/689: creat db/d27/d39/d41/d37/fdc x:0 0 0 2023-12-07T16:21:41.969 INFO:tasks.workunit.client.1.smithi152.stdout:7/690: chown db/d27/d5e/f8b 224089665 1 2023-12-07T16:21:41.970 INFO:tasks.workunit.client.0.smithi063.stdout:2/579: dread d0/d67/f55 [0,4194304] 0 2023-12-07T16:21:41.971 INFO:tasks.workunit.client.1.smithi152.stdout:6/714: mknod d2/d4f/d83/da0/ce9 0 2023-12-07T16:21:41.972 INFO:tasks.workunit.client.1.smithi152.stdout:6/715: read d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/f4e [229998,59829] 0 2023-12-07T16:21:41.972 INFO:tasks.workunit.client.0.smithi063.stdout:3/533: rename d7/d9/d2b to d7/d4f/d53/d72/db1 0 2023-12-07T16:21:41.973 INFO:tasks.workunit.client.0.smithi063.stdout:0/540: getdents d4/d25 0 2023-12-07T16:21:41.973 INFO:tasks.workunit.client.0.smithi063.stdout:0/541: dread - d4/dd/d26/d2b/db5/f81 zero size 2023-12-07T16:21:41.974 INFO:tasks.workunit.client.1.smithi152.stdout:6/716: unlink d2/d4f/d83/d85/l16 0 2023-12-07T16:21:41.974 INFO:tasks.workunit.client.1.smithi152.stdout:6/717: fdatasync d2/d4f/d83/d85/d19/d1f/dc7/dc9/fa4 0 2023-12-07T16:21:41.975 INFO:tasks.workunit.client.0.smithi063.stdout:2/580: mkdir d0/d21/d56/d11/dc0 0 2023-12-07T16:21:41.975 INFO:tasks.workunit.client.0.smithi063.stdout:2/581: chown d0/d21/c2c 28647368 1 2023-12-07T16:21:41.976 INFO:tasks.workunit.client.0.smithi063.stdout:0/542: symlink d4/dd/de/d15/d59/lb6 0 2023-12-07T16:21:41.976 INFO:tasks.workunit.client.0.smithi063.stdout:0/543: chown d4/dd/de/c60 4785266 1 2023-12-07T16:21:41.976 INFO:tasks.workunit.client.1.smithi152.stdout:7/691: write db/d68/d87/f8c [3038766,19041] 0 2023-12-07T16:21:41.977 INFO:tasks.workunit.client.1.smithi152.stdout:2/667: dread d2/d1c/d2e/d57/f7b [0,4194304] 0 2023-12-07T16:21:41.978 INFO:tasks.workunit.client.1.smithi152.stdout:7/692: creat db/d27/fdd x:0 0 0 2023-12-07T16:21:41.981 INFO:tasks.workunit.client.1.smithi152.stdout:2/668: truncate f1 1294495 0 2023-12-07T16:21:41.981 INFO:tasks.workunit.client.1.smithi152.stdout:2/669: readlink d2/d1c/d2e/d30/d33/l78 0 2023-12-07T16:21:41.981 INFO:tasks.workunit.client.1.smithi152.stdout:2/670: truncate d2/d9/d51/d54/fca 894432 0 2023-12-07T16:21:41.981 INFO:tasks.workunit.client.0.smithi063.stdout:2/582: symlink d0/d21/d56/d11/d6d/lc1 0 2023-12-07T16:21:41.982 INFO:tasks.workunit.client.1.smithi152.stdout:7/693: mkdir db/d27/d39/d41/d58/da5/dde 0 2023-12-07T16:21:41.982 INFO:tasks.workunit.client.1.smithi152.stdout:7/694: stat db/d27/d39/d41/d58/ccc 0 2023-12-07T16:21:41.983 INFO:tasks.workunit.client.1.smithi152.stdout:4/663: dread d0/d3/d6/d36/d85/f72 [0,4194304] 0 2023-12-07T16:21:41.985 INFO:tasks.workunit.client.1.smithi152.stdout:4/664: link d0/l49 d0/d3/d6/d2b/db1/lc3 0 2023-12-07T16:21:41.986 INFO:tasks.workunit.client.0.smithi063.stdout:0/544: symlink d4/dd/d26/lb7 0 2023-12-07T16:21:41.986 INFO:tasks.workunit.client.0.smithi063.stdout:2/583: unlink d0/d21/d56/d11/d52/d5d/dbb/f5e 0 2023-12-07T16:21:41.987 INFO:tasks.workunit.client.1.smithi152.stdout:4/665: symlink d0/d3/d6/dc/d3a/d48/lc4 0 2023-12-07T16:21:41.989 INFO:tasks.workunit.client.1.smithi152.stdout:4/666: truncate d0/d17/f43 384023 0 2023-12-07T16:21:41.989 INFO:tasks.workunit.client.1.smithi152.stdout:4/667: dread - d0/d3/d6/dc/db7/fbd zero size 2023-12-07T16:21:41.990 INFO:tasks.workunit.client.0.smithi063.stdout:2/584: mknod d0/d21/cc2 0 2023-12-07T16:21:41.990 INFO:tasks.workunit.client.0.smithi063.stdout:2/585: chown d0/d67/d65/d6a/la6 70024 1 2023-12-07T16:21:41.991 INFO:tasks.workunit.client.1.smithi152.stdout:4/668: mkdir d0/d3/d6/dc/d39/d93/d7c/dc5 0 2023-12-07T16:21:41.991 INFO:tasks.workunit.client.0.smithi063.stdout:0/545: dread d4/dd/d26/d2b/db5/d5b/f5d [0,4194304] 0 2023-12-07T16:21:41.991 INFO:tasks.workunit.client.0.smithi063.stdout:0/546: truncate d4/dd/d26/d2b/db5/d5b/d63/f80 539220 0 2023-12-07T16:21:41.992 INFO:tasks.workunit.client.0.smithi063.stdout:2/586: creat d0/d21/fc3 x:0 0 0 2023-12-07T16:21:41.992 INFO:tasks.workunit.client.1.smithi152.stdout:9/787: rmdir d1/dd/dd6/de2/d53 39 2023-12-07T16:21:41.995 INFO:tasks.workunit.client.0.smithi063.stdout:0/547: rename d4/dd/de/d15/d1f/d22/f23 to d4/dd/d26/d2b/d5e/d8e/fb8 0 2023-12-07T16:21:41.995 INFO:tasks.workunit.client.0.smithi063.stdout:0/548: truncate d4/dd/d26/d2b/db5/f81 266973 0 2023-12-07T16:21:41.995 INFO:tasks.workunit.client.1.smithi152.stdout:9/788: dread d1/d9/db/d70/f98 [0,4194304] 0 2023-12-07T16:21:41.997 INFO:tasks.workunit.client.0.smithi063.stdout:2/587: dread d0/d21/d56/d11/d52/d5d/dbb/f6e [0,4194304] 0 2023-12-07T16:21:41.997 INFO:tasks.workunit.client.0.smithi063.stdout:2/588: stat d0/d21/d56/d11/f1b 0 2023-12-07T16:21:41.998 INFO:tasks.workunit.client.0.smithi063.stdout:2/589: creat d0/d21/d56/d11/d52/d5d/fc4 x:0 0 0 2023-12-07T16:21:42.002 INFO:tasks.workunit.client.0.smithi063.stdout:0/549: dread d4/dd/de/d15/f18 [0,4194304] 0 2023-12-07T16:21:42.005 INFO:tasks.workunit.client.0.smithi063.stdout:0/550: dread - d4/dd/d26/d2b/d5e/d8e/d95/f93 zero size 2023-12-07T16:21:42.005 INFO:tasks.workunit.client.0.smithi063.stdout:2/590: dread d0/d21/d56/d11/d52/da9/dbe/f46 [0,4194304] 0 2023-12-07T16:21:42.005 INFO:tasks.workunit.client.0.smithi063.stdout:2/591: readlink d0/d21/l24 0 2023-12-07T16:21:42.005 INFO:tasks.workunit.client.0.smithi063.stdout:2/592: readlink d0/d67/l61 0 2023-12-07T16:21:42.006 INFO:tasks.workunit.client.1.smithi152.stdout:2/671: dread d2/d9/f25 [0,4194304] 0 2023-12-07T16:21:42.006 INFO:tasks.workunit.client.1.smithi152.stdout:2/672: stat d2/d1c/d2e/d57 0 2023-12-07T16:21:42.006 INFO:tasks.workunit.client.0.smithi063.stdout:0/551: rename d4/dd/de/d15/d59/ca4 to d4/dd/d26/d2b/db5/d5b/d63/d74/d84/cb9 0 2023-12-07T16:21:42.007 INFO:tasks.workunit.client.0.smithi063.stdout:0/552: mknod d4/dd/de/d15/d1f/d4c/da1/db3/cba 0 2023-12-07T16:21:42.007 INFO:tasks.workunit.client.0.smithi063.stdout:0/553: chown d4/f55 56 1 2023-12-07T16:21:42.008 INFO:tasks.workunit.client.1.smithi152.stdout:2/673: unlink d2/d1c/d2e/d30/d42/d84/fce 0 2023-12-07T16:21:42.008 INFO:tasks.workunit.client.1.smithi152.stdout:2/674: unlink d2/d1c/d2e/d57/d5b/da7/d8a/cc5 0 2023-12-07T16:21:42.009 INFO:tasks.workunit.client.0.smithi063.stdout:0/554: unlink d4/d25/f4b 0 2023-12-07T16:21:42.010 INFO:tasks.workunit.client.0.smithi063.stdout:0/555: creat d4/dd/de/d15/d1f/d4c/fbb x:0 0 0 2023-12-07T16:21:42.010 INFO:tasks.workunit.client.0.smithi063.stdout:0/556: chown d4/dd/d26/d2b/db5 3009211 1 2023-12-07T16:21:42.011 INFO:tasks.workunit.client.0.smithi063.stdout:0/557: mknod d4/dd/d26/d2b/d5e/d69/cbc 0 2023-12-07T16:21:42.011 INFO:tasks.workunit.client.0.smithi063.stdout:0/558: stat d4/d7e 0 2023-12-07T16:21:42.011 INFO:tasks.workunit.client.0.smithi063.stdout:0/559: write d4/dd/d26/d2b/db5/d5b/fa9 [208889,20657] 0 2023-12-07T16:21:42.014 INFO:tasks.workunit.client.0.smithi063.stdout:2/593: write d0/d21/d56/d11/d52/da9/daf/fbc [1002079,47894] 0 2023-12-07T16:21:42.014 INFO:tasks.workunit.client.0.smithi063.stdout:2/594: stat d0/d21/d56/d11/d6d 0 2023-12-07T16:21:42.015 INFO:tasks.workunit.client.0.smithi063.stdout:8/663: dwrite d7/d14/d15/db4/f84 [0,4194304] 0 2023-12-07T16:21:42.015 INFO:tasks.workunit.client.0.smithi063.stdout:8/664: truncate d7/f24 5140834 0 2023-12-07T16:21:42.016 INFO:tasks.workunit.client.0.smithi063.stdout:2/595: link d0/d67/f59 d0/d67/fc5 0 2023-12-07T16:21:42.016 INFO:tasks.workunit.client.0.smithi063.stdout:2/596: dread - d0/d21/d56/d11/d52/d63/d8c/fa3 zero size 2023-12-07T16:21:42.017 INFO:tasks.workunit.client.0.smithi063.stdout:8/665: getdents d7/d14/d15/dac/dad 0 2023-12-07T16:21:42.019 INFO:tasks.workunit.client.0.smithi063.stdout:2/597: rename d0/f48 to d0/d67/d5b/db3/fc6 0 2023-12-07T16:21:42.019 INFO:tasks.workunit.client.0.smithi063.stdout:8/666: creat d7/d14/d15/d2b/d40/da8/fcf x:0 0 0 2023-12-07T16:21:42.021 INFO:tasks.workunit.client.0.smithi063.stdout:8/667: symlink d7/d14/d4e/ld0 0 2023-12-07T16:21:42.029 INFO:tasks.workunit.client.0.smithi063.stdout:0/560: dread d4/dd/d26/f70 [0,4194304] 0 2023-12-07T16:21:42.030 INFO:tasks.workunit.client.0.smithi063.stdout:0/561: symlink d4/d7e/lbd 0 2023-12-07T16:21:42.030 INFO:tasks.workunit.client.0.smithi063.stdout:0/562: chown d4/dd/de/d15/l50 386764992 1 2023-12-07T16:21:42.031 INFO:tasks.workunit.client.0.smithi063.stdout:0/563: write d4/dd/de/d15/d1f/d22/f7b [669134,59770] 0 2023-12-07T16:21:42.032 INFO:tasks.workunit.client.0.smithi063.stdout:0/564: dread d4/dd/d26/d2b/d5e/d8e/d95/f7a [0,4194304] 0 2023-12-07T16:21:42.033 INFO:tasks.workunit.client.0.smithi063.stdout:2/598: dread d0/d21/d56/d11/d52/d5d/dbb/f54 [0,4194304] 0 2023-12-07T16:21:42.033 INFO:tasks.workunit.client.0.smithi063.stdout:7/462: dwrite d2/d34/d5a/d5f/d78/d7c/d9b/fad [0,4194304] 0 2023-12-07T16:21:42.033 INFO:tasks.workunit.client.0.smithi063.stdout:0/565: mkdir d4/dd/d26/d2b/db5/d5b/d63/d6b/dbe 0 2023-12-07T16:21:42.033 INFO:tasks.workunit.client.0.smithi063.stdout:2/599: write d0/d21/d56/f17 [3702544,122216] 0 2023-12-07T16:21:42.035 INFO:tasks.workunit.client.0.smithi063.stdout:3/534: rmdir d7/d4f/d53/d72/db1 39 2023-12-07T16:21:42.035 INFO:tasks.workunit.client.0.smithi063.stdout:3/535: write d7/d4f/d53/d72/db1/f8b [137325,80622] 0 2023-12-07T16:21:42.036 INFO:tasks.workunit.client.0.smithi063.stdout:6/594: dwrite d0/d1e/d1d/f27 [0,4194304] 0 2023-12-07T16:21:42.037 INFO:tasks.workunit.client.1.smithi152.stdout:9/789: dwrite d1/d17/d4e/ff2 [0,4194304] 0 2023-12-07T16:21:42.038 INFO:tasks.workunit.client.1.smithi152.stdout:7/695: dwrite db/d27/d5e/d45/f82 [0,4194304] 0 2023-12-07T16:21:42.038 INFO:tasks.workunit.client.1.smithi152.stdout:2/675: dwrite d2/d1c/d2e/fa2 [0,4194304] 0 2023-12-07T16:21:42.038 INFO:tasks.workunit.client.1.smithi152.stdout:0/720: dwrite d0/dc/d36/d7d/d92/de9/fec [0,4194304] 0 2023-12-07T16:21:42.038 INFO:tasks.workunit.client.1.smithi152.stdout:6/718: dwrite d2/d4f/d83/d48/d70/da7/db7/f7b [0,4194304] 0 2023-12-07T16:21:42.040 INFO:tasks.workunit.client.1.smithi152.stdout:1/920: dwrite dc/d28/d4e/f80 [0,4194304] 0 2023-12-07T16:21:42.040 INFO:tasks.workunit.client.0.smithi063.stdout:7/463: rename d2/d34/d5a/d5f/d53/da3/l83 to d2/d34/d5a/d5f/lae 0 2023-12-07T16:21:42.042 INFO:tasks.workunit.client.0.smithi063.stdout:0/566: getdents d4/dd/d26/d2b/db5 0 2023-12-07T16:21:42.042 INFO:tasks.workunit.client.0.smithi063.stdout:0/567: stat d4/dd/d26/d2b/db5/d5b/d63/d9b/l9d 0 2023-12-07T16:21:42.045 INFO:tasks.workunit.client.0.smithi063.stdout:2/600: mknod d0/d21/d56/d11/d52/cc7 0 2023-12-07T16:21:42.047 INFO:tasks.workunit.client.0.smithi063.stdout:3/536: creat d7/d9/dd/d7f/fb2 x:0 0 0 2023-12-07T16:21:42.048 INFO:tasks.workunit.client.1.smithi152.stdout:0/721: mknod d0/dc/d36/d3a/d51/d82/dae/cf9 0 2023-12-07T16:21:42.048 INFO:tasks.workunit.client.1.smithi152.stdout:2/676: mkdir d2/d1c/d2e/d57/d5b/ded 0 2023-12-07T16:21:42.049 INFO:tasks.workunit.client.1.smithi152.stdout:2/677: fdatasync d2/d56/da0/fa5 0 2023-12-07T16:21:42.049 INFO:tasks.workunit.client.1.smithi152.stdout:2/678: stat d2/d9/c1a 0 2023-12-07T16:21:42.049 INFO:tasks.workunit.client.0.smithi063.stdout:2/601: dread d0/d21/d56/d11/d52/d63/d8c/f8f [0,4194304] 0 2023-12-07T16:21:42.050 INFO:tasks.workunit.client.1.smithi152.stdout:6/719: dread d2/d4f/d83/d48/d70/da7/db7/fd2 [0,4194304] 0 2023-12-07T16:21:42.050 INFO:tasks.workunit.client.1.smithi152.stdout:1/921: rename dc/d14/d18/d2d/d48/f125 to dc/def/f134 0 2023-12-07T16:21:42.050 INFO:tasks.workunit.client.1.smithi152.stdout:1/922: fdatasync dc/d14/fd3 0 2023-12-07T16:21:42.051 INFO:tasks.workunit.client.1.smithi152.stdout:0/722: mknod d0/d27/d8c/df7/d30/d6e/d77/d9f/cfa 0 2023-12-07T16:21:42.053 INFO:tasks.workunit.client.1.smithi152.stdout:2/679: mkdir d2/d1c/d2e/d30/d33/d86/dee 0 2023-12-07T16:21:42.054 INFO:tasks.workunit.client.1.smithi152.stdout:0/723: getdents d0/dc/d3d/d4c 0 2023-12-07T16:21:42.054 INFO:tasks.workunit.client.1.smithi152.stdout:0/724: write d0/dc/d26/fdf [169867,97443] 0 2023-12-07T16:21:42.054 INFO:tasks.workunit.client.1.smithi152.stdout:0/725: write d0/dc/d36/d3a/d69/fe5 [995898,87057] 0 2023-12-07T16:21:42.055 INFO:tasks.workunit.client.1.smithi152.stdout:6/720: symlink d2/d4f/d83/d85/d94/lea 0 2023-12-07T16:21:42.055 INFO:tasks.workunit.client.1.smithi152.stdout:6/721: write d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/f8c [990339,96267] 0 2023-12-07T16:21:42.056 INFO:tasks.workunit.client.0.smithi063.stdout:8/668: dwrite d7/d14/d15/d48/fa4 [0,4194304] 0 2023-12-07T16:21:42.056 INFO:tasks.workunit.client.1.smithi152.stdout:9/790: dwrite d1/d17/d3c/d4a/d48/fcb [0,4194304] 0 2023-12-07T16:21:42.060 INFO:tasks.workunit.client.0.smithi063.stdout:6/595: creat d0/d1e/d29/fd7 x:0 0 0 2023-12-07T16:21:42.061 INFO:tasks.workunit.client.1.smithi152.stdout:9/791: creat d1/d9/d2d/d46/f109 x:0 0 0 2023-12-07T16:21:42.061 INFO:tasks.workunit.client.1.smithi152.stdout:6/722: dread d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/f82 [0,4194304] 0 2023-12-07T16:21:42.061 INFO:tasks.workunit.client.0.smithi063.stdout:7/464: mkdir d2/d34/d46/d48/d70/daf 0 2023-12-07T16:21:42.064 INFO:tasks.workunit.client.1.smithi152.stdout:9/792: unlink d1/d9/db/df/dd4/f88 0 2023-12-07T16:21:42.067 INFO:tasks.workunit.client.1.smithi152.stdout:9/793: symlink d1/d9/d2d/d65/l10a 0 2023-12-07T16:21:42.067 INFO:tasks.workunit.client.1.smithi152.stdout:9/794: write d1/d9/d2d/d72/ff3 [437921,38426] 0 2023-12-07T16:21:42.070 INFO:tasks.workunit.client.0.smithi063.stdout:0/568: creat d4/d7e/fbf x:0 0 0 2023-12-07T16:21:42.070 INFO:tasks.workunit.client.0.smithi063.stdout:3/537: symlink d7/d4f/d53/d72/d7d/lb3 0 2023-12-07T16:21:42.070 INFO:tasks.workunit.client.0.smithi063.stdout:2/602: truncate d0/d21/d56/d11/d52/da9/dbe/f90 614596 0 2023-12-07T16:21:42.070 INFO:tasks.workunit.client.0.smithi063.stdout:3/538: write d7/d9/f88 [634095,111806] 0 2023-12-07T16:21:42.070 INFO:tasks.workunit.client.0.smithi063.stdout:2/603: chown d0/d21/d56/d11/d52/d5d/dbb/cba 11 1 2023-12-07T16:21:42.070 INFO:tasks.workunit.client.1.smithi152.stdout:9/795: creat d1/d9/db/df/dd4/f10b x:0 0 0 2023-12-07T16:21:42.071 INFO:tasks.workunit.client.0.smithi063.stdout:8/669: symlink d7/d14/d15/d2b/d40/ld1 0 2023-12-07T16:21:42.072 INFO:tasks.workunit.client.0.smithi063.stdout:8/670: read d7/d14/d15/f6d [3194129,67624] 0 2023-12-07T16:21:42.072 INFO:tasks.workunit.client.0.smithi063.stdout:8/671: write d7/d14/d15/d2b/d40/d63/f6b [1033715,129151] 0 2023-12-07T16:21:42.073 INFO:tasks.workunit.client.1.smithi152.stdout:9/796: rename d1/dd/l30 to d1/d9/db/df/da6/l10c 0 2023-12-07T16:21:42.073 INFO:tasks.workunit.client.1.smithi152.stdout:9/797: write d1/d9/d4f/d83/fab [723015,64838] 0 2023-12-07T16:21:42.075 INFO:tasks.workunit.client.1.smithi152.stdout:9/798: write d1/d9/d2d/f84 [3430952,71490] 0 2023-12-07T16:21:42.076 INFO:tasks.workunit.client.1.smithi152.stdout:2/680: dread d2/d56/da0/fad [0,4194304] 0 2023-12-07T16:21:42.076 INFO:tasks.workunit.client.1.smithi152.stdout:9/799: truncate d1/d9/f12 3643632 0 2023-12-07T16:21:42.076 INFO:tasks.workunit.client.1.smithi152.stdout:9/800: dread - d1/d17/d58/fe0 zero size 2023-12-07T16:21:42.077 INFO:tasks.workunit.client.0.smithi063.stdout:6/596: rmdir d0/d1e/d1d/d1f/d6c 39 2023-12-07T16:21:42.077 INFO:tasks.workunit.client.0.smithi063.stdout:7/465: link d2/l1c d2/d34/d5a/d5f/d53/d9f/lb0 0 2023-12-07T16:21:42.077 INFO:tasks.workunit.client.0.smithi063.stdout:6/597: write d0/d1e/d60/d68/f70 [4977487,121807] 0 2023-12-07T16:21:42.077 INFO:tasks.workunit.client.0.smithi063.stdout:3/539: creat d7/d49/fb4 x:0 0 0 2023-12-07T16:21:42.077 INFO:tasks.workunit.client.0.smithi063.stdout:3/540: fsync d7/d8d/fa8 0 2023-12-07T16:21:42.078 INFO:tasks.workunit.client.0.smithi063.stdout:8/672: rename d7/d14/d15/d2b/d40/c5d to d7/d14/d15/d2b/d40/d63/d75/d98/dc4/cd2 0 2023-12-07T16:21:42.080 INFO:tasks.workunit.client.0.smithi063.stdout:7/466: truncate d2/d34/d5a/d5f/f27 965157 0 2023-12-07T16:21:42.080 INFO:tasks.workunit.client.0.smithi063.stdout:7/467: truncate d2/d34/d46/d48/d56/f95 978293 0 2023-12-07T16:21:42.080 INFO:tasks.workunit.client.0.smithi063.stdout:6/598: stat d0/d17/l98 0 2023-12-07T16:21:42.081 INFO:tasks.workunit.client.0.smithi063.stdout:3/541: dread d7/d21/f69 [0,4194304] 0 2023-12-07T16:21:42.083 INFO:tasks.workunit.client.0.smithi063.stdout:6/599: mknod d0/d1e/d60/d68/d78/d9c/d9f/cd8 0 2023-12-07T16:21:42.083 INFO:tasks.workunit.client.0.smithi063.stdout:6/600: truncate d0/d79/d94/fb7 1497546 0 2023-12-07T16:21:42.083 INFO:tasks.workunit.client.1.smithi152.stdout:6/723: dwrite d2/f5 [0,4194304] 0 2023-12-07T16:21:42.084 INFO:tasks.workunit.client.0.smithi063.stdout:6/601: symlink d0/d17/d1a/ld9 0 2023-12-07T16:21:42.085 INFO:tasks.workunit.client.0.smithi063.stdout:7/468: dread d2/f5 [0,4194304] 0 2023-12-07T16:21:42.085 INFO:tasks.workunit.client.0.smithi063.stdout:2/604: dread d0/f33 [4194304,4194304] 0 2023-12-07T16:21:42.087 INFO:tasks.workunit.client.0.smithi063.stdout:6/602: dread d0/d17/d95/fa7 [0,4194304] 0 2023-12-07T16:21:42.088 INFO:tasks.workunit.client.0.smithi063.stdout:7/469: unlink d2/d2c/l2e 0 2023-12-07T16:21:42.088 INFO:tasks.workunit.client.0.smithi063.stdout:7/470: chown d2/d21/f2d 34949 1 2023-12-07T16:21:42.088 INFO:tasks.workunit.client.0.smithi063.stdout:3/542: write d7/d9/dd/f66 [374129,51841] 0 2023-12-07T16:21:42.089 INFO:tasks.workunit.client.0.smithi063.stdout:6/603: unlink d0/d17/c41 0 2023-12-07T16:21:42.089 INFO:tasks.workunit.client.0.smithi063.stdout:0/569: dread d4/d25/f45 [0,4194304] 0 2023-12-07T16:21:42.090 INFO:tasks.workunit.client.0.smithi063.stdout:6/604: stat d0/d17/d1a/d38/l3c 0 2023-12-07T16:21:42.090 INFO:tasks.workunit.client.0.smithi063.stdout:6/605: chown d0/d1e/f63 1409398 1 2023-12-07T16:21:42.091 INFO:tasks.workunit.client.0.smithi063.stdout:6/606: mknod d0/d17/d1a/cda 0 2023-12-07T16:21:42.093 INFO:tasks.workunit.client.1.smithi152.stdout:9/801: write d1/d17/d4e/ff2 [90459,27274] 0 2023-12-07T16:21:42.095 INFO:tasks.workunit.client.1.smithi152.stdout:9/802: rename d1/d17/d3c/f5f to d1/d9/db/df/d42/de8/df8/f10d 0 2023-12-07T16:21:42.096 INFO:tasks.workunit.client.0.smithi063.stdout:6/607: symlink d0/d1e/d60/d68/d69/d7d/ldb 0 2023-12-07T16:21:42.096 INFO:tasks.workunit.client.0.smithi063.stdout:6/608: mknod d0/d54/cdc 0 2023-12-07T16:21:42.096 INFO:tasks.workunit.client.0.smithi063.stdout:6/609: write d0/d1e/d1d/d4f/f66 [1487687,114343] 0 2023-12-07T16:21:42.097 INFO:tasks.workunit.client.0.smithi063.stdout:6/610: creat d0/d79/d94/fdd x:0 0 0 2023-12-07T16:21:42.097 INFO:tasks.workunit.client.1.smithi152.stdout:9/803: symlink d1/d9/l10e 0 2023-12-07T16:21:42.097 INFO:tasks.workunit.client.1.smithi152.stdout:9/804: write d1/d9/db/d70/fe4 [67091,81886] 0 2023-12-07T16:21:42.097 INFO:tasks.workunit.client.1.smithi152.stdout:9/805: truncate d1/d17/d3c/d4a/d48/f81 949095 0 2023-12-07T16:21:42.098 INFO:tasks.workunit.client.0.smithi063.stdout:0/570: dread d4/dd/d26/f4f [0,4194304] 0 2023-12-07T16:21:42.099 INFO:tasks.workunit.client.1.smithi152.stdout:9/806: getdents d1/d17/d3c/d4a/d7e 0 2023-12-07T16:21:42.099 INFO:tasks.workunit.client.0.smithi063.stdout:0/571: mkdir d4/dd/d26/d2b/db5/d5b/d63/d6b/dc0 0 2023-12-07T16:21:42.100 INFO:tasks.workunit.client.1.smithi152.stdout:9/807: rmdir d1/d9/d4f/d83/d101 39 2023-12-07T16:21:42.100 INFO:tasks.workunit.client.0.smithi063.stdout:6/611: dread d0/d79/d94/fb7 [0,4194304] 0 2023-12-07T16:21:42.101 INFO:tasks.workunit.client.0.smithi063.stdout:0/572: rename d4/f3e to d4/dd/d26/d2b/d5e/d69/fc1 0 2023-12-07T16:21:42.101 INFO:tasks.workunit.client.0.smithi063.stdout:6/612: write d0/d1e/d1d/f27 [2805087,8819] 0 2023-12-07T16:21:42.101 INFO:tasks.workunit.client.0.smithi063.stdout:6/613: dread - d0/d1e/d60/d68/fc9 zero size 2023-12-07T16:21:42.102 INFO:tasks.workunit.client.1.smithi152.stdout:9/808: dread d1/d9/db/d70/f98 [0,4194304] 0 2023-12-07T16:21:42.102 INFO:tasks.workunit.client.0.smithi063.stdout:0/573: rename d4/dd/de/l42 to d4/dd/de/d15/d1f/d4c/lc2 0 2023-12-07T16:21:42.102 INFO:tasks.workunit.client.0.smithi063.stdout:0/574: write d4/dd/de/d15/d59/d43/f5c [1030037,84585] 0 2023-12-07T16:21:42.103 INFO:tasks.workunit.client.0.smithi063.stdout:0/575: truncate d4/dd/de/d15/d59/da5/fb2 118255 0 2023-12-07T16:21:42.103 INFO:tasks.workunit.client.0.smithi063.stdout:6/614: chown d0/c72 65 1 2023-12-07T16:21:42.103 INFO:tasks.workunit.client.0.smithi063.stdout:0/576: fdatasync d4/dd/d26/d2b/d5e/d8e/f8b 0 2023-12-07T16:21:42.124 INFO:tasks.workunit.client.0.smithi063.stdout:0/577: dwrite d4/dd/d26/d2b/db5/f81 [0,4194304] 0 2023-12-07T16:21:42.124 INFO:tasks.workunit.client.1.smithi152.stdout:9/809: dwrite d1/d17/d3c/d4a/d48/d8c/fc3 [0,4194304] 0 2023-12-07T16:21:42.129 INFO:tasks.workunit.client.1.smithi152.stdout:9/810: write d1/d17/d3c/d4a/d7e/f9f [1318996,101513] 0 2023-12-07T16:21:42.129 INFO:tasks.workunit.client.1.smithi152.stdout:9/811: chown d1/d9/d4f/la9 24779 1 2023-12-07T16:21:42.138 INFO:tasks.workunit.client.0.smithi063.stdout:2/605: read d0/d21/d56/d11/d52/da9/dbe/f3e [637848,21222] 0 2023-12-07T16:21:42.138 INFO:tasks.workunit.client.0.smithi063.stdout:2/606: write d0/d21/d56/d11/d52/d63/d8c/f8f [1317115,65980] 0 2023-12-07T16:21:42.142 INFO:tasks.workunit.client.1.smithi152.stdout:2/681: read d2/d9/f25 [2974615,61439] 0 2023-12-07T16:21:42.142 INFO:tasks.workunit.client.1.smithi152.stdout:2/682: write d2/d1c/d2e/d57/d5b/da7/d9a/da6/dbb/fd0 [1026271,4592] 0 2023-12-07T16:21:42.142 INFO:tasks.workunit.client.0.smithi063.stdout:2/607: truncate d0/f44 2769989 0 2023-12-07T16:21:42.145 INFO:tasks.workunit.client.1.smithi152.stdout:2/683: rmdir d2/d56/da0 39 2023-12-07T16:21:42.146 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:42 smithi063 ceph-mon[112095]: pgmap v28: 65 pgs: 65 active+clean; 1.8 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 123 MiB/s rd, 256 MiB/s wr, 375 op/s 2023-12-07T16:21:42.146 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:42 smithi063 ceph-mon[112095]: Upgrade: Updating mgr.smithi063.yohyyx 2023-12-07T16:21:42.146 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:42 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:42.146 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:42 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi063.yohyyx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-07T16:21:42.146 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:42 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi063.yohyyx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-07T16:21:42.146 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:42 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-07T16:21:42.146 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:42 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:21:42.146 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:42 smithi063 ceph-mon[112095]: Deploying daemon mgr.smithi063.yohyyx on smithi063 2023-12-07T16:21:42.146 INFO:tasks.workunit.client.0.smithi063.stdout:2/608: creat d0/d21/d56/d11/d6d/fc8 x:0 0 0 2023-12-07T16:21:42.147 INFO:tasks.workunit.client.1.smithi152.stdout:2/684: creat d2/d1c/d52/da8/fef x:0 0 0 2023-12-07T16:21:42.150 INFO:tasks.workunit.client.1.smithi152.stdout:2/685: creat d2/d1c/d2e/d57/db1/ff0 x:0 0 0 2023-12-07T16:21:42.150 INFO:tasks.workunit.client.1.smithi152.stdout:2/686: write d2/d1c/d2e/d5d/dab/dd9/fe4 [877395,56041] 0 2023-12-07T16:21:42.150 INFO:tasks.workunit.client.1.smithi152.stdout:2/687: chown d2/d1c/d2e/d57/fde 5267 1 2023-12-07T16:21:42.153 INFO:tasks.workunit.client.0.smithi063.stdout:3/543: dread d7/d9/dd/f66 [4194304,4194304] 0 2023-12-07T16:21:42.153 INFO:tasks.workunit.client.0.smithi063.stdout:2/609: dread d0/d67/fc5 [0,4194304] 0 2023-12-07T16:21:42.153 INFO:tasks.workunit.client.0.smithi063.stdout:2/610: truncate d0/d67/d5b/f78 5183348 0 2023-12-07T16:21:42.153 INFO:tasks.workunit.client.0.smithi063.stdout:1/393: sync 2023-12-07T16:21:42.153 INFO:tasks.workunit.client.0.smithi063.stdout:5/456: sync 2023-12-07T16:21:42.153 INFO:tasks.workunit.client.0.smithi063.stdout:4/440: sync 2023-12-07T16:21:42.153 INFO:tasks.workunit.client.0.smithi063.stdout:9/467: sync 2023-12-07T16:21:42.153 INFO:tasks.workunit.client.0.smithi063.stdout:9/468: fsync d0/d7/f58 0 2023-12-07T16:21:42.154 INFO:tasks.workunit.client.1.smithi152.stdout:2/688: unlink d2/d1c/d2e/d57/db1/d90/c37 0 2023-12-07T16:21:42.155 INFO:tasks.workunit.client.0.smithi063.stdout:9/469: dread d0/d13/f3d [0,4194304] 0 2023-12-07T16:21:42.155 INFO:tasks.workunit.client.0.smithi063.stdout:3/544: rmdir d7/d9 39 2023-12-07T16:21:42.156 INFO:tasks.workunit.client.1.smithi152.stdout:2/689: getdents d2/d9/d51 0 2023-12-07T16:21:42.157 INFO:tasks.workunit.client.1.smithi152.stdout:2/690: mknod d2/d1c/d2e/d57/db1/cf1 0 2023-12-07T16:21:42.158 INFO:tasks.workunit.client.0.smithi063.stdout:2/611: creat d0/d21/d56/d11/d52/da9/fc9 x:0 0 0 2023-12-07T16:21:42.159 INFO:tasks.workunit.client.0.smithi063.stdout:2/612: write d0/d67/f82 [1761715,55133] 0 2023-12-07T16:21:42.159 INFO:tasks.workunit.client.1.smithi152.stdout:2/691: creat d2/d1c/d2e/d30/d42/d84/ff2 x:0 0 0 2023-12-07T16:21:42.165 INFO:tasks.workunit.client.0.smithi063.stdout:5/457: rename d1/d31/d56/f73 to d1/d31/d56/d61/d5e/d6a/f8a 0 2023-12-07T16:21:42.166 INFO:tasks.workunit.client.0.smithi063.stdout:4/441: creat d1/d3/db/d16/f7f x:0 0 0 2023-12-07T16:21:42.166 INFO:tasks.workunit.client.0.smithi063.stdout:8/673: dwrite d7/d14/d15/d57/f66 [0,4194304] 0 2023-12-07T16:21:42.166 INFO:tasks.workunit.client.0.smithi063.stdout:8/674: readlink d7/d14/d15/d57/lbd 0 2023-12-07T16:21:42.166 INFO:tasks.workunit.client.0.smithi063.stdout:8/675: write d7/d14/d15/db4/fc3 [397361,111660] 0 2023-12-07T16:21:42.166 INFO:tasks.workunit.client.0.smithi063.stdout:8/676: write d7/d38/d73/f8d [1273177,117273] 0 2023-12-07T16:21:42.166 INFO:tasks.workunit.client.1.smithi152.stdout:1/923: dwrite dc/d28/d7d/f102 [0,4194304] 0 2023-12-07T16:21:42.166 INFO:tasks.workunit.client.1.smithi152.stdout:2/692: dread d2/d1c/d2e/f3e [0,4194304] 0 2023-12-07T16:21:42.168 INFO:tasks.workunit.client.0.smithi063.stdout:9/470: mkdir d0/d13/d95 0 2023-12-07T16:21:42.170 INFO:tasks.workunit.client.0.smithi063.stdout:3/545: mkdir d7/d9/dd/d56/db5 0 2023-12-07T16:21:42.172 INFO:tasks.workunit.client.0.smithi063.stdout:1/394: mknod d0/c8a 0 2023-12-07T16:21:42.174 INFO:tasks.workunit.client.0.smithi063.stdout:4/442: rmdir d1/d3/d3f/d49 39 2023-12-07T16:21:42.177 INFO:tasks.workunit.client.0.smithi063.stdout:3/546: dread d7/d4f/d53/d72/db1/f3d [0,4194304] 0 2023-12-07T16:21:42.177 INFO:tasks.workunit.client.0.smithi063.stdout:8/677: symlink d7/d14/d15/d2b/d40/da8/d9f/ld3 0 2023-12-07T16:21:42.179 INFO:tasks.workunit.client.0.smithi063.stdout:1/395: creat d0/dd/d19/f8b x:0 0 0 2023-12-07T16:21:42.179 INFO:tasks.workunit.client.0.smithi063.stdout:1/396: chown d0/dd/d19/d50/d72/f83 1 1 2023-12-07T16:21:42.181 INFO:tasks.workunit.client.0.smithi063.stdout:1/397: rename d0/dd/d19/d50/c53 to d0/dd/d19/d50/d72/d80/c8c 0 2023-12-07T16:21:42.187 INFO:tasks.workunit.client.0.smithi063.stdout:4/443: write d1/d3/f1e [1797017,51012] 0 2023-12-07T16:21:42.187 INFO:tasks.workunit.client.0.smithi063.stdout:4/444: fdatasync d1/d3/db/f4f 0 2023-12-07T16:21:42.187 INFO:tasks.workunit.client.0.smithi063.stdout:4/445: chown d1/d3/d51/c69 688701299 1 2023-12-07T16:21:42.190 INFO:tasks.workunit.client.0.smithi063.stdout:4/446: mkdir d1/d3/d3f/d49/d64/d80 0 2023-12-07T16:21:42.255 INFO:tasks.workunit.client.1.smithi152.stdout:9/812: dwrite d1/d9/f26 [0,4194304] 0 2023-12-07T16:21:42.262 INFO:tasks.workunit.client.1.smithi152.stdout:1/924: getdents dc/def 0 2023-12-07T16:21:42.262 INFO:tasks.workunit.client.1.smithi152.stdout:1/925: write dc/d14/d18/d79/fa1 [5234298,22083] 0 2023-12-07T16:21:42.262 INFO:tasks.workunit.client.0.smithi063.stdout:4/447: write d1/d3/db/f20 [176760,69827] 0 2023-12-07T16:21:42.262 INFO:tasks.workunit.client.0.smithi063.stdout:0/578: dwrite d4/dd/d26/d2b/d5e/d8e/d95/fb4 [0,4194304] 0 2023-12-07T16:21:42.263 INFO:tasks.workunit.client.0.smithi063.stdout:5/458: dread d1/f65 [0,4194304] 0 2023-12-07T16:21:42.273 INFO:tasks.workunit.client.0.smithi063.stdout:2/613: dwrite d0/d67/d65/d6a/d8e/f91 [0,4194304] 0 2023-12-07T16:21:42.277 INFO:tasks.workunit.client.0.smithi063.stdout:2/614: write d0/d21/d56/d11/d52/da9/dbe/f90 [612920,14904] 0 2023-12-07T16:21:42.279 INFO:tasks.workunit.client.1.smithi152.stdout:9/813: unlink d1/d9/db/c10 0 2023-12-07T16:21:42.279 INFO:tasks.workunit.client.1.smithi152.stdout:9/814: truncate d1/d17/fd5 792198 0 2023-12-07T16:21:42.280 INFO:tasks.workunit.client.0.smithi063.stdout:2/615: creat d0/d67/d65/d6a/fca x:0 0 0 2023-12-07T16:21:42.280 INFO:tasks.workunit.client.0.smithi063.stdout:2/616: fdatasync d0/fa 0 2023-12-07T16:21:42.280 INFO:tasks.workunit.client.0.smithi063.stdout:2/617: chown d0/l32 4045460 1 2023-12-07T16:21:42.281 INFO:tasks.workunit.client.1.smithi152.stdout:9/815: mkdir d1/dd/dd6/de2/d53/dff/d10f 0 2023-12-07T16:21:42.282 INFO:tasks.workunit.client.0.smithi063.stdout:2/618: mkdir d0/d21/d56/d11/d6d/dcb 0 2023-12-07T16:21:42.282 INFO:tasks.workunit.client.1.smithi152.stdout:9/816: mknod d1/d17/d3c/d4a/d48/d8c/c110 0 2023-12-07T16:21:42.284 INFO:tasks.workunit.client.0.smithi063.stdout:2/619: getdents d0/d21/d56/d11/d52/d63/d8c 0 2023-12-07T16:21:42.284 INFO:tasks.workunit.client.0.smithi063.stdout:2/620: read d0/d67/d65/f96 [136855,86142] 0 2023-12-07T16:21:42.284 INFO:tasks.workunit.client.0.smithi063.stdout:2/621: stat d0/d21/d56/l88 0 2023-12-07T16:21:42.284 INFO:tasks.workunit.client.1.smithi152.stdout:9/817: mkdir d1/d17/d58/d86/dd9/d111 0 2023-12-07T16:21:42.284 INFO:tasks.workunit.client.1.smithi152.stdout:9/818: stat d1/d9/d2d 0 2023-12-07T16:21:42.284 INFO:tasks.workunit.client.1.smithi152.stdout:9/819: write d1/dd/f5c [1598473,4591] 0 2023-12-07T16:21:42.285 INFO:tasks.workunit.client.0.smithi063.stdout:2/622: truncate d0/d21/d56/d11/d52/da9/dbe/f3e 625488 0 2023-12-07T16:21:42.288 INFO:tasks.workunit.client.0.smithi063.stdout:2/623: creat d0/d67/d65/d6a/fcc x:0 0 0 2023-12-07T16:21:42.288 INFO:tasks.workunit.client.0.smithi063.stdout:2/624: write d0/d21/fc3 [299262,19014] 0 2023-12-07T16:21:42.288 INFO:tasks.workunit.client.0.smithi063.stdout:2/625: dread - d0/d21/d56/f70 zero size 2023-12-07T16:21:42.288 INFO:tasks.workunit.client.0.smithi063.stdout:2/626: write d0/d21/d56/d11/f1b [2000322,125425] 0 2023-12-07T16:21:42.289 INFO:tasks.workunit.client.1.smithi152.stdout:9/820: write d1/d17/d58/f7f [1681699,66943] 0 2023-12-07T16:21:42.289 INFO:tasks.workunit.client.0.smithi063.stdout:2/627: mkdir d0/d21/d56/d11/d52/da9/daf/dcd 0 2023-12-07T16:21:42.291 INFO:tasks.workunit.client.1.smithi152.stdout:3/755: sync 2023-12-07T16:21:42.291 INFO:tasks.workunit.client.1.smithi152.stdout:5/890: sync 2023-12-07T16:21:42.291 INFO:tasks.workunit.client.1.smithi152.stdout:8/756: sync 2023-12-07T16:21:42.291 INFO:tasks.workunit.client.1.smithi152.stdout:8/757: fdatasync d3/d4/d9/dad/fdc 0 2023-12-07T16:21:42.291 INFO:tasks.workunit.client.1.smithi152.stdout:3/756: dread - d7/d10/d1a/d25/d78/fbc zero size 2023-12-07T16:21:42.291 INFO:tasks.workunit.client.1.smithi152.stdout:8/758: fdatasync d3/d4/d9/f33 0 2023-12-07T16:21:42.291 INFO:tasks.workunit.client.1.smithi152.stdout:8/759: stat d3/d1e/d55/d83/dde/lb5 0 2023-12-07T16:21:42.291 INFO:tasks.workunit.client.0.smithi063.stdout:2/628: unlink d0/d21/d56/d11/d52/d5d/dbb/cba 0 2023-12-07T16:21:42.291 INFO:tasks.workunit.client.0.smithi063.stdout:2/629: stat d0/d21/d56/d11/d6d/fc8 0 2023-12-07T16:21:42.293 INFO:tasks.workunit.client.0.smithi063.stdout:2/630: mkdir d0/d21/db2/dce 0 2023-12-07T16:21:42.293 INFO:tasks.workunit.client.0.smithi063.stdout:2/631: chown d0/d67/d65/d6a/la8 96327603 1 2023-12-07T16:21:42.293 INFO:tasks.workunit.client.1.smithi152.stdout:5/891: rename dd/de/d17 to dd/de/d14/d67/d138 0 2023-12-07T16:21:42.294 INFO:tasks.workunit.client.0.smithi063.stdout:2/632: creat d0/d21/d39/fcf x:0 0 0 2023-12-07T16:21:42.294 INFO:tasks.workunit.client.1.smithi152.stdout:8/760: truncate d3/d1e/d43/dbc/fc0 822960 0 2023-12-07T16:21:42.294 INFO:tasks.workunit.client.1.smithi152.stdout:3/757: write d7/d10/d1a/d2f/d86/dda/d62/d6d/d84/f85 [167142,56567] 0 2023-12-07T16:21:42.297 INFO:tasks.workunit.client.1.smithi152.stdout:5/892: link dd/de/d14/dc6/d7c/l12b dd/de/d14/d19/d1a/def/d11a/l139 0 2023-12-07T16:21:42.297 INFO:tasks.workunit.client.1.smithi152.stdout:5/893: read - dd/de/d38/d3d/d6d/dae/de0/ffa zero size 2023-12-07T16:21:42.297 INFO:tasks.workunit.client.0.smithi063.stdout:7/471: dwrite d2/d21/f2d [0,4194304] 0 2023-12-07T16:21:42.297 INFO:tasks.workunit.client.0.smithi063.stdout:7/472: chown d2/d34/f55 19479859 1 2023-12-07T16:21:42.297 INFO:tasks.workunit.client.0.smithi063.stdout:7/473: chown d2/d34/d5a/d5f/d78/d7c/d9b 76841 1 2023-12-07T16:21:42.298 INFO:tasks.workunit.client.1.smithi152.stdout:8/761: getdents d3/d4 0 2023-12-07T16:21:42.298 INFO:tasks.workunit.client.0.smithi063.stdout:3/547: dwrite d7/d9/f27 [0,4194304] 0 2023-12-07T16:21:42.299 INFO:tasks.workunit.client.0.smithi063.stdout:9/471: dwrite d0/d21/f2c [0,4194304] 0 2023-12-07T16:21:42.305 INFO:tasks.workunit.client.0.smithi063.stdout:5/459: dwrite d1/f2a [0,4194304] 0 2023-12-07T16:21:42.306 INFO:tasks.workunit.client.1.smithi152.stdout:3/758: mknod d7/ced 0 2023-12-07T16:21:42.306 INFO:tasks.workunit.client.1.smithi152.stdout:8/762: creat d3/d4/d9/d34/f113 x:0 0 0 2023-12-07T16:21:42.306 INFO:tasks.workunit.client.1.smithi152.stdout:2/693: dwrite d2/d1c/d2e/d57/d5b/da7/fbd [0,4194304] 0 2023-12-07T16:21:42.308 INFO:tasks.workunit.client.1.smithi152.stdout:2/694: write d2/d1c/d2e/f46 [2601756,3130] 0 2023-12-07T16:21:42.309 INFO:tasks.workunit.client.0.smithi063.stdout:8/678: dwrite d7/d14/d15/db4/f84 [0,4194304] 0 2023-12-07T16:21:42.310 INFO:tasks.workunit.client.1.smithi152.stdout:8/763: link d3/d4/d9/dc/d6f/d7b/d7e/d85/f8c d3/d1e/d55/d83/dae/db1/f114 0 2023-12-07T16:21:42.310 INFO:tasks.workunit.client.1.smithi152.stdout:8/764: truncate d3/d4/d4b/f111 616813 0 2023-12-07T16:21:42.310 INFO:tasks.workunit.client.0.smithi063.stdout:1/398: dwrite d0/dd/f42 [0,4194304] 0 2023-12-07T16:21:42.310 INFO:tasks.workunit.client.0.smithi063.stdout:1/399: readlink d0/dd/d19/d50/l5f 0 2023-12-07T16:21:42.311 INFO:tasks.workunit.client.1.smithi152.stdout:1/926: dwrite dc/d14/d18/d79/d86/db7/fc6 [0,4194304] 0 2023-12-07T16:21:42.311 INFO:tasks.workunit.client.1.smithi152.stdout:2/695: symlink d2/d1c/d2e/d30/d42/d84/lf3 0 2023-12-07T16:21:42.312 INFO:tasks.workunit.client.1.smithi152.stdout:9/821: dwrite d1/d9/d2d/d46/d9a/f9e [0,4194304] 0 2023-12-07T16:21:42.313 INFO:tasks.workunit.client.1.smithi152.stdout:3/759: write d7/d10/d1a/d25/fd5 [2402115,10047] 0 2023-12-07T16:21:42.313 INFO:tasks.workunit.client.1.smithi152.stdout:3/760: stat d7/d10/d1a/d2f/d86/dda/d62/d6d/d98 0 2023-12-07T16:21:42.313 INFO:tasks.workunit.client.1.smithi152.stdout:1/927: mkdir dc/d14/d135 0 2023-12-07T16:21:42.313 INFO:tasks.workunit.client.1.smithi152.stdout:1/928: truncate dc/d14/d18/d64/f114 308302 0 2023-12-07T16:21:42.313 INFO:tasks.workunit.client.0.smithi063.stdout:9/472: creat d0/d21/d64/d6a/f96 x:0 0 0 2023-12-07T16:21:42.313 INFO:tasks.workunit.client.1.smithi152.stdout:2/696: creat d2/d1c/d52/da8/ff4 x:0 0 0 2023-12-07T16:21:42.314 INFO:tasks.workunit.client.1.smithi152.stdout:2/697: chown d2/d1c/d2e/d57/db1/d90/f39 3022 1 2023-12-07T16:21:42.315 INFO:tasks.workunit.client.0.smithi063.stdout:5/460: symlink d1/d3/d3a/l8b 0 2023-12-07T16:21:42.316 INFO:tasks.workunit.client.0.smithi063.stdout:0/579: dwrite d4/dd/d26/d2b/d5e/d8e/d95/f7a [0,4194304] 0 2023-12-07T16:21:42.316 INFO:tasks.workunit.client.0.smithi063.stdout:0/580: fdatasync d4/dd/d26/d2b/d5e/d8e/d95/d68/fad 0 2023-12-07T16:21:42.319 INFO:tasks.workunit.client.1.smithi152.stdout:3/761: rename d7/d10/d1a/d2f/d86 to d7/d10/d1a/d2f/d56/d57/dee 0 2023-12-07T16:21:42.320 INFO:tasks.workunit.client.1.smithi152.stdout:3/762: chown d7/d10/d1a/d25/d78/c83 57 1 2023-12-07T16:21:42.320 INFO:tasks.workunit.client.1.smithi152.stdout:1/929: link dc/f63 dc/def/f136 0 2023-12-07T16:21:42.323 INFO:tasks.workunit.client.1.smithi152.stdout:2/698: unlink d2/d9/d51/d54/d5c/la1 0 2023-12-07T16:21:42.324 INFO:tasks.workunit.client.1.smithi152.stdout:5/894: dwrite dd/d91/dbe/d10e/f104 [0,4194304] 0 2023-12-07T16:21:42.324 INFO:tasks.workunit.client.1.smithi152.stdout:8/765: dread d3/d4/d9/dc/d6f/d7b/d7e/f9a [0,4194304] 0 2023-12-07T16:21:42.324 INFO:tasks.workunit.client.0.smithi063.stdout:2/633: dwrite d0/d21/d56/d11/d52/da9/dbe/f29 [0,4194304] 0 2023-12-07T16:21:42.324 INFO:tasks.workunit.client.0.smithi063.stdout:2/634: chown d0/l32 112037 1 2023-12-07T16:21:42.324 INFO:tasks.workunit.client.0.smithi063.stdout:2/635: readlink d0/d21/d56/d11/d6d/lc1 0 2023-12-07T16:21:42.326 INFO:tasks.workunit.client.1.smithi152.stdout:9/822: creat d1/d9/db/df/da6/f112 x:0 0 0 2023-12-07T16:21:42.326 INFO:tasks.workunit.client.1.smithi152.stdout:9/823: fdatasync d1/d9/db/df/d42/fcd 0 2023-12-07T16:21:42.329 INFO:tasks.workunit.client.1.smithi152.stdout:3/763: creat d7/d10/d1a/d2f/d56/d57/dee/dda/d62/d6d/d98/fef x:0 0 0 2023-12-07T16:21:42.329 INFO:tasks.workunit.client.1.smithi152.stdout:3/764: chown d7/d10/d1a/d2f/d56/d57/dee/dda/d62/d6d/d84/l9d 51115422 1 2023-12-07T16:21:42.330 INFO:tasks.workunit.client.1.smithi152.stdout:1/930: truncate dc/d14/d18/d2d/f33 4838897 0 2023-12-07T16:21:42.331 INFO:tasks.workunit.client.1.smithi152.stdout:1/931: write dc/d28/f39 [5682701,56095] 0 2023-12-07T16:21:42.332 INFO:tasks.workunit.client.1.smithi152.stdout:2/699: mkdir d2/d1c/d52/da8/df5 0 2023-12-07T16:21:42.335 INFO:tasks.workunit.client.0.smithi063.stdout:8/679: creat d7/d38/d73/fd4 x:0 0 0 2023-12-07T16:21:42.335 INFO:tasks.workunit.client.1.smithi152.stdout:9/824: dread d1/d9/d2d/fb0 [0,4194304] 0 2023-12-07T16:21:42.335 INFO:tasks.workunit.client.1.smithi152.stdout:9/825: stat d1/f3a 0 2023-12-07T16:21:42.335 INFO:tasks.workunit.client.1.smithi152.stdout:9/826: chown d1/d9/d4f/daf/fc2 12445460 1 2023-12-07T16:21:42.337 INFO:tasks.workunit.client.1.smithi152.stdout:8/766: mknod d3/d4/d9/dc/c115 0 2023-12-07T16:21:42.338 INFO:tasks.workunit.client.0.smithi063.stdout:1/400: mknod d0/dd/d10/d13/d2f/d79/c8d 0 2023-12-07T16:21:42.338 INFO:tasks.workunit.client.0.smithi063.stdout:1/401: chown d0/dd/f41 4394354 1 2023-12-07T16:21:42.339 INFO:tasks.workunit.client.0.smithi063.stdout:9/473: creat d0/d21/d64/d6a/d8f/f97 x:0 0 0 2023-12-07T16:21:42.344 INFO:tasks.workunit.client.1.smithi152.stdout:3/765: mknod d7/d10/dd0/cf0 0 2023-12-07T16:21:42.344 INFO:tasks.workunit.client.1.smithi152.stdout:1/932: mknod dc/d14/d18/d2d/c137 0 2023-12-07T16:21:42.344 INFO:tasks.workunit.client.1.smithi152.stdout:9/827: rename d1/d9/db/df/dd4/f10b to d1/d9/d2d/d72/f113 0 2023-12-07T16:21:42.344 INFO:tasks.workunit.client.1.smithi152.stdout:9/828: fdatasync d1/d17/d4e/f99 0 2023-12-07T16:21:42.344 INFO:tasks.workunit.client.1.smithi152.stdout:2/700: dread d2/d1c/d2e/f64 [0,4194304] 0 2023-12-07T16:21:42.346 INFO:tasks.workunit.client.1.smithi152.stdout:3/766: link d7/d10/d1a/d2f/d56/d57/dee/dda/d6b/fd3 d7/d10/d41/ff1 0 2023-12-07T16:21:42.346 INFO:tasks.workunit.client.1.smithi152.stdout:3/767: fdatasync d7/d10/fd9 0 2023-12-07T16:21:42.346 INFO:tasks.workunit.client.1.smithi152.stdout:3/768: write d7/d10/d1a/d2f/d5c/dbf/fc7 [357209,24925] 0 2023-12-07T16:21:42.347 INFO:tasks.workunit.client.0.smithi063.stdout:0/581: creat d4/dd/d26/d2b/db5/d5b/d63/d6b/fc3 x:0 0 0 2023-12-07T16:21:42.348 INFO:tasks.workunit.client.1.smithi152.stdout:9/829: creat d1/f114 x:0 0 0 2023-12-07T16:21:42.353 INFO:tasks.workunit.client.1.smithi152.stdout:1/933: write dc/d28/d4e/f99 [2085954,93862] 0 2023-12-07T16:21:42.354 INFO:tasks.workunit.client.1.smithi152.stdout:5/895: dwrite dd/de/d8f/dc9/ffd [0,4194304] 0 2023-12-07T16:21:42.354 INFO:tasks.workunit.client.1.smithi152.stdout:5/896: chown dd/de/d14/d19/d1a 258766 1 2023-12-07T16:21:42.356 INFO:tasks.workunit.client.0.smithi063.stdout:9/474: creat d0/d13/d95/f98 x:0 0 0 2023-12-07T16:21:42.357 INFO:tasks.workunit.client.1.smithi152.stdout:8/767: rename d3/d1e/d55/la2 to d3/d4/l116 0 2023-12-07T16:21:42.359 INFO:tasks.workunit.client.1.smithi152.stdout:9/830: dread d1/d9/d2d/fb0 [0,4194304] 0 2023-12-07T16:21:42.359 INFO:tasks.workunit.client.1.smithi152.stdout:9/831: truncate d1/d9/db/df/d42/fcd 168140 0 2023-12-07T16:21:42.359 INFO:tasks.workunit.client.1.smithi152.stdout:9/832: readlink d1/d9/db/df/da6/la3 0 2023-12-07T16:21:42.359 INFO:tasks.workunit.client.1.smithi152.stdout:9/833: stat d1/d9/db/df/d42/lcf 0 2023-12-07T16:21:42.361 INFO:tasks.workunit.client.1.smithi152.stdout:5/897: mkdir dd/d91/dbe/d10e/d113/d13a 0 2023-12-07T16:21:42.361 INFO:tasks.workunit.client.1.smithi152.stdout:9/834: creat d1/d17/d3c/d4a/d48/d8c/f115 x:0 0 0 2023-12-07T16:21:42.364 INFO:tasks.workunit.client.1.smithi152.stdout:5/898: mkdir dd/de/d14/d19/da3/d114/d13b 0 2023-12-07T16:21:42.364 INFO:tasks.workunit.client.1.smithi152.stdout:9/835: creat d1/d17/d3c/f116 x:0 0 0 2023-12-07T16:21:42.364 INFO:tasks.workunit.client.1.smithi152.stdout:9/836: write d1/d9/d2d/d65/fbb [4998760,70657] 0 2023-12-07T16:21:42.370 INFO:tasks.workunit.client.1.smithi152.stdout:9/837: dread d1/d17/fd5 [0,4194304] 0 2023-12-07T16:21:42.370 INFO:tasks.workunit.client.1.smithi152.stdout:9/838: read - d1/d9/d2d/d46/f109 zero size 2023-12-07T16:21:42.370 INFO:tasks.workunit.client.1.smithi152.stdout:5/899: write dd/de/d38/f79 [194903,27542] 0 2023-12-07T16:21:42.371 INFO:tasks.workunit.client.0.smithi063.stdout:8/680: dwrite d7/d38/d8e/f91 [4194304,4194304] 0 2023-12-07T16:21:42.375 INFO:tasks.workunit.client.0.smithi063.stdout:8/681: mknod d7/d14/d4e/cd5 0 2023-12-07T16:21:42.377 INFO:tasks.workunit.client.1.smithi152.stdout:1/934: dread dc/d14/d18/d2d/f67 [0,4194304] 0 2023-12-07T16:21:42.381 INFO:tasks.workunit.client.0.smithi063.stdout:1/402: dwrite d0/dd/d10/d13/f3d [4194304,4194304] 0 2023-12-07T16:21:42.381 INFO:tasks.workunit.client.0.smithi063.stdout:1/403: stat d0/dd/d10/f27 0 2023-12-07T16:21:42.385 INFO:tasks.workunit.client.0.smithi063.stdout:1/404: creat d0/dd/d10/d13/d2f/d79/f8e x:0 0 0 2023-12-07T16:21:42.385 INFO:tasks.workunit.client.0.smithi063.stdout:1/405: stat d0/dd/d10/d13/d2f/d79/f7d 0 2023-12-07T16:21:42.392 INFO:tasks.workunit.client.0.smithi063.stdout:0/582: dwrite d4/dd/de/f7c [0,4194304] 0 2023-12-07T16:21:42.392 INFO:tasks.workunit.client.0.smithi063.stdout:0/583: read - d4/dd/f6a zero size 2023-12-07T16:21:42.397 INFO:tasks.workunit.client.0.smithi063.stdout:8/682: dread d7/d14/d15/db4/f88 [0,4194304] 0 2023-12-07T16:21:42.400 INFO:tasks.workunit.client.1.smithi152.stdout:9/839: dwrite d1/d9/d4f/daf/fc2 [0,4194304] 0 2023-12-07T16:21:42.400 INFO:tasks.workunit.client.1.smithi152.stdout:9/840: chown d1/d17/d58/f7f 31335 1 2023-12-07T16:21:42.400 INFO:tasks.workunit.client.1.smithi152.stdout:9/841: chown d1/d17/d58/d86/lc7 7 1 2023-12-07T16:21:42.400 INFO:tasks.workunit.client.1.smithi152.stdout:2/701: dwrite d2/f8 [0,4194304] 0 2023-12-07T16:21:42.400 INFO:tasks.workunit.client.1.smithi152.stdout:2/702: readlink d2/d1c/d2e/d30/l6c 0 2023-12-07T16:21:42.400 INFO:tasks.workunit.client.0.smithi063.stdout:0/584: truncate d4/d25/f71 90309 0 2023-12-07T16:21:42.400 INFO:tasks.workunit.client.0.smithi063.stdout:0/585: fdatasync d4/dd/d26/d2b/d5e/d8e/d95/d68/fad 0 2023-12-07T16:21:42.402 INFO:tasks.workunit.client.1.smithi152.stdout:3/769: dwrite d7/d10/d1a/d25/d78/f92 [0,4194304] 0 2023-12-07T16:21:42.402 INFO:tasks.workunit.client.1.smithi152.stdout:1/935: dwrite dc/f63 [0,4194304] 0 2023-12-07T16:21:42.402 INFO:tasks.workunit.client.1.smithi152.stdout:1/936: chown dc/d14/d18/d2d/d9c/dfc 0 1 2023-12-07T16:21:42.402 INFO:tasks.workunit.client.1.smithi152.stdout:3/770: chown d7/dc/d14/f39 14385 1 2023-12-07T16:21:42.403 INFO:tasks.workunit.client.0.smithi063.stdout:8/683: write d7/f24 [1272635,35612] 0 2023-12-07T16:21:42.404 INFO:tasks.workunit.client.0.smithi063.stdout:8/684: chown d7/d38/c4d 58 1 2023-12-07T16:21:42.404 INFO:tasks.workunit.client.0.smithi063.stdout:0/586: write d4/fc [3539238,67576] 0 2023-12-07T16:21:42.404 INFO:tasks.workunit.client.0.smithi063.stdout:0/587: read d4/dd/de/f13 [4793586,90744] 0 2023-12-07T16:21:42.407 INFO:tasks.workunit.client.0.smithi063.stdout:8/685: link d7/d38/d73/fa1 d7/d14/d15/d57/fd6 0 2023-12-07T16:21:42.408 INFO:tasks.workunit.client.1.smithi152.stdout:2/703: rmdir d2/d1c/d52/da8 39 2023-12-07T16:21:42.411 INFO:tasks.workunit.client.1.smithi152.stdout:3/771: symlink d7/d10/d19/lf2 0 2023-12-07T16:21:42.415 INFO:tasks.workunit.client.1.smithi152.stdout:3/772: mkdir d7/d10/d1a/d2f/d56/d57/dee/dda/d62/d6d/d81/de6/df3 0 2023-12-07T16:21:42.415 INFO:tasks.workunit.client.1.smithi152.stdout:2/704: mkdir d2/d1c/d2e/d57/d5b/da7/d9a/dcb/df6 0 2023-12-07T16:21:42.415 INFO:tasks.workunit.client.1.smithi152.stdout:2/705: chown d2/d1c/d52/l74 21 1 2023-12-07T16:21:42.417 INFO:tasks.workunit.client.1.smithi152.stdout:2/706: getdents d2/d9 0 2023-12-07T16:21:42.419 INFO:tasks.workunit.client.1.smithi152.stdout:2/707: truncate d2/d1c/d2e/f64 1891223 0 2023-12-07T16:21:42.421 INFO:tasks.workunit.client.1.smithi152.stdout:2/708: creat d2/d1c/d2e/d5d/dab/dd9/dda/ff7 x:0 0 0 2023-12-07T16:21:42.425 INFO:tasks.workunit.client.0.smithi063.stdout:0/588: dwrite d4/dd/de/d15/d1f/d22/f7b [0,4194304] 0 2023-12-07T16:21:42.428 INFO:tasks.workunit.client.0.smithi063.stdout:0/589: symlink d4/d7e/lc4 0 2023-12-07T16:21:42.430 INFO:tasks.workunit.client.1.smithi152.stdout:2/709: truncate d2/f8 4036486 0 2023-12-07T16:21:42.430 INFO:tasks.workunit.client.1.smithi152.stdout:2/710: stat d2/d1c/d2e/d30/d33/f3d 0 2023-12-07T16:21:42.430 INFO:tasks.workunit.client.0.smithi063.stdout:0/590: creat d4/dd/d26/d2b/db5/d5b/d63/d6b/da8/fc5 x:0 0 0 2023-12-07T16:21:42.432 INFO:tasks.workunit.client.0.smithi063.stdout:0/591: link d4/d25/f8d d4/dd/d26/d2b/d5e/d8e/d95/fc6 0 2023-12-07T16:21:42.433 INFO:tasks.workunit.client.1.smithi152.stdout:2/711: dread d2/d1c/d2e/d57/db1/d90/f2a [0,4194304] 0 2023-12-07T16:21:42.433 INFO:tasks.workunit.client.0.smithi063.stdout:0/592: symlink d4/dd/d26/d2b/db5/d5b/d63/d9b/lc7 0 2023-12-07T16:21:42.434 INFO:tasks.workunit.client.1.smithi152.stdout:3/773: dwrite d7/d10/d1a/d2f/d56/d57/dee/dda/d7d/fa1 [4194304,4194304] 0 2023-12-07T16:21:42.434 INFO:tasks.workunit.client.1.smithi152.stdout:3/774: dread - d7/d10/d1a/d25/d4b/fa4 zero size 2023-12-07T16:21:42.436 INFO:tasks.workunit.client.1.smithi152.stdout:3/775: unlink d7/d10/d1a/d25/d3f/l74 0 2023-12-07T16:21:42.436 INFO:tasks.workunit.client.1.smithi152.stdout:3/776: truncate d7/d10/d41/ff1 53604 0 2023-12-07T16:21:42.436 INFO:tasks.workunit.client.1.smithi152.stdout:3/777: write d7/dc/d14/f87 [774119,93257] 0 2023-12-07T16:21:42.436 INFO:tasks.workunit.client.1.smithi152.stdout:7/696: sync 2023-12-07T16:21:42.436 INFO:tasks.workunit.client.1.smithi152.stdout:6/724: sync 2023-12-07T16:21:42.436 INFO:tasks.workunit.client.1.smithi152.stdout:0/726: sync 2023-12-07T16:21:42.437 INFO:tasks.workunit.client.1.smithi152.stdout:2/712: symlink d2/lf8 0 2023-12-07T16:21:42.437 INFO:tasks.workunit.client.0.smithi063.stdout:0/593: rmdir d4/dd/de 39 2023-12-07T16:21:42.437 INFO:tasks.workunit.client.1.smithi152.stdout:4/669: sync 2023-12-07T16:21:42.437 INFO:tasks.workunit.client.1.smithi152.stdout:4/670: readlink d0/d3/d6/dc/d3a/d46/d80/lab 0 2023-12-07T16:21:42.438 INFO:tasks.workunit.client.1.smithi152.stdout:6/725: write d2/d4f/d83/d85/d94/fb1 [4773398,102169] 0 2023-12-07T16:21:42.438 INFO:tasks.workunit.client.0.smithi063.stdout:8/686: symlink d7/d14/ld7 0 2023-12-07T16:21:42.439 INFO:tasks.workunit.client.1.smithi152.stdout:7/697: symlink db/d1c/dd0/ldf 0 2023-12-07T16:21:42.439 INFO:tasks.workunit.client.1.smithi152.stdout:2/713: rmdir d2/dba 39 2023-12-07T16:21:42.439 INFO:tasks.workunit.client.1.smithi152.stdout:0/727: dread d0/f1a [0,4194304] 0 2023-12-07T16:21:42.439 INFO:tasks.workunit.client.0.smithi063.stdout:0/594: symlink d4/dd/d26/d2b/db5/d5b/lc8 0 2023-12-07T16:21:42.439 INFO:tasks.workunit.client.0.smithi063.stdout:0/595: fdatasync d4/dd/d26/d2b/db5/d5b/fae 0 2023-12-07T16:21:42.440 INFO:tasks.workunit.client.0.smithi063.stdout:0/596: write d4/fc [4863745,106286] 0 2023-12-07T16:21:42.440 INFO:tasks.workunit.client.1.smithi152.stdout:4/671: rmdir d0/d3/d6/dc/d39/d93/d7c/dc5 0 2023-12-07T16:21:42.444 INFO:tasks.workunit.client.0.smithi063.stdout:5/461: link d1/f11 d1/d3/f8c 0 2023-12-07T16:21:42.444 INFO:tasks.workunit.client.1.smithi152.stdout:2/714: rmdir d2/d1c/d2e/d30/d42/d84 39 2023-12-07T16:21:42.444 INFO:tasks.workunit.client.1.smithi152.stdout:2/715: dread - d2/d9/d51/d54/fc4 zero size 2023-12-07T16:21:42.444 INFO:tasks.workunit.client.1.smithi152.stdout:2/716: stat d2/d1c/d2e/d30/d33/fd5 0 2023-12-07T16:21:42.444 INFO:tasks.workunit.client.1.smithi152.stdout:2/717: truncate d2/d1c/d2e/d57/d5b/fe2 192665 0 2023-12-07T16:21:42.445 INFO:tasks.workunit.client.0.smithi063.stdout:8/687: rmdir d7/d14/d15/d48 39 2023-12-07T16:21:42.445 INFO:tasks.workunit.client.0.smithi063.stdout:8/688: chown d7/d14/d1a/f56 82 1 2023-12-07T16:21:42.446 INFO:tasks.workunit.client.1.smithi152.stdout:7/698: creat db/d27/d4d/dc9/fe0 x:0 0 0 2023-12-07T16:21:42.446 INFO:tasks.workunit.client.1.smithi152.stdout:7/699: write db/d1c/f94 [1726841,10275] 0 2023-12-07T16:21:42.446 INFO:tasks.workunit.client.1.smithi152.stdout:4/672: creat d0/d81/fc6 x:0 0 0 2023-12-07T16:21:42.449 INFO:tasks.workunit.client.1.smithi152.stdout:0/728: dread d0/dc/d36/d3a/f85 [0,4194304] 0 2023-12-07T16:21:42.449 INFO:tasks.workunit.client.1.smithi152.stdout:0/729: write d0/dc/d3d/d4c/fa5 [852526,50863] 0 2023-12-07T16:21:42.450 INFO:tasks.workunit.client.0.smithi063.stdout:5/462: mknod d1/d3/de/d1e/d6b/c8d 0 2023-12-07T16:21:42.450 INFO:tasks.workunit.client.0.smithi063.stdout:7/474: creat d2/fb1 x:0 0 0 2023-12-07T16:21:42.450 INFO:tasks.workunit.client.0.smithi063.stdout:7/475: fsync d2/d34/d5a/d5f/f1b 0 2023-12-07T16:21:42.450 INFO:tasks.workunit.client.0.smithi063.stdout:7/476: chown d2/d34/d5a/d5f/d2a/f35 3668 1 2023-12-07T16:21:42.451 INFO:tasks.workunit.client.0.smithi063.stdout:8/689: creat d7/d14/d15/d48/fd8 x:0 0 0 2023-12-07T16:21:42.451 INFO:tasks.workunit.client.0.smithi063.stdout:8/690: chown d7/d14/d1a/l64 233618047 1 2023-12-07T16:21:42.451 INFO:tasks.workunit.client.0.smithi063.stdout:8/691: chown d7/d14/d15/dac/fc6 1279844 1 2023-12-07T16:21:42.451 INFO:tasks.workunit.client.0.smithi063.stdout:8/692: write d7/d14/d15/d57/fb8 [119934,32239] 0 2023-12-07T16:21:42.451 INFO:tasks.workunit.client.0.smithi063.stdout:5/463: dread d1/d3/d3a/f77 [0,4194304] 0 2023-12-07T16:21:42.454 INFO:tasks.workunit.client.0.smithi063.stdout:7/477: rmdir d2/d2c 39 2023-12-07T16:21:42.455 INFO:tasks.workunit.client.0.smithi063.stdout:3/548: mknod d7/cb6 0 2023-12-07T16:21:42.455 INFO:tasks.workunit.client.0.smithi063.stdout:3/549: readlink d7/d21/l2f 0 2023-12-07T16:21:42.456 INFO:tasks.workunit.client.1.smithi152.stdout:4/673: unlink d0/d3/d6/l8e 0 2023-12-07T16:21:42.456 INFO:tasks.workunit.client.1.smithi152.stdout:4/674: readlink d0/d3/d6/d36/l89 0 2023-12-07T16:21:42.456 INFO:tasks.workunit.client.1.smithi152.stdout:4/675: readlink d0/d3/d6/dc/d3a/d46/d80/lb0 0 2023-12-07T16:21:42.456 INFO:tasks.workunit.client.0.smithi063.stdout:8/693: truncate d7/fd 1691410 0 2023-12-07T16:21:42.458 INFO:tasks.workunit.client.1.smithi152.stdout:0/730: symlink d0/dc/d36/d7d/d92/de9/lfb 0 2023-12-07T16:21:42.459 INFO:tasks.workunit.client.0.smithi063.stdout:7/478: rename d2/d2c/c85 to d2/d34/d46/d48/d70/daf/cb2 0 2023-12-07T16:21:42.459 INFO:tasks.workunit.client.1.smithi152.stdout:4/676: getdents d0/d3/d6/dc/d3a 0 2023-12-07T16:21:42.460 INFO:tasks.workunit.client.0.smithi063.stdout:8/694: creat d7/db6/fd9 x:0 0 0 2023-12-07T16:21:42.460 INFO:tasks.workunit.client.0.smithi063.stdout:8/695: fsync d7/d14/d1a/f31 0 2023-12-07T16:21:42.461 INFO:tasks.workunit.client.1.smithi152.stdout:0/731: unlink d0/dc/d36/d3a/d51/l6b 0 2023-12-07T16:21:42.463 INFO:tasks.workunit.client.1.smithi152.stdout:0/732: creat d0/dc/d3d/dab/dc8/ffc x:0 0 0 2023-12-07T16:21:42.474 INFO:tasks.workunit.client.0.smithi063.stdout:9/475: creat d0/f99 x:0 0 0 2023-12-07T16:21:42.474 INFO:tasks.workunit.client.0.smithi063.stdout:8/696: read d7/f4a [505178,551] 0 2023-12-07T16:21:42.475 INFO:tasks.workunit.client.0.smithi063.stdout:2/636: unlink d0/c28 0 2023-12-07T16:21:42.477 INFO:tasks.workunit.client.0.smithi063.stdout:9/476: creat d0/d21/d64/d6a/d8f/d92/f9a x:0 0 0 2023-12-07T16:21:42.477 INFO:tasks.workunit.client.0.smithi063.stdout:9/477: chown d0/d13/d39/d42/c61 13 1 2023-12-07T16:21:42.478 INFO:tasks.workunit.client.0.smithi063.stdout:8/697: mkdir d7/d14/d15/d2b/dda 0 2023-12-07T16:21:42.478 INFO:tasks.workunit.client.0.smithi063.stdout:8/698: fsync d7/d14/d15/d57/fd6 0 2023-12-07T16:21:42.478 INFO:tasks.workunit.client.0.smithi063.stdout:2/637: symlink d0/d67/d65/d6a/d8e/ld0 0 2023-12-07T16:21:42.479 INFO:tasks.workunit.client.0.smithi063.stdout:4/448: creat d1/f81 x:0 0 0 2023-12-07T16:21:42.480 INFO:tasks.workunit.client.0.smithi063.stdout:8/699: mkdir d7/db6/ddb 0 2023-12-07T16:21:42.481 INFO:tasks.workunit.client.0.smithi063.stdout:2/638: creat d0/d67/d5b/fd1 x:0 0 0 2023-12-07T16:21:42.482 INFO:tasks.workunit.client.0.smithi063.stdout:4/449: symlink d1/d3/db/d2c/d63/d62/l82 0 2023-12-07T16:21:42.482 INFO:tasks.workunit.client.0.smithi063.stdout:2/639: mkdir d0/d21/d56/d11/d52/d63/d8c/db9/dd2 0 2023-12-07T16:21:42.483 INFO:tasks.workunit.client.0.smithi063.stdout:4/450: mknod d1/d3/d3f/d49/d64/d80/c83 0 2023-12-07T16:21:42.485 INFO:tasks.workunit.client.0.smithi063.stdout:2/640: unlink d0/d21/l24 0 2023-12-07T16:21:42.487 INFO:tasks.workunit.client.0.smithi063.stdout:4/451: creat d1/d3/db/d2c/d63/f84 x:0 0 0 2023-12-07T16:21:42.488 INFO:tasks.workunit.client.0.smithi063.stdout:2/641: creat d0/d67/d5b/fd3 x:0 0 0 2023-12-07T16:21:42.488 INFO:tasks.workunit.client.0.smithi063.stdout:2/642: getdents d0/d21/db2/dce 0 2023-12-07T16:21:42.490 INFO:tasks.workunit.client.0.smithi063.stdout:4/452: rename d1/d3/d3a/c47 to d1/d3/db/d16/c85 0 2023-12-07T16:21:42.491 INFO:tasks.workunit.client.0.smithi063.stdout:5/464: dwrite d1/d3/de/d1e/d25/f53 [0,4194304] 0 2023-12-07T16:21:42.491 INFO:tasks.workunit.client.0.smithi063.stdout:2/643: creat d0/d21/d56/d11/d52/d63/fd4 x:0 0 0 2023-12-07T16:21:42.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:42 smithi152 ceph-mon[121113]: pgmap v28: 65 pgs: 65 active+clean; 1.8 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 123 MiB/s rd, 256 MiB/s wr, 375 op/s 2023-12-07T16:21:42.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:42 smithi152 ceph-mon[121113]: Upgrade: Updating mgr.smithi063.yohyyx 2023-12-07T16:21:42.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:42 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:42.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:42 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi063.yohyyx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-07T16:21:42.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:42 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi063.yohyyx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-07T16:21:42.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:42 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-07T16:21:42.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:42 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:21:42.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:42 smithi152 ceph-mon[121113]: Deploying daemon mgr.smithi063.yohyyx on smithi063 2023-12-07T16:21:42.494 INFO:tasks.workunit.client.0.smithi063.stdout:5/465: rename d1/d3/de/d1e/c3d to d1/d31/d56/d61/d5e/c8e 0 2023-12-07T16:21:42.496 INFO:tasks.workunit.client.0.smithi063.stdout:5/466: unlink d1/f2e 0 2023-12-07T16:21:42.496 INFO:tasks.workunit.client.0.smithi063.stdout:5/467: stat d1/d3/de/f10 0 2023-12-07T16:21:42.498 INFO:tasks.workunit.client.0.smithi063.stdout:5/468: mkdir d1/d31/d56/d61/d8f 0 2023-12-07T16:21:42.499 INFO:tasks.workunit.client.0.smithi063.stdout:5/469: rmdir d1/d3/de/d1e 39 2023-12-07T16:21:42.501 INFO:tasks.workunit.client.0.smithi063.stdout:5/470: rmdir d1/d31/d56/d61/d5e/d6a/d7e 39 2023-12-07T16:21:42.501 INFO:tasks.workunit.client.0.smithi063.stdout:5/471: fdatasync d1/d3/de/f16 0 2023-12-07T16:21:42.516 INFO:tasks.workunit.client.0.smithi063.stdout:5/472: dread d1/d3/de/d1e/f24 [0,4194304] 0 2023-12-07T16:21:42.518 INFO:tasks.workunit.client.0.smithi063.stdout:5/473: symlink d1/d31/l90 0 2023-12-07T16:21:42.518 INFO:tasks.workunit.client.0.smithi063.stdout:5/474: chown d1/d3/de/f14 3 1 2023-12-07T16:21:42.518 INFO:tasks.workunit.client.0.smithi063.stdout:5/475: chown d1/d3/d3a/d5a/f66 11663 1 2023-12-07T16:21:42.519 INFO:tasks.workunit.client.0.smithi063.stdout:5/476: mkdir d1/d3/d3a/d91 0 2023-12-07T16:21:42.519 INFO:tasks.workunit.client.0.smithi063.stdout:5/477: chown d1/d3/de/d1e/c1c 4 1 2023-12-07T16:21:42.522 INFO:tasks.workunit.client.0.smithi063.stdout:5/478: link d1/d3/d3a/f89 d1/d31/d56/d61/d5e/f92 0 2023-12-07T16:21:42.522 INFO:tasks.workunit.client.0.smithi063.stdout:5/479: dread - d1/d31/d56/d61/d5e/d6a/d7e/f84 zero size 2023-12-07T16:21:42.563 INFO:tasks.workunit.client.1.smithi152.stdout:0/733: dread d0/dc/f79 [0,4194304] 0 2023-12-07T16:21:42.564 INFO:tasks.workunit.client.1.smithi152.stdout:0/734: mkdir d0/dc/d36/d3a/d69/dfd 0 2023-12-07T16:21:42.564 INFO:tasks.workunit.client.1.smithi152.stdout:0/735: truncate d0/dc/d3d/dab/fb6 493289 0 2023-12-07T16:21:42.566 INFO:tasks.workunit.client.1.smithi152.stdout:0/736: creat d0/dc/d36/d7d/d92/de9/ffe x:0 0 0 2023-12-07T16:21:42.566 INFO:tasks.workunit.client.1.smithi152.stdout:0/737: dread - d0/dc/d26/f41 zero size 2023-12-07T16:21:42.576 INFO:tasks.workunit.client.1.smithi152.stdout:0/738: dread d0/dc/d3d/d4c/f8e [0,4194304] 0 2023-12-07T16:21:42.576 INFO:tasks.workunit.client.1.smithi152.stdout:0/739: truncate d0/d27/d8c/df7/d30/d6e/d77/f96 4565207 0 2023-12-07T16:21:42.577 INFO:tasks.workunit.client.1.smithi152.stdout:0/740: mknod d0/d27/d11/cff 0 2023-12-07T16:21:42.578 INFO:tasks.workunit.client.1.smithi152.stdout:0/741: mknod d0/dc/d3d/d73/dbf/c100 0 2023-12-07T16:21:42.578 INFO:tasks.workunit.client.1.smithi152.stdout:0/742: write d0/dc/d36/d3a/d69/f99 [118575,75433] 0 2023-12-07T16:21:42.579 INFO:tasks.workunit.client.1.smithi152.stdout:0/743: fdatasync d0/d27/fef 0 2023-12-07T16:21:42.579 INFO:tasks.workunit.client.1.smithi152.stdout:0/744: chown d0/dc/d3d/d73/fbb 649519 1 2023-12-07T16:21:42.579 INFO:tasks.workunit.client.0.smithi063.stdout:9/478: write d0/f31 [3051479,54676] 0 2023-12-07T16:21:42.579 INFO:tasks.workunit.client.1.smithi152.stdout:0/745: symlink d0/d27/de6/l101 0 2023-12-07T16:21:42.581 INFO:tasks.workunit.client.1.smithi152.stdout:0/746: unlink d0/dc/d36/d3a/d51/d82/dae/cf9 0 2023-12-07T16:21:42.583 INFO:tasks.workunit.client.1.smithi152.stdout:0/747: mknod d0/dc/d36/d3a/d51/c102 0 2023-12-07T16:21:42.583 INFO:tasks.workunit.client.1.smithi152.stdout:0/748: write d0/d27/d11/d68/f81 [699124,105197] 0 2023-12-07T16:21:42.584 INFO:tasks.workunit.client.1.smithi152.stdout:0/749: rmdir d0/dc/d36/d3a/d69/dfd 0 2023-12-07T16:21:42.585 INFO:tasks.workunit.client.0.smithi063.stdout:5/480: dread d1/d31/d56/f67 [0,4194304] 0 2023-12-07T16:21:42.585 INFO:tasks.workunit.client.1.smithi152.stdout:0/750: mknod d0/d27/d11/c103 0 2023-12-07T16:21:42.587 INFO:tasks.workunit.client.1.smithi152.stdout:0/751: dread d0/d27/d8c/df7/d30/d6e/d77/d9f/fa0 [0,4194304] 0 2023-12-07T16:21:42.587 INFO:tasks.workunit.client.1.smithi152.stdout:3/778: dwrite d7/d10/d1a/d25/d78/fc5 [0,4194304] 0 2023-12-07T16:21:42.587 INFO:tasks.workunit.client.1.smithi152.stdout:3/779: write d7/d10/d1a/fc1 [982848,58724] 0 2023-12-07T16:21:42.588 INFO:tasks.workunit.client.1.smithi152.stdout:0/752: creat d0/d27/d8c/df7/d30/d6e/d77/f104 x:0 0 0 2023-12-07T16:21:42.590 INFO:tasks.workunit.client.1.smithi152.stdout:0/753: write d0/dc/d3d/d4c/fdd [14092,53585] 0 2023-12-07T16:21:42.592 INFO:tasks.workunit.client.1.smithi152.stdout:0/754: unlink d0/dc/d3d/l65 0 2023-12-07T16:21:42.600 INFO:tasks.workunit.client.1.smithi152.stdout:6/726: dwrite d2/d4f/d83/d85/d19/fba [0,4194304] 0 2023-12-07T16:21:42.601 INFO:tasks.workunit.client.1.smithi152.stdout:2/718: dwrite d2/d1c/d2e/d57/db1/d90/fac [0,4194304] 0 2023-12-07T16:21:42.604 INFO:tasks.workunit.client.1.smithi152.stdout:6/727: write d2/f3 [2549774,117892] 0 2023-12-07T16:21:42.604 INFO:tasks.workunit.client.0.smithi063.stdout:0/597: dwrite d4/d25/f9e [0,4194304] 0 2023-12-07T16:21:42.605 INFO:tasks.workunit.client.0.smithi063.stdout:0/598: getdents d4/dd/d26/d2b/d5e/d8e/d95/d68 0 2023-12-07T16:21:42.609 INFO:tasks.workunit.client.1.smithi152.stdout:7/700: dwrite db/d27/f7a [0,4194304] 0 2023-12-07T16:21:42.610 INFO:tasks.workunit.client.0.smithi063.stdout:2/644: dwrite d0/d21/d56/d11/d52/d63/d8c/f8f [0,4194304] 0 2023-12-07T16:21:42.610 INFO:tasks.workunit.client.0.smithi063.stdout:2/645: dread - d0/d21/f9e zero size 2023-12-07T16:21:42.610 INFO:tasks.workunit.client.0.smithi063.stdout:4/453: dwrite d1/d3/d3f/d49/d64/f74 [0,4194304] 0 2023-12-07T16:21:42.610 INFO:tasks.workunit.client.0.smithi063.stdout:2/646: fsync d0/d21/d56/d11/d52/d5d/dbb/fb1 0 2023-12-07T16:21:42.610 INFO:tasks.workunit.client.0.smithi063.stdout:2/647: dread - d0/d67/d5b/fd1 zero size 2023-12-07T16:21:42.610 INFO:tasks.workunit.client.0.smithi063.stdout:2/648: chown d0/d21/d56/d11/fb4 83668 1 2023-12-07T16:21:42.610 INFO:tasks.workunit.client.0.smithi063.stdout:8/700: dwrite d7/d14/d1a/fc8 [0,4194304] 0 2023-12-07T16:21:42.611 INFO:tasks.workunit.client.1.smithi152.stdout:2/719: unlink f1 0 2023-12-07T16:21:42.611 INFO:tasks.workunit.client.1.smithi152.stdout:2/720: chown d2/d9/d51/fea 42389022 1 2023-12-07T16:21:42.611 INFO:tasks.workunit.client.1.smithi152.stdout:2/721: readlink d2/d1c/d2e/d57/db1/d90/ldb 0 2023-12-07T16:21:42.611 INFO:tasks.workunit.client.1.smithi152.stdout:4/677: dwrite d0/d3/d6/d2b/d56/f70 [0,4194304] 0 2023-12-07T16:21:42.611 INFO:tasks.workunit.client.1.smithi152.stdout:4/678: chown d0/d3/d6/d36/d85/f74 67677 1 2023-12-07T16:21:42.612 INFO:tasks.workunit.client.1.smithi152.stdout:4/679: fsync d0/d3/d6/d2b/fa1 0 2023-12-07T16:21:42.612 INFO:tasks.workunit.client.1.smithi152.stdout:4/680: fsync d0/d17/f43 0 2023-12-07T16:21:42.612 INFO:tasks.workunit.client.1.smithi152.stdout:0/755: dwrite d0/f5 [0,4194304] 0 2023-12-07T16:21:42.612 INFO:tasks.workunit.client.0.smithi063.stdout:3/550: dwrite d7/d49/fb4 [0,4194304] 0 2023-12-07T16:21:42.612 INFO:tasks.workunit.client.0.smithi063.stdout:5/481: dwrite d1/d31/d56/d61/d5e/d6a/f8a [0,4194304] 0 2023-12-07T16:21:42.612 INFO:tasks.workunit.client.0.smithi063.stdout:3/551: getdents d7/d49/db0 0 2023-12-07T16:21:42.612 INFO:tasks.workunit.client.0.smithi063.stdout:0/599: write d4/dd/d26/d2b/d5e/d8e/f66 [1708120,57649] 0 2023-12-07T16:21:42.612 INFO:tasks.workunit.client.0.smithi063.stdout:0/600: readlink d4/dd/de/d15/d1f/l57 0 2023-12-07T16:21:42.613 INFO:tasks.workunit.client.0.smithi063.stdout:5/482: dread d1/d31/d56/d61/f43 [0,4194304] 0 2023-12-07T16:21:42.614 INFO:tasks.workunit.client.1.smithi152.stdout:6/728: mkdir d2/d4f/d83/d85/d9/deb 0 2023-12-07T16:21:42.616 INFO:tasks.workunit.client.0.smithi063.stdout:4/454: mkdir d1/d3/db/d2c/d63/d62/d86 0 2023-12-07T16:21:42.616 INFO:tasks.workunit.client.0.smithi063.stdout:9/479: rmdir d0 39 2023-12-07T16:21:42.619 INFO:tasks.workunit.client.0.smithi063.stdout:2/649: creat d0/d21/d56/fd5 x:0 0 0 2023-12-07T16:21:42.620 INFO:tasks.workunit.client.0.smithi063.stdout:6/615: sync 2023-12-07T16:21:42.624 INFO:tasks.workunit.client.0.smithi063.stdout:6/616: write d0/d1e/d60/d68/d69/d7d/f86 [3813244,12518] 0 2023-12-07T16:21:42.624 INFO:tasks.workunit.client.0.smithi063.stdout:6/617: truncate d0/d1e/d1d/d1f/d6c/f90 980824 0 2023-12-07T16:21:42.624 INFO:tasks.workunit.client.0.smithi063.stdout:8/701: symlink d7/d14/d15/db4/ldc 0 2023-12-07T16:21:42.624 INFO:tasks.workunit.client.0.smithi063.stdout:8/702: chown d7/d14/d1a/f5c 11 1 2023-12-07T16:21:42.624 INFO:tasks.workunit.client.0.smithi063.stdout:8/703: write f5 [653282,65278] 0 2023-12-07T16:21:42.624 INFO:tasks.workunit.client.0.smithi063.stdout:8/704: write d7/d14/f9e [933753,17151] 0 2023-12-07T16:21:42.628 INFO:tasks.workunit.client.1.smithi152.stdout:7/701: creat db/d27/d39/fe1 x:0 0 0 2023-12-07T16:21:42.629 INFO:tasks.workunit.client.1.smithi152.stdout:2/722: getdents d2/d1c/d2e/d57/d5b 0 2023-12-07T16:21:42.629 INFO:tasks.workunit.client.1.smithi152.stdout:2/723: write d2/d1c/d2e/d57/d5b/f95 [374182,27180] 0 2023-12-07T16:21:42.630 INFO:tasks.workunit.client.1.smithi152.stdout:7/702: read db/d27/f3d [1546022,116633] 0 2023-12-07T16:21:42.631 INFO:tasks.workunit.client.0.smithi063.stdout:3/552: creat d7/d4f/d53/d54/d76/fb7 x:0 0 0 2023-12-07T16:21:42.631 INFO:tasks.workunit.client.0.smithi063.stdout:3/553: truncate d7/d9/f88 851933 0 2023-12-07T16:21:42.633 INFO:tasks.workunit.client.0.smithi063.stdout:4/455: symlink d1/d3/d3f/l87 0 2023-12-07T16:21:42.633 INFO:tasks.workunit.client.0.smithi063.stdout:4/456: fsync d1/d3/f68 0 2023-12-07T16:21:42.634 INFO:tasks.workunit.client.1.smithi152.stdout:4/681: rename d0/d3/d6/dc/d3a/d46/d80/l99 to d0/d3/d6/d36/lc7 0 2023-12-07T16:21:42.635 INFO:tasks.workunit.client.1.smithi152.stdout:0/756: creat d0/dc/d36/d3a/d51/d82/f105 x:0 0 0 2023-12-07T16:21:42.635 INFO:tasks.workunit.client.0.smithi063.stdout:9/480: mkdir d0/d13/d6f/d9b 0 2023-12-07T16:21:42.635 INFO:tasks.workunit.client.1.smithi152.stdout:6/729: truncate d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/f8c 190538 0 2023-12-07T16:21:42.637 INFO:tasks.workunit.client.0.smithi063.stdout:2/650: rename d0/d67/d5b/c7b to d0/d21/d56/d11/d52/d63/d8c/cd6 0 2023-12-07T16:21:42.638 INFO:tasks.workunit.client.1.smithi152.stdout:7/703: creat db/d27/d39/fe2 x:0 0 0 2023-12-07T16:21:42.638 INFO:tasks.workunit.client.1.smithi152.stdout:7/704: fsync db/d27/d39/d63/fc1 0 2023-12-07T16:21:42.638 INFO:tasks.workunit.client.1.smithi152.stdout:7/705: write db/d27/d39/f2f [4409562,98313] 0 2023-12-07T16:21:42.638 INFO:tasks.workunit.client.1.smithi152.stdout:7/706: chown db/l19 121 1 2023-12-07T16:21:42.639 INFO:tasks.workunit.client.1.smithi152.stdout:4/682: truncate d0/d3/d6/dc/d39/f92 2736382 0 2023-12-07T16:21:42.639 INFO:tasks.workunit.client.0.smithi063.stdout:6/618: symlink d0/d17/d95/dd6/lde 0 2023-12-07T16:21:42.639 INFO:tasks.workunit.client.0.smithi063.stdout:6/619: chown d0/d54/f56 1672747 1 2023-12-07T16:21:42.640 INFO:tasks.workunit.client.1.smithi152.stdout:0/757: creat d0/dc/d3d/d73/dbf/f106 x:0 0 0 2023-12-07T16:21:42.641 INFO:tasks.workunit.client.1.smithi152.stdout:2/724: creat d2/d1c/d2e/d57/d5b/da7/ddd/ff9 x:0 0 0 2023-12-07T16:21:42.641 INFO:tasks.workunit.client.0.smithi063.stdout:8/705: link d7/d14/f9e d7/d14/d1a/dce/fdd 0 2023-12-07T16:21:42.644 INFO:tasks.workunit.client.0.smithi063.stdout:3/554: getdents d7/d4f/d53/d72/db1 0 2023-12-07T16:21:42.644 INFO:tasks.workunit.client.0.smithi063.stdout:3/555: fsync d7/d4f/d53/d72/d7d/f85 0 2023-12-07T16:21:42.644 INFO:tasks.workunit.client.0.smithi063.stdout:3/556: fsync d7/d4f/d53/f6a 0 2023-12-07T16:21:42.645 INFO:tasks.workunit.client.1.smithi152.stdout:7/707: rename db/d1c/l26 to db/d27/d39/d63/le3 0 2023-12-07T16:21:42.646 INFO:tasks.workunit.client.1.smithi152.stdout:4/683: truncate d0/d3/f6d 1750224 0 2023-12-07T16:21:42.648 INFO:tasks.workunit.client.1.smithi152.stdout:0/758: creat d0/d27/dd7/f107 x:0 0 0 2023-12-07T16:21:42.648 INFO:tasks.workunit.client.1.smithi152.stdout:0/759: read - d0/d27/f9b zero size 2023-12-07T16:21:42.648 INFO:tasks.workunit.client.1.smithi152.stdout:0/760: chown d0/d27/d11/cbd 260648945 1 2023-12-07T16:21:42.648 INFO:tasks.workunit.client.1.smithi152.stdout:0/761: fsync d0/f9 0 2023-12-07T16:21:42.648 INFO:tasks.workunit.client.0.smithi063.stdout:0/601: dwrite d4/d25/f2f [0,4194304] 0 2023-12-07T16:21:42.648 INFO:tasks.workunit.client.0.smithi063.stdout:5/483: dwrite d1/d3/de/d1e/f47 [0,4194304] 0 2023-12-07T16:21:42.648 INFO:tasks.workunit.client.0.smithi063.stdout:5/484: fdatasync d1/d3/de/d1e/d6b/f7d 0 2023-12-07T16:21:42.648 INFO:tasks.workunit.client.0.smithi063.stdout:2/651: mknod d0/d21/db2/cd7 0 2023-12-07T16:21:42.652 INFO:tasks.workunit.client.1.smithi152.stdout:4/684: getdents d0/d3/d6/dc 0 2023-12-07T16:21:42.652 INFO:tasks.workunit.client.1.smithi152.stdout:7/708: mkdir db/d27/d39/d41/d58/d80/de4 0 2023-12-07T16:21:42.654 INFO:tasks.workunit.client.1.smithi152.stdout:6/730: dread d2/d4f/d83/d48/d70/d81/fe8 [0,4194304] 0 2023-12-07T16:21:42.654 INFO:tasks.workunit.client.1.smithi152.stdout:6/731: write d2/d4f/d83/d85/f74 [717100,10662] 0 2023-12-07T16:21:42.655 INFO:tasks.workunit.client.0.smithi063.stdout:8/706: rename d7/d14/d15/d2b/d40 to d7/d14/d15/dde 0 2023-12-07T16:21:42.655 INFO:tasks.workunit.client.1.smithi152.stdout:0/762: creat d0/dc/d3d/d73/dbf/f108 x:0 0 0 2023-12-07T16:21:42.655 INFO:tasks.workunit.client.1.smithi152.stdout:4/685: symlink d0/d3/d6/dc/db7/lc8 0 2023-12-07T16:21:42.657 INFO:tasks.workunit.client.0.smithi063.stdout:3/557: truncate d7/d9/d1b/f38 4654120 0 2023-12-07T16:21:42.658 INFO:tasks.workunit.client.1.smithi152.stdout:0/763: creat d0/dc/d3d/dab/dc8/f109 x:0 0 0 2023-12-07T16:21:42.660 INFO:tasks.workunit.client.0.smithi063.stdout:2/652: dread d0/f10 [0,4194304] 0 2023-12-07T16:21:42.660 INFO:tasks.workunit.client.0.smithi063.stdout:2/653: write d0/d21/fc3 [452997,60146] 0 2023-12-07T16:21:42.660 INFO:tasks.workunit.client.0.smithi063.stdout:2/654: chown d0/d21/f45 6 1 2023-12-07T16:21:42.664 INFO:tasks.workunit.client.0.smithi063.stdout:4/457: dwrite d1/d3/db/d2c/d63/d62/f7e [0,4194304] 0 2023-12-07T16:21:42.665 INFO:tasks.workunit.client.0.smithi063.stdout:0/602: rmdir d4/dd/de/d15/d1f/d4c 39 2023-12-07T16:21:42.665 INFO:tasks.workunit.client.0.smithi063.stdout:0/603: write d4/dd/d26/d2b/d5e/f64 [187714,81137] 0 2023-12-07T16:21:42.665 INFO:tasks.workunit.client.0.smithi063.stdout:0/604: readlink d4/dd/de/d15/d1f/d22/l9a 0 2023-12-07T16:21:42.666 INFO:tasks.workunit.client.1.smithi152.stdout:0/764: write d0/dc/d36/d3a/d51/d82/dae/fce [1137193,40907] 0 2023-12-07T16:21:42.666 INFO:tasks.workunit.client.0.smithi063.stdout:5/485: rmdir d1/d31/d56/d61/d5e/d6a 39 2023-12-07T16:21:42.669 INFO:tasks.workunit.client.0.smithi063.stdout:6/620: truncate d0/f15 605295 0 2023-12-07T16:21:42.669 INFO:tasks.workunit.client.0.smithi063.stdout:6/621: write d0/d1e/d1d/d1f/f28 [4252681,107370] 0 2023-12-07T16:21:42.671 INFO:tasks.workunit.client.1.smithi152.stdout:4/686: write d0/daa/f42 [45869,9777] 0 2023-12-07T16:21:42.672 INFO:tasks.workunit.client.0.smithi063.stdout:8/707: rmdir d7/d14/d15/d48/daa 0 2023-12-07T16:21:42.673 INFO:tasks.workunit.client.1.smithi152.stdout:0/765: mknod d0/d27/de6/c10a 0 2023-12-07T16:21:42.673 INFO:tasks.workunit.client.1.smithi152.stdout:0/766: chown d0/dc/f3c 4020148 1 2023-12-07T16:21:42.676 INFO:tasks.workunit.client.0.smithi063.stdout:3/558: mkdir d7/d9/d1b/db8 0 2023-12-07T16:21:42.676 INFO:tasks.workunit.client.0.smithi063.stdout:3/559: fsync d7/d9/dd/f66 0 2023-12-07T16:21:42.676 INFO:tasks.workunit.client.0.smithi063.stdout:2/655: creat d0/d21/d56/d11/d6d/fd8 x:0 0 0 2023-12-07T16:21:42.678 INFO:tasks.workunit.client.1.smithi152.stdout:0/767: creat d0/d27/de6/f10b x:0 0 0 2023-12-07T16:21:42.679 INFO:tasks.workunit.client.1.smithi152.stdout:4/687: write d0/d3/d6/d2b/d56/f98 [1093483,44347] 0 2023-12-07T16:21:42.680 INFO:tasks.workunit.client.1.smithi152.stdout:4/688: mknod d0/d3/d6/d2b/d56/cc9 0 2023-12-07T16:21:42.680 INFO:tasks.workunit.client.1.smithi152.stdout:4/689: dread - d0/d17/d7f/fa9 zero size 2023-12-07T16:21:42.682 INFO:tasks.workunit.client.1.smithi152.stdout:4/690: creat d0/d3/d6/d2b/d56/fca x:0 0 0 2023-12-07T16:21:42.682 INFO:tasks.workunit.client.1.smithi152.stdout:4/691: fsync d0/d3/d6/f1d 0 2023-12-07T16:21:42.683 INFO:tasks.workunit.client.1.smithi152.stdout:0/768: write d0/f2e [696448,30004] 0 2023-12-07T16:21:42.683 INFO:tasks.workunit.client.1.smithi152.stdout:0/769: write d0/d27/d8c/df7/d30/d6e/d77/f88 [1307069,124986] 0 2023-12-07T16:21:42.683 INFO:tasks.workunit.client.1.smithi152.stdout:2/725: dwrite d2/d1c/d2e/d30/fc2 [0,4194304] 0 2023-12-07T16:21:42.687 INFO:tasks.workunit.client.0.smithi063.stdout:9/481: dwrite d0/f99 [0,4194304] 0 2023-12-07T16:21:42.688 INFO:tasks.workunit.client.0.smithi063.stdout:0/605: rename d4/dd/l48 to d4/dd/d26/d2b/db5/d5b/d63/d6b/lc9 0 2023-12-07T16:21:42.688 INFO:tasks.workunit.client.0.smithi063.stdout:6/622: mkdir d0/d1e/d20/d4a/ddf 0 2023-12-07T16:21:42.688 INFO:tasks.workunit.client.0.smithi063.stdout:8/708: mknod d7/d14/d15/cdf 0 2023-12-07T16:21:42.688 INFO:tasks.workunit.client.0.smithi063.stdout:3/560: mkdir d7/d9/d1b/db8/db9 0 2023-12-07T16:21:42.688 INFO:tasks.workunit.client.0.smithi063.stdout:2/656: symlink d0/d21/db2/dce/ld9 0 2023-12-07T16:21:42.694 INFO:tasks.workunit.client.0.smithi063.stdout:9/482: symlink d0/d13/d39/l9c 0 2023-12-07T16:21:42.694 INFO:tasks.workunit.client.0.smithi063.stdout:9/483: write d0/d7/f6d [947998,13734] 0 2023-12-07T16:21:42.695 INFO:tasks.workunit.client.0.smithi063.stdout:0/606: rename d4/dd/de/d15/d1f/d22/l9a to d4/dd/d26/d2b/db5/d5b/d63/d9b/lca 0 2023-12-07T16:21:42.696 INFO:tasks.workunit.client.0.smithi063.stdout:0/607: chown d4/dd/de/d15/d59 12296720 1 2023-12-07T16:21:42.696 INFO:tasks.workunit.client.1.smithi152.stdout:6/732: dwrite d2/d4f/d83/d85/d19/d1f/d60/fcf [0,4194304] 0 2023-12-07T16:21:42.696 INFO:tasks.workunit.client.1.smithi152.stdout:4/692: dread d0/d3/fbe [0,4194304] 0 2023-12-07T16:21:42.697 INFO:tasks.workunit.client.0.smithi063.stdout:8/709: creat d7/d14/d4e/fe0 x:0 0 0 2023-12-07T16:21:42.697 INFO:tasks.workunit.client.0.smithi063.stdout:9/484: read d0/d13/d39/d42/f50 [1349960,81121] 0 2023-12-07T16:21:42.697 INFO:tasks.workunit.client.0.smithi063.stdout:9/485: readlink d0/d7/l20 0 2023-12-07T16:21:42.698 INFO:tasks.workunit.client.1.smithi152.stdout:6/733: rmdir d2/d4f/d83/d85/d19/d1f/d60 39 2023-12-07T16:21:42.699 INFO:tasks.workunit.client.0.smithi063.stdout:8/710: dread d7/d14/d1a/f50 [0,4194304] 0 2023-12-07T16:21:42.699 INFO:tasks.workunit.client.1.smithi152.stdout:4/693: link d0/c16 d0/d3/d6/d36/d85/ccb 0 2023-12-07T16:21:42.700 INFO:tasks.workunit.client.0.smithi063.stdout:6/623: link d0/d1e/d60/d68/d76/fcb d0/d1e/d60/d68/d76/dae/fe0 0 2023-12-07T16:21:42.701 INFO:tasks.workunit.client.1.smithi152.stdout:0/770: dread d0/d27/d11/f72 [0,4194304] 0 2023-12-07T16:21:42.701 INFO:tasks.workunit.client.1.smithi152.stdout:4/694: rename d0/d3/d6/d36/d85/f94 to d0/d17/fcc 0 2023-12-07T16:21:42.702 INFO:tasks.workunit.client.0.smithi063.stdout:9/486: creat d0/d13/d39/d42/f9d x:0 0 0 2023-12-07T16:21:42.703 INFO:tasks.workunit.client.0.smithi063.stdout:6/624: mknod d0/d17/d95/dd6/d5a/d9d/ce1 0 2023-12-07T16:21:42.704 INFO:tasks.workunit.client.0.smithi063.stdout:3/561: dread d7/d4f/d53/d72/db1/d41/f86 [0,4194304] 0 2023-12-07T16:21:42.704 INFO:tasks.workunit.client.1.smithi152.stdout:4/695: fsync d0/d3/d6/dc/d39/d93/f6c 0 2023-12-07T16:21:42.704 INFO:tasks.workunit.client.1.smithi152.stdout:7/709: dwrite db/d27/d39/d41/d37/fdc [0,4194304] 0 2023-12-07T16:21:42.705 INFO:tasks.workunit.client.1.smithi152.stdout:0/771: unlink d0/dc/d3d/d4c/ff8 0 2023-12-07T16:21:42.705 INFO:tasks.workunit.client.0.smithi063.stdout:9/487: rename d0/d21/d64/d6a/f96 to d0/d7/f9e 0 2023-12-07T16:21:42.707 INFO:tasks.workunit.client.1.smithi152.stdout:7/710: read db/d1c/f51 [720041,83989] 0 2023-12-07T16:21:42.707 INFO:tasks.workunit.client.1.smithi152.stdout:7/711: chown db/d27/d39/d41/c9c 44 1 2023-12-07T16:21:42.707 INFO:tasks.workunit.client.0.smithi063.stdout:4/458: dwrite d1/d3/d3f/d44/f6c [4194304,4194304] 0 2023-12-07T16:21:42.707 INFO:tasks.workunit.client.0.smithi063.stdout:4/459: fdatasync d1/d3/d3f/d44/f4c 0 2023-12-07T16:21:42.707 INFO:tasks.workunit.client.0.smithi063.stdout:4/460: stat d1/d3/db/cf 0 2023-12-07T16:21:42.708 INFO:tasks.workunit.client.0.smithi063.stdout:9/488: symlink d0/d13/d95/l9f 0 2023-12-07T16:21:42.708 INFO:tasks.workunit.client.0.smithi063.stdout:9/489: readlink d0/d13/d39/d3a/d78/l80 0 2023-12-07T16:21:42.709 INFO:tasks.workunit.client.0.smithi063.stdout:3/562: read d7/d4f/d53/d72/db1/f3d [340345,112869] 0 2023-12-07T16:21:42.709 INFO:tasks.workunit.client.0.smithi063.stdout:3/563: truncate d7/d9/dd/d56/f8c 854357 0 2023-12-07T16:21:42.712 INFO:tasks.workunit.client.1.smithi152.stdout:4/696: dread d0/d3/d6/f8a [0,4194304] 0 2023-12-07T16:21:42.712 INFO:tasks.workunit.client.1.smithi152.stdout:7/712: rename db/d27/d39/d63/f70 to db/d27/d39/d41/d58/fe5 0 2023-12-07T16:21:42.712 INFO:tasks.workunit.client.1.smithi152.stdout:0/772: symlink d0/dc/d36/d3a/d51/l10c 0 2023-12-07T16:21:42.712 INFO:tasks.workunit.client.0.smithi063.stdout:8/711: dread d7/d14/d15/d48/f58 [0,4194304] 0 2023-12-07T16:21:42.713 INFO:tasks.workunit.client.0.smithi063.stdout:9/490: creat d0/d8d/fa0 x:0 0 0 2023-12-07T16:21:42.714 INFO:tasks.workunit.client.0.smithi063.stdout:3/564: creat d7/d8d/fba x:0 0 0 2023-12-07T16:21:42.714 INFO:tasks.workunit.client.1.smithi152.stdout:4/697: getdents d0/d3/d6/dc/d22 0 2023-12-07T16:21:42.714 INFO:tasks.workunit.client.0.smithi063.stdout:6/625: write d0/d17/d46/f55 [1546128,10008] 0 2023-12-07T16:21:42.715 INFO:tasks.workunit.client.1.smithi152.stdout:0/773: link d0/c15 d0/dc/d3d/dab/c10d 0 2023-12-07T16:21:42.715 INFO:tasks.workunit.client.1.smithi152.stdout:0/774: chown d0/dc/d36/d3a 3326 1 2023-12-07T16:21:42.716 INFO:tasks.workunit.client.1.smithi152.stdout:6/734: dread d2/d4f/d83/d48/d70/d81/fdf [0,4194304] 0 2023-12-07T16:21:42.716 INFO:tasks.workunit.client.1.smithi152.stdout:6/735: stat d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/lcb 0 2023-12-07T16:21:42.716 INFO:tasks.workunit.client.0.smithi063.stdout:9/491: truncate d0/d21/f71 197249 0 2023-12-07T16:21:42.717 INFO:tasks.workunit.client.1.smithi152.stdout:4/698: mknod d0/d3/d6/ccd 0 2023-12-07T16:21:42.717 INFO:tasks.workunit.client.1.smithi152.stdout:4/699: fdatasync d0/d3/f7 0 2023-12-07T16:21:42.719 INFO:tasks.workunit.client.0.smithi063.stdout:8/712: creat d7/d14/d15/dac/dad/fe1 x:0 0 0 2023-12-07T16:21:42.721 INFO:tasks.workunit.client.1.smithi152.stdout:4/700: link d0/d3/d6/dc/d3a/d46/d4e/c7d d0/d3/d6/dc/cce 0 2023-12-07T16:21:42.722 INFO:tasks.workunit.client.0.smithi063.stdout:3/565: creat d7/d9/dd/fbb x:0 0 0 2023-12-07T16:21:42.723 INFO:tasks.workunit.client.0.smithi063.stdout:5/486: dwrite d1/d3/de/d1e/f47 [0,4194304] 0 2023-12-07T16:21:42.724 INFO:tasks.workunit.client.1.smithi152.stdout:6/736: mkdir d2/d4f/d83/d85/d94/dec 0 2023-12-07T16:21:42.724 INFO:tasks.workunit.client.1.smithi152.stdout:4/701: read d0/d3/d6/dc/d22/f4d [3569218,93009] 0 2023-12-07T16:21:42.725 INFO:tasks.workunit.client.0.smithi063.stdout:6/626: symlink d0/d1e/d60/d68/d78/d9c/d9f/db8/le2 0 2023-12-07T16:21:42.725 INFO:tasks.workunit.client.0.smithi063.stdout:9/492: unlink d0/d21/d64/d6a/d8f/f97 0 2023-12-07T16:21:42.727 INFO:tasks.workunit.client.0.smithi063.stdout:8/713: rename d7/d14/d15/dac/dad/fe1 to d7/d14/d15/d2b/fe2 0 2023-12-07T16:21:42.727 INFO:tasks.workunit.client.0.smithi063.stdout:8/714: readlink d7/d14/d15/d48/la2 0 2023-12-07T16:21:42.727 INFO:tasks.workunit.client.1.smithi152.stdout:2/726: dwrite d2/d1c/d2e/d30/d33/f40 [0,4194304] 0 2023-12-07T16:21:42.727 INFO:tasks.workunit.client.1.smithi152.stdout:2/727: chown d2/d1c/d2e/d30/c62 7908 1 2023-12-07T16:21:42.728 INFO:tasks.workunit.client.1.smithi152.stdout:2/728: fsync d2/d1c/d52/f99 0 2023-12-07T16:21:42.728 INFO:tasks.workunit.client.1.smithi152.stdout:2/729: truncate d2/d1c/d52/f9d 112480 0 2023-12-07T16:21:42.728 INFO:tasks.workunit.client.1.smithi152.stdout:6/737: mkdir d2/d4f/d83/d48/d70/d81/ded 0 2023-12-07T16:21:42.728 INFO:tasks.workunit.client.1.smithi152.stdout:6/738: write d2/d4f/f9a [331679,15540] 0 2023-12-07T16:21:42.728 INFO:tasks.workunit.client.0.smithi063.stdout:2/657: dwrite d0/d21/d39/fcf [0,4194304] 0 2023-12-07T16:21:42.729 INFO:tasks.workunit.client.0.smithi063.stdout:2/658: chown d0/f14 80 1 2023-12-07T16:21:42.729 INFO:tasks.workunit.client.0.smithi063.stdout:2/659: truncate d0/d67/d5b/fd1 314365 0 2023-12-07T16:21:42.730 INFO:tasks.workunit.client.0.smithi063.stdout:5/487: truncate d1/d31/d56/f6f 1634659 0 2023-12-07T16:21:42.734 INFO:tasks.workunit.client.0.smithi063.stdout:3/566: write d7/fc [5879402,72179] 0 2023-12-07T16:21:42.734 INFO:tasks.workunit.client.0.smithi063.stdout:0/608: dwrite d4/f17 [4194304,4194304] 0 2023-12-07T16:21:42.734 INFO:tasks.workunit.client.0.smithi063.stdout:0/609: stat d4/dd/d26/d2b/db5/d5b/d63/ca3 0 2023-12-07T16:21:42.734 INFO:tasks.workunit.client.0.smithi063.stdout:3/567: write d7/d9/dd/d7f/fb2 [851480,124670] 0 2023-12-07T16:21:42.734 INFO:tasks.workunit.client.0.smithi063.stdout:3/568: fdatasync d7/d9/f9e 0 2023-12-07T16:21:42.734 INFO:tasks.workunit.client.0.smithi063.stdout:2/660: read d0/d21/d56/d11/f1b [614895,33192] 0 2023-12-07T16:21:42.734 INFO:tasks.workunit.client.0.smithi063.stdout:2/661: truncate d0/d21/d56/d11/d52/d63/fd4 5988 0 2023-12-07T16:21:42.734 INFO:tasks.workunit.client.1.smithi152.stdout:2/730: getdents d2 0 2023-12-07T16:21:42.735 INFO:tasks.workunit.client.1.smithi152.stdout:4/702: getdents d0/d81 0 2023-12-07T16:21:42.736 INFO:tasks.workunit.client.0.smithi063.stdout:5/488: write d1/d3/de/d1e/d25/f3c [565714,55644] 0 2023-12-07T16:21:42.738 INFO:tasks.workunit.client.0.smithi063.stdout:2/662: write d0/d21/d56/d71/fa0 [131684,86174] 0 2023-12-07T16:21:42.738 INFO:tasks.workunit.client.0.smithi063.stdout:2/663: dread - d0/d21/d56/d11/d52/da9/dbe/f97 zero size 2023-12-07T16:21:42.738 INFO:tasks.workunit.client.0.smithi063.stdout:2/664: dread - d0/d21/f9e zero size 2023-12-07T16:21:42.740 INFO:tasks.workunit.client.0.smithi063.stdout:6/627: mknod d0/d17/d95/dd6/ce3 0 2023-12-07T16:21:42.740 INFO:tasks.workunit.client.0.smithi063.stdout:6/628: chown d0/d1e/d1d/d1f 191 1 2023-12-07T16:21:42.740 INFO:tasks.workunit.client.0.smithi063.stdout:9/493: mknod d0/d21/ca1 0 2023-12-07T16:21:42.742 INFO:tasks.workunit.client.0.smithi063.stdout:8/715: dread d7/d14/d15/f18 [0,4194304] 0 2023-12-07T16:21:42.750 INFO:tasks.workunit.client.0.smithi063.stdout:3/569: creat d7/d4f/d53/d72/d7d/fbc x:0 0 0 2023-12-07T16:21:42.750 INFO:tasks.workunit.client.0.smithi063.stdout:0/610: mknod d4/dd/de/d15/d1f/d22/ccb 0 2023-12-07T16:21:42.750 INFO:tasks.workunit.client.1.smithi152.stdout:7/713: dwrite db/d27/d39/d41/d37/f67 [0,4194304] 0 2023-12-07T16:21:42.751 INFO:tasks.workunit.client.0.smithi063.stdout:4/461: dwrite d1/d3/f1e [4194304,4194304] 0 2023-12-07T16:21:42.751 INFO:tasks.workunit.client.1.smithi152.stdout:8/768: sync 2023-12-07T16:21:42.753 INFO:tasks.workunit.client.0.smithi063.stdout:2/665: getdents d0/d21/d56/d11/d52/d63 0 2023-12-07T16:21:42.753 INFO:tasks.workunit.client.0.smithi063.stdout:2/666: truncate d0/d21/d56/d11/d52/d5d/dbb/f7c 648458 0 2023-12-07T16:21:42.753 INFO:tasks.workunit.client.1.smithi152.stdout:7/714: truncate db/d27/f6e 545558 0 2023-12-07T16:21:42.753 INFO:tasks.workunit.client.1.smithi152.stdout:7/715: chown db/d27/d39/d41/d58/da5/fca 0 1 2023-12-07T16:21:42.754 INFO:tasks.workunit.client.0.smithi063.stdout:3/570: dread d7/d49/d4b/f7a [0,4194304] 0 2023-12-07T16:21:42.754 INFO:tasks.workunit.client.0.smithi063.stdout:3/571: write d7/d4f/d53/d72/d7d/fbc [1017526,103607] 0 2023-12-07T16:21:42.754 INFO:tasks.workunit.client.0.smithi063.stdout:3/572: truncate d7/d49/d4b/f5e 2219856 0 2023-12-07T16:21:42.754 INFO:tasks.workunit.client.0.smithi063.stdout:6/629: rmdir d0/d17/d95/dd6 39 2023-12-07T16:21:42.755 INFO:tasks.workunit.client.1.smithi152.stdout:8/769: creat d3/d4/d9/d23/f117 x:0 0 0 2023-12-07T16:21:42.758 INFO:tasks.workunit.client.1.smithi152.stdout:7/716: creat db/d1c/dd0/fe6 x:0 0 0 2023-12-07T16:21:42.762 INFO:tasks.workunit.client.1.smithi152.stdout:3/780: sync 2023-12-07T16:21:42.762 INFO:tasks.workunit.client.1.smithi152.stdout:9/842: sync 2023-12-07T16:21:42.762 INFO:tasks.workunit.client.1.smithi152.stdout:1/937: sync 2023-12-07T16:21:42.762 INFO:tasks.workunit.client.1.smithi152.stdout:1/938: write dc/def/f134 [650134,41008] 0 2023-12-07T16:21:42.762 INFO:tasks.workunit.client.1.smithi152.stdout:1/939: chown dc/d14/d18/d2d/d48/da3/d58/dde 264731469 1 2023-12-07T16:21:42.762 INFO:tasks.workunit.client.1.smithi152.stdout:1/940: fdatasync dc/d14/d18/d79/fa1 0 2023-12-07T16:21:42.762 INFO:tasks.workunit.client.1.smithi152.stdout:5/900: sync 2023-12-07T16:21:42.762 INFO:tasks.workunit.client.1.smithi152.stdout:5/901: dread - dd/de/d14/d67/f78 zero size 2023-12-07T16:21:42.763 INFO:tasks.workunit.client.1.smithi152.stdout:3/781: link d7/d10/d19/f4a d7/d10/d1a/d2f/d56/d57/dee/dda/ff4 0 2023-12-07T16:21:42.764 INFO:tasks.workunit.client.0.smithi063.stdout:0/611: mkdir d4/dd/d26/d2b/db5/d5b/d63/d74/d84/dcc 0 2023-12-07T16:21:42.764 INFO:tasks.workunit.client.0.smithi063.stdout:5/489: symlink d1/d3/de/d1e/l93 0 2023-12-07T16:21:42.764 INFO:tasks.workunit.client.0.smithi063.stdout:5/490: chown d1/f5c 5 1 2023-12-07T16:21:42.765 INFO:tasks.workunit.client.0.smithi063.stdout:9/494: creat d0/d21/d64/d6a/d8f/fa2 x:0 0 0 2023-12-07T16:21:42.765 INFO:tasks.workunit.client.1.smithi152.stdout:1/941: truncate dc/d14/d18/d2d/d48/da3/f77 4554161 0 2023-12-07T16:21:42.768 INFO:tasks.workunit.client.1.smithi152.stdout:1/942: unlink dc/d14/d18/d45/d74/cc4 0 2023-12-07T16:21:42.768 INFO:tasks.workunit.client.1.smithi152.stdout:9/843: write d1/d17/d3c/d4a/d48/f91 [2449467,22582] 0 2023-12-07T16:21:42.770 INFO:tasks.workunit.client.1.smithi152.stdout:1/943: creat dc/d28/d4e/de8/f138 x:0 0 0 2023-12-07T16:21:42.776 INFO:tasks.workunit.client.0.smithi063.stdout:2/667: link d0/d67/f55 d0/d21/d56/d11/d52/d5d/dbb/fda 0 2023-12-07T16:21:42.776 INFO:tasks.workunit.client.0.smithi063.stdout:6/630: mkdir d0/d1e/d60/d68/d78/d9c/d9f/de4 0 2023-12-07T16:21:42.776 INFO:tasks.workunit.client.0.smithi063.stdout:6/631: chown d0/d54/f5f 1743 1 2023-12-07T16:21:42.780 INFO:tasks.workunit.client.0.smithi063.stdout:0/612: mkdir d4/dd/d26/d2b/db5/d5b/d63/d6b/da8/dcd 0 2023-12-07T16:21:42.781 INFO:tasks.workunit.client.0.smithi063.stdout:5/491: stat d1/d3/de/c4b 0 2023-12-07T16:21:42.781 INFO:tasks.workunit.client.0.smithi063.stdout:5/492: truncate d1/d31/d56/d61/f64 994633 0 2023-12-07T16:21:42.781 INFO:tasks.workunit.client.0.smithi063.stdout:5/493: stat d1/d3/de/d1e/f78 0 2023-12-07T16:21:42.782 INFO:tasks.workunit.client.0.smithi063.stdout:9/495: symlink d0/d13/d6f/la3 0 2023-12-07T16:21:42.783 INFO:tasks.workunit.client.0.smithi063.stdout:9/496: write d0/d21/d64/d6a/d8f/fa2 [282526,112965] 0 2023-12-07T16:21:42.784 INFO:tasks.workunit.client.0.smithi063.stdout:6/632: getdents d0/d1e 0 2023-12-07T16:21:42.788 INFO:tasks.workunit.client.0.smithi063.stdout:5/494: write d1/d3/de/f1f [5187065,70824] 0 2023-12-07T16:21:42.788 INFO:tasks.workunit.client.0.smithi063.stdout:5/495: dread - d1/d31/d56/d61/d5e/f92 zero size 2023-12-07T16:21:42.789 INFO:tasks.workunit.client.0.smithi063.stdout:5/496: fsync d1/d3/de/d1e/f1d 0 2023-12-07T16:21:42.790 INFO:tasks.workunit.client.0.smithi063.stdout:6/633: write d0/d1e/d60/d68/d69/d7d/f80 [3619891,66334] 0 2023-12-07T16:21:42.792 INFO:tasks.workunit.client.0.smithi063.stdout:5/497: rename d1/d31/d56/d61/d5e/c81 to d1/d31/d56/d61/d5e/d6a/d7e/c94 0 2023-12-07T16:21:42.794 INFO:tasks.workunit.client.0.smithi063.stdout:6/634: mknod d0/d79/db9/ce5 0 2023-12-07T16:21:42.794 INFO:tasks.workunit.client.0.smithi063.stdout:6/635: dread - d0/d17/d95/dd6/d5a/fc0 zero size 2023-12-07T16:21:42.797 INFO:tasks.workunit.client.0.smithi063.stdout:5/498: unlink d1/d31/d56/d61/d5e/f92 0 2023-12-07T16:21:42.797 INFO:tasks.workunit.client.0.smithi063.stdout:5/499: readlink d1/d3/d3a/l8b 0 2023-12-07T16:21:42.798 INFO:tasks.workunit.client.1.smithi152.stdout:3/782: dread d7/d10/d1a/d2f/f22 [0,4194304] 0 2023-12-07T16:21:42.800 INFO:tasks.workunit.client.0.smithi063.stdout:5/500: symlink d1/d3/de/d1e/l95 0 2023-12-07T16:21:42.802 INFO:tasks.workunit.client.0.smithi063.stdout:5/501: symlink d1/d3/de/l96 0 2023-12-07T16:21:42.803 INFO:tasks.workunit.client.0.smithi063.stdout:9/497: dread d0/d13/f2b [0,4194304] 0 2023-12-07T16:21:42.805 INFO:tasks.workunit.client.0.smithi063.stdout:5/502: creat d1/d3/d3a/f97 x:0 0 0 2023-12-07T16:21:42.805 INFO:tasks.workunit.client.0.smithi063.stdout:9/498: truncate d0/d13/d39/d3a/f4d 2896610 0 2023-12-07T16:21:42.805 INFO:tasks.workunit.client.0.smithi063.stdout:9/499: write d0/f56 [653258,124387] 0 2023-12-07T16:21:42.805 INFO:tasks.workunit.client.0.smithi063.stdout:9/500: truncate d0/f99 4756697 0 2023-12-07T16:21:42.808 INFO:tasks.workunit.client.0.smithi063.stdout:8/716: dwrite d7/d14/d1a/dce/fbc [0,4194304] 0 2023-12-07T16:21:42.808 INFO:tasks.workunit.client.0.smithi063.stdout:1/406: sync 2023-12-07T16:21:42.808 INFO:tasks.workunit.client.0.smithi063.stdout:8/717: readlink d7/d38/d8e/l9d 0 2023-12-07T16:21:42.808 INFO:tasks.workunit.client.0.smithi063.stdout:1/407: truncate d0/dd/d19/d50/d71/f5a 295003 0 2023-12-07T16:21:42.808 INFO:tasks.workunit.client.0.smithi063.stdout:9/501: rename d0/d7 to d0/d21/d64/d6a/d85/da4 0 2023-12-07T16:21:42.810 INFO:tasks.workunit.client.1.smithi152.stdout:0/775: dwrite d0/d27/f59 [0,4194304] 0 2023-12-07T16:21:42.815 INFO:tasks.workunit.client.1.smithi152.stdout:0/776: mknod d0/d27/d11/d68/c10e 0 2023-12-07T16:21:42.815 INFO:tasks.workunit.client.1.smithi152.stdout:0/777: read - d0/d27/de6/f10b zero size 2023-12-07T16:21:42.815 INFO:tasks.workunit.client.1.smithi152.stdout:0/778: read d0/dc/d3d/d73/dbf/fd0 [85528,16222] 0 2023-12-07T16:21:42.815 INFO:tasks.workunit.client.1.smithi152.stdout:0/779: dread - d0/fc2 zero size 2023-12-07T16:21:42.815 INFO:tasks.workunit.client.1.smithi152.stdout:0/780: write d0/dc/d36/fb8 [347728,69279] 0 2023-12-07T16:21:42.816 INFO:tasks.workunit.client.1.smithi152.stdout:4/703: dwrite d0/d3/d6/d2b/d75/f9f [0,4194304] 0 2023-12-07T16:21:42.816 INFO:tasks.workunit.client.1.smithi152.stdout:3/783: dread d7/d10/d1a/d2f/d56/d57/faa [0,4194304] 0 2023-12-07T16:21:42.816 INFO:tasks.workunit.client.1.smithi152.stdout:4/704: readlink d0/d3/d6/dc/l96 0 2023-12-07T16:21:42.816 INFO:tasks.workunit.client.1.smithi152.stdout:4/705: readlink d0/d3/d6/dc/d22/l3d 0 2023-12-07T16:21:42.816 INFO:tasks.workunit.client.0.smithi063.stdout:1/408: creat d0/f8f x:0 0 0 2023-12-07T16:21:42.816 INFO:tasks.workunit.client.0.smithi063.stdout:1/409: fdatasync d0/f4b 0 2023-12-07T16:21:42.816 INFO:tasks.workunit.client.0.smithi063.stdout:8/718: symlink d7/le3 0 2023-12-07T16:21:42.817 INFO:tasks.workunit.client.0.smithi063.stdout:8/719: stat d7/f24 0 2023-12-07T16:21:42.817 INFO:tasks.workunit.client.0.smithi063.stdout:8/720: dread - d7/d14/d15/d57/f97 zero size 2023-12-07T16:21:42.818 INFO:tasks.workunit.client.1.smithi152.stdout:3/784: mknod d7/d10/d1a/d2f/d56/d57/dee/dda/d62/d6d/cf5 0 2023-12-07T16:21:42.819 INFO:tasks.workunit.client.1.smithi152.stdout:4/706: symlink d0/d3/d6/dc/d39/d93/d7c/lcf 0 2023-12-07T16:21:42.819 INFO:tasks.workunit.client.1.smithi152.stdout:4/707: dread - d0/d3/d6/dc/d39/d93/d7c/fb9 zero size 2023-12-07T16:21:42.821 INFO:tasks.workunit.client.1.smithi152.stdout:4/708: mknod d0/d3/d6/d2b/cd0 0 2023-12-07T16:21:42.821 INFO:tasks.workunit.client.1.smithi152.stdout:4/709: dread - d0/d3/d6/d2b/d75/fb2 zero size 2023-12-07T16:21:42.822 INFO:tasks.workunit.client.0.smithi063.stdout:8/721: mknod d7/d14/d15/d2b/ce4 0 2023-12-07T16:21:42.822 INFO:tasks.workunit.client.0.smithi063.stdout:8/722: write d7/d14/fb2 [468673,84728] 0 2023-12-07T16:21:42.822 INFO:tasks.workunit.client.1.smithi152.stdout:3/785: read d7/d10/d1a/d2f/d56/d57/dee/f8d [2808292,113316] 0 2023-12-07T16:21:42.823 INFO:tasks.workunit.client.0.smithi063.stdout:1/410: dread d0/dd/d19/d50/d71/f5a [0,4194304] 0 2023-12-07T16:21:42.823 INFO:tasks.workunit.client.1.smithi152.stdout:4/710: creat d0/d3/d6/dc/d39/d93/fd1 x:0 0 0 2023-12-07T16:21:42.823 INFO:tasks.workunit.client.1.smithi152.stdout:4/711: write d0/d3/f3c [3983227,95565] 0 2023-12-07T16:21:42.825 INFO:tasks.workunit.client.0.smithi063.stdout:8/723: rmdir d7/d14/d15/d57 39 2023-12-07T16:21:42.825 INFO:tasks.workunit.client.0.smithi063.stdout:8/724: write d7/d14/d15/dde/d63/f6b [1774439,78167] 0 2023-12-07T16:21:42.825 INFO:tasks.workunit.client.0.smithi063.stdout:8/725: stat d7/d14/d15/d2b/f79 0 2023-12-07T16:21:42.825 INFO:tasks.workunit.client.0.smithi063.stdout:8/726: fsync d7/d14/f7d 0 2023-12-07T16:21:42.825 INFO:tasks.workunit.client.0.smithi063.stdout:8/727: chown d7/d14/d15/dac/fc6 654 1 2023-12-07T16:21:42.826 INFO:tasks.workunit.client.1.smithi152.stdout:4/712: mknod d0/d3/d6/dc/d3a/cd2 0 2023-12-07T16:21:42.826 INFO:tasks.workunit.client.1.smithi152.stdout:4/713: chown d0/d17/cbb 8762523 1 2023-12-07T16:21:42.826 INFO:tasks.workunit.client.1.smithi152.stdout:4/714: fsync d0/d3/d6/d2b/d75/f9f 0 2023-12-07T16:21:42.827 INFO:tasks.workunit.client.0.smithi063.stdout:1/411: link d0/dd/d19/d50/d71/f5a d0/dd/d10/d13/f90 0 2023-12-07T16:21:42.827 INFO:tasks.workunit.client.1.smithi152.stdout:2/731: dwrite d2/d1c/d2e/d5d/fa4 [0,4194304] 0 2023-12-07T16:21:42.827 INFO:tasks.workunit.client.1.smithi152.stdout:2/732: fdatasync d2/d1c/d2e/d57/db1/d90/f36 0 2023-12-07T16:21:42.827 INFO:tasks.workunit.client.1.smithi152.stdout:2/733: dread - d2/d9/d51/d54/fc4 zero size 2023-12-07T16:21:42.827 INFO:tasks.workunit.client.1.smithi152.stdout:2/734: readlink d2/d1c/d52/l74 0 2023-12-07T16:21:42.828 INFO:tasks.workunit.client.1.smithi152.stdout:5/902: dwrite dd/de/d14/d19/d1a/dcc/dd0/ffe [0,4194304] 0 2023-12-07T16:21:42.828 INFO:tasks.workunit.client.0.smithi063.stdout:1/412: creat d0/dd/d10/d46/f91 x:0 0 0 2023-12-07T16:21:42.831 INFO:tasks.workunit.client.0.smithi063.stdout:1/413: link d0/f4b d0/dd/d19/d50/f92 0 2023-12-07T16:21:42.832 INFO:tasks.workunit.client.1.smithi152.stdout:5/903: mknod dd/de/d14/dc6/d7c/c13c 0 2023-12-07T16:21:42.832 INFO:tasks.workunit.client.0.smithi063.stdout:1/414: creat d0/dd/d10/f93 x:0 0 0 2023-12-07T16:21:42.832 INFO:tasks.workunit.client.0.smithi063.stdout:1/415: chown d0/dd/d10/d1b/f51 21565 1 2023-12-07T16:21:42.833 INFO:tasks.workunit.client.1.smithi152.stdout:4/715: dread d0/daa/f42 [0,4194304] 0 2023-12-07T16:21:42.833 INFO:tasks.workunit.client.1.smithi152.stdout:4/716: stat d0/d3/d6/dc/d3a 0 2023-12-07T16:21:42.833 INFO:tasks.workunit.client.1.smithi152.stdout:4/717: chown d0/d17/d7f 8935063 1 2023-12-07T16:21:42.833 INFO:tasks.workunit.client.1.smithi152.stdout:4/718: truncate d0/d17/d7f/fa9 479177 0 2023-12-07T16:21:42.835 INFO:tasks.workunit.client.1.smithi152.stdout:4/719: creat d0/d3/d6/d2b/fd3 x:0 0 0 2023-12-07T16:21:42.839 INFO:tasks.workunit.client.0.smithi063.stdout:4/462: dwrite d1/d3/d3f/d44/f6c [4194304,4194304] 0 2023-12-07T16:21:42.839 INFO:tasks.workunit.client.0.smithi063.stdout:4/463: stat d1/d3/d3f 0 2023-12-07T16:21:42.839 INFO:tasks.workunit.client.0.smithi063.stdout:4/464: fdatasync d1/d3/db/d41/f52 0 2023-12-07T16:21:42.843 INFO:tasks.workunit.client.0.smithi063.stdout:0/613: dwrite d4/dd/d26/d2b/d5e/d69/f85 [0,4194304] 0 2023-12-07T16:21:42.843 INFO:tasks.workunit.client.0.smithi063.stdout:4/465: mknod d1/d3/db/d16/c88 0 2023-12-07T16:21:42.843 INFO:tasks.workunit.client.0.smithi063.stdout:2/668: dwrite d0/f14 [0,4194304] 0 2023-12-07T16:21:42.843 INFO:tasks.workunit.client.0.smithi063.stdout:2/669: write d0/d21/d56/d11/d52/da9/fc9 [361807,25482] 0 2023-12-07T16:21:42.847 INFO:tasks.workunit.client.0.smithi063.stdout:4/466: creat d1/d3/db/d73/f89 x:0 0 0 2023-12-07T16:21:42.852 INFO:tasks.workunit.client.0.smithi063.stdout:2/670: dread d0/d21/d56/d11/d52/d5d/dbb/f6e [0,4194304] 0 2023-12-07T16:21:42.852 INFO:tasks.workunit.client.0.smithi063.stdout:2/671: fsync d0/f33 0 2023-12-07T16:21:42.852 INFO:tasks.workunit.client.0.smithi063.stdout:2/672: fsync d0/d21/f37 0 2023-12-07T16:21:42.853 INFO:tasks.workunit.client.0.smithi063.stdout:2/673: readlink d0/d67/d5b/l87 0 2023-12-07T16:21:42.855 INFO:tasks.workunit.client.0.smithi063.stdout:2/674: unlink d0/d21/d56/d11/d52/da9/dbe/ca7 0 2023-12-07T16:21:42.855 INFO:tasks.workunit.client.0.smithi063.stdout:2/675: readlink d0/l1d 0 2023-12-07T16:21:42.856 INFO:tasks.workunit.client.0.smithi063.stdout:2/676: write d0/d21/d56/d11/d52/da9/dbe/f46 [29639,14706] 0 2023-12-07T16:21:42.857 INFO:tasks.workunit.client.0.smithi063.stdout:2/677: link d0/d21/d56/f70 d0/d21/d56/d11/fdb 0 2023-12-07T16:21:42.857 INFO:tasks.workunit.client.0.smithi063.stdout:2/678: dread - d0/d21/d56/d11/d52/da9/dbe/f97 zero size 2023-12-07T16:21:42.858 INFO:tasks.workunit.client.0.smithi063.stdout:2/679: creat d0/d21/d56/d11/d52/dad/fdc x:0 0 0 2023-12-07T16:21:42.858 INFO:tasks.workunit.client.0.smithi063.stdout:2/680: write d0/d21/d56/d11/f1b [2054724,76417] 0 2023-12-07T16:21:42.858 INFO:tasks.workunit.client.0.smithi063.stdout:2/681: readlink d0/d21/d56/d11/d6d/lc1 0 2023-12-07T16:21:42.860 INFO:tasks.workunit.client.0.smithi063.stdout:2/682: getdents d0 0 2023-12-07T16:21:42.862 INFO:tasks.workunit.client.0.smithi063.stdout:2/683: read d0/d21/d39/f51 [1918797,66019] 0 2023-12-07T16:21:42.865 INFO:tasks.workunit.client.0.smithi063.stdout:3/573: dwrite d7/d4f/d53/d54/d76/f83 [4194304,4194304] 0 2023-12-07T16:21:42.865 INFO:tasks.workunit.client.0.smithi063.stdout:3/574: chown d7/d49/d4b/c89 20104 1 2023-12-07T16:21:42.866 INFO:tasks.workunit.client.1.smithi152.stdout:8/770: dwrite d3/d4/d9/d34/f49 [4194304,4194304] 0 2023-12-07T16:21:42.866 INFO:tasks.workunit.client.1.smithi152.stdout:9/844: dwrite d1/d9/db/d70/fde [0,4194304] 0 2023-12-07T16:21:42.866 INFO:tasks.workunit.client.1.smithi152.stdout:7/717: dwrite db/d27/f3b [0,4194304] 0 2023-12-07T16:21:42.867 INFO:tasks.workunit.client.0.smithi063.stdout:3/575: creat d7/d21/fbd x:0 0 0 2023-12-07T16:21:42.867 INFO:tasks.workunit.client.0.smithi063.stdout:3/576: chown d7/d4f/d53/d72/db1/f9f 16603 1 2023-12-07T16:21:42.867 INFO:tasks.workunit.client.0.smithi063.stdout:3/577: write d7/d9/f12 [5807211,38201] 0 2023-12-07T16:21:42.868 INFO:tasks.workunit.client.1.smithi152.stdout:9/845: write d1/d17/d3c/d4a/d48/d8c/fb2 [569653,2095] 0 2023-12-07T16:21:42.869 INFO:tasks.workunit.client.1.smithi152.stdout:0/781: dwrite d0/dc/d36/d3a/d51/d82/f105 [0,4194304] 0 2023-12-07T16:21:42.871 INFO:tasks.workunit.client.1.smithi152.stdout:7/718: mkdir db/d27/d39/d41/d58/da5/dde/de7 0 2023-12-07T16:21:42.871 INFO:tasks.workunit.client.1.smithi152.stdout:7/719: chown db/d27/d39/d41/c7d 140 1 2023-12-07T16:21:42.871 INFO:tasks.workunit.client.1.smithi152.stdout:7/720: chown db/d27/d39/d63/fc1 190 1 2023-12-07T16:21:42.873 INFO:tasks.workunit.client.1.smithi152.stdout:0/782: symlink d0/dc/d36/d3a/d51/d82/dae/l10f 0 2023-12-07T16:21:42.873 INFO:tasks.workunit.client.1.smithi152.stdout:0/783: write d0/d27/d8c/f8d [260376,21438] 0 2023-12-07T16:21:42.875 INFO:tasks.workunit.client.1.smithi152.stdout:0/784: creat d0/dc/d36/d3a/dca/f110 x:0 0 0 2023-12-07T16:21:42.876 INFO:tasks.workunit.client.1.smithi152.stdout:0/785: creat d0/dc/d36/d3a/dca/f111 x:0 0 0 2023-12-07T16:21:42.877 INFO:tasks.workunit.client.1.smithi152.stdout:0/786: creat d0/dc/d3d/dab/dc8/f112 x:0 0 0 2023-12-07T16:21:42.879 INFO:tasks.workunit.client.0.smithi063.stdout:3/578: rename d7/d21/c2d to d7/d9/dd/d7f/cbe 0 2023-12-07T16:21:42.881 INFO:tasks.workunit.client.1.smithi152.stdout:0/787: dread d0/dc/d3d/dab/fb6 [0,4194304] 0 2023-12-07T16:21:42.881 INFO:tasks.workunit.client.1.smithi152.stdout:0/788: write d0/dc/d3d/d4c/f84 [4387770,80673] 0 2023-12-07T16:21:42.881 INFO:tasks.workunit.client.1.smithi152.stdout:0/789: chown d0/d27/d11/d68/f81 24611336 1 2023-12-07T16:21:42.882 INFO:tasks.workunit.client.1.smithi152.stdout:9/846: dread d1/d9/d2d/d65/fbb [0,4194304] 0 2023-12-07T16:21:42.883 INFO:tasks.workunit.client.0.smithi063.stdout:7/479: sync 2023-12-07T16:21:42.885 INFO:tasks.workunit.client.0.smithi063.stdout:7/480: mknod d2/d2c/cb3 0 2023-12-07T16:21:42.885 INFO:tasks.workunit.client.0.smithi063.stdout:6/636: dread d0/d17/fa9 [0,4194304] 0 2023-12-07T16:21:42.886 INFO:tasks.workunit.client.0.smithi063.stdout:7/481: creat d2/d34/d46/d48/d56/fb4 x:0 0 0 2023-12-07T16:21:42.887 INFO:tasks.workunit.client.0.smithi063.stdout:6/637: write d0/d1e/d1d/fab [441307,70900] 0 2023-12-07T16:21:42.888 INFO:tasks.workunit.client.1.smithi152.stdout:9/847: dread d1/d9/db/d70/fe4 [0,4194304] 0 2023-12-07T16:21:42.888 INFO:tasks.workunit.client.1.smithi152.stdout:9/848: chown d1/dd/la1 812154 1 2023-12-07T16:21:42.888 INFO:tasks.workunit.client.0.smithi063.stdout:7/482: mkdir d2/d34/d5a/d5f/d53/dab/db5 0 2023-12-07T16:21:42.890 INFO:tasks.workunit.client.1.smithi152.stdout:9/849: mknod d1/d17/d58/d86/dd9/c117 0 2023-12-07T16:21:42.890 INFO:tasks.workunit.client.0.smithi063.stdout:6/638: rename d0/d1e/d1d/d1f/c8d to d0/d17/d46/ce6 0 2023-12-07T16:21:42.891 INFO:tasks.workunit.client.1.smithi152.stdout:9/850: stat d1/d17/d3c/d4a/leb 0 2023-12-07T16:21:42.892 INFO:tasks.workunit.client.0.smithi063.stdout:6/639: getdents d0/d1e/d20 0 2023-12-07T16:21:42.892 INFO:tasks.workunit.client.0.smithi063.stdout:5/503: dwrite d1/f18 [0,4194304] 0 2023-12-07T16:21:42.894 INFO:tasks.workunit.client.1.smithi152.stdout:2/735: dwrite d2/d1c/d2e/d30/d42/f92 [0,4194304] 0 2023-12-07T16:21:42.898 INFO:tasks.workunit.client.0.smithi063.stdout:6/640: creat d0/d1e/d1d/d4f/d88/fe7 x:0 0 0 2023-12-07T16:21:42.899 INFO:tasks.workunit.client.1.smithi152.stdout:0/790: dread d0/d27/d8c/df7/d30/f5a [0,4194304] 0 2023-12-07T16:21:42.899 INFO:tasks.workunit.client.1.smithi152.stdout:0/791: read d0/d27/d8c/df7/d30/d6e/d77/d9f/fa0 [607721,14578] 0 2023-12-07T16:21:42.899 INFO:tasks.workunit.client.1.smithi152.stdout:0/792: dread - d0/fc2 zero size 2023-12-07T16:21:42.899 INFO:tasks.workunit.client.1.smithi152.stdout:3/786: rename d7/d10/d1a/d2f/d56/d57/dee/dda/d62 to d7/d10/d1a/d2f/d5c/df6 0 2023-12-07T16:21:42.899 INFO:tasks.workunit.client.1.smithi152.stdout:3/787: stat d7/d10/d1a/d25/fd5 0 2023-12-07T16:21:42.900 INFO:tasks.workunit.client.1.smithi152.stdout:4/720: dwrite d0/d81/fc6 [0,4194304] 0 2023-12-07T16:21:42.900 INFO:tasks.workunit.client.1.smithi152.stdout:0/793: stat d0/d27/ceb 0 2023-12-07T16:21:42.901 INFO:tasks.workunit.client.1.smithi152.stdout:0/794: fsync d0/dc/d36/d3a/d69/f99 0 2023-12-07T16:21:42.902 INFO:tasks.workunit.client.0.smithi063.stdout:6/641: mknod d0/d1e/d1d/d4f/ce8 0 2023-12-07T16:21:42.903 INFO:tasks.workunit.client.1.smithi152.stdout:3/788: write d7/d10/d1a/d25/fd5 [2614384,52421] 0 2023-12-07T16:21:42.904 INFO:tasks.workunit.client.1.smithi152.stdout:4/721: read d0/d3/d6/dc/d3a/d46/fac [2005453,28421] 0 2023-12-07T16:21:42.904 INFO:tasks.workunit.client.1.smithi152.stdout:4/722: dread - d0/d3/d6/d36/f82 zero size 2023-12-07T16:21:42.904 INFO:tasks.workunit.client.0.smithi063.stdout:6/642: unlink d0/d17/d46/l6b 0 2023-12-07T16:21:42.905 INFO:tasks.workunit.client.1.smithi152.stdout:2/736: rename d2/d9/d51/d54/fca to d2/ffa 0 2023-12-07T16:21:42.905 INFO:tasks.workunit.client.1.smithi152.stdout:2/737: fsync d2/d1c/d2e/d57/db1/fcd 0 2023-12-07T16:21:42.906 INFO:tasks.workunit.client.0.smithi063.stdout:6/643: creat d0/d1e/d2a/fe9 x:0 0 0 2023-12-07T16:21:42.908 INFO:tasks.workunit.client.0.smithi063.stdout:1/416: dwrite d0/dd/d10/d1b/f2b [4194304,4194304] 0 2023-12-07T16:21:42.909 INFO:tasks.workunit.client.1.smithi152.stdout:3/789: symlink d7/d10/d1a/d2f/d56/d57/lf7 0 2023-12-07T16:21:42.909 INFO:tasks.workunit.client.1.smithi152.stdout:4/723: symlink d0/d17/d7f/ld4 0 2023-12-07T16:21:42.910 INFO:tasks.workunit.client.1.smithi152.stdout:0/795: mkdir d0/d27/d8c/df7/d30/d6e/d77/d113 0 2023-12-07T16:21:42.910 INFO:tasks.workunit.client.1.smithi152.stdout:3/790: write d7/d10/f91 [575209,108283] 0 2023-12-07T16:21:42.911 INFO:tasks.workunit.client.1.smithi152.stdout:2/738: rmdir d2/d1c/d2e/d57/d5b/da7/d9a/da6/de7 0 2023-12-07T16:21:42.911 INFO:tasks.workunit.client.0.smithi063.stdout:1/417: unlink d0/dd/d10/d46/l4c 0 2023-12-07T16:21:42.911 INFO:tasks.workunit.client.0.smithi063.stdout:1/418: truncate d0/dd/d19/f8b 145795 0 2023-12-07T16:21:42.913 INFO:tasks.workunit.client.1.smithi152.stdout:4/724: link d0/d3/d6/d2b/d75/fb2 d0/daa/fd5 0 2023-12-07T16:21:42.914 INFO:tasks.workunit.client.1.smithi152.stdout:9/851: dwrite d1/d17/d3c/d4a/d48/d8c/f115 [0,4194304] 0 2023-12-07T16:21:42.914 INFO:tasks.workunit.client.0.smithi063.stdout:1/419: creat d0/dd/d1f/f94 x:0 0 0 2023-12-07T16:21:42.915 INFO:tasks.workunit.client.1.smithi152.stdout:3/791: rename d7/d10/d1a/d2f/d5c/df6/d6d/d84/l9d to d7/d10/d1a/d2f/d5c/df6/lf8 0 2023-12-07T16:21:42.916 INFO:tasks.workunit.client.0.smithi063.stdout:2/684: dwrite d0/d21/d56/d11/d6d/f81 [0,4194304] 0 2023-12-07T16:21:42.916 INFO:tasks.workunit.client.0.smithi063.stdout:2/685: chown d0/d67/d5b/db3 511 1 2023-12-07T16:21:42.918 INFO:tasks.workunit.client.1.smithi152.stdout:4/725: rmdir d0/d3/d6/dc/d3a/d48/d4c 39 2023-12-07T16:21:42.921 INFO:tasks.workunit.client.1.smithi152.stdout:9/852: mkdir d1/d9/db/df/da6/da2/d118 0 2023-12-07T16:21:42.921 INFO:tasks.workunit.client.1.smithi152.stdout:2/739: dread d2/d1c/d2e/d30/d33/f2d [0,4194304] 0 2023-12-07T16:21:42.922 INFO:tasks.workunit.client.1.smithi152.stdout:8/771: dwrite d3/d4/d9/dc/d6f/d7a/d8a/f59 [0,4194304] 0 2023-12-07T16:21:42.923 INFO:tasks.workunit.client.1.smithi152.stdout:4/726: mkdir d0/d3/d6/dc/d3a/d48/d4c/dd6 0 2023-12-07T16:21:42.923 INFO:tasks.workunit.client.1.smithi152.stdout:4/727: fdatasync d0/d3/d6/d2b/fd3 0 2023-12-07T16:21:42.923 INFO:tasks.workunit.client.1.smithi152.stdout:3/792: write f2 [5934228,15509] 0 2023-12-07T16:21:42.923 INFO:tasks.workunit.client.1.smithi152.stdout:3/793: fsync d7/d10/d41/f6e 0 2023-12-07T16:21:42.925 INFO:tasks.workunit.client.0.smithi063.stdout:7/483: dwrite d2/d34/d5a/d5f/d78/d7c/f90 [0,4194304] 0 2023-12-07T16:21:42.925 INFO:tasks.workunit.client.1.smithi152.stdout:9/853: mkdir d1/d17/d3c/d4a/d48/d8c/d119 0 2023-12-07T16:21:42.927 INFO:tasks.workunit.client.1.smithi152.stdout:3/794: write d7/f32 [4393529,103562] 0 2023-12-07T16:21:42.929 INFO:tasks.workunit.client.1.smithi152.stdout:8/772: getdents d3/d4/d9/dc 0 2023-12-07T16:21:42.929 INFO:tasks.workunit.client.1.smithi152.stdout:2/740: rename d2/d1c/d2e/d30/d42/f6d to d2/d1c/d2e/d30/d33/ffb 0 2023-12-07T16:21:42.929 INFO:tasks.workunit.client.1.smithi152.stdout:5/904: dwrite dd/de/d14/d67/fad [4194304,4194304] 0 2023-12-07T16:21:42.930 INFO:tasks.workunit.client.0.smithi063.stdout:5/504: dwrite d1/d3/de/d1e/f46 [0,4194304] 0 2023-12-07T16:21:42.930 INFO:tasks.workunit.client.0.smithi063.stdout:5/505: dread - d1/d3/d3a/f97 zero size 2023-12-07T16:21:42.930 INFO:tasks.workunit.client.0.smithi063.stdout:5/506: readlink d1/d3/d3a/l55 0 2023-12-07T16:21:42.932 INFO:tasks.workunit.client.1.smithi152.stdout:0/796: dread d0/d27/d8c/df7/d30/d6e/d77/fa6 [0,4194304] 0 2023-12-07T16:21:42.932 INFO:tasks.workunit.client.1.smithi152.stdout:0/797: truncate d0/d27/d8c/df7/f4d 5031478 0 2023-12-07T16:21:42.932 INFO:tasks.workunit.client.1.smithi152.stdout:4/728: getdents d0 0 2023-12-07T16:21:42.932 INFO:tasks.workunit.client.1.smithi152.stdout:4/729: write d0/d17/d7f/fa9 [232052,37781] 0 2023-12-07T16:21:42.932 INFO:tasks.workunit.client.1.smithi152.stdout:4/730: readlink d0/d3/d6/dc/d3a/d46/d80/lab 0 2023-12-07T16:21:42.932 INFO:tasks.workunit.client.1.smithi152.stdout:9/854: mknod d1/d9/d4f/dd3/c11a 0 2023-12-07T16:21:42.933 INFO:tasks.workunit.client.0.smithi063.stdout:5/507: write d1/d3/d3a/d5a/f85 [5445837,34866] 0 2023-12-07T16:21:42.939 INFO:tasks.workunit.client.1.smithi152.stdout:8/773: unlink d3/d1e/d40/d74/f10f 0 2023-12-07T16:21:42.942 INFO:tasks.workunit.client.1.smithi152.stdout:2/741: rmdir d2/d1c/d52/da8/df5 0 2023-12-07T16:21:42.947 INFO:tasks.workunit.client.1.smithi152.stdout:4/731: mknod d0/d17/cd7 0 2023-12-07T16:21:42.947 INFO:tasks.workunit.client.1.smithi152.stdout:9/855: mknod d1/dd/dd6/de2/d53/dff/d10f/c11b 0 2023-12-07T16:21:42.947 INFO:tasks.workunit.client.1.smithi152.stdout:9/856: stat d1/dd/dd6/de2/d53/fe7 0 2023-12-07T16:21:42.947 INFO:tasks.workunit.client.1.smithi152.stdout:4/732: chown d0/d3/d6/d36/d85 126 1 2023-12-07T16:21:42.949 INFO:tasks.workunit.client.1.smithi152.stdout:8/774: mkdir d3/d4/d9/dc/d6f/d7a/d8a/d66/d9b/d118 0 2023-12-07T16:21:42.950 INFO:tasks.workunit.client.0.smithi063.stdout:1/420: rmdir d0/dd/d1f 39 2023-12-07T16:21:42.952 INFO:tasks.workunit.client.0.smithi063.stdout:1/421: creat d0/dd/d10/d1b/d68/f95 x:0 0 0 2023-12-07T16:21:42.953 INFO:tasks.workunit.client.1.smithi152.stdout:8/775: mkdir d3/d4/d9/d34/d119 0 2023-12-07T16:21:42.953 INFO:tasks.workunit.client.1.smithi152.stdout:8/776: chown d3/d1e/d55/d83/dde/lff 20 1 2023-12-07T16:21:42.953 INFO:tasks.workunit.client.1.smithi152.stdout:8/777: readlink d3/d4/d9/dc/d6f/d7b/d7e/df5/d67/d7d/l8f 0 2023-12-07T16:21:42.954 INFO:tasks.workunit.client.1.smithi152.stdout:2/742: rename d2/d1c/d2e/d57/d5b/da7/f88 to d2/d1c/d2e/d5d/de8/ffc 0 2023-12-07T16:21:42.955 INFO:tasks.workunit.client.0.smithi063.stdout:1/422: rename d0/l29 to d0/dd/d10/d46/l96 0 2023-12-07T16:21:42.955 INFO:tasks.workunit.client.1.smithi152.stdout:8/778: creat d3/d1e/d55/d83/dae/db1/f11a x:0 0 0 2023-12-07T16:21:42.956 INFO:tasks.workunit.client.0.smithi063.stdout:1/423: link d0/dd/d10/f93 d0/dd/d1f/d75/f97 0 2023-12-07T16:21:42.956 INFO:tasks.workunit.client.0.smithi063.stdout:1/424: write d0/dd/d19/d50/d71/f86 [856687,10783] 0 2023-12-07T16:21:42.957 INFO:tasks.workunit.client.1.smithi152.stdout:9/857: rename d1/d9/db/df/d42/lcf to d1/d9/db/df/da6/da2/ddb/l11c 0 2023-12-07T16:21:42.958 INFO:tasks.workunit.client.1.smithi152.stdout:9/858: write d1/d17/d3c/f116 [502090,22431] 0 2023-12-07T16:21:42.958 INFO:tasks.workunit.client.0.smithi063.stdout:1/425: mkdir d0/d98 0 2023-12-07T16:21:42.959 INFO:tasks.workunit.client.1.smithi152.stdout:2/743: symlink d2/d1c/d2e/lfd 0 2023-12-07T16:21:42.959 INFO:tasks.workunit.client.1.smithi152.stdout:2/744: readlink d2/d1c/d2e/d30/d33/lae 0 2023-12-07T16:21:42.961 INFO:tasks.workunit.client.1.smithi152.stdout:4/733: dread d0/d3/d6/d2b/d75/f9f [0,4194304] 0 2023-12-07T16:21:42.961 INFO:tasks.workunit.client.1.smithi152.stdout:4/734: write d0/daa/fd5 [853290,27831] 0 2023-12-07T16:21:42.963 INFO:tasks.workunit.client.1.smithi152.stdout:9/859: link d1/d9/f23 d1/d17/d58/d86/dd9/f11d 0 2023-12-07T16:21:42.966 INFO:tasks.workunit.client.1.smithi152.stdout:2/745: creat d2/d1c/d52/da8/db6/ffe x:0 0 0 2023-12-07T16:21:42.966 INFO:tasks.workunit.client.1.smithi152.stdout:2/746: fsync d2/d1c/d2e/fa2 0 2023-12-07T16:21:42.966 INFO:tasks.workunit.client.1.smithi152.stdout:2/747: fsync d2/d1c/d2e/d57/db1/f3b 0 2023-12-07T16:21:42.967 INFO:tasks.workunit.client.1.smithi152.stdout:2/748: getdents d2/d1c/d2e/d30/d42/d91 0 2023-12-07T16:21:42.967 INFO:tasks.workunit.client.1.smithi152.stdout:2/749: write d2/d1c/d2e/d30/d33/fd5 [679125,21937] 0 2023-12-07T16:21:42.967 INFO:tasks.workunit.client.1.smithi152.stdout:2/750: dread - d2/d1c/d2e/d57/fde zero size 2023-12-07T16:21:42.968 INFO:tasks.workunit.client.1.smithi152.stdout:4/735: mknod d0/d3/d6/dc/d39/d93/cd8 0 2023-12-07T16:21:42.970 INFO:tasks.workunit.client.1.smithi152.stdout:2/751: unlink d2/d1c/d2e/d57/d5b/f95 0 2023-12-07T16:21:42.972 INFO:tasks.workunit.client.1.smithi152.stdout:8/779: dread d3/d4/d9/d23/f36 [0,4194304] 0 2023-12-07T16:21:42.972 INFO:tasks.workunit.client.1.smithi152.stdout:8/780: fdatasync d3/d4/d9/dc/f4d 0 2023-12-07T16:21:42.972 INFO:tasks.workunit.client.0.smithi063.stdout:2/686: dwrite d0/d21/d56/d11/d52/da9/dbe/f76 [0,4194304] 0 2023-12-07T16:21:42.972 INFO:tasks.workunit.client.0.smithi063.stdout:2/687: chown d0/d67/d5b/l73 6009 1 2023-12-07T16:21:42.974 INFO:tasks.workunit.client.0.smithi063.stdout:2/688: creat d0/d67/fdd x:0 0 0 2023-12-07T16:21:42.974 INFO:tasks.workunit.client.0.smithi063.stdout:2/689: write d0/d67/f59 [1292161,5163] 0 2023-12-07T16:21:42.975 INFO:tasks.workunit.client.0.smithi063.stdout:2/690: read d0/d67/f59 [690391,72775] 0 2023-12-07T16:21:42.976 INFO:tasks.workunit.client.1.smithi152.stdout:5/905: dwrite dd/de/d14/d19/d1a/dcc/feb [0,4194304] 0 2023-12-07T16:21:42.977 INFO:tasks.workunit.client.0.smithi063.stdout:2/691: creat d0/d21/d56/fde x:0 0 0 2023-12-07T16:21:42.977 INFO:tasks.workunit.client.0.smithi063.stdout:7/484: dwrite d2/ff [0,4194304] 0 2023-12-07T16:21:42.977 INFO:tasks.workunit.client.1.smithi152.stdout:8/781: creat d3/d1e/d55/d83/dc5/df0/f11b x:0 0 0 2023-12-07T16:21:42.978 INFO:tasks.workunit.client.1.smithi152.stdout:0/798: dwrite d0/f9 [0,4194304] 0 2023-12-07T16:21:42.978 INFO:tasks.workunit.client.1.smithi152.stdout:0/799: fdatasync d0/dc/d3d/dab/dc8/f112 0 2023-12-07T16:21:42.978 INFO:tasks.workunit.client.1.smithi152.stdout:9/860: dread d1/d9/db/df/f1f [0,4194304] 0 2023-12-07T16:21:42.981 INFO:tasks.workunit.client.1.smithi152.stdout:3/795: rmdir d7/d10/d1a 39 2023-12-07T16:21:42.981 INFO:tasks.workunit.client.1.smithi152.stdout:2/752: symlink d2/d1c/d2e/d57/d5b/da7/lff 0 2023-12-07T16:21:42.982 INFO:tasks.workunit.client.0.smithi063.stdout:2/692: link d0/d21/d39/fcf d0/d21/fdf 0 2023-12-07T16:21:42.982 INFO:tasks.workunit.client.0.smithi063.stdout:7/485: rmdir d2/d34/d5a/d5f/d2a 39 2023-12-07T16:21:42.983 INFO:tasks.workunit.client.1.smithi152.stdout:5/906: symlink dd/l13d 0 2023-12-07T16:21:42.983 INFO:tasks.workunit.client.1.smithi152.stdout:5/907: chown dd/de/l4b 684148 1 2023-12-07T16:21:42.983 INFO:tasks.workunit.client.1.smithi152.stdout:5/908: chown dd/de/d14/d19/d1a/l9d 88170 1 2023-12-07T16:21:42.984 INFO:tasks.workunit.client.1.smithi152.stdout:0/800: mknod d0/dc/c114 0 2023-12-07T16:21:42.986 INFO:tasks.workunit.client.1.smithi152.stdout:8/782: creat d3/d1e/d55/d83/dc5/d104/f11c x:0 0 0 2023-12-07T16:21:42.987 INFO:tasks.workunit.client.0.smithi063.stdout:1/426: dwrite d0/dd/d19/d50/d71/f31 [0,4194304] 0 2023-12-07T16:21:42.987 INFO:tasks.workunit.client.0.smithi063.stdout:1/427: write d0/dd/d10/d46/f91 [417320,38629] 0 2023-12-07T16:21:42.987 INFO:tasks.workunit.client.0.smithi063.stdout:5/508: dwrite d1/d31/d56/d61/f64 [0,4194304] 0 2023-12-07T16:21:42.987 INFO:tasks.workunit.client.1.smithi152.stdout:3/796: unlink d7/d10/d1a/d2f/d56/c88 0 2023-12-07T16:21:42.988 INFO:tasks.workunit.client.0.smithi063.stdout:7/486: rename d2/d34/d5a/d5f/f80 to d2/d34/d5a/d5f/d78/fb6 0 2023-12-07T16:21:42.988 INFO:tasks.workunit.client.0.smithi063.stdout:7/487: chown d2/d34/d5a/l98 1868723974 1 2023-12-07T16:21:42.988 INFO:tasks.workunit.client.1.smithi152.stdout:5/909: creat dd/de/d38/d3d/dd3/f13e x:0 0 0 2023-12-07T16:21:42.990 INFO:tasks.workunit.client.1.smithi152.stdout:0/801: rename d0/dc/d3d/d4c/l4e to d0/dc/d3d/d4c/l115 0 2023-12-07T16:21:42.990 INFO:tasks.workunit.client.0.smithi063.stdout:5/509: creat d1/f98 x:0 0 0 2023-12-07T16:21:42.992 INFO:tasks.workunit.client.1.smithi152.stdout:5/910: symlink dd/de/d8f/df2/l13f 0 2023-12-07T16:21:42.994 INFO:tasks.workunit.client.0.smithi063.stdout:7/488: rename d2/d34/f3b to d2/d64/fb7 0 2023-12-07T16:21:42.997 INFO:tasks.workunit.client.0.smithi063.stdout:7/489: mkdir d2/d34/d5a/d5f/d2a/db8 0 2023-12-07T16:21:43.003 INFO:tasks.workunit.client.0.smithi063.stdout:1/428: dread d0/dd/f16 [0,4194304] 0 2023-12-07T16:21:43.003 INFO:tasks.workunit.client.0.smithi063.stdout:1/429: chown d0 1854 1 2023-12-07T16:21:43.007 INFO:tasks.workunit.client.0.smithi063.stdout:5/510: dread d1/d3/de/d1e/d6b/f7d [0,4194304] 0 2023-12-07T16:21:43.007 INFO:tasks.workunit.client.0.smithi063.stdout:5/511: stat d1/d3/f3b 0 2023-12-07T16:21:43.007 INFO:tasks.workunit.client.0.smithi063.stdout:5/512: truncate d1/d31/d56/d61/d5e/d6a/d7e/f84 547128 0 2023-12-07T16:21:43.008 INFO:tasks.workunit.client.0.smithi063.stdout:1/430: rename d0/c5c to d0/dd/d1f/c99 0 2023-12-07T16:21:43.008 INFO:tasks.workunit.client.0.smithi063.stdout:1/431: stat d0/c8a 0 2023-12-07T16:21:43.010 INFO:tasks.workunit.client.0.smithi063.stdout:1/432: mknod d0/dd/d4f/c9a 0 2023-12-07T16:21:43.012 INFO:tasks.workunit.client.0.smithi063.stdout:1/433: mkdir d0/dd/d19/d50/d71/d9b 0 2023-12-07T16:21:43.013 INFO:tasks.workunit.client.1.smithi152.stdout:3/797: dread d7/d10/d1a/d2f/d56/d57/dee/dda/d7d/fa1 [4194304,4194304] 0 2023-12-07T16:21:43.015 INFO:tasks.workunit.client.0.smithi063.stdout:5/513: write d1/d31/d56/f67 [1327780,52435] 0 2023-12-07T16:21:43.015 INFO:tasks.workunit.client.1.smithi152.stdout:4/736: rename d0/d3/d6/dc to d0/d3/d6/d2b/dd9 0 2023-12-07T16:21:43.015 INFO:tasks.workunit.client.1.smithi152.stdout:4/737: readlink d0/d3/d6/d2b/dd9/d3a/d46/d4e/l9a 0 2023-12-07T16:21:43.016 INFO:tasks.workunit.client.0.smithi063.stdout:1/434: read d0/dd/d10/d13/f3d [7790389,124839] 0 2023-12-07T16:21:43.016 INFO:tasks.workunit.client.0.smithi063.stdout:1/435: readlink d0/dd/d10/d13/l76 0 2023-12-07T16:21:43.018 INFO:tasks.workunit.client.1.smithi152.stdout:9/861: dwrite d1/d9/d2d/f8f [0,4194304] 0 2023-12-07T16:21:43.018 INFO:tasks.workunit.client.1.smithi152.stdout:9/862: chown d1/d17/d3c/d4a/d7e/f9b 97078 1 2023-12-07T16:21:43.031 INFO:tasks.workunit.client.1.smithi152.stdout:2/753: dwrite d2/fd8 [0,4194304] 0 2023-12-07T16:21:43.031 INFO:tasks.workunit.client.1.smithi152.stdout:9/863: dread d1/d9/db/df/f27 [0,4194304] 0 2023-12-07T16:21:43.032 INFO:tasks.workunit.client.0.smithi063.stdout:2/693: getdents d0/d21/d56 0 2023-12-07T16:21:43.032 INFO:tasks.workunit.client.0.smithi063.stdout:2/694: stat d0/d21/d56/d11/d52/da9/dbe/f46 0 2023-12-07T16:21:43.033 INFO:tasks.workunit.client.1.smithi152.stdout:9/864: creat d1/d9/db/df/d42/de8/df8/f11e x:0 0 0 2023-12-07T16:21:43.034 INFO:tasks.workunit.client.1.smithi152.stdout:3/798: dread d7/d10/d1a/d2f/d56/d57/dee/dda/ff4 [0,4194304] 0 2023-12-07T16:21:43.034 INFO:tasks.workunit.client.1.smithi152.stdout:3/799: chown d7/d10/d1a/d2f/d5c/df6/d6d/d81/la8 74222381 1 2023-12-07T16:21:43.064 INFO:tasks.workunit.client.1.smithi152.stdout:3/800: unlink d7/d10/d1a/d2f/d5c/df6/l94 0 2023-12-07T16:21:43.064 INFO:tasks.workunit.client.1.smithi152.stdout:3/801: write d7/d10/d1a/d25/d3f/fdf [303347,44435] 0 2023-12-07T16:21:43.065 INFO:tasks.workunit.client.1.smithi152.stdout:0/802: dwrite d0/dc/d36/d3a/dca/f111 [0,4194304] 0 2023-12-07T16:21:43.067 INFO:tasks.workunit.client.1.smithi152.stdout:5/911: dwrite dd/de/d14/d67/d138/f52 [0,4194304] 0 2023-12-07T16:21:43.073 INFO:tasks.workunit.client.1.smithi152.stdout:0/803: write d0/dc/f22 [2754875,94080] 0 2023-12-07T16:21:43.073 INFO:tasks.workunit.client.1.smithi152.stdout:3/802: unlink d7/d10/d19/f23 0 2023-12-07T16:21:43.073 INFO:tasks.workunit.client.1.smithi152.stdout:3/803: write d7/d10/d1a/d2f/d5c/df6/d6d/f73 [4303827,80131] 0 2023-12-07T16:21:43.083 INFO:tasks.workunit.client.0.smithi063.stdout:1/436: dwrite d0/dd/d10/d1b/f74 [0,4194304] 0 2023-12-07T16:21:43.083 INFO:tasks.workunit.client.0.smithi063.stdout:7/490: dwrite d2/d34/f54 [0,4194304] 0 2023-12-07T16:21:43.083 INFO:tasks.workunit.client.0.smithi063.stdout:7/491: stat d2/d34/d5a/l98 0 2023-12-07T16:21:43.084 INFO:tasks.workunit.client.0.smithi063.stdout:1/437: getdents d0/d47 0 2023-12-07T16:21:43.085 INFO:tasks.workunit.client.0.smithi063.stdout:7/492: symlink d2/d34/d5a/d5f/d6d/lb9 0 2023-12-07T16:21:43.086 INFO:tasks.workunit.client.0.smithi063.stdout:1/438: unlink d0/dd/d4f/c9a 0 2023-12-07T16:21:43.086 INFO:tasks.workunit.client.0.smithi063.stdout:1/439: fsync d0/f4 0 2023-12-07T16:21:43.087 INFO:tasks.workunit.client.0.smithi063.stdout:7/493: rename d2/f5 to d2/d2c/fba 0 2023-12-07T16:21:43.092 INFO:tasks.workunit.client.0.smithi063.stdout:5/514: dwrite d1/f40 [0,4194304] 0 2023-12-07T16:21:43.092 INFO:tasks.workunit.client.0.smithi063.stdout:5/515: chown d1/d31/d56/d61/d5e/f75 56377266 1 2023-12-07T16:21:43.097 INFO:tasks.workunit.client.0.smithi063.stdout:5/516: write d1/d3/de/d1e/f46 [3462439,97656] 0 2023-12-07T16:21:43.097 INFO:tasks.workunit.client.0.smithi063.stdout:5/517: chown d1/d3/de/d1e/d25/f3c 24528029 1 2023-12-07T16:21:43.099 INFO:tasks.workunit.client.1.smithi152.stdout:6/739: sync 2023-12-07T16:21:43.099 INFO:tasks.workunit.client.1.smithi152.stdout:6/740: dread - d2/d4f/d83/d85/f80 zero size 2023-12-07T16:21:43.099 INFO:tasks.workunit.client.0.smithi063.stdout:5/518: unlink d1/l83 0 2023-12-07T16:21:43.100 INFO:tasks.workunit.client.1.smithi152.stdout:1/944: sync 2023-12-07T16:21:43.101 INFO:tasks.workunit.client.1.smithi152.stdout:6/741: mknod d2/d4f/d83/d85/cee 0 2023-12-07T16:21:43.101 INFO:tasks.workunit.client.1.smithi152.stdout:6/742: truncate d2/d4f/d83/d85/d94/fb1 5847191 0 2023-12-07T16:21:43.101 INFO:tasks.workunit.client.1.smithi152.stdout:6/743: write d2/d4f/d83/d48/d70/fdb [1541116,67511] 0 2023-12-07T16:21:43.101 INFO:tasks.workunit.client.1.smithi152.stdout:6/744: truncate d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/d5d/fc4 957794 0 2023-12-07T16:21:43.107 INFO:tasks.workunit.client.1.smithi152.stdout:6/745: dread d2/d4f/d83/d58/f93 [0,4194304] 0 2023-12-07T16:21:43.112 INFO:tasks.workunit.client.1.smithi152.stdout:4/738: dwrite d0/d3/d6/d2b/dd9/d22/f4f [4194304,4194304] 0 2023-12-07T16:21:43.116 INFO:tasks.workunit.client.0.smithi063.stdout:5/519: dread d1/d3/de/d1e/d25/f53 [0,4194304] 0 2023-12-07T16:21:43.118 INFO:tasks.workunit.client.0.smithi063.stdout:5/520: rename d1/d31/d56/d61/d5e/f82 to d1/d3/f99 0 2023-12-07T16:21:43.125 INFO:tasks.workunit.client.1.smithi152.stdout:1/945: dread dc/d14/fd3 [0,4194304] 0 2023-12-07T16:21:43.125 INFO:tasks.workunit.client.1.smithi152.stdout:6/746: dread d2/f2a [0,4194304] 0 2023-12-07T16:21:43.127 INFO:tasks.workunit.client.1.smithi152.stdout:6/747: mknod d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/da1/db5/dc1/dd8/cef 0 2023-12-07T16:21:43.129 INFO:tasks.workunit.client.0.smithi063.stdout:5/521: dread d1/d31/d56/d61/f64 [0,4194304] 0 2023-12-07T16:21:43.131 INFO:tasks.workunit.client.1.smithi152.stdout:6/748: read d2/d4f/d83/d85/d94/fc2 [547337,104082] 0 2023-12-07T16:21:43.131 INFO:tasks.workunit.client.0.smithi063.stdout:2/695: dwrite d0/d21/d56/d11/d52/d5d/fc4 [0,4194304] 0 2023-12-07T16:21:43.131 INFO:tasks.workunit.client.1.smithi152.stdout:0/804: dwrite d0/dc/d3d/dab/dc8/f112 [0,4194304] 0 2023-12-07T16:21:43.132 INFO:tasks.workunit.client.1.smithi152.stdout:3/804: dwrite d7/d10/d1a/d2f/d56/d57/dee/dda/d7d/fb5 [0,4194304] 0 2023-12-07T16:21:43.132 INFO:tasks.workunit.client.1.smithi152.stdout:5/912: dwrite dd/de/d14/d19/f64 [0,4194304] 0 2023-12-07T16:21:43.132 INFO:tasks.workunit.client.0.smithi063.stdout:1/440: dwrite d0/dd/d19/d50/d71/f64 [0,4194304] 0 2023-12-07T16:21:43.132 INFO:tasks.workunit.client.0.smithi063.stdout:7/494: dwrite d2/d34/d5a/d5f/d2a/f35 [0,4194304] 0 2023-12-07T16:21:43.133 INFO:tasks.workunit.client.1.smithi152.stdout:9/865: dwrite d1/f3a [4194304,4194304] 0 2023-12-07T16:21:43.133 INFO:tasks.workunit.client.1.smithi152.stdout:9/866: fdatasync d1/d9/d2d/d46/f5d 0 2023-12-07T16:21:43.133 INFO:tasks.workunit.client.1.smithi152.stdout:4/739: dwrite d0/d3/d6/d2b/dd9/d3a/d46/d80/fa7 [0,4194304] 0 2023-12-07T16:21:43.133 INFO:tasks.workunit.client.1.smithi152.stdout:4/740: readlink d0/d3/d6/d2b/db1/lc3 0 2023-12-07T16:21:43.133 INFO:tasks.workunit.client.0.smithi063.stdout:5/522: unlink d1/d3/de/d1e/c1c 0 2023-12-07T16:21:43.134 INFO:tasks.workunit.client.1.smithi152.stdout:6/749: mknod d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/cf0 0 2023-12-07T16:21:43.134 INFO:tasks.workunit.client.1.smithi152.stdout:5/913: write dd/de/d14/d1f/f20 [4900278,106269] 0 2023-12-07T16:21:43.136 INFO:tasks.workunit.client.0.smithi063.stdout:2/696: unlink d0/d21/d56/f17 0 2023-12-07T16:21:43.138 INFO:tasks.workunit.client.0.smithi063.stdout:5/523: read d1/d3/de/f16 [2849884,73699] 0 2023-12-07T16:21:43.140 INFO:tasks.workunit.client.0.smithi063.stdout:1/441: mknod d0/dd/d19/d50/d72/d80/c9c 0 2023-12-07T16:21:43.140 INFO:tasks.workunit.client.0.smithi063.stdout:1/442: stat d0/dd/d10/d46 0 2023-12-07T16:21:43.140 INFO:tasks.workunit.client.0.smithi063.stdout:1/443: truncate d0/dd/f56 417003 0 2023-12-07T16:21:43.140 INFO:tasks.workunit.client.1.smithi152.stdout:9/867: mknod d1/d17/d3c/d4a/d7e/c11f 0 2023-12-07T16:21:43.140 INFO:tasks.workunit.client.1.smithi152.stdout:3/805: read d7/dc/f89 [4136116,98318] 0 2023-12-07T16:21:43.140 INFO:tasks.workunit.client.1.smithi152.stdout:3/806: chown d7/d10/d1a/d2f/d56/fde 8865 1 2023-12-07T16:21:43.141 INFO:tasks.workunit.client.1.smithi152.stdout:3/807: write d7/d10/d1a/d25/d3f/fdf [1043441,2558] 0 2023-12-07T16:21:43.141 INFO:tasks.workunit.client.1.smithi152.stdout:3/808: readlink d7/d10/d1a/d2f/d56/d57/dee/dda/d6b/l90 0 2023-12-07T16:21:43.141 INFO:tasks.workunit.client.0.smithi063.stdout:7/495: mknod d2/d34/d5a/d5f/d61/cbb 0 2023-12-07T16:21:43.143 INFO:tasks.workunit.client.0.smithi063.stdout:5/524: symlink d1/d3/de/l9a 0 2023-12-07T16:21:43.143 INFO:tasks.workunit.client.0.smithi063.stdout:5/525: fsync d1/d3/de/d1e/f47 0 2023-12-07T16:21:43.150 INFO:tasks.workunit.client.1.smithi152.stdout:0/805: dread d0/dc/d3d/f5b [0,4194304] 0 2023-12-07T16:21:43.150 INFO:tasks.workunit.client.1.smithi152.stdout:0/806: chown d0/dc/d36/d3a/d51/fc6 166 1 2023-12-07T16:21:43.150 INFO:tasks.workunit.client.1.smithi152.stdout:4/741: truncate d0/d3/d6/d2b/dd9/d3a/f58 941314 0 2023-12-07T16:21:43.150 INFO:tasks.workunit.client.1.smithi152.stdout:4/742: fsync d0/d3/f95 0 2023-12-07T16:21:43.151 INFO:tasks.workunit.client.0.smithi063.stdout:1/444: dread d0/dd/d19/d50/f92 [0,4194304] 0 2023-12-07T16:21:43.151 INFO:tasks.workunit.client.1.smithi152.stdout:6/750: unlink d2/d4f/d83/d85/d19/d1f/d60/fcf 0 2023-12-07T16:21:43.153 INFO:tasks.workunit.client.0.smithi063.stdout:1/445: mkdir d0/dd/d1f/d9d 0 2023-12-07T16:21:43.153 INFO:tasks.workunit.client.1.smithi152.stdout:3/809: mknod d7/d10/d1a/d2f/d5c/ddd/cf9 0 2023-12-07T16:21:43.155 INFO:tasks.workunit.client.1.smithi152.stdout:4/743: rmdir d0/d17/d7f 39 2023-12-07T16:21:43.155 INFO:tasks.workunit.client.1.smithi152.stdout:4/744: fsync d0/d3/d6/d2b/dd9/d39/d93/f24 0 2023-12-07T16:21:43.155 INFO:tasks.workunit.client.1.smithi152.stdout:0/807: symlink d0/dc/d3d/d73/dbf/l116 0 2023-12-07T16:21:43.156 INFO:tasks.workunit.client.0.smithi063.stdout:1/446: rmdir d0/dd/d10/d13/d2f 39 2023-12-07T16:21:43.156 INFO:tasks.workunit.client.1.smithi152.stdout:6/751: creat d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/da1/db5/dc1/dd8/ff1 x:0 0 0 2023-12-07T16:21:43.157 INFO:tasks.workunit.client.1.smithi152.stdout:3/810: creat d7/d10/d1a/de8/ffa x:0 0 0 2023-12-07T16:21:43.160 INFO:tasks.workunit.client.1.smithi152.stdout:0/808: unlink d0/fa4 0 2023-12-07T16:21:43.160 INFO:tasks.workunit.client.1.smithi152.stdout:6/752: creat d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/da1/db5/ff2 x:0 0 0 2023-12-07T16:21:43.162 INFO:tasks.workunit.client.1.smithi152.stdout:3/811: write d7/dc/fa9 [806016,12245] 0 2023-12-07T16:21:43.162 INFO:tasks.workunit.client.1.smithi152.stdout:0/809: mkdir d0/d27/d8c/df7/d30/d6e/d77/d113/d117 0 2023-12-07T16:21:43.163 INFO:tasks.workunit.client.1.smithi152.stdout:3/812: mkdir d7/d10/d1a/de8/dfb 0 2023-12-07T16:21:43.165 INFO:tasks.workunit.client.0.smithi063.stdout:1/447: dread d0/dd/f1c [0,4194304] 0 2023-12-07T16:21:43.165 INFO:tasks.workunit.client.0.smithi063.stdout:1/448: fdatasync d0/dd/f3b 0 2023-12-07T16:21:43.165 INFO:tasks.workunit.client.0.smithi063.stdout:1/449: fsync d0/dd/f56 0 2023-12-07T16:21:43.165 INFO:tasks.workunit.client.0.smithi063.stdout:1/450: chown d0/dd/d19/d50/d71/f5a 8452272 1 2023-12-07T16:21:43.165 INFO:tasks.workunit.client.0.smithi063.stdout:5/526: dread d1/f40 [0,4194304] 0 2023-12-07T16:21:43.165 INFO:tasks.workunit.client.0.smithi063.stdout:5/527: chown d1/d3/de/l9a 387913 1 2023-12-07T16:21:43.166 INFO:tasks.workunit.client.0.smithi063.stdout:5/528: readlink d1/d3/de/l96 0 2023-12-07T16:21:43.166 INFO:tasks.workunit.client.0.smithi063.stdout:5/529: write d1/d3/f8c [3071698,108577] 0 2023-12-07T16:21:43.166 INFO:tasks.workunit.client.1.smithi152.stdout:0/810: unlink d0/dc/d3d/c4b 0 2023-12-07T16:21:43.166 INFO:tasks.workunit.client.1.smithi152.stdout:6/753: dread d2/d4f/d83/d48/d70/da7/db7/fd2 [0,4194304] 0 2023-12-07T16:21:43.167 INFO:tasks.workunit.client.0.smithi063.stdout:5/530: link d1/d3/de/d1e/f27 d1/d31/d56/d61/d5e/d6a/f9b 0 2023-12-07T16:21:43.167 INFO:tasks.workunit.client.0.smithi063.stdout:5/531: chown d1/d3/de/l96 1 1 2023-12-07T16:21:43.167 INFO:tasks.workunit.client.1.smithi152.stdout:3/813: creat d7/d10/d1a/d25/d3f/dcf/dab/ffc x:0 0 0 2023-12-07T16:21:43.167 INFO:tasks.workunit.client.1.smithi152.stdout:3/814: chown d7/d10/d1a/d2f/d5c/df6/d6d/cf5 1339480 1 2023-12-07T16:21:43.168 INFO:tasks.workunit.client.0.smithi063.stdout:5/532: unlink d1/d3/de/d1e/l95 0 2023-12-07T16:21:43.168 INFO:tasks.workunit.client.0.smithi063.stdout:5/533: chown d1/d31/d56/d61/d5e/c8e 55168968 1 2023-12-07T16:21:43.169 INFO:tasks.workunit.client.0.smithi063.stdout:5/534: symlink d1/d3/l9c 0 2023-12-07T16:21:43.169 INFO:tasks.workunit.client.1.smithi152.stdout:0/811: creat d0/d27/d8c/df7/d30/d6e/d77/d9f/dcb/f118 x:0 0 0 2023-12-07T16:21:43.170 INFO:tasks.workunit.client.1.smithi152.stdout:0/812: write d0/d27/d8c/df7/d30/d6e/d77/d9f/dcb/f118 [149505,100739] 0 2023-12-07T16:21:43.170 INFO:tasks.workunit.client.1.smithi152.stdout:6/754: creat d2/d4f/d83/d85/d65/ff3 x:0 0 0 2023-12-07T16:21:43.170 INFO:tasks.workunit.client.0.smithi063.stdout:5/535: mkdir d1/d31/d56/d9d 0 2023-12-07T16:21:43.170 INFO:tasks.workunit.client.0.smithi063.stdout:5/536: readlink d1/d3/de/l96 0 2023-12-07T16:21:43.170 INFO:tasks.workunit.client.0.smithi063.stdout:5/537: chown d1/d3/d3a/d5a 12945 1 2023-12-07T16:21:43.171 INFO:tasks.workunit.client.0.smithi063.stdout:5/538: mknod d1/d3/d3a/d91/c9e 0 2023-12-07T16:21:43.185 INFO:tasks.workunit.client.1.smithi152.stdout:5/914: dwrite dd/d91/fa1 [0,4194304] 0 2023-12-07T16:21:43.188 INFO:tasks.workunit.client.0.smithi063.stdout:2/697: dwrite d0/d21/d56/d11/f99 [0,4194304] 0 2023-12-07T16:21:43.188 INFO:tasks.workunit.client.0.smithi063.stdout:7/496: dwrite d2/d34/d5a/d5f/d2a/f35 [0,4194304] 0 2023-12-07T16:21:43.190 INFO:tasks.workunit.client.0.smithi063.stdout:5/539: dread d1/f18 [0,4194304] 0 2023-12-07T16:21:43.192 INFO:tasks.workunit.client.0.smithi063.stdout:2/698: symlink d0/d21/d56/d11/d52/d5d/le0 0 2023-12-07T16:21:43.192 INFO:tasks.workunit.client.0.smithi063.stdout:2/699: truncate d0/d21/d56/d11/fdb 732795 0 2023-12-07T16:21:43.195 INFO:tasks.workunit.client.1.smithi152.stdout:4/745: dwrite d0/d81/fc6 [0,4194304] 0 2023-12-07T16:21:43.197 INFO:tasks.workunit.client.1.smithi152.stdout:4/746: creat d0/d3/d6/d2b/dd9/d3a/d46/dad/fda x:0 0 0 2023-12-07T16:21:43.197 INFO:tasks.workunit.client.1.smithi152.stdout:4/747: readlink d0/d3/l5a 0 2023-12-07T16:21:43.199 INFO:tasks.workunit.client.1.smithi152.stdout:4/748: link d0/d3/d6/d36/f44 d0/d3/d6/d2b/db1/fdb 0 2023-12-07T16:21:43.201 INFO:tasks.workunit.client.0.smithi063.stdout:5/540: rename d1/d31/f33 to d1/d3/de/d1e/f9f 0 2023-12-07T16:21:43.201 INFO:tasks.workunit.client.0.smithi063.stdout:5/541: stat d1/f32 0 2023-12-07T16:21:43.203 INFO:tasks.workunit.client.0.smithi063.stdout:7/497: dread d2/d34/d5a/f66 [0,4194304] 0 2023-12-07T16:21:43.203 INFO:tasks.workunit.client.0.smithi063.stdout:5/542: creat d1/d3/de/d1e/fa0 x:0 0 0 2023-12-07T16:21:43.204 INFO:tasks.workunit.client.0.smithi063.stdout:7/498: rename d2/d34/f54 to d2/d2c/d87/fbc 0 2023-12-07T16:21:43.204 INFO:tasks.workunit.client.0.smithi063.stdout:7/499: write d2/d21/f2d [5158674,65078] 0 2023-12-07T16:21:43.205 INFO:tasks.workunit.client.0.smithi063.stdout:7/500: symlink d2/d34/d5a/d5f/d61/lbd 0 2023-12-07T16:21:43.206 INFO:tasks.workunit.client.0.smithi063.stdout:5/543: read d1/f2a [5715110,30732] 0 2023-12-07T16:21:43.206 INFO:tasks.workunit.client.0.smithi063.stdout:7/501: getdents d2/d34/d5a/d5f/d2a/d7e 0 2023-12-07T16:21:43.213 INFO:tasks.workunit.client.1.smithi152.stdout:3/815: dwrite d7/d10/d1a/de8/ffa [0,4194304] 0 2023-12-07T16:21:43.220 INFO:tasks.workunit.client.1.smithi152.stdout:3/816: symlink d7/d10/lfd 0 2023-12-07T16:21:43.220 INFO:tasks.workunit.client.1.smithi152.stdout:3/817: chown d7/d10/d1a/d2f/d5c/db8 57878 1 2023-12-07T16:21:43.221 INFO:tasks.workunit.client.1.smithi152.stdout:3/818: fsync d7/d10/d1a/d2f/f22 0 2023-12-07T16:21:43.222 INFO:tasks.workunit.client.1.smithi152.stdout:5/915: dwrite dd/de/d14/d19/d7a/ff3 [0,4194304] 0 2023-12-07T16:21:43.223 INFO:tasks.workunit.client.1.smithi152.stdout:0/813: dwrite d0/d27/d8c/df7/f4d [0,4194304] 0 2023-12-07T16:21:43.223 INFO:tasks.workunit.client.1.smithi152.stdout:6/755: dwrite d2/d4f/d83/d48/f8d [4194304,4194304] 0 2023-12-07T16:21:43.230 INFO:tasks.workunit.client.1.smithi152.stdout:0/814: write d0/dc/d3d/dab/dc8/f112 [3348217,36269] 0 2023-12-07T16:21:43.231 INFO:tasks.workunit.client.1.smithi152.stdout:5/916: creat dd/de/d14/dc6/db0/f140 x:0 0 0 2023-12-07T16:21:43.231 INFO:tasks.workunit.client.1.smithi152.stdout:5/917: fsync dd/de/d8f/dc9/ffd 0 2023-12-07T16:21:43.231 INFO:tasks.workunit.client.1.smithi152.stdout:5/918: chown dd/de/d14/d19/d1a/f92 443950801 1 2023-12-07T16:21:43.232 INFO:tasks.workunit.client.1.smithi152.stdout:0/815: mknod d0/dc/d3d/d4c/c119 0 2023-12-07T16:21:43.232 INFO:tasks.workunit.client.1.smithi152.stdout:0/816: stat d0/dc/d36/d7d/d92/de9/lf5 0 2023-12-07T16:21:43.235 INFO:tasks.workunit.client.1.smithi152.stdout:0/817: rename d0/dc/d3d/dab/dc8/f109 to d0/d27/d8c/df7/d30/d6e/de0/f11a 0 2023-12-07T16:21:43.235 INFO:tasks.workunit.client.1.smithi152.stdout:5/919: creat dd/de/d14/d1f/f141 x:0 0 0 2023-12-07T16:21:43.235 INFO:tasks.workunit.client.1.smithi152.stdout:8/783: sync 2023-12-07T16:21:43.238 INFO:tasks.workunit.client.1.smithi152.stdout:5/920: rename dd/d7b/l11f to dd/de/d38/d3d/l142 0 2023-12-07T16:21:43.245 INFO:tasks.workunit.client.1.smithi152.stdout:7/721: sync 2023-12-07T16:21:43.245 INFO:tasks.workunit.client.1.smithi152.stdout:7/722: dread - db/d27/f7f zero size 2023-12-07T16:21:43.246 INFO:tasks.workunit.client.0.smithi063.stdout:2/700: dwrite d0/fa [0,4194304] 0 2023-12-07T16:21:43.247 INFO:tasks.workunit.client.1.smithi152.stdout:0/818: dread d0/dc/f3c [0,4194304] 0 2023-12-07T16:21:43.247 INFO:tasks.workunit.client.1.smithi152.stdout:0/819: read - d0/dc/d3d/fde zero size 2023-12-07T16:21:43.248 INFO:tasks.workunit.client.0.smithi063.stdout:2/701: creat d0/d67/d65/fe1 x:0 0 0 2023-12-07T16:21:43.249 INFO:tasks.workunit.client.1.smithi152.stdout:0/820: link d0/dc/d3d/d4c/f60 d0/dc/d3d/d4c/f11b 0 2023-12-07T16:21:43.249 INFO:tasks.workunit.client.1.smithi152.stdout:7/723: write db/d27/d39/f2f [3650433,115975] 0 2023-12-07T16:21:43.250 INFO:tasks.workunit.client.0.smithi063.stdout:2/702: mknod d0/d67/ce2 0 2023-12-07T16:21:43.252 INFO:tasks.workunit.client.1.smithi152.stdout:7/724: link db/d68/fbc db/d27/d39/d41/fe8 0 2023-12-07T16:21:43.253 INFO:tasks.workunit.client.0.smithi063.stdout:2/703: mknod d0/d67/d65/d6a/d8e/ce3 0 2023-12-07T16:21:43.253 INFO:tasks.workunit.client.0.smithi063.stdout:5/544: dwrite d1/d3/d3a/d5a/f7f [0,4194304] 0 2023-12-07T16:21:43.253 INFO:tasks.workunit.client.0.smithi063.stdout:5/545: write d1/d3/de/d1e/fa0 [861119,24330] 0 2023-12-07T16:21:43.254 INFO:tasks.workunit.client.1.smithi152.stdout:5/921: dread dd/de/d8f/dc9/ffd [0,4194304] 0 2023-12-07T16:21:43.254 INFO:tasks.workunit.client.1.smithi152.stdout:5/922: truncate dd/de/d14/dc6/f108 5135945 0 2023-12-07T16:21:43.254 INFO:tasks.workunit.client.1.smithi152.stdout:7/725: symlink db/d27/d4d/le9 0 2023-12-07T16:21:43.254 INFO:tasks.workunit.client.1.smithi152.stdout:7/726: chown db/d27/d39/d41/d58/d80/dac 97289 1 2023-12-07T16:21:43.254 INFO:tasks.workunit.client.1.smithi152.stdout:5/923: mkdir dd/de/d14/d67/d138/d123/d143 0 2023-12-07T16:21:43.255 INFO:tasks.workunit.client.1.smithi152.stdout:5/924: write dd/d91/dbe/fc8 [639410,82428] 0 2023-12-07T16:21:43.255 INFO:tasks.workunit.client.0.smithi063.stdout:2/704: getdents d0/d21/d56 0 2023-12-07T16:21:43.256 INFO:tasks.workunit.client.1.smithi152.stdout:7/727: rename db/d68/l98 to db/d27/d39/d41/d58/lea 0 2023-12-07T16:21:43.257 INFO:tasks.workunit.client.1.smithi152.stdout:5/925: creat dd/de/d14/d19/d1a/def/d11a/f144 x:0 0 0 2023-12-07T16:21:43.258 INFO:tasks.workunit.client.1.smithi152.stdout:5/926: write dd/d91/dbe/d10e/f44 [583197,18840] 0 2023-12-07T16:21:43.258 INFO:tasks.workunit.client.1.smithi152.stdout:5/927: truncate dd/de/d14/d1f/f106 694136 0 2023-12-07T16:21:43.258 INFO:tasks.workunit.client.1.smithi152.stdout:5/928: chown dd/de/d38/d3d/d6d/dae/de0/fe8 228252409 1 2023-12-07T16:21:43.258 INFO:tasks.workunit.client.1.smithi152.stdout:5/929: dread - dd/de/d14/dc6/db0/f140 zero size 2023-12-07T16:21:43.258 INFO:tasks.workunit.client.1.smithi152.stdout:7/728: creat db/d27/d39/d41/d58/da5/dde/de7/feb x:0 0 0 2023-12-07T16:21:43.258 INFO:tasks.workunit.client.1.smithi152.stdout:7/729: dread - db/d27/d39/d41/fe8 zero size 2023-12-07T16:21:43.259 INFO:tasks.workunit.client.0.smithi063.stdout:5/546: truncate d1/d31/d56/d61/f57 2435725 0 2023-12-07T16:21:43.259 INFO:tasks.workunit.client.0.smithi063.stdout:2/705: getdents d0/d67/d65/d6a 0 2023-12-07T16:21:43.260 INFO:tasks.workunit.client.1.smithi152.stdout:5/930: creat dd/de/d14/d19/da3/d114/f145 x:0 0 0 2023-12-07T16:21:43.260 INFO:tasks.workunit.client.1.smithi152.stdout:8/784: dwrite d3/f1d [0,4194304] 0 2023-12-07T16:21:43.261 INFO:tasks.workunit.client.1.smithi152.stdout:3/819: dwrite d7/dc/d14/f39 [0,4194304] 0 2023-12-07T16:21:43.261 INFO:tasks.workunit.client.1.smithi152.stdout:0/821: dread d0/dc/d3d/d4c/fa1 [0,4194304] 0 2023-12-07T16:21:43.261 INFO:tasks.workunit.client.0.smithi063.stdout:5/547: creat d1/d3/de/d1e/fa1 x:0 0 0 2023-12-07T16:21:43.261 INFO:tasks.workunit.client.0.smithi063.stdout:7/502: dwrite d2/d34/d46/d48/d56/f73 [0,4194304] 0 2023-12-07T16:21:43.262 INFO:tasks.workunit.client.0.smithi063.stdout:7/503: getdents d2/d34/d46/d48/d70/daf 0 2023-12-07T16:21:43.262 INFO:tasks.workunit.client.0.smithi063.stdout:7/504: write d2/d34/d5a/d5f/d53/f60 [163321,109918] 0 2023-12-07T16:21:43.262 INFO:tasks.workunit.client.1.smithi152.stdout:7/730: mknod db/d27/d39/d41/cec 0 2023-12-07T16:21:43.262 INFO:tasks.workunit.client.1.smithi152.stdout:6/756: dwrite d2/d4f/d83/d85/f95 [0,4194304] 0 2023-12-07T16:21:43.264 INFO:tasks.workunit.client.0.smithi063.stdout:7/505: mkdir d2/d2c/dbe 0 2023-12-07T16:21:43.264 INFO:tasks.workunit.client.1.smithi152.stdout:5/931: symlink dd/de/d38/d3d/d6d/dae/d112/d122/l146 0 2023-12-07T16:21:43.267 INFO:tasks.workunit.client.0.smithi063.stdout:7/506: rename d2/d34/f3c to d2/d34/d5a/d5f/d53/fbf 0 2023-12-07T16:21:43.267 INFO:tasks.workunit.client.1.smithi152.stdout:0/822: link d0/dc/d3d/d73/dbf/dc9/lee d0/d27/d8c/df7/d30/d6e/d77/l11c 0 2023-12-07T16:21:43.267 INFO:tasks.workunit.client.1.smithi152.stdout:0/823: chown d0/dc/d3d/d4c 313872 1 2023-12-07T16:21:43.269 INFO:tasks.workunit.client.1.smithi152.stdout:5/932: dread dd/de/f132 [0,4194304] 0 2023-12-07T16:21:43.273 INFO:tasks.workunit.client.0.smithi063.stdout:9/502: sync 2023-12-07T16:21:43.274 INFO:tasks.workunit.client.0.smithi063.stdout:7/507: write d2/d34/d46/d48/d56/f73 [95021,79033] 0 2023-12-07T16:21:43.277 INFO:tasks.workunit.client.1.smithi152.stdout:6/757: creat d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/ff4 x:0 0 0 2023-12-07T16:21:43.277 INFO:tasks.workunit.client.1.smithi152.stdout:6/758: chown d2/f5 251369234 1 2023-12-07T16:21:43.277 INFO:tasks.workunit.client.1.smithi152.stdout:6/759: stat d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c 0 2023-12-07T16:21:43.278 INFO:tasks.workunit.client.0.smithi063.stdout:7/508: creat d2/d34/d46/d48/d70/fc0 x:0 0 0 2023-12-07T16:21:43.278 INFO:tasks.workunit.client.0.smithi063.stdout:7/509: write d2/d34/d5a/d5f/f4d [438361,53825] 0 2023-12-07T16:21:43.278 INFO:tasks.workunit.client.1.smithi152.stdout:5/933: unlink fc 0 2023-12-07T16:21:43.279 INFO:tasks.workunit.client.1.smithi152.stdout:8/785: dread d3/d4/d9/dc/d6f/d7b/d7e/d85/f8c [0,4194304] 0 2023-12-07T16:21:43.279 INFO:tasks.workunit.client.1.smithi152.stdout:8/786: readlink d3/d1e/d55/d83/dde/lff 0 2023-12-07T16:21:43.279 INFO:tasks.workunit.client.1.smithi152.stdout:8/787: chown d3/d4/d9/d34/f113 6857984 1 2023-12-07T16:21:43.279 INFO:tasks.workunit.client.1.smithi152.stdout:8/788: dread - d3/d4/d9/dc/d6f/d7a/d8a/f62 zero size 2023-12-07T16:21:43.280 INFO:tasks.workunit.client.1.smithi152.stdout:6/760: truncate d2/d4f/d83/d85/d94/fb1 4976032 0 2023-12-07T16:21:43.280 INFO:tasks.workunit.client.1.smithi152.stdout:6/761: chown d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/f82 4651629 1 2023-12-07T16:21:43.282 INFO:tasks.workunit.client.1.smithi152.stdout:8/789: mkdir d3/d1e/d55/d83/dde/d11d 0 2023-12-07T16:21:43.283 INFO:tasks.workunit.client.0.smithi063.stdout:9/503: write d0/f3 [640828,42509] 0 2023-12-07T16:21:43.284 INFO:tasks.workunit.client.1.smithi152.stdout:6/762: link d2/d4f/d83/d85/d19/l77 d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/lf5 0 2023-12-07T16:21:43.284 INFO:tasks.workunit.client.0.smithi063.stdout:7/510: write d2/d34/d5a/d5f/f3e [2174343,114258] 0 2023-12-07T16:21:43.286 INFO:tasks.workunit.client.1.smithi152.stdout:6/763: read d2/d4f/d83/d48/d70/da7/db7/fd2 [888335,92045] 0 2023-12-07T16:21:43.286 INFO:tasks.workunit.client.1.smithi152.stdout:8/790: unlink d3/d4/d9/dc/d6f/d7b/d7e/cda 0 2023-12-07T16:21:43.286 INFO:tasks.workunit.client.0.smithi063.stdout:9/504: symlink d0/d21/d64/d6a/la5 0 2023-12-07T16:21:43.287 INFO:tasks.workunit.client.1.smithi152.stdout:8/791: mknod d3/d4/d9/df7/c11e 0 2023-12-07T16:21:43.290 INFO:tasks.workunit.client.1.smithi152.stdout:8/792: mknod d3/d4/d9/df7/c11f 0 2023-12-07T16:21:43.290 INFO:tasks.workunit.client.1.smithi152.stdout:8/793: chown d3/d4/d9/dc 21 1 2023-12-07T16:21:43.290 INFO:tasks.workunit.client.0.smithi063.stdout:7/511: symlink d2/d2c/d87/lc1 0 2023-12-07T16:21:43.290 INFO:tasks.workunit.client.0.smithi063.stdout:9/505: rmdir d0/d8d 39 2023-12-07T16:21:43.294 INFO:tasks.workunit.client.0.smithi063.stdout:7/512: mkdir d2/d34/dc2 0 2023-12-07T16:21:43.294 INFO:tasks.workunit.client.0.smithi063.stdout:7/513: dread - d2/d2c/fa9 zero size 2023-12-07T16:21:43.295 INFO:tasks.workunit.client.0.smithi063.stdout:7/514: rmdir d2/d34/d5a/d5f/d6d 39 2023-12-07T16:21:43.295 INFO:tasks.workunit.client.0.smithi063.stdout:9/506: dread d0/d21/f71 [0,4194304] 0 2023-12-07T16:21:43.295 INFO:tasks.workunit.client.0.smithi063.stdout:7/515: symlink d2/d21/lc3 0 2023-12-07T16:21:43.296 INFO:tasks.workunit.client.0.smithi063.stdout:9/507: mknod d0/d13/d6f/d9b/ca6 0 2023-12-07T16:21:43.297 INFO:tasks.workunit.client.1.smithi152.stdout:8/794: dread d3/d4/d9/f33 [0,4194304] 0 2023-12-07T16:21:43.298 INFO:tasks.workunit.client.0.smithi063.stdout:7/516: creat d2/d37/da0/fc4 x:0 0 0 2023-12-07T16:21:43.298 INFO:tasks.workunit.client.1.smithi152.stdout:8/795: mkdir d3/d4/d9/d34/d120 0 2023-12-07T16:21:43.299 INFO:tasks.workunit.client.0.smithi063.stdout:7/517: symlink d2/d34/d5a/d5f/d6d/lc5 0 2023-12-07T16:21:43.299 INFO:tasks.workunit.client.0.smithi063.stdout:7/518: chown d2/d37/da0 680 1 2023-12-07T16:21:43.300 INFO:tasks.workunit.client.0.smithi063.stdout:7/519: mkdir d2/d21/dc6 0 2023-12-07T16:21:43.300 INFO:tasks.workunit.client.1.smithi152.stdout:8/796: link d3/d4/d9/dc/d6f/d7b/d7e/df5/d7c/cc1 d3/d1e/d55/c121 0 2023-12-07T16:21:43.300 INFO:tasks.workunit.client.1.smithi152.stdout:6/764: dread d2/d4f/d83/d85/d9/f35 [0,4194304] 0 2023-12-07T16:21:43.301 INFO:tasks.workunit.client.1.smithi152.stdout:6/765: rmdir d2/d4f/d83/d85/d94 39 2023-12-07T16:21:43.305 INFO:tasks.workunit.client.1.smithi152.stdout:8/797: read d3/d1e/f9c [3322859,114197] 0 2023-12-07T16:21:43.305 INFO:tasks.workunit.client.1.smithi152.stdout:3/820: dwrite d7/d10/d19/f5b [0,4194304] 0 2023-12-07T16:21:43.307 INFO:tasks.workunit.client.1.smithi152.stdout:8/798: mknod d3/d4/d9/dc/d6f/d7b/d7e/df5/d67/dd4/c122 0 2023-12-07T16:21:43.308 INFO:tasks.workunit.client.1.smithi152.stdout:3/821: symlink d7/d10/d1a/d2f/d5c/dbf/lfe 0 2023-12-07T16:21:43.311 INFO:tasks.workunit.client.1.smithi152.stdout:8/799: mkdir d3/d1e/d55/d83/dc5/d123 0 2023-12-07T16:21:43.313 INFO:tasks.workunit.client.1.smithi152.stdout:0/824: dwrite d0/f49 [0,4194304] 0 2023-12-07T16:21:43.314 INFO:tasks.workunit.client.1.smithi152.stdout:3/822: mknod d7/d10/d1a/d2f/d5c/df6/d6d/cff 0 2023-12-07T16:21:43.314 INFO:tasks.workunit.client.1.smithi152.stdout:3/823: getdents d7/d10/d1a/d25/d78/dd4 0 2023-12-07T16:21:43.314 INFO:tasks.workunit.client.1.smithi152.stdout:3/824: fdatasync d7/d10/d1a/d2f/d56/d57/dee/dda/f53 0 2023-12-07T16:21:43.314 INFO:tasks.workunit.client.1.smithi152.stdout:3/825: write d7/d10/d1a/d25/d3f/dcf/fb3 [1744578,86937] 0 2023-12-07T16:21:43.314 INFO:tasks.workunit.client.1.smithi152.stdout:7/731: dwrite db/d27/d39/d41/f4f [4194304,4194304] 0 2023-12-07T16:21:43.316 INFO:tasks.workunit.client.0.smithi063.stdout:9/508: dread d0/f1a [4194304,4194304] 0 2023-12-07T16:21:43.317 INFO:tasks.workunit.client.0.smithi063.stdout:9/509: creat d0/d13/d39/fa7 x:0 0 0 2023-12-07T16:21:43.317 INFO:tasks.workunit.client.0.smithi063.stdout:9/510: chown d0/d21/d64/d6a 1642390 1 2023-12-07T16:21:43.317 INFO:tasks.workunit.client.0.smithi063.stdout:9/511: chown d0/c6 147284 1 2023-12-07T16:21:43.318 INFO:tasks.workunit.client.1.smithi152.stdout:0/825: getdents d0/d27/d8c/df7/d30/d6e/d77/d9f 0 2023-12-07T16:21:43.318 INFO:tasks.workunit.client.1.smithi152.stdout:0/826: chown d0/la 3 1 2023-12-07T16:21:43.318 INFO:tasks.workunit.client.0.smithi063.stdout:9/512: mknod d0/d21/d64/d6a/d8f/d92/ca8 0 2023-12-07T16:21:43.320 INFO:tasks.workunit.client.1.smithi152.stdout:5/934: dwrite dd/de/d38/d3d/d6d/dae/f12a [0,4194304] 0 2023-12-07T16:21:43.320 INFO:tasks.workunit.client.1.smithi152.stdout:5/935: chown dd/de/d38/d3d/l98 0 1 2023-12-07T16:21:43.320 INFO:tasks.workunit.client.1.smithi152.stdout:3/826: mkdir d7/d10/d1a/d2f/d5c/df6/d100 0 2023-12-07T16:21:43.320 INFO:tasks.workunit.client.1.smithi152.stdout:3/827: fsync d7/d10/d41/fdc 0 2023-12-07T16:21:43.321 INFO:tasks.workunit.client.0.smithi063.stdout:5/548: dwrite d1/d3/d3a/d5a/f7f [0,4194304] 0 2023-12-07T16:21:43.324 INFO:tasks.workunit.client.0.smithi063.stdout:5/549: read d1/f34 [1181398,28879] 0 2023-12-07T16:21:43.324 INFO:tasks.workunit.client.0.smithi063.stdout:7/520: dwrite d2/d21/f29 [0,4194304] 0 2023-12-07T16:21:43.324 INFO:tasks.workunit.client.0.smithi063.stdout:7/521: write d2/d21/f49 [686426,1884] 0 2023-12-07T16:21:43.325 INFO:tasks.workunit.client.0.smithi063.stdout:7/522: rmdir d2/d34/d46/d48/d70 39 2023-12-07T16:21:43.327 INFO:tasks.workunit.client.0.smithi063.stdout:7/523: mknod d2/d64/cc7 0 2023-12-07T16:21:43.327 INFO:tasks.workunit.client.1.smithi152.stdout:7/732: creat db/d27/d39/d41/d58/da5/dde/de7/fed x:0 0 0 2023-12-07T16:21:43.328 INFO:tasks.workunit.client.1.smithi152.stdout:0/827: symlink d0/d27/d8c/df7/d30/d6e/de0/l11d 0 2023-12-07T16:21:43.328 INFO:tasks.workunit.client.1.smithi152.stdout:0/828: chown d0/d27/d8c/df7/l33 2843950 1 2023-12-07T16:21:43.328 INFO:tasks.workunit.client.1.smithi152.stdout:0/829: truncate d0/dc/d26/f41 601210 0 2023-12-07T16:21:43.329 INFO:tasks.workunit.client.1.smithi152.stdout:3/828: mkdir d7/d10/d1a/d2f/d5c/ddd/d101 0 2023-12-07T16:21:43.331 INFO:tasks.workunit.client.1.smithi152.stdout:0/830: symlink d0/d27/dd7/l11e 0 2023-12-07T16:21:43.331 INFO:tasks.workunit.client.1.smithi152.stdout:0/831: truncate d0/fc2 953908 0 2023-12-07T16:21:43.331 INFO:tasks.workunit.client.1.smithi152.stdout:5/936: dread dd/de/d14/d19/d7a/ff3 [0,4194304] 0 2023-12-07T16:21:43.332 INFO:tasks.workunit.client.0.smithi063.stdout:7/524: dread d2/d2c/fba [0,4194304] 0 2023-12-07T16:21:43.332 INFO:tasks.workunit.client.1.smithi152.stdout:3/829: symlink d7/d10/d1a/d25/d4b/l102 0 2023-12-07T16:21:43.332 INFO:tasks.workunit.client.0.smithi063.stdout:7/525: creat d2/d34/d5a/d5f/d53/da3/fc8 x:0 0 0 2023-12-07T16:21:43.334 INFO:tasks.workunit.client.0.smithi063.stdout:7/526: mkdir d2/d34/d5a/d5f/d2a/dc9 0 2023-12-07T16:21:43.334 INFO:tasks.workunit.client.1.smithi152.stdout:0/832: mkdir d0/d27/de6/d11f 0 2023-12-07T16:21:43.334 INFO:tasks.workunit.client.1.smithi152.stdout:5/937: truncate dd/de/d14/dc6/db0/fe9 8345649 0 2023-12-07T16:21:43.335 INFO:tasks.workunit.client.0.smithi063.stdout:7/527: symlink d2/d34/d5a/d5f/d78/d7c/lca 0 2023-12-07T16:21:43.335 INFO:tasks.workunit.client.0.smithi063.stdout:5/550: dread d1/d3/de/d1e/d25/f3c [0,4194304] 0 2023-12-07T16:21:43.335 INFO:tasks.workunit.client.1.smithi152.stdout:0/833: write d0/f1a [363704,15461] 0 2023-12-07T16:21:43.337 INFO:tasks.workunit.client.0.smithi063.stdout:5/551: creat d1/d31/d56/d61/d5e/d6a/d7e/fa2 x:0 0 0 2023-12-07T16:21:43.337 INFO:tasks.workunit.client.1.smithi152.stdout:6/766: dwrite d2/d4f/d83/d85/d19/d1f/dc7/dc9/f61 [0,4194304] 0 2023-12-07T16:21:43.337 INFO:tasks.workunit.client.1.smithi152.stdout:7/733: write db/d27/d5e/f48 [3181597,23545] 0 2023-12-07T16:21:43.338 INFO:tasks.workunit.client.1.smithi152.stdout:7/734: fsync db/d27/d5e/f8b 0 2023-12-07T16:21:43.338 INFO:tasks.workunit.client.1.smithi152.stdout:7/735: fdatasync db/d27/d39/d41/d37/f3f 0 2023-12-07T16:21:43.339 INFO:tasks.workunit.client.0.smithi063.stdout:9/513: dwrite d0/f73 [0,4194304] 0 2023-12-07T16:21:43.340 INFO:tasks.workunit.client.1.smithi152.stdout:5/938: rename dd/d91/dbe/f12e to dd/de/d14/f147 0 2023-12-07T16:21:43.341 INFO:tasks.workunit.client.1.smithi152.stdout:2/754: sync 2023-12-07T16:21:43.341 INFO:tasks.workunit.client.1.smithi152.stdout:0/834: truncate d0/d27/f59 3427688 0 2023-12-07T16:21:43.341 INFO:tasks.workunit.client.1.smithi152.stdout:0/835: stat d0/dc/d36/d3a/d51/d82/fb9 0 2023-12-07T16:21:43.341 INFO:tasks.workunit.client.1.smithi152.stdout:0/836: readlink d0/dc/d3d/l7f 0 2023-12-07T16:21:43.342 INFO:tasks.workunit.client.1.smithi152.stdout:6/767: mknod d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/cf6 0 2023-12-07T16:21:43.345 INFO:tasks.workunit.client.1.smithi152.stdout:7/736: truncate db/d27/d39/d41/d37/f67 2277515 0 2023-12-07T16:21:43.345 INFO:tasks.workunit.client.1.smithi152.stdout:7/737: dread - db/d27/d39/fe1 zero size 2023-12-07T16:21:43.345 INFO:tasks.workunit.client.1.smithi152.stdout:7/738: chown db/d27/d39/f66 3 1 2023-12-07T16:21:43.345 INFO:tasks.workunit.client.1.smithi152.stdout:7/739: readlink db/l97 0 2023-12-07T16:21:43.345 INFO:tasks.workunit.client.1.smithi152.stdout:7/740: write db/d27/f91 [1156698,15398] 0 2023-12-07T16:21:43.348 INFO:tasks.workunit.client.0.smithi063.stdout:5/552: dread d1/f5c [0,4194304] 0 2023-12-07T16:21:43.351 INFO:tasks.workunit.client.0.smithi063.stdout:7/528: dread d2/f36 [0,4194304] 0 2023-12-07T16:21:43.351 INFO:tasks.workunit.client.0.smithi063.stdout:7/529: readlink d2/l22 0 2023-12-07T16:21:43.352 INFO:tasks.workunit.client.1.smithi152.stdout:3/830: dwrite d7/d10/d1a/d2f/d56/d57/dee/dda/d6b/d80/dc2/fc8 [0,4194304] 0 2023-12-07T16:21:43.353 INFO:tasks.workunit.client.1.smithi152.stdout:2/755: symlink d2/d1c/d2e/d57/d5b/da7/ddd/l100 0 2023-12-07T16:21:43.354 INFO:tasks.workunit.client.1.smithi152.stdout:0/837: mkdir d0/dc/d36/d7d/d120 0 2023-12-07T16:21:43.356 INFO:tasks.workunit.client.1.smithi152.stdout:6/768: symlink d2/d4f/d83/d48/lf7 0 2023-12-07T16:21:43.356 INFO:tasks.workunit.client.1.smithi152.stdout:6/769: fsync d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/d5d/fb8 0 2023-12-07T16:21:43.357 INFO:tasks.workunit.client.0.smithi063.stdout:5/553: truncate d1/f7 2194356 0 2023-12-07T16:21:43.357 INFO:tasks.workunit.client.1.smithi152.stdout:7/741: mkdir db/d27/d5e/dee 0 2023-12-07T16:21:43.357 INFO:tasks.workunit.client.1.smithi152.stdout:7/742: readlink db/d27/lc0 0 2023-12-07T16:21:43.358 INFO:tasks.workunit.client.0.smithi063.stdout:9/514: dwrite d0/d13/d39/d3a/d78/f8a [0,4194304] 0 2023-12-07T16:21:43.358 INFO:tasks.workunit.client.0.smithi063.stdout:7/530: getdents d2/d34/d5a/d5f/d53/dab 0 2023-12-07T16:21:43.358 INFO:tasks.workunit.client.0.smithi063.stdout:5/554: read d1/d3/f35 [1482051,75951] 0 2023-12-07T16:21:43.359 INFO:tasks.workunit.client.1.smithi152.stdout:0/838: write d0/dc/d3d/d4c/f84 [2365015,55603] 0 2023-12-07T16:21:43.359 INFO:tasks.workunit.client.1.smithi152.stdout:0/839: truncate d0/dc/d36/d3a/dca/f110 830053 0 2023-12-07T16:21:43.359 INFO:tasks.workunit.client.1.smithi152.stdout:0/840: fdatasync d0/dc/d26/fb1 0 2023-12-07T16:21:43.361 INFO:tasks.workunit.client.1.smithi152.stdout:3/831: creat d7/d10/dd0/f103 x:0 0 0 2023-12-07T16:21:43.363 INFO:tasks.workunit.client.0.smithi063.stdout:7/531: dread d2/f36 [0,4194304] 0 2023-12-07T16:21:43.363 INFO:tasks.workunit.client.0.smithi063.stdout:7/532: chown d2/d34/d5a/d5f/d6d/c97 65494 1 2023-12-07T16:21:43.364 INFO:tasks.workunit.client.1.smithi152.stdout:6/770: mkdir d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/d5d/df8 0 2023-12-07T16:21:43.366 INFO:tasks.workunit.client.1.smithi152.stdout:7/743: unlink db/d27/d39/d41/d37/f71 0 2023-12-07T16:21:43.367 INFO:tasks.workunit.client.0.smithi063.stdout:9/515: mkdir d0/da9 0 2023-12-07T16:21:43.367 INFO:tasks.workunit.client.1.smithi152.stdout:0/841: creat d0/dc/d3d/d73/dbf/dc9/f121 x:0 0 0 2023-12-07T16:21:43.368 INFO:tasks.workunit.client.1.smithi152.stdout:3/832: symlink d7/d10/dd0/l104 0 2023-12-07T16:21:43.368 INFO:tasks.workunit.client.1.smithi152.stdout:3/833: readlink d7/d10/d1a/d25/d4b/ldb 0 2023-12-07T16:21:43.369 INFO:tasks.workunit.client.0.smithi063.stdout:5/555: unlink d1/d31/l44 0 2023-12-07T16:21:43.369 INFO:tasks.workunit.client.1.smithi152.stdout:2/756: creat d2/d1c/d2e/d57/d5b/da7/d8a/f101 x:0 0 0 2023-12-07T16:21:43.370 INFO:tasks.workunit.client.0.smithi063.stdout:7/533: mknod d2/d34/d5a/d5f/d2a/d7e/ccb 0 2023-12-07T16:21:43.370 INFO:tasks.workunit.client.0.smithi063.stdout:9/516: stat d0/d13/d39/d42/c5c 0 2023-12-07T16:21:43.371 INFO:tasks.workunit.client.1.smithi152.stdout:6/771: mkdir d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/df9 0 2023-12-07T16:21:43.371 INFO:tasks.workunit.client.1.smithi152.stdout:6/772: stat d2/d4f/d83/d85/d9/l2b 0 2023-12-07T16:21:43.372 INFO:tasks.workunit.client.0.smithi063.stdout:9/517: creat d0/d13/d6f/faa x:0 0 0 2023-12-07T16:21:43.372 INFO:tasks.workunit.client.0.smithi063.stdout:9/518: dread - d0/d13/d6f/f7d zero size 2023-12-07T16:21:43.372 INFO:tasks.workunit.client.0.smithi063.stdout:9/519: chown d0/d21/d64/d6a/d85/da4 6 1 2023-12-07T16:21:43.372 INFO:tasks.workunit.client.0.smithi063.stdout:9/520: readlink d0/d13/d39/l9c 0 2023-12-07T16:21:43.374 INFO:tasks.workunit.client.1.smithi152.stdout:7/744: truncate db/d27/d39/f2f 3134663 0 2023-12-07T16:21:43.376 INFO:tasks.workunit.client.1.smithi152.stdout:0/842: creat d0/d27/de6/f122 x:0 0 0 2023-12-07T16:21:43.378 INFO:tasks.workunit.client.1.smithi152.stdout:3/834: mknod d7/d10/d1a/d2f/d5c/df6/d6d/d81/c105 0 2023-12-07T16:21:43.379 INFO:tasks.workunit.client.1.smithi152.stdout:2/757: mkdir d2/d1c/d2e/d57/d5b/da7/d9a/dcb/d102 0 2023-12-07T16:21:43.379 INFO:tasks.workunit.client.0.smithi063.stdout:9/521: symlink d0/d21/d64/lab 0 2023-12-07T16:21:43.381 INFO:tasks.workunit.client.1.smithi152.stdout:7/745: dread db/d27/d4d/f88 [0,4194304] 0 2023-12-07T16:21:43.381 INFO:tasks.workunit.client.1.smithi152.stdout:0/843: symlink d0/d27/d11/d68/l123 0 2023-12-07T16:21:43.381 INFO:tasks.workunit.client.1.smithi152.stdout:0/844: fsync d0/dc/d3d/dab/fb6 0 2023-12-07T16:21:43.382 INFO:tasks.workunit.client.0.smithi063.stdout:7/534: dread d2/d21/f29 [0,4194304] 0 2023-12-07T16:21:43.383 INFO:tasks.workunit.client.1.smithi152.stdout:3/835: creat d7/d10/d1a/d25/d4b/f106 x:0 0 0 2023-12-07T16:21:43.384 INFO:tasks.workunit.client.0.smithi063.stdout:7/535: unlink d2/d34/d46/d48/d56/f95 0 2023-12-07T16:21:43.384 INFO:tasks.workunit.client.0.smithi063.stdout:7/536: fdatasync d2/fd 0 2023-12-07T16:21:43.386 INFO:tasks.workunit.client.0.smithi063.stdout:5/556: dwrite d1/d31/d56/f67 [0,4194304] 0 2023-12-07T16:21:43.386 INFO:tasks.workunit.client.1.smithi152.stdout:2/758: unlink d2/d1c/l79 0 2023-12-07T16:21:43.386 INFO:tasks.workunit.client.1.smithi152.stdout:2/759: chown d2/d9/d51/d54 6758 1 2023-12-07T16:21:43.387 INFO:tasks.workunit.client.1.smithi152.stdout:2/760: write d2/d1c/d2e/d30/d33/f40 [4473994,2221] 0 2023-12-07T16:21:43.387 INFO:tasks.workunit.client.1.smithi152.stdout:2/761: readlink d2/l12 0 2023-12-07T16:21:43.389 INFO:tasks.workunit.client.0.smithi063.stdout:5/557: creat d1/d31/d56/d61/d5e/d6a/fa3 x:0 0 0 2023-12-07T16:21:43.389 INFO:tasks.workunit.client.1.smithi152.stdout:7/746: truncate db/d27/d39/d41/d37/f3f 1949290 0 2023-12-07T16:21:43.390 INFO:tasks.workunit.client.1.smithi152.stdout:0/845: getdents d0/d27/d8c/df7/d30/d6e 0 2023-12-07T16:21:43.390 INFO:tasks.workunit.client.1.smithi152.stdout:7/747: chown db/d27/d39 0 1 2023-12-07T16:21:43.391 INFO:tasks.workunit.client.0.smithi063.stdout:5/558: getdents d1/d31/d56/d61/d5e/d6a/d7e 0 2023-12-07T16:21:43.393 INFO:tasks.workunit.client.1.smithi152.stdout:3/836: symlink d7/d10/d1a/d2f/d5c/df6/d6d/l107 0 2023-12-07T16:21:43.394 INFO:tasks.workunit.client.1.smithi152.stdout:0/846: symlink d0/dc/d36/d3a/d51/d82/dae/l124 0 2023-12-07T16:21:43.398 INFO:tasks.workunit.client.1.smithi152.stdout:0/847: dread d0/dc/d36/d3a/d69/fe5 [0,4194304] 0 2023-12-07T16:21:43.399 INFO:tasks.workunit.client.0.smithi063.stdout:8/728: sync 2023-12-07T16:21:43.399 INFO:tasks.workunit.client.0.smithi063.stdout:6/644: sync 2023-12-07T16:21:43.400 INFO:tasks.workunit.client.0.smithi063.stdout:4/467: sync 2023-12-07T16:21:43.400 INFO:tasks.workunit.client.0.smithi063.stdout:3/579: sync 2023-12-07T16:21:43.400 INFO:tasks.workunit.client.0.smithi063.stdout:0/614: sync 2023-12-07T16:21:43.400 INFO:tasks.workunit.client.1.smithi152.stdout:5/939: getdents dd/de 0 2023-12-07T16:21:43.400 INFO:tasks.workunit.client.1.smithi152.stdout:5/940: fdatasync dd/de/d14/d19/f64 0 2023-12-07T16:21:43.403 INFO:tasks.workunit.client.0.smithi063.stdout:4/468: unlink d1/d3/db/d16/f37 0 2023-12-07T16:21:43.403 INFO:tasks.workunit.client.1.smithi152.stdout:0/848: truncate d0/f18 1744522 0 2023-12-07T16:21:43.404 INFO:tasks.workunit.client.0.smithi063.stdout:8/729: link d7/d38/cb5 d7/d38/d73/ce5 0 2023-12-07T16:21:43.405 INFO:tasks.workunit.client.0.smithi063.stdout:3/580: mkdir d7/d49/dbf 0 2023-12-07T16:21:43.410 INFO:tasks.workunit.client.0.smithi063.stdout:8/730: write d7/d14/d15/d2b/f59 [350971,13623] 0 2023-12-07T16:21:43.412 INFO:tasks.workunit.client.0.smithi063.stdout:0/615: link d4/dd/de/d15/f8c d4/dd/d26/d2b/db5/d5b/fce 0 2023-12-07T16:21:43.412 INFO:tasks.workunit.client.0.smithi063.stdout:3/581: mknod d7/d4f/d53/d72/db1/cc0 0 2023-12-07T16:21:43.414 INFO:tasks.workunit.client.1.smithi152.stdout:5/941: dread dd/de/d14/d19/d1a/dcc/feb [0,4194304] 0 2023-12-07T16:21:43.414 INFO:tasks.workunit.client.1.smithi152.stdout:5/942: stat dd/d7b/dbf/f102 0 2023-12-07T16:21:43.418 INFO:tasks.workunit.client.0.smithi063.stdout:8/731: rename d7/d14/d15/cdf to d7/d14/d1a/dce/ce6 0 2023-12-07T16:21:43.419 INFO:tasks.workunit.client.0.smithi063.stdout:0/616: mknod d4/dd/de/d15/d1f/d4c/da1/ccf 0 2023-12-07T16:21:43.421 INFO:tasks.workunit.client.0.smithi063.stdout:3/582: truncate d7/d49/fb4 1372679 0 2023-12-07T16:21:43.421 INFO:tasks.workunit.client.0.smithi063.stdout:3/583: stat d7/d4f/d53/d72/db1/d41/l92 0 2023-12-07T16:21:43.421 INFO:tasks.workunit.client.0.smithi063.stdout:3/584: chown d7/d9/dd/c28 24 1 2023-12-07T16:21:43.421 INFO:tasks.workunit.client.0.smithi063.stdout:8/732: rmdir d7 39 2023-12-07T16:21:43.427 INFO:tasks.workunit.client.1.smithi152.stdout:3/837: dread d7/d10/d19/f5b [0,4194304] 0 2023-12-07T16:21:43.430 INFO:tasks.workunit.client.0.smithi063.stdout:3/585: creat d7/d9/dd/fc1 x:0 0 0 2023-12-07T16:21:43.430 INFO:tasks.workunit.client.0.smithi063.stdout:0/617: symlink d4/dd/de/d15/d59/d43/ld0 0 2023-12-07T16:21:43.430 INFO:tasks.workunit.client.0.smithi063.stdout:3/586: truncate d7/d9/f27 5112465 0 2023-12-07T16:21:43.430 INFO:tasks.workunit.client.0.smithi063.stdout:3/587: write d7/d4f/d53/d72/d7d/fbc [1121113,92082] 0 2023-12-07T16:21:43.430 INFO:tasks.workunit.client.0.smithi063.stdout:3/588: chown d7/d4f/d53/d72/db1/f9f 54 1 2023-12-07T16:21:43.431 INFO:tasks.workunit.client.0.smithi063.stdout:3/589: write d7/f51 [654855,32542] 0 2023-12-07T16:21:43.431 INFO:tasks.workunit.client.0.smithi063.stdout:5/559: dwrite d1/d31/d56/d61/d5e/f75 [0,4194304] 0 2023-12-07T16:21:43.432 INFO:tasks.workunit.client.1.smithi152.stdout:3/838: link d7/d10/d1a/d2f/d5c/df6/d6d/d84/ca6 d7/d10/d19/c108 0 2023-12-07T16:21:43.434 INFO:tasks.workunit.client.0.smithi063.stdout:0/618: creat d4/dd/fd1 x:0 0 0 2023-12-07T16:21:43.436 INFO:tasks.workunit.client.0.smithi063.stdout:0/619: symlink d4/dd/d26/d2b/d5e/d8e/d95/d68/ld2 0 2023-12-07T16:21:43.436 INFO:tasks.workunit.client.0.smithi063.stdout:0/620: read - d4/dd/de/d15/f8c zero size 2023-12-07T16:21:43.437 INFO:tasks.workunit.client.1.smithi152.stdout:3/839: chown d7/dc/f33 171493477 1 2023-12-07T16:21:43.437 INFO:tasks.workunit.client.0.smithi063.stdout:0/621: creat d4/d25/fd3 x:0 0 0 2023-12-07T16:21:43.437 INFO:tasks.workunit.client.0.smithi063.stdout:0/622: write d4/dd/d26/f4f [6056105,26526] 0 2023-12-07T16:21:43.438 INFO:tasks.workunit.client.0.smithi063.stdout:0/623: write d4/dd/d26/d2b/db5/d5b/d63/d6b/da8/fc5 [228268,25545] 0 2023-12-07T16:21:43.438 INFO:tasks.workunit.client.1.smithi152.stdout:3/840: write d7/d10/d1a/fb0 [2237545,28646] 0 2023-12-07T16:21:43.440 INFO:tasks.workunit.client.1.smithi152.stdout:3/841: symlink d7/d10/d1a/d2f/d5c/df6/d6d/l109 0 2023-12-07T16:21:43.440 INFO:tasks.workunit.client.1.smithi152.stdout:3/842: fdatasync d7/d10/d1a/d2f/d5c/dbf/fc7 0 2023-12-07T16:21:43.441 INFO:tasks.workunit.client.1.smithi152.stdout:3/843: mknod d7/d10/d1a/c10a 0 2023-12-07T16:21:43.442 INFO:tasks.workunit.client.0.smithi063.stdout:0/624: write d4/dd/de/f24 [1096621,93144] 0 2023-12-07T16:21:43.442 INFO:tasks.workunit.client.0.smithi063.stdout:0/625: stat d4/d7e/fbf 0 2023-12-07T16:21:43.442 INFO:tasks.workunit.client.0.smithi063.stdout:0/626: getdents d4/dd/d26/d2b/db5/d5b/d63/d74 0 2023-12-07T16:21:43.444 INFO:tasks.workunit.client.0.smithi063.stdout:0/627: mkdir d4/dd/de/d15/d1f/d4c/da1/dd4 0 2023-12-07T16:21:43.444 INFO:tasks.workunit.client.0.smithi063.stdout:0/628: getdents d4/dd/de/d15/d1f/d4c/da1/dd4 0 2023-12-07T16:21:43.446 INFO:tasks.workunit.client.0.smithi063.stdout:5/560: dread d1/d3/de/d1e/d25/f3c [0,4194304] 0 2023-12-07T16:21:43.447 INFO:tasks.workunit.client.0.smithi063.stdout:5/561: unlink d1/d3/de/d1e/d25/f53 0 2023-12-07T16:21:43.448 INFO:tasks.workunit.client.0.smithi063.stdout:5/562: creat d1/d3/d3a/fa4 x:0 0 0 2023-12-07T16:21:43.449 INFO:tasks.workunit.client.0.smithi063.stdout:5/563: symlink d1/d3/de/d1e/d6b/la5 0 2023-12-07T16:21:43.449 INFO:tasks.workunit.client.0.smithi063.stdout:5/564: chown d1/d3/de/d1e/d6b 84639 1 2023-12-07T16:21:43.450 INFO:tasks.workunit.client.0.smithi063.stdout:5/565: symlink d1/d3/la6 0 2023-12-07T16:21:43.457 INFO:tasks.workunit.client.0.smithi063.stdout:9/522: dwrite d0/d13/f40 [0,4194304] 0 2023-12-07T16:21:43.457 INFO:tasks.workunit.client.0.smithi063.stdout:9/523: chown d0/d21/d64/d6a 5814182 1 2023-12-07T16:21:43.459 INFO:tasks.workunit.client.1.smithi152.stdout:3/844: getdents d7/d10/d1a/d2f/d5c/df6/d6d 0 2023-12-07T16:21:43.460 INFO:tasks.workunit.client.1.smithi152.stdout:3/845: fdatasync d7/dc/d14/f15 0 2023-12-07T16:21:43.461 INFO:tasks.workunit.client.1.smithi152.stdout:3/846: truncate d7/dc/d14/f15 3319619 0 2023-12-07T16:21:43.462 INFO:tasks.workunit.client.0.smithi063.stdout:9/524: write d0/d21/d64/d6a/d85/da4/f70 [1372867,116947] 0 2023-12-07T16:21:43.462 INFO:tasks.workunit.client.0.smithi063.stdout:9/525: write d0/d21/d64/d6a/d85/da4/f70 [4889450,100505] 0 2023-12-07T16:21:43.463 INFO:tasks.workunit.client.1.smithi152.stdout:3/847: symlink d7/d10/d1a/d25/d3f/l10b 0 2023-12-07T16:21:43.463 INFO:tasks.workunit.client.0.smithi063.stdout:0/629: dread d4/f5 [0,4194304] 0 2023-12-07T16:21:43.463 INFO:tasks.workunit.client.0.smithi063.stdout:9/526: rmdir d0/d21/d64/d6a/d85 39 2023-12-07T16:21:43.465 INFO:tasks.workunit.client.0.smithi063.stdout:0/630: unlink d4/dd/d26/d2b/d5e/d8e/d95/d68/fad 0 2023-12-07T16:21:43.465 INFO:tasks.workunit.client.0.smithi063.stdout:0/631: read - d4/dd/d26/d2b/db5/d5b/fae zero size 2023-12-07T16:21:43.465 INFO:tasks.workunit.client.0.smithi063.stdout:9/527: mknod d0/d8d/cac 0 2023-12-07T16:21:43.467 INFO:tasks.workunit.client.0.smithi063.stdout:9/528: symlink d0/d21/d64/d6a/d85/da4/lad 0 2023-12-07T16:21:43.468 INFO:tasks.workunit.client.0.smithi063.stdout:9/529: creat d0/d21/fae x:0 0 0 2023-12-07T16:21:43.469 INFO:tasks.workunit.client.1.smithi152.stdout:7/748: dwrite db/d1c/f28 [0,4194304] 0 2023-12-07T16:21:43.470 INFO:tasks.workunit.client.0.smithi063.stdout:7/537: dwrite d2/d2c/f3d [0,4194304] 0 2023-12-07T16:21:43.470 INFO:tasks.workunit.client.0.smithi063.stdout:7/538: fdatasync d2/fa 0 2023-12-07T16:21:43.471 INFO:tasks.workunit.client.0.smithi063.stdout:9/530: dread d0/d21/d64/d6a/d85/da4/f6d [0,4194304] 0 2023-12-07T16:21:43.473 INFO:tasks.workunit.client.1.smithi152.stdout:7/749: mkdir db/d27/d39/d41/d58/d80/def 0 2023-12-07T16:21:43.473 INFO:tasks.workunit.client.1.smithi152.stdout:7/750: readlink l5 0 2023-12-07T16:21:43.475 INFO:tasks.workunit.client.1.smithi152.stdout:7/751: creat db/d1c/ff0 x:0 0 0 2023-12-07T16:21:43.475 INFO:tasks.workunit.client.0.smithi063.stdout:9/531: read d0/f99 [2103319,126494] 0 2023-12-07T16:21:43.477 INFO:tasks.workunit.client.1.smithi152.stdout:2/762: dwrite d2/d1c/d2e/d30/d33/f40 [0,4194304] 0 2023-12-07T16:21:43.477 INFO:tasks.workunit.client.1.smithi152.stdout:2/763: write d2/d1c/d52/da8/fef [1024477,112556] 0 2023-12-07T16:21:43.477 INFO:tasks.workunit.client.1.smithi152.stdout:2/764: chown d2/d1c/d52 62109 1 2023-12-07T16:21:43.477 INFO:tasks.workunit.client.1.smithi152.stdout:5/943: dwrite dd/de/d38/d3d/f41 [0,4194304] 0 2023-12-07T16:21:43.478 INFO:tasks.workunit.client.1.smithi152.stdout:0/849: dwrite d0/d27/f9b [0,4194304] 0 2023-12-07T16:21:43.478 INFO:tasks.workunit.client.0.smithi063.stdout:8/733: dwrite d7/d14/fb2 [0,4194304] 0 2023-12-07T16:21:43.478 INFO:tasks.workunit.client.0.smithi063.stdout:8/734: stat d7/d14/fb3 0 2023-12-07T16:21:43.479 INFO:tasks.workunit.client.0.smithi063.stdout:0/632: write d4/dd/d26/f4f [4242193,63511] 0 2023-12-07T16:21:43.479 INFO:tasks.workunit.client.0.smithi063.stdout:0/633: chown d4/dd/de/d15/d59/lb6 29635 1 2023-12-07T16:21:43.479 INFO:tasks.workunit.client.0.smithi063.stdout:0/634: chown d4/f16 13 1 2023-12-07T16:21:43.479 INFO:tasks.workunit.client.0.smithi063.stdout:5/566: dwrite d1/d3/d3a/f97 [0,4194304] 0 2023-12-07T16:21:43.479 INFO:tasks.workunit.client.1.smithi152.stdout:2/765: mknod d2/d9/d51/d54/de3/c103 0 2023-12-07T16:21:43.480 INFO:tasks.workunit.client.0.smithi063.stdout:9/532: rename d0/da9 to d0/d13/d6f/daf 0 2023-12-07T16:21:43.483 INFO:tasks.workunit.client.0.smithi063.stdout:4/469: dwrite d1/f28 [0,4194304] 0 2023-12-07T16:21:43.483 INFO:tasks.workunit.client.0.smithi063.stdout:4/470: chown d1/d3/f4e 1969 1 2023-12-07T16:21:43.483 INFO:tasks.workunit.client.0.smithi063.stdout:4/471: fdatasync d1/d3/db/d2c/d63/f18 0 2023-12-07T16:21:43.486 INFO:tasks.workunit.client.0.smithi063.stdout:8/735: mknod d7/d14/d15/dde/da8/ce7 0 2023-12-07T16:21:43.486 INFO:tasks.workunit.client.0.smithi063.stdout:8/736: fdatasync d7/d14/d15/dde/da8/f95 0 2023-12-07T16:21:43.486 INFO:tasks.workunit.client.0.smithi063.stdout:4/472: read d1/d3/db/f3e [3952169,18040] 0 2023-12-07T16:21:43.486 INFO:tasks.workunit.client.1.smithi152.stdout:5/944: truncate dd/d7b/f84 7507180 0 2023-12-07T16:21:43.487 INFO:tasks.workunit.client.0.smithi063.stdout:3/590: dread d7/d4f/d53/d72/d7d/fbc [0,4194304] 0 2023-12-07T16:21:43.487 INFO:tasks.workunit.client.0.smithi063.stdout:3/591: chown l2 0 1 2023-12-07T16:21:43.487 INFO:tasks.workunit.client.0.smithi063.stdout:3/592: chown d7/d4f/d53/c59 2845666 1 2023-12-07T16:21:43.487 INFO:tasks.workunit.client.1.smithi152.stdout:0/850: creat d0/dc/d36/d3a/d69/f125 x:0 0 0 2023-12-07T16:21:43.488 INFO:tasks.workunit.client.1.smithi152.stdout:0/851: readlink d0/d27/d8c/df7/l55 0 2023-12-07T16:21:43.490 INFO:tasks.workunit.client.0.smithi063.stdout:0/635: dread d4/dd/d26/d2b/d5e/d8e/d95/f94 [0,4194304] 0 2023-12-07T16:21:43.490 INFO:tasks.workunit.client.1.smithi152.stdout:5/945: creat dd/de/f148 x:0 0 0 2023-12-07T16:21:43.491 INFO:tasks.workunit.client.1.smithi152.stdout:0/852: symlink d0/dc/d3d/d73/dbf/l126 0 2023-12-07T16:21:43.492 INFO:tasks.workunit.client.1.smithi152.stdout:0/853: mknod d0/dc/d36/d7d/d120/c127 0 2023-12-07T16:21:43.495 INFO:tasks.workunit.client.0.smithi063.stdout:7/539: dwrite d2/d34/d5a/d5f/f27 [0,4194304] 0 2023-12-07T16:21:43.497 INFO:tasks.workunit.client.1.smithi152.stdout:7/752: dwrite db/d27/f9d [0,4194304] 0 2023-12-07T16:21:43.499 INFO:tasks.workunit.client.0.smithi063.stdout:5/567: getdents d1 0 2023-12-07T16:21:43.502 INFO:tasks.workunit.client.0.smithi063.stdout:4/473: dread d1/d3/f36 [4194304,4194304] 0 2023-12-07T16:21:43.502 INFO:tasks.workunit.client.0.smithi063.stdout:4/474: stat d1/d3/db/d16/c2f 0 2023-12-07T16:21:43.506 INFO:tasks.workunit.client.0.smithi063.stdout:9/533: creat d0/d13/fb0 x:0 0 0 2023-12-07T16:21:43.506 INFO:tasks.workunit.client.1.smithi152.stdout:9/868: sync 2023-12-07T16:21:43.506 INFO:tasks.workunit.client.1.smithi152.stdout:4/749: sync 2023-12-07T16:21:43.508 INFO:tasks.workunit.client.0.smithi063.stdout:8/737: mkdir d7/d14/d15/dde/d63/d75/d98/de8 0 2023-12-07T16:21:43.508 INFO:tasks.workunit.client.0.smithi063.stdout:8/738: write d7/d14/d15/dde/d63/d75/d98/fa3 [1086832,3057] 0 2023-12-07T16:21:43.511 INFO:tasks.workunit.client.0.smithi063.stdout:3/593: mknod d7/d4f/d53/d54/d76/cc2 0 2023-12-07T16:21:43.511 INFO:tasks.workunit.client.0.smithi063.stdout:0/636: creat d4/dd/d26/d2b/db5/d5b/d63/d6b/da8/fd5 x:0 0 0 2023-12-07T16:21:43.512 INFO:tasks.workunit.client.1.smithi152.stdout:1/946: sync 2023-12-07T16:21:43.514 INFO:tasks.workunit.client.0.smithi063.stdout:4/475: unlink d1/d3/db/d16/c3c 0 2023-12-07T16:21:43.514 INFO:tasks.workunit.client.0.smithi063.stdout:4/476: truncate d1/d3/d3f/d49/f5e 1589254 0 2023-12-07T16:21:43.515 INFO:tasks.workunit.client.0.smithi063.stdout:9/534: symlink d0/d21/d64/d6a/d8f/lb1 0 2023-12-07T16:21:43.515 INFO:tasks.workunit.client.0.smithi063.stdout:9/535: read - d0/d13/f7e zero size 2023-12-07T16:21:43.515 INFO:tasks.workunit.client.1.smithi152.stdout:9/869: truncate d1/d9/db/d70/fb3 2207134 0 2023-12-07T16:21:43.515 INFO:tasks.workunit.client.1.smithi152.stdout:9/870: readlink d1/d9/d2d/d65/lf0 0 2023-12-07T16:21:43.515 INFO:tasks.workunit.client.1.smithi152.stdout:9/871: write d1/dd/f78 [1416406,11091] 0 2023-12-07T16:21:43.515 INFO:tasks.workunit.client.1.smithi152.stdout:9/872: truncate d1/d9/db/df/d42/fbe 5001508 0 2023-12-07T16:21:43.515 INFO:tasks.workunit.client.1.smithi152.stdout:4/750: mkdir d0/d3/d6/d2b/dd9/db7/ddc 0 2023-12-07T16:21:43.515 INFO:tasks.workunit.client.1.smithi152.stdout:4/751: stat d0/d3/d6/d2b/fd3 0 2023-12-07T16:21:43.517 INFO:tasks.workunit.client.1.smithi152.stdout:9/873: write d1/d9/d4f/d83/fab [364151,97528] 0 2023-12-07T16:21:43.517 INFO:tasks.workunit.client.0.smithi063.stdout:0/637: mknod d4/dd/d26/d2b/d5e/cd6 0 2023-12-07T16:21:43.519 INFO:tasks.workunit.client.0.smithi063.stdout:3/594: dread d7/f51 [0,4194304] 0 2023-12-07T16:21:43.519 INFO:tasks.workunit.client.1.smithi152.stdout:4/752: mkdir d0/d3/d6/d2b/db1/ddd 0 2023-12-07T16:21:43.519 INFO:tasks.workunit.client.1.smithi152.stdout:1/947: write dc/d14/d18/d2d/d4a/f71 [2546934,54830] 0 2023-12-07T16:21:43.520 INFO:tasks.workunit.client.1.smithi152.stdout:9/874: mkdir d1/d9/db/d70/d120 0 2023-12-07T16:21:43.522 INFO:tasks.workunit.client.1.smithi152.stdout:1/948: creat dc/d14/d18/d2d/d9c/db2/f139 x:0 0 0 2023-12-07T16:21:43.523 INFO:tasks.workunit.client.1.smithi152.stdout:1/949: truncate dc/d14/d90/dbb/fec 455082 0 2023-12-07T16:21:43.523 INFO:tasks.workunit.client.1.smithi152.stdout:1/950: fdatasync dc/d14/d18/f2c 0 2023-12-07T16:21:43.524 INFO:tasks.workunit.client.1.smithi152.stdout:9/875: truncate d1/d9/db/df/da6/f4d 640218 0 2023-12-07T16:21:43.525 INFO:tasks.workunit.client.0.smithi063.stdout:3/595: truncate d7/fc 8218261 0 2023-12-07T16:21:43.525 INFO:tasks.workunit.client.0.smithi063.stdout:3/596: fdatasync d7/d4f/d53/f6a 0 2023-12-07T16:21:43.525 INFO:tasks.workunit.client.0.smithi063.stdout:4/477: creat d1/d3/db/d2c/d63/d62/f8a x:0 0 0 2023-12-07T16:21:43.526 INFO:tasks.workunit.client.1.smithi152.stdout:1/951: getdents dc/d14/d90/da9/df5 0 2023-12-07T16:21:43.526 INFO:tasks.workunit.client.0.smithi063.stdout:0/638: symlink d4/dd/d26/d2b/d5e/d8e/ld7 0 2023-12-07T16:21:43.527 INFO:tasks.workunit.client.1.smithi152.stdout:4/753: dread d0/d3/fbe [0,4194304] 0 2023-12-07T16:21:43.527 INFO:tasks.workunit.client.1.smithi152.stdout:4/754: write d0/d17/fcc [1086765,48968] 0 2023-12-07T16:21:43.528 INFO:tasks.workunit.client.0.smithi063.stdout:9/536: write d0/d13/d39/d3a/d78/f8a [3386702,59497] 0 2023-12-07T16:21:43.528 INFO:tasks.workunit.client.0.smithi063.stdout:9/537: readlink d0/d21/d64/lab 0 2023-12-07T16:21:43.529 INFO:tasks.workunit.client.0.smithi063.stdout:3/597: truncate d7/d9/dd/d56/f8c 214153 0 2023-12-07T16:21:43.531 INFO:tasks.workunit.client.0.smithi063.stdout:4/478: unlink d1/d3/d3f/d44/l50 0 2023-12-07T16:21:43.531 INFO:tasks.workunit.client.0.smithi063.stdout:4/479: write d1/d3/db/d2c/d63/f84 [244015,125210] 0 2023-12-07T16:21:43.537 INFO:tasks.workunit.client.1.smithi152.stdout:9/876: write d1/d9/db/f36 [999248,9363] 0 2023-12-07T16:21:43.537 INFO:tasks.workunit.client.0.smithi063.stdout:3/598: mknod d7/d9/d1b/db8/cc3 0 2023-12-07T16:21:43.537 INFO:tasks.workunit.client.0.smithi063.stdout:3/599: chown d7/d9/dd/d56/l96 24 1 2023-12-07T16:21:43.537 INFO:tasks.workunit.client.0.smithi063.stdout:0/639: mkdir d4/dd/de/d15/d59/d43/dd8 0 2023-12-07T16:21:43.541 INFO:tasks.workunit.client.0.smithi063.stdout:4/480: rmdir d1/d3/db/d16/d66 39 2023-12-07T16:21:43.541 INFO:tasks.workunit.client.0.smithi063.stdout:3/600: truncate d7/d49/d4b/f7a 1353127 0 2023-12-07T16:21:43.542 INFO:tasks.workunit.client.1.smithi152.stdout:9/877: mkdir d1/d17/d58/d86/dd9/d121 0 2023-12-07T16:21:43.545 INFO:tasks.workunit.client.1.smithi152.stdout:2/766: dwrite d2/d1c/d2e/d57/d5b/da7/fbd [0,4194304] 0 2023-12-07T16:21:43.545 INFO:tasks.workunit.client.1.smithi152.stdout:2/767: stat d2/d1c/d2e/d30/d33/c32 0 2023-12-07T16:21:43.550 INFO:tasks.workunit.client.1.smithi152.stdout:9/878: mkdir d1/d9/db/df/da6/da2/d118/d122 0 2023-12-07T16:21:43.552 INFO:tasks.workunit.client.0.smithi063.stdout:9/538: dread d0/d21/d64/d6a/d85/da4/f70 [0,4194304] 0 2023-12-07T16:21:43.553 INFO:tasks.workunit.client.1.smithi152.stdout:2/768: mknod d2/d1c/d52/da8/db6/c104 0 2023-12-07T16:21:43.555 INFO:tasks.workunit.client.0.smithi063.stdout:5/568: dwrite d1/d31/d56/d61/d5e/d6a/fa3 [0,4194304] 0 2023-12-07T16:21:43.559 INFO:tasks.workunit.client.0.smithi063.stdout:5/569: unlink d1/l52 0 2023-12-07T16:21:43.559 INFO:tasks.workunit.client.0.smithi063.stdout:5/570: chown d1/d3/de/l9a 162 1 2023-12-07T16:21:43.559 INFO:tasks.workunit.client.1.smithi152.stdout:2/769: rename d2/d9/d51/d54/de3 to d2/d105 0 2023-12-07T16:21:43.559 INFO:tasks.workunit.client.1.smithi152.stdout:7/753: dwrite db/f47 [0,4194304] 0 2023-12-07T16:21:43.559 INFO:tasks.workunit.client.1.smithi152.stdout:7/754: chown db/d27/d39/d63/fb8 224718 1 2023-12-07T16:21:43.563 INFO:tasks.workunit.client.1.smithi152.stdout:2/770: rmdir d2/d1c/d2e/d57/d5b/da7/d8a 39 2023-12-07T16:21:43.563 INFO:tasks.workunit.client.0.smithi063.stdout:5/571: mkdir d1/d31/d56/d61/d5e/d6a/da7 0 2023-12-07T16:21:43.564 INFO:tasks.workunit.client.0.smithi063.stdout:5/572: fsync d1/d3/de/d1e/f1d 0 2023-12-07T16:21:43.564 INFO:tasks.workunit.client.1.smithi152.stdout:7/755: dread db/d27/d39/d41/d58/f59 [0,4194304] 0 2023-12-07T16:21:43.567 INFO:tasks.workunit.client.1.smithi152.stdout:2/771: creat d2/d1c/d2e/d57/d5b/da7/d9a/dcb/f106 x:0 0 0 2023-12-07T16:21:43.569 INFO:tasks.workunit.client.1.smithi152.stdout:7/756: unlink db/d1c/ff0 0 2023-12-07T16:21:43.570 INFO:tasks.workunit.client.1.smithi152.stdout:2/772: mkdir d2/d1c/d2e/d30/d33/d86/dee/d107 0 2023-12-07T16:21:43.571 INFO:tasks.workunit.client.1.smithi152.stdout:2/773: rename d2/d1c/d2e/d57 to d2/d1c/d2e/d57/d5b/da7/d9a/dcb/d108 22 2023-12-07T16:21:43.572 INFO:tasks.workunit.client.1.smithi152.stdout:7/757: creat db/d27/d39/d41/d58/da5/ff1 x:0 0 0 2023-12-07T16:21:43.572 INFO:tasks.workunit.client.0.smithi063.stdout:7/540: dwrite d2/d34/d5a/d5f/d2a/f35 [0,4194304] 0 2023-12-07T16:21:43.575 INFO:tasks.workunit.client.1.smithi152.stdout:5/946: dwrite dd/de/d14/d1f/fa8 [0,4194304] 0 2023-12-07T16:21:43.577 INFO:tasks.workunit.client.0.smithi063.stdout:8/739: dwrite d7/d14/d1a/fc8 [4194304,4194304] 0 2023-12-07T16:21:43.578 INFO:tasks.workunit.client.0.smithi063.stdout:8/740: dread - d7/d14/d1a/fc9 zero size 2023-12-07T16:21:43.578 INFO:tasks.workunit.client.1.smithi152.stdout:5/947: creat dd/de/d38/d3d/d100/f149 x:0 0 0 2023-12-07T16:21:43.578 INFO:tasks.workunit.client.1.smithi152.stdout:5/948: fsync dd/de/d14/d19/d7a/ff3 0 2023-12-07T16:21:43.580 INFO:tasks.workunit.client.1.smithi152.stdout:5/949: rename dd/de/d14/d19/d1a/l1c to dd/de/d38/d3d/dd3/df0/l14a 0 2023-12-07T16:21:43.581 INFO:tasks.workunit.client.1.smithi152.stdout:5/950: chown dd/de/d38/d3d/d6d/dae/de0/ffa 0 1 2023-12-07T16:21:43.581 INFO:tasks.workunit.client.1.smithi152.stdout:5/951: fdatasync dd/de/d38/f7e 0 2023-12-07T16:21:43.581 INFO:tasks.workunit.client.1.smithi152.stdout:5/952: getdents dd/de/d38/d3d/d6d/dae/d112 0 2023-12-07T16:21:43.582 INFO:tasks.workunit.client.1.smithi152.stdout:5/953: unlink dd/f5a 0 2023-12-07T16:21:43.584 INFO:tasks.workunit.client.0.smithi063.stdout:7/541: write d2/d21/f3f [6466181,100692] 0 2023-12-07T16:21:43.587 INFO:tasks.workunit.client.1.smithi152.stdout:5/954: write dd/de/d14/d67/d138/f5b [22152,13664] 0 2023-12-07T16:21:43.587 INFO:tasks.workunit.client.1.smithi152.stdout:5/955: readlink dd/de/d14/d19/d74/l75 0 2023-12-07T16:21:43.588 INFO:tasks.workunit.client.0.smithi063.stdout:8/741: creat d7/d14/d15/db4/fe9 x:0 0 0 2023-12-07T16:21:43.592 INFO:tasks.workunit.client.0.smithi063.stdout:8/742: symlink d7/d14/d15/dde/lea 0 2023-12-07T16:21:43.592 INFO:tasks.workunit.client.0.smithi063.stdout:8/743: write d7/f24 [5369120,111294] 0 2023-12-07T16:21:43.594 INFO:tasks.workunit.client.0.smithi063.stdout:8/744: mknod d7/d14/d15/ceb 0 2023-12-07T16:21:43.594 INFO:tasks.workunit.client.0.smithi063.stdout:8/745: write d7/d14/d4e/fe0 [1008554,16218] 0 2023-12-07T16:21:43.594 INFO:tasks.workunit.client.0.smithi063.stdout:8/746: stat f5 0 2023-12-07T16:21:43.594 INFO:tasks.workunit.client.0.smithi063.stdout:8/747: getdents d7/d14/d15/dde/d63/d75/d98/dc4 0 2023-12-07T16:21:43.602 INFO:tasks.workunit.client.0.smithi063.stdout:8/748: dread d7/d14/d15/d48/f58 [0,4194304] 0 2023-12-07T16:21:43.608 INFO:tasks.workunit.client.0.smithi063.stdout:7/542: dread d2/f1e [0,4194304] 0 2023-12-07T16:21:43.608 INFO:tasks.workunit.client.0.smithi063.stdout:7/543: chown d2/d34/d5a/d5f/d78/d7c/d9b/ca2 1452 1 2023-12-07T16:21:43.608 INFO:tasks.workunit.client.0.smithi063.stdout:8/749: write d7/d14/fb2 [2252701,71982] 0 2023-12-07T16:21:43.610 INFO:tasks.workunit.client.0.smithi063.stdout:7/544: unlink d2/d34/d5a/d5f/d2a/f35 0 2023-12-07T16:21:43.610 INFO:tasks.workunit.client.0.smithi063.stdout:7/545: stat d2/d34/d5a/d5f/d53/da3/fc8 0 2023-12-07T16:21:43.610 INFO:tasks.workunit.client.0.smithi063.stdout:7/546: write d2/d34/d5a/d5f/f47 [134566,32406] 0 2023-12-07T16:21:43.610 INFO:tasks.workunit.client.0.smithi063.stdout:7/547: fdatasync d2/d34/d5a/d5f/f18 0 2023-12-07T16:21:43.611 INFO:tasks.workunit.client.0.smithi063.stdout:8/750: rename d7/d14/d15/dde/da8/d9f/ld3 to d7/d14/d15/dde/d63/d75/d98/de8/lec 0 2023-12-07T16:21:43.612 INFO:tasks.workunit.client.0.smithi063.stdout:8/751: truncate d7/d14/d15/d57/f66 39061 0 2023-12-07T16:21:43.612 INFO:tasks.workunit.client.1.smithi152.stdout:1/952: dwrite dc/d14/d18/d2d/d48/fc2 [0,4194304] 0 2023-12-07T16:21:43.612 INFO:tasks.workunit.client.1.smithi152.stdout:1/953: chown dc/d14/d18/d2d/d9c/db2 625994 1 2023-12-07T16:21:43.613 INFO:tasks.workunit.client.0.smithi063.stdout:8/752: truncate d7/d14/d1a/f51 1918286 0 2023-12-07T16:21:43.613 INFO:tasks.workunit.client.0.smithi063.stdout:8/753: chown d7/d14/d15/db4/ca6 1 1 2023-12-07T16:21:43.614 INFO:tasks.workunit.client.1.smithi152.stdout:1/954: link dc/d14/d18/d2d/d48/fd7 dc/d14/d18/de9/d12d/f13a 0 2023-12-07T16:21:43.615 INFO:tasks.workunit.client.0.smithi063.stdout:7/548: dread d2/f36 [0,4194304] 0 2023-12-07T16:21:43.616 INFO:tasks.workunit.client.0.smithi063.stdout:7/549: symlink d2/d34/d5a/d5f/d53/lcc 0 2023-12-07T16:21:43.617 INFO:tasks.workunit.client.1.smithi152.stdout:4/755: dwrite d0/d3/d6/d2b/d75/f9f [0,4194304] 0 2023-12-07T16:21:43.617 INFO:tasks.workunit.client.0.smithi063.stdout:0/640: dwrite d4/dd/de/d15/f21 [0,4194304] 0 2023-12-07T16:21:43.618 INFO:tasks.workunit.client.0.smithi063.stdout:7/550: symlink d2/d34/d5a/d5f/lcd 0 2023-12-07T16:21:43.618 INFO:tasks.workunit.client.0.smithi063.stdout:7/551: chown d2/d34/d46/d48/d56/f7d 3261 1 2023-12-07T16:21:43.618 INFO:tasks.workunit.client.0.smithi063.stdout:7/552: rename d2 to d2/d34/d5a/d5f/d2a/d7e/dce 22 2023-12-07T16:21:43.618 INFO:tasks.workunit.client.0.smithi063.stdout:7/553: chown d2/d34/d5a/d5f/d61 2937526 1 2023-12-07T16:21:43.621 INFO:tasks.workunit.client.1.smithi152.stdout:4/756: write d0/d3/d6/d2b/dd9/d39/f41 [4159820,545] 0 2023-12-07T16:21:43.623 INFO:tasks.workunit.client.0.smithi063.stdout:4/481: dwrite d1/d3/db/d2c/f77 [0,4194304] 0 2023-12-07T16:21:43.623 INFO:tasks.workunit.client.1.smithi152.stdout:9/879: dwrite d1/d9/db/df/d42/de8/df8/f10d [0,4194304] 0 2023-12-07T16:21:43.623 INFO:tasks.workunit.client.1.smithi152.stdout:4/757: link d0/d3/d6/l51 d0/d3/d6/d2b/d56/lde 0 2023-12-07T16:21:43.623 INFO:tasks.workunit.client.1.smithi152.stdout:4/758: write d0/d3/d6/d2b/fd3 [62672,76841] 0 2023-12-07T16:21:43.624 INFO:tasks.workunit.client.0.smithi063.stdout:3/601: dwrite d7/d4f/d53/d72/db1/f8b [0,4194304] 0 2023-12-07T16:21:43.626 INFO:tasks.workunit.client.1.smithi152.stdout:7/758: dwrite db/d1c/f94 [0,4194304] 0 2023-12-07T16:21:43.626 INFO:tasks.workunit.client.1.smithi152.stdout:7/759: chown db/d68/lb3 197468 1 2023-12-07T16:21:43.626 INFO:tasks.workunit.client.1.smithi152.stdout:5/956: dwrite dd/de/d14/d19/d1a/f118 [0,4194304] 0 2023-12-07T16:21:43.627 INFO:tasks.workunit.client.0.smithi063.stdout:9/539: dwrite d0/d13/d39/d42/f50 [0,4194304] 0 2023-12-07T16:21:43.627 INFO:tasks.workunit.client.0.smithi063.stdout:5/573: dwrite d1/d3/de/f16 [0,4194304] 0 2023-12-07T16:21:43.627 INFO:tasks.workunit.client.0.smithi063.stdout:8/754: dread d7/d14/d15/f8b [0,4194304] 0 2023-12-07T16:21:43.628 INFO:tasks.workunit.client.0.smithi063.stdout:4/482: mkdir d1/d3/d3f/d49/d8b 0 2023-12-07T16:21:43.629 INFO:tasks.workunit.client.0.smithi063.stdout:4/483: rename d1/d3/db to d1/d3/db/d2c/d63/d62/d86/d8c 22 2023-12-07T16:21:43.629 INFO:tasks.workunit.client.1.smithi152.stdout:9/880: unlink d1/d17/d4e/d5a/lba 0 2023-12-07T16:21:43.629 INFO:tasks.workunit.client.1.smithi152.stdout:4/759: creat d0/d3/d6/d2b/dd9/d39/d93/fdf x:0 0 0 2023-12-07T16:21:43.634 INFO:tasks.workunit.client.0.smithi063.stdout:9/540: mknod d0/cb2 0 2023-12-07T16:21:43.634 INFO:tasks.workunit.client.0.smithi063.stdout:9/541: fdatasync d0/d13/d39/d42/f77 0 2023-12-07T16:21:43.636 INFO:tasks.workunit.client.0.smithi063.stdout:8/755: mknod d7/d38/d73/ced 0 2023-12-07T16:21:43.637 INFO:tasks.workunit.client.0.smithi063.stdout:5/574: truncate d1/d31/d56/d61/d5e/d6a/fa3 1185784 0 2023-12-07T16:21:43.639 INFO:tasks.workunit.client.0.smithi063.stdout:9/542: mknod d0/d21/d64/cb3 0 2023-12-07T16:21:43.642 INFO:tasks.workunit.client.0.smithi063.stdout:8/756: symlink d7/d38/d8e/lee 0 2023-12-07T16:21:43.645 INFO:tasks.workunit.client.0.smithi063.stdout:6/645: sync 2023-12-07T16:21:43.645 INFO:tasks.workunit.client.0.smithi063.stdout:1/451: sync 2023-12-07T16:21:43.645 INFO:tasks.workunit.client.0.smithi063.stdout:2/706: sync 2023-12-07T16:21:43.647 INFO:tasks.workunit.client.1.smithi152.stdout:2/774: write d2/d1c/d52/f9d [391789,112675] 0 2023-12-07T16:21:43.653 INFO:tasks.workunit.client.1.smithi152.stdout:7/760: mkdir db/d27/d39/d41/d58/da5/dde/df2 0 2023-12-07T16:21:43.653 INFO:tasks.workunit.client.1.smithi152.stdout:9/881: creat d1/d9/d2d/d65/f123 x:0 0 0 2023-12-07T16:21:43.655 INFO:tasks.workunit.client.1.smithi152.stdout:5/957: creat dd/de/d14/d19/da3/f14b x:0 0 0 2023-12-07T16:21:43.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:43 smithi063 ceph-mon[112095]: pgmap v29: 65 pgs: 65 active+clean; 2.9 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 215 MiB/s rd, 433 MiB/s wr, 643 op/s 2023-12-07T16:21:43.656 INFO:tasks.workunit.client.1.smithi152.stdout:4/760: rename d0/d3/d6/d2b/dd9/d39/f41 to d0/d3/d6/d2b/dd9/d3a/d46/d4e/fe0 0 2023-12-07T16:21:43.656 INFO:tasks.workunit.client.0.smithi063.stdout:9/543: dread d0/d21/f2c [0,4194304] 0 2023-12-07T16:21:43.657 INFO:tasks.workunit.client.1.smithi152.stdout:9/882: write d1/d9/f23 [3154619,34823] 0 2023-12-07T16:21:43.658 INFO:tasks.workunit.client.1.smithi152.stdout:2/775: symlink d2/d1c/d2e/d57/d5b/da7/d8a/l109 0 2023-12-07T16:21:43.658 INFO:tasks.workunit.client.1.smithi152.stdout:2/776: chown d2/d1c/d2e/d30/l94 64079 1 2023-12-07T16:21:43.662 INFO:tasks.workunit.client.0.smithi063.stdout:8/757: rename d7/d14/d15/db4/fc3 to d7/d38/fef 0 2023-12-07T16:21:43.662 INFO:tasks.workunit.client.0.smithi063.stdout:1/452: symlink d0/dd/d10/d13/d2f/l9e 0 2023-12-07T16:21:43.662 INFO:tasks.workunit.client.0.smithi063.stdout:2/707: link d0/d67/d65/fe1 d0/d21/fe4 0 2023-12-07T16:21:43.662 INFO:tasks.workunit.client.0.smithi063.stdout:1/453: readlink d0/dd/d19/d50/l5f 0 2023-12-07T16:21:43.662 INFO:tasks.workunit.client.0.smithi063.stdout:2/708: stat d0/d21/d56/d11/d52/da9/dbe/f97 0 2023-12-07T16:21:43.666 INFO:tasks.workunit.client.0.smithi063.stdout:9/544: creat d0/d13/fb4 x:0 0 0 2023-12-07T16:21:43.666 INFO:tasks.workunit.client.0.smithi063.stdout:1/454: mkdir d0/d98/d9f 0 2023-12-07T16:21:43.666 INFO:tasks.workunit.client.0.smithi063.stdout:1/455: chown d0/dd/d19/d50/d71/f7e 1055746 1 2023-12-07T16:21:43.670 INFO:tasks.workunit.client.0.smithi063.stdout:6/646: write d0/f1b [753680,20235] 0 2023-12-07T16:21:43.672 INFO:tasks.workunit.client.1.smithi152.stdout:2/777: read d2/d1c/d2e/d30/d33/f2d [2355842,24099] 0 2023-12-07T16:21:43.672 INFO:tasks.workunit.client.1.smithi152.stdout:2/778: write d2/d56/da0/fa5 [723915,39301] 0 2023-12-07T16:21:43.674 INFO:tasks.workunit.client.0.smithi063.stdout:6/647: creat d0/d1e/d1d/d4f/d88/fea x:0 0 0 2023-12-07T16:21:43.676 INFO:tasks.workunit.client.1.smithi152.stdout:4/761: dread d0/d17/f79 [0,4194304] 0 2023-12-07T16:21:43.676 INFO:tasks.workunit.client.1.smithi152.stdout:4/762: readlink d0/l23 0 2023-12-07T16:21:43.676 INFO:tasks.workunit.client.0.smithi063.stdout:7/554: dwrite d2/d64/fb7 [0,4194304] 0 2023-12-07T16:21:43.676 INFO:tasks.workunit.client.0.smithi063.stdout:7/555: chown d2/d2c/fba 385378 1 2023-12-07T16:21:43.677 INFO:tasks.workunit.client.0.smithi063.stdout:6/648: creat d0/d79/feb x:0 0 0 2023-12-07T16:21:43.678 INFO:tasks.workunit.client.0.smithi063.stdout:6/649: dread - d0/d1e/d1d/d1f/d6c/fac zero size 2023-12-07T16:21:43.678 INFO:tasks.workunit.client.0.smithi063.stdout:6/650: dread - d0/d1e/d60/d68/fc9 zero size 2023-12-07T16:21:43.679 INFO:tasks.workunit.client.1.smithi152.stdout:4/763: creat d0/d3/d6/d36/d85/fe1 x:0 0 0 2023-12-07T16:21:43.679 INFO:tasks.workunit.client.1.smithi152.stdout:4/764: fdatasync d0/d3/f7 0 2023-12-07T16:21:43.679 INFO:tasks.workunit.client.1.smithi152.stdout:4/765: stat d0/d3/d6/d2b/dd9/d39 0 2023-12-07T16:21:43.679 INFO:tasks.workunit.client.0.smithi063.stdout:8/758: dread d7/d14/d15/db4/f84 [0,4194304] 0 2023-12-07T16:21:43.679 INFO:tasks.workunit.client.0.smithi063.stdout:8/759: fdatasync d7/d14/d15/db4/fcd 0 2023-12-07T16:21:43.680 INFO:tasks.workunit.client.0.smithi063.stdout:7/556: creat d2/d34/d5a/d5f/d78/fcf x:0 0 0 2023-12-07T16:21:43.682 INFO:tasks.workunit.client.1.smithi152.stdout:4/766: mkdir d0/d3/d6/d2b/de2 0 2023-12-07T16:21:43.682 INFO:tasks.workunit.client.1.smithi152.stdout:4/767: dread - d0/d3/d6/d2b/dd9/db7/fbd zero size 2023-12-07T16:21:43.685 INFO:tasks.workunit.client.0.smithi063.stdout:7/557: rename d2/f36 to d2/d34/d5a/d5f/d53/dab/fd0 0 2023-12-07T16:21:43.685 INFO:tasks.workunit.client.0.smithi063.stdout:0/641: dwrite d4/dd/d26/d2b/d5e/f88 [0,4194304] 0 2023-12-07T16:21:43.685 INFO:tasks.workunit.client.1.smithi152.stdout:4/768: rename d0/daa/f7b to d0/d3/d6/d2b/dd9/d39/fe3 0 2023-12-07T16:21:43.685 INFO:tasks.workunit.client.1.smithi152.stdout:4/769: fsync d0/d3/d6/d2b/dd9/d3a/fa5 0 2023-12-07T16:21:43.688 INFO:tasks.workunit.client.0.smithi063.stdout:0/642: creat d4/dd/d26/d2b/db5/d5b/d63/d74/d84/fd9 x:0 0 0 2023-12-07T16:21:43.692 INFO:tasks.workunit.client.1.smithi152.stdout:4/770: write d0/d17/d7f/f86 [3895776,32957] 0 2023-12-07T16:21:43.692 INFO:tasks.workunit.client.1.smithi152.stdout:4/771: readlink d0/d17/d7f/ld4 0 2023-12-07T16:21:43.698 INFO:tasks.workunit.client.0.smithi063.stdout:7/558: dread d2/d34/d5a/d5f/d53/fac [0,4194304] 0 2023-12-07T16:21:43.708 INFO:tasks.workunit.client.0.smithi063.stdout:4/484: dwrite d1/d3/d3f/d44/f6c [4194304,4194304] 0 2023-12-07T16:21:43.712 INFO:tasks.workunit.client.0.smithi063.stdout:4/485: dread d1/d3/d51/f65 [0,4194304] 0 2023-12-07T16:21:43.714 INFO:tasks.workunit.client.0.smithi063.stdout:4/486: creat d1/d3/db/d2c/d63/d62/d86/f8d x:0 0 0 2023-12-07T16:21:43.714 INFO:tasks.workunit.client.0.smithi063.stdout:6/651: dwrite d0/d1e/d1d/d1f/d4b/fc1 [0,4194304] 0 2023-12-07T16:21:43.720 INFO:tasks.workunit.client.1.smithi152.stdout:7/761: dwrite db/d27/d5e/f54 [0,4194304] 0 2023-12-07T16:21:43.722 INFO:tasks.workunit.client.1.smithi152.stdout:7/762: truncate db/d27/f7a 2289105 0 2023-12-07T16:21:43.724 INFO:tasks.workunit.client.0.smithi063.stdout:5/575: dwrite d1/d3/de/d1e/d25/f3c [0,4194304] 0 2023-12-07T16:21:43.724 INFO:tasks.workunit.client.0.smithi063.stdout:3/602: dwrite d7/d9/dd/d56/f8c [0,4194304] 0 2023-12-07T16:21:43.727 INFO:tasks.workunit.client.1.smithi152.stdout:7/763: write db/d27/d39/d41/d37/fdc [21088,42868] 0 2023-12-07T16:21:43.728 INFO:tasks.workunit.client.0.smithi063.stdout:3/603: mknod d7/d4f/d53/cc4 0 2023-12-07T16:21:43.728 INFO:tasks.workunit.client.0.smithi063.stdout:3/604: chown d7/d9/dd/f1f 17352847 1 2023-12-07T16:21:43.729 INFO:tasks.workunit.client.0.smithi063.stdout:3/605: mknod d7/d9/dd/d60/cc5 0 2023-12-07T16:21:43.730 INFO:tasks.workunit.client.1.smithi152.stdout:5/958: dwrite dd/de/d38/d3d/d6d/f90 [4194304,4194304] 0 2023-12-07T16:21:43.730 INFO:tasks.workunit.client.1.smithi152.stdout:7/764: mknod db/d27/cf3 0 2023-12-07T16:21:43.731 INFO:tasks.workunit.client.0.smithi063.stdout:7/559: dwrite d2/d2c/f3d [4194304,4194304] 0 2023-12-07T16:21:43.731 INFO:tasks.workunit.client.1.smithi152.stdout:5/959: write dd/d91/dbe/d10e/f116 [21673,29792] 0 2023-12-07T16:21:43.732 INFO:tasks.workunit.client.0.smithi063.stdout:7/560: write d2/d34/d5a/d5f/d53/fac [16815,110912] 0 2023-12-07T16:21:43.737 INFO:tasks.workunit.client.0.smithi063.stdout:5/576: dread d1/d3/de/f16 [0,4194304] 0 2023-12-07T16:21:43.737 INFO:tasks.workunit.client.0.smithi063.stdout:5/577: stat d1/l86 0 2023-12-07T16:21:43.737 INFO:tasks.workunit.client.0.smithi063.stdout:5/578: fsync d1/d3/de/d1e/f24 0 2023-12-07T16:21:43.739 INFO:tasks.workunit.client.1.smithi152.stdout:9/883: dwrite d1/d9/db/df/da6/da2/de9/f106 [0,4194304] 0 2023-12-07T16:21:43.739 INFO:tasks.workunit.client.0.smithi063.stdout:2/709: dwrite d0/d21/d56/d11/d52/f9c [0,4194304] 0 2023-12-07T16:21:43.739 INFO:tasks.workunit.client.0.smithi063.stdout:7/561: fdatasync d2/d34/d5a/d5f/f16 0 2023-12-07T16:21:43.739 INFO:tasks.workunit.client.0.smithi063.stdout:7/562: fdatasync d2/d21/f29 0 2023-12-07T16:21:43.741 INFO:tasks.workunit.client.1.smithi152.stdout:5/960: mknod dd/de/d14/d67/c14c 0 2023-12-07T16:21:43.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:43 smithi152 ceph-mon[121113]: pgmap v29: 65 pgs: 65 active+clean; 2.9 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 215 MiB/s rd, 433 MiB/s wr, 643 op/s 2023-12-07T16:21:43.743 INFO:tasks.workunit.client.0.smithi063.stdout:5/579: dread d1/d31/d56/f6f [0,4194304] 0 2023-12-07T16:21:43.743 INFO:tasks.workunit.client.0.smithi063.stdout:5/580: fsync d1/d3/d3a/fa4 0 2023-12-07T16:21:43.743 INFO:tasks.workunit.client.0.smithi063.stdout:5/581: chown d1/d3/d3a/d5a/f85 3 1 2023-12-07T16:21:43.744 INFO:tasks.workunit.client.0.smithi063.stdout:2/710: unlink d0/d21/c2c 0 2023-12-07T16:21:43.747 INFO:tasks.workunit.client.0.smithi063.stdout:5/582: write d1/d31/d56/f67 [3842989,110767] 0 2023-12-07T16:21:43.749 INFO:tasks.workunit.client.1.smithi152.stdout:5/961: read dd/de/d14/d1f/f57 [3011758,34922] 0 2023-12-07T16:21:43.750 INFO:tasks.workunit.client.0.smithi063.stdout:1/456: dwrite d0/dd/d10/d13/f60 [0,4194304] 0 2023-12-07T16:21:43.750 INFO:tasks.workunit.client.0.smithi063.stdout:4/487: dwrite d1/d3/db/d16/f7a [0,4194304] 0 2023-12-07T16:21:43.751 INFO:tasks.workunit.client.1.smithi152.stdout:9/884: write d1/d9/d2d/f8f [2946887,128572] 0 2023-12-07T16:21:43.751 INFO:tasks.workunit.client.1.smithi152.stdout:9/885: chown d1/d9/d2d/d72/d80/da4/ffc 0 1 2023-12-07T16:21:43.754 INFO:tasks.workunit.client.0.smithi063.stdout:7/563: rmdir d2/d34 39 2023-12-07T16:21:43.754 INFO:tasks.workunit.client.0.smithi063.stdout:7/564: fdatasync d2/d34/d5a/d5f/d53/dab/fd0 0 2023-12-07T16:21:43.754 INFO:tasks.workunit.client.0.smithi063.stdout:1/457: dread d0/dd/d10/d1b/f51 [0,4194304] 0 2023-12-07T16:21:43.755 INFO:tasks.workunit.client.0.smithi063.stdout:1/458: chown d0/dd/d10/d13/c32 59449742 1 2023-12-07T16:21:43.755 INFO:tasks.workunit.client.0.smithi063.stdout:1/459: chown d0/dd/d19/c2d 81770 1 2023-12-07T16:21:43.755 INFO:tasks.workunit.client.0.smithi063.stdout:2/711: creat d0/d21/d56/d11/d52/d5d/dbb/fe5 x:0 0 0 2023-12-07T16:21:43.756 INFO:tasks.workunit.client.1.smithi152.stdout:9/886: rename d1/f31 to d1/d9/d4f/dd3/f124 0 2023-12-07T16:21:43.762 INFO:tasks.workunit.client.1.smithi152.stdout:9/887: write d1/d9/db/d70/fb3 [2084540,78386] 0 2023-12-07T16:21:43.762 INFO:tasks.workunit.client.1.smithi152.stdout:8/800: sync 2023-12-07T16:21:43.764 INFO:tasks.workunit.client.0.smithi063.stdout:1/460: mkdir d0/dd/d10/d6f/da0 0 2023-12-07T16:21:43.766 INFO:tasks.workunit.client.1.smithi152.stdout:9/888: unlink d1/d9/db/df/d42/de8/df8/f11e 0 2023-12-07T16:21:43.767 INFO:tasks.workunit.client.0.smithi063.stdout:4/488: link d1/d3/d3f/d49/d64/d80/c83 d1/d3/db/d2c/c8e 0 2023-12-07T16:21:43.767 INFO:tasks.workunit.client.1.smithi152.stdout:9/889: dread d1/d17/d3c/d4a/d48/f91 [4194304,4194304] 0 2023-12-07T16:21:43.767 INFO:tasks.workunit.client.1.smithi152.stdout:9/890: dread - d1/d9/db/df/da6/f112 zero size 2023-12-07T16:21:43.768 INFO:tasks.workunit.client.0.smithi063.stdout:2/712: rename d0/d67/d5b/fd1 to d0/fe6 0 2023-12-07T16:21:43.769 INFO:tasks.workunit.client.1.smithi152.stdout:8/801: rename d3/d4/d9/d23/fc6 to d3/d4/d4b/f124 0 2023-12-07T16:21:43.770 INFO:tasks.workunit.client.0.smithi063.stdout:3/606: dwrite d7/d49/f77 [0,4194304] 0 2023-12-07T16:21:43.770 INFO:tasks.workunit.client.0.smithi063.stdout:4/489: symlink d1/d3/db/d16/l8f 0 2023-12-07T16:21:43.770 INFO:tasks.workunit.client.0.smithi063.stdout:2/713: symlink d0/d21/d56/d71/le7 0 2023-12-07T16:21:43.773 INFO:tasks.workunit.client.0.smithi063.stdout:3/607: creat d7/d9/d1b/fc6 x:0 0 0 2023-12-07T16:21:43.773 INFO:tasks.workunit.client.0.smithi063.stdout:3/608: chown d7/d49/dbf 170183337 1 2023-12-07T16:21:43.773 INFO:tasks.workunit.client.0.smithi063.stdout:2/714: creat d0/d21/d56/d11/d52/d5d/fe8 x:0 0 0 2023-12-07T16:21:43.775 INFO:tasks.workunit.client.0.smithi063.stdout:1/461: write d0/dd/d19/d50/d71/f52 [358087,104032] 0 2023-12-07T16:21:43.777 INFO:tasks.workunit.client.0.smithi063.stdout:3/609: mkdir d7/d4f/d53/dc7 0 2023-12-07T16:21:43.782 INFO:tasks.workunit.client.1.smithi152.stdout:2/779: dwrite d2/d1c/d52/f9d [0,4194304] 0 2023-12-07T16:21:43.783 INFO:tasks.workunit.client.1.smithi152.stdout:7/765: dwrite db/d27/d5e/d45/fab [0,4194304] 0 2023-12-07T16:21:43.785 INFO:tasks.workunit.client.0.smithi063.stdout:7/565: dwrite d2/d64/f8f [0,4194304] 0 2023-12-07T16:21:43.789 INFO:tasks.workunit.client.0.smithi063.stdout:7/566: getdents d2/d34/d5a/d5f/d53/da3 0 2023-12-07T16:21:43.789 INFO:tasks.workunit.client.0.smithi063.stdout:7/567: dread - d2/d34/d5a/d5f/d78/fb6 zero size 2023-12-07T16:21:43.790 INFO:tasks.workunit.client.0.smithi063.stdout:7/568: write d2/d37/da0/fc4 [738348,30867] 0 2023-12-07T16:21:43.793 INFO:tasks.workunit.client.1.smithi152.stdout:7/766: mkdir db/d27/d39/d41/d58/da5/dde/df2/df4 0 2023-12-07T16:21:43.796 INFO:tasks.workunit.client.0.smithi063.stdout:7/569: rename d2/d34/d5a/d5f/l28 to d2/d34/dc2/ld1 0 2023-12-07T16:21:43.796 INFO:tasks.workunit.client.1.smithi152.stdout:6/773: sync 2023-12-07T16:21:43.796 INFO:tasks.workunit.client.1.smithi152.stdout:6/774: stat d2/d4f/d83/d85/f89 0 2023-12-07T16:21:43.796 INFO:tasks.workunit.client.1.smithi152.stdout:3/848: sync 2023-12-07T16:21:43.797 INFO:tasks.workunit.client.0.smithi063.stdout:5/583: dwrite d1/d3/de/d1e/f78 [0,4194304] 0 2023-12-07T16:21:43.797 INFO:tasks.workunit.client.0.smithi063.stdout:5/584: stat d1/c9 0 2023-12-07T16:21:43.797 INFO:tasks.workunit.client.1.smithi152.stdout:2/780: dread d2/d1c/d2e/f3e [0,4194304] 0 2023-12-07T16:21:43.797 INFO:tasks.workunit.client.1.smithi152.stdout:2/781: write d2/d1c/d2e/d30/d33/fd5 [1666046,109722] 0 2023-12-07T16:21:43.798 INFO:tasks.workunit.client.0.smithi063.stdout:5/585: write d1/f2a [485981,100082] 0 2023-12-07T16:21:43.802 INFO:tasks.workunit.client.1.smithi152.stdout:5/962: dwrite dd/f40 [0,4194304] 0 2023-12-07T16:21:43.802 INFO:tasks.workunit.client.1.smithi152.stdout:3/849: creat d7/d10/d1a/d2f/d5c/f10c x:0 0 0 2023-12-07T16:21:43.806 INFO:tasks.workunit.client.1.smithi152.stdout:3/850: truncate d7/d10/d41/f8b 1369563 0 2023-12-07T16:21:43.806 INFO:tasks.workunit.client.0.smithi063.stdout:7/570: creat d2/d34/d46/d48/d70/fd2 x:0 0 0 2023-12-07T16:21:43.806 INFO:tasks.workunit.client.0.smithi063.stdout:7/571: stat d2/f8 0 2023-12-07T16:21:43.809 INFO:tasks.workunit.client.0.smithi063.stdout:5/586: truncate d1/d31/d56/d61/d5e/f75 2074762 0 2023-12-07T16:21:43.812 INFO:tasks.workunit.client.1.smithi152.stdout:5/963: mknod dd/de/c14d 0 2023-12-07T16:21:43.813 INFO:tasks.workunit.client.1.smithi152.stdout:6/775: dread d2/d4f/d83/d85/f95 [0,4194304] 0 2023-12-07T16:21:43.813 INFO:tasks.workunit.client.1.smithi152.stdout:8/802: rename d3/d4/d9/d23 to d3/d1e/d55/d83/dc5/d123/d125 0 2023-12-07T16:21:43.814 INFO:tasks.workunit.client.0.smithi063.stdout:7/572: creat d2/d34/d5a/fd3 x:0 0 0 2023-12-07T16:21:43.815 INFO:tasks.workunit.client.1.smithi152.stdout:3/851: link f2 d7/dc/d14/f10d 0 2023-12-07T16:21:43.817 INFO:tasks.workunit.client.1.smithi152.stdout:6/776: symlink d2/d4f/d83/da0/da2/lfa 0 2023-12-07T16:21:43.817 INFO:tasks.workunit.client.0.smithi063.stdout:5/587: link d1/d3/d3a/d5a/f66 d1/d3/d3a/fa8 0 2023-12-07T16:21:43.817 INFO:tasks.workunit.client.0.smithi063.stdout:7/573: creat d2/d96/fd4 x:0 0 0 2023-12-07T16:21:43.819 INFO:tasks.workunit.client.1.smithi152.stdout:8/803: rename d3/d4/d9/dc/d6f/d7b/d7e/df5/f91 to d3/d4/d9/dad/db3/df3/f126 0 2023-12-07T16:21:43.819 INFO:tasks.workunit.client.1.smithi152.stdout:8/804: dread - d3/d4/d9/dc/d6f/d7a/f10c zero size 2023-12-07T16:21:43.819 INFO:tasks.workunit.client.1.smithi152.stdout:8/805: readlink d3/d1e/d55/d83/dc5/df0/l10a 0 2023-12-07T16:21:43.820 INFO:tasks.workunit.client.1.smithi152.stdout:3/852: mknod d7/d10/d1a/de8/dfb/c10e 0 2023-12-07T16:21:43.820 INFO:tasks.workunit.client.0.smithi063.stdout:7/574: unlink d2/d34/f38 0 2023-12-07T16:21:43.820 INFO:tasks.workunit.client.0.smithi063.stdout:7/575: dread - d2/d34/d46/d48/d70/fc0 zero size 2023-12-07T16:21:43.820 INFO:tasks.workunit.client.0.smithi063.stdout:7/576: chown d2/d2c/f3a 38516995 1 2023-12-07T16:21:43.820 INFO:tasks.workunit.client.0.smithi063.stdout:7/577: getdents d2/d34/d46/d48/d70/daf 0 2023-12-07T16:21:43.821 INFO:tasks.workunit.client.0.smithi063.stdout:7/578: mknod d2/d34/dc2/cd5 0 2023-12-07T16:21:43.822 INFO:tasks.workunit.client.1.smithi152.stdout:5/964: rename dd/de/d14/l131 to dd/de/d14/d19/d1a/def/l14e 0 2023-12-07T16:21:43.822 INFO:tasks.workunit.client.1.smithi152.stdout:5/965: readlink dd/de/d14/l53 0 2023-12-07T16:21:43.823 INFO:tasks.workunit.client.0.smithi063.stdout:7/579: write d2/d34/d46/d48/f4f [478753,88873] 0 2023-12-07T16:21:43.823 INFO:tasks.workunit.client.0.smithi063.stdout:7/580: write d2/d34/d5a/d5f/f9e [58215,94007] 0 2023-12-07T16:21:43.824 INFO:tasks.workunit.client.1.smithi152.stdout:3/853: unlink d7/d10/d1a/d2f/d56/d57/dee/dda/d6b/d80/dc2/l7e 0 2023-12-07T16:21:43.825 INFO:tasks.workunit.client.1.smithi152.stdout:3/854: creat d7/d10/d1a/d2f/d5c/df6/d6d/d81/f10f x:0 0 0 2023-12-07T16:21:43.826 INFO:tasks.workunit.client.0.smithi063.stdout:7/581: write d2/d21/f3f [3859242,91357] 0 2023-12-07T16:21:43.826 INFO:tasks.workunit.client.0.smithi063.stdout:7/582: fsync d2/d34/d5a/d5f/d78/d7c/d9b/faa 0 2023-12-07T16:21:43.827 INFO:tasks.workunit.client.0.smithi063.stdout:7/583: chown d2/f8 2035 1 2023-12-07T16:21:43.827 INFO:tasks.workunit.client.1.smithi152.stdout:8/806: dread d3/fec [0,4194304] 0 2023-12-07T16:21:43.828 INFO:tasks.workunit.client.1.smithi152.stdout:3/855: symlink d7/d10/d1a/l110 0 2023-12-07T16:21:43.829 INFO:tasks.workunit.client.1.smithi152.stdout:8/807: rename d3/d1e/d55/d83/dc5/d104/f11c to d3/d4/d9/d34/de5/f127 0 2023-12-07T16:21:43.829 INFO:tasks.workunit.client.0.smithi063.stdout:7/584: mkdir d2/d34/d46/d48/d70/daf/dd6 0 2023-12-07T16:21:43.829 INFO:tasks.workunit.client.0.smithi063.stdout:5/588: dread d1/d3/d3a/f77 [0,4194304] 0 2023-12-07T16:21:43.829 INFO:tasks.workunit.client.0.smithi063.stdout:7/585: fdatasync d2/d34/d5a/d5f/d6d/f72 0 2023-12-07T16:21:43.830 INFO:tasks.workunit.client.1.smithi152.stdout:8/808: creat d3/d1e/d55/d83/dc5/f128 x:0 0 0 2023-12-07T16:21:43.830 INFO:tasks.workunit.client.1.smithi152.stdout:8/809: dread - d3/d1e/fd0 zero size 2023-12-07T16:21:43.830 INFO:tasks.workunit.client.1.smithi152.stdout:8/810: chown d3/d4/d9/dc/d6f/d7b 15267 1 2023-12-07T16:21:43.831 INFO:tasks.workunit.client.0.smithi063.stdout:7/586: mknod d2/cd7 0 2023-12-07T16:21:43.832 INFO:tasks.workunit.client.0.smithi063.stdout:7/587: creat d2/d34/d5a/d5f/d53/dab/fd8 x:0 0 0 2023-12-07T16:21:43.835 INFO:tasks.workunit.client.0.smithi063.stdout:7/588: mkdir d2/d34/d5a/d5f/d53/da3/dd9 0 2023-12-07T16:21:43.841 INFO:tasks.workunit.client.1.smithi152.stdout:3/856: dread d7/d10/d1a/d25/d78/f92 [0,4194304] 0 2023-12-07T16:21:43.842 INFO:tasks.workunit.client.0.smithi063.stdout:7/589: read d2/d34/d5a/d5f/d53/dab/fd0 [591325,121536] 0 2023-12-07T16:21:43.842 INFO:tasks.workunit.client.0.smithi063.stdout:7/590: write d2/d34/d5a/d5f/d6d/f88 [756484,67426] 0 2023-12-07T16:21:43.842 INFO:tasks.workunit.client.0.smithi063.stdout:7/591: dread - d2/fb1 zero size 2023-12-07T16:21:43.843 INFO:tasks.workunit.client.0.smithi063.stdout:7/592: mknod d2/d37/cda 0 2023-12-07T16:21:43.844 INFO:tasks.workunit.client.0.smithi063.stdout:7/593: rmdir d2/d34/d5a/d5f/d53/da3/dd9 0 2023-12-07T16:21:43.845 INFO:tasks.workunit.client.0.smithi063.stdout:7/594: mkdir d2/d34/d46/d48/d56/ddb 0 2023-12-07T16:21:43.846 INFO:tasks.workunit.client.0.smithi063.stdout:7/595: dread - d2/d34/d5a/d5f/d53/da3/fc8 zero size 2023-12-07T16:21:43.846 INFO:tasks.workunit.client.0.smithi063.stdout:7/596: chown d2/d34/d5a/d5f/d78/d7c/f90 2766 1 2023-12-07T16:21:43.851 INFO:tasks.workunit.client.0.smithi063.stdout:5/589: dread d1/f40 [0,4194304] 0 2023-12-07T16:21:43.857 INFO:tasks.workunit.client.1.smithi152.stdout:3/857: dread d7/dc/d14/f10d [0,4194304] 0 2023-12-07T16:21:43.858 INFO:tasks.workunit.client.1.smithi152.stdout:3/858: chown d7/d10/d1a/d25/fcc 6 1 2023-12-07T16:21:43.858 INFO:tasks.workunit.client.1.smithi152.stdout:3/859: read d7/d10/d1a/fc1 [74881,114370] 0 2023-12-07T16:21:43.860 INFO:tasks.workunit.client.0.smithi063.stdout:5/590: dread d1/f7 [0,4194304] 0 2023-12-07T16:21:43.860 INFO:tasks.workunit.client.0.smithi063.stdout:5/591: chown d1/d3/f99 29195891 1 2023-12-07T16:21:43.861 INFO:tasks.workunit.client.0.smithi063.stdout:5/592: rename d1/d3/de/c15 to d1/d3/de/ca9 0 2023-12-07T16:21:43.861 INFO:tasks.workunit.client.0.smithi063.stdout:5/593: creat d1/d3/de/d1e/faa x:0 0 0 2023-12-07T16:21:43.863 INFO:tasks.workunit.client.0.smithi063.stdout:1/462: dwrite d0/dd/d19/f43 [0,4194304] 0 2023-12-07T16:21:43.863 INFO:tasks.workunit.client.0.smithi063.stdout:5/594: write d1/d3/de/d1e/d25/f3c [1995,76208] 0 2023-12-07T16:21:43.863 INFO:tasks.workunit.client.1.smithi152.stdout:7/767: dwrite db/d27/d39/fe2 [0,4194304] 0 2023-12-07T16:21:43.863 INFO:tasks.workunit.client.0.smithi063.stdout:1/463: creat d0/dd/d19/fa1 x:0 0 0 2023-12-07T16:21:43.864 INFO:tasks.workunit.client.0.smithi063.stdout:1/464: mknod d0/dd/ca2 0 2023-12-07T16:21:43.864 INFO:tasks.workunit.client.0.smithi063.stdout:1/465: chown d0/dd/d55/c57 0 1 2023-12-07T16:21:43.865 INFO:tasks.workunit.client.0.smithi063.stdout:4/490: dwrite d1/d3/db/d2c/d63/f33 [0,4194304] 0 2023-12-07T16:21:43.866 INFO:tasks.workunit.client.1.smithi152.stdout:9/891: dwrite d1/d9/f2b [0,4194304] 0 2023-12-07T16:21:43.866 INFO:tasks.workunit.client.1.smithi152.stdout:9/892: chown d1/d9/db/d70 16347987 1 2023-12-07T16:21:43.866 INFO:tasks.workunit.client.1.smithi152.stdout:9/893: chown d1/d9/db/df/fbd 64246416 1 2023-12-07T16:21:43.866 INFO:tasks.workunit.client.1.smithi152.stdout:6/777: dwrite d2/d4f/d83/d85/d65/fda [0,4194304] 0 2023-12-07T16:21:43.867 INFO:tasks.workunit.client.1.smithi152.stdout:7/768: link db/d27/d39/ld2 db/d27/d39/d41/dcb/lf5 0 2023-12-07T16:21:43.867 INFO:tasks.workunit.client.0.smithi063.stdout:3/610: dwrite d7/d9/dd/f1e [4194304,4194304] 0 2023-12-07T16:21:43.870 INFO:tasks.workunit.client.1.smithi152.stdout:5/966: dwrite dd/de/d14/d19/f64 [4194304,4194304] 0 2023-12-07T16:21:43.870 INFO:tasks.workunit.client.1.smithi152.stdout:2/782: dwrite d2/d1c/d2e/d57/f9f [0,4194304] 0 2023-12-07T16:21:43.870 INFO:tasks.workunit.client.1.smithi152.stdout:8/811: dwrite d3/d1e/d55/d83/dae/fb4 [0,4194304] 0 2023-12-07T16:21:43.870 INFO:tasks.workunit.client.1.smithi152.stdout:8/812: write d3/d1e/d43/dbc/fc0 [1054753,127055] 0 2023-12-07T16:21:43.870 INFO:tasks.workunit.client.1.smithi152.stdout:8/813: fsync d3/d4/d9/dc/d6f/d7b/d7e/df5/d67/dd4/fe3 0 2023-12-07T16:21:43.870 INFO:tasks.workunit.client.1.smithi152.stdout:8/814: write d3/d4/d9/dc/d6f/d7b/d7e/fe8 [610368,99645] 0 2023-12-07T16:21:43.871 INFO:tasks.workunit.client.1.smithi152.stdout:6/778: symlink d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/da1/db5/lfb 0 2023-12-07T16:21:43.871 INFO:tasks.workunit.client.1.smithi152.stdout:9/894: mkdir d1/d9/d4f/daf/d125 0 2023-12-07T16:21:43.872 INFO:tasks.workunit.client.1.smithi152.stdout:7/769: symlink db/d27/d5e/d45/da9/lf6 0 2023-12-07T16:21:43.877 INFO:tasks.workunit.client.1.smithi152.stdout:5/967: chown dd/de/d14/d19/d7a/f133 403 1 2023-12-07T16:21:43.880 INFO:tasks.workunit.client.1.smithi152.stdout:8/815: creat d3/d1e/d55/d83/dae/de1/f129 x:0 0 0 2023-12-07T16:21:43.880 INFO:tasks.workunit.client.1.smithi152.stdout:6/779: mkdir d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/dfc 0 2023-12-07T16:21:43.885 INFO:tasks.workunit.client.0.smithi063.stdout:3/611: mkdir d7/d9/d1b/dc8 0 2023-12-07T16:21:43.887 INFO:tasks.workunit.client.1.smithi152.stdout:7/770: rename db/d27/f9d to db/d27/d39/d41/d58/da5/dde/ff7 0 2023-12-07T16:21:43.887 INFO:tasks.workunit.client.1.smithi152.stdout:7/771: readlink db/d68/d87/ld5 0 2023-12-07T16:21:43.890 INFO:tasks.workunit.client.1.smithi152.stdout:9/895: dread d1/d9/db/df/d42/f93 [0,4194304] 0 2023-12-07T16:21:43.890 INFO:tasks.workunit.client.1.smithi152.stdout:9/896: write d1/d9/d2d/d72/f113 [106978,53082] 0 2023-12-07T16:21:43.893 INFO:tasks.workunit.client.1.smithi152.stdout:5/968: symlink dd/de/d38/d3d/d6d/dae/l14f 0 2023-12-07T16:21:43.895 INFO:tasks.workunit.client.1.smithi152.stdout:6/780: creat d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/df9/ffd x:0 0 0 2023-12-07T16:21:43.897 INFO:tasks.workunit.client.1.smithi152.stdout:7/772: unlink db/d1c/c1d 0 2023-12-07T16:21:43.899 INFO:tasks.workunit.client.1.smithi152.stdout:7/773: symlink db/d27/d5e/lf8 0 2023-12-07T16:21:43.901 INFO:tasks.workunit.client.1.smithi152.stdout:7/774: link db/d27/d5e/f84 db/d27/d39/d41/d58/da5/ff9 0 2023-12-07T16:21:43.902 INFO:tasks.workunit.client.1.smithi152.stdout:6/781: write d2/f2a [3837804,60723] 0 2023-12-07T16:21:43.902 INFO:tasks.workunit.client.1.smithi152.stdout:6/782: readlink d2/d4f/d83/l2c 0 2023-12-07T16:21:43.903 INFO:tasks.workunit.client.1.smithi152.stdout:7/775: link db/d27/f3b db/d27/d5e/dee/ffa 0 2023-12-07T16:21:43.908 INFO:tasks.workunit.client.0.smithi063.stdout:5/595: dwrite d1/d3/f35 [4194304,4194304] 0 2023-12-07T16:21:43.911 INFO:tasks.workunit.client.0.smithi063.stdout:5/596: dread d1/d31/d56/f6f [0,4194304] 0 2023-12-07T16:21:43.920 INFO:tasks.workunit.client.1.smithi152.stdout:7/776: dread db/d1c/fd8 [0,4194304] 0 2023-12-07T16:21:43.921 INFO:tasks.workunit.client.1.smithi152.stdout:7/777: write db/d27/d4d/dc9/fe0 [923838,37386] 0 2023-12-07T16:21:43.922 INFO:tasks.workunit.client.1.smithi152.stdout:7/778: mkdir db/d27/d4d/dfb 0 2023-12-07T16:21:43.923 INFO:tasks.workunit.client.1.smithi152.stdout:7/779: truncate db/d27/d39/d41/d58/f55 3440505 0 2023-12-07T16:21:43.924 INFO:tasks.workunit.client.1.smithi152.stdout:7/780: getdents db/d27/d39/d41/d58 0 2023-12-07T16:21:43.927 INFO:tasks.workunit.client.0.smithi063.stdout:3/612: dwrite d7/ff [0,4194304] 0 2023-12-07T16:21:43.929 INFO:tasks.workunit.client.0.smithi063.stdout:3/613: unlink d7/d9/dd/c28 0 2023-12-07T16:21:43.930 INFO:tasks.workunit.client.0.smithi063.stdout:3/614: creat d7/d4f/d53/d72/fc9 x:0 0 0 2023-12-07T16:21:43.931 INFO:tasks.workunit.client.0.smithi063.stdout:3/615: getdents d7/d9 0 2023-12-07T16:21:43.940 INFO:tasks.workunit.client.0.smithi063.stdout:1/466: dwrite d0/dd/d10/d1b/f67 [0,4194304] 0 2023-12-07T16:21:43.941 INFO:tasks.workunit.client.1.smithi152.stdout:2/783: dwrite d2/d9/f25 [0,4194304] 0 2023-12-07T16:21:43.941 INFO:tasks.workunit.client.1.smithi152.stdout:2/784: fdatasync d2/d1c/d52/da8/db6/ffe 0 2023-12-07T16:21:43.943 INFO:tasks.workunit.client.1.smithi152.stdout:2/785: mkdir d2/d56/d10a 0 2023-12-07T16:21:43.943 INFO:tasks.workunit.client.1.smithi152.stdout:2/786: write d2/d1c/d2e/d57/db1/d90/f39 [3749426,13252] 0 2023-12-07T16:21:43.943 INFO:tasks.workunit.client.1.smithi152.stdout:5/969: dwrite dd/d91/dbe/d10e/f44 [0,4194304] 0 2023-12-07T16:21:43.943 INFO:tasks.workunit.client.1.smithi152.stdout:6/783: dwrite d2/d4f/d83/d85/fc [4194304,4194304] 0 2023-12-07T16:21:43.944 INFO:tasks.workunit.client.1.smithi152.stdout:9/897: dwrite d1/d17/fd5 [0,4194304] 0 2023-12-07T16:21:43.944 INFO:tasks.workunit.client.1.smithi152.stdout:9/898: write d1/dd/f78 [2003072,124596] 0 2023-12-07T16:21:43.945 INFO:tasks.workunit.client.0.smithi063.stdout:6/652: sync 2023-12-07T16:21:43.946 INFO:tasks.workunit.client.0.smithi063.stdout:0/643: sync 2023-12-07T16:21:43.946 INFO:tasks.workunit.client.0.smithi063.stdout:9/545: sync 2023-12-07T16:21:43.946 INFO:tasks.workunit.client.0.smithi063.stdout:8/760: sync 2023-12-07T16:21:43.947 INFO:tasks.workunit.client.0.smithi063.stdout:6/653: link d0/d1e/d1d/f27 d0/d1e/d20/d4a/fec 0 2023-12-07T16:21:43.948 INFO:tasks.workunit.client.0.smithi063.stdout:6/654: chown d0/d1e/f81 31 1 2023-12-07T16:21:43.948 INFO:tasks.workunit.client.1.smithi152.stdout:0/854: sync 2023-12-07T16:21:43.948 INFO:tasks.workunit.client.1.smithi152.stdout:0/855: readlink d0/dc/d3d/d4c/l115 0 2023-12-07T16:21:43.948 INFO:tasks.workunit.client.1.smithi152.stdout:1/955: sync 2023-12-07T16:21:43.948 INFO:tasks.workunit.client.1.smithi152.stdout:5/970: mknod dd/de/d38/d3d/c150 0 2023-12-07T16:21:43.948 INFO:tasks.workunit.client.1.smithi152.stdout:5/971: truncate dd/d91/dbe/d10e/f44 5028518 0 2023-12-07T16:21:43.949 INFO:tasks.workunit.client.0.smithi063.stdout:8/761: creat d7/d14/d15/dac/dad/ff0 x:0 0 0 2023-12-07T16:21:43.951 INFO:tasks.workunit.client.1.smithi152.stdout:6/784: symlink d2/d4f/d83/d85/d65/lfe 0 2023-12-07T16:21:43.952 INFO:tasks.workunit.client.0.smithi063.stdout:3/616: dwrite d7/d49/d4b/fad [0,4194304] 0 2023-12-07T16:21:43.952 INFO:tasks.workunit.client.1.smithi152.stdout:1/956: dread dc/d14/fd8 [0,4194304] 0 2023-12-07T16:21:43.953 INFO:tasks.workunit.client.1.smithi152.stdout:1/957: write dc/d14/d18/f70 [1098495,649] 0 2023-12-07T16:21:43.955 INFO:tasks.workunit.client.1.smithi152.stdout:4/772: sync 2023-12-07T16:21:43.955 INFO:tasks.workunit.client.1.smithi152.stdout:4/773: truncate d0/d3/d6/d36/d85/f74 460861 0 2023-12-07T16:21:43.955 INFO:tasks.workunit.client.1.smithi152.stdout:4/774: fsync d0/d3/d6/d36/f82 0 2023-12-07T16:21:43.960 INFO:tasks.workunit.client.0.smithi063.stdout:3/617: truncate d7/d4f/f55 2872109 0 2023-12-07T16:21:43.962 INFO:tasks.workunit.client.0.smithi063.stdout:1/467: dread d0/dd/f42 [0,4194304] 0 2023-12-07T16:21:43.963 INFO:tasks.workunit.client.1.smithi152.stdout:9/899: unlink d1/dd/dd6/de2/d53/dff/l105 0 2023-12-07T16:21:43.963 INFO:tasks.workunit.client.1.smithi152.stdout:9/900: chown d1/dd/ce 36136 1 2023-12-07T16:21:43.963 INFO:tasks.workunit.client.1.smithi152.stdout:9/901: fdatasync d1/d9/f12 0 2023-12-07T16:21:43.963 INFO:tasks.workunit.client.0.smithi063.stdout:3/618: rmdir d7/d21 39 2023-12-07T16:21:43.964 INFO:tasks.workunit.client.0.smithi063.stdout:3/619: stat l4 0 2023-12-07T16:21:43.965 INFO:tasks.workunit.client.1.smithi152.stdout:0/856: rename d0/d27/d11 to d0/dc/d3d/d73/d128 0 2023-12-07T16:21:43.965 INFO:tasks.workunit.client.0.smithi063.stdout:9/546: dread d0/d21/d64/d6a/d85/da4/f55 [0,4194304] 0 2023-12-07T16:21:43.966 INFO:tasks.workunit.client.1.smithi152.stdout:5/972: symlink dd/de/d14/d1f/d49/l151 0 2023-12-07T16:21:43.967 INFO:tasks.workunit.client.0.smithi063.stdout:3/620: creat d7/d9/fca x:0 0 0 2023-12-07T16:21:43.967 INFO:tasks.workunit.client.0.smithi063.stdout:9/547: rmdir d0/d21/d64/d6a/d85 39 2023-12-07T16:21:43.968 INFO:tasks.workunit.client.0.smithi063.stdout:3/621: mkdir d7/d9/dd/d7f/dcb 0 2023-12-07T16:21:43.969 INFO:tasks.workunit.client.0.smithi063.stdout:3/622: dread - d7/d4f/d53/f5b zero size 2023-12-07T16:21:43.969 INFO:tasks.workunit.client.0.smithi063.stdout:9/548: write d0/d13/f49 [2368395,85186] 0 2023-12-07T16:21:43.969 INFO:tasks.workunit.client.0.smithi063.stdout:9/549: write d0/d21/d64/d6a/d85/da4/f9e [196313,130295] 0 2023-12-07T16:21:43.973 INFO:tasks.workunit.client.1.smithi152.stdout:1/958: creat dc/d14/d18/de9/d12b/f13b x:0 0 0 2023-12-07T16:21:43.974 INFO:tasks.workunit.client.0.smithi063.stdout:9/550: symlink d0/d21/d64/d6a/d85/lb5 0 2023-12-07T16:21:43.975 INFO:tasks.workunit.client.0.smithi063.stdout:1/468: dread d0/dd/d10/d46/f91 [0,4194304] 0 2023-12-07T16:21:43.976 INFO:tasks.workunit.client.1.smithi152.stdout:9/902: chown d1/d9/db/cd8 47 1 2023-12-07T16:21:43.976 INFO:tasks.workunit.client.1.smithi152.stdout:6/785: rename d2/c56 to d2/d4f/d83/d48/d70/cff 0 2023-12-07T16:21:43.976 INFO:tasks.workunit.client.1.smithi152.stdout:6/786: write d2/d4f/d83/d58/f93 [839426,94588] 0 2023-12-07T16:21:43.976 INFO:tasks.workunit.client.1.smithi152.stdout:6/787: dread - d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/fe4 zero size 2023-12-07T16:21:43.977 INFO:tasks.workunit.client.0.smithi063.stdout:1/469: creat d0/dd/d10/fa3 x:0 0 0 2023-12-07T16:21:43.978 INFO:tasks.workunit.client.1.smithi152.stdout:0/857: mkdir d0/dc/d3d/dab/dc8/d129 0 2023-12-07T16:21:43.979 INFO:tasks.workunit.client.0.smithi063.stdout:1/470: mknod d0/dd/d10/d6f/da0/ca4 0 2023-12-07T16:21:43.979 INFO:tasks.workunit.client.0.smithi063.stdout:3/623: dread d7/d9/f18 [4194304,4194304] 0 2023-12-07T16:21:43.980 INFO:tasks.workunit.client.1.smithi152.stdout:6/788: write d2/f4 [4715811,47592] 0 2023-12-07T16:21:43.980 INFO:tasks.workunit.client.1.smithi152.stdout:6/789: chown d2/d4f/d83/d48/d70/d81/fe8 437246 1 2023-12-07T16:21:43.980 INFO:tasks.workunit.client.1.smithi152.stdout:6/790: chown d2/f3 90 1 2023-12-07T16:21:43.982 INFO:tasks.workunit.client.0.smithi063.stdout:3/624: mknod d7/d49/d4b/ccc 0 2023-12-07T16:21:43.982 INFO:tasks.workunit.client.1.smithi152.stdout:5/973: getdents dd/de/d14 0 2023-12-07T16:21:43.985 INFO:tasks.workunit.client.1.smithi152.stdout:1/959: creat dc/d14/d18/d2d/d48/da3/dbf/f13c x:0 0 0 2023-12-07T16:21:43.989 INFO:tasks.workunit.client.0.smithi063.stdout:3/625: rename d7/d4f/f94 to d7/fcd 0 2023-12-07T16:21:43.989 INFO:tasks.workunit.client.0.smithi063.stdout:6/655: dwrite d0/d17/f5d [0,4194304] 0 2023-12-07T16:21:43.989 INFO:tasks.workunit.client.1.smithi152.stdout:4/775: rename d0/d3/d6/d2b/dd9/d3a/d46/fac to d0/d3/fe4 0 2023-12-07T16:21:43.990 INFO:tasks.workunit.client.0.smithi063.stdout:0/644: dwrite d4/dd/d26/d2b/d5e/d8e/f66 [0,4194304] 0 2023-12-07T16:21:43.990 INFO:tasks.workunit.client.0.smithi063.stdout:0/645: write d4/d25/fd3 [164255,22996] 0 2023-12-07T16:21:43.990 INFO:tasks.workunit.client.0.smithi063.stdout:0/646: getdents d4/dd/d26/d2b/db5/d5b/d63/d6b/da8/dcd 0 2023-12-07T16:21:43.990 INFO:tasks.workunit.client.0.smithi063.stdout:3/626: creat d7/d49/dbf/fce x:0 0 0 2023-12-07T16:21:43.991 INFO:tasks.workunit.client.0.smithi063.stdout:3/627: chown d7/d4f/d53/d72/db1/d41/f5a 316656 1 2023-12-07T16:21:43.991 INFO:tasks.workunit.client.1.smithi152.stdout:6/791: mkdir d2/d4f/d83/d85/d65/d100 0 2023-12-07T16:21:43.991 INFO:tasks.workunit.client.1.smithi152.stdout:5/974: truncate dd/de/f13 1205935 0 2023-12-07T16:21:43.991 INFO:tasks.workunit.client.1.smithi152.stdout:6/792: write d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/ff4 [759038,25503] 0 2023-12-07T16:21:43.993 INFO:tasks.workunit.client.1.smithi152.stdout:1/960: truncate dc/d14/d90/da9/df5/f106 970563 0 2023-12-07T16:21:43.993 INFO:tasks.workunit.client.0.smithi063.stdout:6/656: creat d0/d1e/d60/d68/d78/d9c/d9f/db8/fed x:0 0 0 2023-12-07T16:21:43.995 INFO:tasks.workunit.client.0.smithi063.stdout:0/647: creat d4/dd/d26/d2b/db5/fda x:0 0 0 2023-12-07T16:21:43.995 INFO:tasks.workunit.client.0.smithi063.stdout:1/471: dread d0/dd/d19/f43 [0,4194304] 0 2023-12-07T16:21:43.996 INFO:tasks.workunit.client.0.smithi063.stdout:1/472: chown d0/dd/d10/d13 974287 1 2023-12-07T16:21:43.996 INFO:tasks.workunit.client.0.smithi063.stdout:1/473: truncate d0/dd/d10/d6f/f7a 385709 0 2023-12-07T16:21:43.996 INFO:tasks.workunit.client.1.smithi152.stdout:0/858: rename d0/d27/d8c/df7/d30/d6e/d77/fa6 to d0/dc/f12a 0 2023-12-07T16:21:43.996 INFO:tasks.workunit.client.1.smithi152.stdout:0/859: stat d0/dc/f3c 0 2023-12-07T16:21:43.996 INFO:tasks.workunit.client.1.smithi152.stdout:0/860: chown d0/d27/de6 239833 1 2023-12-07T16:21:43.997 INFO:tasks.workunit.client.0.smithi063.stdout:3/628: dread d7/d9/f88 [0,4194304] 0 2023-12-07T16:21:43.997 INFO:tasks.workunit.client.0.smithi063.stdout:3/629: chown d7/d4f/d53/d72/db1/d41/f5a 5593 1 2023-12-07T16:21:43.997 INFO:tasks.workunit.client.0.smithi063.stdout:3/630: fdatasync d7/d4f/d53/f6a 0 2023-12-07T16:21:43.997 INFO:tasks.workunit.client.0.smithi063.stdout:6/657: creat d0/d17/d46/fee x:0 0 0 2023-12-07T16:21:43.997 INFO:tasks.workunit.client.1.smithi152.stdout:4/776: creat d0/d3/d6/d2b/dd9/d3a/d46/d4e/fe5 x:0 0 0 2023-12-07T16:21:43.998 INFO:tasks.workunit.client.0.smithi063.stdout:0/648: mkdir d4/dd/d26/d2b/db5/d5b/d63/d74/d84/ddb 0 2023-12-07T16:21:43.998 INFO:tasks.workunit.client.0.smithi063.stdout:1/474: creat d0/dd/d1f/d9d/fa5 x:0 0 0 2023-12-07T16:21:43.999 INFO:tasks.workunit.client.0.smithi063.stdout:3/631: mknod d7/d4f/d53/d72/db1/ccf 0 2023-12-07T16:21:43.999 INFO:tasks.workunit.client.0.smithi063.stdout:3/632: read - d7/d4f/d53/d72/d7d/f85 zero size 2023-12-07T16:21:44.000 INFO:tasks.workunit.client.1.smithi152.stdout:0/861: rename d0/d27/f1f to d0/dc/d3d/d73/d128/d68/f12b 0 2023-12-07T16:21:44.001 INFO:tasks.workunit.client.0.smithi063.stdout:6/658: mkdir d0/d1e/d60/d68/d76/da4/def 0 2023-12-07T16:21:44.001 INFO:tasks.workunit.client.0.smithi063.stdout:6/659: dread - d0/d1e/d20/d4a/f7a zero size 2023-12-07T16:21:44.003 INFO:tasks.workunit.client.0.smithi063.stdout:0/649: rename d4/dd/d26/d2b/d5e/d8e/d95/l6e to d4/dd/de/d15/d1f/d4c/da1/ldc 0 2023-12-07T16:21:44.003 INFO:tasks.workunit.client.0.smithi063.stdout:6/660: getdents d0/d1e/d60/d68 0 2023-12-07T16:21:44.003 INFO:tasks.workunit.client.0.smithi063.stdout:6/661: dread - d0/d1e/d1d/d1f/d4b/f85 zero size 2023-12-07T16:21:44.007 INFO:tasks.workunit.client.1.smithi152.stdout:4/777: mkdir d0/d3/d6/de6 0 2023-12-07T16:21:44.007 INFO:tasks.workunit.client.1.smithi152.stdout:5/975: dread dd/de/d14/d1f/f106 [0,4194304] 0 2023-12-07T16:21:44.009 INFO:tasks.workunit.client.0.smithi063.stdout:0/650: write d4/dd/d26/f70 [1180211,34038] 0 2023-12-07T16:21:44.009 INFO:tasks.workunit.client.0.smithi063.stdout:0/651: dread - d4/dd/d26/d2b/db5/f87 zero size 2023-12-07T16:21:44.014 INFO:tasks.workunit.client.0.smithi063.stdout:0/652: unlink d4/dd/de/d15/c4d 0 2023-12-07T16:21:44.015 INFO:tasks.workunit.client.0.smithi063.stdout:0/653: mknod d4/dd/de/d15/d59/d43/d91/cdd 0 2023-12-07T16:21:44.017 INFO:tasks.workunit.client.1.smithi152.stdout:0/862: rename d0/d27/l32 to d0/dc/d36/d7d/d120/l12c 0 2023-12-07T16:21:44.020 INFO:tasks.workunit.client.0.smithi063.stdout:0/654: dread d4/f55 [0,4194304] 0 2023-12-07T16:21:44.020 INFO:tasks.workunit.client.0.smithi063.stdout:0/655: chown d4/dd/d26/d2b/db5/d5b/d63/d74 399719 1 2023-12-07T16:21:44.021 INFO:tasks.workunit.client.0.smithi063.stdout:8/762: dwrite d7/f7f [0,4194304] 0 2023-12-07T16:21:44.022 INFO:tasks.workunit.client.1.smithi152.stdout:5/976: getdents dd/de/d14/d19/da3/ddf 0 2023-12-07T16:21:44.022 INFO:tasks.workunit.client.1.smithi152.stdout:5/977: readlink dd/de/d14/d19/d74/l75 0 2023-12-07T16:21:44.023 INFO:tasks.workunit.client.1.smithi152.stdout:2/787: dwrite d2/d1c/d2e/d30/d33/ffb [4194304,4194304] 0 2023-12-07T16:21:44.024 INFO:tasks.workunit.client.1.smithi152.stdout:5/978: creat dd/d91/dbe/d10e/f152 x:0 0 0 2023-12-07T16:21:44.027 INFO:tasks.workunit.client.0.smithi063.stdout:0/656: unlink d4/dd/de/d15/d1f/d4c/c83 0 2023-12-07T16:21:44.028 INFO:tasks.workunit.client.0.smithi063.stdout:8/763: rename d7/d14/d4e to d7/d38/df1 0 2023-12-07T16:21:44.028 INFO:tasks.workunit.client.0.smithi063.stdout:0/657: fdatasync d4/dd/d26/d2b/d5e/d8e/d95/f7a 0 2023-12-07T16:21:44.028 INFO:tasks.workunit.client.1.smithi152.stdout:5/979: mknod dd/de/d14/d19/c153 0 2023-12-07T16:21:44.030 INFO:tasks.workunit.client.1.smithi152.stdout:5/980: getdents dd/d91 0 2023-12-07T16:21:44.031 INFO:tasks.workunit.client.0.smithi063.stdout:8/764: creat d7/d14/ff2 x:0 0 0 2023-12-07T16:21:44.031 INFO:tasks.workunit.client.0.smithi063.stdout:0/658: rename d4/dd/d26/d2b/db5/d5b/d63/d6b/da8/dcd to d4/dd/d26/d2b/db5/d5b/d63/d74/d84/ddb/dde 0 2023-12-07T16:21:44.033 INFO:tasks.workunit.client.1.smithi152.stdout:5/981: rmdir dd/de/d14/d19/d74 39 2023-12-07T16:21:44.033 INFO:tasks.workunit.client.1.smithi152.stdout:6/793: fsync d2/f4 0 2023-12-07T16:21:44.033 INFO:tasks.workunit.client.1.smithi152.stdout:9/903: dwrite d1/d9/d4f/dd3/f124 [4194304,4194304] 0 2023-12-07T16:21:44.033 INFO:tasks.workunit.client.0.smithi063.stdout:8/765: unlink d7/d38/d8e/l9d 0 2023-12-07T16:21:44.033 INFO:tasks.workunit.client.0.smithi063.stdout:8/766: readlink d7/l13 0 2023-12-07T16:21:44.034 INFO:tasks.workunit.client.0.smithi063.stdout:0/659: symlink d4/ldf 0 2023-12-07T16:21:44.035 INFO:tasks.workunit.client.0.smithi063.stdout:8/767: symlink d7/d14/d15/dde/da8/d9f/lf3 0 2023-12-07T16:21:44.035 INFO:tasks.workunit.client.0.smithi063.stdout:8/768: fsync d7/d14/d15/dac/dad/ff0 0 2023-12-07T16:21:44.035 INFO:tasks.workunit.client.0.smithi063.stdout:8/769: stat d7/d14/d1a/dce/c82 0 2023-12-07T16:21:44.039 INFO:tasks.workunit.client.0.smithi063.stdout:8/770: symlink d7/d14/d15/dde/d63/d75/d98/lf4 0 2023-12-07T16:21:44.039 INFO:tasks.workunit.client.0.smithi063.stdout:8/771: truncate d7/d14/d1a/fc9 733246 0 2023-12-07T16:21:44.043 INFO:tasks.workunit.client.0.smithi063.stdout:9/551: dwrite d0/f3 [0,4194304] 0 2023-12-07T16:21:44.045 INFO:tasks.workunit.client.0.smithi063.stdout:8/772: dread d7/d14/f9e [0,4194304] 0 2023-12-07T16:21:44.045 INFO:tasks.workunit.client.0.smithi063.stdout:9/552: link d0/d21/ca1 d0/d13/d6f/cb6 0 2023-12-07T16:21:44.046 INFO:tasks.workunit.client.0.smithi063.stdout:8/773: link d7/d38/d73/ced d7/d14/d15/d57/cf5 0 2023-12-07T16:21:44.046 INFO:tasks.workunit.client.0.smithi063.stdout:8/774: truncate d7/d14/d15/d57/fb8 732462 0 2023-12-07T16:21:44.046 INFO:tasks.workunit.client.0.smithi063.stdout:8/775: readlink d7/d14/d15/dac/dad/lc2 0 2023-12-07T16:21:44.046 INFO:tasks.workunit.client.0.smithi063.stdout:8/776: write d7/d14/d15/d57/f66 [582038,48726] 0 2023-12-07T16:21:44.048 INFO:tasks.workunit.client.0.smithi063.stdout:9/553: link d0/d13/d39/d3a/d78/l80 d0/d13/d39/lb7 0 2023-12-07T16:21:44.048 INFO:tasks.workunit.client.0.smithi063.stdout:9/554: fsync d0/d13/f7e 0 2023-12-07T16:21:44.048 INFO:tasks.workunit.client.0.smithi063.stdout:8/777: creat d7/d14/d15/dde/d63/d75/d98/de8/ff6 x:0 0 0 2023-12-07T16:21:44.049 INFO:tasks.workunit.client.0.smithi063.stdout:9/555: mknod d0/d13/d6f/cb8 0 2023-12-07T16:21:44.050 INFO:tasks.workunit.client.0.smithi063.stdout:8/778: creat d7/d14/d15/dde/ff7 x:0 0 0 2023-12-07T16:21:44.051 INFO:tasks.workunit.client.0.smithi063.stdout:9/556: creat d0/d13/d39/d42/d57/fb9 x:0 0 0 2023-12-07T16:21:44.051 INFO:tasks.workunit.client.0.smithi063.stdout:9/557: read d0/d21/f2c [825712,66696] 0 2023-12-07T16:21:44.055 INFO:tasks.workunit.client.1.smithi152.stdout:6/794: dread d2/d4f/d83/d85/d19/fca [0,4194304] 0 2023-12-07T16:21:44.056 INFO:tasks.workunit.client.1.smithi152.stdout:9/904: write d1/d9/d2d/d65/fbb [3531080,68223] 0 2023-12-07T16:21:44.056 INFO:tasks.workunit.client.1.smithi152.stdout:6/795: mkdir d2/d4f/d83/d85/d19/d1f/d101 0 2023-12-07T16:21:44.058 INFO:tasks.workunit.client.1.smithi152.stdout:6/796: unlink d2/d4f/d83/d85/d9/c8f 0 2023-12-07T16:21:44.058 INFO:tasks.workunit.client.1.smithi152.stdout:6/797: write d2/d4f/d83/d48/d70/fdb [1951176,85115] 0 2023-12-07T16:21:44.060 INFO:tasks.workunit.client.1.smithi152.stdout:6/798: mkdir d2/d4f/d83/d85/d65/d100/d102 0 2023-12-07T16:21:44.060 INFO:tasks.workunit.client.1.smithi152.stdout:6/799: chown d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/cf0 58 1 2023-12-07T16:21:44.061 INFO:tasks.workunit.client.1.smithi152.stdout:6/800: symlink d2/d4f/d83/d85/d9/deb/l103 0 2023-12-07T16:21:44.063 INFO:tasks.workunit.client.1.smithi152.stdout:6/801: rmdir d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e 39 2023-12-07T16:21:44.063 INFO:tasks.workunit.client.1.smithi152.stdout:6/802: fsync d2/d4f/d83/d85/d94/fc2 0 2023-12-07T16:21:44.063 INFO:tasks.workunit.client.1.smithi152.stdout:6/803: write d2/d4f/d83/d85/d19/d1f/dc7/dc9/f62 [351983,4376] 0 2023-12-07T16:21:44.063 INFO:tasks.workunit.client.1.smithi152.stdout:6/804: chown d2/d4f/d83/d85/d94 0 1 2023-12-07T16:21:44.063 INFO:tasks.workunit.client.1.smithi152.stdout:6/805: chown d2/d4f/d83/d48/d70/da7/db7/d9d 31003459 1 2023-12-07T16:21:44.063 INFO:tasks.workunit.client.0.smithi063.stdout:8/779: dread d7/d14/d15/dde/d63/f6b [0,4194304] 0 2023-12-07T16:21:44.067 INFO:tasks.workunit.client.1.smithi152.stdout:1/961: dwrite dc/d14/d18/d79/d86/f8e [0,4194304] 0 2023-12-07T16:21:44.067 INFO:tasks.workunit.client.1.smithi152.stdout:1/962: fdatasync dc/d14/d90/da9/df5/f104 0 2023-12-07T16:21:44.067 INFO:tasks.workunit.client.1.smithi152.stdout:1/963: fdatasync dc/d14/fd3 0 2023-12-07T16:21:44.071 INFO:tasks.workunit.client.1.smithi152.stdout:9/905: dread d1/d17/d3c/d4a/d48/d8c/f115 [0,4194304] 0 2023-12-07T16:21:44.071 INFO:tasks.workunit.client.1.smithi152.stdout:9/906: fdatasync d1/d17/d3c/d4a/d48/d8c/fc3 0 2023-12-07T16:21:44.074 INFO:tasks.workunit.client.1.smithi152.stdout:1/964: creat dc/d14/d90/da9/df5/f13d x:0 0 0 2023-12-07T16:21:44.074 INFO:tasks.workunit.client.1.smithi152.stdout:1/965: fdatasync dc/d14/d18/d2d/d4a/d52/f73 0 2023-12-07T16:21:44.075 INFO:tasks.workunit.client.0.smithi063.stdout:1/475: dwrite d0/dd/d19/d50/d71/f64 [4194304,4194304] 0 2023-12-07T16:21:44.075 INFO:tasks.workunit.client.1.smithi152.stdout:1/966: truncate dc/d28/f39 4856038 0 2023-12-07T16:21:44.076 INFO:tasks.workunit.client.1.smithi152.stdout:1/967: rmdir dc/d14/dfe 39 2023-12-07T16:21:44.078 INFO:tasks.workunit.client.1.smithi152.stdout:1/968: unlink dc/d14/fd8 0 2023-12-07T16:21:44.079 INFO:tasks.workunit.client.1.smithi152.stdout:1/969: getdents dc/def/df6 0 2023-12-07T16:21:44.081 INFO:tasks.workunit.client.1.smithi152.stdout:1/970: mkdir dc/d14/d18/d2d/d9c/dfc/d13e 0 2023-12-07T16:21:44.081 INFO:tasks.workunit.client.1.smithi152.stdout:1/971: chown dc/d14/d18/d2d/d9c/db2 24039230 1 2023-12-07T16:21:44.082 INFO:tasks.workunit.client.1.smithi152.stdout:1/972: truncate dc/d14/d90/fac 939748 0 2023-12-07T16:21:44.082 INFO:tasks.workunit.client.1.smithi152.stdout:1/973: write dc/d14/d90/da9/df5/f13d [268627,44523] 0 2023-12-07T16:21:44.083 INFO:tasks.workunit.client.1.smithi152.stdout:4/778: dwrite d0/d3/d6/f1d [0,4194304] 0 2023-12-07T16:21:44.083 INFO:tasks.workunit.client.1.smithi152.stdout:4/779: chown d0/d3/d6/d2b/dd9/d3a/d46/c6e 32468778 1 2023-12-07T16:21:44.084 INFO:tasks.workunit.client.1.smithi152.stdout:1/974: rename dc/d14/d18/d79/d86/db7/fd0 to dc/d14/d18/d64/d8a/f13f 0 2023-12-07T16:21:44.084 INFO:tasks.workunit.client.0.smithi063.stdout:3/633: dwrite d7/d9/dd/f19 [0,4194304] 0 2023-12-07T16:21:44.085 INFO:tasks.workunit.client.0.smithi063.stdout:3/634: dread - d7/d49/dbf/fce zero size 2023-12-07T16:21:44.085 INFO:tasks.workunit.client.0.smithi063.stdout:3/635: write d7/d4f/d53/f5b [656603,102708] 0 2023-12-07T16:21:44.086 INFO:tasks.workunit.client.0.smithi063.stdout:1/476: mknod d0/d47/ca6 0 2023-12-07T16:21:44.086 INFO:tasks.workunit.client.0.smithi063.stdout:1/477: readlink d0/dd/d10/d13/l76 0 2023-12-07T16:21:44.088 INFO:tasks.workunit.client.1.smithi152.stdout:1/975: dread dc/d14/d18/d79/f85 [0,4194304] 0 2023-12-07T16:21:44.090 INFO:tasks.workunit.client.1.smithi152.stdout:5/982: dwrite dd/f76 [0,4194304] 0 2023-12-07T16:21:44.090 INFO:tasks.workunit.client.1.smithi152.stdout:0/863: dwrite d0/dc/d3d/d73/dbf/fe7 [0,4194304] 0 2023-12-07T16:21:44.091 INFO:tasks.workunit.client.1.smithi152.stdout:4/780: symlink d0/d3/d6/d2b/dd9/db7/ddc/le7 0 2023-12-07T16:21:44.091 INFO:tasks.workunit.client.1.smithi152.stdout:4/781: chown d0/d3/d6/d2b/dd9/d22/la2 7453540 1 2023-12-07T16:21:44.092 INFO:tasks.workunit.client.0.smithi063.stdout:0/660: dwrite d4/dd/d26/d2b/db5/d5b/f5d [0,4194304] 0 2023-12-07T16:21:44.092 INFO:tasks.workunit.client.0.smithi063.stdout:1/478: rename d0/f4 to d0/dd/d10/d13/d2f/d79/fa7 0 2023-12-07T16:21:44.092 INFO:tasks.workunit.client.0.smithi063.stdout:9/558: dwrite d0/d21/d64/d6a/d85/da4/f58 [0,4194304] 0 2023-12-07T16:21:44.092 INFO:tasks.workunit.client.1.smithi152.stdout:1/976: creat dc/d14/d18/d2d/d48/da3/dbf/f140 x:0 0 0 2023-12-07T16:21:44.093 INFO:tasks.workunit.client.0.smithi063.stdout:6/662: dwrite d0/d17/f5d [0,4194304] 0 2023-12-07T16:21:44.093 INFO:tasks.workunit.client.0.smithi063.stdout:6/663: fdatasync d0/d1e/d1d/f3d 0 2023-12-07T16:21:44.094 INFO:tasks.workunit.client.1.smithi152.stdout:2/788: dwrite d2/d9/f25 [0,4194304] 0 2023-12-07T16:21:44.094 INFO:tasks.workunit.client.0.smithi063.stdout:6/664: dread d0/d79/d94/fb7 [0,4194304] 0 2023-12-07T16:21:44.094 INFO:tasks.workunit.client.0.smithi063.stdout:6/665: write d0/d17/d46/fc7 [356124,108185] 0 2023-12-07T16:21:44.097 INFO:tasks.workunit.client.0.smithi063.stdout:1/479: mknod d0/dd/d19/d50/d72/ca8 0 2023-12-07T16:21:44.098 INFO:tasks.workunit.client.1.smithi152.stdout:0/864: read d0/f1a [218222,63226] 0 2023-12-07T16:21:44.099 INFO:tasks.workunit.client.0.smithi063.stdout:9/559: symlink d0/d13/d39/d42/d57/lba 0 2023-12-07T16:21:44.099 INFO:tasks.workunit.client.0.smithi063.stdout:9/560: readlink d0/l1b 0 2023-12-07T16:21:44.099 INFO:tasks.workunit.client.0.smithi063.stdout:9/561: chown d0/d21 275 1 2023-12-07T16:21:44.100 INFO:tasks.workunit.client.0.smithi063.stdout:8/780: dwrite d7/d14/d15/db4/fe9 [0,4194304] 0 2023-12-07T16:21:44.100 INFO:tasks.workunit.client.0.smithi063.stdout:8/781: write d7/d14/d15/db4/f88 [4842449,71981] 0 2023-12-07T16:21:44.102 INFO:tasks.workunit.client.1.smithi152.stdout:4/782: mknod d0/d3/d6/d36/d85/ce8 0 2023-12-07T16:21:44.108 INFO:tasks.workunit.client.0.smithi063.stdout:6/666: mknod d0/d1e/d60/d68/d76/da4/cf0 0 2023-12-07T16:21:44.108 INFO:tasks.workunit.client.0.smithi063.stdout:6/667: dread - d0/d1e/d20/d4a/f7a zero size 2023-12-07T16:21:44.108 INFO:tasks.workunit.client.0.smithi063.stdout:6/668: truncate d0/d17/d46/fc7 873364 0 2023-12-07T16:21:44.110 INFO:tasks.workunit.client.1.smithi152.stdout:2/789: symlink d2/d1c/d2e/d30/d33/d86/dee/d107/l10b 0 2023-12-07T16:21:44.111 INFO:tasks.workunit.client.1.smithi152.stdout:2/790: write d2/d1c/d2e/d30/d33/fe9 [573214,28810] 0 2023-12-07T16:21:44.111 INFO:tasks.workunit.client.1.smithi152.stdout:4/783: dread d0/d3/d6/d2b/d75/fb2 [0,4194304] 0 2023-12-07T16:21:44.111 INFO:tasks.workunit.client.1.smithi152.stdout:4/784: dread - d0/d3/d6/d36/f82 zero size 2023-12-07T16:21:44.111 INFO:tasks.workunit.client.1.smithi152.stdout:0/865: mknod d0/d27/d8c/df7/d30/d6e/d77/d113/c12d 0 2023-12-07T16:21:44.112 INFO:tasks.workunit.client.0.smithi063.stdout:9/562: unlink d0/d21/c46 0 2023-12-07T16:21:44.114 INFO:tasks.workunit.client.1.smithi152.stdout:2/791: symlink d2/d9/d51/l10c 0 2023-12-07T16:21:44.114 INFO:tasks.workunit.client.0.smithi063.stdout:9/563: mkdir d0/d21/d64/d6a/d8f/d92/dbb 0 2023-12-07T16:21:44.117 INFO:tasks.workunit.client.0.smithi063.stdout:8/782: read d7/d38/d8e/fa9 [2391539,82865] 0 2023-12-07T16:21:44.117 INFO:tasks.workunit.client.0.smithi063.stdout:8/783: write d7/d14/d15/d48/f58 [1153481,21856] 0 2023-12-07T16:21:44.117 INFO:tasks.workunit.client.0.smithi063.stdout:8/784: readlink d7/d38/l96 0 2023-12-07T16:21:44.121 INFO:tasks.workunit.client.0.smithi063.stdout:8/785: mkdir d7/d14/d15/dde/da8/df8 0 2023-12-07T16:21:44.125 INFO:tasks.workunit.client.0.smithi063.stdout:8/786: link d7/c1f d7/d14/d15/dde/cf9 0 2023-12-07T16:21:44.128 INFO:tasks.workunit.client.1.smithi152.stdout:2/792: truncate d2/ff 2788729 0 2023-12-07T16:21:44.129 INFO:tasks.workunit.client.1.smithi152.stdout:9/907: truncate d1/d9/d4f/dd3/f124 6445555 0 2023-12-07T16:21:44.129 INFO:tasks.workunit.client.1.smithi152.stdout:0/866: dread d0/dc/f3c [0,4194304] 0 2023-12-07T16:21:44.130 INFO:tasks.workunit.client.1.smithi152.stdout:0/867: truncate d0/d27/d8c/df7/d30/d6e/d77/d9f/fba 651271 0 2023-12-07T16:21:44.130 INFO:tasks.workunit.client.1.smithi152.stdout:9/908: getdents d1/d9/d4f/dd3 0 2023-12-07T16:21:44.132 INFO:tasks.workunit.client.1.smithi152.stdout:0/868: link d0/d27/d8c/f8d d0/dc/d3d/d73/f12e 0 2023-12-07T16:21:44.133 INFO:tasks.workunit.client.1.smithi152.stdout:2/793: dread d2/d1c/d2e/d57/d5b/da7/d9a/da6/dbb/fd0 [0,4194304] 0 2023-12-07T16:21:44.134 INFO:tasks.workunit.client.1.smithi152.stdout:2/794: creat d2/d1c/d2e/d30/f10d x:0 0 0 2023-12-07T16:21:44.142 INFO:tasks.workunit.client.1.smithi152.stdout:6/806: dwrite d2/d4f/d83/d58/f93 [0,4194304] 0 2023-12-07T16:21:44.145 INFO:tasks.workunit.client.1.smithi152.stdout:3/860: sync 2023-12-07T16:21:44.146 INFO:tasks.workunit.client.1.smithi152.stdout:9/909: dread d1/d9/d2d/d65/f73 [0,4194304] 0 2023-12-07T16:21:44.146 INFO:tasks.workunit.client.1.smithi152.stdout:6/807: unlink d2/d4f/d83/d48/d70/d81/fdf 0 2023-12-07T16:21:44.149 INFO:tasks.workunit.client.1.smithi152.stdout:3/861: unlink d7/d10/d1a/d2f/d56/d57/dee/dda/d7d/fa5 0 2023-12-07T16:21:44.150 INFO:tasks.workunit.client.1.smithi152.stdout:0/869: dread d0/d27/f9b [0,4194304] 0 2023-12-07T16:21:44.150 INFO:tasks.workunit.client.1.smithi152.stdout:9/910: mknod d1/d17/d3c/c126 0 2023-12-07T16:21:44.150 INFO:tasks.workunit.client.0.smithi063.stdout:2/715: sync 2023-12-07T16:21:44.151 INFO:tasks.workunit.client.0.smithi063.stdout:5/597: sync 2023-12-07T16:21:44.151 INFO:tasks.workunit.client.0.smithi063.stdout:7/597: sync 2023-12-07T16:21:44.151 INFO:tasks.workunit.client.0.smithi063.stdout:4/491: sync 2023-12-07T16:21:44.151 INFO:tasks.workunit.client.0.smithi063.stdout:4/492: stat d1/d3/d3f 0 2023-12-07T16:21:44.151 INFO:tasks.workunit.client.1.smithi152.stdout:1/977: dwrite dc/d14/d18/f35 [0,4194304] 0 2023-12-07T16:21:44.152 INFO:tasks.workunit.client.1.smithi152.stdout:1/978: stat dc/d14/d18/f2c 0 2023-12-07T16:21:44.152 INFO:tasks.workunit.client.0.smithi063.stdout:9/564: dwrite d0/f31 [0,4194304] 0 2023-12-07T16:21:44.152 INFO:tasks.workunit.client.0.smithi063.stdout:9/565: fdatasync d0/d21/d64/d6a/d85/da4/f70 0 2023-12-07T16:21:44.152 INFO:tasks.workunit.client.0.smithi063.stdout:0/661: dwrite d4/dd/d26/f70 [0,4194304] 0 2023-12-07T16:21:44.152 INFO:tasks.workunit.client.0.smithi063.stdout:8/787: fdatasync d7/d14/d15/db4/f88 0 2023-12-07T16:21:44.152 INFO:tasks.workunit.client.0.smithi063.stdout:8/788: fsync f5 0 2023-12-07T16:21:44.152 INFO:tasks.workunit.client.0.smithi063.stdout:1/480: dwrite d0/dd/f16 [0,4194304] 0 2023-12-07T16:21:44.153 INFO:tasks.workunit.client.1.smithi152.stdout:4/785: dwrite d0/d3/d6/d2b/fd3 [0,4194304] 0 2023-12-07T16:21:44.154 INFO:tasks.workunit.client.1.smithi152.stdout:9/911: chown d1/d9/c14 163438915 1 2023-12-07T16:21:44.154 INFO:tasks.workunit.client.1.smithi152.stdout:9/912: fdatasync d1/d17/d3c/d4a/d48/d8c/fc3 0 2023-12-07T16:21:44.154 INFO:tasks.workunit.client.1.smithi152.stdout:9/913: chown d1/f3a 839161474 1 2023-12-07T16:21:44.154 INFO:tasks.workunit.client.1.smithi152.stdout:2/795: dread d2/d56/da0/fad [0,4194304] 0 2023-12-07T16:21:44.154 INFO:tasks.workunit.client.1.smithi152.stdout:3/862: rmdir d7/d10/d1a 39 2023-12-07T16:21:44.154 INFO:tasks.workunit.client.1.smithi152.stdout:6/808: creat d2/d4f/d83/da0/da2/f104 x:0 0 0 2023-12-07T16:21:44.154 INFO:tasks.workunit.client.1.smithi152.stdout:6/809: dread - d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/d55/fdd zero size 2023-12-07T16:21:44.155 INFO:tasks.workunit.client.0.smithi063.stdout:5/598: rmdir d1/d3/de/d1e/d6b 39 2023-12-07T16:21:44.155 INFO:tasks.workunit.client.0.smithi063.stdout:5/599: stat d1/d3/de/f16 0 2023-12-07T16:21:44.156 INFO:tasks.workunit.client.0.smithi063.stdout:7/598: creat d2/d34/d5a/d5f/d53/dab/fdc x:0 0 0 2023-12-07T16:21:44.156 INFO:tasks.workunit.client.0.smithi063.stdout:7/599: truncate d2/d64/fb7 4369947 0 2023-12-07T16:21:44.156 INFO:tasks.workunit.client.1.smithi152.stdout:0/870: rename d0/d27/de6/f10b to d0/dc/d36/d3a/d69/f12f 0 2023-12-07T16:21:44.157 INFO:tasks.workunit.client.0.smithi063.stdout:4/493: mknod d1/d3/db/c90 0 2023-12-07T16:21:44.158 INFO:tasks.workunit.client.0.smithi063.stdout:9/566: mkdir d0/d13/d6f/daf/dbc 0 2023-12-07T16:21:44.159 INFO:tasks.workunit.client.1.smithi152.stdout:1/979: dread dc/d28/f43 [4194304,4194304] 0 2023-12-07T16:21:44.161 INFO:tasks.workunit.client.0.smithi063.stdout:8/789: symlink d7/d14/d15/d2b/lfa 0 2023-12-07T16:21:44.162 INFO:tasks.workunit.client.0.smithi063.stdout:1/481: getdents d0/dd/d19/d50/d72 0 2023-12-07T16:21:44.162 INFO:tasks.workunit.client.1.smithi152.stdout:3/863: write d7/dc/d14/f16 [1625872,69465] 0 2023-12-07T16:21:44.162 INFO:tasks.workunit.client.1.smithi152.stdout:3/864: fdatasync d7/d10/d41/fdc 0 2023-12-07T16:21:44.162 INFO:tasks.workunit.client.1.smithi152.stdout:4/786: creat d0/d3/d6/d2b/dd9/d3a/d46/d9b/fe9 x:0 0 0 2023-12-07T16:21:44.162 INFO:tasks.workunit.client.1.smithi152.stdout:4/787: chown d0/d3/d6/d2b/dd9/d3a/d46 98885724 1 2023-12-07T16:21:44.163 INFO:tasks.workunit.client.0.smithi063.stdout:0/662: write d4/d25/f8d [3123938,3036] 0 2023-12-07T16:21:44.163 INFO:tasks.workunit.client.0.smithi063.stdout:0/663: readlink d4/dd/de/la2 0 2023-12-07T16:21:44.163 INFO:tasks.workunit.client.1.smithi152.stdout:9/914: rmdir d1/d17/d3c/d4a/dc6 39 2023-12-07T16:21:44.165 INFO:tasks.workunit.client.1.smithi152.stdout:2/796: mknod d2/d1c/d2e/d30/c10e 0 2023-12-07T16:21:44.165 INFO:tasks.workunit.client.1.smithi152.stdout:2/797: fsync d2/d1c/d2e/d5d/f7c 0 2023-12-07T16:21:44.165 INFO:tasks.workunit.client.1.smithi152.stdout:5/983: write dd/de/d14/d19/f95 [1772031,27230] 0 2023-12-07T16:21:44.166 INFO:tasks.workunit.client.1.smithi152.stdout:6/810: mkdir d2/d105 0 2023-12-07T16:21:44.170 INFO:tasks.workunit.client.1.smithi152.stdout:8/816: sync 2023-12-07T16:21:44.170 INFO:tasks.workunit.client.1.smithi152.stdout:7/781: sync 2023-12-07T16:21:44.170 INFO:tasks.workunit.client.1.smithi152.stdout:1/980: symlink dc/d14/d18/d2d/d48/da3/d58/dde/l141 0 2023-12-07T16:21:44.170 INFO:tasks.workunit.client.1.smithi152.stdout:5/984: write dd/de/d8f/dc9/fd7 [1439114,121659] 0 2023-12-07T16:21:44.171 INFO:tasks.workunit.client.1.smithi152.stdout:7/782: unlink db/d27/d39/d41/d58/l85 0 2023-12-07T16:21:44.171 INFO:tasks.workunit.client.1.smithi152.stdout:2/798: read d2/f8 [1192970,113642] 0 2023-12-07T16:21:44.171 INFO:tasks.workunit.client.1.smithi152.stdout:2/799: chown d2/d1c/d2e/d30/d33/lae 114 1 2023-12-07T16:21:44.171 INFO:tasks.workunit.client.1.smithi152.stdout:1/981: read dc/d14/d18/d2d/d4a/d52/f9d [389756,67800] 0 2023-12-07T16:21:44.172 INFO:tasks.workunit.client.1.smithi152.stdout:8/817: write d3/d1e/d55/d83/f107 [1463534,93947] 0 2023-12-07T16:21:44.172 INFO:tasks.workunit.client.1.smithi152.stdout:8/818: chown d3/d1e/d55/f64 0 1 2023-12-07T16:21:44.173 INFO:tasks.workunit.client.1.smithi152.stdout:2/800: dread d2/f5a [0,4194304] 0 2023-12-07T16:21:44.173 INFO:tasks.workunit.client.1.smithi152.stdout:2/801: fsync d2/f5a 0 2023-12-07T16:21:44.184 INFO:tasks.workunit.client.1.smithi152.stdout:9/915: dwrite d1/d9/db/d70/fe4 [0,4194304] 0 2023-12-07T16:21:44.185 INFO:tasks.workunit.client.1.smithi152.stdout:5/985: rmdir dd/de/d14/d67/d138 39 2023-12-07T16:21:44.194 INFO:tasks.workunit.client.0.smithi063.stdout:2/716: rename d0/d21/d56/fde to d0/d21/d56/d11/d52/da9/daf/fe9 0 2023-12-07T16:21:44.195 INFO:tasks.workunit.client.0.smithi063.stdout:5/600: mknod d1/d3/cab 0 2023-12-07T16:21:44.195 INFO:tasks.workunit.client.0.smithi063.stdout:5/601: fdatasync d1/d31/d56/d61/f43 0 2023-12-07T16:21:44.202 INFO:tasks.workunit.client.0.smithi063.stdout:4/494: creat d1/d3/db/d2c/f91 x:0 0 0 2023-12-07T16:21:44.202 INFO:tasks.workunit.client.0.smithi063.stdout:9/567: rmdir d0/d13/d39/d42 39 2023-12-07T16:21:44.203 INFO:tasks.workunit.client.0.smithi063.stdout:9/568: dread - d0/f86 zero size 2023-12-07T16:21:44.204 INFO:tasks.workunit.client.0.smithi063.stdout:5/602: write d1/d31/d56/d61/d5e/d6a/f8a [3201602,95437] 0 2023-12-07T16:21:44.211 INFO:tasks.workunit.client.0.smithi063.stdout:2/717: creat d0/d21/d56/d11/d6d/fea x:0 0 0 2023-12-07T16:21:44.212 INFO:tasks.workunit.client.0.smithi063.stdout:0/664: dread d4/dd/d26/d2b/d5e/d8e/d95/fb4 [0,4194304] 0 2023-12-07T16:21:44.212 INFO:tasks.workunit.client.0.smithi063.stdout:8/790: creat d7/d14/d15/dde/da8/d9f/ffb x:0 0 0 2023-12-07T16:21:44.212 INFO:tasks.workunit.client.0.smithi063.stdout:8/791: write d7/d38/d73/fd4 [778249,29544] 0 2023-12-07T16:21:44.213 INFO:tasks.workunit.client.0.smithi063.stdout:4/495: rename d1/d3/d3f/l87 to d1/d3/d3f/d49/d64/l92 0 2023-12-07T16:21:44.213 INFO:tasks.workunit.client.0.smithi063.stdout:4/496: fsync d1/d3/db/d2c/d63/f33 0 2023-12-07T16:21:44.214 INFO:tasks.workunit.client.0.smithi063.stdout:9/569: creat d0/d13/d6f/daf/fbd x:0 0 0 2023-12-07T16:21:44.215 INFO:tasks.workunit.client.0.smithi063.stdout:0/665: mknod d4/dd/d26/d2b/db5/d5b/ce0 0 2023-12-07T16:21:44.215 INFO:tasks.workunit.client.0.smithi063.stdout:0/666: write d4/dd/d26/d2b/db5/d5b/d63/f80 [1068836,75754] 0 2023-12-07T16:21:44.215 INFO:tasks.workunit.client.0.smithi063.stdout:0/667: readlink d4/dd/de/d15/l39 0 2023-12-07T16:21:44.218 INFO:tasks.workunit.client.0.smithi063.stdout:9/570: mknod d0/d21/cbe 0 2023-12-07T16:21:44.222 INFO:tasks.workunit.client.0.smithi063.stdout:9/571: creat d0/d13/d39/d3a/fbf x:0 0 0 2023-12-07T16:21:44.223 INFO:tasks.workunit.client.0.smithi063.stdout:9/572: dread - d0/d21/f43 zero size 2023-12-07T16:21:44.224 INFO:tasks.workunit.client.1.smithi152.stdout:4/788: dread d0/d3/d6/d2b/d56/f70 [0,4194304] 0 2023-12-07T16:21:44.224 INFO:tasks.workunit.client.1.smithi152.stdout:4/789: truncate d0/d3/f2d 2592486 0 2023-12-07T16:21:44.226 INFO:tasks.workunit.client.0.smithi063.stdout:9/573: rename d0/d13/d39/d3a/f6c to d0/d21/d64/d6a/fc0 0 2023-12-07T16:21:44.227 INFO:tasks.workunit.client.1.smithi152.stdout:7/783: rmdir db/d27/d5e 39 2023-12-07T16:21:44.227 INFO:tasks.workunit.client.0.smithi063.stdout:9/574: creat d0/d21/fc1 x:0 0 0 2023-12-07T16:21:44.233 INFO:tasks.workunit.client.1.smithi152.stdout:8/819: creat d3/d4/d9/d34/dca/f12a x:0 0 0 2023-12-07T16:21:44.234 INFO:tasks.workunit.client.1.smithi152.stdout:2/802: mknod d2/d1c/d2e/d5d/daf/c10f 0 2023-12-07T16:21:44.234 INFO:tasks.workunit.client.1.smithi152.stdout:2/803: dread - d2/d1c/d2e/d57/d5b/da7/d9a/da6/fec zero size 2023-12-07T16:21:44.237 INFO:tasks.workunit.client.0.smithi063.stdout:8/792: dread d7/d14/d15/f46 [0,4194304] 0 2023-12-07T16:21:44.238 INFO:tasks.workunit.client.1.smithi152.stdout:9/916: link d1/dd/dd6/de2/fad d1/d17/f127 0 2023-12-07T16:21:44.240 INFO:tasks.workunit.client.1.smithi152.stdout:7/784: creat db/d27/d39/d41/d58/da5/dde/df2/ffc x:0 0 0 2023-12-07T16:21:44.240 INFO:tasks.workunit.client.1.smithi152.stdout:7/785: write db/d1c/f28 [4411308,39712] 0 2023-12-07T16:21:44.242 INFO:tasks.workunit.client.0.smithi063.stdout:8/793: write d7/d14/d15/d2b/fae [609795,96290] 0 2023-12-07T16:21:44.242 INFO:tasks.workunit.client.1.smithi152.stdout:3/865: dwrite d7/d10/d1a/d25/fd2 [0,4194304] 0 2023-12-07T16:21:44.242 INFO:tasks.workunit.client.0.smithi063.stdout:9/575: dread d0/d13/f5d [0,4194304] 0 2023-12-07T16:21:44.243 INFO:tasks.workunit.client.1.smithi152.stdout:6/811: dwrite d2/d4f/d83/d48/f8d [0,4194304] 0 2023-12-07T16:21:44.243 INFO:tasks.workunit.client.0.smithi063.stdout:9/576: write d0/f47 [32944,64790] 0 2023-12-07T16:21:44.243 INFO:tasks.workunit.client.0.smithi063.stdout:1/482: dwrite d0/dd/d19/d50/d71/f86 [0,4194304] 0 2023-12-07T16:21:44.243 INFO:tasks.workunit.client.0.smithi063.stdout:9/577: write d0/d13/d39/d42/d57/fb9 [677877,16225] 0 2023-12-07T16:21:44.244 INFO:tasks.workunit.client.0.smithi063.stdout:1/483: chown d0/dd/d1f/l35 63 1 2023-12-07T16:21:44.244 INFO:tasks.workunit.client.0.smithi063.stdout:9/578: write d0/d21/fc1 [421457,42731] 0 2023-12-07T16:21:44.244 INFO:tasks.workunit.client.1.smithi152.stdout:8/820: rename d3/d4/d9/f33 to d3/d1e/d55/d83/dae/de1/f12b 0 2023-12-07T16:21:44.244 INFO:tasks.workunit.client.1.smithi152.stdout:8/821: chown d3/d4 462742620 1 2023-12-07T16:21:44.245 INFO:tasks.workunit.client.0.smithi063.stdout:8/794: unlink d7/fbe 0 2023-12-07T16:21:44.245 INFO:tasks.workunit.client.0.smithi063.stdout:7/600: dwrite d2/d2c/f3d [4194304,4194304] 0 2023-12-07T16:21:44.247 INFO:tasks.workunit.client.1.smithi152.stdout:2/804: getdents d2/d1c/d52 0 2023-12-07T16:21:44.247 INFO:tasks.workunit.client.0.smithi063.stdout:1/484: rename d0/dd/f42 to d0/dd/d10/fa9 0 2023-12-07T16:21:44.247 INFO:tasks.workunit.client.0.smithi063.stdout:1/485: write d0/dd/d19/fa1 [288416,33498] 0 2023-12-07T16:21:44.247 INFO:tasks.workunit.client.0.smithi063.stdout:1/486: readlink d0/dd/d19/d50/l5f 0 2023-12-07T16:21:44.248 INFO:tasks.workunit.client.0.smithi063.stdout:1/487: chown d0/dd/d1f/c23 208187 1 2023-12-07T16:21:44.248 INFO:tasks.workunit.client.0.smithi063.stdout:1/488: getdents d0/dd/d55 0 2023-12-07T16:21:44.248 INFO:tasks.workunit.client.0.smithi063.stdout:9/579: creat d0/d13/d6f/daf/dbc/fc2 x:0 0 0 2023-12-07T16:21:44.248 INFO:tasks.workunit.client.0.smithi063.stdout:9/580: write d0/d13/d39/d3a/f81 [756056,41978] 0 2023-12-07T16:21:44.248 INFO:tasks.workunit.client.1.smithi152.stdout:5/986: dwrite dd/de/d14/d19/d7a/ff3 [0,4194304] 0 2023-12-07T16:21:44.248 INFO:tasks.workunit.client.1.smithi152.stdout:5/987: stat dd/d7b/dbf/cf1 0 2023-12-07T16:21:44.248 INFO:tasks.workunit.client.1.smithi152.stdout:5/988: chown dd/l13d 72 1 2023-12-07T16:21:44.249 INFO:tasks.workunit.client.1.smithi152.stdout:9/917: mknod d1/d9/db/df/da6/da2/d118/d122/c128 0 2023-12-07T16:21:44.251 INFO:tasks.workunit.client.0.smithi063.stdout:7/601: creat d2/d34/d5a/d5f/d2a/d7e/fdd x:0 0 0 2023-12-07T16:21:44.256 INFO:tasks.workunit.client.1.smithi152.stdout:3/866: creat d7/d10/d1a/d25/d78/dd4/f111 x:0 0 0 2023-12-07T16:21:44.258 INFO:tasks.workunit.client.0.smithi063.stdout:8/795: rename d7/c1f to d7/d38/d8e/cfc 0 2023-12-07T16:21:44.259 INFO:tasks.workunit.client.0.smithi063.stdout:7/602: rmdir d2/d34/d5a/d5f/d53/da3 39 2023-12-07T16:21:44.260 INFO:tasks.workunit.client.0.smithi063.stdout:7/603: write d2/d21/f2d [4263005,4361] 0 2023-12-07T16:21:44.260 INFO:tasks.workunit.client.0.smithi063.stdout:7/604: read - d2/d34/d46/d48/f62 zero size 2023-12-07T16:21:44.260 INFO:tasks.workunit.client.0.smithi063.stdout:8/796: symlink d7/d14/d15/d57/lfd 0 2023-12-07T16:21:44.262 INFO:tasks.workunit.client.0.smithi063.stdout:8/797: write d7/d14/d1a/dce/fbc [2588960,121683] 0 2023-12-07T16:21:44.262 INFO:tasks.workunit.client.0.smithi063.stdout:8/798: fsync d7/d14/d15/dac/dad/ff0 0 2023-12-07T16:21:44.262 INFO:tasks.workunit.client.0.smithi063.stdout:8/799: write d7/d14/d15/dde/d63/d75/d98/de8/ff6 [709519,86114] 0 2023-12-07T16:21:44.262 INFO:tasks.workunit.client.0.smithi063.stdout:7/605: rename d2/d34/d5a/d5f/d53/dab/fdc to d2/d21/dc6/fde 0 2023-12-07T16:21:44.262 INFO:tasks.workunit.client.0.smithi063.stdout:7/606: stat d2/d34/d46/d48/d70/l7b 0 2023-12-07T16:21:44.264 INFO:tasks.workunit.client.0.smithi063.stdout:8/800: unlink d7/d14/d15/d57/fb8 0 2023-12-07T16:21:44.265 INFO:tasks.workunit.client.1.smithi152.stdout:7/786: dwrite db/d27/d39/f9f [0,4194304] 0 2023-12-07T16:21:44.265 INFO:tasks.workunit.client.1.smithi152.stdout:2/805: creat d2/d1c/d2e/d30/f110 x:0 0 0 2023-12-07T16:21:44.265 INFO:tasks.workunit.client.1.smithi152.stdout:2/806: write d2/d1c/d52/f99 [635997,41150] 0 2023-12-07T16:21:44.268 INFO:tasks.workunit.client.0.smithi063.stdout:8/801: rename d7/d14/d15/dde/d63/d75/f86 to d7/d14/d15/dde/da8/ffe 0 2023-12-07T16:21:44.268 INFO:tasks.workunit.client.0.smithi063.stdout:7/607: write d2/d37/f6c [2168591,4898] 0 2023-12-07T16:21:44.271 INFO:tasks.workunit.client.1.smithi152.stdout:9/918: link d1/d9/d2d/fb0 d1/d9/db/df/f129 0 2023-12-07T16:21:44.271 INFO:tasks.workunit.client.1.smithi152.stdout:5/989: rename dd/de/d14/d67/d138 to dd/d91/dbe/d10e/d113/d13a/d154 0 2023-12-07T16:21:44.272 INFO:tasks.workunit.client.0.smithi063.stdout:0/668: rmdir d4/dd 39 2023-12-07T16:21:44.272 INFO:tasks.workunit.client.0.smithi063.stdout:0/669: write d4/dd/de/d15/d1f/f4a [7080641,106498] 0 2023-12-07T16:21:44.275 INFO:tasks.workunit.client.0.smithi063.stdout:7/608: creat d2/d34/d46/d48/d70/daf/dd6/fdf x:0 0 0 2023-12-07T16:21:44.275 INFO:tasks.workunit.client.0.smithi063.stdout:7/609: chown d2/d2c/f75 13941642 1 2023-12-07T16:21:44.276 INFO:tasks.workunit.client.1.smithi152.stdout:3/867: link f2 d7/d10/d1a/d2f/d56/d57/dee/dda/f112 0 2023-12-07T16:21:44.277 INFO:tasks.workunit.client.1.smithi152.stdout:3/868: chown d7/dc/fa9 446 1 2023-12-07T16:21:44.277 INFO:tasks.workunit.client.0.smithi063.stdout:0/670: rename d4/dd/d26/d2b/db5/d5b/ce0 to d4/dd/d26/d2b/db5/d5b/d63/d6b/da8/ce1 0 2023-12-07T16:21:44.279 INFO:tasks.workunit.client.0.smithi063.stdout:0/671: read d4/d25/f71 [39187,109057] 0 2023-12-07T16:21:44.279 INFO:tasks.workunit.client.0.smithi063.stdout:0/672: chown d4/dd/d26/d2b/db5/d5b/d63/d74/d84/ddb/dde 1979616 1 2023-12-07T16:21:44.279 INFO:tasks.workunit.client.0.smithi063.stdout:0/673: fdatasync d4/f8a 0 2023-12-07T16:21:44.282 INFO:tasks.workunit.client.0.smithi063.stdout:7/610: creat d2/d34/d46/d48/d70/daf/fe0 x:0 0 0 2023-12-07T16:21:44.282 INFO:tasks.workunit.client.0.smithi063.stdout:7/611: chown d2/d34/d5a/d5f/d6d/lc5 206027687 1 2023-12-07T16:21:44.283 INFO:tasks.workunit.client.1.smithi152.stdout:2/807: truncate d2/d9/f2f 701141 0 2023-12-07T16:21:44.283 INFO:tasks.workunit.client.1.smithi152.stdout:2/808: stat d2/d1c/d2e/d57/db1/d90 0 2023-12-07T16:21:44.285 INFO:tasks.workunit.client.0.smithi063.stdout:7/612: mknod d2/ce1 0 2023-12-07T16:21:44.292 INFO:tasks.workunit.client.1.smithi152.stdout:9/919: rename d1/d9/db/df/d42 to d1/d17/d3c/d4a/dc6/d12a 0 2023-12-07T16:21:44.293 INFO:tasks.workunit.client.0.smithi063.stdout:0/674: read d4/dd/f14 [50247,70034] 0 2023-12-07T16:21:44.293 INFO:tasks.workunit.client.0.smithi063.stdout:0/675: write d4/dd/d26/d2b/d5e/d8e/d95/f93 [422276,121202] 0 2023-12-07T16:21:44.293 INFO:tasks.workunit.client.0.smithi063.stdout:0/676: write d4/dd/de/d15/d59/da5/fb2 [804523,110711] 0 2023-12-07T16:21:44.293 INFO:tasks.workunit.client.0.smithi063.stdout:0/677: write d4/dd/d26/d2b/d5e/d8e/f8b [4747223,47693] 0 2023-12-07T16:21:44.296 INFO:tasks.workunit.client.0.smithi063.stdout:0/678: truncate d4/dd/d26/d2b/db5/d5b/d63/f80 374200 0 2023-12-07T16:21:44.297 INFO:tasks.workunit.client.1.smithi152.stdout:2/809: read d2/d1c/d2e/d57/db1/f3b [318698,3431] 0 2023-12-07T16:21:44.297 INFO:tasks.workunit.client.0.smithi063.stdout:0/679: creat d4/dd/d26/d2b/db5/d5b/d63/d9b/fe2 x:0 0 0 2023-12-07T16:21:44.298 INFO:tasks.workunit.client.1.smithi152.stdout:9/920: rename d1/d17/fd5 to d1/d17/f12b 0 2023-12-07T16:21:44.299 INFO:tasks.workunit.client.0.smithi063.stdout:0/680: rmdir d4/dd/de/d15/d59/d43/d91 39 2023-12-07T16:21:44.300 INFO:tasks.workunit.client.0.smithi063.stdout:0/681: symlink d4/dd/de/d15/d59/d43/dd8/le3 0 2023-12-07T16:21:44.301 INFO:tasks.workunit.client.1.smithi152.stdout:9/921: rmdir d1/d17/d58/d86/dd9 39 2023-12-07T16:21:44.303 INFO:tasks.workunit.client.1.smithi152.stdout:9/922: link d1/d17/d3c/d4a/leb d1/dd/dd6/de2/d53/dff/l12c 0 2023-12-07T16:21:44.303 INFO:tasks.workunit.client.1.smithi152.stdout:9/923: readlink d1/d9/l10e 0 2023-12-07T16:21:44.309 INFO:tasks.workunit.client.1.smithi152.stdout:9/924: mknod d1/d9/db/df/da6/c12d 0 2023-12-07T16:21:44.309 INFO:tasks.workunit.client.0.smithi063.stdout:8/802: dwrite d7/d14/d15/dde/da8/ffe [4194304,4194304] 0 2023-12-07T16:21:44.312 INFO:tasks.workunit.client.0.smithi063.stdout:8/803: rename d7/d38/df1/f78 to d7/d14/d15/d2b/fff 0 2023-12-07T16:21:44.313 INFO:tasks.workunit.client.1.smithi152.stdout:8/822: rmdir d3/d1e/d55/d83/dde 39 2023-12-07T16:21:44.315 INFO:tasks.workunit.client.1.smithi152.stdout:8/823: mknod d3/d1e/d55/d83/dae/de1/c12c 0 2023-12-07T16:21:44.326 INFO:tasks.workunit.client.0.smithi063.stdout:0/682: dwrite d4/dd/de/d15/f18 [4194304,4194304] 0 2023-12-07T16:21:44.327 INFO:tasks.workunit.client.1.smithi152.stdout:1/982: creat dc/d14/d90/f142 x:0 0 0 2023-12-07T16:21:44.330 INFO:tasks.workunit.client.1.smithi152.stdout:1/983: creat dc/d14/d18/d45/f143 x:0 0 0 2023-12-07T16:21:44.332 INFO:tasks.workunit.client.1.smithi152.stdout:7/787: dwrite db/d27/f3b [0,4194304] 0 2023-12-07T16:21:44.342 INFO:tasks.workunit.client.1.smithi152.stdout:8/824: rename d3/d4/d9/dc/d6f/d7b/d7e/df5 to d3/d4/d9/dc/d6f/d7b/d7e/d12d 0 2023-12-07T16:21:44.344 INFO:tasks.workunit.client.1.smithi152.stdout:7/788: dread db/d27/d5e/f54 [0,4194304] 0 2023-12-07T16:21:44.345 INFO:tasks.workunit.client.1.smithi152.stdout:7/789: chown db/f95 19180 1 2023-12-07T16:21:44.345 INFO:tasks.workunit.client.1.smithi152.stdout:7/790: write db/d27/d39/d41/d58/da5/dde/de7/feb [416086,9823] 0 2023-12-07T16:21:44.345 INFO:tasks.workunit.client.1.smithi152.stdout:8/825: link d3/d1e/f44 d3/d4/d9/dad/db3/f12e 0 2023-12-07T16:21:44.346 INFO:tasks.workunit.client.1.smithi152.stdout:7/791: rmdir db/d27/d39/d41/d58/da5/dde 39 2023-12-07T16:21:44.382 INFO:tasks.workunit.client.0.smithi063.stdout:0/683: dwrite d4/dd/d26/f70 [0,4194304] 0 2023-12-07T16:21:44.383 INFO:tasks.workunit.client.1.smithi152.stdout:6/812: dwrite d2/d4f/d83/d85/d19/f22 [0,4194304] 0 2023-12-07T16:21:44.384 INFO:tasks.workunit.client.0.smithi063.stdout:0/684: symlink d4/dd/d26/d2b/db5/d5b/le4 0 2023-12-07T16:21:44.384 INFO:tasks.workunit.client.0.smithi063.stdout:0/685: fdatasync d4/dd/d26/d2b/db5/d5b/f5d 0 2023-12-07T16:21:44.396 INFO:tasks.workunit.client.0.smithi063.stdout:7/613: dwrite d2/d34/d5a/d5f/d6d/f72 [0,4194304] 0 2023-12-07T16:21:44.397 INFO:tasks.workunit.client.1.smithi152.stdout:3/869: dwrite d7/d10/d1a/d2f/d56/d57/dee/dda/ff4 [0,4194304] 0 2023-12-07T16:21:44.397 INFO:tasks.workunit.client.1.smithi152.stdout:2/810: dwrite d2/ffa [0,4194304] 0 2023-12-07T16:21:44.397 INFO:tasks.workunit.client.1.smithi152.stdout:2/811: chown d2/d1c/d2e/d57/c73 1 1 2023-12-07T16:21:44.397 INFO:tasks.workunit.client.1.smithi152.stdout:2/812: write d2/d1c/d52/f6b [538130,67830] 0 2023-12-07T16:21:44.400 INFO:tasks.workunit.client.0.smithi063.stdout:7/614: symlink d2/d34/d46/d48/d56/ddb/le2 0 2023-12-07T16:21:44.400 INFO:tasks.workunit.client.0.smithi063.stdout:7/615: chown d2/d34/dc2 242089 1 2023-12-07T16:21:44.400 INFO:tasks.workunit.client.0.smithi063.stdout:7/616: readlink d2/d64/l6b 0 2023-12-07T16:21:44.401 INFO:tasks.workunit.client.1.smithi152.stdout:3/870: creat d7/d10/d1a/d2f/d5c/df6/d6d/d98/f113 x:0 0 0 2023-12-07T16:21:44.404 INFO:tasks.workunit.client.0.smithi063.stdout:7/617: dread d2/d34/d5a/d5f/d2a/f4a [0,4194304] 0 2023-12-07T16:21:44.404 INFO:tasks.workunit.client.0.smithi063.stdout:7/618: dread - d2/d34/d46/d48/f4c zero size 2023-12-07T16:21:44.405 INFO:tasks.workunit.client.1.smithi152.stdout:3/871: creat d7/d10/d1a/d2f/d56/d57/dee/dda/d6b/f114 x:0 0 0 2023-12-07T16:21:44.405 INFO:tasks.workunit.client.1.smithi152.stdout:3/872: write d7/d10/d19/fe3 [938585,47099] 0 2023-12-07T16:21:44.406 INFO:tasks.workunit.client.1.smithi152.stdout:3/873: read d7/dc/fa9 [253253,93795] 0 2023-12-07T16:21:44.411 INFO:tasks.workunit.client.1.smithi152.stdout:3/874: mkdir d7/d10/d1a/d2f/d115 0 2023-12-07T16:21:44.411 INFO:tasks.workunit.client.1.smithi152.stdout:3/875: chown d7/d10/d41/d61/c7c 16103857 1 2023-12-07T16:21:44.411 INFO:tasks.workunit.client.1.smithi152.stdout:3/876: stat d7/d10/d19/fa0 0 2023-12-07T16:21:44.411 INFO:tasks.workunit.client.1.smithi152.stdout:1/984: creat dc/d14/d18/d79/f144 x:0 0 0 2023-12-07T16:21:44.411 INFO:tasks.workunit.client.1.smithi152.stdout:1/985: stat dc/d14/d68/ca8 0 2023-12-07T16:21:44.412 INFO:tasks.workunit.client.1.smithi152.stdout:3/877: mknod d7/d10/d1a/d2f/d5c/ddd/c116 0 2023-12-07T16:21:44.413 INFO:tasks.workunit.client.1.smithi152.stdout:1/986: symlink dc/d14/d18/d64/d8a/l145 0 2023-12-07T16:21:44.415 INFO:tasks.workunit.client.1.smithi152.stdout:3/878: truncate d7/d10/d1a/d25/f6a 3765663 0 2023-12-07T16:21:44.415 INFO:tasks.workunit.client.1.smithi152.stdout:5/990: rmdir dd/de/d8f/df2 39 2023-12-07T16:21:44.416 INFO:tasks.workunit.client.1.smithi152.stdout:1/987: creat dc/d14/d18/f146 x:0 0 0 2023-12-07T16:21:44.416 INFO:tasks.workunit.client.1.smithi152.stdout:3/879: write d7/d10/d1a/d25/d3f/dcf/fb3 [530763,58457] 0 2023-12-07T16:21:44.417 INFO:tasks.workunit.client.1.smithi152.stdout:5/991: truncate dd/d91/dbe/d10e/d113/d13a/d154/f52 1699076 0 2023-12-07T16:21:44.417 INFO:tasks.workunit.client.1.smithi152.stdout:2/813: dread d2/d1c/d52/f9d [0,4194304] 0 2023-12-07T16:21:44.417 INFO:tasks.workunit.client.1.smithi152.stdout:5/992: read - dd/de/d38/d3d/d6d/dae/f121 zero size 2023-12-07T16:21:44.417 INFO:tasks.workunit.client.1.smithi152.stdout:1/988: creat dc/d14/d18/de9/f147 x:0 0 0 2023-12-07T16:21:44.418 INFO:tasks.workunit.client.1.smithi152.stdout:5/993: write dd/de/d14/d19/d1a/def/f30 [2234046,47810] 0 2023-12-07T16:21:44.419 INFO:tasks.workunit.client.1.smithi152.stdout:3/880: link d7/d10/d1a/d25/d3f/f46 d7/d10/d1a/f117 0 2023-12-07T16:21:44.420 INFO:tasks.workunit.client.1.smithi152.stdout:2/814: creat d2/d1c/d2e/d57/f111 x:0 0 0 2023-12-07T16:21:44.420 INFO:tasks.workunit.client.1.smithi152.stdout:2/815: chown d2/d1c/d52/da8/fef 0 1 2023-12-07T16:21:44.420 INFO:tasks.workunit.client.1.smithi152.stdout:2/816: truncate d2/d1c/d52/da8/ff4 684597 0 2023-12-07T16:21:44.420 INFO:tasks.workunit.client.1.smithi152.stdout:3/881: write d7/d10/d1a/d25/d3f/dcf/fb3 [461827,42032] 0 2023-12-07T16:21:44.420 INFO:tasks.workunit.client.1.smithi152.stdout:3/882: chown d7/d10/d1a/d2f/d5c/ddd 171 1 2023-12-07T16:21:44.421 INFO:tasks.workunit.client.1.smithi152.stdout:3/883: dread - d7/d10/d1a/d2f/d56/d57/dee/dda/d6b/fac zero size 2023-12-07T16:21:44.421 INFO:tasks.workunit.client.1.smithi152.stdout:5/994: creat dd/de/d38/d3d/d6d/f155 x:0 0 0 2023-12-07T16:21:44.422 INFO:tasks.workunit.client.1.smithi152.stdout:2/817: mkdir d2/d9/d51/d54/d5c/d112 0 2023-12-07T16:21:44.422 INFO:tasks.workunit.client.1.smithi152.stdout:3/884: getdents d7/dc 0 2023-12-07T16:21:44.422 INFO:tasks.workunit.client.1.smithi152.stdout:3/885: readlink d7/d10/d1a/d2f/d56/d57/dee/dda/d7d/l8c 0 2023-12-07T16:21:44.423 INFO:tasks.workunit.client.1.smithi152.stdout:2/818: creat d2/d1c/d2e/d30/d33/f113 x:0 0 0 2023-12-07T16:21:44.424 INFO:tasks.workunit.client.1.smithi152.stdout:3/886: creat d7/d10/d1a/d2f/d115/f118 x:0 0 0 2023-12-07T16:21:44.425 INFO:tasks.workunit.client.1.smithi152.stdout:3/887: dread - d7/d10/d41/fdc zero size 2023-12-07T16:21:44.425 INFO:tasks.workunit.client.1.smithi152.stdout:2/819: unlink d2/d1c/d2e/d57/db1/d90/f2a 0 2023-12-07T16:21:44.427 INFO:tasks.workunit.client.1.smithi152.stdout:3/888: creat d7/d10/d1a/d25/d3f/dcf/f119 x:0 0 0 2023-12-07T16:21:44.434 INFO:tasks.workunit.client.1.smithi152.stdout:1/989: dread dc/d14/d18/d45/fdf [0,4194304] 0 2023-12-07T16:21:44.434 INFO:tasks.workunit.client.1.smithi152.stdout:1/990: write dc/d28/f43 [5669963,80161] 0 2023-12-07T16:21:44.468 INFO:tasks.workunit.client.0.smithi063.stdout:8/804: dwrite d7/d14/d15/d48/fa4 [0,4194304] 0 2023-12-07T16:21:44.469 INFO:tasks.workunit.client.0.smithi063.stdout:8/805: mkdir d7/d14/d1a/dce/d100 0 2023-12-07T16:21:44.470 INFO:tasks.workunit.client.0.smithi063.stdout:8/806: write d7/d14/f27 [683702,58700] 0 2023-12-07T16:21:44.470 INFO:tasks.workunit.client.0.smithi063.stdout:8/807: stat d7/d14/d15/d2b/fae 0 2023-12-07T16:21:44.471 INFO:tasks.workunit.client.0.smithi063.stdout:8/808: creat d7/d14/d15/dde/d63/d75/d98/f101 x:0 0 0 2023-12-07T16:21:44.472 INFO:tasks.workunit.client.0.smithi063.stdout:8/809: symlink d7/db6/ddb/l102 0 2023-12-07T16:21:44.473 INFO:tasks.workunit.client.0.smithi063.stdout:8/810: mkdir d7/d14/d1a/dce/d100/d103 0 2023-12-07T16:21:44.474 INFO:tasks.workunit.client.0.smithi063.stdout:8/811: creat d7/d14/d15/d48/f104 x:0 0 0 2023-12-07T16:21:44.474 INFO:tasks.workunit.client.0.smithi063.stdout:8/812: write d7/d38/df1/f85 [59706,102044] 0 2023-12-07T16:21:44.483 INFO:tasks.workunit.client.1.smithi152.stdout:3/889: dread d7/d10/d1a/d2f/d56/d57/dee/dda/f53 [0,4194304] 0 2023-12-07T16:21:44.484 INFO:tasks.workunit.client.1.smithi152.stdout:3/890: link d7/dc/c3c d7/d10/d1a/d2f/d115/c11a 0 2023-12-07T16:21:44.485 INFO:tasks.workunit.client.1.smithi152.stdout:3/891: getdents d7/d10/d1a/d2f/d56 0 2023-12-07T16:21:44.486 INFO:tasks.workunit.client.1.smithi152.stdout:3/892: link d7/dc/d14/f39 d7/d10/d1a/d2f/d115/f11b 0 2023-12-07T16:21:44.499 INFO:tasks.workunit.client.1.smithi152.stdout:6/813: dwrite d2/d4f/d83/d85/fc [4194304,4194304] 0 2023-12-07T16:21:44.499 INFO:tasks.workunit.client.1.smithi152.stdout:7/792: dwrite db/d27/d4d/f6d [0,4194304] 0 2023-12-07T16:21:44.499 INFO:tasks.workunit.client.1.smithi152.stdout:8/826: dwrite d3/d4/d9/dad/db3/df3/f126 [4194304,4194304] 0 2023-12-07T16:21:44.499 INFO:tasks.workunit.client.1.smithi152.stdout:6/814: fsync d2/d4f/d83/d85/f74 0 2023-12-07T16:21:44.499 INFO:tasks.workunit.client.1.smithi152.stdout:8/827: dread - d3/d1e/d55/d83/dae/fef zero size 2023-12-07T16:21:44.499 INFO:tasks.workunit.client.1.smithi152.stdout:7/793: write db/d27/d39/d41/f4f [8483556,71474] 0 2023-12-07T16:21:44.500 INFO:tasks.workunit.client.1.smithi152.stdout:8/828: creat d3/d4/d9/dc/d6f/f12f x:0 0 0 2023-12-07T16:21:44.501 INFO:tasks.workunit.client.1.smithi152.stdout:8/829: symlink d3/d1e/d55/l130 0 2023-12-07T16:21:44.508 INFO:tasks.workunit.client.1.smithi152.stdout:8/830: write d3/d1e/d55/d83/dae/de1/f12b [1473134,58157] 0 2023-12-07T16:21:44.508 INFO:tasks.workunit.client.1.smithi152.stdout:8/831: chown d3/d1e/d43/c56 56608649 1 2023-12-07T16:21:44.509 INFO:tasks.workunit.client.1.smithi152.stdout:8/832: truncate d3/d1e/d40/d74/f86 4175041 0 2023-12-07T16:21:44.512 INFO:tasks.workunit.client.1.smithi152.stdout:6/815: dread d2/d4f/d83/d85/d65/fda [0,4194304] 0 2023-12-07T16:21:44.513 INFO:tasks.workunit.client.1.smithi152.stdout:6/816: link d2/d4f/d83/d85/d19/l76 d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/l106 0 2023-12-07T16:21:44.527 INFO:tasks.workunit.client.0.smithi063.stdout:7/619: dwrite d2/d34/d46/d48/d70/daf/dd6/fdf [0,4194304] 0 2023-12-07T16:21:44.527 INFO:tasks.workunit.client.0.smithi063.stdout:7/620: chown d2/lc 33566936 1 2023-12-07T16:21:44.529 INFO:tasks.workunit.client.0.smithi063.stdout:7/621: creat d2/d34/fe3 x:0 0 0 2023-12-07T16:21:44.529 INFO:tasks.workunit.client.0.smithi063.stdout:7/622: fsync d2/d2c/fba 0 2023-12-07T16:21:44.529 INFO:tasks.workunit.client.0.smithi063.stdout:7/623: mkdir d2/d37/de4 0 2023-12-07T16:21:44.530 INFO:tasks.workunit.client.0.smithi063.stdout:7/624: mkdir d2/d34/d5a/d5f/d53/da3/de5 0 2023-12-07T16:21:44.531 INFO:tasks.workunit.client.0.smithi063.stdout:7/625: link d2/d64/cc7 d2/d34/d5a/d5f/d61/ce6 0 2023-12-07T16:21:44.532 INFO:tasks.workunit.client.0.smithi063.stdout:7/626: rename d2/l1c to d2/d34/d5a/d5f/d2a/dc9/le7 0 2023-12-07T16:21:44.532 INFO:tasks.workunit.client.0.smithi063.stdout:7/627: fsync d2/d37/da0/fc4 0 2023-12-07T16:21:44.533 INFO:tasks.workunit.client.0.smithi063.stdout:0/686: dwrite d4/dd/d26/d2b/d5e/d8e/fb8 [0,4194304] 0 2023-12-07T16:21:44.534 INFO:tasks.workunit.client.0.smithi063.stdout:0/687: write d4/dd/de/d15/d1f/d22/fb0 [3808186,38856] 0 2023-12-07T16:21:44.534 INFO:tasks.workunit.client.0.smithi063.stdout:7/628: getdents d2/d34/d46/d48/d56 0 2023-12-07T16:21:44.537 INFO:tasks.workunit.client.0.smithi063.stdout:7/629: mkdir d2/d34/d46/d48/d70/daf/de8 0 2023-12-07T16:21:44.538 INFO:tasks.workunit.client.0.smithi063.stdout:7/630: mknod d2/d34/d5a/d5f/d78/d9a/ce9 0 2023-12-07T16:21:44.538 INFO:tasks.workunit.client.0.smithi063.stdout:7/631: fsync d2/d21/f3f 0 2023-12-07T16:21:44.545 INFO:tasks.workunit.client.1.smithi152.stdout:2/820: dwrite d2/d1c/d52/f9d [4194304,4194304] 0 2023-12-07T16:21:44.545 INFO:tasks.workunit.client.1.smithi152.stdout:5/995: dwrite dd/de/d14/d19/d74/fdd [0,4194304] 0 2023-12-07T16:21:44.545 INFO:tasks.workunit.client.1.smithi152.stdout:5/996: write dd/de/d38/fe2 [105756,111574] 0 2023-12-07T16:21:44.547 INFO:tasks.workunit.client.1.smithi152.stdout:2/821: rename d2/dba to d2/d105/d114 0 2023-12-07T16:21:44.547 INFO:tasks.workunit.client.1.smithi152.stdout:2/822: readlink d2/d1c/d2e/d30/d42/d91/lcf 0 2023-12-07T16:21:44.548 INFO:tasks.workunit.client.1.smithi152.stdout:5/997: creat dd/d91/dbe/d10e/d113/d13a/d154/d123/d129/f156 x:0 0 0 2023-12-07T16:21:44.548 INFO:tasks.workunit.client.1.smithi152.stdout:5/998: fdatasync dd/de/d14/dc6/fb1 0 2023-12-07T16:21:44.549 INFO:tasks.workunit.client.1.smithi152.stdout:2/823: rename d2/d1c/d2e/d30/d42/l4c to d2/d1c/d2e/d5d/dab/l115 0 2023-12-07T16:21:44.549 INFO:tasks.workunit.client.1.smithi152.stdout:2/824: chown d2 1439566 1 2023-12-07T16:21:44.551 INFO:tasks.workunit.client.1.smithi152.stdout:5/999: rename dd/de/d14/d19/da3/d114/d13b to dd/de/d14/d19/d1a/dcc/d157 0 2023-12-07T16:21:44.552 INFO:tasks.workunit.client.1.smithi152.stdout:3/893: dwrite d7/dc/fc9 [0,4194304] 0 2023-12-07T16:21:44.552 INFO:tasks.workunit.client.1.smithi152.stdout:1/991: dwrite dc/d14/d18/d79/f123 [0,4194304] 0 2023-12-07T16:21:44.553 INFO:tasks.workunit.client.1.smithi152.stdout:2/825: symlink d2/d1c/d2e/d5d/dab/dd9/dda/l116 0 2023-12-07T16:21:44.553 INFO:tasks.workunit.client.1.smithi152.stdout:7/794: dwrite db/d27/d39/d41/d58/f59 [0,4194304] 0 2023-12-07T16:21:44.553 INFO:tasks.workunit.client.0.smithi063.stdout:0/688: dread d4/f17 [0,4194304] 0 2023-12-07T16:21:44.553 INFO:tasks.workunit.client.1.smithi152.stdout:6/817: dwrite d2/d4f/d83/da0/fce [0,4194304] 0 2023-12-07T16:21:44.554 INFO:tasks.workunit.client.0.smithi063.stdout:8/813: truncate d7/d14/d15/d48/fa4 429464 0 2023-12-07T16:21:44.554 INFO:tasks.workunit.client.0.smithi063.stdout:8/814: dread - d7/d14/d15/dde/d63/d75/d98/f101 zero size 2023-12-07T16:21:44.554 INFO:tasks.workunit.client.1.smithi152.stdout:8/833: dwrite d3/d4/d9/dc/d6f/d7a/fa8 [0,4194304] 0 2023-12-07T16:21:44.557 INFO:tasks.workunit.client.0.smithi063.stdout:0/689: mknod d4/dd/d26/d2b/db5/d5b/d63/ce5 0 2023-12-07T16:21:44.558 INFO:tasks.workunit.client.1.smithi152.stdout:3/894: mknod d7/d10/d1a/d2f/d56/d57/dee/dda/d6b/c11c 0 2023-12-07T16:21:44.561 INFO:tasks.workunit.client.1.smithi152.stdout:1/992: creat dc/d28/d7d/f148 x:0 0 0 2023-12-07T16:21:44.561 INFO:tasks.workunit.client.1.smithi152.stdout:1/993: truncate dc/d14/d18/d64/d8a/feb 1812739 0 2023-12-07T16:21:44.562 INFO:tasks.workunit.client.0.smithi063.stdout:8/815: rename d7/d38/d8e/fa9 to d7/d14/d15/d48/f105 0 2023-12-07T16:21:44.564 INFO:tasks.workunit.client.0.smithi063.stdout:0/690: symlink d4/dd/de/d15/d1f/le6 0 2023-12-07T16:21:44.564 INFO:tasks.workunit.client.0.smithi063.stdout:0/691: truncate d4/dd/de/f24 4742803 0 2023-12-07T16:21:44.565 INFO:tasks.workunit.client.0.smithi063.stdout:0/692: write d4/dd/d26/d2b/d5e/d8e/d95/fb4 [3674669,117519] 0 2023-12-07T16:21:44.566 INFO:tasks.workunit.client.0.smithi063.stdout:8/816: creat d7/d14/d15/db4/f106 x:0 0 0 2023-12-07T16:21:44.568 INFO:tasks.workunit.client.0.smithi063.stdout:0/693: symlink d4/dd/de/d15/d59/le7 0 2023-12-07T16:21:44.568 INFO:tasks.workunit.client.0.smithi063.stdout:0/694: chown d4/dd/d26/d2b/d5e/d8e/d95/f93 210 1 2023-12-07T16:21:44.569 INFO:tasks.workunit.client.0.smithi063.stdout:0/695: dread - d4/dd/d26/d2b/db5/d5b/d63/d9b/fe2 zero size 2023-12-07T16:21:44.570 INFO:tasks.workunit.client.0.smithi063.stdout:8/817: mkdir d7/d14/d15/dde/da8/d107 0 2023-12-07T16:21:44.576 INFO:tasks.workunit.client.0.smithi063.stdout:8/818: dread d7/d14/d15/dde/d63/d75/d98/de8/ff6 [0,4194304] 0 2023-12-07T16:21:44.577 INFO:tasks.workunit.client.0.smithi063.stdout:8/819: creat d7/d14/d15/d2b/f108 x:0 0 0 2023-12-07T16:21:44.579 INFO:tasks.workunit.client.1.smithi152.stdout:8/834: creat d3/d4/d9/d34/f131 x:0 0 0 2023-12-07T16:21:44.580 INFO:tasks.workunit.client.1.smithi152.stdout:8/835: write d3/d4/d9/dc/d6f/d7b/d7e/d12d/d67/dd4/fd7 [42918,38190] 0 2023-12-07T16:21:44.610 INFO:tasks.workunit.client.0.smithi063.stdout:1/489: sync 2023-12-07T16:21:44.611 INFO:tasks.workunit.client.0.smithi063.stdout:5/603: sync 2023-12-07T16:21:44.611 INFO:tasks.workunit.client.0.smithi063.stdout:2/718: sync 2023-12-07T16:21:44.611 INFO:tasks.workunit.client.0.smithi063.stdout:6/669: sync 2023-12-07T16:21:44.611 INFO:tasks.workunit.client.0.smithi063.stdout:3/636: sync 2023-12-07T16:21:44.611 INFO:tasks.workunit.client.0.smithi063.stdout:4/497: sync 2023-12-07T16:21:44.611 INFO:tasks.workunit.client.0.smithi063.stdout:5/604: fsync d1/f65 0 2023-12-07T16:21:44.611 INFO:tasks.workunit.client.0.smithi063.stdout:2/719: chown d0/d21/d56/d71/l85 2083589428 1 2023-12-07T16:21:44.611 INFO:tasks.workunit.client.0.smithi063.stdout:9/581: sync 2023-12-07T16:21:44.611 INFO:tasks.workunit.client.0.smithi063.stdout:9/582: fsync d0/d21/f23 0 2023-12-07T16:21:44.612 INFO:tasks.workunit.client.0.smithi063.stdout:3/637: rmdir d7/d4f 39 2023-12-07T16:21:44.613 INFO:tasks.workunit.client.0.smithi063.stdout:6/670: getdents d0/d17/d95 0 2023-12-07T16:21:44.614 INFO:tasks.workunit.client.0.smithi063.stdout:2/720: symlink d0/d21/d56/d11/d52/d5d/leb 0 2023-12-07T16:21:44.615 INFO:tasks.workunit.client.1.smithi152.stdout:4/790: sync 2023-12-07T16:21:44.615 INFO:tasks.workunit.client.1.smithi152.stdout:0/871: sync 2023-12-07T16:21:44.616 INFO:tasks.workunit.client.0.smithi063.stdout:9/583: symlink d0/d8d/lc3 0 2023-12-07T16:21:44.617 INFO:tasks.workunit.client.0.smithi063.stdout:3/638: creat d7/d4f/fd0 x:0 0 0 2023-12-07T16:21:44.618 INFO:tasks.workunit.client.1.smithi152.stdout:4/791: unlink d0/d3/d6/d2b/dd9/d3a/d46/d80/lab 0 2023-12-07T16:21:44.619 INFO:tasks.workunit.client.0.smithi063.stdout:2/721: truncate d0/d21/d39/f51 63204 0 2023-12-07T16:21:44.619 INFO:tasks.workunit.client.0.smithi063.stdout:9/584: dread d0/d13/f25 [0,4194304] 0 2023-12-07T16:21:44.619 INFO:tasks.workunit.client.0.smithi063.stdout:9/585: chown d0/l9 7 1 2023-12-07T16:21:44.620 INFO:tasks.workunit.client.1.smithi152.stdout:0/872: symlink d0/dc/d3d/d73/dbf/l130 0 2023-12-07T16:21:44.620 INFO:tasks.workunit.client.1.smithi152.stdout:4/792: mkdir d0/d3/d6/d2b/de2/dea 0 2023-12-07T16:21:44.620 INFO:tasks.workunit.client.1.smithi152.stdout:4/793: symlink d0/d3/d6/d2b/de2/leb 0 2023-12-07T16:21:44.621 INFO:tasks.workunit.client.0.smithi063.stdout:2/722: rename d0/d67/f82 to d0/d21/d56/d11/d6d/dcb/fec 0 2023-12-07T16:21:44.621 INFO:tasks.workunit.client.0.smithi063.stdout:2/723: chown d0/d67/c53 35724 1 2023-12-07T16:21:44.621 INFO:tasks.workunit.client.1.smithi152.stdout:4/794: rmdir d0/d3/d6/d2b/dd9 39 2023-12-07T16:21:44.621 INFO:tasks.workunit.client.1.smithi152.stdout:4/795: chown d0/d3/d6/d2b/dd9/d3a/d46/d4e/fe5 601884147 1 2023-12-07T16:21:44.622 INFO:tasks.workunit.client.0.smithi063.stdout:9/586: unlink d0/d13/d39/l8c 0 2023-12-07T16:21:44.622 INFO:tasks.workunit.client.0.smithi063.stdout:9/587: chown d0/l66 1094565 1 2023-12-07T16:21:44.623 INFO:tasks.workunit.client.0.smithi063.stdout:2/724: mkdir d0/d67/d65/d6a/ded 0 2023-12-07T16:21:44.624 INFO:tasks.workunit.client.0.smithi063.stdout:9/588: mknod d0/d21/d64/d6a/d8f/d92/cc4 0 2023-12-07T16:21:44.626 INFO:tasks.workunit.client.0.smithi063.stdout:9/589: symlink d0/d21/d64/d6a/d85/da4/lc5 0 2023-12-07T16:21:44.626 INFO:tasks.workunit.client.0.smithi063.stdout:9/590: write d0/d13/d39/d3a/f74 [745966,10165] 0 2023-12-07T16:21:44.627 INFO:tasks.workunit.client.0.smithi063.stdout:5/605: dread d1/d3/de/d1e/f78 [0,4194304] 0 2023-12-07T16:21:44.627 INFO:tasks.workunit.client.0.smithi063.stdout:9/591: symlink d0/d13/d39/d3a/lc6 0 2023-12-07T16:21:44.628 INFO:tasks.workunit.client.0.smithi063.stdout:5/606: link d1/d3/de/d1e/d6b/c8d d1/d3/de/d1e/d6b/cac 0 2023-12-07T16:21:44.628 INFO:tasks.workunit.client.0.smithi063.stdout:5/607: write d1/d31/d56/d61/d5e/d6a/d7e/f84 [243865,47518] 0 2023-12-07T16:21:44.630 INFO:tasks.workunit.client.0.smithi063.stdout:2/725: write d0/d67/d5b/f78 [1055590,96229] 0 2023-12-07T16:21:44.631 INFO:tasks.workunit.client.0.smithi063.stdout:2/726: symlink d0/d21/lee 0 2023-12-07T16:21:44.635 INFO:tasks.workunit.client.1.smithi152.stdout:4/796: dread d0/d3/d6/d2b/fa1 [0,4194304] 0 2023-12-07T16:21:44.635 INFO:tasks.workunit.client.1.smithi152.stdout:4/797: chown d0/d81 1361802550 1 2023-12-07T16:21:44.636 INFO:tasks.workunit.client.0.smithi063.stdout:5/608: dread d1/d3/d3a/f77 [0,4194304] 0 2023-12-07T16:21:44.636 INFO:tasks.workunit.client.0.smithi063.stdout:5/609: truncate d1/d31/d56/d61/d5e/d6a/f9b 334292 0 2023-12-07T16:21:44.642 INFO:tasks.workunit.client.0.smithi063.stdout:9/592: dread d0/d21/d64/d6a/d85/da4/f2a [0,4194304] 0 2023-12-07T16:21:44.643 INFO:tasks.workunit.client.0.smithi063.stdout:9/593: dread d0/d21/f71 [0,4194304] 0 2023-12-07T16:21:44.646 INFO:tasks.workunit.client.0.smithi063.stdout:9/594: dread d0/d21/fc1 [0,4194304] 0 2023-12-07T16:21:44.646 INFO:tasks.workunit.client.0.smithi063.stdout:9/595: dread - d0/d13/d39/d3a/d78/f7f zero size 2023-12-07T16:21:44.677 INFO:tasks.workunit.client.1.smithi152.stdout:8/836: read d3/d4/d9/dc/d6f/d7a/d8a/f37 [110190,75596] 0 2023-12-07T16:21:44.679 INFO:tasks.workunit.client.1.smithi152.stdout:4/798: mknod d0/d3/d6/d2b/dd9/d3a/d46/d80/cec 0 2023-12-07T16:21:44.679 INFO:tasks.workunit.client.1.smithi152.stdout:4/799: chown d0/d3/d6/d36/f44 416357167 1 2023-12-07T16:21:44.679 INFO:tasks.workunit.client.1.smithi152.stdout:4/800: stat d0/d3/d6/d2b/dd9/d3a/d46/d80/fa7 0 2023-12-07T16:21:44.683 INFO:tasks.workunit.client.1.smithi152.stdout:8/837: creat d3/d1e/d43/dbc/f132 x:0 0 0 2023-12-07T16:21:44.691 INFO:tasks.workunit.client.1.smithi152.stdout:4/801: rename d0/d3/d6/d2b/cd0 to d0/d3/d6/d2b/db1/ddd/ced 0 2023-12-07T16:21:44.693 INFO:tasks.workunit.client.0.smithi063.stdout:1/490: write d0/dd/d19/d50/f92 [2633562,4614] 0 2023-12-07T16:21:44.693 INFO:tasks.workunit.client.0.smithi063.stdout:1/491: chown d0/dd/d19/d50/d72 3 1 2023-12-07T16:21:44.693 INFO:tasks.workunit.client.0.smithi063.stdout:1/492: stat d0/dd/d10/d1b/c20 0 2023-12-07T16:21:44.694 INFO:tasks.workunit.client.1.smithi152.stdout:7/795: dwrite db/d27/d5e/f48 [0,4194304] 0 2023-12-07T16:21:44.694 INFO:tasks.workunit.client.1.smithi152.stdout:2/826: dwrite d2/d1c/d52/da8/ff4 [0,4194304] 0 2023-12-07T16:21:44.694 INFO:tasks.workunit.client.0.smithi063.stdout:9/596: dread d0/d13/f49 [0,4194304] 0 2023-12-07T16:21:44.695 INFO:tasks.workunit.client.1.smithi152.stdout:8/838: symlink d3/d4/d9/dc/d6f/d7b/dbd/dc4/l133 0 2023-12-07T16:21:44.695 INFO:tasks.workunit.client.1.smithi152.stdout:4/802: creat d0/d17/d7f/fee x:0 0 0 2023-12-07T16:21:44.698 INFO:tasks.workunit.client.0.smithi063.stdout:1/493: rename d0/dd/d1f/d9d to d0/dd/d55/daa 0 2023-12-07T16:21:44.698 INFO:tasks.workunit.client.0.smithi063.stdout:9/597: truncate d0/d21/f2c 4266921 0 2023-12-07T16:21:44.698 INFO:tasks.workunit.client.0.smithi063.stdout:9/598: chown d0/d13/d39/d42/d57/c89 10 1 2023-12-07T16:21:44.698 INFO:tasks.workunit.client.0.smithi063.stdout:9/599: write d0/d21/d64/d6a/d85/da4/f6d [1627174,36924] 0 2023-12-07T16:21:44.698 INFO:tasks.workunit.client.1.smithi152.stdout:7/796: truncate db/d27/f49 534661 0 2023-12-07T16:21:44.699 INFO:tasks.workunit.client.0.smithi063.stdout:1/494: write d0/dd/d19/d50/d71/f2c [669937,84772] 0 2023-12-07T16:21:44.704 INFO:tasks.workunit.client.1.smithi152.stdout:2/827: readlink d2/d1c/d2e/d57/db1/l9e 0 2023-12-07T16:21:44.704 INFO:tasks.workunit.client.1.smithi152.stdout:8/839: creat d3/d4/d9/d34/f134 x:0 0 0 2023-12-07T16:21:44.704 INFO:tasks.workunit.client.1.smithi152.stdout:7/797: rename db/d27/d39/l2a to db/d27/d39/d41/d58/da5/dde/df2/df4/lfd 0 2023-12-07T16:21:44.704 INFO:tasks.workunit.client.1.smithi152.stdout:7/798: chown db/d27/d5e/f8b 6722902 1 2023-12-07T16:21:44.708 INFO:tasks.workunit.client.0.smithi063.stdout:4/498: dread d1/d3/f4e [0,4194304] 0 2023-12-07T16:21:44.711 INFO:tasks.workunit.client.1.smithi152.stdout:7/799: link db/d1c/f10 db/d27/d5e/ffe 0 2023-12-07T16:21:44.712 INFO:tasks.workunit.client.1.smithi152.stdout:8/840: dread d3/d1e/d55/fe9 [0,4194304] 0 2023-12-07T16:21:44.712 INFO:tasks.workunit.client.1.smithi152.stdout:7/800: getdents db/d68 0 2023-12-07T16:21:44.713 INFO:tasks.workunit.client.1.smithi152.stdout:7/801: write db/d27/f3d [4234703,22457] 0 2023-12-07T16:21:44.724 INFO:tasks.workunit.client.1.smithi152.stdout:2/828: dread d2/d1c/d2e/d57/d5b/da7/f55 [0,4194304] 0 2023-12-07T16:21:44.724 INFO:tasks.workunit.client.0.smithi063.stdout:4/499: write d1/d3/db/f3e [2679262,55176] 0 2023-12-07T16:21:44.740 INFO:tasks.workunit.client.0.smithi063.stdout:0/696: dwrite d4/dd/de/f20 [4194304,4194304] 0 2023-12-07T16:21:44.741 INFO:tasks.workunit.client.1.smithi152.stdout:3/895: dwrite d7/d10/d1a/d2f/d56/d57/dee/f8d [0,4194304] 0 2023-12-07T16:21:44.741 INFO:tasks.workunit.client.0.smithi063.stdout:0/697: mknod d4/dd/de/d15/d59/d43/ce8 0 2023-12-07T16:21:44.741 INFO:tasks.workunit.client.1.smithi152.stdout:3/896: symlink d7/d10/d1a/d25/d78/l11d 0 2023-12-07T16:21:44.742 INFO:tasks.workunit.client.0.smithi063.stdout:0/698: creat d4/dd/d26/d2b/fe9 x:0 0 0 2023-12-07T16:21:44.742 INFO:tasks.workunit.client.0.smithi063.stdout:0/699: chown d4/dd/de/d15/l39 5540019 1 2023-12-07T16:21:44.743 INFO:tasks.workunit.client.0.smithi063.stdout:0/700: mkdir d4/dd/de/d15/d1f/d4c/da1/dea 0 2023-12-07T16:21:44.743 INFO:tasks.workunit.client.0.smithi063.stdout:0/701: getdents d4/dd/de/d15/d59/d43/dd8 0 2023-12-07T16:21:44.744 INFO:tasks.workunit.client.1.smithi152.stdout:3/897: write d7/dc/f1b [2435833,52] 0 2023-12-07T16:21:44.744 INFO:tasks.workunit.client.0.smithi063.stdout:0/702: symlink d4/dd/d26/d2b/db5/d5b/d63/d6b/leb 0 2023-12-07T16:21:44.745 INFO:tasks.workunit.client.0.smithi063.stdout:0/703: truncate d4/dd/d26/d2b/d5e/d8e/d95/f94 479656 0 2023-12-07T16:21:44.745 INFO:tasks.workunit.client.0.smithi063.stdout:0/704: truncate d4/dd/de/d15/d59/d43/f5c 1964592 0 2023-12-07T16:21:44.746 INFO:tasks.workunit.client.1.smithi152.stdout:3/898: unlink d7/d10/d1a/d2f/d56/d57/dee/dda/c65 0 2023-12-07T16:21:44.768 INFO:tasks.workunit.client.0.smithi063.stdout:4/500: write d1/d3/db/d2c/d63/f18 [3331611,83377] 0 2023-12-07T16:21:44.768 INFO:tasks.workunit.client.0.smithi063.stdout:4/501: write d1/d3/f5a [562031,82308] 0 2023-12-07T16:21:44.768 INFO:tasks.workunit.client.0.smithi063.stdout:4/502: chown d1/d3/f8 1045923 1 2023-12-07T16:21:44.769 INFO:tasks.workunit.client.1.smithi152.stdout:6/818: dwrite d2/d4f/d83/d48/d70/da7/db7/fd1 [0,4194304] 0 2023-12-07T16:21:44.770 INFO:tasks.workunit.client.0.smithi063.stdout:4/503: link d1/d3/db/d2c/c8e d1/c93 0 2023-12-07T16:21:44.770 INFO:tasks.workunit.client.0.smithi063.stdout:8/820: dwrite d7/d14/d15/db4/fcd [0,4194304] 0 2023-12-07T16:21:44.775 INFO:tasks.workunit.client.0.smithi063.stdout:4/504: unlink d1/d3/db/d41/c79 0 2023-12-07T16:21:44.777 INFO:tasks.workunit.client.0.smithi063.stdout:8/821: truncate d7/fd 1357517 0 2023-12-07T16:21:44.777 INFO:tasks.workunit.client.0.smithi063.stdout:4/505: mknod d1/d3/db/d2c/c94 0 2023-12-07T16:21:44.780 INFO:tasks.workunit.client.0.smithi063.stdout:8/822: rename d7/d14/d15/d2b/fff to d7/d14/d15/dde/d63/d75/d98/dc4/f109 0 2023-12-07T16:21:44.780 INFO:tasks.workunit.client.0.smithi063.stdout:6/671: dwrite d0/d1e/f3e [0,4194304] 0 2023-12-07T16:21:44.781 INFO:tasks.workunit.client.0.smithi063.stdout:2/727: dwrite d0/d21/fc3 [0,4194304] 0 2023-12-07T16:21:44.782 INFO:tasks.workunit.client.0.smithi063.stdout:4/506: link d1/d3/d3f/d49/f5e d1/d3/db/d41/f95 0 2023-12-07T16:21:44.782 INFO:tasks.workunit.client.0.smithi063.stdout:4/507: dread - d1/d3/db/d2c/f91 zero size 2023-12-07T16:21:44.784 INFO:tasks.workunit.client.0.smithi063.stdout:6/672: mknod d0/d1e/d20/d4a/ddf/cf1 0 2023-12-07T16:21:44.794 INFO:tasks.workunit.client.0.smithi063.stdout:4/508: creat d1/d3/db/d73/f96 x:0 0 0 2023-12-07T16:21:44.797 INFO:tasks.workunit.client.0.smithi063.stdout:2/728: getdents d0/d21/db2 0 2023-12-07T16:21:44.798 INFO:tasks.workunit.client.0.smithi063.stdout:4/509: creat d1/d3/d3a/f97 x:0 0 0 2023-12-07T16:21:44.799 INFO:tasks.workunit.client.0.smithi063.stdout:2/729: creat d0/d21/db2/dce/fef x:0 0 0 2023-12-07T16:21:44.800 INFO:tasks.workunit.client.0.smithi063.stdout:0/705: dread d4/dd/d26/d2b/d5e/d8e/f9c [0,4194304] 0 2023-12-07T16:21:44.801 INFO:tasks.workunit.client.0.smithi063.stdout:2/730: rename d0/d21/d56/d11/d52/da9/dbe/f46 to d0/d67/d65/d6a/d8e/ff0 0 2023-12-07T16:21:44.802 INFO:tasks.workunit.client.0.smithi063.stdout:0/706: mknod d4/dd/d26/d2b/d5e/cec 0 2023-12-07T16:21:44.803 INFO:tasks.workunit.client.0.smithi063.stdout:2/731: rename d0/d21/d56/d11/d52/d63/f6b to d0/d21/d56/d11/d52/da9/daf/dcd/ff1 0 2023-12-07T16:21:44.804 INFO:tasks.workunit.client.0.smithi063.stdout:0/707: mkdir d4/dd/d26/d2b/d5e/d8e/d95/d68/ded 0 2023-12-07T16:21:44.806 INFO:tasks.workunit.client.0.smithi063.stdout:2/732: creat d0/d21/d56/d11/d6d/dcb/ff2 x:0 0 0 2023-12-07T16:21:44.808 INFO:tasks.workunit.client.0.smithi063.stdout:2/733: chown d0/d21/f2a 8 1 2023-12-07T16:21:44.817 INFO:tasks.workunit.client.0.smithi063.stdout:2/734: dread d0/d21/d56/d11/d52/d5d/dbb/fb1 [0,4194304] 0 2023-12-07T16:21:44.819 INFO:tasks.workunit.client.0.smithi063.stdout:2/735: mkdir d0/d21/d56/d11/d52/d63/df3 0 2023-12-07T16:21:44.821 INFO:tasks.workunit.client.0.smithi063.stdout:2/736: unlink d0/d21/db2/dce/fef 0 2023-12-07T16:21:44.822 INFO:tasks.workunit.client.0.smithi063.stdout:2/737: creat d0/d21/d56/d11/d52/da9/daf/dcd/ff4 x:0 0 0 2023-12-07T16:21:44.864 INFO:tasks.workunit.client.1.smithi152.stdout:1/994: dwrite dc/d14/d18/f3f [0,4194304] 0 2023-12-07T16:21:44.867 INFO:tasks.workunit.client.1.smithi152.stdout:1/995: dread dc/d14/d18/d64/faf [0,4194304] 0 2023-12-07T16:21:44.867 INFO:tasks.workunit.client.1.smithi152.stdout:1/996: chown dc/d14/d18/d79/d86/db7/l110 6965 1 2023-12-07T16:21:44.868 INFO:tasks.workunit.client.1.smithi152.stdout:1/997: mknod dc/d14/d18/d79/d86/c149 0 2023-12-07T16:21:44.868 INFO:tasks.workunit.client.1.smithi152.stdout:1/998: chown dc/d12f 17512270 1 2023-12-07T16:21:44.868 INFO:tasks.workunit.client.1.smithi152.stdout:1/999: creat dc/d14/dfe/f14a x:0 0 0 2023-12-07T16:21:44.870 INFO:tasks.workunit.client.1.smithi152.stdout:4/803: dwrite d0/d81/fc6 [4194304,4194304] 0 2023-12-07T16:21:44.870 INFO:tasks.workunit.client.1.smithi152.stdout:4/804: read - d0/d3/f95 zero size 2023-12-07T16:21:44.871 INFO:tasks.workunit.client.1.smithi152.stdout:4/805: mknod d0/d3/d6/d2b/d56/d83/cef 0 2023-12-07T16:21:44.876 INFO:tasks.workunit.client.0.smithi063.stdout:1/495: dwrite d0/dd/d10/f27 [0,4194304] 0 2023-12-07T16:21:44.877 INFO:tasks.workunit.client.1.smithi152.stdout:2/829: dwrite d2/d1c/d2e/d57/f68 [0,4194304] 0 2023-12-07T16:21:44.877 INFO:tasks.workunit.client.0.smithi063.stdout:9/600: dwrite d0/d13/d39/d3a/f74 [0,4194304] 0 2023-12-07T16:21:44.879 INFO:tasks.workunit.client.1.smithi152.stdout:0/873: dwrite d0/dc/d36/d7d/d92/fa9 [0,4194304] 0 2023-12-07T16:21:44.879 INFO:tasks.workunit.client.1.smithi152.stdout:8/841: dwrite d3/d1e/d43/f10b [0,4194304] 0 2023-12-07T16:21:44.879 INFO:tasks.workunit.client.1.smithi152.stdout:6/819: dwrite d2/fc6 [0,4194304] 0 2023-12-07T16:21:44.880 INFO:tasks.workunit.client.0.smithi063.stdout:8/823: dwrite d7/d14/d15/d2b/fe2 [0,4194304] 0 2023-12-07T16:21:44.880 INFO:tasks.workunit.client.0.smithi063.stdout:8/824: fdatasync d7/d14/d1a/dce/fdd 0 2023-12-07T16:21:44.880 INFO:tasks.workunit.client.0.smithi063.stdout:1/496: creat d0/dd/d10/d6f/fab x:0 0 0 2023-12-07T16:21:44.881 INFO:tasks.workunit.client.1.smithi152.stdout:3/899: dwrite d7/d10/d1a/d2f/d5c/df6/d6d/d84/f66 [0,4194304] 0 2023-12-07T16:21:44.881 INFO:tasks.workunit.client.1.smithi152.stdout:7/802: dwrite db/d68/d87/f8c [4194304,4194304] 0 2023-12-07T16:21:44.881 INFO:tasks.workunit.client.1.smithi152.stdout:7/803: chown db/d27/d39/d41/d58/da5/dde/df2/df4 351364819 1 2023-12-07T16:21:44.881 INFO:tasks.workunit.client.0.smithi063.stdout:2/738: dwrite d0/d21/d56/d11/d52/da9/dbe/fae [4194304,4194304] 0 2023-12-07T16:21:44.881 INFO:tasks.workunit.client.0.smithi063.stdout:2/739: truncate d0/d21/d56/d11/d52/da9/dbe/fb7 660175 0 2023-12-07T16:21:44.882 INFO:tasks.workunit.client.0.smithi063.stdout:6/673: dwrite d0/d17/d1a/d38/f62 [0,4194304] 0 2023-12-07T16:21:44.883 INFO:tasks.workunit.client.0.smithi063.stdout:5/610: dwrite d1/d3/de/d1e/d25/f3c [0,4194304] 0 2023-12-07T16:21:44.883 INFO:tasks.workunit.client.0.smithi063.stdout:4/510: dwrite d1/d3/db/d41/f6b [0,4194304] 0 2023-12-07T16:21:44.883 INFO:tasks.workunit.client.0.smithi063.stdout:9/601: creat d0/d8d/fc7 x:0 0 0 2023-12-07T16:21:44.892 INFO:tasks.workunit.client.1.smithi152.stdout:8/842: dread d3/d1e/f44 [0,4194304] 0 2023-12-07T16:21:44.892 INFO:tasks.workunit.client.1.smithi152.stdout:0/874: dread d0/d27/f59 [0,4194304] 0 2023-12-07T16:21:44.895 INFO:tasks.workunit.client.1.smithi152.stdout:2/830: dread d2/d1c/d2e/f7f [0,4194304] 0 2023-12-07T16:21:44.898 INFO:tasks.workunit.client.0.smithi063.stdout:2/740: symlink d0/d21/d56/lf5 0 2023-12-07T16:21:44.898 INFO:tasks.workunit.client.0.smithi063.stdout:2/741: truncate d0/d67/d65/d6a/fca 15466 0 2023-12-07T16:21:44.901 INFO:tasks.workunit.client.0.smithi063.stdout:5/611: getdents d1 0 2023-12-07T16:21:44.904 INFO:tasks.workunit.client.0.smithi063.stdout:4/511: creat d1/f98 x:0 0 0 2023-12-07T16:21:44.907 INFO:tasks.workunit.client.1.smithi152.stdout:6/820: mknod d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/c107 0 2023-12-07T16:21:44.907 INFO:tasks.workunit.client.0.smithi063.stdout:9/602: symlink d0/d13/d39/d42/d57/lc8 0 2023-12-07T16:21:44.911 INFO:tasks.workunit.client.1.smithi152.stdout:6/821: dread d2/d4f/d83/d85/f95 [0,4194304] 0 2023-12-07T16:21:44.911 INFO:tasks.workunit.client.0.smithi063.stdout:2/742: truncate d0/d21/d56/d11/d52/d5d/dbb/fda 255888 0 2023-12-07T16:21:44.912 INFO:tasks.workunit.client.1.smithi152.stdout:3/900: rmdir d7/d10/d1a/d2f/d5c/df6/d6d/d98 39 2023-12-07T16:21:44.912 INFO:tasks.workunit.client.0.smithi063.stdout:5/612: rmdir d1/d31/d56/d9d 0 2023-12-07T16:21:44.913 INFO:tasks.workunit.client.1.smithi152.stdout:7/804: unlink db/d27/d4d/f88 0 2023-12-07T16:21:44.914 INFO:tasks.workunit.client.1.smithi152.stdout:3/901: write d7/d10/d19/fe3 [671221,65948] 0 2023-12-07T16:21:44.915 INFO:tasks.workunit.client.0.smithi063.stdout:8/825: rmdir d7/d14/d15/dde 39 2023-12-07T16:21:44.919 INFO:tasks.workunit.client.1.smithi152.stdout:0/875: creat d0/dc/d36/d3a/dca/f131 x:0 0 0 2023-12-07T16:21:44.919 INFO:tasks.workunit.client.1.smithi152.stdout:8/843: creat d3/d1e/d55/d83/dae/de1/f135 x:0 0 0 2023-12-07T16:21:44.923 INFO:tasks.workunit.client.0.smithi063.stdout:2/743: creat d0/d67/d65/d6a/ded/ff6 x:0 0 0 2023-12-07T16:21:44.925 INFO:tasks.workunit.client.1.smithi152.stdout:8/844: mknod d3/d1e/d55/d83/dc5/d123/d125/d4c/da6/c136 0 2023-12-07T16:21:44.925 INFO:tasks.workunit.client.1.smithi152.stdout:7/805: rename db/d27/fdd to db/d27/d39/d41/d58/da5/dde/fff 0 2023-12-07T16:21:44.927 INFO:tasks.workunit.client.0.smithi063.stdout:5/613: mknod d1/d3/de/cad 0 2023-12-07T16:21:44.927 INFO:tasks.workunit.client.0.smithi063.stdout:5/614: write d1/d3/f8c [4167766,69393] 0 2023-12-07T16:21:44.927 INFO:tasks.workunit.client.0.smithi063.stdout:5/615: write d1/d31/d56/d61/f43 [1340173,84898] 0 2023-12-07T16:21:44.927 INFO:tasks.workunit.client.0.smithi063.stdout:5/616: fdatasync d1/d3/de/d1e/f47 0 2023-12-07T16:21:44.929 INFO:tasks.workunit.client.0.smithi063.stdout:8/826: rename d7/d14/d15/d57/f66 to d7/d14/d15/db4/f10a 0 2023-12-07T16:21:44.930 INFO:tasks.workunit.client.1.smithi152.stdout:8/845: mkdir d3/d1e/d55/d83/dc5/d123/d125/d4c/da6/db2/dc3/d137 0 2023-12-07T16:21:44.930 INFO:tasks.workunit.client.1.smithi152.stdout:8/846: readlink d3/d4/d9/dc/l60 0 2023-12-07T16:21:44.930 INFO:tasks.workunit.client.1.smithi152.stdout:6/822: dread d2/d4f/d83/d85/fc [0,4194304] 0 2023-12-07T16:21:44.932 INFO:tasks.workunit.client.1.smithi152.stdout:8/847: symlink d3/d4/d9/dc/d6f/d7a/d8a/d66/d9b/l138 0 2023-12-07T16:21:44.932 INFO:tasks.workunit.client.1.smithi152.stdout:8/848: dread - d3/d4/d4b/f124 zero size 2023-12-07T16:21:44.934 INFO:tasks.workunit.client.0.smithi063.stdout:8/827: rename d7/d14/d15/dde/da8/d9f/fa5 to d7/d14/d15/dde/d63/d75/d98/dc4/f10b 0 2023-12-07T16:21:44.934 INFO:tasks.workunit.client.1.smithi152.stdout:6/823: symlink d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/da1/l108 0 2023-12-07T16:21:44.936 INFO:tasks.workunit.client.0.smithi063.stdout:8/828: mknod d7/d14/d1a/c10c 0 2023-12-07T16:21:44.937 INFO:tasks.workunit.client.1.smithi152.stdout:8/849: link d3/d4/d9/dc/d6f/d7b/d7e/f9a d3/d1e/d55/d83/dc5/d123/d125/d4c/f139 0 2023-12-07T16:21:44.937 INFO:tasks.workunit.client.1.smithi152.stdout:0/876: dread d0/dc/d3d/dab/dc8/f112 [0,4194304] 0 2023-12-07T16:21:44.938 INFO:tasks.workunit.client.0.smithi063.stdout:8/829: link d7/d14/d1a/f50 d7/d14/d1a/dce/f10d 0 2023-12-07T16:21:44.939 INFO:tasks.workunit.client.1.smithi152.stdout:6/824: creat d2/d4f/d83/d85/d9/f109 x:0 0 0 2023-12-07T16:21:44.939 INFO:tasks.workunit.client.1.smithi152.stdout:6/825: fdatasync d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/ff4 0 2023-12-07T16:21:44.939 INFO:tasks.workunit.client.1.smithi152.stdout:9/925: sync 2023-12-07T16:21:44.939 INFO:tasks.workunit.client.0.smithi063.stdout:6/674: dwrite d0/d1e/d60/d68/d76/fcb [0,4194304] 0 2023-12-07T16:21:44.940 INFO:tasks.workunit.client.1.smithi152.stdout:8/850: getdents d3/d1e/d55/d83/dc5/d104 0 2023-12-07T16:21:44.940 INFO:tasks.workunit.client.1.smithi152.stdout:8/851: dread - d3/d1e/d55/d83/dc5/d123/d125/f117 zero size 2023-12-07T16:21:44.941 INFO:tasks.workunit.client.0.smithi063.stdout:5/617: dread d1/f34 [0,4194304] 0 2023-12-07T16:21:44.941 INFO:tasks.workunit.client.0.smithi063.stdout:8/830: read d7/d14/d15/d2b/f41 [35092,36141] 0 2023-12-07T16:21:44.941 INFO:tasks.workunit.client.1.smithi152.stdout:0/877: truncate d0/dc/d36/d3a/d69/f99 323750 0 2023-12-07T16:21:44.944 INFO:tasks.workunit.client.1.smithi152.stdout:6/826: rmdir d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/d5d/df8 0 2023-12-07T16:21:44.944 INFO:tasks.workunit.client.1.smithi152.stdout:6/827: stat d2/f24 0 2023-12-07T16:21:44.945 INFO:tasks.workunit.client.0.smithi063.stdout:5/618: write d1/d3/f35 [6128399,106044] 0 2023-12-07T16:21:44.946 INFO:tasks.workunit.client.0.smithi063.stdout:6/675: mkdir d0/d1e/d60/d68/d78/df2 0 2023-12-07T16:21:44.946 INFO:tasks.workunit.client.1.smithi152.stdout:8/852: symlink d3/d1e/d55/d83/dc5/d123/d125/d4c/da6/l13a 0 2023-12-07T16:21:44.947 INFO:tasks.workunit.client.1.smithi152.stdout:4/806: dwrite d0/d3/d6/d2b/fd3 [0,4194304] 0 2023-12-07T16:21:44.947 INFO:tasks.workunit.client.1.smithi152.stdout:6/828: mkdir d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d10a 0 2023-12-07T16:21:44.947 INFO:tasks.workunit.client.1.smithi152.stdout:6/829: write d2/d4f/d83/d48/d70/d81/fe8 [5986308,66331] 0 2023-12-07T16:21:44.949 INFO:tasks.workunit.client.1.smithi152.stdout:8/853: mkdir d3/d4/d9/dc/d6f/d7a/d8a/d66/d9b/d13b 0 2023-12-07T16:21:44.953 INFO:tasks.workunit.client.1.smithi152.stdout:4/807: unlink d0/d3/d6/c20 0 2023-12-07T16:21:44.953 INFO:tasks.workunit.client.1.smithi152.stdout:4/808: write d0/d3/d6/d2b/dd9/d3a/d46/d9b/fe9 [409014,22699] 0 2023-12-07T16:21:44.953 INFO:tasks.workunit.client.1.smithi152.stdout:4/809: write d0/d3/d6/d36/f82 [641166,12227] 0 2023-12-07T16:21:44.954 INFO:tasks.workunit.client.0.smithi063.stdout:5/619: symlink d1/d3/de/d1e/d25/lae 0 2023-12-07T16:21:44.954 INFO:tasks.workunit.client.0.smithi063.stdout:6/676: creat d0/d1e/d60/d68/d76/da4/dc6/ff3 x:0 0 0 2023-12-07T16:21:44.954 INFO:tasks.workunit.client.1.smithi152.stdout:6/830: mkdir d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/df9/d10b 0 2023-12-07T16:21:44.955 INFO:tasks.workunit.client.1.smithi152.stdout:8/854: mkdir d3/d1e/d43/dbc/d13c 0 2023-12-07T16:21:44.956 INFO:tasks.workunit.client.0.smithi063.stdout:6/677: chown d0/d1e/d29/f57 1116436345 1 2023-12-07T16:21:44.958 INFO:tasks.workunit.client.1.smithi152.stdout:4/810: symlink d0/d3/d6/d2b/dd9/d3a/d48/d4c/lf0 0 2023-12-07T16:21:44.958 INFO:tasks.workunit.client.1.smithi152.stdout:4/811: readlink d0/d81/lb6 0 2023-12-07T16:21:44.959 INFO:tasks.workunit.client.0.smithi063.stdout:4/512: dwrite d1/d3/db/d73/f78 [0,4194304] 0 2023-12-07T16:21:44.959 INFO:tasks.workunit.client.0.smithi063.stdout:9/603: dwrite d0/d13/d6f/faa [0,4194304] 0 2023-12-07T16:21:44.959 INFO:tasks.workunit.client.1.smithi152.stdout:6/831: rmdir d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f 39 2023-12-07T16:21:44.959 INFO:tasks.workunit.client.1.smithi152.stdout:3/902: dwrite d7/d10/d41/fdc [0,4194304] 0 2023-12-07T16:21:44.960 INFO:tasks.workunit.client.0.smithi063.stdout:1/497: dwrite d0/dd/d10/fa9 [4194304,4194304] 0 2023-12-07T16:21:44.961 INFO:tasks.workunit.client.1.smithi152.stdout:8/855: rename d3/d1e/d55/d83/dde to d3/d4/d9/dc/d6f/d7b/dbd/dc4/d13d 0 2023-12-07T16:21:44.963 INFO:tasks.workunit.client.1.smithi152.stdout:4/812: mknod d0/d3/d6/d2b/de2/cf1 0 2023-12-07T16:21:44.967 INFO:tasks.workunit.client.0.smithi063.stdout:5/620: write d1/f40 [3325913,61654] 0 2023-12-07T16:21:44.967 INFO:tasks.workunit.client.0.smithi063.stdout:4/513: dread d1/d3/db/d41/f95 [0,4194304] 0 2023-12-07T16:21:44.967 INFO:tasks.workunit.client.0.smithi063.stdout:4/514: truncate d1/f98 700825 0 2023-12-07T16:21:44.967 INFO:tasks.workunit.client.1.smithi152.stdout:8/856: mkdir d3/d1e/d55/d83/dc5/d123/d125/d4c/da6/d106/d13e 0 2023-12-07T16:21:44.969 INFO:tasks.workunit.client.1.smithi152.stdout:4/813: symlink d0/d3/d6/lf2 0 2023-12-07T16:21:44.969 INFO:tasks.workunit.client.1.smithi152.stdout:4/814: chown d0/d3/d6/d2b/dd9/d3a/d48/l97 84332039 1 2023-12-07T16:21:44.972 INFO:tasks.workunit.client.0.smithi063.stdout:9/604: rename d0/f3 to d0/d13/d39/d42/fc9 0 2023-12-07T16:21:44.974 INFO:tasks.workunit.client.0.smithi063.stdout:1/498: creat d0/dd/d10/d6f/fac x:0 0 0 2023-12-07T16:21:44.974 INFO:tasks.workunit.client.1.smithi152.stdout:8/857: creat d3/d1e/d55/d83/dc5/d104/f13f x:0 0 0 2023-12-07T16:21:44.975 INFO:tasks.workunit.client.0.smithi063.stdout:5/621: mknod d1/d31/d56/d61/d5e/d6a/d7e/caf 0 2023-12-07T16:21:44.975 INFO:tasks.workunit.client.0.smithi063.stdout:5/622: fdatasync d1/f34 0 2023-12-07T16:21:44.977 INFO:tasks.workunit.client.0.smithi063.stdout:1/499: rmdir d0/d98 39 2023-12-07T16:21:44.977 INFO:tasks.workunit.client.1.smithi152.stdout:3/903: dread d7/d10/d19/f45 [0,4194304] 0 2023-12-07T16:21:44.977 INFO:tasks.workunit.client.1.smithi152.stdout:3/904: chown d7/d10/d1a/d2f/f20 1 1 2023-12-07T16:21:44.980 INFO:tasks.workunit.client.1.smithi152.stdout:4/815: link d0/d3/d6/d2b/dd9/d3a/d48/d4c/f52 d0/d3/d6/d2b/d75/ff3 0 2023-12-07T16:21:44.980 INFO:tasks.workunit.client.0.smithi063.stdout:1/500: creat d0/dd/d19/d50/d71/fad x:0 0 0 2023-12-07T16:21:44.981 INFO:tasks.workunit.client.1.smithi152.stdout:3/905: mknod d7/d10/d1a/d2f/c11e 0 2023-12-07T16:21:44.982 INFO:tasks.workunit.client.0.smithi063.stdout:1/501: mknod d0/dd/d10/d1b/d68/cae 0 2023-12-07T16:21:44.983 INFO:tasks.workunit.client.1.smithi152.stdout:7/806: dwrite db/d27/d39/d41/d58/f73 [0,4194304] 0 2023-12-07T16:21:44.983 INFO:tasks.workunit.client.1.smithi152.stdout:4/816: mkdir d0/d3/d6/d2b/de2/df4 0 2023-12-07T16:21:44.983 INFO:tasks.workunit.client.1.smithi152.stdout:4/817: chown d0/d3/d6/d2b/dd9/d39/d93 2 1 2023-12-07T16:21:44.983 INFO:tasks.workunit.client.1.smithi152.stdout:4/818: chown d0/c8c 1869184845 1 2023-12-07T16:21:44.983 INFO:tasks.workunit.client.0.smithi063.stdout:1/502: creat d0/dd/d10/d6f/faf x:0 0 0 2023-12-07T16:21:44.984 INFO:tasks.workunit.client.0.smithi063.stdout:7/632: sync 2023-12-07T16:21:44.985 INFO:tasks.workunit.client.0.smithi063.stdout:1/503: getdents d0/dd/d1f 0 2023-12-07T16:21:44.986 INFO:tasks.workunit.client.0.smithi063.stdout:7/633: creat d2/d34/d46/d48/d70/daf/dd6/fea x:0 0 0 2023-12-07T16:21:44.986 INFO:tasks.workunit.client.0.smithi063.stdout:7/634: fsync d2/f8 0 2023-12-07T16:21:44.987 INFO:tasks.workunit.client.1.smithi152.stdout:3/906: truncate d7/d10/d1a/d2f/f22 4071148 0 2023-12-07T16:21:44.987 INFO:tasks.workunit.client.1.smithi152.stdout:4/819: mkdir d0/d17/df5 0 2023-12-07T16:21:44.988 INFO:tasks.workunit.client.0.smithi063.stdout:9/605: dread d0/d21/d64/d6a/d85/da4/f58 [0,4194304] 0 2023-12-07T16:21:44.988 INFO:tasks.workunit.client.0.smithi063.stdout:9/606: write d0/d21/d64/d6a/d8f/d92/f9a [941709,55333] 0 2023-12-07T16:21:44.988 INFO:tasks.workunit.client.0.smithi063.stdout:9/607: write d0/d13/d39/d3a/fbf [841044,8511] 0 2023-12-07T16:21:44.988 INFO:tasks.workunit.client.0.smithi063.stdout:9/608: fdatasync d0/f73 0 2023-12-07T16:21:44.992 INFO:tasks.workunit.client.0.smithi063.stdout:9/609: unlink d0/d21/d64/d6a/fc0 0 2023-12-07T16:21:44.994 INFO:tasks.workunit.client.1.smithi152.stdout:8/858: dread d3/d4/d9/dc/d6f/d7b/d7e/f9a [0,4194304] 0 2023-12-07T16:21:44.995 INFO:tasks.workunit.client.0.smithi063.stdout:9/610: rename d0/f31 to d0/d13/fca 0 2023-12-07T16:21:44.995 INFO:tasks.workunit.client.1.smithi152.stdout:7/807: write db/d27/d39/f66 [2147494,30811] 0 2023-12-07T16:21:44.997 INFO:tasks.workunit.client.0.smithi063.stdout:9/611: creat d0/d13/fcb x:0 0 0 2023-12-07T16:21:44.997 INFO:tasks.workunit.client.0.smithi063.stdout:9/612: write d0/d13/d39/d42/d57/f76 [1837460,121203] 0 2023-12-07T16:21:44.997 INFO:tasks.workunit.client.0.smithi063.stdout:2/744: dwrite d0/d67/d65/f96 [0,4194304] 0 2023-12-07T16:21:44.998 INFO:tasks.workunit.client.1.smithi152.stdout:7/808: mkdir db/d27/d39/d41/d58/da5/dde/d100 0 2023-12-07T16:21:45.000 INFO:tasks.workunit.client.1.smithi152.stdout:7/809: mknod db/d27/d39/d41/d58/d80/def/c101 0 2023-12-07T16:21:45.003 INFO:tasks.workunit.client.1.smithi152.stdout:3/907: dread d7/d10/d1a/d25/fcc [0,4194304] 0 2023-12-07T16:21:45.003 INFO:tasks.workunit.client.1.smithi152.stdout:3/908: chown d7/d10/d1a/d2f/d56/f9f 4993 1 2023-12-07T16:21:45.006 INFO:tasks.workunit.client.0.smithi063.stdout:7/635: dread d2/d21/f3f [0,4194304] 0 2023-12-07T16:21:45.006 INFO:tasks.workunit.client.0.smithi063.stdout:7/636: chown d2/fa 986452541 1 2023-12-07T16:21:45.006 INFO:tasks.workunit.client.0.smithi063.stdout:7/637: chown d2/d34/d5a/f66 12 1 2023-12-07T16:21:45.007 INFO:tasks.workunit.client.1.smithi152.stdout:3/909: symlink d7/d10/d1a/d2f/l11f 0 2023-12-07T16:21:45.007 INFO:tasks.workunit.client.1.smithi152.stdout:3/910: write d7/d10/d1a/d2f/d56/d57/dee/dda/f5e [430331,31727] 0 2023-12-07T16:21:45.007 INFO:tasks.workunit.client.0.smithi063.stdout:2/745: dread d0/d67/f59 [0,4194304] 0 2023-12-07T16:21:45.007 INFO:tasks.workunit.client.0.smithi063.stdout:2/746: readlink d0/d67/d65/d6a/d8e/lb5 0 2023-12-07T16:21:45.007 INFO:tasks.workunit.client.0.smithi063.stdout:7/638: symlink d2/d34/d5a/leb 0 2023-12-07T16:21:45.010 INFO:tasks.workunit.client.0.smithi063.stdout:9/613: dread d0/f73 [0,4194304] 0 2023-12-07T16:21:45.010 INFO:tasks.workunit.client.0.smithi063.stdout:2/747: link d0/d21/d56/d11/d52/da9/dbe/f30 d0/d67/d65/d6a/d8e/ff7 0 2023-12-07T16:21:45.010 INFO:tasks.workunit.client.0.smithi063.stdout:2/748: readlink d0/d21/d56/d11/l2e 0 2023-12-07T16:21:45.011 INFO:tasks.workunit.client.0.smithi063.stdout:9/614: rmdir d0/d13/d39/d3a 39 2023-12-07T16:21:45.012 INFO:tasks.workunit.client.0.smithi063.stdout:7/639: write d2/d34/d5a/fa4 [2256723,26907] 0 2023-12-07T16:21:45.012 INFO:tasks.workunit.client.0.smithi063.stdout:7/640: fsync d2/d34/d5a/d5f/d78/d7c/d9b/fad 0 2023-12-07T16:21:45.013 INFO:tasks.workunit.client.0.smithi063.stdout:2/749: unlink d0/d67/fdd 0 2023-12-07T16:21:45.013 INFO:tasks.workunit.client.0.smithi063.stdout:2/750: chown d0/d67/d65/d6a/d8e/ff0 2998332 1 2023-12-07T16:21:45.013 INFO:tasks.workunit.client.0.smithi063.stdout:2/751: fsync d0/d21/d56/d11/d52/d5d/dbb/fb1 0 2023-12-07T16:21:45.014 INFO:tasks.workunit.client.0.smithi063.stdout:2/752: rmdir d0/d21/db2 39 2023-12-07T16:21:45.014 INFO:tasks.workunit.client.1.smithi152.stdout:7/810: dread db/d68/d87/f8c [0,4194304] 0 2023-12-07T16:21:45.015 INFO:tasks.workunit.client.0.smithi063.stdout:9/615: write d0/d13/f40 [1179660,63264] 0 2023-12-07T16:21:45.015 INFO:tasks.workunit.client.0.smithi063.stdout:9/616: truncate d0/d21/d64/d6a/d85/da4/f9e 856196 0 2023-12-07T16:21:45.023 INFO:tasks.workunit.client.0.smithi063.stdout:7/641: dread d2/d34/d5a/d5f/d53/fbf [0,4194304] 0 2023-12-07T16:21:45.023 INFO:tasks.workunit.client.0.smithi063.stdout:7/642: fsync d2/d34/d5a/d5f/d78/d7c/d9b/faa 0 2023-12-07T16:21:45.025 INFO:tasks.workunit.client.0.smithi063.stdout:7/643: truncate d2/f8 206443 0 2023-12-07T16:21:45.025 INFO:tasks.workunit.client.0.smithi063.stdout:2/753: dread d0/d21/d56/d11/d52/da9/daf/fbc [0,4194304] 0 2023-12-07T16:21:45.026 INFO:tasks.workunit.client.0.smithi063.stdout:2/754: dread d0/d21/d56/d11/d52/da9/dbe/f3e [0,4194304] 0 2023-12-07T16:21:45.026 INFO:tasks.workunit.client.0.smithi063.stdout:7/644: rename d2/d21/c8b to d2/d34/d5a/cec 0 2023-12-07T16:21:45.027 INFO:tasks.workunit.client.0.smithi063.stdout:7/645: dread - d2/d34/d46/d48/d70/daf/dd6/fea zero size 2023-12-07T16:21:45.028 INFO:tasks.workunit.client.0.smithi063.stdout:7/646: mkdir d2/d34/d5a/d5f/d53/ded 0 2023-12-07T16:21:45.028 INFO:tasks.workunit.client.0.smithi063.stdout:7/647: chown d2/ff 44556448 1 2023-12-07T16:21:45.032 INFO:tasks.workunit.client.0.smithi063.stdout:7/648: read d2/d34/d46/d48/f4f [3690816,105656] 0 2023-12-07T16:21:45.032 INFO:tasks.workunit.client.0.smithi063.stdout:7/649: truncate d2/d34/d46/d48/f4c 75983 0 2023-12-07T16:21:45.032 INFO:tasks.workunit.client.0.smithi063.stdout:8/831: dwrite d7/d14/d1a/dce/f5b [0,4194304] 0 2023-12-07T16:21:45.033 INFO:tasks.workunit.client.1.smithi152.stdout:9/926: dwrite d1/d17/d4e/ff2 [0,4194304] 0 2023-12-07T16:21:45.033 INFO:tasks.workunit.client.1.smithi152.stdout:9/927: readlink d1/d17/d58/lec 0 2023-12-07T16:21:45.033 INFO:tasks.workunit.client.1.smithi152.stdout:6/832: dwrite d2/d4f/d83/d48/da8/fe2 [0,4194304] 0 2023-12-07T16:21:45.033 INFO:tasks.workunit.client.1.smithi152.stdout:6/833: readlink d2/d4f/d83/l2c 0 2023-12-07T16:21:45.033 INFO:tasks.workunit.client.1.smithi152.stdout:0/878: dwrite d0/d27/d8c/df7/f52 [0,4194304] 0 2023-12-07T16:21:45.033 INFO:tasks.workunit.client.0.smithi063.stdout:7/650: creat d2/d34/d46/d48/d70/daf/de8/fee x:0 0 0 2023-12-07T16:21:45.036 INFO:tasks.workunit.client.0.smithi063.stdout:7/651: creat d2/d34/dc2/fef x:0 0 0 2023-12-07T16:21:45.037 INFO:tasks.workunit.client.0.smithi063.stdout:7/652: rmdir d2/d2c 39 2023-12-07T16:21:45.037 INFO:tasks.workunit.client.0.smithi063.stdout:7/653: symlink d2/d34/lf0 0 2023-12-07T16:21:45.039 INFO:tasks.workunit.client.0.smithi063.stdout:7/654: rename d2/d34/d5a/d5f/d53/d9f/lb0 to d2/d34/d5a/d5f/d2a/dc9/lf1 0 2023-12-07T16:21:45.041 INFO:tasks.workunit.client.0.smithi063.stdout:7/655: unlink d2/d37/da0/fc4 0 2023-12-07T16:21:45.041 INFO:tasks.workunit.client.0.smithi063.stdout:7/656: write d2/d34/d5a/d5f/d61/f6a [797001,24489] 0 2023-12-07T16:21:45.043 INFO:tasks.workunit.client.1.smithi152.stdout:4/820: dwrite d0/d3/d6/d2b/d75/f9f [4194304,4194304] 0 2023-12-07T16:21:45.044 INFO:tasks.workunit.client.0.smithi063.stdout:6/678: dwrite d0/d54/f5f [0,4194304] 0 2023-12-07T16:21:45.044 INFO:tasks.workunit.client.0.smithi063.stdout:6/679: fsync d0/d1e/d1d/d1f/d6c/fa8 0 2023-12-07T16:21:45.044 INFO:tasks.workunit.client.0.smithi063.stdout:6/680: fsync d0/d1e/d29/f36 0 2023-12-07T16:21:45.044 INFO:tasks.workunit.client.0.smithi063.stdout:6/681: stat d0/d1e/d60/d68/d78 0 2023-12-07T16:21:45.045 INFO:tasks.workunit.client.0.smithi063.stdout:5/623: dwrite d1/d3/f3b [0,4194304] 0 2023-12-07T16:21:45.045 INFO:tasks.workunit.client.0.smithi063.stdout:5/624: stat d1/d3/de/d1e/l5f 0 2023-12-07T16:21:45.045 INFO:tasks.workunit.client.0.smithi063.stdout:4/515: dwrite d1/d3/db/d2c/d63/f84 [0,4194304] 0 2023-12-07T16:21:45.045 INFO:tasks.workunit.client.1.smithi152.stdout:8/859: dwrite d3/d4/d9/dc/f39 [0,4194304] 0 2023-12-07T16:21:45.046 INFO:tasks.workunit.client.0.smithi063.stdout:6/682: truncate d0/d79/fa0 368196 0 2023-12-07T16:21:45.046 INFO:tasks.workunit.client.0.smithi063.stdout:8/832: dread d7/d14/f27 [0,4194304] 0 2023-12-07T16:21:45.046 INFO:tasks.workunit.client.0.smithi063.stdout:2/755: dwrite d0/d21/d56/d11/d52/da9/dbe/f9a [4194304,4194304] 0 2023-12-07T16:21:45.046 INFO:tasks.workunit.client.0.smithi063.stdout:2/756: chown d0/d21/d56/d11/d52/d63 293607 1 2023-12-07T16:21:45.047 INFO:tasks.workunit.client.0.smithi063.stdout:9/617: dwrite d0/f47 [0,4194304] 0 2023-12-07T16:21:45.047 INFO:tasks.workunit.client.0.smithi063.stdout:9/618: fsync d0/d13/d6f/daf/fbd 0 2023-12-07T16:21:45.047 INFO:tasks.workunit.client.0.smithi063.stdout:9/619: dread - d0/d13/d39/fa7 zero size 2023-12-07T16:21:45.047 INFO:tasks.workunit.client.0.smithi063.stdout:9/620: dread - d0/d8d/fc7 zero size 2023-12-07T16:21:45.047 INFO:tasks.workunit.client.0.smithi063.stdout:9/621: chown d0/d13/c37 1 1 2023-12-07T16:21:45.048 INFO:tasks.workunit.client.0.smithi063.stdout:2/757: write d0/f33 [4296399,35711] 0 2023-12-07T16:21:45.048 INFO:tasks.workunit.client.0.smithi063.stdout:8/833: dread d7/d14/d1a/f33 [0,4194304] 0 2023-12-07T16:21:45.048 INFO:tasks.workunit.client.0.smithi063.stdout:8/834: chown d7/d14/d1a/f56 1 1 2023-12-07T16:21:45.048 INFO:tasks.workunit.client.0.smithi063.stdout:5/625: mknod d1/d31/cb0 0 2023-12-07T16:21:45.051 INFO:tasks.workunit.client.0.smithi063.stdout:4/516: mkdir d1/d3/db/d2c/d63/d99 0 2023-12-07T16:21:45.051 INFO:tasks.workunit.client.0.smithi063.stdout:4/517: chown d1/d3/d3f/d49/f61 96 1 2023-12-07T16:21:45.053 INFO:tasks.workunit.client.0.smithi063.stdout:6/683: rmdir d0/d1e/d2a 39 2023-12-07T16:21:45.054 INFO:tasks.workunit.client.0.smithi063.stdout:6/684: read d0/d54/f5f [3626226,101966] 0 2023-12-07T16:21:45.057 INFO:tasks.workunit.client.0.smithi063.stdout:9/622: creat d0/d21/d64/d6a/d8f/d92/dbb/fcc x:0 0 0 2023-12-07T16:21:45.059 INFO:tasks.workunit.client.0.smithi063.stdout:2/758: rmdir d0/d21/d56/d11/d52/d63 39 2023-12-07T16:21:45.060 INFO:tasks.workunit.client.0.smithi063.stdout:8/835: rmdir d7/d38/df1 39 2023-12-07T16:21:45.061 INFO:tasks.workunit.client.0.smithi063.stdout:5/626: link d1/d3/de/d1e/d25/l6e d1/d3/lb1 0 2023-12-07T16:21:45.061 INFO:tasks.workunit.client.0.smithi063.stdout:5/627: write d1/d3/de/d1e/faa [907056,3445] 0 2023-12-07T16:21:45.062 INFO:tasks.workunit.client.0.smithi063.stdout:8/836: write f5 [225230,10157] 0 2023-12-07T16:21:45.063 INFO:tasks.workunit.client.0.smithi063.stdout:9/623: truncate d0/d21/d64/d6a/d8f/fa2 100862 0 2023-12-07T16:21:45.063 INFO:tasks.workunit.client.0.smithi063.stdout:9/624: fdatasync d0/d13/d6f/daf/fbd 0 2023-12-07T16:21:45.065 INFO:tasks.workunit.client.0.smithi063.stdout:5/628: symlink d1/d31/d56/d61/d5e/d6a/lb2 0 2023-12-07T16:21:45.065 INFO:tasks.workunit.client.0.smithi063.stdout:5/629: write d1/d31/d56/f6f [2048541,32403] 0 2023-12-07T16:21:45.068 INFO:tasks.workunit.client.0.smithi063.stdout:9/625: creat d0/d21/d64/d6a/d8f/d92/fcd x:0 0 0 2023-12-07T16:21:45.070 INFO:tasks.workunit.client.0.smithi063.stdout:8/837: write d7/d38/d8e/f91 [1974774,102826] 0 2023-12-07T16:21:45.072 INFO:tasks.workunit.client.0.smithi063.stdout:3/639: sync 2023-12-07T16:21:45.073 INFO:tasks.workunit.client.0.smithi063.stdout:4/518: dwrite d1/f34 [0,4194304] 0 2023-12-07T16:21:45.073 INFO:tasks.workunit.client.0.smithi063.stdout:4/519: truncate d1/d3/db/d41/f6b 4752947 0 2023-12-07T16:21:45.073 INFO:tasks.workunit.client.0.smithi063.stdout:4/520: chown d1/d3/d3f/d49/d64/f74 495837503 1 2023-12-07T16:21:45.074 INFO:tasks.workunit.client.0.smithi063.stdout:3/640: symlink d7/d9/d1b/ld1 0 2023-12-07T16:21:45.076 INFO:tasks.workunit.client.0.smithi063.stdout:8/838: write d7/d14/d15/f18 [3973386,82924] 0 2023-12-07T16:21:45.078 INFO:tasks.workunit.client.0.smithi063.stdout:4/521: creat d1/d3/d3f/f9a x:0 0 0 2023-12-07T16:21:45.078 INFO:tasks.workunit.client.0.smithi063.stdout:3/641: write d7/d9/dd/f1e [4937462,76671] 0 2023-12-07T16:21:45.079 INFO:tasks.workunit.client.0.smithi063.stdout:8/839: truncate d7/d14/fb2 3995940 0 2023-12-07T16:21:45.080 INFO:tasks.workunit.client.0.smithi063.stdout:6/685: dwrite d0/d1e/d60/d68/f70 [4194304,4194304] 0 2023-12-07T16:21:45.080 INFO:tasks.workunit.client.0.smithi063.stdout:6/686: chown d0/d17 365 1 2023-12-07T16:21:45.080 INFO:tasks.workunit.client.0.smithi063.stdout:6/687: fdatasync d0/d17/d95/dd6/d8b/fa2 0 2023-12-07T16:21:45.080 INFO:tasks.workunit.client.0.smithi063.stdout:6/688: chown d0/d1e/l67 19592863 1 2023-12-07T16:21:45.080 INFO:tasks.workunit.client.0.smithi063.stdout:4/522: creat d1/d3/d3a/f9b x:0 0 0 2023-12-07T16:21:45.082 INFO:tasks.workunit.client.0.smithi063.stdout:3/642: mknod d7/d9/dd/d60/cd2 0 2023-12-07T16:21:45.084 INFO:tasks.workunit.client.0.smithi063.stdout:8/840: unlink d7/d14/d15/dde/d63/c92 0 2023-12-07T16:21:45.084 INFO:tasks.workunit.client.0.smithi063.stdout:8/841: readlink d7/l13 0 2023-12-07T16:21:45.085 INFO:tasks.workunit.client.0.smithi063.stdout:0/708: sync 2023-12-07T16:21:45.085 INFO:tasks.workunit.client.0.smithi063.stdout:6/689: mkdir d0/d17/df4 0 2023-12-07T16:21:45.086 INFO:tasks.workunit.client.0.smithi063.stdout:6/690: stat d0/d17/l98 0 2023-12-07T16:21:45.086 INFO:tasks.workunit.client.0.smithi063.stdout:6/691: chown d0/d1e/d20/d4a/c99 162916 1 2023-12-07T16:21:45.086 INFO:tasks.workunit.client.0.smithi063.stdout:6/692: fdatasync d0/d1e/d1d/d4f/d88/fea 0 2023-12-07T16:21:45.087 INFO:tasks.workunit.client.0.smithi063.stdout:4/523: creat d1/d3/d3f/d49/d64/d80/f9c x:0 0 0 2023-12-07T16:21:45.087 INFO:tasks.workunit.client.0.smithi063.stdout:2/759: dwrite d0/d21/d56/d71/fa0 [0,4194304] 0 2023-12-07T16:21:45.088 INFO:tasks.workunit.client.0.smithi063.stdout:3/643: dread d7/d4f/d53/d72/db1/f62 [0,4194304] 0 2023-12-07T16:21:45.088 INFO:tasks.workunit.client.0.smithi063.stdout:3/644: fdatasync d7/d49/d4b/fad 0 2023-12-07T16:21:45.088 INFO:tasks.workunit.client.0.smithi063.stdout:9/626: dwrite d0/d21/d64/d6a/d85/da4/f2a [0,4194304] 0 2023-12-07T16:21:45.089 INFO:tasks.workunit.client.0.smithi063.stdout:9/627: write d0/d21/d64/d6a/d85/da4/f58 [3477277,33444] 0 2023-12-07T16:21:45.090 INFO:tasks.workunit.client.0.smithi063.stdout:2/760: read d0/d21/d56/f20 [1880933,116052] 0 2023-12-07T16:21:45.090 INFO:tasks.workunit.client.0.smithi063.stdout:2/761: fsync d0/d67/d65/fe1 0 2023-12-07T16:21:45.090 INFO:tasks.workunit.client.0.smithi063.stdout:2/762: chown d0/d21/d56/d11/d52/da9/dbe/cb8 23271 1 2023-12-07T16:21:45.090 INFO:tasks.workunit.client.0.smithi063.stdout:8/842: mkdir d7/d14/d15/dac/dad/d10e 0 2023-12-07T16:21:45.090 INFO:tasks.workunit.client.0.smithi063.stdout:8/843: chown d7/d14/ld7 187654 1 2023-12-07T16:21:45.091 INFO:tasks.workunit.client.0.smithi063.stdout:6/693: symlink d0/d1e/d60/d68/d76/da4/def/lf5 0 2023-12-07T16:21:45.092 INFO:tasks.workunit.client.0.smithi063.stdout:2/763: read d0/d67/d5b/db3/fc6 [2130724,30654] 0 2023-12-07T16:21:45.092 INFO:tasks.workunit.client.0.smithi063.stdout:2/764: truncate d0/d21/d56/fbd 134775 0 2023-12-07T16:21:45.092 INFO:tasks.workunit.client.0.smithi063.stdout:4/524: symlink d1/d3/db/d16/l9d 0 2023-12-07T16:21:45.095 INFO:tasks.workunit.client.0.smithi063.stdout:3/645: symlink d7/d4f/d53/ld3 0 2023-12-07T16:21:45.097 INFO:tasks.workunit.client.0.smithi063.stdout:9/628: rmdir d0/d13/d39/d42/d57 39 2023-12-07T16:21:45.098 INFO:tasks.workunit.client.0.smithi063.stdout:8/844: symlink d7/d14/d1a/dce/d100/l10f 0 2023-12-07T16:21:45.100 INFO:tasks.workunit.client.1.smithi152.stdout:3/911: getdents d7/d10/d1a 0 2023-12-07T16:21:45.100 INFO:tasks.workunit.client.0.smithi063.stdout:0/709: rename d4/dd/de/d15/d59/da5 to d4/dd/d26/d2b/d5e/d8e/dee 0 2023-12-07T16:21:45.103 INFO:tasks.workunit.client.0.smithi063.stdout:5/630: getdents d1/d3 0 2023-12-07T16:21:45.104 INFO:tasks.workunit.client.1.smithi152.stdout:7/811: rename db/d27/d39/d41/dcb/lf5 to db/d27/l102 0 2023-12-07T16:21:45.104 INFO:tasks.workunit.client.1.smithi152.stdout:7/812: stat db/d27/d5e/fd6 0 2023-12-07T16:21:45.104 INFO:tasks.workunit.client.0.smithi063.stdout:6/694: mkdir d0/d79/db9/df6 0 2023-12-07T16:21:45.105 INFO:tasks.workunit.client.0.smithi063.stdout:5/631: write d1/d3/de/d1e/f47 [715674,27871] 0 2023-12-07T16:21:45.105 INFO:tasks.workunit.client.0.smithi063.stdout:4/525: getdents d1/d3/db/d73 0 2023-12-07T16:21:45.105 INFO:tasks.workunit.client.0.smithi063.stdout:4/526: stat d1/d3/db/d16/f7f 0 2023-12-07T16:21:45.107 INFO:tasks.workunit.client.0.smithi063.stdout:3/646: mknod d7/d9/dd/d60/cd4 0 2023-12-07T16:21:45.108 INFO:tasks.workunit.client.0.smithi063.stdout:9/629: getdents d0/d8d 0 2023-12-07T16:21:45.110 INFO:tasks.workunit.client.1.smithi152.stdout:9/928: rmdir d1/d9/db/df/da6 39 2023-12-07T16:21:45.110 INFO:tasks.workunit.client.0.smithi063.stdout:2/765: rename d0/d67/d65/cab to d0/d21/d56/d11/d52/d63/d8c/db9/cf8 0 2023-12-07T16:21:45.114 INFO:tasks.workunit.client.0.smithi063.stdout:6/695: mkdir d0/d1e/d60/d68/d78/d9c/d9f/df7 0 2023-12-07T16:21:45.115 INFO:tasks.workunit.client.0.smithi063.stdout:2/766: dread d0/d67/fc5 [0,4194304] 0 2023-12-07T16:21:45.117 INFO:tasks.workunit.client.0.smithi063.stdout:5/632: mknod d1/d31/d56/d61/d5e/d6a/cb3 0 2023-12-07T16:21:45.118 INFO:tasks.workunit.client.1.smithi152.stdout:6/834: rmdir d2/d4f/d83/d85/d94/dec 0 2023-12-07T16:21:45.118 INFO:tasks.workunit.client.0.smithi063.stdout:9/630: getdents d0/d21/d64/d6a/d8f/d92 0 2023-12-07T16:21:45.118 INFO:tasks.workunit.client.0.smithi063.stdout:9/631: truncate d0/d13/d39/d42/f77 21636 0 2023-12-07T16:21:45.122 INFO:tasks.workunit.client.1.smithi152.stdout:0/879: truncate d0/d27/d8c/df7/d30/d6e/d77/f96 2890739 0 2023-12-07T16:21:45.122 INFO:tasks.workunit.client.0.smithi063.stdout:6/696: mknod d0/d1e/d20/d4a/cf8 0 2023-12-07T16:21:45.124 INFO:tasks.workunit.client.0.smithi063.stdout:2/767: symlink d0/lf9 0 2023-12-07T16:21:45.124 INFO:tasks.workunit.client.0.smithi063.stdout:2/768: fdatasync d0/d21/d56/d11/d6d/fd8 0 2023-12-07T16:21:45.125 INFO:tasks.workunit.client.0.smithi063.stdout:5/633: rmdir d1/d31/d56/d61/d5e/d6a/d7e 39 2023-12-07T16:21:45.126 INFO:tasks.workunit.client.1.smithi152.stdout:4/821: mkdir d0/d3/d6/d2b/dd9/d3a/d46/d80/df6 0 2023-12-07T16:21:45.126 INFO:tasks.workunit.client.1.smithi152.stdout:4/822: chown d0/d3/d6/d2b/fb5 203 1 2023-12-07T16:21:45.128 INFO:tasks.workunit.client.0.smithi063.stdout:8/845: rename d7/db6/ddb to d7/d14/d110 0 2023-12-07T16:21:45.131 INFO:tasks.workunit.client.1.smithi152.stdout:8/860: stat d3/d1e/d43/c51 0 2023-12-07T16:21:45.133 INFO:tasks.workunit.client.0.smithi063.stdout:6/697: symlink d0/d1e/d60/d68/d78/d9c/d9f/df7/lf9 0 2023-12-07T16:21:45.133 INFO:tasks.workunit.client.1.smithi152.stdout:3/912: rename d7/f8 to d7/d10/d1a/d2f/d5c/dbf/f120 0 2023-12-07T16:21:45.136 INFO:tasks.workunit.client.1.smithi152.stdout:7/813: symlink db/d27/d5e/d45/l103 0 2023-12-07T16:21:45.136 INFO:tasks.workunit.client.1.smithi152.stdout:6/835: creat d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/dfc/f10c x:0 0 0 2023-12-07T16:21:45.139 INFO:tasks.workunit.client.1.smithi152.stdout:0/880: mknod d0/dc/d3d/d4c/c132 0 2023-12-07T16:21:45.140 INFO:tasks.workunit.client.1.smithi152.stdout:4/823: mkdir d0/d3/d6/d36/d85/df7 0 2023-12-07T16:21:45.141 INFO:tasks.workunit.client.1.smithi152.stdout:8/861: symlink d3/d4/d9/dc/d6f/d7b/d7e/d12d/d67/dd4/l140 0 2023-12-07T16:21:45.142 INFO:tasks.workunit.client.1.smithi152.stdout:3/913: truncate d7/d10/d1a/d25/f27 1901434 0 2023-12-07T16:21:45.143 INFO:tasks.workunit.client.1.smithi152.stdout:6/836: mkdir d2/d4f/d83/d58/d10d 0 2023-12-07T16:21:45.144 INFO:tasks.workunit.client.1.smithi152.stdout:0/881: symlink d0/d27/de6/l133 0 2023-12-07T16:21:45.146 INFO:tasks.workunit.client.1.smithi152.stdout:8/862: symlink d3/d1e/d40/l141 0 2023-12-07T16:21:45.146 INFO:tasks.workunit.client.1.smithi152.stdout:8/863: fdatasync d3/d1e/d55/d83/dae/fb4 0 2023-12-07T16:21:45.146 INFO:tasks.workunit.client.1.smithi152.stdout:8/864: readlink d3/d1e/d55/d83/dc5/d123/d125/l47 0 2023-12-07T16:21:45.146 INFO:tasks.workunit.client.1.smithi152.stdout:3/914: mkdir d7/dc/d121 0 2023-12-07T16:21:45.148 INFO:tasks.workunit.client.1.smithi152.stdout:8/865: link d3/d1e/d43/l70 d3/d1e/d40/l142 0 2023-12-07T16:21:45.148 INFO:tasks.workunit.client.1.smithi152.stdout:8/866: write d3/d4/d9/dc/d6f/d7b/dbd/dc4/d13d/ff1 [200438,39974] 0 2023-12-07T16:21:45.154 INFO:tasks.workunit.client.1.smithi152.stdout:9/929: dwrite d1/d9/f20 [8388608,4194304] 0 2023-12-07T16:21:45.154 INFO:tasks.workunit.client.0.smithi063.stdout:9/632: dwrite d0/d21/d64/d6a/d8f/d92/f9a [0,4194304] 0 2023-12-07T16:21:45.155 INFO:tasks.workunit.client.0.smithi063.stdout:8/846: dwrite d7/d14/f27 [0,4194304] 0 2023-12-07T16:21:45.155 INFO:tasks.workunit.client.0.smithi063.stdout:8/847: truncate d7/d14/d15/dac/fc6 1224206 0 2023-12-07T16:21:45.156 INFO:tasks.workunit.client.1.smithi152.stdout:4/824: dread d0/d3/d6/d2b/dd9/d39/f5e [0,4194304] 0 2023-12-07T16:21:45.158 INFO:tasks.workunit.client.0.smithi063.stdout:9/633: rename d0/d8d/lc3 to d0/d13/d6f/d9b/lce 0 2023-12-07T16:21:45.159 INFO:tasks.workunit.client.1.smithi152.stdout:4/825: rmdir d0/d3/d6/d2b/db1/ddd 39 2023-12-07T16:21:45.160 INFO:tasks.workunit.client.1.smithi152.stdout:9/930: symlink d1/d9/db/l12e 0 2023-12-07T16:21:45.161 INFO:tasks.workunit.client.0.smithi063.stdout:8/848: rename d7/d14/d15/d2b/ce4 to d7/d14/d1a/dce/d100/d103/c111 0 2023-12-07T16:21:45.161 INFO:tasks.workunit.client.0.smithi063.stdout:9/634: dread d0/d13/d39/d42/d57/fb9 [0,4194304] 0 2023-12-07T16:21:45.161 INFO:tasks.workunit.client.1.smithi152.stdout:4/826: rmdir d0/d3/d6/d2b/dd9/d39/d93 39 2023-12-07T16:21:45.163 INFO:tasks.workunit.client.1.smithi152.stdout:9/931: creat d1/d9/db/df/da6/da2/f12f x:0 0 0 2023-12-07T16:21:45.163 INFO:tasks.workunit.client.0.smithi063.stdout:8/849: mkdir d7/d14/d1a/d112 0 2023-12-07T16:21:45.164 INFO:tasks.workunit.client.0.smithi063.stdout:9/635: mknod d0/d21/d64/d6a/d85/da4/ccf 0 2023-12-07T16:21:45.164 INFO:tasks.workunit.client.0.smithi063.stdout:9/636: truncate d0/d13/fb4 285128 0 2023-12-07T16:21:45.166 INFO:tasks.workunit.client.1.smithi152.stdout:4/827: rename d0/d3/d6/d2b/dd9/d3a/d46/d4e/c7d to d0/d3/d6/d2b/dd9/d3a/d48/d4c/cf8 0 2023-12-07T16:21:45.167 INFO:tasks.workunit.client.1.smithi152.stdout:0/882: dwrite d0/d27/d8c/df7/d30/f4a [0,4194304] 0 2023-12-07T16:21:45.167 INFO:tasks.workunit.client.1.smithi152.stdout:0/883: fdatasync d0/dc/d36/d3a/d69/f99 0 2023-12-07T16:21:45.168 INFO:tasks.workunit.client.0.smithi063.stdout:8/850: read d7/d14/d15/d57/f6f [1873567,118975] 0 2023-12-07T16:21:45.172 INFO:tasks.workunit.client.0.smithi063.stdout:8/851: creat d7/d14/d15/d48/f113 x:0 0 0 2023-12-07T16:21:45.172 INFO:tasks.workunit.client.0.smithi063.stdout:8/852: fsync d7/d14/d1a/f33 0 2023-12-07T16:21:45.172 INFO:tasks.workunit.client.1.smithi152.stdout:9/932: rename d1/d9/d2d/l44 to d1/d17/d3c/d4a/d48/d8c/l130 0 2023-12-07T16:21:45.173 INFO:tasks.workunit.client.1.smithi152.stdout:0/884: symlink d0/dc/d36/d7d/d92/l134 0 2023-12-07T16:21:45.173 INFO:tasks.workunit.client.1.smithi152.stdout:0/885: dread - d0/dc/d36/d3a/d51/d82/fb9 zero size 2023-12-07T16:21:45.174 INFO:tasks.workunit.client.1.smithi152.stdout:9/933: creat d1/d9/db/f131 x:0 0 0 2023-12-07T16:21:45.175 INFO:tasks.workunit.client.1.smithi152.stdout:0/886: mkdir d0/d27/d8c/df7/d30/d6e/d77/d113/d135 0 2023-12-07T16:21:45.180 INFO:tasks.workunit.client.1.smithi152.stdout:0/887: rename d0/d27/d8c/df7/d30/d6e/d77/d9f to d0/dc/d36/d7d/d136 0 2023-12-07T16:21:45.181 INFO:tasks.workunit.client.1.smithi152.stdout:3/915: dwrite d7/d10/d1a/f117 [0,4194304] 0 2023-12-07T16:21:45.182 INFO:tasks.workunit.client.0.smithi063.stdout:9/637: dwrite d0/d21/d64/d6a/d85/da4/f58 [0,4194304] 0 2023-12-07T16:21:45.182 INFO:tasks.workunit.client.1.smithi152.stdout:2/831: sync 2023-12-07T16:21:45.184 INFO:tasks.workunit.client.1.smithi152.stdout:0/888: rename d0/dc/d26/cf1 to d0/dc/d36/d7d/d92/c137 0 2023-12-07T16:21:45.186 INFO:tasks.workunit.client.0.smithi063.stdout:9/638: symlink d0/d21/d64/d6a/d8f/ld0 0 2023-12-07T16:21:45.188 INFO:tasks.workunit.client.1.smithi152.stdout:4/828: rmdir d0/d3 39 2023-12-07T16:21:45.188 INFO:tasks.workunit.client.1.smithi152.stdout:3/916: creat d7/f122 x:0 0 0 2023-12-07T16:21:45.188 INFO:tasks.workunit.client.0.smithi063.stdout:8/853: dread d7/d14/d15/d2b/fae [0,4194304] 0 2023-12-07T16:21:45.188 INFO:tasks.workunit.client.0.smithi063.stdout:8/854: chown d7/d14/d15/d57/f97 0 1 2023-12-07T16:21:45.189 INFO:tasks.workunit.client.0.smithi063.stdout:8/855: write d7/d14/d15/d48/f113 [97570,65038] 0 2023-12-07T16:21:45.189 INFO:tasks.workunit.client.1.smithi152.stdout:2/832: creat d2/d1c/d52/da8/f117 x:0 0 0 2023-12-07T16:21:45.189 INFO:tasks.workunit.client.1.smithi152.stdout:2/833: getdents d2/d56/d10a 0 2023-12-07T16:21:45.189 INFO:tasks.workunit.client.1.smithi152.stdout:2/834: chown d2/l12 395578 1 2023-12-07T16:21:45.193 INFO:tasks.workunit.client.1.smithi152.stdout:0/889: creat d0/dc/d3d/d73/f138 x:0 0 0 2023-12-07T16:21:45.193 INFO:tasks.workunit.client.1.smithi152.stdout:0/890: fdatasync d0/d27/d8c/df7/f35 0 2023-12-07T16:21:45.193 INFO:tasks.workunit.client.1.smithi152.stdout:0/891: write d0/dc/d3d/d73/fd2 [28851,95170] 0 2023-12-07T16:21:45.194 INFO:tasks.workunit.client.0.smithi063.stdout:8/856: getdents d7/d38/d8e 0 2023-12-07T16:21:45.194 INFO:tasks.workunit.client.1.smithi152.stdout:4/829: getdents d0/d3/d6/d2b/dd9/db7/ddc 0 2023-12-07T16:21:45.195 INFO:tasks.workunit.client.0.smithi063.stdout:8/857: mknod d7/d14/d15/dde/da8/c114 0 2023-12-07T16:21:45.195 INFO:tasks.workunit.client.1.smithi152.stdout:2/835: getdents d2/d1c/d2e/d57/d5b 0 2023-12-07T16:21:45.196 INFO:tasks.workunit.client.0.smithi063.stdout:8/858: rmdir d7/d38/df1 39 2023-12-07T16:21:45.199 INFO:tasks.workunit.client.1.smithi152.stdout:0/892: mkdir d0/dc/d3d/dab/dc8/d129/d139 0 2023-12-07T16:21:45.199 INFO:tasks.workunit.client.1.smithi152.stdout:0/893: chown d0/dc/d3d/d4c/fa1 127331 1 2023-12-07T16:21:45.200 INFO:tasks.workunit.client.1.smithi152.stdout:8/867: dread d3/d4/d4b/f4f [0,4194304] 0 2023-12-07T16:21:45.200 INFO:tasks.workunit.client.1.smithi152.stdout:0/894: write d0/f1a [502129,95385] 0 2023-12-07T16:21:45.201 INFO:tasks.workunit.client.1.smithi152.stdout:0/895: dread - d0/dc/d36/d3a/d51/fc6 zero size 2023-12-07T16:21:45.201 INFO:tasks.workunit.client.1.smithi152.stdout:0/896: readlink d0/d27/d8c/df7/l62 0 2023-12-07T16:21:45.202 INFO:tasks.workunit.client.1.smithi152.stdout:4/830: unlink d0/d3/d6/d2b/dd9/d3a/d46/d80/cec 0 2023-12-07T16:21:45.204 INFO:tasks.workunit.client.1.smithi152.stdout:2/836: mknod d2/d1c/c118 0 2023-12-07T16:21:45.205 INFO:tasks.workunit.client.1.smithi152.stdout:0/897: mkdir d0/d27/d8c/d13a 0 2023-12-07T16:21:45.207 INFO:tasks.workunit.client.1.smithi152.stdout:4/831: symlink d0/d17/d7f/lf9 0 2023-12-07T16:21:45.207 INFO:tasks.workunit.client.1.smithi152.stdout:2/837: stat d2/d1c/d2e/d5d/dab/dd9/fe4 0 2023-12-07T16:21:45.210 INFO:tasks.workunit.client.1.smithi152.stdout:3/917: read d7/d10/d1a/d2f/d56/d57/dee/dda/d7d/f99 [833564,82241] 0 2023-12-07T16:21:45.210 INFO:tasks.workunit.client.1.smithi152.stdout:3/918: readlink d7/dc/l50 0 2023-12-07T16:21:45.211 INFO:tasks.workunit.client.1.smithi152.stdout:3/919: stat d7/d10/d1a 0 2023-12-07T16:21:45.211 INFO:tasks.workunit.client.1.smithi152.stdout:3/920: fsync f3 0 2023-12-07T16:21:45.211 INFO:tasks.workunit.client.1.smithi152.stdout:3/921: fdatasync d7/d10/d1a/d2f/d56/d57/faa 0 2023-12-07T16:21:45.211 INFO:tasks.workunit.client.1.smithi152.stdout:3/922: write d7/d10/d1a/d2f/f26 [4915901,110986] 0 2023-12-07T16:21:45.211 INFO:tasks.workunit.client.1.smithi152.stdout:3/923: stat d7/d10/d1a/d2f/d56/d57/dee/dda/f112 0 2023-12-07T16:21:45.211 INFO:tasks.workunit.client.1.smithi152.stdout:4/832: truncate d0/d3/d6/f8a 864042 0 2023-12-07T16:21:45.211 INFO:tasks.workunit.client.1.smithi152.stdout:2/838: write d2/d1c/d2e/d57/db1/d90/f36 [3818553,122833] 0 2023-12-07T16:21:45.212 INFO:tasks.workunit.client.1.smithi152.stdout:2/839: chown d2/d1c/fc8 26700710 1 2023-12-07T16:21:45.213 INFO:tasks.workunit.client.1.smithi152.stdout:3/924: dread d7/dc/fa9 [0,4194304] 0 2023-12-07T16:21:45.216 INFO:tasks.workunit.client.1.smithi152.stdout:2/840: write d2/d1c/d52/da8/ff4 [168713,106229] 0 2023-12-07T16:21:45.217 INFO:tasks.workunit.client.1.smithi152.stdout:4/833: creat d0/d3/d6/d2b/dd9/d39/d93/ffa x:0 0 0 2023-12-07T16:21:45.222 INFO:tasks.workunit.client.1.smithi152.stdout:7/814: dwrite db/d27/d39/f6a [0,4194304] 0 2023-12-07T16:21:45.223 INFO:tasks.workunit.client.0.smithi063.stdout:3/647: dwrite d7/d9/d1b/f38 [0,4194304] 0 2023-12-07T16:21:45.223 INFO:tasks.workunit.client.0.smithi063.stdout:4/527: dwrite d1/d3/d3f/d44/f70 [0,4194304] 0 2023-12-07T16:21:45.225 INFO:tasks.workunit.client.1.smithi152.stdout:2/841: rename d2/d105 to d2/d1c/d2e/d57/d5b/da7/d9a/da6/d119 0 2023-12-07T16:21:45.227 INFO:tasks.workunit.client.0.smithi063.stdout:9/639: dwrite d0/f86 [0,4194304] 0 2023-12-07T16:21:45.229 INFO:tasks.workunit.client.0.smithi063.stdout:3/648: creat d7/d49/d4b/fd5 x:0 0 0 2023-12-07T16:21:45.229 INFO:tasks.workunit.client.1.smithi152.stdout:7/815: mkdir db/d27/d5e/d104 0 2023-12-07T16:21:45.229 INFO:tasks.workunit.client.1.smithi152.stdout:7/816: stat db/d1c/c1a 0 2023-12-07T16:21:45.229 INFO:tasks.workunit.client.1.smithi152.stdout:7/817: stat db/d27/d39/d41/d58/da5/ff1 0 2023-12-07T16:21:45.229 INFO:tasks.workunit.client.1.smithi152.stdout:2/842: mknod d2/d9/d51/d54/d5c/d112/c11a 0 2023-12-07T16:21:45.230 INFO:tasks.workunit.client.0.smithi063.stdout:4/528: mknod d1/d3/d3f/d49/d64/c9e 0 2023-12-07T16:21:45.230 INFO:tasks.workunit.client.0.smithi063.stdout:4/529: fdatasync d1/d3/db/d73/f96 0 2023-12-07T16:21:45.231 INFO:tasks.workunit.client.1.smithi152.stdout:7/818: symlink db/d1c/l105 0 2023-12-07T16:21:45.232 INFO:tasks.workunit.client.0.smithi063.stdout:9/640: creat d0/d13/d39/fd1 x:0 0 0 2023-12-07T16:21:45.232 INFO:tasks.workunit.client.0.smithi063.stdout:4/530: mkdir d1/d3/d9f 0 2023-12-07T16:21:45.232 INFO:tasks.workunit.client.0.smithi063.stdout:4/531: fsync d1/d3/db/d73/f78 0 2023-12-07T16:21:45.232 INFO:tasks.workunit.client.0.smithi063.stdout:4/532: write d1/d3/db/d2c/d63/d62/f8a [991095,3841] 0 2023-12-07T16:21:45.238 INFO:tasks.workunit.client.0.smithi063.stdout:4/533: write d1/d3/f1e [6661748,39585] 0 2023-12-07T16:21:45.241 INFO:tasks.workunit.client.0.smithi063.stdout:4/534: unlink d1/c14 0 2023-12-07T16:21:45.242 INFO:tasks.workunit.client.0.smithi063.stdout:4/535: mkdir d1/d3/d3f/d44/da0 0 2023-12-07T16:21:45.245 INFO:tasks.workunit.client.0.smithi063.stdout:9/641: dread d0/d21/d64/d6a/d85/da4/f2a [0,4194304] 0 2023-12-07T16:21:45.245 INFO:tasks.workunit.client.0.smithi063.stdout:9/642: chown d0/d13/d39/f48 109360 1 2023-12-07T16:21:45.246 INFO:tasks.workunit.client.0.smithi063.stdout:9/643: mkdir d0/d13/dd2 0 2023-12-07T16:21:45.247 INFO:tasks.workunit.client.0.smithi063.stdout:9/644: truncate d0/d21/d64/d6a/d8f/d92/f9a 435825 0 2023-12-07T16:21:45.247 INFO:tasks.workunit.client.1.smithi152.stdout:6/837: dwrite d2/f4 [0,4194304] 0 2023-12-07T16:21:45.248 INFO:tasks.workunit.client.1.smithi152.stdout:6/838: symlink d2/d4f/d83/d85/d94/l10e 0 2023-12-07T16:21:45.254 INFO:tasks.workunit.client.1.smithi152.stdout:9/934: dwrite d1/d9/ff7 [0,4194304] 0 2023-12-07T16:21:45.258 INFO:tasks.workunit.client.0.smithi063.stdout:4/536: dread d1/d3/db/d41/f6b [0,4194304] 0 2023-12-07T16:21:45.262 INFO:tasks.workunit.client.1.smithi152.stdout:4/834: dwrite d0/d81/fc6 [4194304,4194304] 0 2023-12-07T16:21:45.262 INFO:tasks.workunit.client.1.smithi152.stdout:4/835: write d0/d3/d6/d2b/dd9/d3a/d48/d4c/fa8 [845621,9138] 0 2023-12-07T16:21:45.262 INFO:tasks.workunit.client.1.smithi152.stdout:4/836: readlink d0/d3/d6/d2b/db1/lc3 0 2023-12-07T16:21:45.262 INFO:tasks.workunit.client.0.smithi063.stdout:3/649: dwrite d7/d9/d1b/d5c/f91 [0,4194304] 0 2023-12-07T16:21:45.263 INFO:tasks.workunit.client.0.smithi063.stdout:3/650: stat d7/d4f/d53/d72/db1/d41/f5a 0 2023-12-07T16:21:45.263 INFO:tasks.workunit.client.1.smithi152.stdout:9/935: mknod d1/d17/d4e/c132 0 2023-12-07T16:21:45.263 INFO:tasks.workunit.client.1.smithi152.stdout:9/936: fdatasync d1/f114 0 2023-12-07T16:21:45.265 INFO:tasks.workunit.client.1.smithi152.stdout:4/837: creat d0/d3/d6/d2b/dd9/d3a/d48/d4c/ffb x:0 0 0 2023-12-07T16:21:45.268 INFO:tasks.workunit.client.1.smithi152.stdout:9/937: mknod d1/d9/db/df/c133 0 2023-12-07T16:21:45.268 INFO:tasks.workunit.client.1.smithi152.stdout:9/938: chown d1/d17/d3c 2475741 1 2023-12-07T16:21:45.269 INFO:tasks.workunit.client.0.smithi063.stdout:4/537: creat d1/d3/d51/fa1 x:0 0 0 2023-12-07T16:21:45.269 INFO:tasks.workunit.client.0.smithi063.stdout:8/859: dwrite d7/d14/d1a/dce/f10d [0,4194304] 0 2023-12-07T16:21:45.269 INFO:tasks.workunit.client.1.smithi152.stdout:0/898: dwrite d0/dc/d36/d3a/dca/f111 [0,4194304] 0 2023-12-07T16:21:45.269 INFO:tasks.workunit.client.1.smithi152.stdout:0/899: truncate d0/f1a 1187916 0 2023-12-07T16:21:45.269 INFO:tasks.workunit.client.1.smithi152.stdout:0/900: chown d0/dc/d3d/d73/d128/c13 0 1 2023-12-07T16:21:45.271 INFO:tasks.workunit.client.1.smithi152.stdout:4/838: creat d0/d3/d6/d2b/ffc x:0 0 0 2023-12-07T16:21:45.271 INFO:tasks.workunit.client.1.smithi152.stdout:4/839: fdatasync d0/d3/d6/d2b/fa1 0 2023-12-07T16:21:45.274 INFO:tasks.workunit.client.1.smithi152.stdout:4/840: symlink d0/d3/d6/d2b/dd9/d3a/d46/d9b/lfd 0 2023-12-07T16:21:45.275 INFO:tasks.workunit.client.1.smithi152.stdout:7/819: dwrite db/d27/fb4 [0,4194304] 0 2023-12-07T16:21:45.275 INFO:tasks.workunit.client.1.smithi152.stdout:7/820: readlink db/d27/d5e/d45/l103 0 2023-12-07T16:21:45.275 INFO:tasks.workunit.client.1.smithi152.stdout:4/841: mknod d0/d3/d6/d36/cfe 0 2023-12-07T16:21:45.276 INFO:tasks.workunit.client.1.smithi152.stdout:4/842: write d0/d3/d6/d2b/dd9/d39/d93/f6c [4708702,26234] 0 2023-12-07T16:21:45.276 INFO:tasks.workunit.client.1.smithi152.stdout:6/839: dwrite d2/f2a [0,4194304] 0 2023-12-07T16:21:45.278 INFO:tasks.workunit.client.1.smithi152.stdout:3/925: dwrite d7/d10/d1a/d25/d3f/f51 [0,4194304] 0 2023-12-07T16:21:45.278 INFO:tasks.workunit.client.1.smithi152.stdout:3/926: read d7/d10/d1a/d2f/d56/d57/dee/dda/f5e [364340,78309] 0 2023-12-07T16:21:45.279 INFO:tasks.workunit.client.0.smithi063.stdout:4/538: creat d1/d3/d3f/d49/fa2 x:0 0 0 2023-12-07T16:21:45.280 INFO:tasks.workunit.client.1.smithi152.stdout:7/821: mkdir db/d27/d5e/d104/d106 0 2023-12-07T16:21:45.280 INFO:tasks.workunit.client.1.smithi152.stdout:4/843: creat d0/d3/d6/d2b/d56/d83/fff x:0 0 0 2023-12-07T16:21:45.280 INFO:tasks.workunit.client.1.smithi152.stdout:4/844: readlink d0/d3/d6/d2b/d56/lb8 0 2023-12-07T16:21:45.280 INFO:tasks.workunit.client.1.smithi152.stdout:4/845: chown d0/d3/d6/d2b/d75/f8f 239606430 1 2023-12-07T16:21:45.282 INFO:tasks.workunit.client.1.smithi152.stdout:9/939: dread d1/f49 [0,4194304] 0 2023-12-07T16:21:45.282 INFO:tasks.workunit.client.1.smithi152.stdout:9/940: truncate d1/dd/f5c 1633985 0 2023-12-07T16:21:45.282 INFO:tasks.workunit.client.1.smithi152.stdout:3/927: read d7/d10/f91 [210984,79177] 0 2023-12-07T16:21:45.283 INFO:tasks.workunit.client.1.smithi152.stdout:6/840: rename d2/d4f/d83/d85/d94/fc2 to d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/da1/db5/dc1/f10f 0 2023-12-07T16:21:45.283 INFO:tasks.workunit.client.0.smithi063.stdout:3/651: dwrite d7/d21/fbd [0,4194304] 0 2023-12-07T16:21:45.285 INFO:tasks.workunit.client.1.smithi152.stdout:7/822: creat db/d68/f107 x:0 0 0 2023-12-07T16:21:45.286 INFO:tasks.workunit.client.1.smithi152.stdout:4/846: creat d0/d3/d6/d2b/dd9/d3a/d48/d4c/f100 x:0 0 0 2023-12-07T16:21:45.286 INFO:tasks.workunit.client.1.smithi152.stdout:3/928: mknod d7/d10/d41/d61/c123 0 2023-12-07T16:21:45.286 INFO:tasks.workunit.client.1.smithi152.stdout:9/941: write d1/d17/d3c/d4a/d7e/f9b [256306,117016] 0 2023-12-07T16:21:45.286 INFO:tasks.workunit.client.0.smithi063.stdout:9/645: getdents d0/d13/d39 0 2023-12-07T16:21:45.287 INFO:tasks.workunit.client.0.smithi063.stdout:9/646: read - d0/d21/d64/d6a/d8f/d92/fcd zero size 2023-12-07T16:21:45.290 INFO:tasks.workunit.client.1.smithi152.stdout:9/942: creat d1/d17/d58/d86/f134 x:0 0 0 2023-12-07T16:21:45.290 INFO:tasks.workunit.client.0.smithi063.stdout:4/539: rmdir d1/d3/d3a 39 2023-12-07T16:21:45.292 INFO:tasks.workunit.client.1.smithi152.stdout:4/847: mknod d0/d3/d6/de6/c101 0 2023-12-07T16:21:45.293 INFO:tasks.workunit.client.1.smithi152.stdout:4/848: chown d0/d3/d6/d2b/dd9/d22/lb3 4682493 1 2023-12-07T16:21:45.293 INFO:tasks.workunit.client.1.smithi152.stdout:0/901: dwrite d0/d27/d8c/f8d [0,4194304] 0 2023-12-07T16:21:45.293 INFO:tasks.workunit.client.1.smithi152.stdout:0/902: chown d0/dc/d36/d3a/d69/lf6 1603101273 1 2023-12-07T16:21:45.293 INFO:tasks.workunit.client.0.smithi063.stdout:3/652: dread d7/d9/d1b/d5c/f91 [0,4194304] 0 2023-12-07T16:21:45.296 INFO:tasks.workunit.client.0.smithi063.stdout:9/647: mknod d0/d13/d39/cd3 0 2023-12-07T16:21:45.296 INFO:tasks.workunit.client.1.smithi152.stdout:3/929: symlink d7/d10/d1a/d2f/d5c/df6/d100/l124 0 2023-12-07T16:21:45.297 INFO:tasks.workunit.client.0.smithi063.stdout:4/540: creat d1/d3/db/d2c/fa3 x:0 0 0 2023-12-07T16:21:45.298 INFO:tasks.workunit.client.0.smithi063.stdout:4/541: write d1/d3/db/d2c/f91 [719779,78766] 0 2023-12-07T16:21:45.298 INFO:tasks.workunit.client.0.smithi063.stdout:3/653: creat d7/d49/d4b/fd6 x:0 0 0 2023-12-07T16:21:45.298 INFO:tasks.workunit.client.0.smithi063.stdout:9/648: symlink d0/d13/d39/d3a/d78/ld4 0 2023-12-07T16:21:45.300 INFO:tasks.workunit.client.1.smithi152.stdout:9/943: rename d1/d9/db/df/f43 to d1/d9/db/df/da6/da2/de9/f135 0 2023-12-07T16:21:45.300 INFO:tasks.workunit.client.0.smithi063.stdout:4/542: getdents d1/d3/d3f/d44 0 2023-12-07T16:21:45.302 INFO:tasks.workunit.client.0.smithi063.stdout:9/649: creat d0/d13/d6f/daf/dbc/fd5 x:0 0 0 2023-12-07T16:21:45.303 INFO:tasks.workunit.client.0.smithi063.stdout:4/543: getdents d1/d3/d51 0 2023-12-07T16:21:45.303 INFO:tasks.workunit.client.0.smithi063.stdout:8/860: truncate d7/d14/d1a/dce/f10d 4046956 0 2023-12-07T16:21:45.304 INFO:tasks.workunit.client.0.smithi063.stdout:8/861: chown d7/d14/d15/db4 9 1 2023-12-07T16:21:45.308 INFO:tasks.workunit.client.1.smithi152.stdout:4/849: unlink d0/d3/d6/d2b/dd9/d3a/d46/d4e/cbc 0 2023-12-07T16:21:45.308 INFO:tasks.workunit.client.1.smithi152.stdout:3/930: creat d7/d10/d1a/d2f/d5c/df6/d6d/d98/f125 x:0 0 0 2023-12-07T16:21:45.310 INFO:tasks.workunit.client.1.smithi152.stdout:6/841: dwrite d2/d4f/d83/d85/d19/fca [0,4194304] 0 2023-12-07T16:21:45.310 INFO:tasks.workunit.client.0.smithi063.stdout:8/862: write d7/d14/d15/f68 [408098,81744] 0 2023-12-07T16:21:45.311 INFO:tasks.workunit.client.0.smithi063.stdout:8/863: write d7/d14/d15/d2b/fae [4780823,58276] 0 2023-12-07T16:21:45.313 INFO:tasks.workunit.client.1.smithi152.stdout:4/850: dread d0/d3/d6/d2b/dd9/d3a/d46/d4e/f84 [0,4194304] 0 2023-12-07T16:21:45.314 INFO:tasks.workunit.client.0.smithi063.stdout:8/864: rename d7/d38/d8e/lbf to d7/d14/d15/dde/d63/d75/d98/de8/l115 0 2023-12-07T16:21:45.316 INFO:tasks.workunit.client.0.smithi063.stdout:8/865: dread d7/d14/d15/f2d [0,4194304] 0 2023-12-07T16:21:45.319 INFO:tasks.workunit.client.1.smithi152.stdout:7/823: dwrite db/d1c/f51 [4194304,4194304] 0 2023-12-07T16:21:45.319 INFO:tasks.workunit.client.1.smithi152.stdout:7/824: fsync db/d27/d39/f9f 0 2023-12-07T16:21:45.320 INFO:tasks.workunit.client.1.smithi152.stdout:7/825: write db/f5d [576718,42397] 0 2023-12-07T16:21:45.322 INFO:tasks.workunit.client.0.smithi063.stdout:8/866: getdents d7/d14/d15/dde/d63/d75/d98/de8 0 2023-12-07T16:21:45.323 INFO:tasks.workunit.client.1.smithi152.stdout:3/931: creat d7/d10/d1a/de8/f126 x:0 0 0 2023-12-07T16:21:45.323 INFO:tasks.workunit.client.1.smithi152.stdout:3/932: fsync d7/d10/d1a/d2f/d56/d57/dee/dda/d6b/fac 0 2023-12-07T16:21:45.325 INFO:tasks.workunit.client.0.smithi063.stdout:4/544: dread d1/d3/db/d2c/d63/d62/f7e [0,4194304] 0 2023-12-07T16:21:45.328 INFO:tasks.workunit.client.1.smithi152.stdout:9/944: mkdir d1/d9/d2d/d46/d9a/d136 0 2023-12-07T16:21:45.329 INFO:tasks.workunit.client.0.smithi063.stdout:4/545: creat d1/d3/d3f/d49/d8b/fa4 x:0 0 0 2023-12-07T16:21:45.329 INFO:tasks.workunit.client.0.smithi063.stdout:4/546: readlink d1/l6f 0 2023-12-07T16:21:45.330 INFO:tasks.workunit.client.1.smithi152.stdout:4/851: symlink d0/d3/d6/d2b/dd9/db7/ddc/l102 0 2023-12-07T16:21:45.330 INFO:tasks.workunit.client.1.smithi152.stdout:4/852: fsync d0/daa/f42 0 2023-12-07T16:21:45.330 INFO:tasks.workunit.client.0.smithi063.stdout:4/547: mknod d1/d3/d3f/d44/ca5 0 2023-12-07T16:21:45.333 INFO:tasks.workunit.client.1.smithi152.stdout:7/826: mkdir db/d27/d4d/d108 0 2023-12-07T16:21:45.335 INFO:tasks.workunit.client.1.smithi152.stdout:9/945: truncate d1/d17/d58/d86/dd9/f11d 3147364 0 2023-12-07T16:21:45.336 INFO:tasks.workunit.client.0.smithi063.stdout:3/654: dwrite d7/d9/dd/f1f [0,4194304] 0 2023-12-07T16:21:45.336 INFO:tasks.workunit.client.0.smithi063.stdout:3/655: write d7/d9/dd/fbb [1004402,97290] 0 2023-12-07T16:21:45.339 INFO:tasks.workunit.client.1.smithi152.stdout:4/853: mkdir d0/d3/d6/d2b/dd9/d3a/d48/d103 0 2023-12-07T16:21:45.340 INFO:tasks.workunit.client.0.smithi063.stdout:8/867: dread d7/d14/d1a/fc8 [4194304,4194304] 0 2023-12-07T16:21:45.342 INFO:tasks.workunit.client.1.smithi152.stdout:6/842: dwrite d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/f41 [0,4194304] 0 2023-12-07T16:21:45.344 INFO:tasks.workunit.client.1.smithi152.stdout:4/854: truncate d0/d3/d6/d2b/dd9/d39/d93/f33 834484 0 2023-12-07T16:21:45.344 INFO:tasks.workunit.client.1.smithi152.stdout:4/855: read - d0/d17/d7f/fc2 zero size 2023-12-07T16:21:45.345 INFO:tasks.workunit.client.1.smithi152.stdout:6/843: creat d2/d4f/d83/d85/d19/d1f/f110 x:0 0 0 2023-12-07T16:21:45.346 INFO:tasks.workunit.client.1.smithi152.stdout:4/856: read d0/d3/d6/d2b/d56/f70 [1387155,44834] 0 2023-12-07T16:21:45.353 INFO:tasks.workunit.client.1.smithi152.stdout:4/857: unlink d0/d17/d7f/fee 0 2023-12-07T16:21:45.354 INFO:tasks.workunit.client.1.smithi152.stdout:6/844: creat d2/d4f/d83/d48/da8/f111 x:0 0 0 2023-12-07T16:21:45.355 INFO:tasks.workunit.client.1.smithi152.stdout:6/845: creat d2/d4f/d83/d48/d70/d81/f112 x:0 0 0 2023-12-07T16:21:45.366 INFO:tasks.workunit.client.1.smithi152.stdout:4/858: write d0/d3/f37 [5389316,124679] 0 2023-12-07T16:21:45.366 INFO:tasks.workunit.client.1.smithi152.stdout:4/859: fdatasync d0/d3/d6/d2b/dd9/d39/d93/f6c 0 2023-12-07T16:21:45.377 INFO:tasks.workunit.client.0.smithi063.stdout:4/548: dwrite d1/d3/d3f/d49/d64/f74 [4194304,4194304] 0 2023-12-07T16:21:45.379 INFO:tasks.workunit.client.0.smithi063.stdout:4/549: read d1/d3/db/d73/f78 [785888,16767] 0 2023-12-07T16:21:45.380 INFO:tasks.workunit.client.0.smithi063.stdout:4/550: truncate d1/d3/d3a/f9b 13789 0 2023-12-07T16:21:45.383 INFO:tasks.workunit.client.1.smithi152.stdout:6/846: dwrite d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/d5d/f9b [0,4194304] 0 2023-12-07T16:21:45.384 INFO:tasks.workunit.client.0.smithi063.stdout:4/551: rename d1/d3/db/f4f to d1/d3/d3f/d49/d64/d80/fa6 0 2023-12-07T16:21:45.384 INFO:tasks.workunit.client.0.smithi063.stdout:4/552: write d1/d3/d3f/f9a [1031435,62357] 0 2023-12-07T16:21:45.390 INFO:tasks.workunit.client.1.smithi152.stdout:6/847: creat d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/d55/f113 x:0 0 0 2023-12-07T16:21:45.390 INFO:tasks.workunit.client.1.smithi152.stdout:6/848: chown d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/f4e 728212 1 2023-12-07T16:21:45.391 INFO:tasks.workunit.client.1.smithi152.stdout:4/860: dwrite d0/d3/d6/d2b/dd9/d39/f92 [0,4194304] 0 2023-12-07T16:21:45.394 INFO:tasks.workunit.client.1.smithi152.stdout:3/933: dwrite d7/d10/d1a/d25/d3f/f51 [0,4194304] 0 2023-12-07T16:21:45.394 INFO:tasks.workunit.client.1.smithi152.stdout:4/861: write d0/d3/d6/d2b/dd9/d39/d93/f6c [2257525,60247] 0 2023-12-07T16:21:45.395 INFO:tasks.workunit.client.0.smithi063.stdout:8/868: dwrite d7/d14/d15/d2b/fe2 [0,4194304] 0 2023-12-07T16:21:45.396 INFO:tasks.workunit.client.0.smithi063.stdout:8/869: truncate d7/d14/f28 1033996 0 2023-12-07T16:21:45.396 INFO:tasks.workunit.client.0.smithi063.stdout:8/870: readlink d7/d14/ld7 0 2023-12-07T16:21:45.396 INFO:tasks.workunit.client.1.smithi152.stdout:9/946: dwrite d1/d9/db/df/da6/da2/de9/f135 [0,4194304] 0 2023-12-07T16:21:45.397 INFO:tasks.workunit.client.0.smithi063.stdout:3/656: dwrite d7/d9/d1b/fc6 [0,4194304] 0 2023-12-07T16:21:45.397 INFO:tasks.workunit.client.0.smithi063.stdout:3/657: stat d7/d9/d1b 0 2023-12-07T16:21:45.397 INFO:tasks.workunit.client.0.smithi063.stdout:3/658: chown d7/d49/fb4 61102428 1 2023-12-07T16:21:45.398 INFO:tasks.workunit.client.0.smithi063.stdout:8/871: mknod d7/d14/c116 0 2023-12-07T16:21:45.401 INFO:tasks.workunit.client.1.smithi152.stdout:6/849: dread d2/f5 [4194304,4194304] 0 2023-12-07T16:21:45.402 INFO:tasks.workunit.client.1.smithi152.stdout:3/934: dread d7/d10/d1a/d25/f27 [0,4194304] 0 2023-12-07T16:21:45.402 INFO:tasks.workunit.client.1.smithi152.stdout:3/935: chown d7/d10/d1a/d25/d3f/dcf/dab/ffc 64 1 2023-12-07T16:21:45.403 INFO:tasks.workunit.client.0.smithi063.stdout:3/659: rename d7/d21/f69 to d7/d9/d1b/fd7 0 2023-12-07T16:21:45.403 INFO:tasks.workunit.client.0.smithi063.stdout:8/872: mknod d7/d14/d1a/dce/c117 0 2023-12-07T16:21:45.403 INFO:tasks.workunit.client.1.smithi152.stdout:9/947: write d1/d17/d3c/d4a/d7e/f9b [1654435,123070] 0 2023-12-07T16:21:45.403 INFO:tasks.workunit.client.1.smithi152.stdout:9/948: truncate d1/d9/d2d/d72/d80/da4/ffc 926354 0 2023-12-07T16:21:45.404 INFO:tasks.workunit.client.1.smithi152.stdout:6/850: mknod d2/d4f/d83/d85/c114 0 2023-12-07T16:21:45.405 INFO:tasks.workunit.client.1.smithi152.stdout:3/936: mknod d7/d10/d1a/c127 0 2023-12-07T16:21:45.406 INFO:tasks.workunit.client.0.smithi063.stdout:4/553: dread d1/d3/f1e [0,4194304] 0 2023-12-07T16:21:45.408 INFO:tasks.workunit.client.1.smithi152.stdout:9/949: rename d1/d9/d2d/d65/f6f to d1/d9/d2d/d46/d9a/d136/f137 0 2023-12-07T16:21:45.408 INFO:tasks.workunit.client.1.smithi152.stdout:9/950: readlink d1/d9/d4f/lfb 0 2023-12-07T16:21:45.408 INFO:tasks.workunit.client.1.smithi152.stdout:9/951: fsync d1/f76 0 2023-12-07T16:21:45.410 INFO:tasks.workunit.client.1.smithi152.stdout:6/851: unlink d2/d4f/d83/d48/d70/da7/db7/d9d/lbf 0 2023-12-07T16:21:45.410 INFO:tasks.workunit.client.1.smithi152.stdout:6/852: chown d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/dfc 16739789 1 2023-12-07T16:21:45.410 INFO:tasks.workunit.client.1.smithi152.stdout:6/853: fsync d2/f3 0 2023-12-07T16:21:45.410 INFO:tasks.workunit.client.1.smithi152.stdout:6/854: write d2/d4f/d83/d48/da8/f111 [360549,31498] 0 2023-12-07T16:21:45.410 INFO:tasks.workunit.client.1.smithi152.stdout:6/855: fdatasync d2/d4f/d83/d85/d19/d1f/f20 0 2023-12-07T16:21:45.411 INFO:tasks.workunit.client.1.smithi152.stdout:4/862: dwrite d0/d3/d6/d2b/d75/ff3 [0,4194304] 0 2023-12-07T16:21:45.411 INFO:tasks.workunit.client.1.smithi152.stdout:6/856: mknod d2/d4f/d83/d85/d9/c115 0 2023-12-07T16:21:45.412 INFO:tasks.workunit.client.1.smithi152.stdout:6/857: read d2/d4f/d83/d48/d70/fdb [1292715,5222] 0 2023-12-07T16:21:45.412 INFO:tasks.workunit.client.1.smithi152.stdout:6/858: chown d2/d4f/d83/d85/d19/d1f/c23 122501 1 2023-12-07T16:21:45.414 INFO:tasks.workunit.client.1.smithi152.stdout:4/863: symlink d0/d3/d6/d2b/dd9/d3a/d46/d4e/l104 0 2023-12-07T16:21:45.418 INFO:tasks.workunit.client.0.smithi063.stdout:3/660: mknod d7/d9/dd/d7f/cd8 0 2023-12-07T16:21:45.418 INFO:tasks.workunit.client.0.smithi063.stdout:8/873: mknod d7/d14/d15/d57/c118 0 2023-12-07T16:21:45.418 INFO:tasks.workunit.client.1.smithi152.stdout:4/864: rename d0/d3/d6/d2b/dd9/d3a/d46/d4e/f84 to d0/d3/d6/d36/d85/df7/f105 0 2023-12-07T16:21:45.421 INFO:tasks.workunit.client.1.smithi152.stdout:4/865: mkdir d0/d3/d6/d2b/dd9/d39/d93/d106 0 2023-12-07T16:21:45.422 INFO:tasks.workunit.client.1.smithi152.stdout:3/937: dwrite d7/d10/d1a/d2f/d56/d57/dee/dda/d6b/fd3 [0,4194304] 0 2023-12-07T16:21:45.422 INFO:tasks.workunit.client.1.smithi152.stdout:6/859: dread d2/f3 [0,4194304] 0 2023-12-07T16:21:45.423 INFO:tasks.workunit.client.0.smithi063.stdout:4/554: creat d1/d3/db/d16/d66/fa7 x:0 0 0 2023-12-07T16:21:45.423 INFO:tasks.workunit.client.0.smithi063.stdout:8/874: creat d7/d14/d15/dde/d63/d75/f119 x:0 0 0 2023-12-07T16:21:45.423 INFO:tasks.workunit.client.0.smithi063.stdout:8/875: dread - d7/d14/d15/d48/fd8 zero size 2023-12-07T16:21:45.424 INFO:tasks.workunit.client.0.smithi063.stdout:1/504: sync 2023-12-07T16:21:45.424 INFO:tasks.workunit.client.0.smithi063.stdout:1/505: getdents d0/dd/d19/d50/d72 0 2023-12-07T16:21:45.424 INFO:tasks.workunit.client.0.smithi063.stdout:1/506: readlink d0/dd/d10/d13/l76 0 2023-12-07T16:21:45.424 INFO:tasks.workunit.client.0.smithi063.stdout:3/661: write d7/d9/d1b/f2c [2757166,126929] 0 2023-12-07T16:21:45.424 INFO:tasks.workunit.client.0.smithi063.stdout:3/662: chown d7/d4f/d53/d72/db1/ccf 134823 1 2023-12-07T16:21:45.424 INFO:tasks.workunit.client.0.smithi063.stdout:3/663: dread - d7/d9/dd/f90 zero size 2023-12-07T16:21:45.424 INFO:tasks.workunit.client.0.smithi063.stdout:3/664: truncate d7/d9/dd/d7f/fab 571465 0 2023-12-07T16:21:45.425 INFO:tasks.workunit.client.1.smithi152.stdout:6/860: read d2/d4f/d83/d48/d70/fdb [847818,125772] 0 2023-12-07T16:21:45.425 INFO:tasks.workunit.client.0.smithi063.stdout:4/555: creat d1/d3/d51/fa8 x:0 0 0 2023-12-07T16:21:45.425 INFO:tasks.workunit.client.0.smithi063.stdout:4/556: fdatasync d1/d3/d3f/d44/f70 0 2023-12-07T16:21:45.425 INFO:tasks.workunit.client.0.smithi063.stdout:8/876: truncate d7/d14/f7d 3306182 0 2023-12-07T16:21:45.427 INFO:tasks.workunit.client.0.smithi063.stdout:1/507: mknod d0/dd/d1f/cb0 0 2023-12-07T16:21:45.428 INFO:tasks.workunit.client.1.smithi152.stdout:3/938: mknod d7/dc/c128 0 2023-12-07T16:21:45.428 INFO:tasks.workunit.client.1.smithi152.stdout:6/861: unlink d2/d4f/d83/d85/d19/d1f/dc7/dc9/f62 0 2023-12-07T16:21:45.428 INFO:tasks.workunit.client.0.smithi063.stdout:3/665: mkdir d7/d49/dd9 0 2023-12-07T16:21:45.428 INFO:tasks.workunit.client.0.smithi063.stdout:3/666: fsync d7/d9/dd/fa9 0 2023-12-07T16:21:45.429 INFO:tasks.workunit.client.0.smithi063.stdout:4/557: rmdir d1/d3/db/d73 39 2023-12-07T16:21:45.429 INFO:tasks.workunit.client.1.smithi152.stdout:3/939: rmdir d7/d10/d1a/d25/d78 39 2023-12-07T16:21:45.432 INFO:tasks.workunit.client.1.smithi152.stdout:6/862: mkdir d2/d4f/d83/d48/d70/d81/d116 0 2023-12-07T16:21:45.434 INFO:tasks.workunit.client.0.smithi063.stdout:1/508: creat d0/dd/d10/d13/d2f/fb1 x:0 0 0 2023-12-07T16:21:45.434 INFO:tasks.workunit.client.0.smithi063.stdout:1/509: chown d0/dd/d10/d13/f60 680299 1 2023-12-07T16:21:45.434 INFO:tasks.workunit.client.0.smithi063.stdout:1/510: fdatasync d0/dd/d10/d46/f73 0 2023-12-07T16:21:45.434 INFO:tasks.workunit.client.0.smithi063.stdout:1/511: chown d0/dd/l24 3 1 2023-12-07T16:21:45.435 INFO:tasks.workunit.client.0.smithi063.stdout:4/558: unlink d1/d3/d51/c54 0 2023-12-07T16:21:45.437 INFO:tasks.workunit.client.1.smithi152.stdout:6/863: creat d2/d4f/d83/d85/d65/d100/f117 x:0 0 0 2023-12-07T16:21:45.439 INFO:tasks.workunit.client.0.smithi063.stdout:1/512: creat d0/dd/d1f/d75/fb2 x:0 0 0 2023-12-07T16:21:45.439 INFO:tasks.workunit.client.0.smithi063.stdout:1/513: stat d0 0 2023-12-07T16:21:45.442 INFO:tasks.workunit.client.0.smithi063.stdout:8/877: rename d7/d14/f7d to d7/d14/d15/dde/da8/f11a 0 2023-12-07T16:21:45.444 INFO:tasks.workunit.client.1.smithi152.stdout:6/864: dread d2/d4f/d83/d48/d70/fdb [0,4194304] 0 2023-12-07T16:21:45.444 INFO:tasks.workunit.client.1.smithi152.stdout:4/866: dwrite d0/d3/fbe [0,4194304] 0 2023-12-07T16:21:45.444 INFO:tasks.workunit.client.1.smithi152.stdout:4/867: fsync d0/d3/d6/d2b/d56/f98 0 2023-12-07T16:21:45.444 INFO:tasks.workunit.client.1.smithi152.stdout:6/865: read - d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/fe4 zero size 2023-12-07T16:21:45.444 INFO:tasks.workunit.client.1.smithi152.stdout:6/866: readlink d2/d4f/d83/d85/d19/l77 0 2023-12-07T16:21:45.446 INFO:tasks.workunit.client.1.smithi152.stdout:4/868: rename d0/d3/d6/d2b/d56/f70 to d0/d3/d6/d2b/dd9/d3a/f107 0 2023-12-07T16:21:45.455 INFO:tasks.workunit.client.0.smithi063.stdout:3/667: dwrite d7/d9/dd/fc1 [0,4194304] 0 2023-12-07T16:21:45.455 INFO:tasks.workunit.client.0.smithi063.stdout:3/668: write d7/d4f/d53/d72/db1/d41/f86 [1011136,83668] 0 2023-12-07T16:21:45.455 INFO:tasks.workunit.client.1.smithi152.stdout:3/940: dwrite d7/d10/d41/fdc [0,4194304] 0 2023-12-07T16:21:45.457 INFO:tasks.workunit.client.0.smithi063.stdout:4/559: dread d1/d3/d3f/d44/f6c [0,4194304] 0 2023-12-07T16:21:45.458 INFO:tasks.workunit.client.0.smithi063.stdout:4/560: readlink d1/l7c 0 2023-12-07T16:21:45.460 INFO:tasks.workunit.client.1.smithi152.stdout:3/941: link d7/dc/d14/f1e d7/dc/d14/f129 0 2023-12-07T16:21:45.461 INFO:tasks.workunit.client.0.smithi063.stdout:3/669: dread d7/d9/d1b/d5c/f91 [0,4194304] 0 2023-12-07T16:21:45.463 INFO:tasks.workunit.client.0.smithi063.stdout:4/561: link d1/d3/db/d2c/d63/d62/l82 d1/d3/db/d16/la9 0 2023-12-07T16:21:45.463 INFO:tasks.workunit.client.0.smithi063.stdout:4/562: fsync d1/d3/f5 0 2023-12-07T16:21:45.464 INFO:tasks.workunit.client.1.smithi152.stdout:3/942: creat d7/dc/f12a x:0 0 0 2023-12-07T16:21:45.465 INFO:tasks.workunit.client.0.smithi063.stdout:3/670: creat d7/d8d/fda x:0 0 0 2023-12-07T16:21:45.465 INFO:tasks.workunit.client.0.smithi063.stdout:3/671: read - d7/d9/dd/d56/fa7 zero size 2023-12-07T16:21:45.465 INFO:tasks.workunit.client.0.smithi063.stdout:4/563: mknod d1/d3/d3f/d44/caa 0 2023-12-07T16:21:45.465 INFO:tasks.workunit.client.0.smithi063.stdout:4/564: stat d1/d3/db/d2c/d63/d62/f7e 0 2023-12-07T16:21:45.473 INFO:tasks.workunit.client.1.smithi152.stdout:0/903: sync 2023-12-07T16:21:45.474 INFO:tasks.workunit.client.1.smithi152.stdout:8/868: sync 2023-12-07T16:21:45.474 INFO:tasks.workunit.client.1.smithi152.stdout:8/869: chown d3/d4/d9/dc/d6f/d7a/d8a/f62 4024185 1 2023-12-07T16:21:45.475 INFO:tasks.workunit.client.1.smithi152.stdout:2/843: sync 2023-12-07T16:21:45.475 INFO:tasks.workunit.client.1.smithi152.stdout:2/844: chown d2/d56 1 1 2023-12-07T16:21:45.475 INFO:tasks.workunit.client.1.smithi152.stdout:2/845: readlink d2/l12 0 2023-12-07T16:21:45.477 INFO:tasks.workunit.client.0.smithi063.stdout:1/514: dwrite d0/dd/d10/f27 [0,4194304] 0 2023-12-07T16:21:45.477 INFO:tasks.workunit.client.1.smithi152.stdout:0/904: rename d0/c15 to d0/dc/d36/d7d/d92/de9/c13b 0 2023-12-07T16:21:45.477 INFO:tasks.workunit.client.1.smithi152.stdout:0/905: dread - d0/dc/d3d/d4c/f60 zero size 2023-12-07T16:21:45.477 INFO:tasks.workunit.client.1.smithi152.stdout:8/870: mkdir d3/d4/d9/dc/d6f/d7b/d7e/d12d/d67/d143 0 2023-12-07T16:21:45.477 INFO:tasks.workunit.client.1.smithi152.stdout:8/871: write d3/d4/d9/d34/f134 [236164,86428] 0 2023-12-07T16:21:45.478 INFO:tasks.workunit.client.1.smithi152.stdout:8/872: creat d3/d1e/d55/d83/dc5/d104/ddb/f144 x:0 0 0 2023-12-07T16:21:45.478 INFO:tasks.workunit.client.0.smithi063.stdout:1/515: symlink d0/d98/d9f/lb3 0 2023-12-07T16:21:45.479 INFO:tasks.workunit.client.1.smithi152.stdout:2/846: rename d2/d1c/d2e/f3e to d2/d9/d51/d54/f11b 0 2023-12-07T16:21:45.480 INFO:tasks.workunit.client.0.smithi063.stdout:1/516: rename d0/dd/d10/d1b/d68/l6e to d0/dd/d19/lb4 0 2023-12-07T16:21:45.480 INFO:tasks.workunit.client.0.smithi063.stdout:1/517: chown d0/dd/d1f/f4e 490139994 1 2023-12-07T16:21:45.482 INFO:tasks.workunit.client.1.smithi152.stdout:2/847: link d2/d1c/d52/da8/db6/cbe d2/d1c/d2e/d57/d5b/da7/d9a/dcb/d102/c11c 0 2023-12-07T16:21:45.482 INFO:tasks.workunit.client.1.smithi152.stdout:2/848: dread - d2/d1c/d52/da8/db6/ffe zero size 2023-12-07T16:21:45.482 INFO:tasks.workunit.client.1.smithi152.stdout:8/873: dread d3/d4/d4b/f111 [0,4194304] 0 2023-12-07T16:21:45.482 INFO:tasks.workunit.client.1.smithi152.stdout:8/874: fdatasync d3/d1e/d55/d83/dae/fef 0 2023-12-07T16:21:45.482 INFO:tasks.workunit.client.1.smithi152.stdout:8/875: write d3/d4/d4b/f111 [1009256,110443] 0 2023-12-07T16:21:45.483 INFO:tasks.workunit.client.0.smithi063.stdout:1/518: rmdir d0/dd/d19/d50/d71 39 2023-12-07T16:21:45.483 INFO:tasks.workunit.client.0.smithi063.stdout:1/519: rename d0 to d0/dd/d1f/d75/db5 22 2023-12-07T16:21:45.483 INFO:tasks.workunit.client.1.smithi152.stdout:2/849: symlink d2/d1c/d2e/d5d/dab/l11d 0 2023-12-07T16:21:45.483 INFO:tasks.workunit.client.1.smithi152.stdout:2/850: dread - d2/d1c/d2e/d57/d5b/da7/d9a/da6/fec zero size 2023-12-07T16:21:45.487 INFO:tasks.workunit.client.0.smithi063.stdout:1/520: creat d0/dd/d19/d50/d71/d9b/fb6 x:0 0 0 2023-12-07T16:21:45.492 INFO:tasks.workunit.client.1.smithi152.stdout:4/869: dwrite d0/d3/d6/d2b/dd9/d39/f92 [0,4194304] 0 2023-12-07T16:21:45.492 INFO:tasks.workunit.client.1.smithi152.stdout:4/870: fdatasync d0/d3/d6/d2b/dd9/d3a/f58 0 2023-12-07T16:21:45.495 INFO:tasks.workunit.client.0.smithi063.stdout:4/565: dwrite d1/d3/db/d2c/f91 [0,4194304] 0 2023-12-07T16:21:45.496 INFO:tasks.workunit.client.1.smithi152.stdout:4/871: symlink d0/d3/d6/d2b/dd9/d22/l108 0 2023-12-07T16:21:45.496 INFO:tasks.workunit.client.0.smithi063.stdout:8/878: dwrite d7/d14/f35 [0,4194304] 0 2023-12-07T16:21:45.498 INFO:tasks.workunit.client.1.smithi152.stdout:0/906: dread d0/dc/d3d/f5b [0,4194304] 0 2023-12-07T16:21:45.499 INFO:tasks.workunit.client.1.smithi152.stdout:4/872: rename d0/d3/fe4 to d0/d3/d6/d2b/de2/dea/f109 0 2023-12-07T16:21:45.499 INFO:tasks.workunit.client.0.smithi063.stdout:4/566: creat d1/d3/d3f/d49/d8b/fab x:0 0 0 2023-12-07T16:21:45.499 INFO:tasks.workunit.client.0.smithi063.stdout:4/567: write d1/d3/f4a [1050004,73307] 0 2023-12-07T16:21:45.499 INFO:tasks.workunit.client.0.smithi063.stdout:4/568: chown d1/d3/db/d16/c21 218383078 1 2023-12-07T16:21:45.500 INFO:tasks.workunit.client.1.smithi152.stdout:0/907: mkdir d0/dc/d36/d3a/d51/d82/d13c 0 2023-12-07T16:21:45.500 INFO:tasks.workunit.client.1.smithi152.stdout:8/876: dread d3/fec [0,4194304] 0 2023-12-07T16:21:45.500 INFO:tasks.workunit.client.1.smithi152.stdout:4/873: creat d0/d3/d6/d2b/db1/ddd/f10a x:0 0 0 2023-12-07T16:21:45.501 INFO:tasks.workunit.client.1.smithi152.stdout:0/908: mkdir d0/d27/d8c/df7/d30/d6e/d13d 0 2023-12-07T16:21:45.501 INFO:tasks.workunit.client.0.smithi063.stdout:3/672: dwrite d7/d9/f27 [0,4194304] 0 2023-12-07T16:21:45.502 INFO:tasks.workunit.client.1.smithi152.stdout:4/874: mknod d0/d3/d6/d2b/de2/c10b 0 2023-12-07T16:21:45.502 INFO:tasks.workunit.client.1.smithi152.stdout:4/875: dread - d0/d81/fa0 zero size 2023-12-07T16:21:45.502 INFO:tasks.workunit.client.1.smithi152.stdout:4/876: chown d0/d3/d6/c1b 1 1 2023-12-07T16:21:45.503 INFO:tasks.workunit.client.1.smithi152.stdout:0/909: getdents d0/dc/d3d/dab/dc8 0 2023-12-07T16:21:45.505 INFO:tasks.workunit.client.1.smithi152.stdout:4/877: mknod d0/d3/d6/c10c 0 2023-12-07T16:21:45.506 INFO:tasks.workunit.client.1.smithi152.stdout:4/878: mknod d0/d3/d6/d2b/dd9/d3a/d48/d103/c10d 0 2023-12-07T16:21:45.506 INFO:tasks.workunit.client.1.smithi152.stdout:4/879: chown d0/d3/d6/d2b/dd9/d3a/d46/d4e/l9a 285952792 1 2023-12-07T16:21:45.509 INFO:tasks.workunit.client.0.smithi063.stdout:8/879: creat d7/d14/d15/dde/f11b x:0 0 0 2023-12-07T16:21:45.509 INFO:tasks.workunit.client.0.smithi063.stdout:8/880: dread - d7/d14/d15/dde/da8/fcf zero size 2023-12-07T16:21:45.509 INFO:tasks.workunit.client.1.smithi152.stdout:4/880: mkdir d0/d3/d6/d2b/dd9/d3a/d46/d9b/d10e 0 2023-12-07T16:21:45.510 INFO:tasks.workunit.client.1.smithi152.stdout:4/881: readlink d0/d3/d6/d2b/dd9/db7/ddc/le7 0 2023-12-07T16:21:45.510 INFO:tasks.workunit.client.0.smithi063.stdout:4/569: write d1/d3/db/d41/f52 [555163,58656] 0 2023-12-07T16:21:45.511 INFO:tasks.workunit.client.0.smithi063.stdout:3/673: creat d7/d9/d1b/db8/db9/fdb x:0 0 0 2023-12-07T16:21:45.511 INFO:tasks.workunit.client.1.smithi152.stdout:4/882: unlink d0/d3/d6/d2b/dd9/d3a/d46/d4e/l9a 0 2023-12-07T16:21:45.514 INFO:tasks.workunit.client.0.smithi063.stdout:3/674: creat d7/d4f/d53/d54/d76/fdc x:0 0 0 2023-12-07T16:21:45.516 INFO:tasks.workunit.client.1.smithi152.stdout:2/851: dwrite d2/d1c/d2e/d57/fbf [0,4194304] 0 2023-12-07T16:21:45.516 INFO:tasks.workunit.client.1.smithi152.stdout:8/877: dread d3/d4/d9/f18 [4194304,4194304] 0 2023-12-07T16:21:45.516 INFO:tasks.workunit.client.1.smithi152.stdout:8/878: write d3/d4/d9/dc/d6f/d7b/d7e/d85/fd8 [482882,119289] 0 2023-12-07T16:21:45.518 INFO:tasks.workunit.client.0.smithi063.stdout:1/521: dwrite d0/dd/d19/d50/d71/f2c [0,4194304] 0 2023-12-07T16:21:45.521 INFO:tasks.workunit.client.0.smithi063.stdout:1/522: write d0/dd/d10/d13/d2f/d79/fa7 [3988259,105831] 0 2023-12-07T16:21:45.521 INFO:tasks.workunit.client.0.smithi063.stdout:8/881: dread d7/d38/d8e/f91 [0,4194304] 0 2023-12-07T16:21:45.521 INFO:tasks.workunit.client.0.smithi063.stdout:8/882: dread - d7/d14/d15/dde/d63/d75/d98/f101 zero size 2023-12-07T16:21:45.525 INFO:tasks.workunit.client.1.smithi152.stdout:0/910: dwrite d0/dc/d3d/d4c/fdd [0,4194304] 0 2023-12-07T16:21:45.525 INFO:tasks.workunit.client.1.smithi152.stdout:2/852: symlink d2/d1c/d2e/d5d/dab/l11e 0 2023-12-07T16:21:45.525 INFO:tasks.workunit.client.1.smithi152.stdout:8/879: symlink d3/d4/d4b/l145 0 2023-12-07T16:21:45.525 INFO:tasks.workunit.client.0.smithi063.stdout:1/523: mkdir d0/dd/d10/d1b/d68/db7 0 2023-12-07T16:21:45.525 INFO:tasks.workunit.client.0.smithi063.stdout:1/524: write d0/dd/d10/d13/d2f/f7c [977494,50199] 0 2023-12-07T16:21:45.527 INFO:tasks.workunit.client.1.smithi152.stdout:0/911: chown d0/dc/d36/d3a/d51/c7c 148229 1 2023-12-07T16:21:45.528 INFO:tasks.workunit.client.0.smithi063.stdout:4/570: dread d1/d3/f1e [4194304,4194304] 0 2023-12-07T16:21:45.528 INFO:tasks.workunit.client.0.smithi063.stdout:4/571: fdatasync d1/d3/f5 0 2023-12-07T16:21:45.529 INFO:tasks.workunit.client.1.smithi152.stdout:8/880: mknod d3/d1e/d55/d83/dae/db1/c146 0 2023-12-07T16:21:45.529 INFO:tasks.workunit.client.1.smithi152.stdout:8/881: stat d3/fec 0 2023-12-07T16:21:45.529 INFO:tasks.workunit.client.1.smithi152.stdout:0/912: mknod d0/d27/c13e 0 2023-12-07T16:21:45.531 INFO:tasks.workunit.client.0.smithi063.stdout:1/525: creat d0/dd/d19/d50/d72/fb8 x:0 0 0 2023-12-07T16:21:45.532 INFO:tasks.workunit.client.0.smithi063.stdout:0/710: sync 2023-12-07T16:21:45.532 INFO:tasks.workunit.client.0.smithi063.stdout:5/634: sync 2023-12-07T16:21:45.532 INFO:tasks.workunit.client.0.smithi063.stdout:5/635: chown d1/d3/d3a/l8b 1410614 1 2023-12-07T16:21:45.533 INFO:tasks.workunit.client.1.smithi152.stdout:0/913: link d0/dc/d36/d7d/d136/dcb/ldc d0/dc/d36/d3a/d69/l13f 0 2023-12-07T16:21:45.533 INFO:tasks.workunit.client.0.smithi063.stdout:4/572: creat d1/d3/db/d16/d66/fac x:0 0 0 2023-12-07T16:21:45.533 INFO:tasks.workunit.client.0.smithi063.stdout:4/573: write d1/d3/f5a [822258,34930] 0 2023-12-07T16:21:45.533 INFO:tasks.workunit.client.0.smithi063.stdout:7/657: sync 2023-12-07T16:21:45.535 INFO:tasks.workunit.client.1.smithi152.stdout:0/914: mkdir d0/d140 0 2023-12-07T16:21:45.537 INFO:tasks.workunit.client.0.smithi063.stdout:4/574: creat d1/d3/d3f/d49/d64/d80/fad x:0 0 0 2023-12-07T16:21:45.537 INFO:tasks.workunit.client.0.smithi063.stdout:4/575: chown d1/d3/d51/f65 1525831 1 2023-12-07T16:21:45.537 INFO:tasks.workunit.client.0.smithi063.stdout:2/769: sync 2023-12-07T16:21:45.537 INFO:tasks.workunit.client.0.smithi063.stdout:9/650: sync 2023-12-07T16:21:45.537 INFO:tasks.workunit.client.0.smithi063.stdout:6/698: sync 2023-12-07T16:21:45.539 INFO:tasks.workunit.client.0.smithi063.stdout:7/658: mknod d2/d34/d5a/d5f/d78/d7c/d9b/cf2 0 2023-12-07T16:21:45.540 INFO:tasks.workunit.client.0.smithi063.stdout:2/770: dread - d0/d21/f9e zero size 2023-12-07T16:21:45.544 INFO:tasks.workunit.client.0.smithi063.stdout:6/699: creat d0/d17/d95/dd6/d8b/ffa x:0 0 0 2023-12-07T16:21:45.544 INFO:tasks.workunit.client.0.smithi063.stdout:6/700: dread - d0/d1e/d1d/d1f/d4b/f85 zero size 2023-12-07T16:21:45.548 INFO:tasks.workunit.client.0.smithi063.stdout:2/771: mknod d0/d21/d56/d11/d52/d63/d8c/db9/cfa 0 2023-12-07T16:21:45.548 INFO:tasks.workunit.client.0.smithi063.stdout:6/701: mkdir d0/d1e/dfb 0 2023-12-07T16:21:45.548 INFO:tasks.workunit.client.0.smithi063.stdout:6/702: chown d0/d1e/d1d/d1f/l44 0 1 2023-12-07T16:21:45.551 INFO:tasks.workunit.client.0.smithi063.stdout:6/703: symlink d0/d1e/d60/lfc 0 2023-12-07T16:21:45.566 INFO:tasks.workunit.client.1.smithi152.stdout:4/883: dwrite d0/d3/d6/d2b/dd9/d39/fe3 [0,4194304] 0 2023-12-07T16:21:45.590 INFO:tasks.workunit.client.0.smithi063.stdout:5/636: dwrite d1/d31/d56/d61/d5e/d6a/fa3 [0,4194304] 0 2023-12-07T16:21:45.590 INFO:tasks.workunit.client.0.smithi063.stdout:5/637: chown d1/d31/d56/d61/c49 765 1 2023-12-07T16:21:45.591 INFO:tasks.workunit.client.0.smithi063.stdout:5/638: write d1/d3/d3a/fa8 [127884,127291] 0 2023-12-07T16:21:45.591 INFO:tasks.workunit.client.1.smithi152.stdout:0/915: dwrite d0/dc/d3d/dab/dc8/fcf [0,4194304] 0 2023-12-07T16:21:45.592 INFO:tasks.workunit.client.1.smithi152.stdout:2/853: dwrite d2/d1c/d2e/d57/d5b/da7/d9a/da6/dbb/fd0 [0,4194304] 0 2023-12-07T16:21:45.592 INFO:tasks.workunit.client.0.smithi063.stdout:5/639: unlink d1/d3/f8c 0 2023-12-07T16:21:45.596 INFO:tasks.workunit.client.1.smithi152.stdout:2/854: creat d2/d1c/d2e/d30/d33/d86/dee/f11f x:0 0 0 2023-12-07T16:21:45.597 INFO:tasks.workunit.client.1.smithi152.stdout:2/855: symlink d2/l120 0 2023-12-07T16:21:45.598 INFO:tasks.workunit.client.1.smithi152.stdout:0/916: write d0/d27/d8c/df7/f74 [3832720,116709] 0 2023-12-07T16:21:45.599 INFO:tasks.workunit.client.0.smithi063.stdout:1/526: dwrite d0/dd/d1f/d75/f97 [0,4194304] 0 2023-12-07T16:21:45.599 INFO:tasks.workunit.client.0.smithi063.stdout:4/576: dwrite d1/d3/db/f56 [0,4194304] 0 2023-12-07T16:21:45.599 INFO:tasks.workunit.client.0.smithi063.stdout:1/527: fdatasync d0/dd/d10/d13/d2f/f89 0 2023-12-07T16:21:45.599 INFO:tasks.workunit.client.0.smithi063.stdout:4/577: truncate d1/d3/f5a 1452448 0 2023-12-07T16:21:45.599 INFO:tasks.workunit.client.1.smithi152.stdout:2/856: creat d2/d1c/d2e/d57/d5b/f121 x:0 0 0 2023-12-07T16:21:45.600 INFO:tasks.workunit.client.0.smithi063.stdout:9/651: dwrite d0/f56 [0,4194304] 0 2023-12-07T16:21:45.603 INFO:tasks.workunit.client.0.smithi063.stdout:6/704: dwrite d0/d1e/d1d/d1f/d6c/fa8 [0,4194304] 0 2023-12-07T16:21:45.603 INFO:tasks.workunit.client.0.smithi063.stdout:4/578: mknod d1/d3/d3a/cae 0 2023-12-07T16:21:45.603 INFO:tasks.workunit.client.0.smithi063.stdout:4/579: truncate d1/d3/d3f/d49/fa2 911751 0 2023-12-07T16:21:45.604 INFO:tasks.workunit.client.1.smithi152.stdout:8/882: dwrite d3/d4/d9/d34/f42 [0,4194304] 0 2023-12-07T16:21:45.606 INFO:tasks.workunit.client.0.smithi063.stdout:6/705: mknod d0/d1e/d60/d68/d78/cfd 0 2023-12-07T16:21:45.609 INFO:tasks.workunit.client.0.smithi063.stdout:7/659: dwrite d2/d34/d46/d48/d70/fc0 [0,4194304] 0 2023-12-07T16:21:45.609 INFO:tasks.workunit.client.0.smithi063.stdout:7/660: dread - d2/d34/d46/d48/d70/fd2 zero size 2023-12-07T16:21:45.610 INFO:tasks.workunit.client.1.smithi152.stdout:8/883: write d3/d4/d9/dad/db3/df3/f126 [6397432,98676] 0 2023-12-07T16:21:45.610 INFO:tasks.workunit.client.0.smithi063.stdout:6/706: creat d0/d1e/d1d/d4f/d88/ffe x:0 0 0 2023-12-07T16:21:45.610 INFO:tasks.workunit.client.0.smithi063.stdout:6/707: read - d0/d1e/d1d/d4f/d88/fd0 zero size 2023-12-07T16:21:45.610 INFO:tasks.workunit.client.0.smithi063.stdout:6/708: stat d0/d1e/d1d/d1f/c8a 0 2023-12-07T16:21:45.611 INFO:tasks.workunit.client.0.smithi063.stdout:4/580: symlink d1/d3/laf 0 2023-12-07T16:21:45.611 INFO:tasks.workunit.client.1.smithi152.stdout:4/884: dwrite d0/d3/d6/d36/d85/f72 [0,4194304] 0 2023-12-07T16:21:45.613 INFO:tasks.workunit.client.0.smithi063.stdout:7/661: creat d2/d34/d5a/d5f/d78/d7c/d9b/ff3 x:0 0 0 2023-12-07T16:21:45.614 INFO:tasks.workunit.client.0.smithi063.stdout:6/709: creat d0/d79/fff x:0 0 0 2023-12-07T16:21:45.617 INFO:tasks.workunit.client.0.smithi063.stdout:4/581: mknod d1/d3/d3f/d49/d64/cb0 0 2023-12-07T16:21:45.617 INFO:tasks.workunit.client.0.smithi063.stdout:7/662: getdents d2/d34/d5a/d5f/d78/d9a 0 2023-12-07T16:21:45.617 INFO:tasks.workunit.client.0.smithi063.stdout:7/663: write d2/d34/d46/d48/d70/daf/dd6/fea [332141,66712] 0 2023-12-07T16:21:45.618 INFO:tasks.workunit.client.0.smithi063.stdout:6/710: creat d0/d1e/d60/d68/d78/df2/f100 x:0 0 0 2023-12-07T16:21:45.619 INFO:tasks.workunit.client.0.smithi063.stdout:6/711: read - d0/d79/d94/fdd zero size 2023-12-07T16:21:45.620 INFO:tasks.workunit.client.1.smithi152.stdout:7/827: sync 2023-12-07T16:21:45.620 INFO:tasks.workunit.client.1.smithi152.stdout:9/952: sync 2023-12-07T16:21:45.621 INFO:tasks.workunit.client.0.smithi063.stdout:7/664: creat d2/d37/da0/ff4 x:0 0 0 2023-12-07T16:21:45.623 INFO:tasks.workunit.client.0.smithi063.stdout:6/712: mkdir d0/d1e/d60/d68/d78/d9c/d9f/de4/d101 0 2023-12-07T16:21:45.625 INFO:tasks.workunit.client.1.smithi152.stdout:9/953: symlink d1/d9/l138 0 2023-12-07T16:21:45.625 INFO:tasks.workunit.client.1.smithi152.stdout:9/954: getdents d1/dd/dd6/de2/d53/dff/d10f 0 2023-12-07T16:21:45.627 INFO:tasks.workunit.client.1.smithi152.stdout:7/828: write db/d27/d39/d41/d58/f73 [2755851,92102] 0 2023-12-07T16:21:45.629 INFO:tasks.workunit.client.0.smithi063.stdout:4/582: read d1/d3/db/d2c/d63/f48 [209217,124638] 0 2023-12-07T16:21:45.632 INFO:tasks.workunit.client.1.smithi152.stdout:7/829: write db/d27/d5e/f48 [308605,107839] 0 2023-12-07T16:21:45.639 INFO:tasks.workunit.client.0.smithi063.stdout:4/583: dread d1/d3/f5a [0,4194304] 0 2023-12-07T16:21:45.640 INFO:tasks.workunit.client.0.smithi063.stdout:4/584: rmdir d1/d3/d3f/d49/d8b 39 2023-12-07T16:21:45.640 INFO:tasks.workunit.client.0.smithi063.stdout:4/585: creat d1/d3/db/d2c/fb1 x:0 0 0 2023-12-07T16:21:45.643 INFO:tasks.workunit.client.0.smithi063.stdout:5/640: dwrite d1/d3/de/d1e/f1d [0,4194304] 0 2023-12-07T16:21:45.643 INFO:tasks.workunit.client.1.smithi152.stdout:0/917: dwrite d0/dc/d3d/d4c/fa1 [0,4194304] 0 2023-12-07T16:21:45.644 INFO:tasks.workunit.client.0.smithi063.stdout:9/652: dwrite d0/d8d/fc7 [0,4194304] 0 2023-12-07T16:21:45.653 INFO:tasks.workunit.client.1.smithi152.stdout:8/884: dwrite d3/d4/d9/dc/d6f/d7b/d7e/ffd [0,4194304] 0 2023-12-07T16:21:45.653 INFO:tasks.workunit.client.1.smithi152.stdout:4/885: dwrite d0/f1 [0,4194304] 0 2023-12-07T16:21:45.653 INFO:tasks.workunit.client.1.smithi152.stdout:8/885: readlink d3/d4/l2a 0 2023-12-07T16:21:45.656 INFO:tasks.workunit.client.0.smithi063.stdout:5/641: dread d1/d3/de/f1f [0,4194304] 0 2023-12-07T16:21:45.656 INFO:tasks.workunit.client.0.smithi063.stdout:7/665: dwrite d2/d34/d5a/d5f/f27 [0,4194304] 0 2023-12-07T16:21:45.659 INFO:tasks.workunit.client.0.smithi063.stdout:5/642: getdents d1/d3/de/d1e 0 2023-12-07T16:21:45.659 INFO:tasks.workunit.client.1.smithi152.stdout:8/886: symlink d3/d1e/d55/d83/dc5/d123/d125/d4c/l147 0 2023-12-07T16:21:45.660 INFO:tasks.workunit.client.1.smithi152.stdout:4/886: dread d0/d3/d6/d36/f82 [0,4194304] 0 2023-12-07T16:21:45.660 INFO:tasks.workunit.client.1.smithi152.stdout:9/955: dwrite d1/d9/f2b [0,4194304] 0 2023-12-07T16:21:45.661 INFO:tasks.workunit.client.1.smithi152.stdout:9/956: stat d1/d9/db/df/da6/da2/de9 0 2023-12-07T16:21:45.661 INFO:tasks.workunit.client.1.smithi152.stdout:8/887: mkdir d3/d1e/d40/d74/d148 0 2023-12-07T16:21:45.663 INFO:tasks.workunit.client.0.smithi063.stdout:5/643: rmdir d1 39 2023-12-07T16:21:45.663 INFO:tasks.workunit.client.1.smithi152.stdout:9/957: rmdir d1/dd/dd6/de2 39 2023-12-07T16:21:45.664 INFO:tasks.workunit.client.1.smithi152.stdout:4/887: mkdir d0/d3/d6/d2b/d56/d10f 0 2023-12-07T16:21:45.664 INFO:tasks.workunit.client.1.smithi152.stdout:4/888: fdatasync d0/d3/f37 0 2023-12-07T16:21:45.666 INFO:tasks.workunit.client.1.smithi152.stdout:8/888: mkdir d3/d1e/d55/d149 0 2023-12-07T16:21:45.668 INFO:tasks.workunit.client.1.smithi152.stdout:9/958: rename d1/d9/db/cd8 to d1/dd/dd6/de2/d53/c139 0 2023-12-07T16:21:45.669 INFO:tasks.workunit.client.1.smithi152.stdout:0/918: dwrite d0/dc/d3d/fde [0,4194304] 0 2023-12-07T16:21:45.669 INFO:tasks.workunit.client.0.smithi063.stdout:9/653: dwrite d0/d13/d39/d3a/f81 [0,4194304] 0 2023-12-07T16:21:45.670 INFO:tasks.workunit.client.1.smithi152.stdout:4/889: symlink d0/d3/d6/d2b/dd9/d3a/d46/d80/df6/l110 0 2023-12-07T16:21:45.673 INFO:tasks.workunit.client.1.smithi152.stdout:0/919: unlink d0/dc/d36/d3a/f85 0 2023-12-07T16:21:45.674 INFO:tasks.workunit.client.1.smithi152.stdout:0/920: read d0/dc/d36/d7d/d92/de9/fec [704537,73464] 0 2023-12-07T16:21:45.674 INFO:tasks.workunit.client.1.smithi152.stdout:4/890: creat d0/d3/d6/d2b/de2/f111 x:0 0 0 2023-12-07T16:21:45.675 INFO:tasks.workunit.client.1.smithi152.stdout:9/959: truncate d1/d17/d3c/d4a/d48/d8c/fb2 1122395 0 2023-12-07T16:21:45.675 INFO:tasks.workunit.client.1.smithi152.stdout:0/921: mknod d0/dc/d3d/d4c/c141 0 2023-12-07T16:21:45.676 INFO:tasks.workunit.client.1.smithi152.stdout:4/891: read d0/d17/d7f/f86 [1408851,38708] 0 2023-12-07T16:21:45.676 INFO:tasks.workunit.client.1.smithi152.stdout:4/892: chown d0/d3/d6/d2b/dd9/d3a/d46/d4e 0 1 2023-12-07T16:21:45.676 INFO:tasks.workunit.client.1.smithi152.stdout:4/893: write d0/d3/d6/d2b/dd9/d3a/d46/d4e/f57 [2272413,81081] 0 2023-12-07T16:21:45.676 INFO:tasks.workunit.client.1.smithi152.stdout:9/960: unlink d1/d17/l92 0 2023-12-07T16:21:45.678 INFO:tasks.workunit.client.1.smithi152.stdout:0/922: link d0/d27/d8c/df7/d30/f4a d0/dc/d3d/d73/dbf/dc9/f142 0 2023-12-07T16:21:45.680 INFO:tasks.workunit.client.1.smithi152.stdout:4/894: symlink d0/d3/d6/d36/d85/l112 0 2023-12-07T16:21:45.680 INFO:tasks.workunit.client.1.smithi152.stdout:4/895: chown d0/d3/d6/f35 32593733 1 2023-12-07T16:21:45.680 INFO:tasks.workunit.client.1.smithi152.stdout:4/896: write d0/d3/d6/d2b/de2/f111 [463440,52293] 0 2023-12-07T16:21:45.680 INFO:tasks.workunit.client.1.smithi152.stdout:4/897: write d0/d3/d6/d2b/dd9/d3a/fa5 [1030956,61119] 0 2023-12-07T16:21:45.681 INFO:tasks.workunit.client.1.smithi152.stdout:0/923: link d0/dc/d3d/d73/d128/d68/c8f d0/dc/d36/c143 0 2023-12-07T16:21:45.682 INFO:tasks.workunit.client.0.smithi063.stdout:9/654: dread d0/d21/d64/d6a/d85/da4/f9e [0,4194304] 0 2023-12-07T16:21:45.683 INFO:tasks.workunit.client.1.smithi152.stdout:4/898: getdents d0/d3/d6/d36 0 2023-12-07T16:21:45.683 INFO:tasks.workunit.client.1.smithi152.stdout:4/899: stat d0/d3/d6/d36/d85/df7/f105 0 2023-12-07T16:21:45.683 INFO:tasks.workunit.client.1.smithi152.stdout:4/900: dread - d0/d3/f95 zero size 2023-12-07T16:21:45.683 INFO:tasks.workunit.client.1.smithi152.stdout:8/889: dwrite d3/d1e/f30 [4194304,4194304] 0 2023-12-07T16:21:45.684 INFO:tasks.workunit.client.0.smithi063.stdout:2/772: sync 2023-12-07T16:21:45.684 INFO:tasks.workunit.client.0.smithi063.stdout:0/711: sync 2023-12-07T16:21:45.684 INFO:tasks.workunit.client.0.smithi063.stdout:8/883: sync 2023-12-07T16:21:45.684 INFO:tasks.workunit.client.0.smithi063.stdout:0/712: chown d4/dd/de/d15/d1f/d22 35996 1 2023-12-07T16:21:45.684 INFO:tasks.workunit.client.0.smithi063.stdout:3/675: sync 2023-12-07T16:21:45.684 INFO:tasks.workunit.client.1.smithi152.stdout:0/924: symlink d0/dc/d36/d7d/d136/l144 0 2023-12-07T16:21:45.685 INFO:tasks.workunit.client.1.smithi152.stdout:0/925: write d0/d27/d8c/df7/d30/d6e/d77/f88 [7520,3627] 0 2023-12-07T16:21:45.685 INFO:tasks.workunit.client.1.smithi152.stdout:4/901: mkdir d0/d3/d6/d2b/dd9/db7/d113 0 2023-12-07T16:21:45.686 INFO:tasks.workunit.client.0.smithi063.stdout:9/655: rename d0/d13/d39/d42/f9d to d0/d21/d64/d6a/d8f/d92/fd6 0 2023-12-07T16:21:45.686 INFO:tasks.workunit.client.0.smithi063.stdout:9/656: dread - d0/d21/f43 zero size 2023-12-07T16:21:45.686 INFO:tasks.workunit.client.0.smithi063.stdout:2/773: creat d0/d21/d56/d11/dc0/ffb x:0 0 0 2023-12-07T16:21:45.686 INFO:tasks.workunit.client.0.smithi063.stdout:2/774: stat d0/d67/d5b/c68 0 2023-12-07T16:21:45.686 INFO:tasks.workunit.client.0.smithi063.stdout:8/884: write d7/d14/d15/f18 [3197666,57104] 0 2023-12-07T16:21:45.687 INFO:tasks.workunit.client.0.smithi063.stdout:0/713: truncate d4/dd/f14 1720138 0 2023-12-07T16:21:45.688 INFO:tasks.workunit.client.0.smithi063.stdout:9/657: creat d0/d13/d39/d42/fd7 x:0 0 0 2023-12-07T16:21:45.688 INFO:tasks.workunit.client.0.smithi063.stdout:5/644: dread d1/f32 [0,4194304] 0 2023-12-07T16:21:45.692 INFO:tasks.workunit.client.1.smithi152.stdout:8/890: rename d3/d4/d9/dc/d6f/d7b/l100 to d3/d4/l14a 0 2023-12-07T16:21:45.692 INFO:tasks.workunit.client.1.smithi152.stdout:8/891: chown d3/d4/d9/d34/d119 5 1 2023-12-07T16:21:45.692 INFO:tasks.workunit.client.1.smithi152.stdout:8/892: chown d3/d4/d9/dc/d6f/d7a/d8a/c73 380600101 1 2023-12-07T16:21:45.692 INFO:tasks.workunit.client.1.smithi152.stdout:9/961: dread d1/d17/d58/f7f [0,4194304] 0 2023-12-07T16:21:45.692 INFO:tasks.workunit.client.1.smithi152.stdout:9/962: truncate d1/d9/d4f/d83/fab 1198209 0 2023-12-07T16:21:45.693 INFO:tasks.workunit.client.0.smithi063.stdout:8/885: rename d7/d14/d15/db4/ca6 to d7/d14/d15/dde/da8/d9f/c11c 0 2023-12-07T16:21:45.694 INFO:tasks.workunit.client.0.smithi063.stdout:9/658: unlink d0/d21/cbe 0 2023-12-07T16:21:45.694 INFO:tasks.workunit.client.0.smithi063.stdout:0/714: link d4/dd/d26/c27 d4/dd/de/d15/d59/d43/cef 0 2023-12-07T16:21:45.696 INFO:tasks.workunit.client.0.smithi063.stdout:5/645: creat d1/d31/d56/d61/d5e/fb4 x:0 0 0 2023-12-07T16:21:45.697 INFO:tasks.workunit.client.1.smithi152.stdout:8/893: write d3/d1e/f9c [1520137,54653] 0 2023-12-07T16:21:45.699 INFO:tasks.workunit.client.0.smithi063.stdout:8/886: rename d7/d14/d15/d48/f58 to d7/d14/d15/db4/f11d 0 2023-12-07T16:21:45.700 INFO:tasks.workunit.client.0.smithi063.stdout:9/659: link d0/d21/fc1 d0/d13/d6f/fd8 0 2023-12-07T16:21:45.702 INFO:tasks.workunit.client.0.smithi063.stdout:8/887: read d7/d14/d15/dde/d63/d75/d98/de8/ff6 [514973,8496] 0 2023-12-07T16:21:45.702 INFO:tasks.workunit.client.0.smithi063.stdout:8/888: write d7/d14/d15/dde/d63/d75/fa0 [196861,79579] 0 2023-12-07T16:21:45.702 INFO:tasks.workunit.client.0.smithi063.stdout:5/646: truncate d1/d3/de/d1e/f78 3870300 0 2023-12-07T16:21:45.703 INFO:tasks.workunit.client.1.smithi152.stdout:8/894: mknod d3/d1e/d40/c14b 0 2023-12-07T16:21:45.705 INFO:tasks.workunit.client.1.smithi152.stdout:8/895: symlink d3/d4/l14c 0 2023-12-07T16:21:45.705 INFO:tasks.workunit.client.1.smithi152.stdout:8/896: chown d3 362976 1 2023-12-07T16:21:45.705 INFO:tasks.workunit.client.1.smithi152.stdout:8/897: write d3/d4/d9/dc/d6f/d7b/d7e/fa1 [1986313,46238] 0 2023-12-07T16:21:45.707 INFO:tasks.workunit.client.0.smithi063.stdout:8/889: mknod d7/d14/d15/dac/dad/c11e 0 2023-12-07T16:21:45.707 INFO:tasks.workunit.client.0.smithi063.stdout:9/660: creat d0/d21/d64/d6a/fd9 x:0 0 0 2023-12-07T16:21:45.707 INFO:tasks.workunit.client.0.smithi063.stdout:5/647: rename d1/d3/de/cad to d1/cb5 0 2023-12-07T16:21:45.708 INFO:tasks.workunit.client.0.smithi063.stdout:8/890: write d7/d14/d15/dde/f62 [1697373,367] 0 2023-12-07T16:21:45.708 INFO:tasks.workunit.client.0.smithi063.stdout:8/891: truncate d7/d14/d15/dde/ff7 933315 0 2023-12-07T16:21:45.709 INFO:tasks.workunit.client.1.smithi152.stdout:8/898: dread d3/da7/fb6 [0,4194304] 0 2023-12-07T16:21:45.710 INFO:tasks.workunit.client.0.smithi063.stdout:8/892: symlink d7/d14/d1a/dce/d100/l11f 0 2023-12-07T16:21:45.710 INFO:tasks.workunit.client.1.smithi152.stdout:6/867: sync 2023-12-07T16:21:45.710 INFO:tasks.workunit.client.1.smithi152.stdout:3/943: sync 2023-12-07T16:21:45.711 INFO:tasks.workunit.client.1.smithi152.stdout:6/868: chown d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/d5d/ce3 294158 1 2023-12-07T16:21:45.711 INFO:tasks.workunit.client.1.smithi152.stdout:6/869: fsync d2/d4f/d83/d85/d19/d1f/dc7/dc9/fbc 0 2023-12-07T16:21:45.711 INFO:tasks.workunit.client.1.smithi152.stdout:8/899: unlink d3/d1e/cf2 0 2023-12-07T16:21:45.712 INFO:tasks.workunit.client.1.smithi152.stdout:3/944: symlink d7/d10/d41/d61/l12b 0 2023-12-07T16:21:45.712 INFO:tasks.workunit.client.0.smithi063.stdout:8/893: rmdir d7/d38/d8e 39 2023-12-07T16:21:45.712 INFO:tasks.workunit.client.0.smithi063.stdout:8/894: chown d7/d14/d15/db4/f11d 1 1 2023-12-07T16:21:45.712 INFO:tasks.workunit.client.0.smithi063.stdout:8/895: readlink d7/d14/d15/d57/lbd 0 2023-12-07T16:21:45.712 INFO:tasks.workunit.client.0.smithi063.stdout:8/896: truncate d7/d38/f3b 4696468 0 2023-12-07T16:21:45.712 INFO:tasks.workunit.client.0.smithi063.stdout:8/897: chown d7/d14/f4f 2101509 1 2023-12-07T16:21:45.715 INFO:tasks.workunit.client.0.smithi063.stdout:8/898: read d7/d14/d15/dde/da8/f95 [28743,125073] 0 2023-12-07T16:21:45.717 INFO:tasks.workunit.client.1.smithi152.stdout:6/870: rename d2/d4f/d83/d48/d70/da7/db7/d9d to d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/d5d/d118 0 2023-12-07T16:21:45.717 INFO:tasks.workunit.client.1.smithi152.stdout:0/926: dwrite d0/dc/d36/d7d/d136/dcb/f118 [0,4194304] 0 2023-12-07T16:21:45.718 INFO:tasks.workunit.client.1.smithi152.stdout:0/927: fsync d0/dc/d26/f67 0 2023-12-07T16:21:45.721 INFO:tasks.workunit.client.1.smithi152.stdout:4/902: dwrite d0/d3/d6/d2b/d75/fb2 [0,4194304] 0 2023-12-07T16:21:45.722 INFO:tasks.workunit.client.0.smithi063.stdout:9/661: getdents d0/d21 0 2023-12-07T16:21:45.726 INFO:tasks.workunit.client.0.smithi063.stdout:9/662: creat d0/fda x:0 0 0 2023-12-07T16:21:45.726 INFO:tasks.workunit.client.1.smithi152.stdout:0/928: read d0/dc/d3d/d73/d128/f72 [141831,101631] 0 2023-12-07T16:21:45.730 INFO:tasks.workunit.client.1.smithi152.stdout:4/903: getdents d0/d3/d6 0 2023-12-07T16:21:45.730 INFO:tasks.workunit.client.1.smithi152.stdout:6/871: dread d2/d4f/d83/d85/f95 [0,4194304] 0 2023-12-07T16:21:45.730 INFO:tasks.workunit.client.0.smithi063.stdout:9/663: creat d0/d13/dd2/fdb x:0 0 0 2023-12-07T16:21:45.732 INFO:tasks.workunit.client.1.smithi152.stdout:4/904: write d0/d17/d7f/fa9 [296971,40675] 0 2023-12-07T16:21:45.732 INFO:tasks.workunit.client.1.smithi152.stdout:4/905: readlink d0/d3/d6/d2b/d56/d83/lae 0 2023-12-07T16:21:45.733 INFO:tasks.workunit.client.0.smithi063.stdout:0/715: dwrite d4/dd/d26/d2b/db5/d5b/d63/d6b/da8/fd5 [0,4194304] 0 2023-12-07T16:21:45.733 INFO:tasks.workunit.client.0.smithi063.stdout:8/899: dread d7/d14/d15/d2b/fe2 [0,4194304] 0 2023-12-07T16:21:45.733 INFO:tasks.workunit.client.0.smithi063.stdout:0/716: truncate d4/dd/de/d15/d59/f6d 969074 0 2023-12-07T16:21:45.733 INFO:tasks.workunit.client.0.smithi063.stdout:9/664: mkdir d0/d13/d6f/daf/dbc/ddc 0 2023-12-07T16:21:45.733 INFO:tasks.workunit.client.1.smithi152.stdout:6/872: rename d2/d4f/d83/d85/d9/c87 to d2/d4f/d83/d85/d19/d1f/dc7/dc9/c119 0 2023-12-07T16:21:45.734 INFO:tasks.workunit.client.0.smithi063.stdout:8/900: getdents d7/d14/d15/dde 0 2023-12-07T16:21:45.736 INFO:tasks.workunit.client.0.smithi063.stdout:9/665: write d0/d13/f36 [3783109,56208] 0 2023-12-07T16:21:45.736 INFO:tasks.workunit.client.1.smithi152.stdout:4/906: dread d0/d17/fcc [0,4194304] 0 2023-12-07T16:21:45.737 INFO:tasks.workunit.client.0.smithi063.stdout:0/717: mknod d4/dd/de/d15/d1f/d4c/cf0 0 2023-12-07T16:21:45.738 INFO:tasks.workunit.client.0.smithi063.stdout:8/901: rename d7/d14/d15/dde/da8/fcf to d7/d38/df1/f120 0 2023-12-07T16:21:45.738 INFO:tasks.workunit.client.0.smithi063.stdout:8/902: chown d7/d14/d15/dac/dad 3974121 1 2023-12-07T16:21:45.739 INFO:tasks.workunit.client.0.smithi063.stdout:9/666: mkdir d0/d21/d64/d6a/d8f/ddd 0 2023-12-07T16:21:45.739 INFO:tasks.workunit.client.1.smithi152.stdout:6/873: creat d2/d4f/d83/d48/d70/da7/db7/f11a x:0 0 0 2023-12-07T16:21:45.740 INFO:tasks.workunit.client.0.smithi063.stdout:8/903: rename d7/d14/d15/db4/f10a to d7/d14/d1a/f121 0 2023-12-07T16:21:45.741 INFO:tasks.workunit.client.1.smithi152.stdout:8/900: dwrite d3/d1e/d55/d83/dae/fb4 [4194304,4194304] 0 2023-12-07T16:21:45.742 INFO:tasks.workunit.client.0.smithi063.stdout:8/904: creat d7/d14/d15/dde/da8/d9f/f122 x:0 0 0 2023-12-07T16:21:45.742 INFO:tasks.workunit.client.1.smithi152.stdout:4/907: creat d0/d3/d6/d2b/dd9/d3a/d46/d80/f114 x:0 0 0 2023-12-07T16:21:45.743 INFO:tasks.workunit.client.0.smithi063.stdout:5/648: dwrite d1/d3/de/d1e/fa0 [0,4194304] 0 2023-12-07T16:21:45.747 INFO:tasks.workunit.client.1.smithi152.stdout:6/874: truncate d2/d4f/d83/d85/d19/d1f/f20 2953622 0 2023-12-07T16:21:45.747 INFO:tasks.workunit.client.0.smithi063.stdout:5/649: rename d1/d3/cab to d1/d31/d56/d61/d5e/d6a/da7/cb6 0 2023-12-07T16:21:45.747 INFO:tasks.workunit.client.0.smithi063.stdout:0/718: dread d4/d25/f45 [0,4194304] 0 2023-12-07T16:21:45.748 INFO:tasks.workunit.client.0.smithi063.stdout:0/719: dread - d4/dd/f6a zero size 2023-12-07T16:21:45.748 INFO:tasks.workunit.client.0.smithi063.stdout:0/720: chown d4/dd/d26/d2b/db5/d5b/d63/d6b 700 1 2023-12-07T16:21:45.748 INFO:tasks.workunit.client.0.smithi063.stdout:0/721: readlink d4/dd/de/d15/d59/d43/dd8/le3 0 2023-12-07T16:21:45.748 INFO:tasks.workunit.client.1.smithi152.stdout:6/875: write d2/f3 [1354414,125915] 0 2023-12-07T16:21:45.749 INFO:tasks.workunit.client.1.smithi152.stdout:8/901: mknod d3/d1e/d40/c14d 0 2023-12-07T16:21:45.749 INFO:tasks.workunit.client.1.smithi152.stdout:8/902: readlink d3/d1e/d55/d83/dc5/d123/d125/d4c/l9d 0 2023-12-07T16:21:45.751 INFO:tasks.workunit.client.0.smithi063.stdout:8/905: getdents d7/d38/df1 0 2023-12-07T16:21:45.751 INFO:tasks.workunit.client.1.smithi152.stdout:0/929: dwrite d0/fc2 [0,4194304] 0 2023-12-07T16:21:45.751 INFO:tasks.workunit.client.1.smithi152.stdout:4/908: rename d0/d3/d6/d2b/dd9/d3a/d48/d4c/ffb to d0/f115 0 2023-12-07T16:21:45.752 INFO:tasks.workunit.client.1.smithi152.stdout:6/876: creat d2/d4f/d83/d85/d19/d1f/f11b x:0 0 0 2023-12-07T16:21:45.754 INFO:tasks.workunit.client.1.smithi152.stdout:8/903: creat d3/d4/d9/d34/de5/f14e x:0 0 0 2023-12-07T16:21:45.754 INFO:tasks.workunit.client.1.smithi152.stdout:8/904: chown d3/d4/d9/dc/d6f/d7a/d8a/l3c 635 1 2023-12-07T16:21:45.754 INFO:tasks.workunit.client.1.smithi152.stdout:8/905: readlink d3/d4/d9/dc/d6f/d7b/dbd/dc4/d13d/lb5 0 2023-12-07T16:21:45.757 INFO:tasks.workunit.client.0.smithi063.stdout:5/650: unlink d1/d31/d56/d61/d5e/d6a/c6c 0 2023-12-07T16:21:45.758 INFO:tasks.workunit.client.1.smithi152.stdout:0/930: unlink d0/d27/d8c/cc7 0 2023-12-07T16:21:45.759 INFO:tasks.workunit.client.0.smithi063.stdout:0/722: mknod d4/cf1 0 2023-12-07T16:21:45.759 INFO:tasks.workunit.client.0.smithi063.stdout:9/667: dwrite d0/f56 [0,4194304] 0 2023-12-07T16:21:45.761 INFO:tasks.workunit.client.0.smithi063.stdout:8/906: link d7/d14/d15/dde/d63/l6a d7/d14/d15/dde/d63/d75/d98/de8/l123 0 2023-12-07T16:21:45.761 INFO:tasks.workunit.client.0.smithi063.stdout:8/907: fsync d7/d14/d15/dde/da8/ffe 0 2023-12-07T16:21:45.761 INFO:tasks.workunit.client.0.smithi063.stdout:1/528: sync 2023-12-07T16:21:45.761 INFO:tasks.workunit.client.0.smithi063.stdout:1/529: chown d0/dd/d10/d46 13 1 2023-12-07T16:21:45.761 INFO:tasks.workunit.client.1.smithi152.stdout:4/909: creat d0/d3/d6/d2b/de2/df4/f116 x:0 0 0 2023-12-07T16:21:45.761 INFO:tasks.workunit.client.1.smithi152.stdout:4/910: dread - d0/d3/d6/d2b/dd9/d3a/d46/d4e/fe5 zero size 2023-12-07T16:21:45.763 INFO:tasks.workunit.client.1.smithi152.stdout:6/877: creat d2/d4f/d83/d85/d9/deb/f11c x:0 0 0 2023-12-07T16:21:45.763 INFO:tasks.workunit.client.1.smithi152.stdout:6/878: fsync d2/f5 0 2023-12-07T16:21:45.763 INFO:tasks.workunit.client.0.smithi063.stdout:1/530: creat d0/dd/d10/d1b/d68/db7/fb9 x:0 0 0 2023-12-07T16:21:45.765 INFO:tasks.workunit.client.1.smithi152.stdout:8/906: getdents d3/d1e/d43/dbc 0 2023-12-07T16:21:45.766 INFO:tasks.workunit.client.0.smithi063.stdout:9/668: write d0/d21/fc1 [4657,32197] 0 2023-12-07T16:21:45.766 INFO:tasks.workunit.client.0.smithi063.stdout:9/669: write d0/d13/d6f/daf/dbc/fd5 [25249,33799] 0 2023-12-07T16:21:45.766 INFO:tasks.workunit.client.0.smithi063.stdout:8/908: write d7/d14/d15/d2b/fe2 [3070295,25197] 0 2023-12-07T16:21:45.768 INFO:tasks.workunit.client.0.smithi063.stdout:5/651: dread d1/f5c [0,4194304] 0 2023-12-07T16:21:45.769 INFO:tasks.workunit.client.0.smithi063.stdout:9/670: truncate d0/d21/d64/d6a/f79 191141 0 2023-12-07T16:21:45.771 INFO:tasks.workunit.client.0.smithi063.stdout:9/671: read d0/d13/fb4 [8336,77879] 0 2023-12-07T16:21:45.772 INFO:tasks.workunit.client.1.smithi152.stdout:4/911: getdents d0/d3/d6/d2b/db1/ddd 0 2023-12-07T16:21:45.773 INFO:tasks.workunit.client.0.smithi063.stdout:8/909: dread d7/d14/d15/db4/f88 [4194304,4194304] 0 2023-12-07T16:21:45.773 INFO:tasks.workunit.client.0.smithi063.stdout:8/910: truncate d7/d14/d1a/dce/fdd 1311335 0 2023-12-07T16:21:45.773 INFO:tasks.workunit.client.0.smithi063.stdout:8/911: write d7/d14/d15/dde/da8/f95 [372840,114816] 0 2023-12-07T16:21:45.774 INFO:tasks.workunit.client.0.smithi063.stdout:9/672: mknod d0/d13/d6f/daf/dbc/cde 0 2023-12-07T16:21:45.774 INFO:tasks.workunit.client.0.smithi063.stdout:9/673: write d0/d13/d39/d42/fd7 [396104,47878] 0 2023-12-07T16:21:45.774 INFO:tasks.workunit.client.0.smithi063.stdout:1/531: dread d0/dd/d19/f43 [0,4194304] 0 2023-12-07T16:21:45.774 INFO:tasks.workunit.client.0.smithi063.stdout:1/532: write d0/dd/d4f/f69 [446405,129220] 0 2023-12-07T16:21:45.774 INFO:tasks.workunit.client.1.smithi152.stdout:8/907: symlink d3/d4/d9/d34/d120/l14f 0 2023-12-07T16:21:45.775 INFO:tasks.workunit.client.0.smithi063.stdout:9/674: getdents d0/d21/d64/d6a/d8f 0 2023-12-07T16:21:45.775 INFO:tasks.workunit.client.1.smithi152.stdout:0/931: dread d0/dc/d26/f41 [0,4194304] 0 2023-12-07T16:21:45.776 INFO:tasks.workunit.client.1.smithi152.stdout:4/912: rmdir d0/d81 39 2023-12-07T16:21:45.776 INFO:tasks.workunit.client.0.smithi063.stdout:0/723: dwrite d4/dd/de/f13 [4194304,4194304] 0 2023-12-07T16:21:45.778 INFO:tasks.workunit.client.0.smithi063.stdout:1/533: rename d0/dd/d10/d13/d2f/f89 to d0/dd/d19/d50/d71/fba 0 2023-12-07T16:21:45.779 INFO:tasks.workunit.client.0.smithi063.stdout:9/675: symlink d0/d8d/ldf 0 2023-12-07T16:21:45.779 INFO:tasks.workunit.client.1.smithi152.stdout:0/932: dread d0/dc/d3d/d4c/f6a [0,4194304] 0 2023-12-07T16:21:45.781 INFO:tasks.workunit.client.1.smithi152.stdout:4/913: rename d0/d3/d6/d2b/dd9/d3a/cd2 to d0/d3/d6/d2b/dd9/d39/c117 0 2023-12-07T16:21:45.781 INFO:tasks.workunit.client.0.smithi063.stdout:0/724: link d4/dd/d26/d2b/d5e/d69/f85 d4/dd/d26/d2b/db5/d5b/ff2 0 2023-12-07T16:21:45.782 INFO:tasks.workunit.client.0.smithi063.stdout:8/912: dread d7/d14/d1a/fc8 [4194304,4194304] 0 2023-12-07T16:21:45.783 INFO:tasks.workunit.client.1.smithi152.stdout:0/933: mkdir d0/d27/d8c/df7/d30/d6e/d13d/d145 0 2023-12-07T16:21:45.783 INFO:tasks.workunit.client.1.smithi152.stdout:0/934: chown d0/dc/l95 3488 1 2023-12-07T16:21:45.784 INFO:tasks.workunit.client.0.smithi063.stdout:1/534: rename d0/dd/d4f/l70 to d0/dd/d10/d6f/lbb 0 2023-12-07T16:21:45.784 INFO:tasks.workunit.client.0.smithi063.stdout:1/535: stat d0/dd/d10/d6f/faf 0 2023-12-07T16:21:45.787 INFO:tasks.workunit.client.0.smithi063.stdout:0/725: creat d4/dd/d26/d2b/db5/d5b/d63/d6b/da8/ff3 x:0 0 0 2023-12-07T16:21:45.787 INFO:tasks.workunit.client.1.smithi152.stdout:4/914: mkdir d0/d3/d6/d2b/db1/d118 0 2023-12-07T16:21:45.787 INFO:tasks.workunit.client.1.smithi152.stdout:4/915: write d0/d3/d6/d2b/db1/ddd/f10a [771757,11452] 0 2023-12-07T16:21:45.788 INFO:tasks.workunit.client.1.smithi152.stdout:4/916: chown d0/d3/d6/f1d 62 1 2023-12-07T16:21:45.788 INFO:tasks.workunit.client.0.smithi063.stdout:0/726: write d4/dd/d26/f4f [4866770,47928] 0 2023-12-07T16:21:45.788 INFO:tasks.workunit.client.0.smithi063.stdout:5/652: dread d1/d3/de/d1e/f24 [0,4194304] 0 2023-12-07T16:21:45.789 INFO:tasks.workunit.client.0.smithi063.stdout:8/913: stat d7/d38/d73/ced 0 2023-12-07T16:21:45.792 INFO:tasks.workunit.client.0.smithi063.stdout:0/727: mkdir d4/dd/d26/d2b/db5/d5b/d63/d74/df4 0 2023-12-07T16:21:45.792 INFO:tasks.workunit.client.0.smithi063.stdout:0/728: fsync d4/d25/f2f 0 2023-12-07T16:21:45.792 INFO:tasks.workunit.client.0.smithi063.stdout:0/729: dread - d4/d25/f7d zero size 2023-12-07T16:21:45.793 INFO:tasks.workunit.client.1.smithi152.stdout:4/917: read d0/d17/d7f/f86 [1060110,72621] 0 2023-12-07T16:21:45.793 INFO:tasks.workunit.client.1.smithi152.stdout:4/918: chown d0/d3/d6/d2b/dd9/d3a/d46/d80/f114 4 1 2023-12-07T16:21:45.794 INFO:tasks.workunit.client.0.smithi063.stdout:5/653: mkdir d1/d31/d56/db7 0 2023-12-07T16:21:45.796 INFO:tasks.workunit.client.1.smithi152.stdout:4/919: unlink d0/d3/d6/d2b/db1/lc3 0 2023-12-07T16:21:45.796 INFO:tasks.workunit.client.1.smithi152.stdout:4/920: chown d0/d3/d6/d2b/d56/c66 668 1 2023-12-07T16:21:45.796 INFO:tasks.workunit.client.1.smithi152.stdout:4/921: readlink d0/d17/d7f/lf9 0 2023-12-07T16:21:45.797 INFO:tasks.workunit.client.1.smithi152.stdout:4/922: readlink d0/d3/d6/d2b/dd9/d3a/d48/l97 0 2023-12-07T16:21:45.797 INFO:tasks.workunit.client.1.smithi152.stdout:4/923: read d0/d3/d6/d2b/db1/ddd/f10a [100284,11925] 0 2023-12-07T16:21:45.797 INFO:tasks.workunit.client.1.smithi152.stdout:4/924: dread - d0/d3/d6/d2b/dd9/d3a/d46/d4e/fe5 zero size 2023-12-07T16:21:45.798 INFO:tasks.workunit.client.1.smithi152.stdout:4/925: symlink d0/d3/d6/d2b/de2/l119 0 2023-12-07T16:21:45.798 INFO:tasks.workunit.client.0.smithi063.stdout:8/914: dread f5 [0,4194304] 0 2023-12-07T16:21:45.800 INFO:tasks.workunit.client.1.smithi152.stdout:8/908: dwrite d3/d4/d9/dc/f4d [0,4194304] 0 2023-12-07T16:21:45.800 INFO:tasks.workunit.client.1.smithi152.stdout:4/926: mkdir d0/d3/d6/d2b/de2/d11a 0 2023-12-07T16:21:45.802 INFO:tasks.workunit.client.0.smithi063.stdout:1/536: dread d0/dd/d10/d1b/f2b [4194304,4194304] 0 2023-12-07T16:21:45.803 INFO:tasks.workunit.client.0.smithi063.stdout:0/730: creat d4/d25/ff5 x:0 0 0 2023-12-07T16:21:45.807 INFO:tasks.workunit.client.0.smithi063.stdout:5/654: mkdir d1/d31/db8 0 2023-12-07T16:21:45.807 INFO:tasks.workunit.client.0.smithi063.stdout:5/655: getdents d1/d31/d56/db7 0 2023-12-07T16:21:45.807 INFO:tasks.workunit.client.0.smithi063.stdout:5/656: readlink d1/d3/l72 0 2023-12-07T16:21:45.807 INFO:tasks.workunit.client.0.smithi063.stdout:5/657: dread - d1/f98 zero size 2023-12-07T16:21:45.807 INFO:tasks.workunit.client.0.smithi063.stdout:5/658: write d1/d3/f99 [680218,99973] 0 2023-12-07T16:21:45.810 INFO:tasks.workunit.client.0.smithi063.stdout:1/537: creat d0/dd/d10/d6f/da0/fbc x:0 0 0 2023-12-07T16:21:45.810 INFO:tasks.workunit.client.0.smithi063.stdout:1/538: readlink d0/dd/d10/d46/l96 0 2023-12-07T16:21:45.810 INFO:tasks.workunit.client.0.smithi063.stdout:1/539: chown d0/dd/d10 2213 1 2023-12-07T16:21:45.810 INFO:tasks.workunit.client.0.smithi063.stdout:0/731: symlink d4/d25/lf6 0 2023-12-07T16:21:45.815 INFO:tasks.workunit.client.0.smithi063.stdout:5/659: unlink d1/d3/de/d1e/fa0 0 2023-12-07T16:21:45.815 INFO:tasks.workunit.client.0.smithi063.stdout:9/676: dwrite d0/d13/d39/d42/f50 [0,4194304] 0 2023-12-07T16:21:45.815 INFO:tasks.workunit.client.0.smithi063.stdout:5/660: write d1/d31/d56/d61/d5e/d6a/fa3 [4895689,71917] 0 2023-12-07T16:21:45.815 INFO:tasks.workunit.client.0.smithi063.stdout:9/677: dread - d0/d21/d64/d6a/d8f/d92/fd6 zero size 2023-12-07T16:21:45.815 INFO:tasks.workunit.client.0.smithi063.stdout:5/661: write d1/d31/d56/d61/d5e/fb4 [375032,49631] 0 2023-12-07T16:21:45.815 INFO:tasks.workunit.client.0.smithi063.stdout:5/662: chown d1/l39 18215105 1 2023-12-07T16:21:45.815 INFO:tasks.workunit.client.0.smithi063.stdout:1/540: unlink d0/dd/f16 0 2023-12-07T16:21:45.815 INFO:tasks.workunit.client.0.smithi063.stdout:1/541: stat d0/dd/d1f/f94 0 2023-12-07T16:21:45.816 INFO:tasks.workunit.client.1.smithi152.stdout:8/909: dread d3/f1d [0,4194304] 0 2023-12-07T16:21:45.816 INFO:tasks.workunit.client.0.smithi063.stdout:9/678: write d0/d13/fca [3265852,19157] 0 2023-12-07T16:21:45.816 INFO:tasks.workunit.client.0.smithi063.stdout:9/679: fdatasync d0/d13/d39/d3a/f74 0 2023-12-07T16:21:45.817 INFO:tasks.workunit.client.1.smithi152.stdout:0/935: dwrite d0/dc/d3d/d4c/f84 [0,4194304] 0 2023-12-07T16:21:45.817 INFO:tasks.workunit.client.1.smithi152.stdout:0/936: truncate d0/dc/d36/d3a/dca/f110 1744609 0 2023-12-07T16:21:45.818 INFO:tasks.workunit.client.1.smithi152.stdout:8/910: truncate d3/fdf 160578 0 2023-12-07T16:21:45.819 INFO:tasks.workunit.client.1.smithi152.stdout:8/911: write d3/d1e/d55/d83/dae/db1/f114 [1269699,17472] 0 2023-12-07T16:21:45.819 INFO:tasks.workunit.client.1.smithi152.stdout:8/912: dread - d3/d1e/d55/d83/dc5/d123/d125/d4c/da6/f110 zero size 2023-12-07T16:21:45.820 INFO:tasks.workunit.client.1.smithi152.stdout:2/857: sync 2023-12-07T16:21:45.822 INFO:tasks.workunit.client.0.smithi063.stdout:0/732: getdents d4/dd/d26/d2b/db5/d5b/d63/d6b/da8 0 2023-12-07T16:21:45.822 INFO:tasks.workunit.client.0.smithi063.stdout:5/663: symlink d1/d31/d56/d61/d5e/d6a/d7e/lb9 0 2023-12-07T16:21:45.823 INFO:tasks.workunit.client.1.smithi152.stdout:2/858: mknod d2/c122 0 2023-12-07T16:21:45.824 INFO:tasks.workunit.client.1.smithi152.stdout:2/859: mknod d2/d1c/d2e/d30/d33/d86/dee/c123 0 2023-12-07T16:21:45.824 INFO:tasks.workunit.client.1.smithi152.stdout:2/860: stat d2 0 2023-12-07T16:21:45.825 INFO:tasks.workunit.client.0.smithi063.stdout:0/733: rename d4/f5 to d4/dd/d26/d2b/d5e/d8e/d95/ff7 0 2023-12-07T16:21:45.825 INFO:tasks.workunit.client.0.smithi063.stdout:0/734: chown d4/dd/d26/d2b/db5/d5b/fae 121600 1 2023-12-07T16:21:45.825 INFO:tasks.workunit.client.0.smithi063.stdout:5/664: mknod d1/d3/d3a/d91/cba 0 2023-12-07T16:21:45.826 INFO:tasks.workunit.client.0.smithi063.stdout:0/735: write d4/f17 [3379078,16215] 0 2023-12-07T16:21:45.826 INFO:tasks.workunit.client.0.smithi063.stdout:0/736: dread - d4/f90 zero size 2023-12-07T16:21:45.826 INFO:tasks.workunit.client.0.smithi063.stdout:5/665: mknod d1/d31/cbb 0 2023-12-07T16:21:45.829 INFO:tasks.workunit.client.0.smithi063.stdout:0/737: creat d4/dd/d26/d2b/db5/ff8 x:0 0 0 2023-12-07T16:21:45.830 INFO:tasks.workunit.client.0.smithi063.stdout:9/680: dread d0/f86 [0,4194304] 0 2023-12-07T16:21:45.830 INFO:tasks.workunit.client.0.smithi063.stdout:9/681: readlink d0/d13/d39/d3a/d78/l80 0 2023-12-07T16:21:45.831 INFO:tasks.workunit.client.0.smithi063.stdout:9/682: read d0/d13/d6f/daf/dbc/fd5 [58963,48800] 0 2023-12-07T16:21:45.831 INFO:tasks.workunit.client.1.smithi152.stdout:2/861: rename d2/d1c/d2e/d30/l6a to d2/d1c/d2e/d5d/dab/dd9/l124 0 2023-12-07T16:21:45.832 INFO:tasks.workunit.client.0.smithi063.stdout:5/666: creat d1/d3/de/d1e/fbc x:0 0 0 2023-12-07T16:21:45.832 INFO:tasks.workunit.client.0.smithi063.stdout:5/667: truncate d1/d3/de/f4a 451644 0 2023-12-07T16:21:45.832 INFO:tasks.workunit.client.0.smithi063.stdout:5/668: getdents d1/d31/d56/d61/d8f 0 2023-12-07T16:21:45.832 INFO:tasks.workunit.client.1.smithi152.stdout:0/937: dread d0/dc/d3d/f5b [0,4194304] 0 2023-12-07T16:21:45.833 INFO:tasks.workunit.client.0.smithi063.stdout:5/669: dread - d1/d3/d3a/f89 zero size 2023-12-07T16:21:45.833 INFO:tasks.workunit.client.1.smithi152.stdout:2/862: chown d2/d1c/d2e/lfd 2018833566 1 2023-12-07T16:21:45.833 INFO:tasks.workunit.client.0.smithi063.stdout:1/542: dread d0/f4b [4194304,4194304] 0 2023-12-07T16:21:45.834 INFO:tasks.workunit.client.0.smithi063.stdout:1/543: mkdir d0/dd/d19/dbd 0 2023-12-07T16:21:45.835 INFO:tasks.workunit.client.1.smithi152.stdout:4/927: dwrite d0/d3/d6/d2b/dd9/d3a/d46/dad/fda [0,4194304] 0 2023-12-07T16:21:45.835 INFO:tasks.workunit.client.1.smithi152.stdout:0/938: mkdir d0/dc/d36/d7d/d146 0 2023-12-07T16:21:45.837 INFO:tasks.workunit.client.1.smithi152.stdout:2/863: mkdir d2/d1c/d125 0 2023-12-07T16:21:45.837 INFO:tasks.workunit.client.0.smithi063.stdout:9/683: dread d0/d21/d64/d6a/d85/da4/f9e [0,4194304] 0 2023-12-07T16:21:45.837 INFO:tasks.workunit.client.0.smithi063.stdout:8/915: dwrite d7/d14/f27 [4194304,4194304] 0 2023-12-07T16:21:45.839 INFO:tasks.workunit.client.1.smithi152.stdout:0/939: rmdir d0/dc/d3d/dab/dc8/d129/d139 0 2023-12-07T16:21:45.840 INFO:tasks.workunit.client.1.smithi152.stdout:4/928: write d0/d3/f7 [8176228,112533] 0 2023-12-07T16:21:45.840 INFO:tasks.workunit.client.1.smithi152.stdout:2/864: rename d2/d9/c17 to d2/d1c/d2e/d5d/dab/c126 0 2023-12-07T16:21:45.841 INFO:tasks.workunit.client.1.smithi152.stdout:0/940: creat d0/d27/de6/f147 x:0 0 0 2023-12-07T16:21:45.844 INFO:tasks.workunit.client.0.smithi063.stdout:9/684: symlink d0/d13/le0 0 2023-12-07T16:21:45.844 INFO:tasks.workunit.client.0.smithi063.stdout:1/544: read d0/f1 [3505183,76495] 0 2023-12-07T16:21:45.844 INFO:tasks.workunit.client.0.smithi063.stdout:8/916: creat d7/d38/d8e/f124 x:0 0 0 2023-12-07T16:21:45.845 INFO:tasks.workunit.client.0.smithi063.stdout:5/670: dread d1/d31/d56/d61/f43 [0,4194304] 0 2023-12-07T16:21:45.845 INFO:tasks.workunit.client.1.smithi152.stdout:4/929: mknod d0/d3/d6/d2b/dd9/db7/ddc/c11b 0 2023-12-07T16:21:45.846 INFO:tasks.workunit.client.1.smithi152.stdout:4/930: creat d0/d3/d6/d2b/dd9/d3a/d46/d80/f11c x:0 0 0 2023-12-07T16:21:45.847 INFO:tasks.workunit.client.1.smithi152.stdout:0/941: write d0/dc/f12a [2907922,49296] 0 2023-12-07T16:21:45.848 INFO:tasks.workunit.client.1.smithi152.stdout:4/931: symlink d0/d3/d6/d2b/dd9/db7/d113/l11d 0 2023-12-07T16:21:45.849 INFO:tasks.workunit.client.0.smithi063.stdout:9/685: link d0/d21/d64/d6a/d85/da4/l20 d0/d8d/le1 0 2023-12-07T16:21:45.849 INFO:tasks.workunit.client.0.smithi063.stdout:9/686: write d0/d13/d39/f51 [5195265,123237] 0 2023-12-07T16:21:45.849 INFO:tasks.workunit.client.0.smithi063.stdout:9/687: fdatasync d0/d13/d6f/f7d 0 2023-12-07T16:21:45.849 INFO:tasks.workunit.client.0.smithi063.stdout:9/688: stat d0/d21/d64/d6a/d8f 0 2023-12-07T16:21:45.850 INFO:tasks.workunit.client.0.smithi063.stdout:8/917: creat d7/db6/f125 x:0 0 0 2023-12-07T16:21:45.850 INFO:tasks.workunit.client.0.smithi063.stdout:8/918: dread - d7/db6/f125 zero size 2023-12-07T16:21:45.850 INFO:tasks.workunit.client.1.smithi152.stdout:0/942: link d0/dc/d3d/dab/dc8/ffc d0/dc/f148 0 2023-12-07T16:21:45.850 INFO:tasks.workunit.client.1.smithi152.stdout:8/913: dwrite d3/d1e/d40/d74/f86 [0,4194304] 0 2023-12-07T16:21:45.851 INFO:tasks.workunit.client.0.smithi063.stdout:0/738: dread d4/dd/d26/f70 [0,4194304] 0 2023-12-07T16:21:45.851 INFO:tasks.workunit.client.0.smithi063.stdout:0/739: dread - d4/d25/f7d zero size 2023-12-07T16:21:45.852 INFO:tasks.workunit.client.1.smithi152.stdout:4/932: creat d0/d3/d6/d2b/dd9/d3a/d46/d9b/d10e/f11e x:0 0 0 2023-12-07T16:21:45.853 INFO:tasks.workunit.client.0.smithi063.stdout:5/671: rmdir d1/d3/d3a 39 2023-12-07T16:21:45.853 INFO:tasks.workunit.client.0.smithi063.stdout:5/672: chown d1/d31/d56/d61/d5e/d6a/fa3 775 1 2023-12-07T16:21:45.853 INFO:tasks.workunit.client.1.smithi152.stdout:0/943: link d0/dc/d3d/c66 d0/dc/d36/d3a/d51/d82/dae/c149 0 2023-12-07T16:21:45.855 INFO:tasks.workunit.client.0.smithi063.stdout:9/689: creat d0/d21/fe2 x:0 0 0 2023-12-07T16:21:45.855 INFO:tasks.workunit.client.0.smithi063.stdout:9/690: fsync d0/d21/d64/d6a/d8f/d92/f9a 0 2023-12-07T16:21:45.855 INFO:tasks.workunit.client.1.smithi152.stdout:8/914: mkdir d3/d1e/d55/d83/dc5/d123/d125/d4c/da6/db2/dc3/d137/d150 0 2023-12-07T16:21:45.855 INFO:tasks.workunit.client.1.smithi152.stdout:2/865: dwrite d2/d9/d51/d54/fc4 [0,4194304] 0 2023-12-07T16:21:45.856 INFO:tasks.workunit.client.1.smithi152.stdout:4/933: truncate d0/d3/d6/d2b/d75/f8f 2523602 0 2023-12-07T16:21:45.858 INFO:tasks.workunit.client.1.smithi152.stdout:8/915: mkdir d3/d151 0 2023-12-07T16:21:45.858 INFO:tasks.workunit.client.0.smithi063.stdout:0/740: rename d4/dd/de/d15/d59/f49 to d4/dd/de/ff9 0 2023-12-07T16:21:45.859 INFO:tasks.workunit.client.0.smithi063.stdout:0/741: fsync d4/dd/de/d15/d1f/f54 0 2023-12-07T16:21:45.859 INFO:tasks.workunit.client.0.smithi063.stdout:0/742: chown d4/dd/de/d15/d1f/d4c 429600474 1 2023-12-07T16:21:45.859 INFO:tasks.workunit.client.0.smithi063.stdout:9/691: creat d0/d21/d64/d6a/d8f/fe3 x:0 0 0 2023-12-07T16:21:45.860 INFO:tasks.workunit.client.1.smithi152.stdout:2/866: creat d2/d1c/d2e/d57/d5b/da7/d9a/dcb/d102/f127 x:0 0 0 2023-12-07T16:21:45.860 INFO:tasks.workunit.client.0.smithi063.stdout:1/545: dread d0/dd/d19/d50/f92 [4194304,4194304] 0 2023-12-07T16:21:45.861 INFO:tasks.workunit.client.0.smithi063.stdout:0/743: mknod d4/dd/d26/d2b/d5e/d8e/d95/d68/cfa 0 2023-12-07T16:21:45.861 INFO:tasks.workunit.client.0.smithi063.stdout:0/744: fsync d4/dd/de/d15/d1f/f4a 0 2023-12-07T16:21:45.862 INFO:tasks.workunit.client.1.smithi152.stdout:0/944: mknod d0/dc/d36/d3a/d51/c14a 0 2023-12-07T16:21:45.864 INFO:tasks.workunit.client.0.smithi063.stdout:9/692: creat d0/d13/d6f/daf/fe4 x:0 0 0 2023-12-07T16:21:45.865 INFO:tasks.workunit.client.0.smithi063.stdout:0/745: creat d4/dd/d26/d2b/db5/d5b/d63/d74/d84/dcc/ffb x:0 0 0 2023-12-07T16:21:45.866 INFO:tasks.workunit.client.0.smithi063.stdout:0/746: stat d4/dd/de/d15/d1f/d22/cab 0 2023-12-07T16:21:45.866 INFO:tasks.workunit.client.0.smithi063.stdout:4/586: sync 2023-12-07T16:21:45.866 INFO:tasks.workunit.client.0.smithi063.stdout:6/713: sync 2023-12-07T16:21:45.866 INFO:tasks.workunit.client.1.smithi152.stdout:2/867: unlink d2/d1c/d2e/d5d/dab/dd9/dda/l116 0 2023-12-07T16:21:45.867 INFO:tasks.workunit.client.0.smithi063.stdout:9/693: creat d0/d13/d39/d42/d57/fe5 x:0 0 0 2023-12-07T16:21:45.867 INFO:tasks.workunit.client.0.smithi063.stdout:9/694: dread - d0/d13/d39/fa7 zero size 2023-12-07T16:21:45.867 INFO:tasks.workunit.client.0.smithi063.stdout:9/695: stat d0/d13/d6f/f7d 0 2023-12-07T16:21:45.867 INFO:tasks.workunit.client.1.smithi152.stdout:4/934: dread d0/d3/d6/d2b/dd9/d39/f5e [0,4194304] 0 2023-12-07T16:21:45.867 INFO:tasks.workunit.client.1.smithi152.stdout:4/935: chown d0/d3/d6/d2b/d56 80266 1 2023-12-07T16:21:45.867 INFO:tasks.workunit.client.1.smithi152.stdout:4/936: write d0/d3/d6/d2b/fa1 [5210508,130889] 0 2023-12-07T16:21:45.869 INFO:tasks.workunit.client.1.smithi152.stdout:2/868: creat d2/d9/d51/d54/d5c/f128 x:0 0 0 2023-12-07T16:21:45.869 INFO:tasks.workunit.client.1.smithi152.stdout:2/869: truncate d2/f8 4766535 0 2023-12-07T16:21:45.869 INFO:tasks.workunit.client.1.smithi152.stdout:2/870: write d2/d1c/d2e/d30/d33/fe9 [1343490,100693] 0 2023-12-07T16:21:45.869 INFO:tasks.workunit.client.0.smithi063.stdout:6/714: symlink d0/d17/d1a/l102 0 2023-12-07T16:21:45.869 INFO:tasks.workunit.client.0.smithi063.stdout:7/666: sync 2023-12-07T16:21:45.870 INFO:tasks.workunit.client.0.smithi063.stdout:0/747: write d4/dd/d26/d2b/f33 [2714157,75419] 0 2023-12-07T16:21:45.871 INFO:tasks.workunit.client.1.smithi152.stdout:2/871: getdents d2/d1c/d2e/d57/d5b/da7/d8a 0 2023-12-07T16:21:45.872 INFO:tasks.workunit.client.1.smithi152.stdout:4/937: read d0/d3/d6/d2b/dd9/d22/f4f [3976231,91838] 0 2023-12-07T16:21:45.872 INFO:tasks.workunit.client.1.smithi152.stdout:4/938: chown d0/d3/d6/d2b/dd9/cce 758074 1 2023-12-07T16:21:45.873 INFO:tasks.workunit.client.0.smithi063.stdout:6/715: link d0/l6 d0/d17/d95/dd6/d8b/l103 0 2023-12-07T16:21:45.874 INFO:tasks.workunit.client.1.smithi152.stdout:4/939: write d0/d3/d6/d2b/dd9/d39/f5e [587087,2555] 0 2023-12-07T16:21:45.875 INFO:tasks.workunit.client.0.smithi063.stdout:7/667: mknod d2/d34/d5a/d5f/d2a/d7e/cf5 0 2023-12-07T16:21:45.875 INFO:tasks.workunit.client.1.smithi152.stdout:2/872: link d2/d1c/f69 d2/d1c/d2e/d30/d42/d91/f129 0 2023-12-07T16:21:45.876 INFO:tasks.workunit.client.0.smithi063.stdout:6/716: write d0/d17/d1a/d38/f75 [915767,7355] 0 2023-12-07T16:21:45.881 INFO:tasks.workunit.client.0.smithi063.stdout:5/673: dwrite d1/d3/de/f10 [4194304,4194304] 0 2023-12-07T16:21:45.882 INFO:tasks.workunit.client.0.smithi063.stdout:0/748: mknod d4/dd/de/d15/d1f/d4c/da1/cfc 0 2023-12-07T16:21:45.882 INFO:tasks.workunit.client.0.smithi063.stdout:7/668: unlink d2/d34/d46/f74 0 2023-12-07T16:21:45.882 INFO:tasks.workunit.client.0.smithi063.stdout:7/669: dread - d2/d37/da0/ff4 zero size 2023-12-07T16:21:45.882 INFO:tasks.workunit.client.0.smithi063.stdout:7/670: stat d2/d34/d5a/d5f/d61/f6a 0 2023-12-07T16:21:45.882 INFO:tasks.workunit.client.0.smithi063.stdout:7/671: fdatasync d2/d34/d5a/d5f/d2a/f41 0 2023-12-07T16:21:45.882 INFO:tasks.workunit.client.0.smithi063.stdout:7/672: fdatasync d2/d34/d46/d48/d70/fd2 0 2023-12-07T16:21:45.882 INFO:tasks.workunit.client.0.smithi063.stdout:5/674: write d1/d31/d56/d61/d5e/d6a/d7e/f84 [56175,67896] 0 2023-12-07T16:21:45.882 INFO:tasks.workunit.client.0.smithi063.stdout:5/675: chown d1/d3/f3b 40181340 1 2023-12-07T16:21:45.882 INFO:tasks.workunit.client.1.smithi152.stdout:2/873: symlink d2/d1c/d2e/d57/d5b/da7/d9a/l12a 0 2023-12-07T16:21:45.883 INFO:tasks.workunit.client.1.smithi152.stdout:2/874: getdents d2/d1c/d2e/d30/d33/d86/dee 0 2023-12-07T16:21:45.884 INFO:tasks.workunit.client.0.smithi063.stdout:7/673: mkdir d2/d34/d46/d48/d70/daf/dd6/df6 0 2023-12-07T16:21:45.885 INFO:tasks.workunit.client.0.smithi063.stdout:5/676: symlink d1/d31/d56/d61/d5e/d6a/da7/lbd 0 2023-12-07T16:21:45.886 INFO:tasks.workunit.client.0.smithi063.stdout:7/674: symlink d2/d34/d5a/d5f/d2a/d7e/lf7 0 2023-12-07T16:21:45.886 INFO:tasks.workunit.client.0.smithi063.stdout:7/675: fsync d2/d64/fb7 0 2023-12-07T16:21:45.888 INFO:tasks.workunit.client.0.smithi063.stdout:5/677: symlink d1/d3/de/lbe 0 2023-12-07T16:21:45.888 INFO:tasks.workunit.client.0.smithi063.stdout:5/678: chown d1/d3/de/d1e/d25/l7a 3 1 2023-12-07T16:21:45.888 INFO:tasks.workunit.client.0.smithi063.stdout:5/679: readlink d1/d3/de/l96 0 2023-12-07T16:21:45.888 INFO:tasks.workunit.client.0.smithi063.stdout:5/680: chown d1/d31/l90 32474 1 2023-12-07T16:21:45.890 INFO:tasks.workunit.client.0.smithi063.stdout:7/676: write d2/d34/d5a/d5f/d2a/f2f [1954360,33497] 0 2023-12-07T16:21:45.894 INFO:tasks.workunit.client.0.smithi063.stdout:7/677: rename d2/d34/lf0 to d2/d34/d5a/d5f/d2a/d7e/lf8 0 2023-12-07T16:21:45.895 INFO:tasks.workunit.client.0.smithi063.stdout:7/678: write d2/d34/d5a/f66 [2286886,92983] 0 2023-12-07T16:21:45.897 INFO:tasks.workunit.client.0.smithi063.stdout:1/546: dwrite d0/dd/d10/f27 [0,4194304] 0 2023-12-07T16:21:45.898 INFO:tasks.workunit.client.1.smithi152.stdout:8/916: dread d3/d1e/d55/d83/dae/db1/f114 [0,4194304] 0 2023-12-07T16:21:45.898 INFO:tasks.workunit.client.0.smithi063.stdout:7/679: mknod d2/d34/d5a/cf9 0 2023-12-07T16:21:45.899 INFO:tasks.workunit.client.1.smithi152.stdout:8/917: creat d3/d4/d4b/f152 x:0 0 0 2023-12-07T16:21:45.899 INFO:tasks.workunit.client.1.smithi152.stdout:8/918: getdents d3/d4/d9/dc/d6f/d7b 0 2023-12-07T16:21:45.900 INFO:tasks.workunit.client.0.smithi063.stdout:7/680: creat d2/d34/d5a/d5f/d53/dab/ffa x:0 0 0 2023-12-07T16:21:45.900 INFO:tasks.workunit.client.0.smithi063.stdout:7/681: readlink d2/d2c/d87/lc1 0 2023-12-07T16:21:45.900 INFO:tasks.workunit.client.0.smithi063.stdout:7/682: readlink d2/d34/d5a/l98 0 2023-12-07T16:21:45.900 INFO:tasks.workunit.client.0.smithi063.stdout:7/683: write d2/d2c/fa9 [605844,74255] 0 2023-12-07T16:21:45.900 INFO:tasks.workunit.client.0.smithi063.stdout:7/684: truncate d2/fb1 307285 0 2023-12-07T16:21:45.900 INFO:tasks.workunit.client.1.smithi152.stdout:8/919: rmdir d3/d1e/d55/d83/dae 39 2023-12-07T16:21:45.902 INFO:tasks.workunit.client.0.smithi063.stdout:7/685: write d2/d34/d5a/d5f/f16 [251060,23902] 0 2023-12-07T16:21:45.903 INFO:tasks.workunit.client.0.smithi063.stdout:7/686: mknod d2/cfb 0 2023-12-07T16:21:45.903 INFO:tasks.workunit.client.1.smithi152.stdout:8/920: unlink d3/d1e/d55/d83/dc5/d123/d125/fcb 0 2023-12-07T16:21:45.904 INFO:tasks.workunit.client.1.smithi152.stdout:8/921: truncate d3/d4/f5c 5522894 0 2023-12-07T16:21:45.905 INFO:tasks.workunit.client.0.smithi063.stdout:1/547: dread d0/dd/d19/d50/d71/f52 [0,4194304] 0 2023-12-07T16:21:45.905 INFO:tasks.workunit.client.0.smithi063.stdout:1/548: dread - d0/dd/d10/d6f/fac zero size 2023-12-07T16:21:45.906 INFO:tasks.workunit.client.0.smithi063.stdout:1/549: link d0/dd/d1f/c4a d0/dd/cbe 0 2023-12-07T16:21:45.907 INFO:tasks.workunit.client.0.smithi063.stdout:5/681: dread d1/d3/de/d1e/f78 [0,4194304] 0 2023-12-07T16:21:45.907 INFO:tasks.workunit.client.0.smithi063.stdout:1/550: creat d0/fbf x:0 0 0 2023-12-07T16:21:45.907 INFO:tasks.workunit.client.0.smithi063.stdout:5/682: symlink d1/d31/lbf 0 2023-12-07T16:21:45.908 INFO:tasks.workunit.client.0.smithi063.stdout:1/551: mkdir d0/dd/d19/d50/d72/dc0 0 2023-12-07T16:21:45.909 INFO:tasks.workunit.client.1.smithi152.stdout:8/922: write d3/d1e/d55/d83/dc5/d123/d125/f36 [3996570,84045] 0 2023-12-07T16:21:45.910 INFO:tasks.workunit.client.0.smithi063.stdout:5/683: rename d1/d3/f80 to d1/d3/d3a/fc0 0 2023-12-07T16:21:45.910 INFO:tasks.workunit.client.0.smithi063.stdout:5/684: stat d1/d3/l72 0 2023-12-07T16:21:45.910 INFO:tasks.workunit.client.0.smithi063.stdout:5/685: fsync d1/d3/d3a/d5a/f66 0 2023-12-07T16:21:45.911 INFO:tasks.workunit.client.0.smithi063.stdout:5/686: readlink d1/d3/de/d1e/d25/l6e 0 2023-12-07T16:21:45.911 INFO:tasks.workunit.client.0.smithi063.stdout:5/687: readlink d1/d3/de/l96 0 2023-12-07T16:21:45.911 INFO:tasks.workunit.client.0.smithi063.stdout:7/687: dread d2/d34/d5a/d5f/d53/fbf [0,4194304] 0 2023-12-07T16:21:45.911 INFO:tasks.workunit.client.0.smithi063.stdout:7/688: chown d2/d21/lc3 0 1 2023-12-07T16:21:45.911 INFO:tasks.workunit.client.0.smithi063.stdout:1/552: symlink d0/dd/d10/d1b/d68/lc1 0 2023-12-07T16:21:45.911 INFO:tasks.workunit.client.0.smithi063.stdout:1/553: stat d0/fbf 0 2023-12-07T16:21:45.911 INFO:tasks.workunit.client.0.smithi063.stdout:1/554: stat d0/dd/f41 0 2023-12-07T16:21:45.912 INFO:tasks.workunit.client.0.smithi063.stdout:5/688: truncate d1/d3/d3a/d5a/f66 40208 0 2023-12-07T16:21:45.912 INFO:tasks.workunit.client.0.smithi063.stdout:7/689: creat d2/d21/dc6/ffc x:0 0 0 2023-12-07T16:21:45.912 INFO:tasks.workunit.client.1.smithi152.stdout:8/923: symlink d3/d4/d9/dc/d6f/d7b/d7e/d85/l153 0 2023-12-07T16:21:45.912 INFO:tasks.workunit.client.1.smithi152.stdout:8/924: fsync d3/d1e/d43/dbc/f132 0 2023-12-07T16:21:45.913 INFO:tasks.workunit.client.1.smithi152.stdout:8/925: mkdir d3/d4/d9/dc/d6f/d7b/d7e/d12d/d67/d154 0 2023-12-07T16:21:45.913 INFO:tasks.workunit.client.0.smithi063.stdout:1/555: getdents d0/dd/d10/d13 0 2023-12-07T16:21:45.913 INFO:tasks.workunit.client.0.smithi063.stdout:9/696: dwrite d0/d21/f71 [0,4194304] 0 2023-12-07T16:21:45.914 INFO:tasks.workunit.client.0.smithi063.stdout:5/689: mknod d1/d31/cc1 0 2023-12-07T16:21:45.914 INFO:tasks.workunit.client.1.smithi152.stdout:4/940: dwrite d0/d3/d6/d2b/dd9/d22/faf [0,4194304] 0 2023-12-07T16:21:45.914 INFO:tasks.workunit.client.1.smithi152.stdout:4/941: truncate d0/d3/d6/d2b/dd9/d3a/d46/d9b/d10e/f11e 734032 0 2023-12-07T16:21:45.914 INFO:tasks.workunit.client.1.smithi152.stdout:8/926: symlink d3/d4/d9/dc/d6f/d7a/d8a/d66/d9b/d13b/l155 0 2023-12-07T16:21:45.915 INFO:tasks.workunit.client.0.smithi063.stdout:7/690: symlink d2/d34/d46/d48/d56/ddb/lfd 0 2023-12-07T16:21:45.917 INFO:tasks.workunit.client.0.smithi063.stdout:6/717: dwrite d0/d17/d1a/fc8 [0,4194304] 0 2023-12-07T16:21:45.917 INFO:tasks.workunit.client.0.smithi063.stdout:6/718: fdatasync d0/d1e/d1d/d1f/d4b/fc1 0 2023-12-07T16:21:45.919 INFO:tasks.workunit.client.0.smithi063.stdout:1/556: mknod d0/dd/d55/cc2 0 2023-12-07T16:21:45.919 INFO:tasks.workunit.client.0.smithi063.stdout:0/749: dwrite d4/dd/d26/d2b/d5e/f73 [0,4194304] 0 2023-12-07T16:21:45.921 INFO:tasks.workunit.client.0.smithi063.stdout:9/697: mknod d0/d13/d6f/daf/dbc/ce6 0 2023-12-07T16:21:45.925 INFO:tasks.workunit.client.1.smithi152.stdout:2/875: rmdir d2/d1c/d2e/d57 39 2023-12-07T16:21:45.929 INFO:tasks.workunit.client.0.smithi063.stdout:5/690: unlink d1/d3/de/d1e/f9f 0 2023-12-07T16:21:45.929 INFO:tasks.workunit.client.0.smithi063.stdout:7/691: mkdir d2/d34/d5a/d5f/d53/dab/dfe 0 2023-12-07T16:21:45.930 INFO:tasks.workunit.client.0.smithi063.stdout:6/719: symlink d0/d54/l104 0 2023-12-07T16:21:45.930 INFO:tasks.workunit.client.1.smithi152.stdout:2/876: rmdir d2/d1c/d2e/d30/d33 39 2023-12-07T16:21:45.932 INFO:tasks.workunit.client.0.smithi063.stdout:0/750: creat d4/dd/d26/d2b/db5/d5b/d63/d74/d84/dcc/ffd x:0 0 0 2023-12-07T16:21:45.935 INFO:tasks.workunit.client.1.smithi152.stdout:2/877: creat d2/d1c/d2e/d30/d33/d86/dee/d107/f12b x:0 0 0 2023-12-07T16:21:45.935 INFO:tasks.workunit.client.0.smithi063.stdout:5/691: creat d1/d3/d3a/fc2 x:0 0 0 2023-12-07T16:21:45.937 INFO:tasks.workunit.client.0.smithi063.stdout:6/720: mknod d0/d1e/d1d/d4f/c105 0 2023-12-07T16:21:45.939 INFO:tasks.workunit.client.0.smithi063.stdout:0/751: creat d4/d7e/ffe x:0 0 0 2023-12-07T16:21:45.940 INFO:tasks.workunit.client.1.smithi152.stdout:2/878: mknod d2/d9/d51/d54/c12c 0 2023-12-07T16:21:45.941 INFO:tasks.workunit.client.1.smithi152.stdout:2/879: chown d2/d1c/d2e/d57/db1/fcd 55509 1 2023-12-07T16:21:45.941 INFO:tasks.workunit.client.1.smithi152.stdout:9/963: sync 2023-12-07T16:21:45.941 INFO:tasks.workunit.client.1.smithi152.stdout:9/964: chown d1/d9/db/df/da6 1304107239 1 2023-12-07T16:21:45.942 INFO:tasks.workunit.client.1.smithi152.stdout:9/965: mkdir d1/d17/d3c/d4a/d48/d8c/d13a 0 2023-12-07T16:21:45.945 INFO:tasks.workunit.client.1.smithi152.stdout:9/966: mkdir d1/d17/d3c/d4a/d48/d8c/d13a/d13b 0 2023-12-07T16:21:45.946 INFO:tasks.workunit.client.1.smithi152.stdout:9/967: stat d1/d17/d58/d86/f87 0 2023-12-07T16:21:45.946 INFO:tasks.workunit.client.0.smithi063.stdout:6/721: mknod d0/d1e/d60/d68/d76/dae/c106 0 2023-12-07T16:21:45.946 INFO:tasks.workunit.client.0.smithi063.stdout:6/722: fsync d0/d1e/d1d/fab 0 2023-12-07T16:21:45.947 INFO:tasks.workunit.client.0.smithi063.stdout:0/752: getdents d4/dd/d26/d2b/db5/d5b/d63/d74 0 2023-12-07T16:21:45.949 INFO:tasks.workunit.client.0.smithi063.stdout:0/753: write d4/dd/d26/f70 [2625943,81918] 0 2023-12-07T16:21:45.951 INFO:tasks.workunit.client.1.smithi152.stdout:7/830: sync 2023-12-07T16:21:45.951 INFO:tasks.workunit.client.1.smithi152.stdout:7/831: write db/d27/d39/d41/d58/da5/dde/ff7 [4724332,94031] 0 2023-12-07T16:21:45.951 INFO:tasks.workunit.client.1.smithi152.stdout:7/832: dread - db/d68/fbc zero size 2023-12-07T16:21:45.951 INFO:tasks.workunit.client.1.smithi152.stdout:7/833: chown db/d27/d5e/d45/l103 479530 1 2023-12-07T16:21:45.951 INFO:tasks.workunit.client.1.smithi152.stdout:7/834: chown db/d27/d39/f6a 8067 1 2023-12-07T16:21:45.951 INFO:tasks.workunit.client.0.smithi063.stdout:6/723: rename d0/d1e/d20/d4a/ddf to d0/d1e/d60/d68/d76/da4/d107 0 2023-12-07T16:21:45.951 INFO:tasks.workunit.client.0.smithi063.stdout:5/692: dread d1/f11 [0,4194304] 0 2023-12-07T16:21:45.953 INFO:tasks.workunit.client.1.smithi152.stdout:7/835: rename db/d27/d4d/d108 to db/d27/d39/d41/d58/d109 0 2023-12-07T16:21:45.954 INFO:tasks.workunit.client.1.smithi152.stdout:7/836: readlink db/d27/d39/d41/d37/la6 0 2023-12-07T16:21:45.954 INFO:tasks.workunit.client.1.smithi152.stdout:7/837: write db/d68/f74 [145126,81096] 0 2023-12-07T16:21:45.955 INFO:tasks.workunit.client.0.smithi063.stdout:5/693: symlink d1/d3/lc3 0 2023-12-07T16:21:45.955 INFO:tasks.workunit.client.1.smithi152.stdout:7/838: mknod db/d27/d39/d41/c10a 0 2023-12-07T16:21:45.956 INFO:tasks.workunit.client.1.smithi152.stdout:7/839: write f8 [2075522,86026] 0 2023-12-07T16:21:45.957 INFO:tasks.workunit.client.1.smithi152.stdout:7/840: stat db/d27/d39/d41/d37/f64 0 2023-12-07T16:21:45.957 INFO:tasks.workunit.client.1.smithi152.stdout:7/841: chown l3 724665 1 2023-12-07T16:21:45.957 INFO:tasks.workunit.client.0.smithi063.stdout:0/754: creat d4/dd/d26/d2b/db5/d5b/d63/d74/d84/ddb/fff x:0 0 0 2023-12-07T16:21:45.957 INFO:tasks.workunit.client.0.smithi063.stdout:0/755: chown d4/dd/de/d15/d1f/c2e 988 1 2023-12-07T16:21:45.958 INFO:tasks.workunit.client.0.smithi063.stdout:1/557: dwrite d0/dd/d10/d1b/d68/f95 [0,4194304] 0 2023-12-07T16:21:45.958 INFO:tasks.workunit.client.0.smithi063.stdout:1/558: chown d0/dd/f56 2526 1 2023-12-07T16:21:45.959 INFO:tasks.workunit.client.0.smithi063.stdout:5/694: write d1/d31/d56/d61/d5e/d6a/f9b [927364,72478] 0 2023-12-07T16:21:45.960 INFO:tasks.workunit.client.1.smithi152.stdout:8/927: dwrite d3/d1e/d55/d83/dc5/d123/d125/fb9 [0,4194304] 0 2023-12-07T16:21:45.960 INFO:tasks.workunit.client.1.smithi152.stdout:8/928: chown d3/d4/f35 27961 1 2023-12-07T16:21:45.960 INFO:tasks.workunit.client.1.smithi152.stdout:8/929: readlink d3/d4/d9/d34/l6b 0 2023-12-07T16:21:45.960 INFO:tasks.workunit.client.1.smithi152.stdout:7/842: creat db/d27/d4d/dc9/f10b x:0 0 0 2023-12-07T16:21:45.960 INFO:tasks.workunit.client.1.smithi152.stdout:7/843: chown db/d27/d39/d41/d37 6950808 1 2023-12-07T16:21:45.960 INFO:tasks.workunit.client.1.smithi152.stdout:4/942: dwrite d0/d3/d6/d2b/dd9/d3a/d46/dad/fda [0,4194304] 0 2023-12-07T16:21:45.960 INFO:tasks.workunit.client.1.smithi152.stdout:4/943: dread - d0/d3/d6/d2b/dd9/d39/d93/fd1 zero size 2023-12-07T16:21:45.960 INFO:tasks.workunit.client.1.smithi152.stdout:4/944: chown d0/d3/d6/d36/cfe 27589 1 2023-12-07T16:21:45.960 INFO:tasks.workunit.client.1.smithi152.stdout:4/945: write d0/d3/d6/d36/d85/f74 [1157483,91069] 0 2023-12-07T16:21:45.962 INFO:tasks.workunit.client.1.smithi152.stdout:4/946: write d0/d3/d6/d36/d85/f74 [1149522,40859] 0 2023-12-07T16:21:45.962 INFO:tasks.workunit.client.0.smithi063.stdout:0/756: rename d4/dd/de/f7c to d4/dd/de/d15/d59/d43/dd8/f100 0 2023-12-07T16:21:45.964 INFO:tasks.workunit.client.1.smithi152.stdout:8/930: mkdir d3/d1e/d55/d83/dae/db1/d156 0 2023-12-07T16:21:45.964 INFO:tasks.workunit.client.1.smithi152.stdout:8/931: chown d3/fc8 3327 1 2023-12-07T16:21:45.964 INFO:tasks.workunit.client.1.smithi152.stdout:7/844: getdents db/d27/d39/d41/d58/da5/dde/de7 0 2023-12-07T16:21:45.964 INFO:tasks.workunit.client.0.smithi063.stdout:1/559: write d0/dd/d19/d50/d71/f64 [4161464,48893] 0 2023-12-07T16:21:45.967 INFO:tasks.workunit.client.1.smithi152.stdout:4/947: creat d0/d3/d6/d2b/dd9/d3a/d46/d80/f11f x:0 0 0 2023-12-07T16:21:45.967 INFO:tasks.workunit.client.0.smithi063.stdout:5/695: rename d1/d3/c20 to d1/d31/d56/db7/cc4 0 2023-12-07T16:21:45.967 INFO:tasks.workunit.client.0.smithi063.stdout:5/696: dread - d1/d3/d3a/f89 zero size 2023-12-07T16:21:45.972 INFO:tasks.workunit.client.1.smithi152.stdout:4/948: mkdir d0/d3/d6/d2b/dd9/d3a/d120 0 2023-12-07T16:21:45.972 INFO:tasks.workunit.client.1.smithi152.stdout:4/949: creat d0/d3/d6/f121 x:0 0 0 2023-12-07T16:21:45.972 INFO:tasks.workunit.client.1.smithi152.stdout:4/950: dread - d0/d3/d6/d2b/dd9/d3a/d48/d4c/f100 zero size 2023-12-07T16:21:45.973 INFO:tasks.workunit.client.1.smithi152.stdout:4/951: symlink d0/d3/d6/d2b/de2/df4/l122 0 2023-12-07T16:21:45.973 INFO:tasks.workunit.client.1.smithi152.stdout:7/845: mknod db/d27/d39/d41/d58/da5/dde/d100/c10c 0 2023-12-07T16:21:45.974 INFO:tasks.workunit.client.0.smithi063.stdout:0/757: creat d4/dd/d26/d2b/d5e/f101 x:0 0 0 2023-12-07T16:21:45.974 INFO:tasks.workunit.client.0.smithi063.stdout:1/560: mkdir d0/d98/d9f/dc3 0 2023-12-07T16:21:45.975 INFO:tasks.workunit.client.0.smithi063.stdout:5/697: creat d1/d3/fc5 x:0 0 0 2023-12-07T16:21:45.975 INFO:tasks.workunit.client.0.smithi063.stdout:5/698: chown d1/d3/la6 29956 1 2023-12-07T16:21:45.975 INFO:tasks.workunit.client.0.smithi063.stdout:0/758: stat d4/dd/de/d15/d1f/l57 0 2023-12-07T16:21:45.975 INFO:tasks.workunit.client.0.smithi063.stdout:0/759: write d4/dd/de/d15/f18 [1760424,69742] 0 2023-12-07T16:21:45.975 INFO:tasks.workunit.client.1.smithi152.stdout:7/846: creat db/d27/d4d/dc9/f10d x:0 0 0 2023-12-07T16:21:45.975 INFO:tasks.workunit.client.0.smithi063.stdout:5/699: dread d1/d3/de/f4a [0,4194304] 0 2023-12-07T16:21:45.976 INFO:tasks.workunit.client.0.smithi063.stdout:5/700: mkdir d1/d3/d3a/d5a/dc6 0 2023-12-07T16:21:45.977 INFO:tasks.workunit.client.1.smithi152.stdout:7/847: mkdir db/d27/d39/d41/d58/da5/dde/df2/df4/d10e 0 2023-12-07T16:21:45.978 INFO:tasks.workunit.client.1.smithi152.stdout:4/952: write d0/d3/d6/d2b/d75/f9f [3407829,55393] 0 2023-12-07T16:21:45.978 INFO:tasks.workunit.client.1.smithi152.stdout:4/953: chown d0/d3/d6/d2b/db1/ddd/f10a 0 1 2023-12-07T16:21:45.979 INFO:tasks.workunit.client.1.smithi152.stdout:4/954: readlink d0/d3/d6/l51 0 2023-12-07T16:21:45.979 INFO:tasks.workunit.client.1.smithi152.stdout:7/848: truncate db/d27/d39/d41/f4f 6210600 0 2023-12-07T16:21:45.979 INFO:tasks.workunit.client.0.smithi063.stdout:0/760: write d4/dd/de/d15/d59/d43/dd8/f100 [4081835,100246] 0 2023-12-07T16:21:45.980 INFO:tasks.workunit.client.1.smithi152.stdout:7/849: mknod db/d27/d39/d41/d58/da5/dde/df2/c10f 0 2023-12-07T16:21:45.983 INFO:tasks.workunit.client.1.smithi152.stdout:7/850: mkdir db/d27/d39/d41/d58/da5/dde/d110 0 2023-12-07T16:21:45.983 INFO:tasks.workunit.client.0.smithi063.stdout:5/701: dread d1/f65 [0,4194304] 0 2023-12-07T16:21:45.987 INFO:tasks.workunit.client.0.smithi063.stdout:5/702: creat d1/d31/d56/d61/d5e/d6a/da7/fc7 x:0 0 0 2023-12-07T16:21:45.987 INFO:tasks.workunit.client.0.smithi063.stdout:5/703: readlink d1/d31/d56/l87 0 2023-12-07T16:21:45.997 INFO:tasks.workunit.client.0.smithi063.stdout:5/704: write d1/d31/d56/d61/f43 [216479,67025] 0 2023-12-07T16:21:45.997 INFO:tasks.workunit.client.0.smithi063.stdout:5/705: write d1/f98 [974605,22293] 0 2023-12-07T16:21:46.001 INFO:tasks.workunit.client.1.smithi152.stdout:2/880: dwrite d2/d1c/d2e/d5d/dab/dd9/dda/ff7 [0,4194304] 0 2023-12-07T16:21:46.002 INFO:tasks.workunit.client.0.smithi063.stdout:7/692: dwrite d2/fb1 [0,4194304] 0 2023-12-07T16:21:46.002 INFO:tasks.workunit.client.0.smithi063.stdout:6/724: dwrite d0/d1e/d1d/d1f/d6c/fac [0,4194304] 0 2023-12-07T16:21:46.002 INFO:tasks.workunit.client.0.smithi063.stdout:6/725: fsync d0/d1e/d1d/d1f/d4b/fc1 0 2023-12-07T16:21:46.003 INFO:tasks.workunit.client.1.smithi152.stdout:2/881: rmdir d2/d1c/d2e/d5d/dab 39 2023-12-07T16:21:46.004 INFO:tasks.workunit.client.1.smithi152.stdout:2/882: getdents d2/d1c/d2e/d57/d5b/da7/d9a/da6/d119/d114 0 2023-12-07T16:21:46.005 INFO:tasks.workunit.client.1.smithi152.stdout:9/968: dwrite d1/f3a [0,4194304] 0 2023-12-07T16:21:46.005 INFO:tasks.workunit.client.1.smithi152.stdout:8/932: dwrite d3/d4/d9/d34/f134 [0,4194304] 0 2023-12-07T16:21:46.005 INFO:tasks.workunit.client.1.smithi152.stdout:8/933: stat d3/d1e/d55/d83/dc5/d123/d125/d4c/da6/db2/dd6/l10d 0 2023-12-07T16:21:46.005 INFO:tasks.workunit.client.1.smithi152.stdout:9/969: write d1/dd/dd6/de2/fad [124087,66571] 0 2023-12-07T16:21:46.005 INFO:tasks.workunit.client.1.smithi152.stdout:8/934: write d3/d1e/d55/fe9 [486600,6654] 0 2023-12-07T16:21:46.007 INFO:tasks.workunit.client.1.smithi152.stdout:2/883: read d2/d1c/d2e/d5d/de8/ffc [1902987,9824] 0 2023-12-07T16:21:46.010 INFO:tasks.workunit.client.1.smithi152.stdout:9/970: link d1/d17/d3c/fa0 d1/dd/dd6/de2/d53/f13c 0 2023-12-07T16:21:46.010 INFO:tasks.workunit.client.1.smithi152.stdout:2/884: getdents d2/d56 0 2023-12-07T16:21:46.010 INFO:tasks.workunit.client.1.smithi152.stdout:2/885: stat d2/d9/c65 0 2023-12-07T16:21:46.012 INFO:tasks.workunit.client.1.smithi152.stdout:2/886: getdents d2/d1c/d52/da8 0 2023-12-07T16:21:46.013 INFO:tasks.workunit.client.1.smithi152.stdout:2/887: chown d2/d1c/d125 9 1 2023-12-07T16:21:46.013 INFO:tasks.workunit.client.1.smithi152.stdout:2/888: write d2/d1c/d2e/d30/d33/f113 [725309,54788] 0 2023-12-07T16:21:46.014 INFO:tasks.workunit.client.1.smithi152.stdout:2/889: unlink d2/d1c/d52/f6b 0 2023-12-07T16:21:46.015 INFO:tasks.workunit.client.0.smithi063.stdout:0/761: dwrite d4/dd/d26/d2b/db5/d5b/d63/d74/d84/ddb/fff [0,4194304] 0 2023-12-07T16:21:46.015 INFO:tasks.workunit.client.0.smithi063.stdout:0/762: fdatasync d4/dd/f6a 0 2023-12-07T16:21:46.015 INFO:tasks.workunit.client.0.smithi063.stdout:0/763: dread - d4/dd/d26/d2b/db5/d5b/d63/d74/d84/dcc/ffb zero size 2023-12-07T16:21:46.016 INFO:tasks.workunit.client.1.smithi152.stdout:4/955: dwrite d0/d17/f43 [0,4194304] 0 2023-12-07T16:21:46.016 INFO:tasks.workunit.client.1.smithi152.stdout:4/956: readlink d0/d3/d6/l31 0 2023-12-07T16:21:46.016 INFO:tasks.workunit.client.1.smithi152.stdout:2/890: rmdir d2/d1c/d2e/d57/d5b/da7/d9a/da6/dbb 39 2023-12-07T16:21:46.016 INFO:tasks.workunit.client.0.smithi063.stdout:5/706: fdatasync d1/d3/de/d1e/d6b/f88 0 2023-12-07T16:21:46.017 INFO:tasks.workunit.client.0.smithi063.stdout:1/561: dwrite d0/dd/d19/f43 [4194304,4194304] 0 2023-12-07T16:21:46.018 INFO:tasks.workunit.client.0.smithi063.stdout:7/693: dread d2/d34/d5a/d5f/f18 [0,4194304] 0 2023-12-07T16:21:46.018 INFO:tasks.workunit.client.0.smithi063.stdout:7/694: chown d2/d2c/dbe 93306 1 2023-12-07T16:21:46.018 INFO:tasks.workunit.client.0.smithi063.stdout:7/695: read d2/d2c/fa9 [651574,30306] 0 2023-12-07T16:21:46.018 INFO:tasks.workunit.client.0.smithi063.stdout:7/696: dread - d2/d34/d5a/d5f/d78/fcf zero size 2023-12-07T16:21:46.019 INFO:tasks.workunit.client.1.smithi152.stdout:2/891: write d2/d1c/f7a [2382909,37484] 0 2023-12-07T16:21:46.019 INFO:tasks.workunit.client.1.smithi152.stdout:2/892: write d2/d1c/d2e/d57/f111 [602976,46436] 0 2023-12-07T16:21:46.020 INFO:tasks.workunit.client.0.smithi063.stdout:1/562: symlink d0/dd/d10/d1b/d68/db7/lc4 0 2023-12-07T16:21:46.021 INFO:tasks.workunit.client.0.smithi063.stdout:7/697: mknod d2/d34/d5a/d5f/d2a/db8/cff 0 2023-12-07T16:21:46.025 INFO:tasks.workunit.client.0.smithi063.stdout:5/707: dread d1/d3/de/d1e/d6b/f7d [0,4194304] 0 2023-12-07T16:21:46.026 INFO:tasks.workunit.client.0.smithi063.stdout:1/563: dread d0/dd/d10/d46/f58 [0,4194304] 0 2023-12-07T16:21:46.030 INFO:tasks.workunit.client.0.smithi063.stdout:1/564: link d0/dd/d55/c77 d0/dd/d10/d1b/d68/db7/cc5 0 2023-12-07T16:21:46.030 INFO:tasks.workunit.client.1.smithi152.stdout:7/851: rmdir db/d27/d39/d41/d58/da5/dde/df2 39 2023-12-07T16:21:46.030 INFO:tasks.workunit.client.1.smithi152.stdout:4/957: creat d0/d3/d6/d2b/dd9/d3a/d120/f123 x:0 0 0 2023-12-07T16:21:46.031 INFO:tasks.workunit.client.0.smithi063.stdout:1/565: creat d0/dd/d10/d1b/d68/db7/fc6 x:0 0 0 2023-12-07T16:21:46.031 INFO:tasks.workunit.client.1.smithi152.stdout:2/893: mknod d2/d1c/d2e/d57/d5b/da7/d9a/dcb/c12d 0 2023-12-07T16:21:46.034 INFO:tasks.workunit.client.0.smithi063.stdout:5/708: rename d1/d31/d56/d61/d5e/d6a/da7 to d1/d31/dc8 0 2023-12-07T16:21:46.034 INFO:tasks.workunit.client.1.smithi152.stdout:8/935: write d3/d4/d9/dc/d6f/d7b/d7e/d12d/d67/fe4 [2303594,96501] 0 2023-12-07T16:21:46.036 INFO:tasks.workunit.client.0.smithi063.stdout:5/709: creat d1/d3/d3a/d5a/dc6/fc9 x:0 0 0 2023-12-07T16:21:46.036 INFO:tasks.workunit.client.0.smithi063.stdout:5/710: write d1/f32 [4571269,73814] 0 2023-12-07T16:21:46.038 INFO:tasks.workunit.client.1.smithi152.stdout:8/936: creat d3/d4/d9/dc/d6f/d7a/d8a/d66/d9b/f157 x:0 0 0 2023-12-07T16:21:46.038 INFO:tasks.workunit.client.1.smithi152.stdout:8/937: write d3/d4/d9/d34/de5/f14e [669761,51430] 0 2023-12-07T16:21:46.039 INFO:tasks.workunit.client.0.smithi063.stdout:5/711: symlink d1/d31/d56/d61/lca 0 2023-12-07T16:21:46.041 INFO:tasks.workunit.client.1.smithi152.stdout:8/938: mknod d3/d1e/d55/d83/dc5/d123/d125/d4c/da6/db2/c158 0 2023-12-07T16:21:46.044 INFO:tasks.workunit.client.1.smithi152.stdout:8/939: rename d3/d4/d9/dad/db3 to d3/d1e/d55/d83/dc5/d123/d125/d4c/da6/db2/dc3/d159 0 2023-12-07T16:21:46.044 INFO:tasks.workunit.client.1.smithi152.stdout:8/940: dread - d3/d1e/d55/d83/dae/fef zero size 2023-12-07T16:21:46.044 INFO:tasks.workunit.client.1.smithi152.stdout:4/958: dread d0/d3/fbe [0,4194304] 0 2023-12-07T16:21:46.045 INFO:tasks.workunit.client.1.smithi152.stdout:8/941: creat d3/f15a x:0 0 0 2023-12-07T16:21:46.049 INFO:tasks.workunit.client.1.smithi152.stdout:9/971: dwrite d1/d17/d58/d86/dd9/f11d [0,4194304] 0 2023-12-07T16:21:46.050 INFO:tasks.workunit.client.1.smithi152.stdout:6/879: sync 2023-12-07T16:21:46.050 INFO:tasks.workunit.client.1.smithi152.stdout:6/880: fdatasync d2/d4f/d83/d85/f80 0 2023-12-07T16:21:46.050 INFO:tasks.workunit.client.1.smithi152.stdout:6/881: dread - d2/d4f/d83/d85/d19/d1f/f11b zero size 2023-12-07T16:21:46.051 INFO:tasks.workunit.client.1.smithi152.stdout:3/945: sync 2023-12-07T16:21:46.057 INFO:tasks.workunit.client.1.smithi152.stdout:6/882: getdents d2/d4f/d83 0 2023-12-07T16:21:46.060 INFO:tasks.workunit.client.1.smithi152.stdout:6/883: link d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/dfc/f10c d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/f11d 0 2023-12-07T16:21:46.062 INFO:tasks.workunit.client.1.smithi152.stdout:8/942: dread d3/d1e/f9c [0,4194304] 0 2023-12-07T16:21:46.062 INFO:tasks.workunit.client.1.smithi152.stdout:6/884: creat d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/f11e x:0 0 0 2023-12-07T16:21:46.064 INFO:tasks.workunit.client.1.smithi152.stdout:8/943: symlink d3/d1e/d55/d83/dc5/d123/d125/d4c/da6/db2/l15b 0 2023-12-07T16:21:46.064 INFO:tasks.workunit.client.1.smithi152.stdout:8/944: chown d3/d4/d9/d34/c5b 17 1 2023-12-07T16:21:46.064 INFO:tasks.workunit.client.1.smithi152.stdout:8/945: write d3/d1e/d55/d83/dc5/df0/f11b [308174,47778] 0 2023-12-07T16:21:46.064 INFO:tasks.workunit.client.1.smithi152.stdout:6/885: creat d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/d55/f11f x:0 0 0 2023-12-07T16:21:46.064 INFO:tasks.workunit.client.1.smithi152.stdout:6/886: chown d2/d4f/d83/d85/d19/d1f/dc7/dc9/cb3 3055440 1 2023-12-07T16:21:46.065 INFO:tasks.workunit.client.1.smithi152.stdout:3/946: dread d7/d10/d1a/d2f/d56/d57/dee/dda/d6b/fd3 [0,4194304] 0 2023-12-07T16:21:46.065 INFO:tasks.workunit.client.1.smithi152.stdout:6/887: creat d2/d4f/d83/da0/da2/f120 x:0 0 0 2023-12-07T16:21:46.066 INFO:tasks.workunit.client.1.smithi152.stdout:3/947: symlink d7/d10/l12c 0 2023-12-07T16:21:46.068 INFO:tasks.workunit.client.1.smithi152.stdout:6/888: mkdir d2/d4f/d83/d92/d121 0 2023-12-07T16:21:46.068 INFO:tasks.workunit.client.1.smithi152.stdout:6/889: truncate d2/d4f/d83/da0/fce 5043684 0 2023-12-07T16:21:46.068 INFO:tasks.workunit.client.1.smithi152.stdout:6/890: chown d2/d4f/d83/c18 306374995 1 2023-12-07T16:21:46.069 INFO:tasks.workunit.client.1.smithi152.stdout:6/891: symlink d2/d4f/d83/d48/d70/d81/d116/l122 0 2023-12-07T16:21:46.072 INFO:tasks.workunit.client.1.smithi152.stdout:6/892: dread d2/d4f/d83/d85/f63 [0,4194304] 0 2023-12-07T16:21:46.072 INFO:tasks.workunit.client.1.smithi152.stdout:3/948: dread d7/d10/d1a/d25/f27 [0,4194304] 0 2023-12-07T16:21:46.073 INFO:tasks.workunit.client.1.smithi152.stdout:7/852: dwrite db/d27/d5e/dee/ffa [0,4194304] 0 2023-12-07T16:21:46.074 INFO:tasks.workunit.client.1.smithi152.stdout:6/893: link d2/d4f/d83/d58/l5b d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/l123 0 2023-12-07T16:21:46.078 INFO:tasks.workunit.client.1.smithi152.stdout:0/945: sync 2023-12-07T16:21:46.078 INFO:tasks.workunit.client.1.smithi152.stdout:0/946: fsync d0/dc/d36/f9c 0 2023-12-07T16:21:46.080 INFO:tasks.workunit.client.1.smithi152.stdout:0/947: link d0/d27/d8c/df7/l55 d0/dc/d3d/d4c/l14b 0 2023-12-07T16:21:46.083 INFO:tasks.workunit.client.0.smithi063.stdout:3/676: sync 2023-12-07T16:21:46.085 INFO:tasks.workunit.client.1.smithi152.stdout:0/948: rename d0/dc/d36/d7d/d92/de9/fec to d0/d27/d8c/df7/d30/d6e/d77/d113/f14c 0 2023-12-07T16:21:46.087 INFO:tasks.workunit.client.0.smithi063.stdout:1/566: dwrite d0/dd/d19/d50/d72/f83 [0,4194304] 0 2023-12-07T16:21:46.087 INFO:tasks.workunit.client.0.smithi063.stdout:1/567: stat d0/dd/ca2 0 2023-12-07T16:21:46.087 INFO:tasks.workunit.client.0.smithi063.stdout:3/677: creat d7/d49/d4b/fdd x:0 0 0 2023-12-07T16:21:46.087 INFO:tasks.workunit.client.0.smithi063.stdout:3/678: write d7/d49/d4b/fd6 [568293,82250] 0 2023-12-07T16:21:46.087 INFO:tasks.workunit.client.0.smithi063.stdout:3/679: write d7/d4f/d53/d72/db1/f3d [2007341,48128] 0 2023-12-07T16:21:46.087 INFO:tasks.workunit.client.1.smithi152.stdout:0/949: unlink d0/dc/d3d/fde 0 2023-12-07T16:21:46.088 INFO:tasks.workunit.client.0.smithi063.stdout:3/680: unlink d7/d4f/d53/d72/d7d/ca2 0 2023-12-07T16:21:46.089 INFO:tasks.workunit.client.1.smithi152.stdout:0/950: link d0/dc/d36/d3a/d69/fad d0/d27/de6/f14d 0 2023-12-07T16:21:46.090 INFO:tasks.workunit.client.0.smithi063.stdout:3/681: creat d7/d4f/fde x:0 0 0 2023-12-07T16:21:46.092 INFO:tasks.workunit.client.0.smithi063.stdout:3/682: rename d7/d8d/c9b to d7/d9/dd/d56/cdf 0 2023-12-07T16:21:46.092 INFO:tasks.workunit.client.0.smithi063.stdout:3/683: readlink d7/d4f/d53/ld3 0 2023-12-07T16:21:46.093 INFO:tasks.workunit.client.0.smithi063.stdout:5/712: dwrite d1/f2a [0,4194304] 0 2023-12-07T16:21:46.093 INFO:tasks.workunit.client.0.smithi063.stdout:3/684: creat d7/d9/d1b/d5c/fe0 x:0 0 0 2023-12-07T16:21:46.094 INFO:tasks.workunit.client.0.smithi063.stdout:3/685: readlink l2 0 2023-12-07T16:21:46.094 INFO:tasks.workunit.client.0.smithi063.stdout:3/686: dread - d7/f4c zero size 2023-12-07T16:21:46.096 INFO:tasks.workunit.client.0.smithi063.stdout:5/713: creat d1/d31/fcb x:0 0 0 2023-12-07T16:21:46.109 INFO:tasks.workunit.client.1.smithi152.stdout:0/951: write d0/d27/d8c/df7/d30/d6e/d77/f96 [2976461,110049] 0 2023-12-07T16:21:46.110 INFO:tasks.workunit.client.0.smithi063.stdout:5/714: dread d1/d3/de/d1e/d25/f3c [0,4194304] 0 2023-12-07T16:21:46.110 INFO:tasks.workunit.client.0.smithi063.stdout:5/715: fsync d1/d3/de/d1e/f27 0 2023-12-07T16:21:46.110 INFO:tasks.workunit.client.0.smithi063.stdout:5/716: truncate d1/d3/d3a/fa8 257508 0 2023-12-07T16:21:46.110 INFO:tasks.workunit.client.0.smithi063.stdout:5/717: fsync d1/d3/de/d1e/f78 0 2023-12-07T16:21:46.110 INFO:tasks.workunit.client.0.smithi063.stdout:5/718: fsync d1/f40 0 2023-12-07T16:21:46.110 INFO:tasks.workunit.client.0.smithi063.stdout:5/719: readlink d1/d3/de/d1e/l3e 0 2023-12-07T16:21:46.111 INFO:tasks.workunit.client.1.smithi152.stdout:0/952: symlink d0/dc/d36/d7d/d92/l14e 0 2023-12-07T16:21:46.111 INFO:tasks.workunit.client.0.smithi063.stdout:5/720: creat d1/d31/d56/d61/fcc x:0 0 0 2023-12-07T16:21:46.112 INFO:tasks.workunit.client.0.smithi063.stdout:5/721: mkdir d1/d3/d3a/dcd 0 2023-12-07T16:21:46.113 INFO:tasks.workunit.client.0.smithi063.stdout:5/722: symlink d1/d3/d3a/d91/lce 0 2023-12-07T16:21:46.113 INFO:tasks.workunit.client.0.smithi063.stdout:5/723: chown d1/d3/d3a/d5a/dc6/fc9 5181513 1 2023-12-07T16:21:46.113 INFO:tasks.workunit.client.1.smithi152.stdout:0/953: write d0/dc/d36/d7d/d136/dcb/f118 [4053944,51420] 0 2023-12-07T16:21:46.113 INFO:tasks.workunit.client.0.smithi063.stdout:5/724: mkdir d1/d31/d56/d61/d5e/d6a/d7e/dcf 0 2023-12-07T16:21:46.116 INFO:tasks.workunit.client.1.smithi152.stdout:0/954: rename d0/dc/f22 to d0/d27/d8c/df7/d30/f14f 0 2023-12-07T16:21:46.116 INFO:tasks.workunit.client.0.smithi063.stdout:5/725: rename d1/d3/de/d1e/d25 to d1/d3/de/d1e/d6b/dd0 0 2023-12-07T16:21:46.116 INFO:tasks.workunit.client.1.smithi152.stdout:2/894: dwrite d2/d9/d51/d54/f11b [0,4194304] 0 2023-12-07T16:21:46.117 INFO:tasks.workunit.client.1.smithi152.stdout:0/955: mkdir d0/dc/d3d/dab/dc8/d129/d150 0 2023-12-07T16:21:46.117 INFO:tasks.workunit.client.0.smithi063.stdout:5/726: rename d1/d3/de/d1e/d6b/dd0/c30 to d1/d3/d3a/d5a/dc6/cd1 0 2023-12-07T16:21:46.118 INFO:tasks.workunit.client.0.smithi063.stdout:5/727: creat d1/d3/fd2 x:0 0 0 2023-12-07T16:21:46.118 INFO:tasks.workunit.client.0.smithi063.stdout:5/728: chown d1/cb5 251809 1 2023-12-07T16:21:46.121 INFO:tasks.workunit.client.1.smithi152.stdout:0/956: write d0/d27/d8c/df7/d30/f4a [1764308,45123] 0 2023-12-07T16:21:46.121 INFO:tasks.workunit.client.1.smithi152.stdout:0/957: getdents d0/dc/d36/d7d 0 2023-12-07T16:21:46.123 INFO:tasks.workunit.client.1.smithi152.stdout:7/853: dwrite db/d27/f91 [0,4194304] 0 2023-12-07T16:21:46.123 INFO:tasks.workunit.client.1.smithi152.stdout:7/854: chown db/d27/d39/d41/d58/f73 134 1 2023-12-07T16:21:46.123 INFO:tasks.workunit.client.1.smithi152.stdout:4/959: dwrite d0/d3/d6/f26 [0,4194304] 0 2023-12-07T16:21:46.123 INFO:tasks.workunit.client.1.smithi152.stdout:8/946: dwrite d3/d4/d9/dc/d6f/d7b/d7e/fa1 [0,4194304] 0 2023-12-07T16:21:46.123 INFO:tasks.workunit.client.1.smithi152.stdout:0/958: mknod d0/dc/c151 0 2023-12-07T16:21:46.123 INFO:tasks.workunit.client.1.smithi152.stdout:6/894: dwrite d2/d4f/d83/d85/f6a [0,4194304] 0 2023-12-07T16:21:46.124 INFO:tasks.workunit.client.1.smithi152.stdout:3/949: dwrite d7/d10/d1a/d25/fd2 [0,4194304] 0 2023-12-07T16:21:46.124 INFO:tasks.workunit.client.0.smithi063.stdout:1/568: dwrite d0/dd/d19/d50/f6a [0,4194304] 0 2023-12-07T16:21:46.124 INFO:tasks.workunit.client.0.smithi063.stdout:3/687: dwrite d7/d9/d1b/d5c/fe0 [0,4194304] 0 2023-12-07T16:21:46.126 INFO:tasks.workunit.client.1.smithi152.stdout:7/855: symlink db/d27/d39/l111 0 2023-12-07T16:21:46.131 INFO:tasks.workunit.client.1.smithi152.stdout:7/856: write db/d27/d4d/f6d [538030,126892] 0 2023-12-07T16:21:46.131 INFO:tasks.workunit.client.1.smithi152.stdout:7/857: dread - db/d27/d39/fe1 zero size 2023-12-07T16:21:46.135 INFO:tasks.workunit.client.1.smithi152.stdout:8/947: rmdir d3/d1e/d43/dbc/d13c 0 2023-12-07T16:21:46.136 INFO:tasks.workunit.client.0.smithi063.stdout:1/569: creat d0/dd/d19/d50/fc7 x:0 0 0 2023-12-07T16:21:46.136 INFO:tasks.workunit.client.1.smithi152.stdout:0/959: truncate d0/f49 2876999 0 2023-12-07T16:21:46.140 INFO:tasks.workunit.client.1.smithi152.stdout:6/895: symlink d2/d4f/d83/d48/da8/l124 0 2023-12-07T16:21:46.142 INFO:tasks.workunit.client.0.smithi063.stdout:1/570: truncate d0/dd/d10/f85 2600874 0 2023-12-07T16:21:46.147 INFO:tasks.workunit.client.1.smithi152.stdout:6/896: read d2/d4f/d83/d48/d70/da7/db7/fd1 [2846557,7722] 0 2023-12-07T16:21:46.147 INFO:tasks.workunit.client.1.smithi152.stdout:3/950: mknod d7/d10/d1a/d2f/d5c/dbf/c12d 0 2023-12-07T16:21:46.147 INFO:tasks.workunit.client.0.smithi063.stdout:5/729: rename d1/d31/d56/d61/d5e/d6a to d1/d3/d3a/dcd/dd3 0 2023-12-07T16:21:46.147 INFO:tasks.workunit.client.0.smithi063.stdout:5/730: write d1/d3/d3a/d5a/f85 [8870934,55570] 0 2023-12-07T16:21:46.150 INFO:tasks.workunit.client.1.smithi152.stdout:3/951: mknod d7/d10/d1a/d2f/d56/d57/dee/dda/d6b/d80/dc2/dbe/c12e 0 2023-12-07T16:21:46.150 INFO:tasks.workunit.client.1.smithi152.stdout:3/952: read - d7/d10/d1a/d2f/d56/d57/dee/dda/d6b/f114 zero size 2023-12-07T16:21:46.150 INFO:tasks.workunit.client.0.smithi063.stdout:1/571: rename d0/f8f to d0/dd/d19/dbd/fc8 0 2023-12-07T16:21:46.152 INFO:tasks.workunit.client.1.smithi152.stdout:8/948: dread d3/d1e/d55/f64 [0,4194304] 0 2023-12-07T16:21:46.153 INFO:tasks.workunit.client.1.smithi152.stdout:8/949: chown d3/d4/l9e 17134302 1 2023-12-07T16:21:46.153 INFO:tasks.workunit.client.0.smithi063.stdout:1/572: write d0/dd/d19/d50/d71/f64 [3124191,122466] 0 2023-12-07T16:21:46.153 INFO:tasks.workunit.client.0.smithi063.stdout:5/731: symlink d1/d3/d3a/d5a/ld4 0 2023-12-07T16:21:46.153 INFO:tasks.workunit.client.0.smithi063.stdout:5/732: stat d1/d3 0 2023-12-07T16:21:46.166 INFO:tasks.workunit.client.0.smithi063.stdout:5/733: dread d1/d3/d3a/dcd/dd3/fa3 [0,4194304] 0 2023-12-07T16:21:46.166 INFO:tasks.workunit.client.0.smithi063.stdout:5/734: chown d1/f7 875672320 1 2023-12-07T16:21:46.167 INFO:tasks.workunit.client.0.smithi063.stdout:5/735: write d1/d3/de/d1e/faa [403883,85346] 0 2023-12-07T16:21:46.168 INFO:tasks.workunit.client.1.smithi152.stdout:2/895: dwrite d2/d9/d51/d54/f11b [0,4194304] 0 2023-12-07T16:21:46.169 INFO:tasks.workunit.client.0.smithi063.stdout:5/736: mknod d1/cd5 0 2023-12-07T16:21:46.170 INFO:tasks.workunit.client.0.smithi063.stdout:5/737: creat d1/d31/d56/d61/d5e/fd6 x:0 0 0 2023-12-07T16:21:46.180 INFO:tasks.workunit.client.1.smithi152.stdout:2/896: dread d2/d1c/d2e/d30/d42/f92 [0,4194304] 0 2023-12-07T16:21:46.180 INFO:tasks.workunit.client.1.smithi152.stdout:2/897: fsync d2/d9/d51/d54/fb4 0 2023-12-07T16:21:46.180 INFO:tasks.workunit.client.1.smithi152.stdout:2/898: readlink d2/d1c/d2e/d57/db1/d90/ldb 0 2023-12-07T16:21:46.183 INFO:tasks.workunit.client.1.smithi152.stdout:2/899: read d2/d1c/d2e/d57/db1/f3b [596490,72311] 0 2023-12-07T16:21:46.183 INFO:tasks.workunit.client.1.smithi152.stdout:2/900: chown d2/d1c/d52/da8/db6/c104 188555411 1 2023-12-07T16:21:46.190 INFO:tasks.workunit.client.1.smithi152.stdout:4/960: dwrite d0/d3/d6/d2b/d75/f9f [4194304,4194304] 0 2023-12-07T16:21:46.191 INFO:tasks.workunit.client.1.smithi152.stdout:4/961: mknod d0/d3/d6/d2b/dd9/d3a/d48/c124 0 2023-12-07T16:21:46.204 INFO:tasks.workunit.client.1.smithi152.stdout:7/858: dwrite db/d27/d5e/d45/fc3 [0,4194304] 0 2023-12-07T16:21:46.204 INFO:tasks.workunit.client.1.smithi152.stdout:7/859: chown db/d27 5939441 1 2023-12-07T16:21:46.204 INFO:tasks.workunit.client.0.smithi063.stdout:3/688: dwrite d7/d9/f9e [0,4194304] 0 2023-12-07T16:21:46.206 INFO:tasks.workunit.client.1.smithi152.stdout:6/897: dwrite d2/d4f/d83/d48/d70/da7/db7/f50 [0,4194304] 0 2023-12-07T16:21:46.207 INFO:tasks.workunit.client.1.smithi152.stdout:8/950: dwrite d3/d4/d9/dc/d6f/d7a/f89 [0,4194304] 0 2023-12-07T16:21:46.207 INFO:tasks.workunit.client.1.smithi152.stdout:8/951: chown d3/d1e/d55/d83/dc5/d123/d125/d4c/da6 0 1 2023-12-07T16:21:46.207 INFO:tasks.workunit.client.1.smithi152.stdout:8/952: chown d3/d4/d9/dc/d6f/d7b/dbd/dc4/d13d/lff 2 1 2023-12-07T16:21:46.208 INFO:tasks.workunit.client.1.smithi152.stdout:3/953: dwrite d7/d10/d1a/d25/d78/fbc [0,4194304] 0 2023-12-07T16:21:46.208 INFO:tasks.workunit.client.1.smithi152.stdout:2/901: dwrite d2/d9/d51/d54/fc4 [0,4194304] 0 2023-12-07T16:21:46.208 INFO:tasks.workunit.client.1.smithi152.stdout:2/902: fdatasync d2/d9/d51/d54/fb4 0 2023-12-07T16:21:46.208 INFO:tasks.workunit.client.1.smithi152.stdout:2/903: fdatasync d2/fe0 0 2023-12-07T16:21:46.208 INFO:tasks.workunit.client.1.smithi152.stdout:2/904: fsync d2/d1c/d2e/d30/d33/fe9 0 2023-12-07T16:21:46.208 INFO:tasks.workunit.client.1.smithi152.stdout:7/860: creat db/d1c/f112 x:0 0 0 2023-12-07T16:21:46.208 INFO:tasks.workunit.client.1.smithi152.stdout:7/861: fdatasync f8 0 2023-12-07T16:21:46.208 INFO:tasks.workunit.client.1.smithi152.stdout:7/862: readlink db/l12 0 2023-12-07T16:21:46.209 INFO:tasks.workunit.client.1.smithi152.stdout:8/953: read d3/d1e/f30 [723993,69566] 0 2023-12-07T16:21:46.211 INFO:tasks.workunit.client.1.smithi152.stdout:6/898: creat d2/d4f/d83/d92/d121/f125 x:0 0 0 2023-12-07T16:21:46.211 INFO:tasks.workunit.client.0.smithi063.stdout:1/573: dwrite d0/dd/f3b [0,4194304] 0 2023-12-07T16:21:46.212 INFO:tasks.workunit.client.1.smithi152.stdout:0/960: dwrite d0/dc/d3d/f5b [0,4194304] 0 2023-12-07T16:21:46.214 INFO:tasks.workunit.client.1.smithi152.stdout:7/863: write db/d27/d39/d41/d58/f59 [1909678,96082] 0 2023-12-07T16:21:46.214 INFO:tasks.workunit.client.1.smithi152.stdout:7/864: getdents db/d1c/dd0/ddb 0 2023-12-07T16:21:46.214 INFO:tasks.workunit.client.1.smithi152.stdout:7/865: read - db/d27/d5e/d45/f9e zero size 2023-12-07T16:21:46.214 INFO:tasks.workunit.client.0.smithi063.stdout:5/738: rmdir d1/d31/d56/d61/d5e 39 2023-12-07T16:21:46.216 INFO:tasks.workunit.client.1.smithi152.stdout:0/961: write d0/d27/d8c/df7/f74 [3002439,6269] 0 2023-12-07T16:21:46.216 INFO:tasks.workunit.client.1.smithi152.stdout:0/962: getdents d0/dc/d36/d3a/d51/d82/d13c 0 2023-12-07T16:21:46.216 INFO:tasks.workunit.client.1.smithi152.stdout:0/963: chown d0/dc/d3d/d73/dbf/dc9/f142 9444235 1 2023-12-07T16:21:46.218 INFO:tasks.workunit.client.0.smithi063.stdout:5/739: getdents d1/d3/d3a/d5a 0 2023-12-07T16:21:46.220 INFO:tasks.workunit.client.1.smithi152.stdout:6/899: unlink d2/d4f/d83/d48/d70/fd9 0 2023-12-07T16:21:46.224 INFO:tasks.workunit.client.1.smithi152.stdout:2/905: write d2/d1c/d2e/d57/db1/d90/f39 [5115025,34676] 0 2023-12-07T16:21:46.229 INFO:tasks.workunit.client.1.smithi152.stdout:7/866: mknod db/d27/d39/d41/d58/d109/c113 0 2023-12-07T16:21:46.230 INFO:tasks.workunit.client.1.smithi152.stdout:7/867: read - db/d27/d39/d41/d58/da5/fca zero size 2023-12-07T16:21:46.230 INFO:tasks.workunit.client.1.smithi152.stdout:7/868: write db/d27/d39/d41/d37/fa3 [295989,114581] 0 2023-12-07T16:21:46.230 INFO:tasks.workunit.client.1.smithi152.stdout:6/900: truncate d2/d4f/d83/d85/f25 3847460 0 2023-12-07T16:21:46.232 INFO:tasks.workunit.client.1.smithi152.stdout:2/906: mknod d2/d1c/d2e/d57/d5b/da7/ddd/c12e 0 2023-12-07T16:21:46.234 INFO:tasks.workunit.client.1.smithi152.stdout:6/901: mkdir d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d10a/d126 0 2023-12-07T16:21:46.234 INFO:tasks.workunit.client.1.smithi152.stdout:7/869: write db/d27/d39/d41/d37/f67 [1732825,33499] 0 2023-12-07T16:21:46.234 INFO:tasks.workunit.client.1.smithi152.stdout:7/870: truncate db/d27/d39/d63/f9b 67807 0 2023-12-07T16:21:46.234 INFO:tasks.workunit.client.0.smithi063.stdout:2/775: sync 2023-12-07T16:21:46.234 INFO:tasks.workunit.client.0.smithi063.stdout:2/776: dread - d0/d21/d56/fd5 zero size 2023-12-07T16:21:46.235 INFO:tasks.workunit.client.1.smithi152.stdout:8/954: dread d3/d4/d9/dc/d6f/d7b/d7e/d12d/d67/fa0 [0,4194304] 0 2023-12-07T16:21:46.236 INFO:tasks.workunit.client.1.smithi152.stdout:2/907: rename d2/d9/d51/d54/fc4 to d2/d1c/d2e/d57/d5b/da7/d8a/f12f 0 2023-12-07T16:21:46.241 INFO:tasks.workunit.client.1.smithi152.stdout:7/871: write db/d27/f3b [1962195,101890] 0 2023-12-07T16:21:46.245 INFO:tasks.workunit.client.1.smithi152.stdout:8/955: dread d3/d4/d9/dc/d6f/fba [0,4194304] 0 2023-12-07T16:21:46.246 INFO:tasks.workunit.client.1.smithi152.stdout:7/872: creat db/d27/d39/d41/d58/f114 x:0 0 0 2023-12-07T16:21:46.259 INFO:tasks.workunit.client.0.smithi063.stdout:3/689: dwrite d7/d21/f34 [0,4194304] 0 2023-12-07T16:21:46.261 INFO:tasks.workunit.client.0.smithi063.stdout:3/690: creat d7/d49/dbf/fe1 x:0 0 0 2023-12-07T16:21:46.265 INFO:tasks.workunit.client.1.smithi152.stdout:9/972: sync 2023-12-07T16:21:46.265 INFO:tasks.workunit.client.1.smithi152.stdout:9/973: stat d1/d9/d4f/lfb 0 2023-12-07T16:21:46.265 INFO:tasks.workunit.client.1.smithi152.stdout:9/974: chown d1/d9/db/df/da6/c103 2006189997 1 2023-12-07T16:21:46.268 INFO:tasks.workunit.client.1.smithi152.stdout:9/975: creat d1/d17/d3c/d4a/dc6/d12a/de8/df8/f13d x:0 0 0 2023-12-07T16:21:46.269 INFO:tasks.workunit.client.1.smithi152.stdout:9/976: getdents d1/d17/d3c/d4a/dc6/d12a 0 2023-12-07T16:21:46.269 INFO:tasks.workunit.client.1.smithi152.stdout:9/977: read - d1/d9/d4f/fc8 zero size 2023-12-07T16:21:46.271 INFO:tasks.workunit.client.1.smithi152.stdout:9/978: rename d1/d17/d58 to d1/d17/d3c/d4a/d48/d8c/d13e 0 2023-12-07T16:21:46.288 INFO:tasks.workunit.client.1.smithi152.stdout:3/954: dwrite d7/d10/d1a/d2f/d115/f118 [0,4194304] 0 2023-12-07T16:21:46.288 INFO:tasks.workunit.client.1.smithi152.stdout:3/955: readlink d7/d10/d1a/d25/d4b/l102 0 2023-12-07T16:21:46.291 INFO:tasks.workunit.client.1.smithi152.stdout:3/956: link d7/dc/fc9 d7/dc/d14/f12f 0 2023-12-07T16:21:46.293 INFO:tasks.workunit.client.1.smithi152.stdout:3/957: rename d7/d10/d1a/d2f/d56/d57/dee/dda/d6b/l9c to d7/d10/d1a/d2f/d56/d57/dee/dda/d6b/l130 0 2023-12-07T16:21:46.294 INFO:tasks.workunit.client.1.smithi152.stdout:3/958: truncate d7/d10/d1a/d2f/d56/d57/dee/dda/f95 3332726 0 2023-12-07T16:21:46.295 INFO:tasks.workunit.client.1.smithi152.stdout:3/959: mkdir d7/d10/d1a/d131 0 2023-12-07T16:21:46.295 INFO:tasks.workunit.client.1.smithi152.stdout:3/960: chown d7/dc/c3c 10962333 1 2023-12-07T16:21:46.295 INFO:tasks.workunit.client.1.smithi152.stdout:3/961: readlink d7/d10/d1a/d25/d78/l11d 0 2023-12-07T16:21:46.298 INFO:tasks.workunit.client.0.smithi063.stdout:5/740: dwrite d1/d3/de/f1f [0,4194304] 0 2023-12-07T16:21:46.299 INFO:tasks.workunit.client.0.smithi063.stdout:1/574: dwrite d0/dd/d10/d13/d2f/f7c [0,4194304] 0 2023-12-07T16:21:46.299 INFO:tasks.workunit.client.0.smithi063.stdout:1/575: write d0/dd/d10/d1b/f51 [848462,1097] 0 2023-12-07T16:21:46.309 INFO:tasks.workunit.client.1.smithi152.stdout:0/964: dwrite d0/d27/d8c/df7/fd1 [0,4194304] 0 2023-12-07T16:21:46.309 INFO:tasks.workunit.client.1.smithi152.stdout:2/908: dwrite d2/d1c/f7a [0,4194304] 0 2023-12-07T16:21:46.312 INFO:tasks.workunit.client.1.smithi152.stdout:0/965: link d0/dc/d36/d3a/d51/d82/l9e d0/dc/d3d/d73/dbf/l152 0 2023-12-07T16:21:46.312 INFO:tasks.workunit.client.1.smithi152.stdout:0/966: getdents d0/d27/de6/d11f 0 2023-12-07T16:21:46.312 INFO:tasks.workunit.client.1.smithi152.stdout:2/909: creat d2/d1c/d2e/d30/d42/f130 x:0 0 0 2023-12-07T16:21:46.313 INFO:tasks.workunit.client.1.smithi152.stdout:0/967: rename d0/d27/f59 to d0/dc/d36/d3a/d51/d82/d13c/f153 0 2023-12-07T16:21:46.314 INFO:tasks.workunit.client.1.smithi152.stdout:2/910: mknod d2/d1c/d2e/d30/d33/c131 0 2023-12-07T16:21:46.317 INFO:tasks.workunit.client.1.smithi152.stdout:2/911: write d2/d1c/d2e/d57/db1/d90/fac [1140362,36013] 0 2023-12-07T16:21:46.317 INFO:tasks.workunit.client.1.smithi152.stdout:0/968: dread d0/dc/d26/f63 [0,4194304] 0 2023-12-07T16:21:46.317 INFO:tasks.workunit.client.1.smithi152.stdout:0/969: fdatasync d0/dc/f34 0 2023-12-07T16:21:46.318 INFO:tasks.workunit.client.1.smithi152.stdout:2/912: symlink d2/d1c/d2e/d30/d33/d86/dee/d107/l132 0 2023-12-07T16:21:46.319 INFO:tasks.workunit.client.1.smithi152.stdout:2/913: truncate d2/d9/d51/f63 342643 0 2023-12-07T16:21:46.321 INFO:tasks.workunit.client.1.smithi152.stdout:6/902: dwrite d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/df9/ffd [0,4194304] 0 2023-12-07T16:21:46.321 INFO:tasks.workunit.client.1.smithi152.stdout:6/903: write d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/d55/fdd [540933,105319] 0 2023-12-07T16:21:46.322 INFO:tasks.workunit.client.1.smithi152.stdout:2/914: rename d2/d9/d51/d54/d5c to d2/d1c/d2e/d5d/daf/d133 0 2023-12-07T16:21:46.322 INFO:tasks.workunit.client.1.smithi152.stdout:2/915: dread - d2/fe0 zero size 2023-12-07T16:21:46.322 INFO:tasks.workunit.client.1.smithi152.stdout:2/916: chown d2/c122 672753892 1 2023-12-07T16:21:46.322 INFO:tasks.workunit.client.1.smithi152.stdout:2/917: fsync d2/d1c/d2e/d30/d33/fd5 0 2023-12-07T16:21:46.323 INFO:tasks.workunit.client.1.smithi152.stdout:7/873: dwrite db/d27/d4d/f6d [4194304,4194304] 0 2023-12-07T16:21:46.323 INFO:tasks.workunit.client.1.smithi152.stdout:7/874: chown db/d27/l57 117 1 2023-12-07T16:21:46.324 INFO:tasks.workunit.client.0.smithi063.stdout:3/691: dwrite d7/d9/d1b/f2c [0,4194304] 0 2023-12-07T16:21:46.324 INFO:tasks.workunit.client.1.smithi152.stdout:3/962: dwrite d7/d10/d1a/d2f/d115/f11b [4194304,4194304] 0 2023-12-07T16:21:46.324 INFO:tasks.workunit.client.1.smithi152.stdout:6/904: unlink d2/d4f/d83/d85/d19/d1f/cac 0 2023-12-07T16:21:46.324 INFO:tasks.workunit.client.1.smithi152.stdout:9/979: dwrite d1/d9/d4f/d83/fab [0,4194304] 0 2023-12-07T16:21:46.325 INFO:tasks.workunit.client.1.smithi152.stdout:8/956: dwrite d3/d1e/d55/fe9 [0,4194304] 0 2023-12-07T16:21:46.325 INFO:tasks.workunit.client.1.smithi152.stdout:8/957: fdatasync d3/d4/d9/dc/d6f/d7b/d7e/d85/fd8 0 2023-12-07T16:21:46.325 INFO:tasks.workunit.client.0.smithi063.stdout:2/777: dwrite d0/d21/d39/f51 [0,4194304] 0 2023-12-07T16:21:46.327 INFO:tasks.workunit.client.1.smithi152.stdout:7/875: symlink db/d27/d39/d41/dcb/l115 0 2023-12-07T16:21:46.327 INFO:tasks.workunit.client.0.smithi063.stdout:1/576: dwrite d0/dd/d1f/d75/fb2 [0,4194304] 0 2023-12-07T16:21:46.327 INFO:tasks.workunit.client.0.smithi063.stdout:1/577: read - d0/fbf zero size 2023-12-07T16:21:46.328 INFO:tasks.workunit.client.1.smithi152.stdout:3/963: mknod d7/d10/c132 0 2023-12-07T16:21:46.330 INFO:tasks.workunit.client.1.smithi152.stdout:9/980: creat d1/d17/d3c/d4a/d48/f13f x:0 0 0 2023-12-07T16:21:46.332 INFO:tasks.workunit.client.0.smithi063.stdout:1/578: mkdir d0/dd/d55/dc9 0 2023-12-07T16:21:46.333 INFO:tasks.workunit.client.0.smithi063.stdout:1/579: fsync d0/dd/d10/d6f/fab 0 2023-12-07T16:21:46.335 INFO:tasks.workunit.client.0.smithi063.stdout:1/580: unlink d0/dd/d10/d1b/f2b 0 2023-12-07T16:21:46.337 INFO:tasks.workunit.client.1.smithi152.stdout:2/918: mknod d2/d1c/d2e/c134 0 2023-12-07T16:21:46.340 INFO:tasks.workunit.client.1.smithi152.stdout:0/970: dwrite d0/dc/d3d/d73/d128/d68/f12b [0,4194304] 0 2023-12-07T16:21:46.340 INFO:tasks.workunit.client.1.smithi152.stdout:0/971: truncate d0/dc/d3d/d73/f138 252356 0 2023-12-07T16:21:46.340 INFO:tasks.workunit.client.1.smithi152.stdout:3/964: mkdir d7/d10/d1a/d25/d133 0 2023-12-07T16:21:46.341 INFO:tasks.workunit.client.1.smithi152.stdout:7/876: link db/c8e db/d27/d5e/d104/d106/c116 0 2023-12-07T16:21:46.341 INFO:tasks.workunit.client.1.smithi152.stdout:9/981: creat d1/d9/db/d70/f140 x:0 0 0 2023-12-07T16:21:46.343 INFO:tasks.workunit.client.0.smithi063.stdout:8/919: sync 2023-12-07T16:21:46.344 INFO:tasks.workunit.client.0.smithi063.stdout:7/698: sync 2023-12-07T16:21:46.344 INFO:tasks.workunit.client.0.smithi063.stdout:6/726: sync 2023-12-07T16:21:46.344 INFO:tasks.workunit.client.0.smithi063.stdout:0/764: sync 2023-12-07T16:21:46.344 INFO:tasks.workunit.client.0.smithi063.stdout:7/699: fsync d2/d34/d5a/d5f/d53/da3/f8e 0 2023-12-07T16:21:46.344 INFO:tasks.workunit.client.0.smithi063.stdout:7/700: chown d2/d34/d46/d48/d70/l7b 1826 1 2023-12-07T16:21:46.344 INFO:tasks.workunit.client.0.smithi063.stdout:7/701: chown d2/d34/d46/d48/d56/ddb/le2 8 1 2023-12-07T16:21:46.344 INFO:tasks.workunit.client.0.smithi063.stdout:7/702: chown d2/d34/l45 15831836 1 2023-12-07T16:21:46.344 INFO:tasks.workunit.client.0.smithi063.stdout:7/703: chown d2/d34/d5a/d5f/d61/cbb 21 1 2023-12-07T16:21:46.344 INFO:tasks.workunit.client.0.smithi063.stdout:7/704: dread - d2/d21/dc6/ffc zero size 2023-12-07T16:21:46.344 INFO:tasks.workunit.client.1.smithi152.stdout:6/905: dread d2/d4f/d83/d58/f93 [0,4194304] 0 2023-12-07T16:21:46.345 INFO:tasks.workunit.client.0.smithi063.stdout:7/705: rename d2/d37/cda to d2/d34/d5a/c100 0 2023-12-07T16:21:46.345 INFO:tasks.workunit.client.0.smithi063.stdout:1/581: dread d0/dd/d19/fa1 [0,4194304] 0 2023-12-07T16:21:46.346 INFO:tasks.workunit.client.1.smithi152.stdout:0/972: mknod d0/d27/d8c/df7/d30/d6e/d13d/c154 0 2023-12-07T16:21:46.346 INFO:tasks.workunit.client.1.smithi152.stdout:0/973: chown d0/dc/d3d/dab/dc8 5021168 1 2023-12-07T16:21:46.346 INFO:tasks.workunit.client.1.smithi152.stdout:0/974: fsync d0/dc/f34 0 2023-12-07T16:21:46.346 INFO:tasks.workunit.client.1.smithi152.stdout:7/877: link db/d27/d39/f66 db/d27/d4d/dfb/f117 0 2023-12-07T16:21:46.348 INFO:tasks.workunit.client.0.smithi063.stdout:1/582: rename d0/dd/d1f/d75/fb2 to d0/dd/d10/d1b/fca 0 2023-12-07T16:21:46.348 INFO:tasks.workunit.client.1.smithi152.stdout:9/982: creat d1/d9/d4f/f141 x:0 0 0 2023-12-07T16:21:46.349 INFO:tasks.workunit.client.1.smithi152.stdout:9/983: write d1/d9/d2d/d46/f109 [63932,98066] 0 2023-12-07T16:21:46.349 INFO:tasks.workunit.client.1.smithi152.stdout:6/906: link d2/l3a d2/d105/l127 0 2023-12-07T16:21:46.350 INFO:tasks.workunit.client.0.smithi063.stdout:1/583: rename d0/dd/d1f/f65 to d0/dd/d1f/d75/fcb 0 2023-12-07T16:21:46.352 INFO:tasks.workunit.client.0.smithi063.stdout:1/584: link d0/dd/d10/d13/d2f/fb1 d0/dd/d10/d6f/da0/fcc 0 2023-12-07T16:21:46.354 INFO:tasks.workunit.client.1.smithi152.stdout:0/975: rename d0/dc/d36/d7d/d136/dcb to d0/d27/d8c/df7/d30/d6e/d77/d113/d117/d155 0 2023-12-07T16:21:46.354 INFO:tasks.workunit.client.1.smithi152.stdout:0/976: fsync d0/dc/d3d/d73/f138 0 2023-12-07T16:21:46.354 INFO:tasks.workunit.client.1.smithi152.stdout:0/977: fsync d0/dc/d36/d3a/d69/f12f 0 2023-12-07T16:21:46.354 INFO:tasks.workunit.client.0.smithi063.stdout:1/585: symlink d0/dd/d19/d50/lcd 0 2023-12-07T16:21:46.354 INFO:tasks.workunit.client.0.smithi063.stdout:1/586: readlink d0/dd/d10/d6f/lbb 0 2023-12-07T16:21:46.355 INFO:tasks.workunit.client.0.smithi063.stdout:1/587: truncate d0/dd/d10/d13/f3d 4731518 0 2023-12-07T16:21:46.355 INFO:tasks.workunit.client.0.smithi063.stdout:7/706: write d2/d64/fb7 [2214435,56591] 0 2023-12-07T16:21:46.355 INFO:tasks.workunit.client.1.smithi152.stdout:7/878: unlink db/d27/d5e/dee/ffa 0 2023-12-07T16:21:46.355 INFO:tasks.workunit.client.1.smithi152.stdout:3/965: dread d7/d10/d1a/d2f/d5c/df6/d6d/d84/f85 [0,4194304] 0 2023-12-07T16:21:46.356 INFO:tasks.workunit.client.1.smithi152.stdout:7/879: truncate db/d27/d39/d41/d58/da5/ff1 203698 0 2023-12-07T16:21:46.356 INFO:tasks.workunit.client.1.smithi152.stdout:3/966: truncate d7/d10/d1a/d25/f27 2324421 0 2023-12-07T16:21:46.356 INFO:tasks.workunit.client.1.smithi152.stdout:7/880: fsync db/d27/d39/d41/d58/da5/dde/de7/fed 0 2023-12-07T16:21:46.357 INFO:tasks.workunit.client.0.smithi063.stdout:1/588: rename d0/dd/d10/d1b/d68/cae to d0/dd/d1f/cce 0 2023-12-07T16:21:46.357 INFO:tasks.workunit.client.0.smithi063.stdout:1/589: write d0/dd/d19/f8b [1125594,33407] 0 2023-12-07T16:21:46.357 INFO:tasks.workunit.client.0.smithi063.stdout:0/765: dread d4/f17 [4194304,4194304] 0 2023-12-07T16:21:46.358 INFO:tasks.workunit.client.1.smithi152.stdout:9/984: creat d1/d9/d4f/d83/d101/f142 x:0 0 0 2023-12-07T16:21:46.358 INFO:tasks.workunit.client.0.smithi063.stdout:7/707: mkdir d2/d34/d5a/d5f/d53/dab/db5/d101 0 2023-12-07T16:21:46.359 INFO:tasks.workunit.client.1.smithi152.stdout:6/907: mknod d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/df9/d10b/c128 0 2023-12-07T16:21:46.359 INFO:tasks.workunit.client.0.smithi063.stdout:6/727: dread d0/d1e/d1d/d1f/d4b/fc1 [0,4194304] 0 2023-12-07T16:21:46.359 INFO:tasks.workunit.client.0.smithi063.stdout:1/590: creat d0/dd/d19/d50/d72/dc0/fcf x:0 0 0 2023-12-07T16:21:46.361 INFO:tasks.workunit.client.0.smithi063.stdout:7/708: symlink d2/d34/l102 0 2023-12-07T16:21:46.362 INFO:tasks.workunit.client.0.smithi063.stdout:6/728: mkdir d0/d1e/d60/d68/d76/da4/dcc/d108 0 2023-12-07T16:21:46.362 INFO:tasks.workunit.client.1.smithi152.stdout:0/978: rename d0/d27/d8c/df7/d30/d6e/d77/l11c to d0/dc/d3d/d73/d128/l156 0 2023-12-07T16:21:46.364 INFO:tasks.workunit.client.1.smithi152.stdout:7/881: unlink db/d27/d39/d41/dcb/l115 0 2023-12-07T16:21:46.364 INFO:tasks.workunit.client.1.smithi152.stdout:7/882: readlink db/d27/d5e/d45/da9/lf6 0 2023-12-07T16:21:46.364 INFO:tasks.workunit.client.0.smithi063.stdout:7/709: mkdir d2/d34/d46/d48/d103 0 2023-12-07T16:21:46.364 INFO:tasks.workunit.client.0.smithi063.stdout:6/729: creat d0/d17/d46/f109 x:0 0 0 2023-12-07T16:21:46.367 INFO:tasks.workunit.client.1.smithi152.stdout:9/985: stat d1/d9/d2d/d65/lf0 0 2023-12-07T16:21:46.367 INFO:tasks.workunit.client.1.smithi152.stdout:2/919: dwrite d2/d1c/f41 [0,4194304] 0 2023-12-07T16:21:46.367 INFO:tasks.workunit.client.1.smithi152.stdout:3/967: getdents d7/d10/d1a/d2f/d5c/df6/d6d/d98 0 2023-12-07T16:21:46.367 INFO:tasks.workunit.client.0.smithi063.stdout:3/692: dwrite d7/fa [4194304,4194304] 0 2023-12-07T16:21:46.367 INFO:tasks.workunit.client.0.smithi063.stdout:3/693: chown d7/d4f/d53/cc4 1883 1 2023-12-07T16:21:46.367 INFO:tasks.workunit.client.0.smithi063.stdout:2/778: dwrite d0/d21/d56/d11/d52/d5d/f5f [4194304,4194304] 0 2023-12-07T16:21:46.367 INFO:tasks.workunit.client.0.smithi063.stdout:2/779: readlink d0/d67/d65/la1 0 2023-12-07T16:21:46.370 INFO:tasks.workunit.client.0.smithi063.stdout:6/730: rename d0/l14 to d0/d17/d1a/d38/d64/l10a 0 2023-12-07T16:21:46.370 INFO:tasks.workunit.client.1.smithi152.stdout:6/908: creat d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d10a/d126/f129 x:0 0 0 2023-12-07T16:21:46.370 INFO:tasks.workunit.client.1.smithi152.stdout:0/979: creat d0/dc/d3d/dab/dc8/d129/f157 x:0 0 0 2023-12-07T16:21:46.371 INFO:tasks.workunit.client.1.smithi152.stdout:7/883: creat db/d27/d39/d41/d58/da5/f118 x:0 0 0 2023-12-07T16:21:46.373 INFO:tasks.workunit.client.0.smithi063.stdout:3/694: creat d7/d9/dd/d7f/fe2 x:0 0 0 2023-12-07T16:21:46.374 INFO:tasks.workunit.client.1.smithi152.stdout:2/920: write d2/d1c/d2e/f46 [5327167,52623] 0 2023-12-07T16:21:46.376 INFO:tasks.workunit.client.0.smithi063.stdout:2/780: rename d0/d67/d65/d6a/fca to d0/d21/db2/dce/ffc 0 2023-12-07T16:21:46.377 INFO:tasks.workunit.client.0.smithi063.stdout:6/731: getdents d0/d1e/d60/d68/d76/da4/dc6 0 2023-12-07T16:21:46.378 INFO:tasks.workunit.client.0.smithi063.stdout:6/732: dread - d0/d1e/d60/d68/d78/d9c/d9f/db8/fed zero size 2023-12-07T16:21:46.378 INFO:tasks.workunit.client.1.smithi152.stdout:0/980: mkdir d0/dc/d3d/d73/d128/d68/d158 0 2023-12-07T16:21:46.378 INFO:tasks.workunit.client.1.smithi152.stdout:6/909: rmdir d2 39 2023-12-07T16:21:46.378 INFO:tasks.workunit.client.1.smithi152.stdout:6/910: dread - d2/d4f/d83/d85/f80 zero size 2023-12-07T16:21:46.379 INFO:tasks.workunit.client.0.smithi063.stdout:2/781: getdents d0/d21/d39 0 2023-12-07T16:21:46.379 INFO:tasks.workunit.client.0.smithi063.stdout:2/782: fsync d0/d67/d5b/db3/fc6 0 2023-12-07T16:21:46.379 INFO:tasks.workunit.client.1.smithi152.stdout:2/921: link d2/d1c/d2e/d30/f10d d2/d1c/d2e/d30/d42/d84/f135 0 2023-12-07T16:21:46.379 INFO:tasks.workunit.client.1.smithi152.stdout:9/986: dread d1/d17/d3c/d4a/dc6/d12a/de8/df8/f10d [0,4194304] 0 2023-12-07T16:21:46.379 INFO:tasks.workunit.client.1.smithi152.stdout:2/922: truncate d2/d9/f98 799729 0 2023-12-07T16:21:46.381 INFO:tasks.workunit.client.1.smithi152.stdout:6/911: symlink d2/d4f/d83/d85/d65/d100/l12a 0 2023-12-07T16:21:46.381 INFO:tasks.workunit.client.1.smithi152.stdout:6/912: chown d2/d4f/d83/d48/d70/d81/f112 196887422 1 2023-12-07T16:21:46.381 INFO:tasks.workunit.client.1.smithi152.stdout:6/913: fsync d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/f86 0 2023-12-07T16:21:46.381 INFO:tasks.workunit.client.1.smithi152.stdout:6/914: write d2/d4f/d83/d85/d19/d1f/dc7/dc9/fa4 [4276027,48320] 0 2023-12-07T16:21:46.385 INFO:tasks.workunit.client.0.smithi063.stdout:2/783: dread d0/d21/d56/d11/d52/d5d/dbb/f6e [0,4194304] 0 2023-12-07T16:21:46.385 INFO:tasks.workunit.client.0.smithi063.stdout:2/784: stat d0/d67/d65/d6a 0 2023-12-07T16:21:46.386 INFO:tasks.workunit.client.1.smithi152.stdout:7/884: dread db/d27/f3d [0,4194304] 0 2023-12-07T16:21:46.386 INFO:tasks.workunit.client.1.smithi152.stdout:9/987: symlink d1/dd/dd6/l143 0 2023-12-07T16:21:46.387 INFO:tasks.workunit.client.1.smithi152.stdout:4/962: sync 2023-12-07T16:21:46.387 INFO:tasks.workunit.client.1.smithi152.stdout:4/963: chown d0/d17/d7f/ld4 493280 1 2023-12-07T16:21:46.390 INFO:tasks.workunit.client.1.smithi152.stdout:7/885: rename db/d27/d39/d41/d37/f64 to db/d27/d39/d41/d58/da5/dde/d110/f119 0 2023-12-07T16:21:46.390 INFO:tasks.workunit.client.0.smithi063.stdout:2/785: rename d0/d21/d39/f4e to d0/d21/d56/d11/d52/da9/ffd 0 2023-12-07T16:21:46.390 INFO:tasks.workunit.client.0.smithi063.stdout:2/786: truncate d0/d21/d56/fa2 544818 0 2023-12-07T16:21:46.390 INFO:tasks.workunit.client.0.smithi063.stdout:2/787: chown d0/d67/d65/d6a/d8e/lb5 58 1 2023-12-07T16:21:46.390 INFO:tasks.workunit.client.0.smithi063.stdout:2/788: stat d0/d21/d56/d11/d52/da9/daf/dcd 0 2023-12-07T16:21:46.390 INFO:tasks.workunit.client.0.smithi063.stdout:2/789: stat d0/d21/d56/d71 0 2023-12-07T16:21:46.393 INFO:tasks.workunit.client.1.smithi152.stdout:6/915: dread d2/f24 [0,4194304] 0 2023-12-07T16:21:46.393 INFO:tasks.workunit.client.0.smithi063.stdout:3/695: dread d7/ff [0,4194304] 0 2023-12-07T16:21:46.395 INFO:tasks.workunit.client.1.smithi152.stdout:9/988: creat d1/d17/d3c/d4a/dc6/d12a/f144 x:0 0 0 2023-12-07T16:21:46.395 INFO:tasks.workunit.client.1.smithi152.stdout:4/964: creat d0/d17/df5/f125 x:0 0 0 2023-12-07T16:21:46.395 INFO:tasks.workunit.client.1.smithi152.stdout:9/989: write d1/d9/d2d/d72/d80/da4/f102 [468213,118884] 0 2023-12-07T16:21:46.396 INFO:tasks.workunit.client.1.smithi152.stdout:7/886: creat db/d27/d39/d41/dcb/f11a x:0 0 0 2023-12-07T16:21:46.396 INFO:tasks.workunit.client.0.smithi063.stdout:3/696: read d7/d9/dd/f1e [553778,56791] 0 2023-12-07T16:21:46.396 INFO:tasks.workunit.client.0.smithi063.stdout:3/697: fdatasync d7/d4f/d53/d72/db1/f8b 0 2023-12-07T16:21:46.398 INFO:tasks.workunit.client.1.smithi152.stdout:2/923: dread d2/d1c/d2e/d57/d5b/da7/fbd [0,4194304] 0 2023-12-07T16:21:46.398 INFO:tasks.workunit.client.1.smithi152.stdout:2/924: chown d2/d1c/d2e/d5d 1398739 1 2023-12-07T16:21:46.399 INFO:tasks.workunit.client.0.smithi063.stdout:3/698: truncate d7/d4f/d53/d72/db1/f8b 3126357 0 2023-12-07T16:21:46.399 INFO:tasks.workunit.client.1.smithi152.stdout:6/916: mknod d2/d4f/d83/d92/c12b 0 2023-12-07T16:21:46.402 INFO:tasks.workunit.client.1.smithi152.stdout:2/925: mknod d2/d1c/d2e/d57/d5b/c136 0 2023-12-07T16:21:46.403 INFO:tasks.workunit.client.1.smithi152.stdout:2/926: rename d2/d1c/d2e/d30/d42/d84/lf3 to d2/d1c/d2e/d57/db1/l137 0 2023-12-07T16:21:46.404 INFO:tasks.workunit.client.0.smithi063.stdout:7/710: getdents d2/d34 0 2023-12-07T16:21:46.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:46 smithi063 ceph-mon[112095]: pgmap v30: 65 pgs: 65 active+clean; 2.9 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 170 MiB/s rd, 346 MiB/s wr, 507 op/s 2023-12-07T16:21:46.406 INFO:tasks.workunit.client.1.smithi152.stdout:9/990: write d1/d17/d3c/d4a/d48/f59 [1798822,77579] 0 2023-12-07T16:21:46.407 INFO:tasks.workunit.client.1.smithi152.stdout:2/927: rename d2/d1c/d2e/d5d/f7c to d2/d9/d51/f138 0 2023-12-07T16:21:46.409 INFO:tasks.workunit.client.0.smithi063.stdout:2/790: dread d0/d21/d56/d11/f58 [0,4194304] 0 2023-12-07T16:21:46.411 INFO:tasks.workunit.client.0.smithi063.stdout:4/587: sync 2023-12-07T16:21:46.411 INFO:tasks.workunit.client.0.smithi063.stdout:2/791: mknod d0/d21/d56/cfe 0 2023-12-07T16:21:46.412 INFO:tasks.workunit.client.1.smithi152.stdout:9/991: write d1/d17/d4e/ff2 [267111,23332] 0 2023-12-07T16:21:46.413 INFO:tasks.workunit.client.0.smithi063.stdout:3/699: dread d7/d9/dd/f66 [0,4194304] 0 2023-12-07T16:21:46.413 INFO:tasks.workunit.client.0.smithi063.stdout:2/792: symlink d0/d21/d56/d11/d52/d63/lff 0 2023-12-07T16:21:46.416 INFO:tasks.workunit.client.0.smithi063.stdout:3/700: symlink d7/d9/le3 0 2023-12-07T16:21:46.416 INFO:tasks.workunit.client.0.smithi063.stdout:4/588: write d1/d3/db/f56 [2271353,67914] 0 2023-12-07T16:21:46.417 INFO:tasks.workunit.client.0.smithi063.stdout:3/701: write d7/d4f/f55 [910200,94671] 0 2023-12-07T16:21:46.417 INFO:tasks.workunit.client.0.smithi063.stdout:3/702: truncate d7/d4f/d53/d72/db1/f9f 928014 0 2023-12-07T16:21:46.417 INFO:tasks.workunit.client.0.smithi063.stdout:2/793: rename d0/l32 to d0/d21/db2/l100 0 2023-12-07T16:21:46.420 INFO:tasks.workunit.client.0.smithi063.stdout:3/703: write d7/d9/f18 [6158266,35743] 0 2023-12-07T16:21:46.422 INFO:tasks.workunit.client.0.smithi063.stdout:0/766: dwrite d4/dd/de/d15/d1f/d4c/fbb [0,4194304] 0 2023-12-07T16:21:46.422 INFO:tasks.workunit.client.0.smithi063.stdout:0/767: chown d4/dd/de/d15/d59/d43/d91 2 1 2023-12-07T16:21:46.422 INFO:tasks.workunit.client.0.smithi063.stdout:0/768: readlink d4/dd/d26/d2b/l92 0 2023-12-07T16:21:46.422 INFO:tasks.workunit.client.0.smithi063.stdout:2/794: write d0/d21/d56/f20 [382204,53527] 0 2023-12-07T16:21:46.422 INFO:tasks.workunit.client.0.smithi063.stdout:3/704: creat d7/d9/d1b/d5c/fe4 x:0 0 0 2023-12-07T16:21:46.422 INFO:tasks.workunit.client.0.smithi063.stdout:3/705: stat d7/d9/d1b/db8 0 2023-12-07T16:21:46.432 INFO:tasks.workunit.client.0.smithi063.stdout:0/769: unlink d4/dd/de/d15/d1f/d22/c9f 0 2023-12-07T16:21:46.432 INFO:tasks.workunit.client.0.smithi063.stdout:2/795: rename d0/d67/d65/fe1 to d0/d21/d56/d11/d52/dad/f101 0 2023-12-07T16:21:46.432 INFO:tasks.workunit.client.0.smithi063.stdout:3/706: creat d7/d49/fe5 x:0 0 0 2023-12-07T16:21:46.434 INFO:tasks.workunit.client.0.smithi063.stdout:2/796: mknod d0/c102 0 2023-12-07T16:21:46.435 INFO:tasks.workunit.client.0.smithi063.stdout:3/707: mkdir d7/d4f/d53/d72/db1/de6 0 2023-12-07T16:21:46.436 INFO:tasks.workunit.client.0.smithi063.stdout:2/797: symlink d0/d67/d65/l103 0 2023-12-07T16:21:46.436 INFO:tasks.workunit.client.0.smithi063.stdout:2/798: truncate d0/d21/d56/d11/d6d/fd8 917421 0 2023-12-07T16:21:46.437 INFO:tasks.workunit.client.0.smithi063.stdout:3/708: link d7/l17 d7/d4f/d53/d72/db1/d41/le7 0 2023-12-07T16:21:46.437 INFO:tasks.workunit.client.0.smithi063.stdout:3/709: truncate d7/d4f/d53/d72/db1/d41/f86 1767473 0 2023-12-07T16:21:46.437 INFO:tasks.workunit.client.0.smithi063.stdout:3/710: stat d7/d4f/d53/d54 0 2023-12-07T16:21:46.439 INFO:tasks.workunit.client.0.smithi063.stdout:2/799: creat d0/d21/d56/d11/f104 x:0 0 0 2023-12-07T16:21:46.439 INFO:tasks.workunit.client.0.smithi063.stdout:2/800: dread - d0/d21/d56/d11/d6d/fea zero size 2023-12-07T16:21:46.444 INFO:tasks.workunit.client.0.smithi063.stdout:2/801: write d0/d21/fdf [1752844,17864] 0 2023-12-07T16:21:46.444 INFO:tasks.workunit.client.0.smithi063.stdout:0/770: dread d4/dd/d26/d2b/f33 [0,4194304] 0 2023-12-07T16:21:46.444 INFO:tasks.workunit.client.0.smithi063.stdout:0/771: dread - d4/dd/d26/d2b/db5/d5b/fce zero size 2023-12-07T16:21:46.444 INFO:tasks.workunit.client.0.smithi063.stdout:0/772: stat d4/dd/d26/d2b/db5/fda 0 2023-12-07T16:21:46.444 INFO:tasks.workunit.client.0.smithi063.stdout:0/773: write d4/d7e/fbf [238098,112468] 0 2023-12-07T16:21:46.445 INFO:tasks.workunit.client.0.smithi063.stdout:0/774: creat d4/dd/d26/d2b/d5e/d69/f102 x:0 0 0 2023-12-07T16:21:46.447 INFO:tasks.workunit.client.0.smithi063.stdout:0/775: creat d4/dd/d26/d2b/db5/d5b/f103 x:0 0 0 2023-12-07T16:21:46.448 INFO:tasks.workunit.client.0.smithi063.stdout:0/776: creat d4/dd/d26/d2b/db5/d5b/d63/d6b/f104 x:0 0 0 2023-12-07T16:21:46.457 INFO:tasks.workunit.client.0.smithi063.stdout:6/733: dwrite d0/d79/fff [0,4194304] 0 2023-12-07T16:21:46.460 INFO:tasks.workunit.client.0.smithi063.stdout:2/802: dread d0/f14 [0,4194304] 0 2023-12-07T16:21:46.461 INFO:tasks.workunit.client.0.smithi063.stdout:6/734: mkdir d0/d1e/d60/d68/d78/d9c/d10b 0 2023-12-07T16:21:46.462 INFO:tasks.workunit.client.0.smithi063.stdout:6/735: link d0/d17/d1a/f61 d0/d79/f10c 0 2023-12-07T16:21:46.475 INFO:tasks.workunit.client.0.smithi063.stdout:4/589: dwrite d1/d3/db/d2c/d63/f84 [4194304,4194304] 0 2023-12-07T16:21:46.475 INFO:tasks.workunit.client.0.smithi063.stdout:2/803: dread d0/d21/d56/d11/d52/d5d/fc4 [0,4194304] 0 2023-12-07T16:21:46.475 INFO:tasks.workunit.client.1.smithi152.stdout:3/968: dwrite d7/d10/d1a/f72 [0,4194304] 0 2023-12-07T16:21:46.475 INFO:tasks.workunit.client.1.smithi152.stdout:0/981: dwrite d0/dc/f12a [0,4194304] 0 2023-12-07T16:21:46.475 INFO:tasks.workunit.client.1.smithi152.stdout:0/982: write d0/d27/d8c/df7/d30/d6e/d77/d113/f14c [4346138,55888] 0 2023-12-07T16:21:46.477 INFO:tasks.workunit.client.1.smithi152.stdout:3/969: creat d7/d10/dd0/f134 x:0 0 0 2023-12-07T16:21:46.478 INFO:tasks.workunit.client.0.smithi063.stdout:2/804: unlink d0/d21/d56/d71/l85 0 2023-12-07T16:21:46.478 INFO:tasks.workunit.client.0.smithi063.stdout:2/805: write d0/d67/fc5 [664466,49112] 0 2023-12-07T16:21:46.478 INFO:tasks.workunit.client.0.smithi063.stdout:4/590: link d1/d3/db/d41/l5b d1/d3/db/d2c/lb2 0 2023-12-07T16:21:46.480 INFO:tasks.workunit.client.0.smithi063.stdout:4/591: symlink d1/d3/db/d2c/d63/lb3 0 2023-12-07T16:21:46.481 INFO:tasks.workunit.client.1.smithi152.stdout:0/983: mknod d0/dc/d3d/dab/dc8/d129/c159 0 2023-12-07T16:21:46.481 INFO:tasks.workunit.client.0.smithi063.stdout:4/592: symlink d1/d3/d3a/lb4 0 2023-12-07T16:21:46.483 INFO:tasks.workunit.client.0.smithi063.stdout:4/593: truncate d1/d3/db/d2c/f91 2383229 0 2023-12-07T16:21:46.484 INFO:tasks.workunit.client.0.smithi063.stdout:4/594: creat d1/d3/db/d41/fb5 x:0 0 0 2023-12-07T16:21:46.488 INFO:tasks.workunit.client.1.smithi152.stdout:3/970: rmdir d7/d10 39 2023-12-07T16:21:46.491 INFO:tasks.workunit.client.1.smithi152.stdout:3/971: dread d7/d10/d1a/d2f/d5c/df6/fb6 [0,4194304] 0 2023-12-07T16:21:46.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:46 smithi152 ceph-mon[121113]: pgmap v30: 65 pgs: 65 active+clean; 2.9 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 170 MiB/s rd, 346 MiB/s wr, 507 op/s 2023-12-07T16:21:46.492 INFO:tasks.workunit.client.0.smithi063.stdout:2/806: dread d0/d21/f45 [0,4194304] 0 2023-12-07T16:21:46.494 INFO:tasks.workunit.client.1.smithi152.stdout:8/958: sync 2023-12-07T16:21:46.496 INFO:tasks.workunit.client.0.smithi063.stdout:7/711: dwrite d2/d2c/fa9 [0,4194304] 0 2023-12-07T16:21:46.497 INFO:tasks.workunit.client.1.smithi152.stdout:9/992: dwrite d1/d9/db/f79 [0,4194304] 0 2023-12-07T16:21:46.497 INFO:tasks.workunit.client.1.smithi152.stdout:9/993: fsync d1/d17/d3c/d4a/d48/d8c/f115 0 2023-12-07T16:21:46.501 INFO:tasks.workunit.client.0.smithi063.stdout:7/712: symlink d2/d37/da0/l104 0 2023-12-07T16:21:46.502 INFO:tasks.workunit.client.1.smithi152.stdout:9/994: rename d1/d9/f23 to d1/f145 0 2023-12-07T16:21:46.503 INFO:tasks.workunit.client.1.smithi152.stdout:6/917: dwrite d2/d4f/d83/d48/d70/d81/f112 [0,4194304] 0 2023-12-07T16:21:46.503 INFO:tasks.workunit.client.1.smithi152.stdout:7/887: dwrite db/d27/f49 [0,4194304] 0 2023-12-07T16:21:46.503 INFO:tasks.workunit.client.1.smithi152.stdout:7/888: readlink db/l36 0 2023-12-07T16:21:46.506 INFO:tasks.workunit.client.1.smithi152.stdout:6/918: write d2/d4f/d83/d85/f74 [222448,30794] 0 2023-12-07T16:21:46.507 INFO:tasks.workunit.client.1.smithi152.stdout:7/889: rmdir db/d27/d5e/d45 39 2023-12-07T16:21:46.509 INFO:tasks.workunit.client.0.smithi063.stdout:7/713: mknod d2/d34/d5a/d5f/d53/dab/c105 0 2023-12-07T16:21:46.510 INFO:tasks.workunit.client.0.smithi063.stdout:7/714: mknod d2/d34/d5a/d5f/d53/dab/dfe/c106 0 2023-12-07T16:21:46.510 INFO:tasks.workunit.client.0.smithi063.stdout:7/715: readlink d2/d21/lc3 0 2023-12-07T16:21:46.511 INFO:tasks.workunit.client.1.smithi152.stdout:7/890: rename db/d27/d4d/cb2 to db/d27/d39/d41/d58/da5/c11b 0 2023-12-07T16:21:46.511 INFO:tasks.workunit.client.0.smithi063.stdout:9/698: sync 2023-12-07T16:21:46.512 INFO:tasks.workunit.client.1.smithi152.stdout:3/972: dread d7/dc/f2a [4194304,4194304] 0 2023-12-07T16:21:46.512 INFO:tasks.workunit.client.1.smithi152.stdout:3/973: write d7/f52 [9106275,3511] 0 2023-12-07T16:21:46.516 INFO:tasks.workunit.client.1.smithi152.stdout:6/919: write d2/d4f/d83/d85/f4d [1735459,49538] 0 2023-12-07T16:21:46.519 INFO:tasks.workunit.client.1.smithi152.stdout:6/920: rename d2/d4f/d83/d85/d19/l51 to d2/d4f/d83/d85/d65/l12c 0 2023-12-07T16:21:46.521 INFO:tasks.workunit.client.1.smithi152.stdout:6/921: symlink d2/d4f/d83/d85/d65/d100/l12d 0 2023-12-07T16:21:46.521 INFO:tasks.workunit.client.1.smithi152.stdout:6/922: chown d2/d4f/d83/d48/d70 986679112 1 2023-12-07T16:21:46.523 INFO:tasks.workunit.client.1.smithi152.stdout:7/891: write db/d27/d39/d63/f9b [1064309,124664] 0 2023-12-07T16:21:46.533 INFO:tasks.workunit.client.1.smithi152.stdout:3/974: dread d7/d10/d1a/d2f/d115/f118 [0,4194304] 0 2023-12-07T16:21:46.533 INFO:tasks.workunit.client.1.smithi152.stdout:3/975: chown d7/d10/d1a/d25/d78/fc5 64 1 2023-12-07T16:21:46.534 INFO:tasks.workunit.client.1.smithi152.stdout:3/976: creat d7/f135 x:0 0 0 2023-12-07T16:21:46.537 INFO:tasks.workunit.client.0.smithi063.stdout:0/777: dwrite d4/d25/f7d [0,4194304] 0 2023-12-07T16:21:46.542 INFO:tasks.workunit.client.0.smithi063.stdout:0/778: mknod d4/d25/c105 0 2023-12-07T16:21:46.545 INFO:tasks.workunit.client.0.smithi063.stdout:0/779: mkdir d4/dd/d106 0 2023-12-07T16:21:46.545 INFO:tasks.workunit.client.0.smithi063.stdout:0/780: dread - d4/dd/d26/d2b/db5/d5b/d63/d74/f96 zero size 2023-12-07T16:21:46.547 INFO:tasks.workunit.client.0.smithi063.stdout:0/781: creat d4/dd/d26/d2b/d5e/d8e/d95/d68/f107 x:0 0 0 2023-12-07T16:21:46.548 INFO:tasks.workunit.client.1.smithi152.stdout:3/977: dread d7/d10/d1a/d25/fd5 [0,4194304] 0 2023-12-07T16:21:46.550 INFO:tasks.workunit.client.1.smithi152.stdout:3/978: rename d7/dc/l13 to d7/d10/d1a/d2f/d56/d57/dee/dda/l136 0 2023-12-07T16:21:46.595 INFO:tasks.workunit.client.1.smithi152.stdout:0/984: dwrite d0/f5 [0,4194304] 0 2023-12-07T16:21:46.595 INFO:tasks.workunit.client.1.smithi152.stdout:8/959: dwrite d3/fdf [0,4194304] 0 2023-12-07T16:21:46.595 INFO:tasks.workunit.client.0.smithi063.stdout:0/782: dread d4/dd/d26/d2b/d5e/d69/fc1 [0,4194304] 0 2023-12-07T16:21:46.596 INFO:tasks.workunit.client.1.smithi152.stdout:0/985: write d0/dc/d26/fb1 [716244,10528] 0 2023-12-07T16:21:46.598 INFO:tasks.workunit.client.1.smithi152.stdout:8/960: creat d3/d4/d9/dc/d6f/d7a/d101/f15c x:0 0 0 2023-12-07T16:21:46.599 INFO:tasks.workunit.client.1.smithi152.stdout:8/961: chown d3/d4/d9/dc/d6f/d7b/d7e/d12d/d67/cfe 1 1 2023-12-07T16:21:46.601 INFO:tasks.workunit.client.1.smithi152.stdout:8/962: getdents d3/d1e/d55/d83/dc5/d123/d125/d4c 0 2023-12-07T16:21:46.611 INFO:tasks.workunit.client.0.smithi063.stdout:4/595: dwrite d1/d3/db/d73/f89 [0,4194304] 0 2023-12-07T16:21:46.612 INFO:tasks.workunit.client.0.smithi063.stdout:6/736: dwrite d0/d1e/d29/fd7 [0,4194304] 0 2023-12-07T16:21:46.619 INFO:tasks.workunit.client.0.smithi063.stdout:6/737: unlink d0/d1e/d1d/d4f/c105 0 2023-12-07T16:21:46.624 INFO:tasks.workunit.client.0.smithi063.stdout:6/738: write d0/d1e/d2a/faa [344748,27875] 0 2023-12-07T16:21:46.626 INFO:tasks.workunit.client.0.smithi063.stdout:6/739: link d0/d17/d95/dd6/d8b/l103 d0/d17/l10d 0 2023-12-07T16:21:46.647 INFO:tasks.workunit.client.0.smithi063.stdout:9/699: dwrite d0/d13/d39/d3a/fbf [0,4194304] 0 2023-12-07T16:21:46.653 INFO:tasks.workunit.client.0.smithi063.stdout:3/711: dwrite d7/d9/f18 [4194304,4194304] 0 2023-12-07T16:21:46.653 INFO:tasks.workunit.client.0.smithi063.stdout:7/716: dwrite d2/d34/d5a/d5f/f4d [0,4194304] 0 2023-12-07T16:21:46.653 INFO:tasks.workunit.client.0.smithi063.stdout:7/717: chown d2/d34/d5a/d5f/d61/f6a 413680448 1 2023-12-07T16:21:46.653 INFO:tasks.workunit.client.1.smithi152.stdout:7/892: dwrite db/d27/d4d/f69 [0,4194304] 0 2023-12-07T16:21:46.654 INFO:tasks.workunit.client.1.smithi152.stdout:7/893: write db/d1c/f90 [335044,27470] 0 2023-12-07T16:21:46.654 INFO:tasks.workunit.client.1.smithi152.stdout:7/894: readlink db/d27/d39/l79 0 2023-12-07T16:21:46.654 INFO:tasks.workunit.client.0.smithi063.stdout:7/718: write d2/d34/d5a/d5f/f18 [79749,127225] 0 2023-12-07T16:21:46.654 INFO:tasks.workunit.client.1.smithi152.stdout:6/923: dwrite d2/d4f/d83/d85/d65/d100/f117 [0,4194304] 0 2023-12-07T16:21:46.656 INFO:tasks.workunit.client.0.smithi063.stdout:3/712: rename d7/d49/d4b/f7a to d7/fe8 0 2023-12-07T16:21:46.656 INFO:tasks.workunit.client.0.smithi063.stdout:2/807: dwrite d0/d21/d56/d11/d52/d63/f6c [4194304,4194304] 0 2023-12-07T16:21:46.658 INFO:tasks.workunit.client.0.smithi063.stdout:7/719: mknod d2/d21/dc6/c107 0 2023-12-07T16:21:46.658 INFO:tasks.workunit.client.0.smithi063.stdout:7/720: readlink d2/d34/d5a/d5f/d2a/dc9/le7 0 2023-12-07T16:21:46.661 INFO:tasks.workunit.client.1.smithi152.stdout:3/979: dwrite d7/d10/d1a/d25/f76 [0,4194304] 0 2023-12-07T16:21:46.661 INFO:tasks.workunit.client.1.smithi152.stdout:3/980: truncate d7/d10/d1a/d2f/d5c/df6/d6d/d98/fef 430728 0 2023-12-07T16:21:46.665 INFO:tasks.workunit.client.1.smithi152.stdout:6/924: dread d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/fa5 [0,4194304] 0 2023-12-07T16:21:46.665 INFO:tasks.workunit.client.1.smithi152.stdout:6/925: fdatasync d2/d4f/d83/d85/d9/deb/f11c 0 2023-12-07T16:21:46.665 INFO:tasks.workunit.client.1.smithi152.stdout:3/981: truncate d7/d10/d1a/d2f/f30 1883930 0 2023-12-07T16:21:46.666 INFO:tasks.workunit.client.0.smithi063.stdout:0/783: dwrite d4/dd/d26/d2b/f33 [0,4194304] 0 2023-12-07T16:21:46.666 INFO:tasks.workunit.client.0.smithi063.stdout:0/784: fdatasync d4/dd/d26/d2b/db5/d5b/d63/d74/f96 0 2023-12-07T16:21:46.666 INFO:tasks.workunit.client.0.smithi063.stdout:6/740: dwrite d0/d17/d95/dd6/f8e [0,4194304] 0 2023-12-07T16:21:46.667 INFO:tasks.workunit.client.0.smithi063.stdout:4/596: dwrite d1/d3/d3f/d49/d64/d80/fad [0,4194304] 0 2023-12-07T16:21:46.667 INFO:tasks.workunit.client.0.smithi063.stdout:4/597: chown d1/d3/db/d16/d66/fa7 0 1 2023-12-07T16:21:46.669 INFO:tasks.workunit.client.0.smithi063.stdout:6/741: creat d0/d1e/d60/d68/d76/f10e x:0 0 0 2023-12-07T16:21:46.670 INFO:tasks.workunit.client.1.smithi152.stdout:8/963: dwrite d3/fec [0,4194304] 0 2023-12-07T16:21:46.676 INFO:tasks.workunit.client.1.smithi152.stdout:6/926: read d2/d4f/d83/d85/d19/d1f/dc7/dc9/fa4 [3083034,120339] 0 2023-12-07T16:21:46.676 INFO:tasks.workunit.client.1.smithi152.stdout:3/982: rename d7/d10/d1a/d25/d78/cbb to d7/d10/d1a/c137 0 2023-12-07T16:21:46.678 INFO:tasks.workunit.client.0.smithi063.stdout:6/742: mknod d0/d1e/d60/d68/c10f 0 2023-12-07T16:21:46.678 INFO:tasks.workunit.client.0.smithi063.stdout:6/743: fsync d0/d54/f5f 0 2023-12-07T16:21:46.682 INFO:tasks.workunit.client.1.smithi152.stdout:3/983: write d7/d10/d1a/d2f/d56/d57/dee/dda/d7d/fb5 [2247955,86750] 0 2023-12-07T16:21:46.682 INFO:tasks.workunit.client.1.smithi152.stdout:3/984: read - d7/d10/d1a/de8/f126 zero size 2023-12-07T16:21:46.683 INFO:tasks.workunit.client.0.smithi063.stdout:1/591: sync 2023-12-07T16:21:46.684 INFO:tasks.workunit.client.1.smithi152.stdout:8/964: rmdir d3/d151 0 2023-12-07T16:21:46.684 INFO:tasks.workunit.client.1.smithi152.stdout:8/965: chown d3/d4/d9/dc/d6f/d7b/dbd/cd2 0 1 2023-12-07T16:21:46.684 INFO:tasks.workunit.client.1.smithi152.stdout:6/927: stat d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/lad 0 2023-12-07T16:21:46.684 INFO:tasks.workunit.client.0.smithi063.stdout:6/744: mknod d0/d1e/d60/d68/d76/da4/def/c110 0 2023-12-07T16:21:46.686 INFO:tasks.workunit.client.0.smithi063.stdout:1/592: unlink d0/dd/d10/d1b/d68/db7/fc6 0 2023-12-07T16:21:46.686 INFO:tasks.workunit.client.0.smithi063.stdout:1/593: dread - d0/dd/d1f/f94 zero size 2023-12-07T16:21:46.687 INFO:tasks.workunit.client.1.smithi152.stdout:6/928: write d2/f3 [6331448,118430] 0 2023-12-07T16:21:46.687 INFO:tasks.workunit.client.1.smithi152.stdout:6/929: write d2/d4f/d83/d85/d9/f7c [774600,112934] 0 2023-12-07T16:21:46.688 INFO:tasks.workunit.client.0.smithi063.stdout:6/745: creat d0/d17/d46/f111 x:0 0 0 2023-12-07T16:21:46.688 INFO:tasks.workunit.client.0.smithi063.stdout:1/594: unlink d0/dd/d10/d13/d2f/c3c 0 2023-12-07T16:21:46.689 INFO:tasks.workunit.client.0.smithi063.stdout:3/713: dread d7/d9/dd/f2a [0,4194304] 0 2023-12-07T16:21:46.689 INFO:tasks.workunit.client.0.smithi063.stdout:3/714: readlink d7/d4f/d53/d72/db1/l3e 0 2023-12-07T16:21:46.689 INFO:tasks.workunit.client.0.smithi063.stdout:6/746: mkdir d0/d1e/d60/d68/d78/d112 0 2023-12-07T16:21:46.690 INFO:tasks.workunit.client.0.smithi063.stdout:1/595: creat d0/dd/d10/d6f/fd0 x:0 0 0 2023-12-07T16:21:46.690 INFO:tasks.workunit.client.0.smithi063.stdout:1/596: read - d0/dd/d10/d46/f5e zero size 2023-12-07T16:21:46.690 INFO:tasks.workunit.client.0.smithi063.stdout:3/715: mknod d7/d49/db0/ce9 0 2023-12-07T16:21:46.691 INFO:tasks.workunit.client.0.smithi063.stdout:6/747: creat d0/d1e/f113 x:0 0 0 2023-12-07T16:21:46.691 INFO:tasks.workunit.client.0.smithi063.stdout:6/748: chown d0/d1e/d1d/d1f/laf 45080 1 2023-12-07T16:21:46.692 INFO:tasks.workunit.client.1.smithi152.stdout:6/930: write d2/d4f/d83/d85/f6a [3806191,64310] 0 2023-12-07T16:21:46.692 INFO:tasks.workunit.client.0.smithi063.stdout:1/597: mknod d0/dd/d4f/cd1 0 2023-12-07T16:21:46.694 INFO:tasks.workunit.client.0.smithi063.stdout:3/716: rename d7/l17 to d7/d9/dd/d56/lea 0 2023-12-07T16:21:46.696 INFO:tasks.workunit.client.0.smithi063.stdout:1/598: link d0/dd/d10/d46/f91 d0/dd/d10/d1b/d68/fd2 0 2023-12-07T16:21:46.703 INFO:tasks.workunit.client.0.smithi063.stdout:3/717: write d7/d9/d1b/d5c/f91 [973609,41165] 0 2023-12-07T16:21:46.703 INFO:tasks.workunit.client.0.smithi063.stdout:3/718: fdatasync d7/d4f/d53/d72/d7d/fbc 0 2023-12-07T16:21:46.706 INFO:tasks.workunit.client.0.smithi063.stdout:2/808: dread d0/d21/d56/d11/f23 [4194304,4194304] 0 2023-12-07T16:21:46.706 INFO:tasks.workunit.client.0.smithi063.stdout:3/719: mknod d7/d4f/d53/d72/d7d/ceb 0 2023-12-07T16:21:46.709 INFO:tasks.workunit.client.0.smithi063.stdout:3/720: mkdir d7/dec 0 2023-12-07T16:21:46.709 INFO:tasks.workunit.client.0.smithi063.stdout:3/721: chown d7/d4f/d53/d72/db1/f8b 429 1 2023-12-07T16:21:46.710 INFO:tasks.workunit.client.0.smithi063.stdout:6/749: dread d0/d1e/f12 [4194304,4194304] 0 2023-12-07T16:21:46.710 INFO:tasks.workunit.client.1.smithi152.stdout:2/928: sync 2023-12-07T16:21:46.710 INFO:tasks.workunit.client.1.smithi152.stdout:4/965: sync 2023-12-07T16:21:46.712 INFO:tasks.workunit.client.0.smithi063.stdout:3/722: rename d7/d21/c32 to d7/d4f/d53/ced 0 2023-12-07T16:21:46.712 INFO:tasks.workunit.client.0.smithi063.stdout:3/723: chown d7/d49/d4b/d8e 1176165 1 2023-12-07T16:21:46.713 INFO:tasks.workunit.client.1.smithi152.stdout:4/966: link d0/d3/d6/f35 d0/d3/d6/d2b/dd9/d39/d93/d7c/f126 0 2023-12-07T16:21:46.713 INFO:tasks.workunit.client.0.smithi063.stdout:3/724: creat d7/d4f/d53/dc7/fee x:0 0 0 2023-12-07T16:21:46.714 INFO:tasks.workunit.client.1.smithi152.stdout:2/929: truncate d2/d1c/d2e/f44 3054166 0 2023-12-07T16:21:46.714 INFO:tasks.workunit.client.1.smithi152.stdout:2/930: chown d2/d1c/d2e/d30/d42/d91/f129 1475 1 2023-12-07T16:21:46.714 INFO:tasks.workunit.client.1.smithi152.stdout:2/931: chown d2/d1c/d2e/d57/db1/f3b 69671673 1 2023-12-07T16:21:46.716 INFO:tasks.workunit.client.1.smithi152.stdout:2/932: mknod d2/d1c/d125/c139 0 2023-12-07T16:21:46.716 INFO:tasks.workunit.client.1.smithi152.stdout:2/933: fsync d2/d1c/d2e/d57/d5b/da7/d9a/da6/fec 0 2023-12-07T16:21:46.716 INFO:tasks.workunit.client.0.smithi063.stdout:2/809: write d0/d21/f69 [2852163,4159] 0 2023-12-07T16:21:46.716 INFO:tasks.workunit.client.0.smithi063.stdout:3/725: truncate d7/d4f/d53/d72/db1/d41/f5a 529832 0 2023-12-07T16:21:46.716 INFO:tasks.workunit.client.0.smithi063.stdout:3/726: write d7/d9/dd/fa9 [275075,17401] 0 2023-12-07T16:21:46.717 INFO:tasks.workunit.client.0.smithi063.stdout:3/727: chown d7/d9/dd/l1a 196 1 2023-12-07T16:21:46.717 INFO:tasks.workunit.client.0.smithi063.stdout:3/728: chown d7/d9/dd/d7f/fac 47224 1 2023-12-07T16:21:46.717 INFO:tasks.workunit.client.1.smithi152.stdout:4/967: mkdir d0/d3/d6/d2b/dd9/d39/d93/d127 0 2023-12-07T16:21:46.720 INFO:tasks.workunit.client.0.smithi063.stdout:8/920: sync 2023-12-07T16:21:46.720 INFO:tasks.workunit.client.0.smithi063.stdout:3/729: getdents d7/d9/dd 0 2023-12-07T16:21:46.720 INFO:tasks.workunit.client.0.smithi063.stdout:3/730: readlink d7/l8 0 2023-12-07T16:21:46.720 INFO:tasks.workunit.client.0.smithi063.stdout:5/741: sync 2023-12-07T16:21:46.720 INFO:tasks.workunit.client.0.smithi063.stdout:5/742: readlink d1/d3/l72 0 2023-12-07T16:21:46.721 INFO:tasks.workunit.client.0.smithi063.stdout:3/731: creat d7/d4f/d53/d72/fef x:0 0 0 2023-12-07T16:21:46.721 INFO:tasks.workunit.client.1.smithi152.stdout:4/968: unlink d0/d3/d6/d2b/c64 0 2023-12-07T16:21:46.723 INFO:tasks.workunit.client.0.smithi063.stdout:3/732: creat d7/d4f/d53/d72/db1/ff0 x:0 0 0 2023-12-07T16:21:46.723 INFO:tasks.workunit.client.1.smithi152.stdout:2/934: symlink d2/d1c/d2e/d57/d5b/da7/l13a 0 2023-12-07T16:21:46.724 INFO:tasks.workunit.client.1.smithi152.stdout:4/969: getdents d0/d3/d6/d2b/dd9/d3a/d46/dad 0 2023-12-07T16:21:46.727 INFO:tasks.workunit.client.0.smithi063.stdout:3/733: symlink d7/d9/d1b/d5c/lf1 0 2023-12-07T16:21:46.734 INFO:tasks.workunit.client.1.smithi152.stdout:4/970: creat d0/d3/d6/d2b/d75/f128 x:0 0 0 2023-12-07T16:21:46.736 INFO:tasks.workunit.client.0.smithi063.stdout:7/721: dwrite d2/d2c/fa9 [0,4194304] 0 2023-12-07T16:21:46.738 INFO:tasks.workunit.client.0.smithi063.stdout:0/785: dwrite d4/dd/d26/d2b/d5e/d69/f85 [0,4194304] 0 2023-12-07T16:21:46.743 INFO:tasks.workunit.client.0.smithi063.stdout:0/786: getdents d4/dd/d26/d2b/db5/d5b/d63 0 2023-12-07T16:21:46.748 INFO:tasks.workunit.client.1.smithi152.stdout:4/971: dread d0/d3/d6/f1d [0,4194304] 0 2023-12-07T16:21:46.749 INFO:tasks.workunit.client.1.smithi152.stdout:4/972: mknod d0/d3/c129 0 2023-12-07T16:21:46.751 INFO:tasks.workunit.client.1.smithi152.stdout:4/973: mkdir d0/d3/d6/d2b/dd9/d12a 0 2023-12-07T16:21:46.751 INFO:tasks.workunit.client.1.smithi152.stdout:4/974: truncate d0/d3/d6/d2b/d75/f128 990538 0 2023-12-07T16:21:46.754 INFO:tasks.workunit.client.1.smithi152.stdout:4/975: link d0/d17/d7f/lf9 d0/d3/d6/d2b/dd9/d3a/d120/l12b 0 2023-12-07T16:21:46.754 INFO:tasks.workunit.client.0.smithi063.stdout:3/734: dread d7/d9/f12 [0,4194304] 0 2023-12-07T16:21:46.756 INFO:tasks.workunit.client.0.smithi063.stdout:3/735: rename d7/dec to d7/d9/dd/df2 0 2023-12-07T16:21:46.756 INFO:tasks.workunit.client.0.smithi063.stdout:3/736: fsync d7/d9/dd/f42 0 2023-12-07T16:21:46.756 INFO:tasks.workunit.client.0.smithi063.stdout:3/737: chown d7/d9/dd/f42 88153 1 2023-12-07T16:21:46.758 INFO:tasks.workunit.client.0.smithi063.stdout:3/738: mkdir d7/d9/d1b/df3 0 2023-12-07T16:21:46.758 INFO:tasks.workunit.client.0.smithi063.stdout:3/739: creat d7/d49/d4b/d8e/ff4 x:0 0 0 2023-12-07T16:21:46.783 INFO:tasks.workunit.client.0.smithi063.stdout:7/722: dread d2/f17 [0,4194304] 0 2023-12-07T16:21:46.784 INFO:tasks.workunit.client.0.smithi063.stdout:7/723: rename d2/ff to d2/d34/d5a/d5f/d53/dab/dfe/f108 0 2023-12-07T16:21:46.789 INFO:tasks.workunit.client.1.smithi152.stdout:7/895: dwrite db/d27/d5e/fd6 [0,4194304] 0 2023-12-07T16:21:46.793 INFO:tasks.workunit.client.1.smithi152.stdout:6/931: dwrite d2/d4f/d83/d85/d19/d1f/dc7/fe7 [0,4194304] 0 2023-12-07T16:21:46.793 INFO:tasks.workunit.client.0.smithi063.stdout:9/700: dwrite d0/d13/f40 [0,4194304] 0 2023-12-07T16:21:46.793 INFO:tasks.workunit.client.0.smithi063.stdout:4/598: dwrite d1/d3/db/d73/f96 [0,4194304] 0 2023-12-07T16:21:46.795 INFO:tasks.workunit.client.1.smithi152.stdout:7/896: creat db/d27/d39/d41/dcb/f11c x:0 0 0 2023-12-07T16:21:46.796 INFO:tasks.workunit.client.0.smithi063.stdout:9/701: getdents d0/d13/d6f/daf/dbc 0 2023-12-07T16:21:46.796 INFO:tasks.workunit.client.0.smithi063.stdout:9/702: write d0/d21/f2c [4566137,103331] 0 2023-12-07T16:21:46.796 INFO:tasks.workunit.client.0.smithi063.stdout:9/703: chown d0/d13/d39/c60 9690 1 2023-12-07T16:21:46.796 INFO:tasks.workunit.client.0.smithi063.stdout:9/704: fsync d0/d13/f36 0 2023-12-07T16:21:46.797 INFO:tasks.workunit.client.1.smithi152.stdout:7/897: mkdir db/d27/d39/d41/d58/d80/def/d11d 0 2023-12-07T16:21:46.798 INFO:tasks.workunit.client.0.smithi063.stdout:9/705: truncate d0/d13/d39/d3a/f81 2359203 0 2023-12-07T16:21:46.798 INFO:tasks.workunit.client.0.smithi063.stdout:4/599: mknod d1/d3/db/d2c/d63/cb6 0 2023-12-07T16:21:46.799 INFO:tasks.workunit.client.0.smithi063.stdout:9/706: creat d0/d21/d64/d6a/d85/fe7 x:0 0 0 2023-12-07T16:21:46.800 INFO:tasks.workunit.client.0.smithi063.stdout:4/600: rmdir d1/d3 39 2023-12-07T16:21:46.800 INFO:tasks.workunit.client.1.smithi152.stdout:7/898: write db/d27/d39/f22 [470120,81136] 0 2023-12-07T16:21:46.800 INFO:tasks.workunit.client.1.smithi152.stdout:7/899: chown db/c83 493266367 1 2023-12-07T16:21:46.805 INFO:tasks.workunit.client.0.smithi063.stdout:4/601: write d1/d3/f68 [3817745,85086] 0 2023-12-07T16:21:46.805 INFO:tasks.workunit.client.0.smithi063.stdout:4/602: fdatasync d1/d3/f4e 0 2023-12-07T16:21:46.806 INFO:tasks.workunit.client.1.smithi152.stdout:9/995: sync 2023-12-07T16:21:46.806 INFO:tasks.workunit.client.1.smithi152.stdout:0/986: sync 2023-12-07T16:21:46.807 INFO:tasks.workunit.client.1.smithi152.stdout:9/996: truncate d1/d17/d3c/d4a/d48/d8c/fb2 148589 0 2023-12-07T16:21:46.809 INFO:tasks.workunit.client.1.smithi152.stdout:7/900: dread db/d27/d4d/f6d [4194304,4194304] 0 2023-12-07T16:21:46.812 INFO:tasks.workunit.client.0.smithi063.stdout:4/603: creat d1/d3/db/d2c/fb7 x:0 0 0 2023-12-07T16:21:46.812 INFO:tasks.workunit.client.1.smithi152.stdout:9/997: symlink d1/d9/db/d70/l146 0 2023-12-07T16:21:46.813 INFO:tasks.workunit.client.1.smithi152.stdout:7/901: rmdir db/d27/d5e/d104/d106 39 2023-12-07T16:21:46.814 INFO:tasks.workunit.client.0.smithi063.stdout:4/604: creat d1/d3/db/d73/fb8 x:0 0 0 2023-12-07T16:21:46.814 INFO:tasks.workunit.client.1.smithi152.stdout:7/902: mkdir db/d27/d39/d41/d58/d80/dac/d11e 0 2023-12-07T16:21:46.816 INFO:tasks.workunit.client.0.smithi063.stdout:5/743: dwrite d1/d3/d3a/f89 [0,4194304] 0 2023-12-07T16:21:46.821 INFO:tasks.workunit.client.0.smithi063.stdout:5/744: mknod d1/d3/d3a/d5a/dc6/cd7 0 2023-12-07T16:21:46.823 INFO:tasks.workunit.client.0.smithi063.stdout:5/745: link d1/f40 d1/d31/d56/d61/d8f/fd8 0 2023-12-07T16:21:46.825 INFO:tasks.workunit.client.1.smithi152.stdout:7/903: dread db/d27/d39/d41/d37/f67 [0,4194304] 0 2023-12-07T16:21:46.826 INFO:tasks.workunit.client.1.smithi152.stdout:9/998: dread d1/d9/db/f79 [0,4194304] 0 2023-12-07T16:21:46.826 INFO:tasks.workunit.client.1.smithi152.stdout:7/904: creat db/d27/d5e/d45/da9/f11f x:0 0 0 2023-12-07T16:21:46.827 INFO:tasks.workunit.client.0.smithi063.stdout:5/746: creat d1/d31/dc8/fd9 x:0 0 0 2023-12-07T16:21:46.827 INFO:tasks.workunit.client.0.smithi063.stdout:5/747: chown d1/f65 632702 1 2023-12-07T16:21:46.828 INFO:tasks.workunit.client.0.smithi063.stdout:6/750: dwrite d0/d17/d46/f9e [0,4194304] 0 2023-12-07T16:21:46.828 INFO:tasks.workunit.client.0.smithi063.stdout:8/921: dwrite d7/d14/d1a/f51 [0,4194304] 0 2023-12-07T16:21:46.828 INFO:tasks.workunit.client.0.smithi063.stdout:6/751: stat d0/d1e/d60/d68/d78/df2 0 2023-12-07T16:21:46.828 INFO:tasks.workunit.client.0.smithi063.stdout:6/752: chown d0/d17 2352 1 2023-12-07T16:21:46.828 INFO:tasks.workunit.client.0.smithi063.stdout:8/922: write d7/d14/fb3 [517035,45590] 0 2023-12-07T16:21:46.828 INFO:tasks.workunit.client.0.smithi063.stdout:2/810: dwrite d0/d21/d56/d11/d52/dad/fdc [0,4194304] 0 2023-12-07T16:21:46.828 INFO:tasks.workunit.client.0.smithi063.stdout:1/599: dwrite d0/f1 [0,4194304] 0 2023-12-07T16:21:46.828 INFO:tasks.workunit.client.0.smithi063.stdout:1/600: chown d0/d47 182 1 2023-12-07T16:21:46.829 INFO:tasks.workunit.client.1.smithi152.stdout:9/999: link d1/d9/db/df/da6/da2/laa d1/dd/dd6/de2/d53/dff/l147 0 2023-12-07T16:21:46.831 INFO:tasks.workunit.client.0.smithi063.stdout:6/753: creat d0/d1e/d29/f114 x:0 0 0 2023-12-07T16:21:46.833 INFO:tasks.workunit.client.0.smithi063.stdout:1/601: read d0/dd/d19/d50/d71/f2c [3707277,124452] 0 2023-12-07T16:21:46.833 INFO:tasks.workunit.client.0.smithi063.stdout:1/602: chown d0/dd/f6d 214188 1 2023-12-07T16:21:46.833 INFO:tasks.workunit.client.0.smithi063.stdout:8/923: mknod d7/d14/d1a/c126 0 2023-12-07T16:21:46.834 INFO:tasks.workunit.client.0.smithi063.stdout:7/724: rmdir d2/d34/d5a/d5f/d53 39 2023-12-07T16:21:46.838 INFO:tasks.workunit.client.0.smithi063.stdout:6/754: write d0/d1e/d60/d68/d76/fcb [3336965,70630] 0 2023-12-07T16:21:46.838 INFO:tasks.workunit.client.0.smithi063.stdout:6/755: truncate d0/d1e/d1d/d4f/d88/ffe 521234 0 2023-12-07T16:21:46.838 INFO:tasks.workunit.client.0.smithi063.stdout:6/756: read - d0/d17/d95/dd6/d8b/fa2 zero size 2023-12-07T16:21:46.838 INFO:tasks.workunit.client.0.smithi063.stdout:2/811: unlink d0/d21/d56/d11/d52/d63/f6c 0 2023-12-07T16:21:46.838 INFO:tasks.workunit.client.0.smithi063.stdout:2/812: chown d0/d21/d56/d11/d52/da9/dbe/f97 47268 1 2023-12-07T16:21:46.838 INFO:tasks.workunit.client.0.smithi063.stdout:3/740: dwrite d7/d4f/d53/d72/db1/f8b [0,4194304] 0 2023-12-07T16:21:46.839 INFO:tasks.workunit.client.0.smithi063.stdout:3/741: fsync d7/d8d/f81 0 2023-12-07T16:21:46.839 INFO:tasks.workunit.client.0.smithi063.stdout:0/787: dwrite d4/dd/d26/d2b/db5/d5b/d63/d74/f96 [0,4194304] 0 2023-12-07T16:21:46.839 INFO:tasks.workunit.client.0.smithi063.stdout:0/788: truncate d4/dd/d26/d2b/db5/d5b/fce 12210 0 2023-12-07T16:21:46.839 INFO:tasks.workunit.client.0.smithi063.stdout:0/789: stat d4/dd/laf 0 2023-12-07T16:21:46.840 INFO:tasks.workunit.client.1.smithi152.stdout:0/987: dwrite d0/dc/d26/f67 [0,4194304] 0 2023-12-07T16:21:46.840 INFO:tasks.workunit.client.1.smithi152.stdout:7/905: dread db/d27/d39/d63/fc1 [0,4194304] 0 2023-12-07T16:21:46.840 INFO:tasks.workunit.client.1.smithi152.stdout:2/935: dwrite d2/d1c/f69 [0,4194304] 0 2023-12-07T16:21:46.840 INFO:tasks.workunit.client.1.smithi152.stdout:4/976: dwrite d0/d3/d6/d2b/dd9/d39/d93/fd1 [0,4194304] 0 2023-12-07T16:21:46.840 INFO:tasks.workunit.client.0.smithi063.stdout:9/707: dwrite d0/d13/d39/fa7 [0,4194304] 0 2023-12-07T16:21:46.840 INFO:tasks.workunit.client.0.smithi063.stdout:1/603: creat d0/dd/d19/d50/d72/fd3 x:0 0 0 2023-12-07T16:21:46.840 INFO:tasks.workunit.client.0.smithi063.stdout:1/604: truncate d0/dd/d19/fa1 736691 0 2023-12-07T16:21:46.840 INFO:tasks.workunit.client.0.smithi063.stdout:1/605: getdents d0/dd/d55/dc9 0 2023-12-07T16:21:46.840 INFO:tasks.workunit.client.0.smithi063.stdout:1/606: dread - d0/dd/d10/d6f/fac zero size 2023-12-07T16:21:46.841 INFO:tasks.workunit.client.1.smithi152.stdout:0/988: symlink d0/d27/d8c/df7/d30/d6e/d13d/l15a 0 2023-12-07T16:21:46.842 INFO:tasks.workunit.client.0.smithi063.stdout:8/924: getdents d7/d14/d15/d48 0 2023-12-07T16:21:46.843 INFO:tasks.workunit.client.0.smithi063.stdout:5/748: dread d1/d3/d3a/f97 [0,4194304] 0 2023-12-07T16:21:46.843 INFO:tasks.workunit.client.1.smithi152.stdout:7/906: unlink db/l2b 0 2023-12-07T16:21:46.844 INFO:tasks.workunit.client.0.smithi063.stdout:7/725: rename d2/d34/d5a/d5f/d53/dab/dfe to d2/d21/dc6/d109 0 2023-12-07T16:21:46.850 INFO:tasks.workunit.client.1.smithi152.stdout:4/977: creat d0/d3/d6/d2b/dd9/d3a/d46/d80/f12c x:0 0 0 2023-12-07T16:21:46.851 INFO:tasks.workunit.client.0.smithi063.stdout:9/708: dread d0/f68 [0,4194304] 0 2023-12-07T16:21:46.851 INFO:tasks.workunit.client.0.smithi063.stdout:3/742: link d7/d4f/d53/c9d d7/d49/db0/cf5 0 2023-12-07T16:21:46.851 INFO:tasks.workunit.client.0.smithi063.stdout:2/813: creat d0/d67/d65/d6a/ded/f105 x:0 0 0 2023-12-07T16:21:46.851 INFO:tasks.workunit.client.0.smithi063.stdout:2/814: chown d0/d21/d56/d11/d52/d5d/dbb/fe5 6 1 2023-12-07T16:21:46.855 INFO:tasks.workunit.client.1.smithi152.stdout:0/989: rename d0/dc/d3d/d73/d128/d68/f12b to d0/dc/d36/d3a/f15b 0 2023-12-07T16:21:46.855 INFO:tasks.workunit.client.1.smithi152.stdout:4/978: mkdir d0/d3/d6/d2b/dd9/d3a/d46/d80/df6/d12d 0 2023-12-07T16:21:46.855 INFO:tasks.workunit.client.1.smithi152.stdout:7/907: creat db/d27/d39/d41/f120 x:0 0 0 2023-12-07T16:21:46.857 INFO:tasks.workunit.client.1.smithi152.stdout:4/979: creat d0/d3/d6/d2b/dd9/d3a/d46/d80/df6/d12d/f12e x:0 0 0 2023-12-07T16:21:46.858 INFO:tasks.workunit.client.1.smithi152.stdout:0/990: write d0/d27/d8c/f8d [3378523,76590] 0 2023-12-07T16:21:46.859 INFO:tasks.workunit.client.0.smithi063.stdout:8/925: getdents d7/d14/d15/dde/d63/d75/d98/dc4 0 2023-12-07T16:21:46.859 INFO:tasks.workunit.client.0.smithi063.stdout:8/926: write d7/d14/d15/d57/fd6 [241019,128749] 0 2023-12-07T16:21:46.859 INFO:tasks.workunit.client.0.smithi063.stdout:5/749: dread d1/f40 [0,4194304] 0 2023-12-07T16:21:46.860 INFO:tasks.workunit.client.1.smithi152.stdout:7/908: rename db/d27/d39/d63/f77 to db/d27/d39/f121 0 2023-12-07T16:21:46.862 INFO:tasks.workunit.client.1.smithi152.stdout:7/909: rmdir db/d27/d4d 39 2023-12-07T16:21:46.862 INFO:tasks.workunit.client.0.smithi063.stdout:7/726: rename d2/d34/d5a/d5f/f47 to d2/d21/dc6/f10a 0 2023-12-07T16:21:46.862 INFO:tasks.workunit.client.0.smithi063.stdout:2/815: mkdir d0/d21/d56/d11/db0/d106 0 2023-12-07T16:21:46.863 INFO:tasks.workunit.client.1.smithi152.stdout:0/991: dread d0/dc/d36/d3a/d69/fe5 [0,4194304] 0 2023-12-07T16:21:46.863 INFO:tasks.workunit.client.0.smithi063.stdout:8/927: creat d7/d38/d73/f127 x:0 0 0 2023-12-07T16:21:46.864 INFO:tasks.workunit.client.1.smithi152.stdout:2/936: dwrite d2/d1c/d52/da8/db6/ffe [0,4194304] 0 2023-12-07T16:21:46.864 INFO:tasks.workunit.client.1.smithi152.stdout:0/992: symlink d0/dc/d3d/d73/d128/d68/l15c 0 2023-12-07T16:21:46.864 INFO:tasks.workunit.client.1.smithi152.stdout:0/993: stat d0/f38 0 2023-12-07T16:21:46.864 INFO:tasks.workunit.client.0.smithi063.stdout:5/750: symlink d1/d3/de/d1e/d6b/dd0/lda 0 2023-12-07T16:21:46.866 INFO:tasks.workunit.client.0.smithi063.stdout:3/743: dread d7/d49/d4b/fad [0,4194304] 0 2023-12-07T16:21:46.866 INFO:tasks.workunit.client.0.smithi063.stdout:1/607: dwrite d0/dd/d10/fa9 [4194304,4194304] 0 2023-12-07T16:21:46.866 INFO:tasks.workunit.client.0.smithi063.stdout:6/757: rename d0/d1e/d60/d68/d76/da4/def/c110 to d0/d17/c115 0 2023-12-07T16:21:46.867 INFO:tasks.workunit.client.0.smithi063.stdout:2/816: creat d0/d21/d56/d11/d52/dad/f107 x:0 0 0 2023-12-07T16:21:46.869 INFO:tasks.workunit.client.1.smithi152.stdout:0/994: mkdir d0/dc/d36/d7d/d146/d15d 0 2023-12-07T16:21:46.869 INFO:tasks.workunit.client.1.smithi152.stdout:7/910: dread db/d27/d5e/ffe [0,4194304] 0 2023-12-07T16:21:46.872 INFO:tasks.workunit.client.0.smithi063.stdout:8/928: creat d7/d14/d15/dac/dad/d10e/f128 x:0 0 0 2023-12-07T16:21:46.872 INFO:tasks.workunit.client.0.smithi063.stdout:8/929: truncate d7/d14/d1a/f31 4294119 0 2023-12-07T16:21:46.872 INFO:tasks.workunit.client.0.smithi063.stdout:8/930: readlink d7/d14/d15/dde/d63/d75/d98/de8/l123 0 2023-12-07T16:21:46.873 INFO:tasks.workunit.client.1.smithi152.stdout:0/995: symlink d0/d27/d8c/l15e 0 2023-12-07T16:21:46.873 INFO:tasks.workunit.client.1.smithi152.stdout:7/911: mknod db/d27/d39/d41/d58/d80/def/d11d/c122 0 2023-12-07T16:21:46.873 INFO:tasks.workunit.client.0.smithi063.stdout:3/744: dread d7/d4f/f64 [0,4194304] 0 2023-12-07T16:21:46.874 INFO:tasks.workunit.client.1.smithi152.stdout:2/937: dread d2/d1c/d2e/d57/db1/d90/f39 [0,4194304] 0 2023-12-07T16:21:46.875 INFO:tasks.workunit.client.0.smithi063.stdout:5/751: creat d1/d3/de/d1e/d6b/fdb x:0 0 0 2023-12-07T16:21:46.875 INFO:tasks.workunit.client.0.smithi063.stdout:5/752: stat d1/d3/cc 0 2023-12-07T16:21:46.875 INFO:tasks.workunit.client.0.smithi063.stdout:5/753: dread - d1/d3/d3a/fc2 zero size 2023-12-07T16:21:46.875 INFO:tasks.workunit.client.0.smithi063.stdout:5/754: truncate d1/f18 4655964 0 2023-12-07T16:21:46.875 INFO:tasks.workunit.client.0.smithi063.stdout:5/755: chown d1/d31/d56/f6f 530360866 1 2023-12-07T16:21:46.877 INFO:tasks.workunit.client.0.smithi063.stdout:6/758: dread d0/d1e/f24 [0,4194304] 0 2023-12-07T16:21:46.877 INFO:tasks.workunit.client.0.smithi063.stdout:6/759: chown d0/d54/f56 17609 1 2023-12-07T16:21:46.878 INFO:tasks.workunit.client.0.smithi063.stdout:6/760: dread - d0/d1e/d60/d68/d76/f10e zero size 2023-12-07T16:21:46.879 INFO:tasks.workunit.client.1.smithi152.stdout:0/996: symlink d0/dc/d36/d7d/d146/l15f 0 2023-12-07T16:21:46.880 INFO:tasks.workunit.client.1.smithi152.stdout:7/912: chown db/d27/d39/d41/f60 1 1 2023-12-07T16:21:46.881 INFO:tasks.workunit.client.0.smithi063.stdout:2/817: creat d0/d67/d65/f108 x:0 0 0 2023-12-07T16:21:46.881 INFO:tasks.workunit.client.0.smithi063.stdout:8/931: symlink d7/d14/d15/dac/dad/l129 0 2023-12-07T16:21:46.882 INFO:tasks.workunit.client.1.smithi152.stdout:2/938: creat d2/d1c/d2e/d30/d33/d86/f13b x:0 0 0 2023-12-07T16:21:46.883 INFO:tasks.workunit.client.0.smithi063.stdout:3/745: unlink d7/d4f/d53/f5b 0 2023-12-07T16:21:46.883 INFO:tasks.workunit.client.0.smithi063.stdout:3/746: dread - d7/d4f/d53/d72/fef zero size 2023-12-07T16:21:46.883 INFO:tasks.workunit.client.0.smithi063.stdout:3/747: chown d7/d49/c73 6453852 1 2023-12-07T16:21:46.883 INFO:tasks.workunit.client.0.smithi063.stdout:3/748: write d7/d9/dd/d7f/fac [110915,60198] 0 2023-12-07T16:21:46.884 INFO:tasks.workunit.client.1.smithi152.stdout:7/913: creat db/d27/d39/d41/d58/da5/dde/df2/df4/f123 x:0 0 0 2023-12-07T16:21:46.884 INFO:tasks.workunit.client.1.smithi152.stdout:7/914: dread - db/d27/d39/d41/dcb/f11c zero size 2023-12-07T16:21:46.885 INFO:tasks.workunit.client.0.smithi063.stdout:6/761: unlink d0/f15 0 2023-12-07T16:21:46.885 INFO:tasks.workunit.client.0.smithi063.stdout:2/818: dread - d0/d21/fe4 zero size 2023-12-07T16:21:46.885 INFO:tasks.workunit.client.0.smithi063.stdout:6/762: write d0/d17/d95/dd6/d8b/fa2 [680264,78078] 0 2023-12-07T16:21:46.885 INFO:tasks.workunit.client.0.smithi063.stdout:2/819: stat d0/d21/f2a 0 2023-12-07T16:21:46.887 INFO:tasks.workunit.client.1.smithi152.stdout:2/939: link d2/d1c/d52/l66 d2/d1c/d2e/d5d/dab/dd9/dda/l13c 0 2023-12-07T16:21:46.889 INFO:tasks.workunit.client.0.smithi063.stdout:7/727: dread d2/d34/d5a/d5f/d53/dab/fd0 [0,4194304] 0 2023-12-07T16:21:46.889 INFO:tasks.workunit.client.0.smithi063.stdout:8/932: mknod d7/d14/d15/dde/da8/df8/c12a 0 2023-12-07T16:21:46.889 INFO:tasks.workunit.client.1.smithi152.stdout:7/915: rename db/d27/d5e/cba to db/d1c/dd4/c124 0 2023-12-07T16:21:46.890 INFO:tasks.workunit.client.1.smithi152.stdout:7/916: rmdir db/d27/d4d/dc9 39 2023-12-07T16:21:46.891 INFO:tasks.workunit.client.0.smithi063.stdout:3/749: link d7/d49/db0/ce9 d7/d9/dd/d7f/cf6 0 2023-12-07T16:21:46.892 INFO:tasks.workunit.client.1.smithi152.stdout:2/940: dread d2/d1c/d2e/d30/d33/f3d [0,4194304] 0 2023-12-07T16:21:46.894 INFO:tasks.workunit.client.0.smithi063.stdout:1/608: dwrite d0/dd/d10/d13/d2f/f7c [0,4194304] 0 2023-12-07T16:21:46.894 INFO:tasks.workunit.client.1.smithi152.stdout:7/917: creat db/d27/d39/d41/d58/da5/dde/f125 x:0 0 0 2023-12-07T16:21:46.895 INFO:tasks.workunit.client.0.smithi063.stdout:3/750: read d7/fcd [4601677,116745] 0 2023-12-07T16:21:46.895 INFO:tasks.workunit.client.0.smithi063.stdout:3/751: truncate d7/d9/f88 1543552 0 2023-12-07T16:21:46.895 INFO:tasks.workunit.client.0.smithi063.stdout:3/752: chown d7/d9/dd 3 1 2023-12-07T16:21:46.895 INFO:tasks.workunit.client.1.smithi152.stdout:0/997: dread d0/d27/f9b [0,4194304] 0 2023-12-07T16:21:46.895 INFO:tasks.workunit.client.1.smithi152.stdout:0/998: chown d0/dc/d36/d3a/d51/d82/lc4 702 1 2023-12-07T16:21:46.896 INFO:tasks.workunit.client.1.smithi152.stdout:2/941: mknod d2/d1c/d2e/d30/c13d 0 2023-12-07T16:21:46.896 INFO:tasks.workunit.client.0.smithi063.stdout:6/763: creat d0/d17/d95/dd6/d5a/d9d/f116 x:0 0 0 2023-12-07T16:21:46.897 INFO:tasks.workunit.client.1.smithi152.stdout:2/942: creat d2/d1c/d2e/f13e x:0 0 0 2023-12-07T16:21:46.901 INFO:tasks.workunit.client.1.smithi152.stdout:2/943: rename d2/d1c/d2e/f46 to d2/d1c/d2e/d57/d5b/da7/d9a/da6/dbb/f13f 0 2023-12-07T16:21:46.901 INFO:tasks.workunit.client.1.smithi152.stdout:2/944: chown d2/d1c/d2e/d30/caa 3263002 1 2023-12-07T16:21:46.904 INFO:tasks.workunit.client.1.smithi152.stdout:2/945: read d2/d1c/d2e/d5d/de8/ffc [4190333,55908] 0 2023-12-07T16:21:46.909 INFO:tasks.workunit.client.1.smithi152.stdout:2/946: creat d2/d1c/d2e/d30/d42/d91/f140 x:0 0 0 2023-12-07T16:21:46.909 INFO:tasks.workunit.client.1.smithi152.stdout:2/947: dread - d2/fe0 zero size 2023-12-07T16:21:46.909 INFO:tasks.workunit.client.1.smithi152.stdout:2/948: readlink d2/d1c/d52/l74 0 2023-12-07T16:21:46.912 INFO:tasks.workunit.client.1.smithi152.stdout:4/980: dwrite d0/d3/d6/d2b/dd9/d39/d93/fd1 [4194304,4194304] 0 2023-12-07T16:21:46.912 INFO:tasks.workunit.client.1.smithi152.stdout:0/999: dread d0/dc/d3d/d4c/fa1 [0,4194304] 0 2023-12-07T16:21:46.912 INFO:tasks.workunit.client.1.smithi152.stdout:4/981: chown d0/d3/d6/f1d 1007190 1 2023-12-07T16:21:46.912 INFO:tasks.workunit.client.1.smithi152.stdout:4/982: chown d0/d3/d6/d36/l89 5996 1 2023-12-07T16:21:46.913 INFO:tasks.workunit.client.1.smithi152.stdout:2/949: rename d2/d1c/d2e/d57/d5b/da7/d9a/dcb/c12d to d2/c141 0 2023-12-07T16:21:46.918 INFO:tasks.workunit.client.1.smithi152.stdout:2/950: mknod d2/d1c/c142 0 2023-12-07T16:21:46.921 INFO:tasks.workunit.client.1.smithi152.stdout:2/951: creat d2/d1c/d2e/d30/d42/d84/f143 x:0 0 0 2023-12-07T16:21:46.922 INFO:tasks.workunit.client.0.smithi063.stdout:8/933: link d7/c69 d7/d38/d8e/c12b 0 2023-12-07T16:21:46.923 INFO:tasks.workunit.client.0.smithi063.stdout:2/820: mknod d0/d21/d56/d11/d52/da9/dbe/c109 0 2023-12-07T16:21:46.923 INFO:tasks.workunit.client.0.smithi063.stdout:8/934: write d7/d14/d15/db4/f11d [1586058,27216] 0 2023-12-07T16:21:46.923 INFO:tasks.workunit.client.0.smithi063.stdout:1/609: rmdir d0/dd/d10/d1b/d68/db7 39 2023-12-07T16:21:46.924 INFO:tasks.workunit.client.1.smithi152.stdout:2/952: creat d2/d1c/d2e/d57/d5b/da7/d9a/dcb/f144 x:0 0 0 2023-12-07T16:21:46.924 INFO:tasks.workunit.client.0.smithi063.stdout:3/753: rename d7/d9/d1b/d5c/fe4 to d7/d4f/d53/ff7 0 2023-12-07T16:21:46.925 INFO:tasks.workunit.client.0.smithi063.stdout:2/821: write d0/d21/d56/d11/f89 [450366,76912] 0 2023-12-07T16:21:46.926 INFO:tasks.workunit.client.1.smithi152.stdout:2/953: creat d2/d1c/d2e/d30/d33/d86/dee/d107/f145 x:0 0 0 2023-12-07T16:21:46.926 INFO:tasks.workunit.client.1.smithi152.stdout:2/954: chown d2/d1c/d52 862776 1 2023-12-07T16:21:46.927 INFO:tasks.workunit.client.0.smithi063.stdout:3/754: rmdir d7/d9/dd/df2 0 2023-12-07T16:21:46.930 INFO:tasks.workunit.client.1.smithi152.stdout:7/918: dwrite db/d27/fa4 [0,4194304] 0 2023-12-07T16:21:46.930 INFO:tasks.workunit.client.1.smithi152.stdout:7/919: fsync db/d27/d39/d41/d58/f55 0 2023-12-07T16:21:46.930 INFO:tasks.workunit.client.0.smithi063.stdout:7/728: dwrite d2/d34/dc2/fef [0,4194304] 0 2023-12-07T16:21:46.930 INFO:tasks.workunit.client.0.smithi063.stdout:3/755: mkdir d7/d4f/d53/d54/df8 0 2023-12-07T16:21:46.930 INFO:tasks.workunit.client.0.smithi063.stdout:3/756: write d7/d4f/d53/d72/db1/f8b [4288463,26057] 0 2023-12-07T16:21:46.935 INFO:tasks.workunit.client.0.smithi063.stdout:5/756: dwrite d1/f18 [0,4194304] 0 2023-12-07T16:21:46.936 INFO:tasks.workunit.client.0.smithi063.stdout:6/764: dwrite d0/d17/d95/dd6/d8b/ffa [0,4194304] 0 2023-12-07T16:21:46.936 INFO:tasks.workunit.client.0.smithi063.stdout:6/765: chown d0/d79/db9 2093462813 1 2023-12-07T16:21:46.936 INFO:tasks.workunit.client.0.smithi063.stdout:7/729: unlink d2/d34/d5a/d5f/d78/d7c/d9b/ff3 0 2023-12-07T16:21:46.936 INFO:tasks.workunit.client.0.smithi063.stdout:7/730: stat d2/d34/d5a/d5f/f18 0 2023-12-07T16:21:46.937 INFO:tasks.workunit.client.0.smithi063.stdout:3/757: link d7/d49/d4b/fd5 d7/d9/dd/d7f/ff9 0 2023-12-07T16:21:46.940 INFO:tasks.workunit.client.0.smithi063.stdout:5/757: creat d1/d31/d56/fdc x:0 0 0 2023-12-07T16:21:46.941 INFO:tasks.workunit.client.1.smithi152.stdout:4/983: dwrite d0/d3/d6/d2b/dd9/d39/fe3 [0,4194304] 0 2023-12-07T16:21:46.942 INFO:tasks.workunit.client.0.smithi063.stdout:7/731: mkdir d2/d34/d46/d48/d70/daf/de8/d10b 0 2023-12-07T16:21:46.943 INFO:tasks.workunit.client.1.smithi152.stdout:8/966: sync 2023-12-07T16:21:46.947 INFO:tasks.workunit.client.0.smithi063.stdout:5/758: mknod d1/d31/dc8/cdd 0 2023-12-07T16:21:46.947 INFO:tasks.workunit.client.0.smithi063.stdout:3/758: rename d7/d4f/d53/d54/df8 to d7/d9/dfa 0 2023-12-07T16:21:46.948 INFO:tasks.workunit.client.1.smithi152.stdout:3/985: sync 2023-12-07T16:21:46.948 INFO:tasks.workunit.client.1.smithi152.stdout:3/986: chown d7/d10/d1a/fc1 3334274 1 2023-12-07T16:21:46.948 INFO:tasks.workunit.client.1.smithi152.stdout:4/984: rmdir d0/d3/d6/d2b/dd9/d3a/d46/dad 39 2023-12-07T16:21:46.950 INFO:tasks.workunit.client.0.smithi063.stdout:5/759: link d1/d31/d56/db7/cc4 d1/d31/d56/d61/d5e/cde 0 2023-12-07T16:21:46.950 INFO:tasks.workunit.client.1.smithi152.stdout:3/987: mknod d7/d10/d1a/d2f/d5c/df6/d6d/d81/de6/c138 0 2023-12-07T16:21:46.956 INFO:tasks.workunit.client.1.smithi152.stdout:3/988: rename d7/d10/d1a/d2f/d115 to d7/d10/d1a/d2f/d5c/df6/d6d/d81/de6/df3/d139 0 2023-12-07T16:21:46.956 INFO:tasks.workunit.client.1.smithi152.stdout:4/985: mkdir d0/d17/df5/d12f 0 2023-12-07T16:21:46.957 INFO:tasks.workunit.client.1.smithi152.stdout:3/989: mknod d7/d10/d1a/d25/d78/c13a 0 2023-12-07T16:21:46.957 INFO:tasks.workunit.client.1.smithi152.stdout:3/990: dread - d7/d10/d1a/d25/d4b/fa4 zero size 2023-12-07T16:21:46.965 INFO:tasks.workunit.client.0.smithi063.stdout:5/760: read d1/d3/de/d1e/f46 [1480676,45160] 0 2023-12-07T16:21:46.968 INFO:tasks.workunit.client.0.smithi063.stdout:6/766: dwrite d0/d1e/f24 [0,4194304] 0 2023-12-07T16:21:46.968 INFO:tasks.workunit.client.0.smithi063.stdout:6/767: stat d0/d1e/d60/d68/d76/da4/dc6 0 2023-12-07T16:21:46.969 INFO:tasks.workunit.client.0.smithi063.stdout:6/768: getdents d0/d1e/d2a 0 2023-12-07T16:21:46.970 INFO:tasks.workunit.client.0.smithi063.stdout:3/759: dread d7/d4f/d53/d54/f58 [0,4194304] 0 2023-12-07T16:21:46.972 INFO:tasks.workunit.client.0.smithi063.stdout:6/769: link d0/d54/f56 d0/d1e/d60/d68/d78/d9c/d9f/de4/f117 0 2023-12-07T16:21:46.977 INFO:tasks.workunit.client.0.smithi063.stdout:8/935: dwrite d7/d14/d15/d48/f105 [0,4194304] 0 2023-12-07T16:21:46.977 INFO:tasks.workunit.client.0.smithi063.stdout:1/610: dwrite d0/dd/d19/d50/d72/fb8 [0,4194304] 0 2023-12-07T16:21:46.977 INFO:tasks.workunit.client.0.smithi063.stdout:2/822: dwrite d0/fa [0,4194304] 0 2023-12-07T16:21:46.977 INFO:tasks.workunit.client.1.smithi152.stdout:8/967: dwrite d3/f1d [0,4194304] 0 2023-12-07T16:21:46.978 INFO:tasks.workunit.client.1.smithi152.stdout:8/968: write d3/d1e/d55/d83/dc5/d123/d125/d4c/da6/f110 [883583,58174] 0 2023-12-07T16:21:46.978 INFO:tasks.workunit.client.1.smithi152.stdout:8/969: readlink d3/d1e/d55/d83/dc5/d123/d125/lb7 0 2023-12-07T16:21:46.978 INFO:tasks.workunit.client.1.smithi152.stdout:7/920: dwrite db/d27/d39/d41/d58/da5/dde/d110/f119 [0,4194304] 0 2023-12-07T16:21:46.978 INFO:tasks.workunit.client.1.smithi152.stdout:7/921: dread - db/d27/d39/d41/d58/f114 zero size 2023-12-07T16:21:46.981 INFO:tasks.workunit.client.0.smithi063.stdout:7/732: dwrite d2/d64/f84 [0,4194304] 0 2023-12-07T16:21:46.982 INFO:tasks.workunit.client.0.smithi063.stdout:1/611: write d0/dd/d10/d1b/d68/f95 [2646642,101463] 0 2023-12-07T16:21:46.984 INFO:tasks.workunit.client.1.smithi152.stdout:8/970: creat d3/d1e/d55/d83/dc5/d123/d125/d4c/f15d x:0 0 0 2023-12-07T16:21:46.984 INFO:tasks.workunit.client.1.smithi152.stdout:7/922: truncate db/fe 3447531 0 2023-12-07T16:21:46.984 INFO:tasks.workunit.client.1.smithi152.stdout:7/923: chown db/d27/d39/cda 965 1 2023-12-07T16:21:46.987 INFO:tasks.workunit.client.0.smithi063.stdout:2/823: read d0/d21/d56/d11/d6d/fd8 [444873,45075] 0 2023-12-07T16:21:46.987 INFO:tasks.workunit.client.0.smithi063.stdout:2/824: fdatasync d0/d21/d56/d11/d52/da9/dbe/f9a 0 2023-12-07T16:21:46.988 INFO:tasks.workunit.client.0.smithi063.stdout:5/761: dwrite d1/d31/d56/d61/d5e/f75 [0,4194304] 0 2023-12-07T16:21:46.988 INFO:tasks.workunit.client.1.smithi152.stdout:7/924: symlink db/d27/d39/d41/d37/l126 0 2023-12-07T16:21:46.988 INFO:tasks.workunit.client.1.smithi152.stdout:8/971: write d3/d1e/d55/d83/dae/db1/f114 [2605645,130062] 0 2023-12-07T16:21:46.988 INFO:tasks.workunit.client.1.smithi152.stdout:8/972: chown d3/d4/d9/dc/d6f/d7a/d8a/c26 422 1 2023-12-07T16:21:46.990 INFO:tasks.workunit.client.0.smithi063.stdout:7/733: rmdir d2/d96 39 2023-12-07T16:21:46.990 INFO:tasks.workunit.client.0.smithi063.stdout:7/734: write d2/d34/d46/d48/d56/fb4 [100519,25564] 0 2023-12-07T16:21:46.990 INFO:tasks.workunit.client.0.smithi063.stdout:7/735: chown d2/d34/d5a/fa4 77722180 1 2023-12-07T16:21:46.991 INFO:tasks.workunit.client.1.smithi152.stdout:8/973: creat d3/d4/d4b/f15e x:0 0 0 2023-12-07T16:21:46.992 INFO:tasks.workunit.client.0.smithi063.stdout:1/612: mknod d0/dd/d19/cd4 0 2023-12-07T16:21:46.993 INFO:tasks.workunit.client.0.smithi063.stdout:5/762: mkdir d1/d31/d56/d61/d8f/ddf 0 2023-12-07T16:21:46.995 INFO:tasks.workunit.client.0.smithi063.stdout:7/736: creat d2/d34/d5a/d5f/d53/dab/db5/f10c x:0 0 0 2023-12-07T16:21:46.995 INFO:tasks.workunit.client.0.smithi063.stdout:7/737: chown d2/d34/d5a/c63 3 1 2023-12-07T16:21:46.995 INFO:tasks.workunit.client.0.smithi063.stdout:7/738: write d2/d21/dc6/d109/f108 [4449943,104562] 0 2023-12-07T16:21:46.996 INFO:tasks.workunit.client.0.smithi063.stdout:1/613: mkdir d0/dd/d55/daa/dd5 0 2023-12-07T16:21:46.996 INFO:tasks.workunit.client.0.smithi063.stdout:1/614: chown d0/f1 112 1 2023-12-07T16:21:46.998 INFO:tasks.workunit.client.0.smithi063.stdout:8/936: dread d7/d14/d15/dde/da8/ffe [0,4194304] 0 2023-12-07T16:21:46.998 INFO:tasks.workunit.client.0.smithi063.stdout:5/763: rename d1/d3/de/d1e/f46 to d1/d3/de/d1e/d6b/dd0/fe0 0 2023-12-07T16:21:47.001 INFO:tasks.workunit.client.0.smithi063.stdout:1/615: link d0/dd/d10/d1b/fca d0/dd/d10/d6f/fd6 0 2023-12-07T16:21:47.001 INFO:tasks.workunit.client.0.smithi063.stdout:6/770: dwrite d0/d79/feb [0,4194304] 0 2023-12-07T16:21:47.001 INFO:tasks.workunit.client.0.smithi063.stdout:6/771: fsync d0/d79/feb 0 2023-12-07T16:21:47.005 INFO:tasks.workunit.client.0.smithi063.stdout:8/937: link d7/d14/d1a/l64 d7/d38/d73/l12c 0 2023-12-07T16:21:47.006 INFO:tasks.workunit.client.0.smithi063.stdout:5/764: rename d1/d31/d56/d61/f43 to d1/d31/d56/d61/fe1 0 2023-12-07T16:21:47.006 INFO:tasks.workunit.client.0.smithi063.stdout:2/825: dread d0/f44 [0,4194304] 0 2023-12-07T16:21:47.006 INFO:tasks.workunit.client.0.smithi063.stdout:2/826: write d0/f77 [888711,81931] 0 2023-12-07T16:21:47.007 INFO:tasks.workunit.client.0.smithi063.stdout:3/760: getdents d7/d4f/d53/d54 0 2023-12-07T16:21:47.007 INFO:tasks.workunit.client.0.smithi063.stdout:3/761: write d7/d4f/d53/d72/d7d/fbc [1496016,62981] 0 2023-12-07T16:21:47.010 INFO:tasks.workunit.client.0.smithi063.stdout:7/739: dread d2/d21/f29 [0,4194304] 0 2023-12-07T16:21:47.010 INFO:tasks.workunit.client.0.smithi063.stdout:7/740: fdatasync d2/d34/d5a/d5f/d78/fb6 0 2023-12-07T16:21:47.012 INFO:tasks.workunit.client.1.smithi152.stdout:6/932: sync 2023-12-07T16:21:47.012 INFO:tasks.workunit.client.1.smithi152.stdout:6/933: getdents d2/d4f/d83/d48/d70/d81/ded 0 2023-12-07T16:21:47.016 INFO:tasks.workunit.client.1.smithi152.stdout:8/974: dwrite d3/fa4 [0,4194304] 0 2023-12-07T16:21:47.018 INFO:tasks.workunit.client.1.smithi152.stdout:6/934: truncate d2/d4f/d83/d85/f6a 2357267 0 2023-12-07T16:21:47.018 INFO:tasks.workunit.client.1.smithi152.stdout:6/935: write d2/d4f/d83/d48/d70/da7/db7/f11a [362743,118506] 0 2023-12-07T16:21:47.018 INFO:tasks.workunit.client.1.smithi152.stdout:6/936: stat d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/d5d/ce3 0 2023-12-07T16:21:47.018 INFO:tasks.workunit.client.1.smithi152.stdout:6/937: getdents d2/d4f/d83/d58/d10d 0 2023-12-07T16:21:47.020 INFO:tasks.workunit.client.1.smithi152.stdout:6/938: creat d2/d4f/d83/d92/f12e x:0 0 0 2023-12-07T16:21:47.023 INFO:tasks.workunit.client.0.smithi063.stdout:1/616: truncate d0/dd/d19/d50/d71/f52 2400591 0 2023-12-07T16:21:47.024 INFO:tasks.workunit.client.0.smithi063.stdout:1/617: fdatasync d0/dd/d10/d46/f91 0 2023-12-07T16:21:47.026 INFO:tasks.workunit.client.1.smithi152.stdout:8/975: read d3/d1e/d55/fb8 [1419482,129846] 0 2023-12-07T16:21:47.028 INFO:tasks.workunit.client.1.smithi152.stdout:7/925: dwrite db/d27/f91 [0,4194304] 0 2023-12-07T16:21:47.028 INFO:tasks.workunit.client.0.smithi063.stdout:6/772: fdatasync d0/d1e/d1d/f40 0 2023-12-07T16:21:47.028 INFO:tasks.workunit.client.0.smithi063.stdout:2/827: rename d0/d21/d56/d11/d52/da9/dbe/cb8 to d0/d21/d56/d11/d52/d63/df3/c10a 0 2023-12-07T16:21:47.030 INFO:tasks.workunit.client.0.smithi063.stdout:1/618: dread d0/dd/d10/d13/d2f/d79/f7d [0,4194304] 0 2023-12-07T16:21:47.031 INFO:tasks.workunit.client.0.smithi063.stdout:3/762: rename d7/d4f/fd0 to d7/d9/d1b/ffb 0 2023-12-07T16:21:47.032 INFO:tasks.workunit.client.0.smithi063.stdout:2/828: getdents d0/d21/d56/d11/d6d/dcb 0 2023-12-07T16:21:47.034 INFO:tasks.workunit.client.0.smithi063.stdout:5/765: dwrite d1/d3/de/f1f [0,4194304] 0 2023-12-07T16:21:47.034 INFO:tasks.workunit.client.0.smithi063.stdout:8/938: dwrite d7/d14/f35 [4194304,4194304] 0 2023-12-07T16:21:47.034 INFO:tasks.workunit.client.0.smithi063.stdout:3/763: dread d7/d4f/f64 [0,4194304] 0 2023-12-07T16:21:47.036 INFO:tasks.workunit.client.0.smithi063.stdout:1/619: creat d0/dd/d19/fd7 x:0 0 0 2023-12-07T16:21:47.039 INFO:tasks.workunit.client.0.smithi063.stdout:2/829: rename d0/d21/d56/d11/d52/d5d/le0 to d0/d21/d56/d11/d6d/l10b 0 2023-12-07T16:21:47.041 INFO:tasks.workunit.client.0.smithi063.stdout:5/766: creat d1/d3/d3a/dcd/dd3/fe2 x:0 0 0 2023-12-07T16:21:47.044 INFO:tasks.workunit.client.1.smithi152.stdout:7/926: mknod db/d27/d39/d41/d58/da5/dde/df2/df4/c127 0 2023-12-07T16:21:47.044 INFO:tasks.workunit.client.0.smithi063.stdout:5/767: dread d1/d3/d3a/dcd/dd3/d7e/f84 [0,4194304] 0 2023-12-07T16:21:47.045 INFO:tasks.workunit.client.0.smithi063.stdout:5/768: write d1/f5c [4985989,95036] 0 2023-12-07T16:21:47.045 INFO:tasks.workunit.client.0.smithi063.stdout:2/830: getdents d0/d21/d56/d71 0 2023-12-07T16:21:47.046 INFO:tasks.workunit.client.0.smithi063.stdout:1/620: rename d0/d98/d9f to d0/dd/d10/d6f/dd8 0 2023-12-07T16:21:47.047 INFO:tasks.workunit.client.0.smithi063.stdout:3/764: dread d7/d4f/d53/d72/db1/d41/f5a [0,4194304] 0 2023-12-07T16:21:47.047 INFO:tasks.workunit.client.0.smithi063.stdout:3/765: stat d7/d4f/d53/d72/fef 0 2023-12-07T16:21:47.047 INFO:tasks.workunit.client.0.smithi063.stdout:3/766: stat l4 0 2023-12-07T16:21:47.050 INFO:tasks.workunit.client.0.smithi063.stdout:5/769: mkdir d1/d31/d56/d61/de3 0 2023-12-07T16:21:47.050 INFO:tasks.workunit.client.0.smithi063.stdout:1/621: dread d0/dd/d19/f8b [0,4194304] 0 2023-12-07T16:21:47.052 INFO:tasks.workunit.client.0.smithi063.stdout:2/831: unlink d0/d21/d56/d71/lac 0 2023-12-07T16:21:47.054 INFO:tasks.workunit.client.0.smithi063.stdout:3/767: creat d7/d4f/d53/d72/db1/ffc x:0 0 0 2023-12-07T16:21:47.054 INFO:tasks.workunit.client.0.smithi063.stdout:3/768: readlink d7/d4f/d53/d54/d76/l80 0 2023-12-07T16:21:47.054 INFO:tasks.workunit.client.0.smithi063.stdout:3/769: chown d7/d4f/f64 1373 1 2023-12-07T16:21:47.057 INFO:tasks.workunit.client.0.smithi063.stdout:5/770: getdents d1/d3 0 2023-12-07T16:21:47.057 INFO:tasks.workunit.client.1.smithi152.stdout:6/939: dwrite d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/f11d [0,4194304] 0 2023-12-07T16:21:47.058 INFO:tasks.workunit.client.0.smithi063.stdout:6/773: dwrite d0/d1e/d1d/d4f/f66 [0,4194304] 0 2023-12-07T16:21:47.058 INFO:tasks.workunit.client.1.smithi152.stdout:7/927: write db/d27/f56 [3413195,74393] 0 2023-12-07T16:21:47.059 INFO:tasks.workunit.client.0.smithi063.stdout:1/622: rmdir d0/dd/d10/d6f/da0 39 2023-12-07T16:21:47.060 INFO:tasks.workunit.client.1.smithi152.stdout:7/928: write db/d27/d39/d63/f9b [987592,52518] 0 2023-12-07T16:21:47.060 INFO:tasks.workunit.client.1.smithi152.stdout:7/929: fdatasync db/d27/d39/d41/f60 0 2023-12-07T16:21:47.060 INFO:tasks.workunit.client.0.smithi063.stdout:2/832: rename d0/d21/d56/d11/d52/d63/d8c/db9/cfa to d0/d21/d56/d11/d52/d5d/dbb/c10c 0 2023-12-07T16:21:47.060 INFO:tasks.workunit.client.0.smithi063.stdout:2/833: dread - d0/d21/d56/d11/d6d/fea zero size 2023-12-07T16:21:47.061 INFO:tasks.workunit.client.1.smithi152.stdout:6/940: getdents d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/da1/db5/dc1/dd8 0 2023-12-07T16:21:47.062 INFO:tasks.workunit.client.0.smithi063.stdout:5/771: mkdir d1/d31/d56/d61/d8f/ddf/de4 0 2023-12-07T16:21:47.062 INFO:tasks.workunit.client.0.smithi063.stdout:5/772: chown d1/d3/de/l96 3212 1 2023-12-07T16:21:47.065 INFO:tasks.workunit.client.0.smithi063.stdout:3/770: creat d7/d4f/ffd x:0 0 0 2023-12-07T16:21:47.065 INFO:tasks.workunit.client.0.smithi063.stdout:8/939: dwrite d7/d14/d15/dde/d63/d75/d98/fa3 [0,4194304] 0 2023-12-07T16:21:47.066 INFO:tasks.workunit.client.0.smithi063.stdout:1/623: rename d0/dd/d19/d50/f6a to d0/dd/d19/d50/d72/fd9 0 2023-12-07T16:21:47.066 INFO:tasks.workunit.client.0.smithi063.stdout:4/605: sync 2023-12-07T16:21:47.066 INFO:tasks.workunit.client.0.smithi063.stdout:4/606: chown d1/d3/db/d41/f52 3581 1 2023-12-07T16:21:47.067 INFO:tasks.workunit.client.0.smithi063.stdout:9/709: sync 2023-12-07T16:21:47.069 INFO:tasks.workunit.client.0.smithi063.stdout:2/834: write d0/d21/d56/d11/f58 [1356913,124098] 0 2023-12-07T16:21:47.069 INFO:tasks.workunit.client.0.smithi063.stdout:2/835: readlink d0/d67/d65/l84 0 2023-12-07T16:21:47.069 INFO:tasks.workunit.client.0.smithi063.stdout:0/790: sync 2023-12-07T16:21:47.070 INFO:tasks.workunit.client.0.smithi063.stdout:9/710: dread d0/d13/f25 [0,4194304] 0 2023-12-07T16:21:47.071 INFO:tasks.workunit.client.0.smithi063.stdout:1/624: rmdir d0/dd/d19/d50/d72/d80 39 2023-12-07T16:21:47.074 INFO:tasks.workunit.client.1.smithi152.stdout:8/976: dwrite d3/d1e/d55/fe9 [4194304,4194304] 0 2023-12-07T16:21:47.075 INFO:tasks.workunit.client.1.smithi152.stdout:6/941: mkdir d2/d4f/d83/d48/d70/d81/d12f 0 2023-12-07T16:21:47.075 INFO:tasks.workunit.client.1.smithi152.stdout:7/930: symlink db/d27/d39/d41/d58/d80/def/d11d/l128 0 2023-12-07T16:21:47.081 INFO:tasks.workunit.client.0.smithi063.stdout:2/836: rmdir d0/d21/db2/dce 39 2023-12-07T16:21:47.081 INFO:tasks.workunit.client.0.smithi063.stdout:2/837: read - d0/d21/d56/d11/d52/dad/f107 zero size 2023-12-07T16:21:47.081 INFO:tasks.workunit.client.0.smithi063.stdout:0/791: symlink d4/d7e/l108 0 2023-12-07T16:21:47.081 INFO:tasks.workunit.client.0.smithi063.stdout:9/711: mkdir d0/d13/d39/d3a/d78/de8 0 2023-12-07T16:21:47.082 INFO:tasks.workunit.client.0.smithi063.stdout:9/712: write d0/d21/d64/d6a/fd9 [657947,99374] 0 2023-12-07T16:21:47.082 INFO:tasks.workunit.client.1.smithi152.stdout:6/942: mknod d2/d4f/d83/d85/d19/d1f/d101/c130 0 2023-12-07T16:21:47.082 INFO:tasks.workunit.client.1.smithi152.stdout:6/943: fdatasync d2/d4f/d83/d85/f25 0 2023-12-07T16:21:47.089 INFO:tasks.workunit.client.1.smithi152.stdout:8/977: dread d3/d4/d9/dc/d6f/d7b/d7e/d12d/d67/d7d/f8d [4194304,4194304] 0 2023-12-07T16:21:47.091 INFO:tasks.workunit.client.0.smithi063.stdout:8/940: dread d7/d14/d15/dde/da8/ffe [4194304,4194304] 0 2023-12-07T16:21:47.092 INFO:tasks.workunit.client.1.smithi152.stdout:8/978: mknod d3/d1e/c15f 0 2023-12-07T16:21:47.099 INFO:tasks.workunit.client.0.smithi063.stdout:1/625: rename d0/dd/d55/daa to d0/dd/d10/d1b/d68/db7/dda 0 2023-12-07T16:21:47.099 INFO:tasks.workunit.client.0.smithi063.stdout:1/626: dread - d0/dd/d19/d50/d71/fba zero size 2023-12-07T16:21:47.099 INFO:tasks.workunit.client.0.smithi063.stdout:2/838: creat d0/d21/db2/f10d x:0 0 0 2023-12-07T16:21:47.099 INFO:tasks.workunit.client.0.smithi063.stdout:1/627: chown d0/dd/d19/d50/d71/f64 369 1 2023-12-07T16:21:47.099 INFO:tasks.workunit.client.0.smithi063.stdout:9/713: mknod d0/d21/d64/d6a/d8f/ce9 0 2023-12-07T16:21:47.099 INFO:tasks.workunit.client.0.smithi063.stdout:0/792: mknod d4/dd/de/d15/d1f/d22/c109 0 2023-12-07T16:21:47.099 INFO:tasks.workunit.client.0.smithi063.stdout:0/793: fsync d4/dd/d26/d2b/d5e/d8e/d95/f7a 0 2023-12-07T16:21:47.099 INFO:tasks.workunit.client.0.smithi063.stdout:9/714: write d0/d13/d39/d42/d57/fe5 [196895,89083] 0 2023-12-07T16:21:47.099 INFO:tasks.workunit.client.0.smithi063.stdout:6/774: dwrite d0/d1e/f81 [0,4194304] 0 2023-12-07T16:21:47.100 INFO:tasks.workunit.client.0.smithi063.stdout:6/775: truncate d0/d1e/d60/d68/fc9 671054 0 2023-12-07T16:21:47.100 INFO:tasks.workunit.client.1.smithi152.stdout:8/979: write d3/d4/d9/dc/d6f/d7b/d7e/d12d/d67/fa0 [1596906,75550] 0 2023-12-07T16:21:47.103 INFO:tasks.workunit.client.1.smithi152.stdout:8/980: symlink d3/d1e/d55/d83/dc5/df0/l160 0 2023-12-07T16:21:47.104 INFO:tasks.workunit.client.1.smithi152.stdout:8/981: chown d3/d4/d9/dc/d6f/d7b/d7e/d12d/d7c/lc7 0 1 2023-12-07T16:21:47.109 INFO:tasks.workunit.client.0.smithi063.stdout:2/839: dread d0/d67/f59 [0,4194304] 0 2023-12-07T16:21:47.109 INFO:tasks.workunit.client.0.smithi063.stdout:2/840: chown d0/d21/d56/d11/d6d/l10b 179226094 1 2023-12-07T16:21:47.111 INFO:tasks.workunit.client.0.smithi063.stdout:8/941: creat d7/d14/d15/dac/f12d x:0 0 0 2023-12-07T16:21:47.111 INFO:tasks.workunit.client.0.smithi063.stdout:8/942: fsync d7/d38/df1/fe0 0 2023-12-07T16:21:47.112 INFO:tasks.workunit.client.0.smithi063.stdout:1/628: creat d0/dd/d10/d13/d2f/fdb x:0 0 0 2023-12-07T16:21:47.112 INFO:tasks.workunit.client.0.smithi063.stdout:9/715: symlink d0/d21/d64/lea 0 2023-12-07T16:21:47.112 INFO:tasks.workunit.client.0.smithi063.stdout:9/716: readlink d0/d13/l19 0 2023-12-07T16:21:47.112 INFO:tasks.workunit.client.0.smithi063.stdout:0/794: unlink d4/dd/d26/d2b/d5e/d8e/ld7 0 2023-12-07T16:21:47.112 INFO:tasks.workunit.client.0.smithi063.stdout:0/795: fsync d4/dd/d26/d2b/db5/d5b/d63/d74/d84/fd9 0 2023-12-07T16:21:47.114 INFO:tasks.workunit.client.1.smithi152.stdout:7/931: dwrite db/d27/d39/fe2 [0,4194304] 0 2023-12-07T16:21:47.117 INFO:tasks.workunit.client.0.smithi063.stdout:6/776: dread d0/d1e/d60/d68/d69/d7d/f86 [0,4194304] 0 2023-12-07T16:21:47.118 INFO:tasks.workunit.client.1.smithi152.stdout:7/932: creat db/d27/d5e/d104/d106/f129 x:0 0 0 2023-12-07T16:21:47.118 INFO:tasks.workunit.client.1.smithi152.stdout:7/933: write db/d27/d39/fe1 [725691,76127] 0 2023-12-07T16:21:47.118 INFO:tasks.workunit.client.0.smithi063.stdout:3/771: dwrite d7/fa [0,4194304] 0 2023-12-07T16:21:47.118 INFO:tasks.workunit.client.0.smithi063.stdout:3/772: stat d7/d9/d1b/db8 0 2023-12-07T16:21:47.119 INFO:tasks.workunit.client.0.smithi063.stdout:3/773: getdents d7/d4f/d53/d54 0 2023-12-07T16:21:47.125 INFO:tasks.workunit.client.0.smithi063.stdout:9/717: symlink d0/d13/d6f/daf/dbc/leb 0 2023-12-07T16:21:47.125 INFO:tasks.workunit.client.0.smithi063.stdout:8/943: truncate d7/d14/d15/f46 4533223 0 2023-12-07T16:21:47.125 INFO:tasks.workunit.client.0.smithi063.stdout:1/629: symlink d0/dd/d10/d6f/ldc 0 2023-12-07T16:21:47.127 INFO:tasks.workunit.client.0.smithi063.stdout:4/607: dwrite d1/d3/d3a/f9b [0,4194304] 0 2023-12-07T16:21:47.128 INFO:tasks.workunit.client.0.smithi063.stdout:4/608: write d1/d3/db/d16/d66/fac [617117,66509] 0 2023-12-07T16:21:47.130 INFO:tasks.workunit.client.0.smithi063.stdout:0/796: rmdir d4/dd/d26/d2b/d5e 39 2023-12-07T16:21:47.131 INFO:tasks.workunit.client.0.smithi063.stdout:8/944: truncate d7/d38/df1/fe0 35584 0 2023-12-07T16:21:47.131 INFO:tasks.workunit.client.0.smithi063.stdout:8/945: fdatasync d7/d14/d15/dde/da8/d9f/ffb 0 2023-12-07T16:21:47.134 INFO:tasks.workunit.client.0.smithi063.stdout:2/841: rename d0/d21/d56/d11/d52/d5d/fc4 to d0/d21/f10e 0 2023-12-07T16:21:47.134 INFO:tasks.workunit.client.0.smithi063.stdout:0/797: mkdir d4/dd/de/d15/d59/d43/d10a 0 2023-12-07T16:21:47.134 INFO:tasks.workunit.client.0.smithi063.stdout:8/946: truncate d7/d14/d15/f6d 442337 0 2023-12-07T16:21:47.134 INFO:tasks.workunit.client.0.smithi063.stdout:8/947: dread - d7/d14/d15/dde/da8/d9f/ffb zero size 2023-12-07T16:21:47.138 INFO:tasks.workunit.client.0.smithi063.stdout:1/630: rename d0/dd/d10/d1b/f74 to d0/d47/fdd 0 2023-12-07T16:21:47.140 INFO:tasks.workunit.client.0.smithi063.stdout:2/842: mkdir d0/d10f 0 2023-12-07T16:21:47.142 INFO:tasks.workunit.client.0.smithi063.stdout:0/798: symlink d4/dd/d26/d2b/db5/d5b/d63/d9b/l10b 0 2023-12-07T16:21:47.144 INFO:tasks.workunit.client.0.smithi063.stdout:1/631: creat d0/dd/d10/d1b/d68/fde x:0 0 0 2023-12-07T16:21:47.144 INFO:tasks.workunit.client.0.smithi063.stdout:1/632: fsync d0/dd/d10/d46/f73 0 2023-12-07T16:21:47.144 INFO:tasks.workunit.client.0.smithi063.stdout:8/948: rename d7/d14/d1a/f33 to d7/d14/d15/f12e 0 2023-12-07T16:21:47.144 INFO:tasks.workunit.client.0.smithi063.stdout:8/949: fsync d7/d14/d15/d57/f6f 0 2023-12-07T16:21:47.144 INFO:tasks.workunit.client.0.smithi063.stdout:8/950: chown d7/d14/d15 6 1 2023-12-07T16:21:47.147 INFO:tasks.workunit.client.0.smithi063.stdout:0/799: creat d4/dd/d26/f10c x:0 0 0 2023-12-07T16:21:47.150 INFO:tasks.workunit.client.0.smithi063.stdout:1/633: mknod d0/dd/cdf 0 2023-12-07T16:21:47.150 INFO:tasks.workunit.client.0.smithi063.stdout:0/800: creat d4/dd/de/d15/d59/d43/dd8/f10d x:0 0 0 2023-12-07T16:21:47.150 INFO:tasks.workunit.client.0.smithi063.stdout:0/801: stat d4/dd/d26/d2b/db5/d5b/d63/d74/d84/ddb/fff 0 2023-12-07T16:21:47.150 INFO:tasks.workunit.client.0.smithi063.stdout:4/609: dread d1/d3/db/d2c/d63/d62/f7e [0,4194304] 0 2023-12-07T16:21:47.152 INFO:tasks.workunit.client.0.smithi063.stdout:4/610: symlink d1/d3/db/d2c/d63/d99/lb9 0 2023-12-07T16:21:47.153 INFO:tasks.workunit.client.0.smithi063.stdout:4/611: symlink d1/d3/db/d2c/d63/d99/lba 0 2023-12-07T16:21:47.154 INFO:tasks.workunit.client.0.smithi063.stdout:4/612: truncate d1/d3/f8 1387035 0 2023-12-07T16:21:47.154 INFO:tasks.workunit.client.0.smithi063.stdout:4/613: fsync d1/d3/db/d2c/d63/d62/f8a 0 2023-12-07T16:21:47.154 INFO:tasks.workunit.client.0.smithi063.stdout:4/614: chown d1/d3/db/d16/f7a 136252840 1 2023-12-07T16:21:47.154 INFO:tasks.workunit.client.0.smithi063.stdout:4/615: dread - d1/d3/db/d16/d66/fa7 zero size 2023-12-07T16:21:47.155 INFO:tasks.workunit.client.0.smithi063.stdout:4/616: truncate d1/d3/d3f/d49/f61 3841323 0 2023-12-07T16:21:47.155 INFO:tasks.workunit.client.0.smithi063.stdout:4/617: fdatasync d1/d3/d3f/d49/d8b/fa4 0 2023-12-07T16:21:47.155 INFO:tasks.workunit.client.0.smithi063.stdout:4/618: chown d1/d3/f8 24 1 2023-12-07T16:21:47.155 INFO:tasks.workunit.client.0.smithi063.stdout:4/619: dread - d1/d3/d3f/d49/d8b/fab zero size 2023-12-07T16:21:47.156 INFO:tasks.workunit.client.0.smithi063.stdout:4/620: chown d1/d3/d3f/d49/d64/d80 168 1 2023-12-07T16:21:47.156 INFO:tasks.workunit.client.0.smithi063.stdout:0/802: write d4/fc [3923562,497] 0 2023-12-07T16:21:47.156 INFO:tasks.workunit.client.0.smithi063.stdout:0/803: write d4/dd/d26/d2b/d5e/d8e/d95/d68/f107 [718083,8810] 0 2023-12-07T16:21:47.159 INFO:tasks.workunit.client.1.smithi152.stdout:8/982: dwrite d3/d4/d9/dc/d6f/d7b/d7e/d12d/fd1 [0,4194304] 0 2023-12-07T16:21:47.159 INFO:tasks.workunit.client.0.smithi063.stdout:0/804: read d4/dd/d26/d2b/d5e/f88 [2233499,17168] 0 2023-12-07T16:21:47.162 INFO:tasks.workunit.client.1.smithi152.stdout:6/944: dwrite d2/d4f/d83/d85/d94/fb1 [0,4194304] 0 2023-12-07T16:21:47.173 INFO:tasks.workunit.client.0.smithi063.stdout:3/774: dwrite d7/d4f/d53/d72/db1/ff0 [0,4194304] 0 2023-12-07T16:21:47.185 INFO:tasks.workunit.client.1.smithi152.stdout:7/934: dwrite db/d27/d39/d41/d58/da5/dde/fff [0,4194304] 0 2023-12-07T16:21:47.185 INFO:tasks.workunit.client.1.smithi152.stdout:7/935: chown db/d27/d39/d41/d37/c93 5 1 2023-12-07T16:21:47.187 INFO:tasks.workunit.client.0.smithi063.stdout:4/621: dread d1/d3/db/f20 [0,4194304] 0 2023-12-07T16:21:47.189 INFO:tasks.workunit.client.0.smithi063.stdout:6/777: dwrite d0/d1e/d1d/d4f/d88/fea [0,4194304] 0 2023-12-07T16:21:47.189 INFO:tasks.workunit.client.0.smithi063.stdout:9/718: dwrite d0/d13/d6f/faa [0,4194304] 0 2023-12-07T16:21:47.190 INFO:tasks.workunit.client.0.smithi063.stdout:8/951: dwrite d7/d14/d15/dde/f62 [0,4194304] 0 2023-12-07T16:21:47.192 INFO:tasks.workunit.client.1.smithi152.stdout:7/936: fsync db/f18 0 2023-12-07T16:21:47.192 INFO:tasks.workunit.client.0.smithi063.stdout:4/622: write d1/d3/db/d41/f46 [918357,56132] 0 2023-12-07T16:21:47.196 INFO:tasks.workunit.client.0.smithi063.stdout:6/778: mkdir d0/d1e/d1d/d4f/d88/d118 0 2023-12-07T16:21:47.196 INFO:tasks.workunit.client.0.smithi063.stdout:6/779: fdatasync d0/d1e/d1d/f3d 0 2023-12-07T16:21:47.198 INFO:tasks.workunit.client.0.smithi063.stdout:9/719: mknod d0/d13/d39/d42/cec 0 2023-12-07T16:21:47.206 INFO:tasks.workunit.client.0.smithi063.stdout:4/623: dread d1/d3/d3f/d49/d64/d80/fad [0,4194304] 0 2023-12-07T16:21:47.208 INFO:tasks.workunit.client.1.smithi152.stdout:4/986: sync 2023-12-07T16:21:47.208 INFO:tasks.workunit.client.1.smithi152.stdout:3/991: sync 2023-12-07T16:21:47.208 INFO:tasks.workunit.client.1.smithi152.stdout:2/955: sync 2023-12-07T16:21:47.209 INFO:tasks.workunit.client.1.smithi152.stdout:4/987: mknod d0/d3/d6/d2b/dd9/d39/d93/d106/c130 0 2023-12-07T16:21:47.211 INFO:tasks.workunit.client.1.smithi152.stdout:6/945: dwrite d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/f11d [0,4194304] 0 2023-12-07T16:21:47.212 INFO:tasks.workunit.client.0.smithi063.stdout:0/805: dwrite d4/d25/f8d [0,4194304] 0 2023-12-07T16:21:47.212 INFO:tasks.workunit.client.0.smithi063.stdout:3/775: dwrite d7/d9/d1b/d5c/f91 [0,4194304] 0 2023-12-07T16:21:47.212 INFO:tasks.workunit.client.0.smithi063.stdout:9/720: dread d0/d13/d39/d42/f50 [0,4194304] 0 2023-12-07T16:21:47.212 INFO:tasks.workunit.client.1.smithi152.stdout:8/983: dwrite d3/d4/d9/dad/fdc [0,4194304] 0 2023-12-07T16:21:47.213 INFO:tasks.workunit.client.0.smithi063.stdout:8/952: dread d7/fd [0,4194304] 0 2023-12-07T16:21:47.213 INFO:tasks.workunit.client.0.smithi063.stdout:8/953: chown d7/d14/d15/dde/f62 10208524 1 2023-12-07T16:21:47.214 INFO:tasks.workunit.client.1.smithi152.stdout:3/992: rename d7/d10/d1a/d2f/d56/d57/dee to d7/d10/d41/d61/d13b 0 2023-12-07T16:21:47.214 INFO:tasks.workunit.client.1.smithi152.stdout:3/993: fdatasync d7/d10/fd9 0 2023-12-07T16:21:47.214 INFO:tasks.workunit.client.1.smithi152.stdout:3/994: read d7/d10/f91 [226327,30456] 0 2023-12-07T16:21:47.214 INFO:tasks.workunit.client.1.smithi152.stdout:2/956: symlink d2/d1c/d2e/d57/d5b/da7/ddd/l146 0 2023-12-07T16:21:47.214 INFO:tasks.workunit.client.1.smithi152.stdout:4/988: truncate d0/d3/d6/d2b/dd9/d3a/f58 906794 0 2023-12-07T16:21:47.214 INFO:tasks.workunit.client.1.smithi152.stdout:8/984: symlink d3/d4/d4b/l161 0 2023-12-07T16:21:47.214 INFO:tasks.workunit.client.1.smithi152.stdout:8/985: readlink d3/d4/d9/dc/d6f/d7b/d7e/d85/le6 0 2023-12-07T16:21:47.215 INFO:tasks.workunit.client.1.smithi152.stdout:7/937: dwrite db/d27/d39/d41/d58/f73 [0,4194304] 0 2023-12-07T16:21:47.215 INFO:tasks.workunit.client.1.smithi152.stdout:2/957: creat d2/d1c/d2e/d5d/daf/d133/f147 x:0 0 0 2023-12-07T16:21:47.215 INFO:tasks.workunit.client.1.smithi152.stdout:2/958: stat d2/fe0 0 2023-12-07T16:21:47.215 INFO:tasks.workunit.client.1.smithi152.stdout:2/959: chown d2/d1c/d52/da8/fef 33912 1 2023-12-07T16:21:47.216 INFO:tasks.workunit.client.1.smithi152.stdout:6/946: write d2/d4f/d83/d48/d70/d81/fe8 [1741560,5081] 0 2023-12-07T16:21:47.216 INFO:tasks.workunit.client.1.smithi152.stdout:4/989: creat d0/d3/d6/d2b/dd9/d3a/d46/f131 x:0 0 0 2023-12-07T16:21:47.218 INFO:tasks.workunit.client.1.smithi152.stdout:8/986: symlink d3/d1e/d55/d83/dc5/d104/l162 0 2023-12-07T16:21:47.218 INFO:tasks.workunit.client.1.smithi152.stdout:2/960: read d2/d1c/d2e/d57/db1/fcd [3268737,90786] 0 2023-12-07T16:21:47.218 INFO:tasks.workunit.client.1.smithi152.stdout:2/961: read - d2/d1c/d2e/f13e zero size 2023-12-07T16:21:47.218 INFO:tasks.workunit.client.1.smithi152.stdout:2/962: write d2/d9/d51/fea [792884,39527] 0 2023-12-07T16:21:47.219 INFO:tasks.workunit.client.1.smithi152.stdout:3/995: write d7/d10/d41/fdc [2720379,67728] 0 2023-12-07T16:21:47.221 INFO:tasks.workunit.client.1.smithi152.stdout:7/938: rename db/d27/d39/d41/d58/f73 to db/d27/d39/d41/d58/da5/dde/de7/f12a 0 2023-12-07T16:21:47.224 INFO:tasks.workunit.client.1.smithi152.stdout:8/987: link d3/d4/d9/df7/c11f d3/d4/d9/dc/d6f/d7b/d7e/d12d/c163 0 2023-12-07T16:21:47.225 INFO:tasks.workunit.client.1.smithi152.stdout:7/939: write db/d27/d39/d41/d58/f59 [3166771,84172] 0 2023-12-07T16:21:47.226 INFO:tasks.workunit.client.1.smithi152.stdout:2/963: mkdir d2/d1c/d2e/d30/d33/d86/d148 0 2023-12-07T16:21:47.229 INFO:tasks.workunit.client.1.smithi152.stdout:8/988: dread d3/d1e/d55/d83/dae/de1/f12b [0,4194304] 0 2023-12-07T16:21:47.232 INFO:tasks.workunit.client.1.smithi152.stdout:3/996: creat d7/d10/d1a/d2f/f13c x:0 0 0 2023-12-07T16:21:47.232 INFO:tasks.workunit.client.1.smithi152.stdout:3/997: write d7/d10/d1a/d2f/d56/d57/faa [1936735,2575] 0 2023-12-07T16:21:47.232 INFO:tasks.workunit.client.1.smithi152.stdout:3/998: fsync d7/dc/fe 0 2023-12-07T16:21:47.233 INFO:tasks.workunit.client.1.smithi152.stdout:7/940: rename db/d27/d5e/d45/f9e to db/d27/d4d/f12b 0 2023-12-07T16:21:47.233 INFO:tasks.workunit.client.1.smithi152.stdout:8/989: mkdir d3/d1e/d55/d83/dc5/d123/d125/d4c/da6/db2/dc3/d137/d150/d164 0 2023-12-07T16:21:47.235 INFO:tasks.workunit.client.1.smithi152.stdout:4/990: dread d0/d3/d6/d2b/dd9/d39/d93/fd1 [0,4194304] 0 2023-12-07T16:21:47.235 INFO:tasks.workunit.client.1.smithi152.stdout:7/941: symlink db/d27/d39/d41/l12c 0 2023-12-07T16:21:47.239 INFO:tasks.workunit.client.1.smithi152.stdout:3/999: dread d7/dc/f33 [0,4194304] 0 2023-12-07T16:21:47.239 INFO:tasks.workunit.client.1.smithi152.stdout:2/964: rename d2/d1c/d2e/d5d/daf/d133/l96 to d2/d1c/d2e/d5d/daf/d133/d112/l149 0 2023-12-07T16:21:47.239 INFO:tasks.workunit.client.1.smithi152.stdout:8/990: getdents d3/d1e/d55 0 2023-12-07T16:21:47.240 INFO:tasks.workunit.client.1.smithi152.stdout:7/942: creat db/d27/d39/d41/d58/d80/def/d11d/f12d x:0 0 0 2023-12-07T16:21:47.241 INFO:tasks.workunit.client.1.smithi152.stdout:2/965: creat d2/d1c/d2e/d5d/daf/f14a x:0 0 0 2023-12-07T16:21:47.242 INFO:tasks.workunit.client.1.smithi152.stdout:7/943: write db/d1c/f94 [3132644,118382] 0 2023-12-07T16:21:47.245 INFO:tasks.workunit.client.1.smithi152.stdout:7/944: creat db/d27/d39/d41/d58/d80/dac/d11e/f12e x:0 0 0 2023-12-07T16:21:47.246 INFO:tasks.workunit.client.1.smithi152.stdout:6/947: dwrite d2/d4f/d83/d85/d19/d1f/dc7/fe7 [4194304,4194304] 0 2023-12-07T16:21:47.246 INFO:tasks.workunit.client.1.smithi152.stdout:6/948: chown d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/fe4 90 1 2023-12-07T16:21:47.250 INFO:tasks.workunit.client.1.smithi152.stdout:6/949: creat d2/d4f/d83/d85/d65/d100/f131 x:0 0 0 2023-12-07T16:21:47.260 INFO:tasks.workunit.client.1.smithi152.stdout:4/991: dwrite d0/d17/fcc [0,4194304] 0 2023-12-07T16:21:47.263 INFO:tasks.workunit.client.1.smithi152.stdout:8/991: dread d3/d4/d9/dc/d6f/d7b/d7e/d12d/d67/dd4/fd7 [0,4194304] 0 2023-12-07T16:21:47.265 INFO:tasks.workunit.client.0.smithi063.stdout:0/806: creat d4/dd/d26/d2b/db5/d5b/d63/d6b/da8/f10e x:0 0 0 2023-12-07T16:21:47.267 INFO:tasks.workunit.client.1.smithi152.stdout:4/992: symlink d0/d17/df5/l132 0 2023-12-07T16:21:47.267 INFO:tasks.workunit.client.1.smithi152.stdout:8/992: truncate d3/d4/d9/f18 3241485 0 2023-12-07T16:21:47.270 INFO:tasks.workunit.client.1.smithi152.stdout:4/993: mkdir d0/d3/d6/d2b/dd9/d3a/d48/d4c/dd6/d133 0 2023-12-07T16:21:47.270 INFO:tasks.workunit.client.0.smithi063.stdout:0/807: dread d4/dd/de/d15/f3d [0,4194304] 0 2023-12-07T16:21:47.270 INFO:tasks.workunit.client.0.smithi063.stdout:0/808: write d4/dd/d26/d2b/db5/f87 [931435,130964] 0 2023-12-07T16:21:47.270 INFO:tasks.workunit.client.0.smithi063.stdout:0/809: write d4/dd/de/d15/d59/d43/f5c [1087997,15294] 0 2023-12-07T16:21:47.270 INFO:tasks.workunit.client.0.smithi063.stdout:0/810: chown d4/dd/d26/d2b/db5/d5b/d63/d6b/da8/ce1 78016 1 2023-12-07T16:21:47.271 INFO:tasks.workunit.client.0.smithi063.stdout:3/776: symlink d7/d4f/d53/d54/d76/lfe 0 2023-12-07T16:21:47.271 INFO:tasks.workunit.client.0.smithi063.stdout:3/777: dread - d7/f4c zero size 2023-12-07T16:21:47.278 INFO:tasks.workunit.client.0.smithi063.stdout:9/721: rename d0/d13/d39/d42 to d0/d13/d95/ded 0 2023-12-07T16:21:47.279 INFO:tasks.workunit.client.1.smithi152.stdout:2/966: dwrite d2/d1c/d2e/d57/fb8 [0,4194304] 0 2023-12-07T16:21:47.279 INFO:tasks.workunit.client.1.smithi152.stdout:7/945: dwrite db/d27/d4d/fb0 [4194304,4194304] 0 2023-12-07T16:21:47.290 INFO:tasks.workunit.client.0.smithi063.stdout:0/811: creat d4/f10f x:0 0 0 2023-12-07T16:21:47.291 INFO:tasks.workunit.client.1.smithi152.stdout:7/946: rename db/d1c/f9a to db/d27/d39/f12f 0 2023-12-07T16:21:47.293 INFO:tasks.workunit.client.0.smithi063.stdout:9/722: creat d0/d13/d39/d3a/d78/de8/fee x:0 0 0 2023-12-07T16:21:47.293 INFO:tasks.workunit.client.0.smithi063.stdout:9/723: dread - d0/d8d/fa0 zero size 2023-12-07T16:21:47.295 INFO:tasks.workunit.client.0.smithi063.stdout:9/724: write d0/d8d/fc7 [3194020,3341] 0 2023-12-07T16:21:47.296 INFO:tasks.workunit.client.0.smithi063.stdout:0/812: link d4/d25/f9e d4/dd/d26/d2b/db5/d5b/d63/d6b/da8/f110 0 2023-12-07T16:21:47.298 INFO:tasks.workunit.client.0.smithi063.stdout:3/778: dwrite d7/d4f/d53/ff7 [0,4194304] 0 2023-12-07T16:21:47.301 INFO:tasks.workunit.client.0.smithi063.stdout:0/813: symlink d4/dd/d26/d2b/db5/d5b/d63/d6b/dc0/l111 0 2023-12-07T16:21:47.303 INFO:tasks.workunit.client.1.smithi152.stdout:2/967: dwrite d2/d1c/fd2 [0,4194304] 0 2023-12-07T16:21:47.303 INFO:tasks.workunit.client.1.smithi152.stdout:2/968: write d2/d1c/d2e/d30/d42/d84/f135 [692480,22702] 0 2023-12-07T16:21:47.303 INFO:tasks.workunit.client.1.smithi152.stdout:2/969: write d2/d1c/d2e/d57/d5b/fe2 [948569,41664] 0 2023-12-07T16:21:47.303 INFO:tasks.workunit.client.1.smithi152.stdout:2/970: fdatasync d2/d1c/d52/f9d 0 2023-12-07T16:21:47.303 INFO:tasks.workunit.client.1.smithi152.stdout:4/994: dwrite d0/d3/d6/d2b/db1/ddd/f10a [0,4194304] 0 2023-12-07T16:21:47.306 INFO:tasks.workunit.client.1.smithi152.stdout:2/971: symlink d2/d1c/d2e/d57/db1/l14b 0 2023-12-07T16:21:47.307 INFO:tasks.workunit.client.0.smithi063.stdout:3/779: symlink d7/lff 0 2023-12-07T16:21:47.310 INFO:tasks.workunit.client.1.smithi152.stdout:2/972: creat d2/d56/f14c x:0 0 0 2023-12-07T16:21:47.310 INFO:tasks.workunit.client.1.smithi152.stdout:2/973: stat d2/d1c/c118 0 2023-12-07T16:21:47.310 INFO:tasks.workunit.client.1.smithi152.stdout:4/995: write d0/d3/d6/d36/d85/f72 [1196342,105938] 0 2023-12-07T16:21:47.312 INFO:tasks.workunit.client.1.smithi152.stdout:2/974: mkdir d2/d14d 0 2023-12-07T16:21:47.312 INFO:tasks.workunit.client.1.smithi152.stdout:2/975: readlink d2/d1c/d2e/d30/d42/d91/lcf 0 2023-12-07T16:21:47.319 INFO:tasks.workunit.client.0.smithi063.stdout:0/814: creat d4/dd/d26/d2b/db5/d5b/d63/d74/f112 x:0 0 0 2023-12-07T16:21:47.319 INFO:tasks.workunit.client.0.smithi063.stdout:0/815: write d4/d25/f71 [404006,96908] 0 2023-12-07T16:21:47.321 INFO:tasks.workunit.client.1.smithi152.stdout:2/976: write d2/d1c/d2e/d57/fb8 [379237,119567] 0 2023-12-07T16:21:47.321 INFO:tasks.workunit.client.1.smithi152.stdout:2/977: fsync d2/d1c/d2e/d57/d5b/da7/d9a/dcb/f144 0 2023-12-07T16:21:47.322 INFO:tasks.workunit.client.1.smithi152.stdout:7/947: dwrite db/d27/f7a [0,4194304] 0 2023-12-07T16:21:47.323 INFO:tasks.workunit.client.0.smithi063.stdout:0/816: truncate d4/dd/d26/d2b/d5e/d69/f85 578367 0 2023-12-07T16:21:47.323 INFO:tasks.workunit.client.0.smithi063.stdout:0/817: stat d4/dd/de/d15/d1f/f54 0 2023-12-07T16:21:47.323 INFO:tasks.workunit.client.0.smithi063.stdout:9/725: dwrite d0/d13/d6f/daf/dbc/fc2 [0,4194304] 0 2023-12-07T16:21:47.324 INFO:tasks.workunit.client.1.smithi152.stdout:2/978: creat d2/d1c/d2e/d57/d5b/da7/d9a/da6/d119/f14e x:0 0 0 2023-12-07T16:21:47.326 INFO:tasks.workunit.client.0.smithi063.stdout:0/818: creat d4/d25/f113 x:0 0 0 2023-12-07T16:21:47.326 INFO:tasks.workunit.client.0.smithi063.stdout:0/819: fsync d4/dd/de/d15/d1f/d22/fb0 0 2023-12-07T16:21:47.327 INFO:tasks.workunit.client.0.smithi063.stdout:9/726: write d0/f1a [4551198,109986] 0 2023-12-07T16:21:47.328 INFO:tasks.workunit.client.1.smithi152.stdout:7/948: mkdir db/d27/d39/d41/d58/d80/d130 0 2023-12-07T16:21:47.330 INFO:tasks.workunit.client.1.smithi152.stdout:2/979: creat d2/d1c/d2e/d57/d5b/da7/d9a/f14f x:0 0 0 2023-12-07T16:21:47.330 INFO:tasks.workunit.client.1.smithi152.stdout:2/980: chown d2/d1c/d52/da8/db6/ffe 25914426 1 2023-12-07T16:21:47.332 INFO:tasks.workunit.client.0.smithi063.stdout:0/820: write d4/dd/d26/d2b/f33 [994393,113151] 0 2023-12-07T16:21:47.334 INFO:tasks.workunit.client.1.smithi152.stdout:2/981: link d2/d1c/d2e/d57/d5b/da7/lff d2/d56/d10a/l150 0 2023-12-07T16:21:47.335 INFO:tasks.workunit.client.1.smithi152.stdout:2/982: read d2/d1c/d2e/d57/db1/d90/fac [2618871,4226] 0 2023-12-07T16:21:47.335 INFO:tasks.workunit.client.1.smithi152.stdout:2/983: chown d2/d1c/d2e/d30/d33/lae 6485125 1 2023-12-07T16:21:47.335 INFO:tasks.workunit.client.1.smithi152.stdout:2/984: stat d2/d1c/d2e/d30/d33/f113 0 2023-12-07T16:21:47.336 INFO:tasks.workunit.client.1.smithi152.stdout:4/996: dwrite d0/daa/fba [0,4194304] 0 2023-12-07T16:21:47.339 INFO:tasks.workunit.client.1.smithi152.stdout:2/985: unlink d2/l3 0 2023-12-07T16:21:47.342 INFO:tasks.workunit.client.1.smithi152.stdout:2/986: creat d2/d1c/d52/da8/db6/f151 x:0 0 0 2023-12-07T16:21:47.342 INFO:tasks.workunit.client.1.smithi152.stdout:7/949: dread db/d27/d39/d41/d58/da5/dde/d110/f119 [0,4194304] 0 2023-12-07T16:21:47.342 INFO:tasks.workunit.client.1.smithi152.stdout:7/950: chown db/d27/d5e/cc4 580170 1 2023-12-07T16:21:47.344 INFO:tasks.workunit.client.1.smithi152.stdout:2/987: creat d2/d1c/d2e/d5d/dab/dd9/f152 x:0 0 0 2023-12-07T16:21:47.347 INFO:tasks.workunit.client.1.smithi152.stdout:2/988: rename d2/d56/f14c to d2/d1c/d2e/d57/d5b/da7/f153 0 2023-12-07T16:21:47.350 INFO:tasks.workunit.client.1.smithi152.stdout:2/989: mknod d2/d1c/d2e/d30/d33/d86/d148/c154 0 2023-12-07T16:21:47.350 INFO:tasks.workunit.client.1.smithi152.stdout:2/990: dread - d2/d1c/d52/da8/db6/f151 zero size 2023-12-07T16:21:47.352 INFO:tasks.workunit.client.0.smithi063.stdout:9/727: symlink d0/d21/d64/d6a/lef 0 2023-12-07T16:21:47.352 INFO:tasks.workunit.client.0.smithi063.stdout:9/728: truncate d0/d13/fb0 703993 0 2023-12-07T16:21:47.354 INFO:tasks.workunit.client.0.smithi063.stdout:9/729: stat d0/d21/d64/d6a/c91 0 2023-12-07T16:21:47.361 INFO:tasks.workunit.client.1.smithi152.stdout:7/951: dread db/d27/fa7 [0,4194304] 0 2023-12-07T16:21:47.365 INFO:tasks.workunit.client.0.smithi063.stdout:9/730: creat d0/d13/d95/ded/ff0 x:0 0 0 2023-12-07T16:21:47.365 INFO:tasks.workunit.client.0.smithi063.stdout:9/731: stat d0/d13/f40 0 2023-12-07T16:21:47.365 INFO:tasks.workunit.client.0.smithi063.stdout:9/732: truncate d0/d21/d64/d6a/d8f/fa2 190439 0 2023-12-07T16:21:47.366 INFO:tasks.workunit.client.1.smithi152.stdout:7/952: rmdir db/d68/d87 39 2023-12-07T16:21:47.377 INFO:tasks.workunit.client.0.smithi063.stdout:0/821: dwrite d4/dd/d26/d2b/db5/d5b/fae [0,4194304] 0 2023-12-07T16:21:47.378 INFO:tasks.workunit.client.1.smithi152.stdout:4/997: dwrite d0/d3/f95 [0,4194304] 0 2023-12-07T16:21:47.378 INFO:tasks.workunit.client.1.smithi152.stdout:2/991: dwrite d2/d1c/d2e/d57/f9f [0,4194304] 0 2023-12-07T16:21:47.379 INFO:tasks.workunit.client.1.smithi152.stdout:7/953: dread db/d68/d87/f8c [0,4194304] 0 2023-12-07T16:21:47.382 INFO:tasks.workunit.client.0.smithi063.stdout:0/822: creat d4/dd/d26/d2b/db5/d5b/d63/d9b/f114 x:0 0 0 2023-12-07T16:21:47.387 INFO:tasks.workunit.client.1.smithi152.stdout:2/992: rename d2/d1c/d2e/f44 to d2/d1c/d52/da8/f155 0 2023-12-07T16:21:47.388 INFO:tasks.workunit.client.1.smithi152.stdout:2/993: dread d2/d1c/d2e/d30/d42/d84/f135 [0,4194304] 0 2023-12-07T16:21:47.389 INFO:tasks.workunit.client.0.smithi063.stdout:4/624: mknod d1/d3/db/d2c/cbb 0 2023-12-07T16:21:47.390 INFO:tasks.workunit.client.1.smithi152.stdout:2/994: rmdir d2/d1c/d2e/d57/d5b/da7/d9a/da6/d119/d114 39 2023-12-07T16:21:47.390 INFO:tasks.workunit.client.0.smithi063.stdout:4/625: symlink d1/d3/db/d2c/d63/d99/lbc 0 2023-12-07T16:21:47.392 INFO:tasks.workunit.client.0.smithi063.stdout:4/626: write d1/d3/db/d41/f46 [262972,25881] 0 2023-12-07T16:21:47.393 INFO:tasks.workunit.client.1.smithi152.stdout:2/995: symlink d2/d1c/d2e/d30/d33/d86/l156 0 2023-12-07T16:21:47.393 INFO:tasks.workunit.client.1.smithi152.stdout:2/996: fdatasync d2/d1c/d2e/d57/d5b/fe2 0 2023-12-07T16:21:47.393 INFO:tasks.workunit.client.0.smithi063.stdout:9/733: dwrite d0/d21/f43 [0,4194304] 0 2023-12-07T16:21:47.393 INFO:tasks.workunit.client.0.smithi063.stdout:3/780: mknod d7/d4f/d53/d72/c100 0 2023-12-07T16:21:47.393 INFO:tasks.workunit.client.0.smithi063.stdout:3/781: chown d7/d4f/d53/d54/d76/fdc 3337700 1 2023-12-07T16:21:47.393 INFO:tasks.workunit.client.0.smithi063.stdout:0/823: dread d4/dd/de/d15/d1f/f4a [0,4194304] 0 2023-12-07T16:21:47.393 INFO:tasks.workunit.client.0.smithi063.stdout:4/627: creat d1/d3/d3f/d49/fbd x:0 0 0 2023-12-07T16:21:47.394 INFO:tasks.workunit.client.1.smithi152.stdout:2/997: dread d2/d1c/d2e/d30/f10d [0,4194304] 0 2023-12-07T16:21:47.395 INFO:tasks.workunit.client.0.smithi063.stdout:9/734: symlink d0/d13/d6f/d9b/lf1 0 2023-12-07T16:21:47.396 INFO:tasks.workunit.client.0.smithi063.stdout:9/735: stat d0/d13/fca 0 2023-12-07T16:21:47.398 INFO:tasks.workunit.client.0.smithi063.stdout:0/824: symlink d4/dd/de/d15/d1f/d22/l115 0 2023-12-07T16:21:47.399 INFO:tasks.workunit.client.0.smithi063.stdout:0/825: write d4/dd/fd1 [680957,102057] 0 2023-12-07T16:21:47.401 INFO:tasks.workunit.client.0.smithi063.stdout:4/628: creat d1/d3/d3a/fbe x:0 0 0 2023-12-07T16:21:47.401 INFO:tasks.workunit.client.0.smithi063.stdout:4/629: write d1/d3/db/d41/fb5 [517478,84975] 0 2023-12-07T16:21:47.401 INFO:tasks.workunit.client.0.smithi063.stdout:0/826: dread d4/dd/d26/d2b/d5e/d8e/dee/fb2 [0,4194304] 0 2023-12-07T16:21:47.403 INFO:tasks.workunit.client.0.smithi063.stdout:4/630: read d1/d3/d3f/d49/fa2 [366290,74369] 0 2023-12-07T16:21:47.403 INFO:tasks.workunit.client.0.smithi063.stdout:3/782: dread d7/d9/f46 [0,4194304] 0 2023-12-07T16:21:47.405 INFO:tasks.workunit.client.0.smithi063.stdout:0/827: creat d4/dd/de/d15/d59/d43/d10a/f116 x:0 0 0 2023-12-07T16:21:47.406 INFO:tasks.workunit.client.0.smithi063.stdout:7/741: sync 2023-12-07T16:21:47.406 INFO:tasks.workunit.client.0.smithi063.stdout:4/631: creat d1/d3/db/d73/fbf x:0 0 0 2023-12-07T16:21:47.408 INFO:tasks.workunit.client.0.smithi063.stdout:3/783: getdents d7/d4f 0 2023-12-07T16:21:47.408 INFO:tasks.workunit.client.1.smithi152.stdout:2/998: dread d2/d1c/d2e/f64 [0,4194304] 0 2023-12-07T16:21:47.410 INFO:tasks.workunit.client.0.smithi063.stdout:1/634: sync 2023-12-07T16:21:47.410 INFO:tasks.workunit.client.0.smithi063.stdout:2/843: sync 2023-12-07T16:21:47.410 INFO:tasks.workunit.client.0.smithi063.stdout:6/780: sync 2023-12-07T16:21:47.410 INFO:tasks.workunit.client.0.smithi063.stdout:5/773: sync 2023-12-07T16:21:47.410 INFO:tasks.workunit.client.0.smithi063.stdout:8/954: sync 2023-12-07T16:21:47.411 INFO:tasks.workunit.client.0.smithi063.stdout:7/742: getdents d2/d34/d5a/d5f 0 2023-12-07T16:21:47.411 INFO:tasks.workunit.client.0.smithi063.stdout:0/828: rmdir d4/dd/de/d15/d1f 39 2023-12-07T16:21:47.411 INFO:tasks.workunit.client.0.smithi063.stdout:0/829: chown d4/dd/d26/d2b/d5e/d8e/d95/d68/ld2 275932007 1 2023-12-07T16:21:47.411 INFO:tasks.workunit.client.0.smithi063.stdout:7/743: write d2/d34/d5a/d5f/d53/f91 [295291,6276] 0 2023-12-07T16:21:47.411 INFO:tasks.workunit.client.0.smithi063.stdout:4/632: mknod d1/d3/d3f/d49/d64/d80/cc0 0 2023-12-07T16:21:47.412 INFO:tasks.workunit.client.1.smithi152.stdout:2/999: creat d2/d9/d51/d54/f157 x:0 0 0 2023-12-07T16:21:47.414 INFO:tasks.workunit.client.0.smithi063.stdout:3/784: creat d7/d9/d1b/d5c/f101 x:0 0 0 2023-12-07T16:21:47.414 INFO:tasks.workunit.client.0.smithi063.stdout:3/785: write d7/d4f/d53/d72/fc9 [713378,129084] 0 2023-12-07T16:21:47.414 INFO:tasks.workunit.client.0.smithi063.stdout:6/781: truncate d0/d1e/f63 486301 0 2023-12-07T16:21:47.414 INFO:tasks.workunit.client.0.smithi063.stdout:1/635: mknod d0/dd/d55/dc9/ce0 0 2023-12-07T16:21:47.415 INFO:tasks.workunit.client.0.smithi063.stdout:2/844: symlink d0/d21/d56/d11/d52/da9/daf/dcd/l110 0 2023-12-07T16:21:47.417 INFO:tasks.workunit.client.0.smithi063.stdout:8/955: getdents d7/d14/d15/db4 0 2023-12-07T16:21:47.418 INFO:tasks.workunit.client.0.smithi063.stdout:9/736: dwrite d0/d13/d95/ded/ff0 [0,4194304] 0 2023-12-07T16:21:47.418 INFO:tasks.workunit.client.0.smithi063.stdout:9/737: write d0/d13/d39/d3a/d78/f7f [157449,34545] 0 2023-12-07T16:21:47.421 INFO:tasks.workunit.client.0.smithi063.stdout:0/830: creat d4/dd/d26/d2b/db5/d5b/d63/d6b/dc0/f117 x:0 0 0 2023-12-07T16:21:47.421 INFO:tasks.workunit.client.0.smithi063.stdout:4/633: creat d1/d3/db/d2c/d63/d62/d86/fc1 x:0 0 0 2023-12-07T16:21:47.423 INFO:tasks.workunit.client.0.smithi063.stdout:3/786: unlink d7/d9/dd/c15 0 2023-12-07T16:21:47.424 INFO:tasks.workunit.client.0.smithi063.stdout:1/636: creat d0/d47/fe1 x:0 0 0 2023-12-07T16:21:47.424 INFO:tasks.workunit.client.0.smithi063.stdout:6/782: dread d0/d1e/d29/f36 [0,4194304] 0 2023-12-07T16:21:47.425 INFO:tasks.workunit.client.0.smithi063.stdout:2/845: creat d0/d21/d56/d11/d52/dad/f111 x:0 0 0 2023-12-07T16:21:47.426 INFO:tasks.workunit.client.0.smithi063.stdout:6/783: write d0/d1e/d1d/d4f/d88/fea [708175,36554] 0 2023-12-07T16:21:47.429 INFO:tasks.workunit.client.0.smithi063.stdout:2/846: dread d0/f44 [0,4194304] 0 2023-12-07T16:21:47.429 INFO:tasks.workunit.client.0.smithi063.stdout:8/956: creat d7/d14/d15/d2b/dda/f12f x:0 0 0 2023-12-07T16:21:47.429 INFO:tasks.workunit.client.0.smithi063.stdout:5/774: dwrite d1/d31/d56/fdc [0,4194304] 0 2023-12-07T16:21:47.431 INFO:tasks.workunit.client.0.smithi063.stdout:9/738: link d0/d21/d64/d6a/d85/da4/ff d0/d21/d64/d6a/d8f/d92/dbb/ff2 0 2023-12-07T16:21:47.432 INFO:tasks.workunit.client.0.smithi063.stdout:4/634: creat d1/d3/d3f/d49/d64/fc2 x:0 0 0 2023-12-07T16:21:47.434 INFO:tasks.workunit.client.0.smithi063.stdout:3/787: creat d7/d4f/d53/f102 x:0 0 0 2023-12-07T16:21:47.435 INFO:tasks.workunit.client.0.smithi063.stdout:1/637: creat d0/d47/fe2 x:0 0 0 2023-12-07T16:21:47.441 INFO:tasks.workunit.client.0.smithi063.stdout:2/847: symlink d0/d21/d56/l112 0 2023-12-07T16:21:47.441 INFO:tasks.workunit.client.0.smithi063.stdout:8/957: mknod d7/d14/d15/dde/da8/d107/c130 0 2023-12-07T16:21:47.444 INFO:tasks.workunit.client.0.smithi063.stdout:6/784: symlink d0/d1e/d60/d68/d78/l119 0 2023-12-07T16:21:47.447 INFO:tasks.workunit.client.0.smithi063.stdout:5/775: mkdir d1/d31/dc8/de5 0 2023-12-07T16:21:47.447 INFO:tasks.workunit.client.0.smithi063.stdout:4/635: mknod d1/d3/d3f/d44/cc3 0 2023-12-07T16:21:47.447 INFO:tasks.workunit.client.0.smithi063.stdout:5/776: write d1/d3/d3a/f89 [4398558,19259] 0 2023-12-07T16:21:47.447 INFO:tasks.workunit.client.0.smithi063.stdout:5/777: chown d1/d3/d3a/fc0 21054964 1 2023-12-07T16:21:47.447 INFO:tasks.workunit.client.0.smithi063.stdout:5/778: chown d1/l39 166609588 1 2023-12-07T16:21:47.447 INFO:tasks.workunit.client.0.smithi063.stdout:5/779: fsync d1/d31/d56/fdc 0 2023-12-07T16:21:47.447 INFO:tasks.workunit.client.0.smithi063.stdout:5/780: truncate d1/d3/d3a/dcd/dd3/fe2 473143 0 2023-12-07T16:21:47.447 INFO:tasks.workunit.client.0.smithi063.stdout:3/788: truncate d7/fa 6002235 0 2023-12-07T16:21:47.453 INFO:tasks.workunit.client.0.smithi063.stdout:5/781: write d1/d31/d56/d61/f64 [2401127,89696] 0 2023-12-07T16:21:47.453 INFO:tasks.workunit.client.0.smithi063.stdout:9/739: dwrite d0/d21/d64/d6a/d8f/fe3 [0,4194304] 0 2023-12-07T16:21:47.456 INFO:tasks.workunit.client.0.smithi063.stdout:1/638: dwrite d0/dd/d1f/d75/fcb [0,4194304] 0 2023-12-07T16:21:47.460 INFO:tasks.workunit.client.0.smithi063.stdout:2/848: unlink d0/d21/d56/cfe 0 2023-12-07T16:21:47.460 INFO:tasks.workunit.client.0.smithi063.stdout:6/785: rename d0/d1e/d20/c39 to d0/d1e/d60/d68/d78/d9c/d9f/de4/d101/c11a 0 2023-12-07T16:21:47.461 INFO:tasks.workunit.client.0.smithi063.stdout:4/636: rmdir d1/d3/db/d2c/d63/d62 39 2023-12-07T16:21:47.461 INFO:tasks.workunit.client.0.smithi063.stdout:3/789: mkdir d7/d9/d103 0 2023-12-07T16:21:47.461 INFO:tasks.workunit.client.0.smithi063.stdout:3/790: chown d7/d9/dd/f90 2986 1 2023-12-07T16:21:47.462 INFO:tasks.workunit.client.0.smithi063.stdout:5/782: mkdir d1/d3/de6 0 2023-12-07T16:21:47.464 INFO:tasks.workunit.client.0.smithi063.stdout:8/958: dread d7/d14/d15/f68 [0,4194304] 0 2023-12-07T16:21:47.465 INFO:tasks.workunit.client.0.smithi063.stdout:4/637: read d1/d3/d3f/d49/d64/f74 [8228689,117124] 0 2023-12-07T16:21:47.465 INFO:tasks.workunit.client.0.smithi063.stdout:4/638: readlink d1/d3/l19 0 2023-12-07T16:21:47.465 INFO:tasks.workunit.client.0.smithi063.stdout:4/639: readlink d1/d3/db/d16/l60 0 2023-12-07T16:21:47.465 INFO:tasks.workunit.client.0.smithi063.stdout:9/740: write d0/d13/d39/d3a/f81 [462914,14469] 0 2023-12-07T16:21:47.465 INFO:tasks.workunit.client.0.smithi063.stdout:1/639: dread d0/dd/d19/d50/d71/f86 [0,4194304] 0 2023-12-07T16:21:47.465 INFO:tasks.workunit.client.0.smithi063.stdout:4/640: write d1/d3/db/d41/f52 [442456,118958] 0 2023-12-07T16:21:47.466 INFO:tasks.workunit.client.0.smithi063.stdout:8/959: dread d7/d38/fef [0,4194304] 0 2023-12-07T16:21:47.466 INFO:tasks.workunit.client.0.smithi063.stdout:8/960: chown d7/d14/d15/d48/f113 3 1 2023-12-07T16:21:47.472 INFO:tasks.workunit.client.0.smithi063.stdout:6/786: rmdir d0/d1e/d60/d68/d78/d9c/d9f/db8 39 2023-12-07T16:21:47.475 INFO:tasks.workunit.client.0.smithi063.stdout:2/849: creat d0/d21/d56/d11/d52/d63/f113 x:0 0 0 2023-12-07T16:21:47.475 INFO:tasks.workunit.client.0.smithi063.stdout:5/783: creat d1/d31/fe7 x:0 0 0 2023-12-07T16:21:47.477 INFO:tasks.workunit.client.0.smithi063.stdout:8/961: dread d7/d14/d15/d2b/f59 [0,4194304] 0 2023-12-07T16:21:47.478 INFO:tasks.workunit.client.0.smithi063.stdout:9/741: symlink d0/d21/d64/d6a/d8f/ddd/lf3 0 2023-12-07T16:21:47.484 INFO:tasks.workunit.client.0.smithi063.stdout:2/850: symlink d0/d21/d56/l114 0 2023-12-07T16:21:47.484 INFO:tasks.workunit.client.0.smithi063.stdout:5/784: unlink d1/d31/d56/l60 0 2023-12-07T16:21:47.485 INFO:tasks.workunit.client.0.smithi063.stdout:6/787: dread d0/d1e/d60/d68/d76/fcb [0,4194304] 0 2023-12-07T16:21:47.487 INFO:tasks.workunit.client.0.smithi063.stdout:9/742: mknod d0/d13/d6f/d9b/cf4 0 2023-12-07T16:21:47.487 INFO:tasks.workunit.client.0.smithi063.stdout:9/743: dread - d0/d13/f7e zero size 2023-12-07T16:21:47.487 INFO:tasks.workunit.client.0.smithi063.stdout:4/641: dwrite d1/d3/d3f/d49/d64/d80/fa6 [4194304,4194304] 0 2023-12-07T16:21:47.487 INFO:tasks.workunit.client.0.smithi063.stdout:4/642: fdatasync d1/d3/db/d2c/d63/f48 0 2023-12-07T16:21:47.488 INFO:tasks.workunit.client.0.smithi063.stdout:2/851: mkdir d0/d21/d56/d11/d52/da9/d115 0 2023-12-07T16:21:47.490 INFO:tasks.workunit.client.0.smithi063.stdout:5/785: creat d1/d3/d3a/fe8 x:0 0 0 2023-12-07T16:21:47.490 INFO:tasks.workunit.client.0.smithi063.stdout:5/786: chown d1/d3/de/d1e/d6b/dd0/l7a 61809429 1 2023-12-07T16:21:47.492 INFO:tasks.workunit.client.0.smithi063.stdout:6/788: rename d0/d1e/d60/d68/cc5 to d0/d1e/d1d/d4f/d88/d118/c11b 0 2023-12-07T16:21:47.492 INFO:tasks.workunit.client.0.smithi063.stdout:6/789: truncate d0/d17/d95/dd6/d5a/d9d/f116 279386 0 2023-12-07T16:21:47.492 INFO:tasks.workunit.client.0.smithi063.stdout:6/790: truncate d0/d1e/d2a/f52 4536751 0 2023-12-07T16:21:47.494 INFO:tasks.workunit.client.0.smithi063.stdout:1/640: rmdir d0/d98 0 2023-12-07T16:21:47.496 INFO:tasks.workunit.client.0.smithi063.stdout:5/787: getdents d1/d3/d3a/dcd/dd3 0 2023-12-07T16:21:47.498 INFO:tasks.workunit.client.0.smithi063.stdout:4/643: rename d1/d3/d3f/d44/f6c to d1/d3/db/d2c/fc4 0 2023-12-07T16:21:47.500 INFO:tasks.workunit.client.0.smithi063.stdout:5/788: mknod d1/d3/d3a/dcd/ce9 0 2023-12-07T16:21:47.502 INFO:tasks.workunit.client.0.smithi063.stdout:4/644: creat d1/d3/d3f/d49/d8b/fc5 x:0 0 0 2023-12-07T16:21:47.503 INFO:tasks.workunit.client.0.smithi063.stdout:4/645: readlink d1/d3/d3f/d49/d64/l92 0 2023-12-07T16:21:47.503 INFO:tasks.workunit.client.0.smithi063.stdout:4/646: read - d1/d3/db/d2c/fb7 zero size 2023-12-07T16:21:47.505 INFO:tasks.workunit.client.0.smithi063.stdout:4/647: write d1/d3/db/d2c/d63/f45 [1817820,79499] 0 2023-12-07T16:21:47.506 INFO:tasks.workunit.client.0.smithi063.stdout:8/962: dwrite d7/d14/d15/d2b/dda/f12f [0,4194304] 0 2023-12-07T16:21:47.507 INFO:tasks.workunit.client.0.smithi063.stdout:2/852: dread d0/d21/d56/d11/d52/da9/dbe/fae [0,4194304] 0 2023-12-07T16:21:47.513 INFO:tasks.workunit.client.0.smithi063.stdout:9/744: dwrite d0/d21/f2c [0,4194304] 0 2023-12-07T16:21:47.513 INFO:tasks.workunit.client.0.smithi063.stdout:8/963: symlink d7/d38/d73/l131 0 2023-12-07T16:21:47.515 INFO:tasks.workunit.client.0.smithi063.stdout:2/853: truncate d0/d21/d56/d11/d6d/f81 2179961 0 2023-12-07T16:21:47.519 INFO:tasks.workunit.client.0.smithi063.stdout:9/745: rename d0/d21/d64/d6a/d85/da4/c24 to d0/d13/cf5 0 2023-12-07T16:21:47.520 INFO:tasks.workunit.client.0.smithi063.stdout:8/964: unlink d7/d38/f70 0 2023-12-07T16:21:47.521 INFO:tasks.workunit.client.0.smithi063.stdout:2/854: mkdir d0/d21/d56/d11/db0/d106/d116 0 2023-12-07T16:21:47.522 INFO:tasks.workunit.client.0.smithi063.stdout:2/855: read d0/d21/d56/d11/f94 [228434,92566] 0 2023-12-07T16:21:47.523 INFO:tasks.workunit.client.0.smithi063.stdout:1/641: dwrite d0/dd/d19/d50/d71/f2c [0,4194304] 0 2023-12-07T16:21:47.523 INFO:tasks.workunit.client.0.smithi063.stdout:9/746: rename d0/d13/fcb to d0/d13/d6f/d9b/ff6 0 2023-12-07T16:21:47.526 INFO:tasks.workunit.client.0.smithi063.stdout:1/642: creat d0/dd/d1f/fe3 x:0 0 0 2023-12-07T16:21:47.527 INFO:tasks.workunit.client.0.smithi063.stdout:1/643: readlink d0/dd/d19/d50/lcd 0 2023-12-07T16:21:47.527 INFO:tasks.workunit.client.0.smithi063.stdout:1/644: fdatasync d0/dd/f6d 0 2023-12-07T16:21:47.527 INFO:tasks.workunit.client.0.smithi063.stdout:9/747: truncate d0/d13/d6f/daf/dbc/fc2 581812 0 2023-12-07T16:21:47.527 INFO:tasks.workunit.client.0.smithi063.stdout:9/748: write d0/d21/d64/d6a/d8f/d92/dbb/fcc [65227,9231] 0 2023-12-07T16:21:47.528 INFO:tasks.workunit.client.0.smithi063.stdout:1/645: symlink d0/dd/d1f/d75/le4 0 2023-12-07T16:21:47.528 INFO:tasks.workunit.client.0.smithi063.stdout:1/646: write d0/dd/d10/d1b/f82 [567196,22008] 0 2023-12-07T16:21:47.529 INFO:tasks.workunit.client.0.smithi063.stdout:1/647: rmdir d0/dd/d10/d1b 39 2023-12-07T16:21:47.529 INFO:tasks.workunit.client.0.smithi063.stdout:5/789: dwrite d1/d3/de/d1e/d6b/f88 [0,4194304] 0 2023-12-07T16:21:47.530 INFO:tasks.workunit.client.0.smithi063.stdout:5/790: fdatasync d1/d31/fe7 0 2023-12-07T16:21:47.530 INFO:tasks.workunit.client.0.smithi063.stdout:2/856: write d0/d21/d56/d11/d52/da9/daf/fbc [1615874,59998] 0 2023-12-07T16:21:47.530 INFO:tasks.workunit.client.0.smithi063.stdout:2/857: read d0/d21/d56/d11/d6d/fd8 [664026,118925] 0 2023-12-07T16:21:47.530 INFO:tasks.workunit.client.0.smithi063.stdout:2/858: fdatasync d0/d21/d56/d11/d52/da9/dbe/f3e 0 2023-12-07T16:21:47.530 INFO:tasks.workunit.client.0.smithi063.stdout:5/791: write d1/f7 [1492773,67156] 0 2023-12-07T16:21:47.530 INFO:tasks.workunit.client.0.smithi063.stdout:4/648: dwrite d1/d3/d3a/f97 [0,4194304] 0 2023-12-07T16:21:47.532 INFO:tasks.workunit.client.0.smithi063.stdout:4/649: write d1/d3/db/f56 [1180088,31671] 0 2023-12-07T16:21:47.532 INFO:tasks.workunit.client.0.smithi063.stdout:4/650: dread - d1/d3/db/d73/fb8 zero size 2023-12-07T16:21:47.532 INFO:tasks.workunit.client.0.smithi063.stdout:4/651: fdatasync d1/d3/d3f/d49/d64/d80/fa6 0 2023-12-07T16:21:47.533 INFO:tasks.workunit.client.0.smithi063.stdout:1/648: symlink d0/dd/d10/d13/le5 0 2023-12-07T16:21:47.534 INFO:tasks.workunit.client.0.smithi063.stdout:2/859: mkdir d0/d21/d39/d117 0 2023-12-07T16:21:47.534 INFO:tasks.workunit.client.0.smithi063.stdout:9/749: dread d0/d21/d64/d6a/d8f/d92/f9a [0,4194304] 0 2023-12-07T16:21:47.537 INFO:tasks.workunit.client.0.smithi063.stdout:5/792: mknod d1/d3/cea 0 2023-12-07T16:21:47.541 INFO:tasks.workunit.client.0.smithi063.stdout:4/652: mkdir d1/dc6 0 2023-12-07T16:21:47.544 INFO:tasks.workunit.client.0.smithi063.stdout:1/649: rename d0/dd/f3b to d0/dd/d10/d6f/da0/fe6 0 2023-12-07T16:21:47.546 INFO:tasks.workunit.client.0.smithi063.stdout:5/793: mknod d1/d31/d56/d61/d8f/ddf/de4/ceb 0 2023-12-07T16:21:47.546 INFO:tasks.workunit.client.0.smithi063.stdout:5/794: stat d1/d31/d56/d61/fcc 0 2023-12-07T16:21:47.546 INFO:tasks.workunit.client.0.smithi063.stdout:5/795: truncate d1/d31/d56/d61/fcc 95409 0 2023-12-07T16:21:47.547 INFO:tasks.workunit.client.0.smithi063.stdout:5/796: read d1/f40 [1222159,115570] 0 2023-12-07T16:21:47.558 INFO:tasks.workunit.client.0.smithi063.stdout:1/650: unlink d0/dd/d10/d13/l76 0 2023-12-07T16:21:47.558 INFO:tasks.workunit.client.0.smithi063.stdout:4/653: rmdir d1/d3/d3f/d44/da0 0 2023-12-07T16:21:47.558 INFO:tasks.workunit.client.0.smithi063.stdout:5/797: mknod d1/d31/d56/db7/cec 0 2023-12-07T16:21:47.560 INFO:tasks.workunit.client.0.smithi063.stdout:9/750: dwrite d0/d21/f23 [0,4194304] 0 2023-12-07T16:21:47.561 INFO:tasks.workunit.client.0.smithi063.stdout:9/751: dread - d0/d13/d39/d3a/d78/de8/fee zero size 2023-12-07T16:21:47.562 INFO:tasks.workunit.client.1.smithi152.stdout:7/954: sync 2023-12-07T16:21:47.562 INFO:tasks.workunit.client.1.smithi152.stdout:4/998: sync 2023-12-07T16:21:47.562 INFO:tasks.workunit.client.1.smithi152.stdout:4/999: write d0/d3/d6/d2b/dd9/d3a/d46/d9b/fe9 [588091,88729] 0 2023-12-07T16:21:47.562 INFO:tasks.workunit.client.1.smithi152.stdout:8/993: sync 2023-12-07T16:21:47.563 INFO:tasks.workunit.client.1.smithi152.stdout:6/950: sync 2023-12-07T16:21:47.564 INFO:tasks.workunit.client.1.smithi152.stdout:7/955: creat db/d27/d39/f131 x:0 0 0 2023-12-07T16:21:47.564 INFO:tasks.workunit.client.0.smithi063.stdout:4/654: mknod d1/d3/db/cc7 0 2023-12-07T16:21:47.564 INFO:tasks.workunit.client.0.smithi063.stdout:4/655: chown d1/d3/db/f3e 3918 1 2023-12-07T16:21:47.565 INFO:tasks.workunit.client.0.smithi063.stdout:4/656: truncate d1/d3/d3f/d49/d64/fc2 258588 0 2023-12-07T16:21:47.566 INFO:tasks.workunit.client.1.smithi152.stdout:6/951: mkdir d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/d55/d132 0 2023-12-07T16:21:47.566 INFO:tasks.workunit.client.1.smithi152.stdout:6/952: stat d2/d4f/d83/d48/d70/da7/db7/fd2 0 2023-12-07T16:21:47.567 INFO:tasks.workunit.client.0.smithi063.stdout:5/798: creat d1/d3/de6/fed x:0 0 0 2023-12-07T16:21:47.568 INFO:tasks.workunit.client.0.smithi063.stdout:9/752: link d0/d21/d64/d6a/d8f/d92/dbb/fcc d0/d21/d64/d6a/d8f/d92/dbb/ff7 0 2023-12-07T16:21:47.569 INFO:tasks.workunit.client.1.smithi152.stdout:6/953: symlink d2/d4f/d83/d85/d65/l133 0 2023-12-07T16:21:47.569 INFO:tasks.workunit.client.1.smithi152.stdout:6/954: chown d2/d4f/d83/d48/da8/l124 46967 1 2023-12-07T16:21:47.570 INFO:tasks.workunit.client.0.smithi063.stdout:4/657: mkdir d1/d3/d3f/d49/dc8 0 2023-12-07T16:21:47.571 INFO:tasks.workunit.client.1.smithi152.stdout:6/955: mknod d2/d4f/d83/d85/d19/d1f/dc7/dc9/c134 0 2023-12-07T16:21:47.571 INFO:tasks.workunit.client.1.smithi152.stdout:6/956: write d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/d5d/f6b [679965,11655] 0 2023-12-07T16:21:47.572 INFO:tasks.workunit.client.0.smithi063.stdout:4/658: write d1/d3/d3f/d44/f70 [2303541,75205] 0 2023-12-07T16:21:47.575 INFO:tasks.workunit.client.1.smithi152.stdout:6/957: read d2/f3 [10767010,126464] 0 2023-12-07T16:21:47.576 INFO:tasks.workunit.client.0.smithi063.stdout:9/753: write d0/d13/f2b [1305995,74024] 0 2023-12-07T16:21:47.577 INFO:tasks.workunit.client.1.smithi152.stdout:6/958: symlink d2/d4f/d83/d85/d9/deb/l135 0 2023-12-07T16:21:47.577 INFO:tasks.workunit.client.1.smithi152.stdout:6/959: write d2/d4f/d83/d85/d19/fca [4679084,122843] 0 2023-12-07T16:21:47.577 INFO:tasks.workunit.client.1.smithi152.stdout:6/960: fsync d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/dfc/f10c 0 2023-12-07T16:21:47.577 INFO:tasks.workunit.client.1.smithi152.stdout:6/961: read - d2/d4f/d83/d92/d121/f125 zero size 2023-12-07T16:21:47.578 INFO:tasks.workunit.client.0.smithi063.stdout:9/754: write d0/d21/d64/f4c [1558976,39185] 0 2023-12-07T16:21:47.583 INFO:tasks.workunit.client.1.smithi152.stdout:6/962: unlink d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/fa5 0 2023-12-07T16:21:47.584 INFO:tasks.workunit.client.0.smithi063.stdout:1/651: rmdir d0/dd 39 2023-12-07T16:21:47.584 INFO:tasks.workunit.client.0.smithi063.stdout:1/652: write d0/dd/d10/d13/d2f/fdb [6451,118628] 0 2023-12-07T16:21:47.588 INFO:tasks.workunit.client.0.smithi063.stdout:1/653: link d0/d47/ca6 d0/dd/d10/d13/ce7 0 2023-12-07T16:21:47.588 INFO:tasks.workunit.client.0.smithi063.stdout:9/755: dread d0/d13/d6f/fd8 [0,4194304] 0 2023-12-07T16:21:47.588 INFO:tasks.workunit.client.0.smithi063.stdout:9/756: readlink d0/l93 0 2023-12-07T16:21:47.588 INFO:tasks.workunit.client.1.smithi152.stdout:7/956: dwrite db/d27/d4d/f6d [4194304,4194304] 0 2023-12-07T16:21:47.588 INFO:tasks.workunit.client.1.smithi152.stdout:7/957: truncate db/d27/d5e/d104/d106/f129 159774 0 2023-12-07T16:21:47.589 INFO:tasks.workunit.client.0.smithi063.stdout:1/654: creat d0/dd/d10/d1b/fe8 x:0 0 0 2023-12-07T16:21:47.590 INFO:tasks.workunit.client.0.smithi063.stdout:1/655: truncate d0/dd/d10/d13/d2f/d79/f7d 630601 0 2023-12-07T16:21:47.591 INFO:tasks.workunit.client.1.smithi152.stdout:7/958: creat db/d27/d39/d41/d58/da5/dde/de7/f132 x:0 0 0 2023-12-07T16:21:47.592 INFO:tasks.workunit.client.1.smithi152.stdout:8/994: dwrite d3/d1e/d55/d83/dc5/f128 [0,4194304] 0 2023-12-07T16:21:47.592 INFO:tasks.workunit.client.0.smithi063.stdout:1/656: read d0/dd/d10/d13/f60 [909235,20069] 0 2023-12-07T16:21:47.592 INFO:tasks.workunit.client.0.smithi063.stdout:1/657: stat d0/dd/d10/d1b/d68/f95 0 2023-12-07T16:21:47.592 INFO:tasks.workunit.client.0.smithi063.stdout:1/658: write d0/dd/d10/d6f/fd0 [628632,31773] 0 2023-12-07T16:21:47.594 INFO:tasks.workunit.client.1.smithi152.stdout:7/959: unlink db/d27/d4d/f69 0 2023-12-07T16:21:47.594 INFO:tasks.workunit.client.0.smithi063.stdout:9/757: write d0/d21/d64/d6a/d85/da4/ff [2476198,73049] 0 2023-12-07T16:21:47.594 INFO:tasks.workunit.client.0.smithi063.stdout:1/659: mkdir d0/dd/d19/d50/d72/de9 0 2023-12-07T16:21:47.595 INFO:tasks.workunit.client.1.smithi152.stdout:8/995: mknod d3/d1e/d55/d83/dc5/d123/c165 0 2023-12-07T16:21:47.596 INFO:tasks.workunit.client.0.smithi063.stdout:9/758: mknod d0/cf8 0 2023-12-07T16:21:47.596 INFO:tasks.workunit.client.1.smithi152.stdout:7/960: truncate db/d1c/f51 7699055 0 2023-12-07T16:21:47.596 INFO:tasks.workunit.client.1.smithi152.stdout:7/961: readlink db/d27/d5e/lf8 0 2023-12-07T16:21:47.597 INFO:tasks.workunit.client.1.smithi152.stdout:8/996: mkdir d3/d166 0 2023-12-07T16:21:47.597 INFO:tasks.workunit.client.1.smithi152.stdout:7/962: dread - db/d27/f7f zero size 2023-12-07T16:21:47.597 INFO:tasks.workunit.client.1.smithi152.stdout:7/963: write db/d27/d39/d41/dcb/f11c [263009,93564] 0 2023-12-07T16:21:47.598 INFO:tasks.workunit.client.0.smithi063.stdout:1/660: mknod d0/dd/d10/d6f/da0/cea 0 2023-12-07T16:21:47.599 INFO:tasks.workunit.client.1.smithi152.stdout:8/997: mknod d3/d1e/d55/d83/dc5/d104/c167 0 2023-12-07T16:21:47.600 INFO:tasks.workunit.client.1.smithi152.stdout:8/998: dread - d3/d4/d9/d34/de5/f127 zero size 2023-12-07T16:21:47.600 INFO:tasks.workunit.client.1.smithi152.stdout:7/964: truncate db/fe 3953979 0 2023-12-07T16:21:47.600 INFO:tasks.workunit.client.0.smithi063.stdout:9/759: creat d0/d13/d39/d3a/d78/de8/ff9 x:0 0 0 2023-12-07T16:21:47.601 INFO:tasks.workunit.client.0.smithi063.stdout:5/799: dwrite d1/d31/d56/fdc [0,4194304] 0 2023-12-07T16:21:47.601 INFO:tasks.workunit.client.0.smithi063.stdout:5/800: truncate d1/d31/d56/d61/f58 5169308 0 2023-12-07T16:21:47.601 INFO:tasks.workunit.client.0.smithi063.stdout:5/801: truncate d1/d3/d3a/fc2 937970 0 2023-12-07T16:21:47.601 INFO:tasks.workunit.client.1.smithi152.stdout:7/965: rmdir db/d27/d5e/d104 39 2023-12-07T16:21:47.603 INFO:tasks.workunit.client.1.smithi152.stdout:8/999: mkdir d3/d1e/d55/d83/dae/de1/d168 0 2023-12-07T16:21:47.604 INFO:tasks.workunit.client.1.smithi152.stdout:7/966: truncate db/d27/d5e/fd6 1337383 0 2023-12-07T16:21:47.604 INFO:tasks.workunit.client.1.smithi152.stdout:7/967: fsync db/d27/d39/fe1 0 2023-12-07T16:21:47.605 INFO:tasks.workunit.client.0.smithi063.stdout:1/661: link d0/dd/d10/d13/f3d d0/dd/d1f/d75/feb 0 2023-12-07T16:21:47.605 INFO:tasks.workunit.client.0.smithi063.stdout:9/760: creat d0/d21/d64/ffa x:0 0 0 2023-12-07T16:21:47.605 INFO:tasks.workunit.client.0.smithi063.stdout:9/761: write d0/d13/d6f/daf/dbc/fd5 [119232,68088] 0 2023-12-07T16:21:47.606 INFO:tasks.workunit.client.1.smithi152.stdout:7/968: creat db/d1c/dd4/f133 x:0 0 0 2023-12-07T16:21:47.607 INFO:tasks.workunit.client.0.smithi063.stdout:5/802: rename d1/d31/d56/d61 to d1/d31/db8/dee 0 2023-12-07T16:21:47.609 INFO:tasks.workunit.client.1.smithi152.stdout:7/969: write db/d27/d5e/d45/f82 [1433395,106380] 0 2023-12-07T16:21:47.610 INFO:tasks.workunit.client.0.smithi063.stdout:5/803: creat d1/d31/db8/dee/de3/fef x:0 0 0 2023-12-07T16:21:47.610 INFO:tasks.workunit.client.1.smithi152.stdout:6/963: dwrite d2/d4f/d83/d85/d19/f22 [0,4194304] 0 2023-12-07T16:21:47.613 INFO:tasks.workunit.client.0.smithi063.stdout:5/804: mkdir d1/d3/de6/df0 0 2023-12-07T16:21:47.617 INFO:tasks.workunit.client.1.smithi152.stdout:6/964: link d2/d4f/d83/d85/d65/lfe d2/d4f/d83/d48/da8/l136 0 2023-12-07T16:21:47.617 INFO:tasks.workunit.client.1.smithi152.stdout:6/965: chown d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/d55/f11f 42 1 2023-12-07T16:21:47.618 INFO:tasks.workunit.client.0.smithi063.stdout:5/805: mkdir d1/d31/db8/dee/d8f/df1 0 2023-12-07T16:21:47.620 INFO:tasks.workunit.client.1.smithi152.stdout:6/966: rename d2/d4f/d83/d85/d65/d100/d102 to d2/d4f/d137 0 2023-12-07T16:21:47.620 INFO:tasks.workunit.client.1.smithi152.stdout:7/970: dread db/d27/f3d [0,4194304] 0 2023-12-07T16:21:47.624 INFO:tasks.workunit.client.1.smithi152.stdout:7/971: mkdir db/d1c/dd0/ddb/d134 0 2023-12-07T16:21:47.626 INFO:tasks.workunit.client.0.smithi063.stdout:9/762: dwrite d0/d13/f25 [0,4194304] 0 2023-12-07T16:21:47.626 INFO:tasks.workunit.client.1.smithi152.stdout:7/972: mknod db/d27/d39/d41/d58/da5/dde/df2/df4/d10e/c135 0 2023-12-07T16:21:47.627 INFO:tasks.workunit.client.1.smithi152.stdout:7/973: chown db/d27/d39/fb9 15861 1 2023-12-07T16:21:47.630 INFO:tasks.workunit.client.1.smithi152.stdout:7/974: write db/d27/d4d/dfb/f117 [3573864,130045] 0 2023-12-07T16:21:47.631 INFO:tasks.workunit.client.1.smithi152.stdout:7/975: creat db/d27/d39/d41/d58/da5/dde/f136 x:0 0 0 2023-12-07T16:21:47.636 INFO:tasks.workunit.client.1.smithi152.stdout:6/967: dwrite d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/f59 [4194304,4194304] 0 2023-12-07T16:21:47.636 INFO:tasks.workunit.client.0.smithi063.stdout:9/763: fsync d0/d13/d6f/daf/dbc/fd5 0 2023-12-07T16:21:47.636 INFO:tasks.workunit.client.0.smithi063.stdout:5/806: rmdir d1/d31 39 2023-12-07T16:21:47.638 INFO:tasks.workunit.client.1.smithi152.stdout:7/976: rename db/l12 to db/d68/d87/l137 0 2023-12-07T16:21:47.638 INFO:tasks.workunit.client.1.smithi152.stdout:7/977: fdatasync db/d27/d39/fe1 0 2023-12-07T16:21:47.640 INFO:tasks.workunit.client.0.smithi063.stdout:9/764: link d0/d21/d64/d6a/d8f/ddd/lf3 d0/d13/d95/ded/d57/lfb 0 2023-12-07T16:21:47.640 INFO:tasks.workunit.client.0.smithi063.stdout:5/807: dread d1/d3/f99 [0,4194304] 0 2023-12-07T16:21:47.641 INFO:tasks.workunit.client.1.smithi152.stdout:7/978: mkdir db/d27/d39/d41/d58/d138 0 2023-12-07T16:21:47.641 INFO:tasks.workunit.client.0.smithi063.stdout:9/765: mknod d0/d13/d39/d3a/d78/de8/cfc 0 2023-12-07T16:21:47.644 INFO:tasks.workunit.client.1.smithi152.stdout:6/968: rename d2/d4f/d83/d85/f89 to d2/d4f/d83/d85/d19/f138 0 2023-12-07T16:21:47.644 INFO:tasks.workunit.client.0.smithi063.stdout:5/808: rename d1/d3/de6/fed to d1/d31/db8/dee/d5e/ff2 0 2023-12-07T16:21:47.645 INFO:tasks.workunit.client.0.smithi063.stdout:9/766: mkdir d0/d21/d64/d6a/d85/dfd 0 2023-12-07T16:21:47.646 INFO:tasks.workunit.client.0.smithi063.stdout:5/809: truncate d1/d3/de/f1f 230002 0 2023-12-07T16:21:47.646 INFO:tasks.workunit.client.1.smithi152.stdout:7/979: creat db/d27/d39/d41/d58/d80/def/f139 x:0 0 0 2023-12-07T16:21:47.647 INFO:tasks.workunit.client.1.smithi152.stdout:6/969: creat d2/d4f/d83/d85/d94/f139 x:0 0 0 2023-12-07T16:21:47.649 INFO:tasks.workunit.client.0.smithi063.stdout:5/810: creat d1/d31/db8/ff3 x:0 0 0 2023-12-07T16:21:47.649 INFO:tasks.workunit.client.0.smithi063.stdout:5/811: chown d1/d3/d3a/dcd/dd3/d7e/c94 90 1 2023-12-07T16:21:47.651 INFO:tasks.workunit.client.0.smithi063.stdout:5/812: mknod d1/d3/d3a/dcd/dd3/d7e/dcf/cf4 0 2023-12-07T16:21:47.655 INFO:tasks.workunit.client.1.smithi152.stdout:7/980: rename db/d27/d39/d41/d58/da5/dde/df2/df4/d10e to db/d27/d39/d41/d58/d80/dac/d11e/d13a 0 2023-12-07T16:21:47.655 INFO:tasks.workunit.client.1.smithi152.stdout:7/981: fdatasync db/d27/d4d/f6d 0 2023-12-07T16:21:47.655 INFO:tasks.workunit.client.1.smithi152.stdout:7/982: chown db/d27/fa4 1244511 1 2023-12-07T16:21:47.659 INFO:tasks.workunit.client.1.smithi152.stdout:6/970: dread d2/d4f/d83/f99 [0,4194304] 0 2023-12-07T16:21:47.662 INFO:tasks.workunit.client.1.smithi152.stdout:6/971: unlink d2/d4f/d83/d85/l10 0 2023-12-07T16:21:47.674 INFO:tasks.workunit.client.0.smithi063.stdout:9/767: dwrite d0/d8d/fc7 [4194304,4194304] 0 2023-12-07T16:21:47.674 INFO:tasks.workunit.client.0.smithi063.stdout:9/768: chown d0/d21 1633771582 1 2023-12-07T16:21:47.676 INFO:tasks.workunit.client.0.smithi063.stdout:5/813: dwrite d1/d3/d3a/dcd/dd3/f8a [0,4194304] 0 2023-12-07T16:21:47.680 INFO:tasks.workunit.client.0.smithi063.stdout:9/769: creat d0/d21/d64/ffe x:0 0 0 2023-12-07T16:21:47.680 INFO:tasks.workunit.client.0.smithi063.stdout:9/770: chown d0 174948227 1 2023-12-07T16:21:47.681 INFO:tasks.workunit.client.0.smithi063.stdout:9/771: read d0/d21/d64/d6a/d8f/d92/dbb/ff7 [43386,46234] 0 2023-12-07T16:21:47.684 INFO:tasks.workunit.client.0.smithi063.stdout:9/772: rename d0/d21/f2c to d0/d13/d95/ded/fff 0 2023-12-07T16:21:47.686 INFO:tasks.workunit.client.0.smithi063.stdout:9/773: symlink d0/d13/d95/ded/d57/l100 0 2023-12-07T16:21:47.698 INFO:tasks.workunit.client.1.smithi152.stdout:7/983: dwrite db/d27/d5e/d45/f82 [4194304,4194304] 0 2023-12-07T16:21:47.700 INFO:tasks.workunit.client.0.smithi063.stdout:9/774: dread d0/d13/d39/fa7 [0,4194304] 0 2023-12-07T16:21:47.700 INFO:tasks.workunit.client.1.smithi152.stdout:7/984: rename db/f18 to db/d27/d4d/dfb/f13b 0 2023-12-07T16:21:47.701 INFO:tasks.workunit.client.1.smithi152.stdout:7/985: write db/d27/d5e/f54 [5215051,82000] 0 2023-12-07T16:21:47.701 INFO:tasks.workunit.client.0.smithi063.stdout:9/775: symlink d0/d13/d6f/d9b/l101 0 2023-12-07T16:21:47.702 INFO:tasks.workunit.client.1.smithi152.stdout:7/986: write db/d27/d5e/d45/fab [1333577,86101] 0 2023-12-07T16:21:47.702 INFO:tasks.workunit.client.0.smithi063.stdout:9/776: write d0/d13/d95/ded/f50 [3539895,116695] 0 2023-12-07T16:21:47.702 INFO:tasks.workunit.client.0.smithi063.stdout:9/777: truncate d0/d13/d6f/d9b/ff6 744840 0 2023-12-07T16:21:47.704 INFO:tasks.workunit.client.1.smithi152.stdout:7/987: write db/d27/f56 [3838872,92340] 0 2023-12-07T16:21:47.704 INFO:tasks.workunit.client.0.smithi063.stdout:9/778: mkdir d0/d13/d6f/d9b/d102 0 2023-12-07T16:21:47.705 INFO:tasks.workunit.client.0.smithi063.stdout:9/779: mknod d0/d21/d64/d6a/d8f/ddd/c103 0 2023-12-07T16:21:47.706 INFO:tasks.workunit.client.1.smithi152.stdout:7/988: mknod db/d1c/dd0/ddb/c13c 0 2023-12-07T16:21:47.706 INFO:tasks.workunit.client.0.smithi063.stdout:9/780: link d0/d13/le0 d0/d13/l104 0 2023-12-07T16:21:47.707 INFO:tasks.workunit.client.1.smithi152.stdout:7/989: creat db/d1c/dd4/f13d x:0 0 0 2023-12-07T16:21:47.707 INFO:tasks.workunit.client.1.smithi152.stdout:7/990: write db/d27/d39/d41/d58/da5/fca [21001,80638] 0 2023-12-07T16:21:47.709 INFO:tasks.workunit.client.1.smithi152.stdout:7/991: mkdir db/d27/d5e/d104/d106/d13e 0 2023-12-07T16:21:47.709 INFO:tasks.workunit.client.1.smithi152.stdout:7/992: chown db/d27/d5e/d45/da9/fce 0 1 2023-12-07T16:21:47.718 INFO:tasks.workunit.client.1.smithi152.stdout:7/993: dread db/fe [0,4194304] 0 2023-12-07T16:21:47.718 INFO:tasks.workunit.client.1.smithi152.stdout:7/994: stat db/d27/d39/d41/dcb/f11a 0 2023-12-07T16:21:47.718 INFO:tasks.workunit.client.1.smithi152.stdout:7/995: write db/d27/fa7 [1788411,116951] 0 2023-12-07T16:21:47.719 INFO:tasks.workunit.client.1.smithi152.stdout:7/996: dread - db/d1c/dd4/f13d zero size 2023-12-07T16:21:47.721 INFO:tasks.workunit.client.1.smithi152.stdout:7/997: mkdir db/d27/d39/d63/d13f 0 2023-12-07T16:21:47.722 INFO:tasks.workunit.client.1.smithi152.stdout:7/998: mkdir db/d27/d39/d41/d58/d80/def/d140 0 2023-12-07T16:21:47.722 INFO:tasks.workunit.client.1.smithi152.stdout:7/999: truncate db/d27/d39/d63/fb8 1211854 0 2023-12-07T16:21:47.724 INFO:tasks.workunit.client.0.smithi063.stdout:9/781: dwrite d0/d21/d64/d6a/d8f/d92/dbb/ff2 [0,4194304] 0 2023-12-07T16:21:47.725 INFO:tasks.workunit.client.0.smithi063.stdout:9/782: symlink d0/d21/d64/d6a/d8f/d92/dbb/l105 0 2023-12-07T16:21:47.726 INFO:tasks.workunit.client.0.smithi063.stdout:9/783: mkdir d0/d13/d95/d106 0 2023-12-07T16:21:47.726 INFO:tasks.workunit.client.0.smithi063.stdout:9/784: mknod d0/d13/d95/d106/c107 0 2023-12-07T16:21:47.728 INFO:tasks.workunit.client.0.smithi063.stdout:9/785: creat d0/d13/d39/d3a/d78/f108 x:0 0 0 2023-12-07T16:21:47.728 INFO:tasks.workunit.client.0.smithi063.stdout:9/786: chown d0/d21/c29 11 1 2023-12-07T16:21:47.742 INFO:tasks.workunit.client.0.smithi063.stdout:9/787: dwrite d0/d13/dd2/fdb [0,4194304] 0 2023-12-07T16:21:47.790 INFO:tasks.workunit.client.0.smithi063.stdout:7/744: sync 2023-12-07T16:21:47.790 INFO:tasks.workunit.client.0.smithi063.stdout:0/831: sync 2023-12-07T16:21:47.791 INFO:tasks.workunit.client.0.smithi063.stdout:0/832: creat d4/dd/de/d15/d59/d43/dd8/f118 x:0 0 0 2023-12-07T16:21:47.793 INFO:tasks.workunit.client.0.smithi063.stdout:0/833: creat d4/dd/d26/d2b/db5/d5b/f119 x:0 0 0 2023-12-07T16:21:47.819 INFO:tasks.workunit.client.1.smithi152.stdout:6/972: sync 2023-12-07T16:21:47.819 INFO:tasks.workunit.client.1.smithi152.stdout:6/973: chown d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/c107 9641 1 2023-12-07T16:21:47.819 INFO:tasks.workunit.client.1.smithi152.stdout:6/974: chown d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d10a 38 1 2023-12-07T16:21:47.819 INFO:tasks.workunit.client.0.smithi063.stdout:7/745: dwrite d2/d34/fa7 [0,4194304] 0 2023-12-07T16:21:47.819 INFO:tasks.workunit.client.0.smithi063.stdout:7/746: write d2/d96/fd4 [1018319,44532] 0 2023-12-07T16:21:47.819 INFO:tasks.workunit.client.0.smithi063.stdout:0/834: dwrite d4/dd/d26/f10c [0,4194304] 0 2023-12-07T16:21:47.819 INFO:tasks.workunit.client.0.smithi063.stdout:0/835: write d4/dd/d26/f70 [4745845,11537] 0 2023-12-07T16:21:47.819 INFO:tasks.workunit.client.0.smithi063.stdout:0/836: chown d4/dd/d26/d2b/db5/d5b/d63/d6b 36491 1 2023-12-07T16:21:47.821 INFO:tasks.workunit.client.0.smithi063.stdout:7/747: rename d2/d37/f6c to d2/d21/dc6/f10d 0 2023-12-07T16:21:47.825 INFO:tasks.workunit.client.0.smithi063.stdout:0/837: creat d4/dd/d26/d2b/db5/d5b/d63/d6b/da8/f11a x:0 0 0 2023-12-07T16:21:47.825 INFO:tasks.workunit.client.0.smithi063.stdout:0/838: dread - d4/d25/f113 zero size 2023-12-07T16:21:47.827 INFO:tasks.workunit.client.0.smithi063.stdout:7/748: mknod d2/d34/d5a/d5f/d53/d9f/c10e 0 2023-12-07T16:21:47.827 INFO:tasks.workunit.client.0.smithi063.stdout:7/749: getdents d2/d34/d46/d48/d103 0 2023-12-07T16:21:47.827 INFO:tasks.workunit.client.1.smithi152.stdout:6/975: rmdir d2/d4f/d83/d48/d70/d81 39 2023-12-07T16:21:47.828 INFO:tasks.workunit.client.1.smithi152.stdout:6/976: fsync d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/d55/fdd 0 2023-12-07T16:21:47.829 INFO:tasks.workunit.client.0.smithi063.stdout:0/839: unlink d4/dd/de/d15/d1f/l57 0 2023-12-07T16:21:47.835 INFO:tasks.workunit.client.0.smithi063.stdout:7/750: dread d2/fa [0,4194304] 0 2023-12-07T16:21:47.836 INFO:tasks.workunit.client.0.smithi063.stdout:7/751: mknod d2/d2c/c10f 0 2023-12-07T16:21:47.836 INFO:tasks.workunit.client.0.smithi063.stdout:0/840: dread d4/dd/d26/d2b/d5e/d8e/d95/fb4 [0,4194304] 0 2023-12-07T16:21:47.836 INFO:tasks.workunit.client.0.smithi063.stdout:7/752: mknod d2/d34/d5a/d5f/d78/d7c/c110 0 2023-12-07T16:21:47.837 INFO:tasks.workunit.client.0.smithi063.stdout:0/841: mknod d4/dd/d26/d2b/db5/d5b/d63/d74/c11b 0 2023-12-07T16:21:47.839 INFO:tasks.workunit.client.0.smithi063.stdout:0/842: creat d4/dd/d26/d2b/db5/d5b/d63/d74/d84/f11c x:0 0 0 2023-12-07T16:21:47.840 INFO:tasks.workunit.client.0.smithi063.stdout:0/843: mknod d4/dd/de/d15/d59/d43/c11d 0 2023-12-07T16:21:47.844 INFO:tasks.workunit.client.1.smithi152.stdout:6/977: dwrite d2/d4f/d83/d48/d70/f9e [0,4194304] 0 2023-12-07T16:21:47.845 INFO:tasks.workunit.client.0.smithi063.stdout:0/844: rmdir d4/dd/d26/d2b/db5/d5b/d63/d74/d84/ddb/dde 0 2023-12-07T16:21:47.858 INFO:tasks.workunit.client.1.smithi152.stdout:6/978: dread d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/f59 [4194304,4194304] 0 2023-12-07T16:21:47.860 INFO:tasks.workunit.client.1.smithi152.stdout:6/979: rename d2/d4f/d83/d48/d70/d81/fe8 to d2/d4f/d83/d48/d70/d81/d12f/f13a 0 2023-12-07T16:21:47.862 INFO:tasks.workunit.client.0.smithi063.stdout:7/753: dwrite d2/d64/f84 [0,4194304] 0 2023-12-07T16:21:47.862 INFO:tasks.workunit.client.0.smithi063.stdout:7/754: chown d2/d21/dc6/f10a 718090227 1 2023-12-07T16:21:47.862 INFO:tasks.workunit.client.0.smithi063.stdout:7/755: chown d2/d34/d5a/d5f/d78/d9a 620656 1 2023-12-07T16:21:47.864 INFO:tasks.workunit.client.0.smithi063.stdout:7/756: unlink d2/d2c/d87/fbc 0 2023-12-07T16:21:47.864 INFO:tasks.workunit.client.0.smithi063.stdout:7/757: read - d2/d34/d5a/d5f/d2a/d7e/fdd zero size 2023-12-07T16:21:47.865 INFO:tasks.workunit.client.0.smithi063.stdout:7/758: creat d2/d34/d5a/d5f/d78/f111 x:0 0 0 2023-12-07T16:21:47.866 INFO:tasks.workunit.client.0.smithi063.stdout:7/759: creat d2/d34/d5a/d5f/d53/d9f/f112 x:0 0 0 2023-12-07T16:21:47.866 INFO:tasks.workunit.client.0.smithi063.stdout:7/760: dread - d2/d34/d5a/d5f/d53/dab/db5/f10c zero size 2023-12-07T16:21:47.866 INFO:tasks.workunit.client.0.smithi063.stdout:7/761: truncate d2/d34/d5a/d5f/d53/dab/ffa 80922 0 2023-12-07T16:21:47.867 INFO:tasks.workunit.client.1.smithi152.stdout:6/980: dread d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/f40 [0,4194304] 0 2023-12-07T16:21:47.868 INFO:tasks.workunit.client.0.smithi063.stdout:0/845: dwrite d4/d25/f9e [0,4194304] 0 2023-12-07T16:21:47.868 INFO:tasks.workunit.client.0.smithi063.stdout:0/846: truncate d4/dd/d26/d2b/db5/d5b/d63/d6b/da8/fc5 545338 0 2023-12-07T16:21:47.868 INFO:tasks.workunit.client.0.smithi063.stdout:7/762: unlink d2/d64/f8f 0 2023-12-07T16:21:47.868 INFO:tasks.workunit.client.1.smithi152.stdout:6/981: mknod d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/c13b 0 2023-12-07T16:21:47.869 INFO:tasks.workunit.client.1.smithi152.stdout:6/982: truncate d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/f86 303441 0 2023-12-07T16:21:47.869 INFO:tasks.workunit.client.0.smithi063.stdout:0/847: link d4/dd/de/d15/d1f/le6 d4/dd/l11e 0 2023-12-07T16:21:47.869 INFO:tasks.workunit.client.1.smithi152.stdout:6/983: link d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/c64 d2/d4f/d83/d48/c13c 0 2023-12-07T16:21:47.870 INFO:tasks.workunit.client.0.smithi063.stdout:0/848: mknod d4/dd/d26/d2b/db5/d5b/d63/d74/d84/dcc/c11f 0 2023-12-07T16:21:47.871 INFO:tasks.workunit.client.1.smithi152.stdout:6/984: unlink d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/d5d/d118/ca6 0 2023-12-07T16:21:47.872 INFO:tasks.workunit.client.0.smithi063.stdout:0/849: link d4/dd/de/ff9 d4/dd/de/d15/d59/d43/f120 0 2023-12-07T16:21:47.875 INFO:tasks.workunit.client.0.smithi063.stdout:0/850: mkdir d4/dd/d26/d2b/d5e/d8e/d121 0 2023-12-07T16:21:47.878 INFO:tasks.workunit.client.0.smithi063.stdout:0/851: mkdir d4/dd/d26/d2b/db5/d5b/d63/d74/d84/d122 0 2023-12-07T16:21:47.879 INFO:tasks.workunit.client.0.smithi063.stdout:0/852: getdents d4/dd/d106 0 2023-12-07T16:21:47.879 INFO:tasks.workunit.client.0.smithi063.stdout:0/853: truncate d4/dd/d26/d2b/db5/d5b/d63/f80 1358793 0 2023-12-07T16:21:47.880 INFO:tasks.workunit.client.0.smithi063.stdout:0/854: creat d4/dd/d26/d2b/d5e/d69/f123 x:0 0 0 2023-12-07T16:21:47.880 INFO:tasks.workunit.client.0.smithi063.stdout:0/855: read - d4/dd/d26/d2b/d5e/f101 zero size 2023-12-07T16:21:47.880 INFO:tasks.workunit.client.1.smithi152.stdout:6/985: dread d2/d4f/d83/d85/d19/fca [0,4194304] 0 2023-12-07T16:21:47.882 INFO:tasks.workunit.client.1.smithi152.stdout:6/986: truncate d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/f11d 445579 0 2023-12-07T16:21:47.882 INFO:tasks.workunit.client.0.smithi063.stdout:0/856: mkdir d4/dd/de/d124 0 2023-12-07T16:21:47.883 INFO:tasks.workunit.client.0.smithi063.stdout:0/857: rmdir d4/d25 39 2023-12-07T16:21:47.883 INFO:tasks.workunit.client.1.smithi152.stdout:6/987: creat d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/d55/f13d x:0 0 0 2023-12-07T16:21:47.884 INFO:tasks.workunit.client.0.smithi063.stdout:0/858: mknod d4/d25/c125 0 2023-12-07T16:21:47.885 INFO:tasks.workunit.client.0.smithi063.stdout:0/859: creat d4/dd/d26/d2b/f126 x:0 0 0 2023-12-07T16:21:47.886 INFO:tasks.workunit.client.0.smithi063.stdout:0/860: creat d4/dd/de/d15/d1f/d22/f127 x:0 0 0 2023-12-07T16:21:47.886 INFO:tasks.workunit.client.0.smithi063.stdout:0/861: write d4/dd/de/d15/d59/d43/dd8/f10d [946832,66079] 0 2023-12-07T16:21:47.886 INFO:tasks.workunit.client.0.smithi063.stdout:0/862: write d4/dd/d26/d2b/db5/d5b/d63/d6b/dc0/f117 [285032,48969] 0 2023-12-07T16:21:47.886 INFO:tasks.workunit.client.0.smithi063.stdout:0/863: chown d4/dd/d26/d2b/db5/d5b/d63/d9b/l10b 1 1 2023-12-07T16:21:47.908 INFO:tasks.workunit.client.0.smithi063.stdout:0/864: write d4/dd/d26/f4f [6235091,75801] 0 2023-12-07T16:21:47.908 INFO:tasks.workunit.client.0.smithi063.stdout:7/763: dwrite d2/d34/d46/d48/d70/daf/de8/fee [0,4194304] 0 2023-12-07T16:21:47.908 INFO:tasks.workunit.client.0.smithi063.stdout:7/764: truncate d2/d34/d5a/d5f/d2a/d7e/fdd 973154 0 2023-12-07T16:21:47.918 INFO:tasks.workunit.client.0.smithi063.stdout:7/765: mkdir d2/d34/d46/d48/d56/d113 0 2023-12-07T16:21:47.928 INFO:tasks.workunit.client.1.smithi152.stdout:6/988: dwrite d2/d4f/d83/d48/d70/da7/db7/fd1 [0,4194304] 0 2023-12-07T16:21:47.930 INFO:tasks.workunit.client.0.smithi063.stdout:7/766: getdents d2/d34/d46/d48/d56 0 2023-12-07T16:21:47.930 INFO:tasks.workunit.client.1.smithi152.stdout:6/989: unlink d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/d8b/cd3 0 2023-12-07T16:21:47.930 INFO:tasks.workunit.client.1.smithi152.stdout:6/990: write d2/d4f/d83/d85/d19/d1f/dc7/dc9/d45/d55/f13d [959690,14858] 0 2023-12-07T16:21:47.931 INFO:tasks.workunit.client.0.smithi063.stdout:7/767: rmdir d2/d34/d5a/d5f/d2a/db8 39 2023-12-07T16:21:47.931 INFO:tasks.workunit.client.1.smithi152.stdout:6/991: truncate d2/d4f/d83/d85/d19/d1f/dc7/fe7 97681 0 2023-12-07T16:21:47.931 INFO:tasks.workunit.client.1.smithi152.stdout:6/992: chown d2/d4f/d83/d58/f93 1213 1 2023-12-07T16:21:47.932 INFO:tasks.workunit.client.1.smithi152.stdout:6/993: creat d2/d4f/f13e x:0 0 0 2023-12-07T16:21:47.932 INFO:tasks.workunit.client.1.smithi152.stdout:6/994: readlink d2/d4f/d83/d48/l6f 0 2023-12-07T16:21:47.933 INFO:tasks.workunit.client.1.smithi152.stdout:6/995: unlink d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/d8b/f9c 0 2023-12-07T16:21:47.934 INFO:tasks.workunit.client.0.smithi063.stdout:8/965: sync 2023-12-07T16:21:47.934 INFO:tasks.workunit.client.0.smithi063.stdout:6/791: sync 2023-12-07T16:21:47.934 INFO:tasks.workunit.client.0.smithi063.stdout:3/791: sync 2023-12-07T16:21:47.935 INFO:tasks.workunit.client.0.smithi063.stdout:8/966: read d7/d14/d15/db4/fe9 [3908485,75429] 0 2023-12-07T16:21:47.936 INFO:tasks.workunit.client.1.smithi152.stdout:6/996: mkdir d2/d4f/d83/d85/d19/d1f/dc7/dc9/d3f/d13f 0 2023-12-07T16:21:47.936 INFO:tasks.workunit.client.1.smithi152.stdout:6/997: dread - d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/d5d/fb8 zero size 2023-12-07T16:21:47.937 INFO:tasks.workunit.client.0.smithi063.stdout:6/792: rmdir d0/d1e 39 2023-12-07T16:21:47.937 INFO:tasks.workunit.client.0.smithi063.stdout:6/793: stat d0/d1e/d20/d4a/fce 0 2023-12-07T16:21:47.939 INFO:tasks.workunit.client.1.smithi152.stdout:6/998: link d2/d4f/d83/d85/d19/d1f/dc7/dc9/d2e/d4c/d5d/f9b d2/d4f/d83/d48/d70/d81/ded/f140 0 2023-12-07T16:21:47.940 INFO:tasks.workunit.client.0.smithi063.stdout:3/792: unlink d7/d21/c4d 0 2023-12-07T16:21:47.940 INFO:tasks.workunit.client.0.smithi063.stdout:3/793: readlink d7/d9/d1b/l95 0 2023-12-07T16:21:47.941 INFO:tasks.workunit.client.0.smithi063.stdout:8/967: rename d7/d14/d15/dde/da8/ffe to d7/d14/d15/d2b/f132 0 2023-12-07T16:21:47.942 INFO:tasks.workunit.client.0.smithi063.stdout:6/794: getdents d0/d1e/d1d/d4f 0 2023-12-07T16:21:47.943 INFO:tasks.workunit.client.0.smithi063.stdout:8/968: symlink d7/d14/d15/dde/l133 0 2023-12-07T16:21:47.943 INFO:tasks.workunit.client.0.smithi063.stdout:0/865: dwrite d4/dd/d26/d2b/d5e/d69/f123 [0,4194304] 0 2023-12-07T16:21:47.944 INFO:tasks.workunit.client.0.smithi063.stdout:6/795: symlink d0/d1e/d60/d68/d69/l11c 0 2023-12-07T16:21:47.945 INFO:tasks.workunit.client.0.smithi063.stdout:8/969: truncate d7/d38/fef 8027 0 2023-12-07T16:21:47.946 INFO:tasks.workunit.client.1.smithi152.stdout:6/999: link d2/d4f/d83/da0/da2/cc8 d2/d4f/c141 0 2023-12-07T16:21:47.948 INFO:tasks.workunit.client.0.smithi063.stdout:8/970: mkdir d7/d14/d110/d134 0 2023-12-07T16:21:47.948 INFO:tasks.workunit.client.0.smithi063.stdout:8/971: readlink d7/d14/d15/d2b/lfa 0 2023-12-07T16:21:47.949 INFO:tasks.workunit.client.1.smithi152.stderr:+ rm -rf -- ./tmp.SvNsZpREOA 2023-12-07T16:21:47.954 INFO:tasks.workunit.client.0.smithi063.stdout:7/768: dwrite d2/d34/d46/d48/d70/fd2 [0,4194304] 0 2023-12-07T16:21:47.960 INFO:tasks.workunit.client.0.smithi063.stdout:7/769: mknod d2/d34/d5a/d5f/d53/da3/c114 0 2023-12-07T16:21:47.961 INFO:tasks.workunit.client.0.smithi063.stdout:7/770: link d2/d34/d5a/d5f/d78/c8d d2/d34/d5a/d5f/d53/ded/c115 0 2023-12-07T16:21:47.965 INFO:tasks.workunit.client.0.smithi063.stdout:8/972: dwrite d7/d14/d15/dac/f12d [0,4194304] 0 2023-12-07T16:21:47.969 INFO:tasks.workunit.client.0.smithi063.stdout:8/973: link d7/d14/d1a/dce/d100/l10f d7/d14/d15/dde/da8/df8/l135 0 2023-12-07T16:21:47.986 INFO:tasks.workunit.client.0.smithi063.stdout:8/974: dwrite d7/d14/d15/d57/f97 [0,4194304] 0 2023-12-07T16:21:47.986 INFO:tasks.workunit.client.0.smithi063.stdout:8/975: dread - d7/d14/d15/dde/f11b zero size 2023-12-07T16:21:47.987 INFO:tasks.workunit.client.0.smithi063.stdout:8/976: fsync d7/d14/d15/dde/d63/d75/f80 0 2023-12-07T16:21:47.990 INFO:tasks.workunit.client.0.smithi063.stdout:7/771: dwrite d2/d34/d5a/d5f/d61/f6a [0,4194304] 0 2023-12-07T16:21:47.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:47 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:47.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:47 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:47.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:47 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:21:47.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:47 smithi152 ceph-mon[121113]: pgmap v31: 65 pgs: 65 active+clean; 2.9 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 170 MiB/s rd, 346 MiB/s wr, 507 op/s 2023-12-07T16:21:47.995 INFO:tasks.workunit.client.0.smithi063.stdout:7/772: rename d2/d34/d5a/d5f/d6d/f92 to d2/d34/d5a/d5f/d53/dab/db5/f116 0 2023-12-07T16:21:47.998 INFO:tasks.workunit.client.0.smithi063.stdout:7/773: rmdir d2/d34/d46 39 2023-12-07T16:21:47.999 INFO:tasks.workunit.client.0.smithi063.stdout:2/860: sync 2023-12-07T16:21:47.999 INFO:tasks.workunit.client.0.smithi063.stdout:1/662: sync 2023-12-07T16:21:47.999 INFO:tasks.workunit.client.0.smithi063.stdout:2/861: write d0/d21/d56/d11/f1b [2665855,21167] 0 2023-12-07T16:21:48.000 INFO:tasks.workunit.client.0.smithi063.stdout:7/774: dread d2/d34/d46/d48/d70/daf/dd6/fea [0,4194304] 0 2023-12-07T16:21:48.000 INFO:tasks.workunit.client.0.smithi063.stdout:1/663: symlink d0/dd/d10/d6f/dd8/dc3/lec 0 2023-12-07T16:21:48.000 INFO:tasks.workunit.client.0.smithi063.stdout:1/664: dread - d0/dd/d19/dbd/fc8 zero size 2023-12-07T16:21:48.001 INFO:tasks.workunit.client.0.smithi063.stdout:2/862: dread d0/d67/f55 [0,4194304] 0 2023-12-07T16:21:48.002 INFO:tasks.workunit.client.0.smithi063.stdout:8/977: dwrite d7/d14/d15/d48/f104 [0,4194304] 0 2023-12-07T16:21:48.003 INFO:tasks.workunit.client.0.smithi063.stdout:8/978: fdatasync d7/f4a 0 2023-12-07T16:21:48.003 INFO:tasks.workunit.client.0.smithi063.stdout:7/775: creat d2/d21/dc6/d109/f117 x:0 0 0 2023-12-07T16:21:48.004 INFO:tasks.workunit.client.0.smithi063.stdout:1/665: mknod d0/dd/d10/d6f/dd8/ced 0 2023-12-07T16:21:48.004 INFO:tasks.workunit.client.0.smithi063.stdout:1/666: chown d0/dd/d10/d13/d2f/fb1 33 1 2023-12-07T16:21:48.004 INFO:tasks.workunit.client.0.smithi063.stdout:1/667: read d0/dd/d10/d46/f58 [156698,73700] 0 2023-12-07T16:21:48.005 INFO:tasks.workunit.client.0.smithi063.stdout:2/863: symlink d0/d67/d65/l118 0 2023-12-07T16:21:48.007 INFO:tasks.workunit.client.0.smithi063.stdout:7/776: creat d2/f118 x:0 0 0 2023-12-07T16:21:48.007 INFO:tasks.workunit.client.0.smithi063.stdout:7/777: dread - d2/d21/dc6/fde zero size 2023-12-07T16:21:48.008 INFO:tasks.workunit.client.0.smithi063.stdout:1/668: mknod d0/dd/d19/cee 0 2023-12-07T16:21:48.008 INFO:tasks.workunit.client.0.smithi063.stdout:7/778: write d2/d21/f29 [3173332,34808] 0 2023-12-07T16:21:48.009 INFO:tasks.workunit.client.0.smithi063.stdout:1/669: getdents d0/dd/d10/d6f/dd8/dc3 0 2023-12-07T16:21:48.010 INFO:tasks.workunit.client.0.smithi063.stdout:7/779: mkdir d2/d34/d5a/d5f/d2a/d7e/d119 0 2023-12-07T16:21:48.011 INFO:tasks.workunit.client.0.smithi063.stdout:8/979: dread d7/d14/d15/dde/d63/d75/d98/fa3 [0,4194304] 0 2023-12-07T16:21:48.011 INFO:tasks.workunit.client.0.smithi063.stdout:1/670: symlink d0/dd/d4f/lef 0 2023-12-07T16:21:48.012 INFO:tasks.workunit.client.0.smithi063.stdout:7/780: mknod d2/d34/d46/d48/c11a 0 2023-12-07T16:21:48.012 INFO:tasks.workunit.client.0.smithi063.stdout:7/781: fdatasync d2/d34/fa7 0 2023-12-07T16:21:48.013 INFO:tasks.workunit.client.0.smithi063.stdout:8/980: stat d7/d14/d15/f6d 0 2023-12-07T16:21:48.020 INFO:tasks.workunit.client.0.smithi063.stdout:1/671: rename d0/dd/cbe to d0/dd/d19/cf0 0 2023-12-07T16:21:48.020 INFO:tasks.workunit.client.0.smithi063.stdout:7/782: symlink d2/d96/l11b 0 2023-12-07T16:21:48.020 INFO:tasks.workunit.client.0.smithi063.stdout:8/981: creat d7/d14/d110/f136 x:0 0 0 2023-12-07T16:21:48.021 INFO:tasks.workunit.client.0.smithi063.stdout:1/672: creat d0/dd/d10/d13/ff1 x:0 0 0 2023-12-07T16:21:48.023 INFO:tasks.workunit.client.0.smithi063.stdout:8/982: creat d7/d38/d73/f137 x:0 0 0 2023-12-07T16:21:48.023 INFO:tasks.workunit.client.0.smithi063.stdout:7/783: dread d2/d34/d46/d48/f4c [0,4194304] 0 2023-12-07T16:21:48.026 INFO:tasks.workunit.client.0.smithi063.stdout:1/673: mknod d0/cf2 0 2023-12-07T16:21:48.026 INFO:tasks.workunit.client.0.smithi063.stdout:7/784: read d2/d34/d5a/d5f/f1b [2226362,71890] 0 2023-12-07T16:21:48.026 INFO:tasks.workunit.client.0.smithi063.stdout:1/674: truncate d0/dd/d10/d6f/da0/fe6 99052 0 2023-12-07T16:21:48.027 INFO:tasks.workunit.client.0.smithi063.stdout:7/785: creat d2/d34/d5a/d5f/d2a/d7e/d119/f11c x:0 0 0 2023-12-07T16:21:48.028 INFO:tasks.workunit.client.0.smithi063.stdout:1/675: mknod d0/dd/d19/d50/cf3 0 2023-12-07T16:21:48.029 INFO:tasks.workunit.client.0.smithi063.stdout:7/786: mkdir d2/d34/d5a/d5f/d78/d7c/d9b/d11d 0 2023-12-07T16:21:48.029 INFO:tasks.workunit.client.0.smithi063.stdout:7/787: fdatasync d2/d34/d5a/d5f/f27 0 2023-12-07T16:21:48.030 INFO:tasks.workunit.client.0.smithi063.stdout:2/864: dwrite d0/d21/d56/d11/f104 [0,4194304] 0 2023-12-07T16:21:48.030 INFO:tasks.workunit.client.0.smithi063.stdout:2/865: truncate d0/d21/d56/d11/d52/d63/fd4 169957 0 2023-12-07T16:21:48.031 INFO:tasks.workunit.client.0.smithi063.stdout:1/676: rename d0/dd/d10/d1b/d68/db7/dda/fa5 to d0/dd/d4f/ff4 0 2023-12-07T16:21:48.031 INFO:tasks.workunit.client.0.smithi063.stdout:2/866: write d0/d21/fdf [1201662,73930] 0 2023-12-07T16:21:48.033 INFO:tasks.workunit.client.0.smithi063.stdout:7/788: mkdir d2/d21/d11e 0 2023-12-07T16:21:48.033 INFO:tasks.workunit.client.0.smithi063.stdout:7/789: write d2/d34/d5a/d5f/d2a/d7e/f86 [719056,124] 0 2023-12-07T16:21:48.037 INFO:tasks.workunit.client.0.smithi063.stdout:2/867: mknod d0/d21/d56/d11/d6d/dcb/c119 0 2023-12-07T16:21:48.037 INFO:tasks.workunit.client.0.smithi063.stdout:2/868: chown d0/f14 119172 1 2023-12-07T16:21:48.038 INFO:tasks.workunit.client.0.smithi063.stdout:2/869: mkdir d0/d21/d56/d11/d52/d5d/d11a 0 2023-12-07T16:21:48.039 INFO:tasks.workunit.client.0.smithi063.stdout:2/870: chown d0/d21/d56/d11/f1b 71 1 2023-12-07T16:21:48.042 INFO:tasks.workunit.client.0.smithi063.stdout:8/983: dwrite d7/d14/d15/d2b/f132 [8388608,4194304] 0 2023-12-07T16:21:48.042 INFO:tasks.workunit.client.0.smithi063.stdout:2/871: dread d0/d21/d56/d11/d52/da9/dbe/f30 [0,4194304] 0 2023-12-07T16:21:48.042 INFO:tasks.workunit.client.0.smithi063.stdout:2/872: chown d0/d21/d56/d11/d52/da9 37 1 2023-12-07T16:21:48.045 INFO:tasks.workunit.client.0.smithi063.stdout:8/984: mkdir d7/d38/d138 0 2023-12-07T16:21:48.046 INFO:tasks.workunit.client.0.smithi063.stdout:7/790: dread d2/d34/d5a/d5f/f3e [0,4194304] 0 2023-12-07T16:21:48.048 INFO:tasks.workunit.client.0.smithi063.stdout:1/677: dwrite d0/dd/d10/d6f/fac [0,4194304] 0 2023-12-07T16:21:48.048 INFO:tasks.workunit.client.0.smithi063.stdout:7/791: link d2/d34/d5a/fa4 d2/d34/d5a/d5f/d53/da3/de5/f11f 0 2023-12-07T16:21:48.053 INFO:tasks.workunit.client.0.smithi063.stdout:7/792: rename d2/d34/d5a/d5f/d53/c8a to d2/d34/d5a/d5f/d53/d9f/c120 0 2023-12-07T16:21:48.053 INFO:tasks.workunit.client.0.smithi063.stdout:7/793: chown d2/d34/d46/d48/d70/daf 29 1 2023-12-07T16:21:48.055 INFO:tasks.workunit.client.0.smithi063.stdout:7/794: mkdir d2/d34/d5a/d5f/d2a/db8/d121 0 2023-12-07T16:21:48.056 INFO:tasks.workunit.client.0.smithi063.stdout:1/678: dread d0/dd/d10/d6f/fd6 [0,4194304] 0 2023-12-07T16:21:48.056 INFO:tasks.workunit.client.0.smithi063.stdout:1/679: truncate d0/dd/d1f/d75/feb 5757735 0 2023-12-07T16:21:48.056 INFO:tasks.workunit.client.0.smithi063.stdout:7/795: mknod d2/d2c/dbe/c122 0 2023-12-07T16:21:48.057 INFO:tasks.workunit.client.0.smithi063.stdout:2/873: dread d0/d21/d56/d11/f1b [0,4194304] 0 2023-12-07T16:21:48.058 INFO:tasks.workunit.client.0.smithi063.stdout:1/680: write d0/dd/f6d [2161449,95933] 0 2023-12-07T16:21:48.059 INFO:tasks.workunit.client.0.smithi063.stdout:2/874: mknod d0/d10f/c11b 0 2023-12-07T16:21:48.062 INFO:tasks.workunit.client.0.smithi063.stdout:2/875: creat d0/d21/d56/d11/d52/d5d/f11c x:0 0 0 2023-12-07T16:21:48.063 INFO:tasks.workunit.client.0.smithi063.stdout:1/681: dread d0/dd/d10/d13/d2f/fdb [0,4194304] 0 2023-12-07T16:21:48.063 INFO:tasks.workunit.client.0.smithi063.stdout:9/788: sync 2023-12-07T16:21:48.063 INFO:tasks.workunit.client.0.smithi063.stdout:5/814: sync 2023-12-07T16:21:48.065 INFO:tasks.workunit.client.0.smithi063.stdout:4/659: sync 2023-12-07T16:21:48.069 INFO:tasks.workunit.client.0.smithi063.stdout:1/682: fsync d0/dd/d10/d13/f3d 0 2023-12-07T16:21:48.071 INFO:tasks.workunit.client.0.smithi063.stdout:4/660: write d1/d3/db/d73/f89 [543875,18219] 0 2023-12-07T16:21:48.071 INFO:tasks.workunit.client.0.smithi063.stdout:1/683: rmdir d0/dd/d10/d13/d2f 39 2023-12-07T16:21:48.071 INFO:tasks.workunit.client.0.smithi063.stdout:1/684: dread - d0/dd/d19/d50/fc7 zero size 2023-12-07T16:21:48.071 INFO:tasks.workunit.client.0.smithi063.stdout:1/685: fsync d0/dd/d19/d50/d71/f7e 0 2023-12-07T16:21:48.073 INFO:tasks.workunit.client.0.smithi063.stdout:4/661: link d1/d3/db/d2c/d63/d62/d86/f8d d1/d3/d3a/fc9 0 2023-12-07T16:21:48.076 INFO:tasks.workunit.client.0.smithi063.stdout:2/876: dread d0/d21/d56/d11/f58 [0,4194304] 0 2023-12-07T16:21:48.077 INFO:tasks.workunit.client.0.smithi063.stdout:1/686: creat d0/dd/d10/d13/ff5 x:0 0 0 2023-12-07T16:21:48.077 INFO:tasks.workunit.client.0.smithi063.stdout:1/687: write d0/dd/d19/d50/d72/fd3 [240362,97641] 0 2023-12-07T16:21:48.078 INFO:tasks.workunit.client.0.smithi063.stdout:2/877: creat d0/d21/d56/d11/db0/d106/d116/f11d x:0 0 0 2023-12-07T16:21:48.078 INFO:tasks.workunit.client.0.smithi063.stdout:2/878: write d0/d67/d65/f96 [5162659,69110] 0 2023-12-07T16:21:48.078 INFO:tasks.workunit.client.0.smithi063.stdout:2/879: chown d0/d21/d56/d11/d52/d63/d8c/cd6 1163526722 1 2023-12-07T16:21:48.081 INFO:tasks.workunit.client.0.smithi063.stdout:5/815: dread d1/d3/f3b [0,4194304] 0 2023-12-07T16:21:48.081 INFO:tasks.workunit.client.0.smithi063.stdout:5/816: chown d1/d31/db8/dee/d5e/f75 107683 1 2023-12-07T16:21:48.081 INFO:tasks.workunit.client.0.smithi063.stdout:2/880: rename d0/d21/d56/d11/d52/d63/fd4 to d0/d67/d65/f11e 0 2023-12-07T16:21:48.082 INFO:tasks.workunit.client.0.smithi063.stdout:2/881: symlink d0/l11f 0 2023-12-07T16:21:48.084 INFO:tasks.workunit.client.0.smithi063.stdout:7/796: dwrite d2/d34/d5a/d5f/f27 [0,4194304] 0 2023-12-07T16:21:48.085 INFO:tasks.workunit.client.0.smithi063.stdout:4/662: write d1/d3/db/d2c/d63/f84 [6416687,21204] 0 2023-12-07T16:21:48.085 INFO:tasks.workunit.client.0.smithi063.stdout:2/882: symlink d0/d21/d56/d11/dc0/l120 0 2023-12-07T16:21:48.086 INFO:tasks.workunit.client.0.smithi063.stdout:9/789: dwrite d0/d13/fca [4194304,4194304] 0 2023-12-07T16:21:48.090 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:47 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:48.090 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:47 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:48.090 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:47 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:21:48.090 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:47 smithi063 ceph-mon[112095]: pgmap v31: 65 pgs: 65 active+clean; 2.9 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 170 MiB/s rd, 346 MiB/s wr, 507 op/s 2023-12-07T16:21:48.095 INFO:tasks.workunit.client.0.smithi063.stdout:4/663: dread d1/d3/d3f/d49/f61 [0,4194304] 0 2023-12-07T16:21:48.095 INFO:tasks.workunit.client.0.smithi063.stdout:4/664: chown d1/d3/d51/fa1 37616 1 2023-12-07T16:21:48.096 INFO:tasks.workunit.client.0.smithi063.stdout:1/688: dwrite d0/dd/d19/d50/d71/f2c [0,4194304] 0 2023-12-07T16:21:48.096 INFO:tasks.workunit.client.0.smithi063.stdout:1/689: truncate d0/dd/d10/d6f/da0/fbc 512853 0 2023-12-07T16:21:48.101 INFO:tasks.workunit.client.0.smithi063.stdout:7/797: symlink d2/d2c/d87/l123 0 2023-12-07T16:21:48.101 INFO:tasks.workunit.client.0.smithi063.stdout:2/883: creat d0/d21/d56/d11/d52/d63/f121 x:0 0 0 2023-12-07T16:21:48.101 INFO:tasks.workunit.client.0.smithi063.stdout:9/790: creat d0/d13/d39/f109 x:0 0 0 2023-12-07T16:21:48.101 INFO:tasks.workunit.client.0.smithi063.stdout:2/884: fsync d0/d67/f59 0 2023-12-07T16:21:48.113 INFO:tasks.workunit.client.0.smithi063.stdout:4/665: unlink d1/d3/db/l2d 0 2023-12-07T16:21:48.113 INFO:tasks.workunit.client.0.smithi063.stdout:1/690: truncate d0/dd/d10/d13/f60 2007129 0 2023-12-07T16:21:48.114 INFO:tasks.workunit.client.0.smithi063.stdout:4/666: getdents d1/d3/d3f/d44 0 2023-12-07T16:21:48.115 INFO:tasks.workunit.client.0.smithi063.stdout:7/798: write d2/d21/f49 [340617,106565] 0 2023-12-07T16:21:48.115 INFO:tasks.workunit.client.0.smithi063.stdout:1/691: symlink d0/dd/d10/d13/d2f/lf6 0 2023-12-07T16:21:48.117 INFO:tasks.workunit.client.0.smithi063.stdout:1/692: write d0/dd/d19/d50/d72/fb8 [3059519,58972] 0 2023-12-07T16:21:48.119 INFO:tasks.workunit.client.0.smithi063.stdout:1/693: unlink d0/dd/d19/c45 0 2023-12-07T16:21:48.121 INFO:tasks.workunit.client.0.smithi063.stdout:7/799: write d2/f1e [4764344,84924] 0 2023-12-07T16:21:48.124 INFO:tasks.workunit.client.0.smithi063.stdout:7/800: unlink d2/d34/d5a/leb 0 2023-12-07T16:21:48.126 INFO:tasks.workunit.client.0.smithi063.stdout:7/801: unlink d2/d34/d5a/d5f/d78/fcf 0 2023-12-07T16:21:48.127 INFO:tasks.workunit.client.0.smithi063.stdout:7/802: mkdir d2/d2c/dbe/d124 0 2023-12-07T16:21:48.130 INFO:tasks.workunit.client.0.smithi063.stdout:2/885: dwrite d0/d67/d65/d6a/ded/ff6 [0,4194304] 0 2023-12-07T16:21:48.133 INFO:tasks.workunit.client.0.smithi063.stdout:2/886: creat d0/d21/d56/d11/dc0/f122 x:0 0 0 2023-12-07T16:21:48.133 INFO:tasks.workunit.client.0.smithi063.stdout:2/887: fdatasync d0/d21/d56/d11/f104 0 2023-12-07T16:21:48.135 INFO:tasks.workunit.client.0.smithi063.stdout:2/888: unlink d0/d21/d56/f20 0 2023-12-07T16:21:48.135 INFO:tasks.workunit.client.0.smithi063.stdout:4/667: dread d1/d3/db/d2c/f77 [0,4194304] 0 2023-12-07T16:21:48.135 INFO:tasks.workunit.client.0.smithi063.stdout:9/791: dwrite d0/d13/fb4 [0,4194304] 0 2023-12-07T16:21:48.137 INFO:tasks.workunit.client.0.smithi063.stdout:4/668: creat d1/d3/d3f/d44/fca x:0 0 0 2023-12-07T16:21:48.140 INFO:tasks.workunit.client.0.smithi063.stdout:7/803: dread d2/d21/f29 [0,4194304] 0 2023-12-07T16:21:48.141 INFO:tasks.workunit.client.0.smithi063.stdout:1/694: dwrite d0/dd/d10/fa3 [0,4194304] 0 2023-12-07T16:21:48.141 INFO:tasks.workunit.client.0.smithi063.stdout:1/695: readlink d0/dd/d10/d6f/dd8/dc3/lec 0 2023-12-07T16:21:48.141 INFO:tasks.workunit.client.0.smithi063.stdout:9/792: truncate d0/d13/f40 3734578 0 2023-12-07T16:21:48.143 INFO:tasks.workunit.client.0.smithi063.stdout:7/804: rmdir d2/d34/d46/d48/d56 39 2023-12-07T16:21:48.148 INFO:tasks.workunit.client.0.smithi063.stdout:1/696: rename d0/dd/d10/d46/f5e to d0/dd/d4f/ff7 0 2023-12-07T16:21:48.148 INFO:tasks.workunit.client.0.smithi063.stdout:1/697: readlink d0/dd/l18 0 2023-12-07T16:21:48.152 INFO:tasks.workunit.client.0.smithi063.stdout:7/805: mkdir d2/d34/d5a/d5f/d78/d7c/d125 0 2023-12-07T16:21:48.155 INFO:tasks.workunit.client.0.smithi063.stdout:7/806: read d2/f8 [147433,116754] 0 2023-12-07T16:21:48.157 INFO:tasks.workunit.client.0.smithi063.stdout:3/794: sync 2023-12-07T16:21:48.157 INFO:tasks.workunit.client.0.smithi063.stdout:0/866: sync 2023-12-07T16:21:48.157 INFO:tasks.workunit.client.0.smithi063.stdout:0/867: fdatasync d4/dd/d26/d2b/d5e/d8e/f9c 0 2023-12-07T16:21:48.161 INFO:tasks.workunit.client.0.smithi063.stdout:7/807: mkdir d2/d21/d126 0 2023-12-07T16:21:48.162 INFO:tasks.workunit.client.0.smithi063.stdout:3/795: link d7/d4f/d53/ced d7/d4f/d53/dc7/c104 0 2023-12-07T16:21:48.162 INFO:tasks.workunit.client.0.smithi063.stdout:7/808: write d2/d34/d46/d48/f4f [3629064,57710] 0 2023-12-07T16:21:48.163 INFO:tasks.workunit.client.0.smithi063.stdout:3/796: creat d7/d9/dd/d56/db5/f105 x:0 0 0 2023-12-07T16:21:48.163 INFO:tasks.workunit.client.0.smithi063.stdout:3/797: fsync d7/d9/dd/d7f/fab 0 2023-12-07T16:21:48.165 INFO:tasks.workunit.client.0.smithi063.stdout:2/889: dwrite d0/d21/d56/d11/d52/d5d/dbb/f54 [0,4194304] 0 2023-12-07T16:21:48.166 INFO:tasks.workunit.client.0.smithi063.stdout:7/809: link d2/d34/d46/d48/d56/f73 d2/d34/d5a/d5f/d53/d9f/f127 0 2023-12-07T16:21:48.166 INFO:tasks.workunit.client.0.smithi063.stdout:2/890: write d0/d67/d65/d6a/d8e/f91 [2244563,12796] 0 2023-12-07T16:21:48.166 INFO:tasks.workunit.client.0.smithi063.stdout:3/798: creat d7/d9/d1b/dc8/f106 x:0 0 0 2023-12-07T16:21:48.166 INFO:tasks.workunit.client.0.smithi063.stdout:3/799: fdatasync d7/d4f/d53/f6a 0 2023-12-07T16:21:48.167 INFO:tasks.workunit.client.0.smithi063.stdout:9/793: dwrite d0/d13/f25 [4194304,4194304] 0 2023-12-07T16:21:48.167 INFO:tasks.workunit.client.0.smithi063.stdout:3/800: write d7/d4f/d53/d72/db1/d41/f5a [460772,99908] 0 2023-12-07T16:21:48.167 INFO:tasks.workunit.client.0.smithi063.stdout:7/810: write d2/f12 [3933227,123739] 0 2023-12-07T16:21:48.168 INFO:tasks.workunit.client.0.smithi063.stdout:7/811: read - d2/d34/d5a/d5f/f81 zero size 2023-12-07T16:21:48.168 INFO:tasks.workunit.client.0.smithi063.stdout:2/891: symlink d0/d21/d56/d11/d52/d63/df3/l123 0 2023-12-07T16:21:48.170 INFO:tasks.workunit.client.0.smithi063.stdout:9/794: creat d0/d13/d95/d106/f10a x:0 0 0 2023-12-07T16:21:48.170 INFO:tasks.workunit.client.0.smithi063.stdout:9/795: chown d0/d21/ca1 177996 1 2023-12-07T16:21:48.171 INFO:tasks.workunit.client.0.smithi063.stdout:9/796: readlink d0/d21/d64/d6a/la5 0 2023-12-07T16:21:48.171 INFO:tasks.workunit.client.0.smithi063.stdout:9/797: chown d0/d8d/cac 1134713503 1 2023-12-07T16:21:48.171 INFO:tasks.workunit.client.0.smithi063.stdout:9/798: write d0/d13/fca [2581891,123504] 0 2023-12-07T16:21:48.172 INFO:tasks.workunit.client.0.smithi063.stdout:2/892: mkdir d0/d21/d56/d11/d52/da9/d124 0 2023-12-07T16:21:48.176 INFO:tasks.workunit.client.0.smithi063.stdout:2/893: rmdir d0/d21/d56/d71 39 2023-12-07T16:21:48.176 INFO:tasks.workunit.client.0.smithi063.stdout:9/799: creat d0/d21/d64/d6a/d85/dfd/f10b x:0 0 0 2023-12-07T16:21:48.176 INFO:tasks.workunit.client.0.smithi063.stdout:9/800: stat d0/d13/d39/d3a/d78/ld4 0 2023-12-07T16:21:48.176 INFO:tasks.workunit.client.0.smithi063.stdout:9/801: fsync d0/d13/f7e 0 2023-12-07T16:21:48.176 INFO:tasks.workunit.client.0.smithi063.stdout:9/802: chown d0/d13/d95/ded/fff 4715 1 2023-12-07T16:21:48.179 INFO:tasks.workunit.client.0.smithi063.stdout:2/894: creat d0/d21/d56/d11/db0/d106/f125 x:0 0 0 2023-12-07T16:21:48.180 INFO:tasks.workunit.client.0.smithi063.stdout:2/895: chown d0/d21/d56/d11/d6d/dcb/ff2 10867 1 2023-12-07T16:21:48.180 INFO:tasks.workunit.client.0.smithi063.stdout:2/896: chown d0/d21/d56/d11/d52/d63/d8c/cd6 3 1 2023-12-07T16:21:48.180 INFO:tasks.workunit.client.0.smithi063.stdout:2/897: write d0/d21/d56/d11/d52/da9/daf/dcd/ff1 [5412250,49725] 0 2023-12-07T16:21:48.180 INFO:tasks.workunit.client.0.smithi063.stdout:2/898: write d0/d21/d56/d11/d6d/fc8 [633094,89341] 0 2023-12-07T16:21:48.180 INFO:tasks.workunit.client.0.smithi063.stdout:3/801: dread d7/d49/d4b/d8e/fa4 [0,4194304] 0 2023-12-07T16:21:48.181 INFO:tasks.workunit.client.0.smithi063.stdout:9/803: dread d0/d21/d64/d6a/d85/da4/f6d [0,4194304] 0 2023-12-07T16:21:48.181 INFO:tasks.workunit.client.0.smithi063.stdout:2/899: stat d0/d67/d5b/l87 0 2023-12-07T16:21:48.182 INFO:tasks.workunit.client.0.smithi063.stdout:3/802: rmdir d7/d4f/d53/d54 39 2023-12-07T16:21:48.185 INFO:tasks.workunit.client.0.smithi063.stdout:9/804: getdents d0/d13/d39 0 2023-12-07T16:21:48.186 INFO:tasks.workunit.client.0.smithi063.stdout:9/805: symlink d0/d13/l10c 0 2023-12-07T16:21:48.193 INFO:tasks.workunit.client.0.smithi063.stdout:7/812: dwrite d2/f8 [0,4194304] 0 2023-12-07T16:21:48.195 INFO:tasks.workunit.client.0.smithi063.stdout:7/813: mknod d2/d37/de4/c128 0 2023-12-07T16:21:48.197 INFO:tasks.workunit.client.0.smithi063.stdout:2/900: dread d0/d21/d56/d11/d52/dad/fdc [0,4194304] 0 2023-12-07T16:21:48.198 INFO:tasks.workunit.client.0.smithi063.stdout:2/901: mkdir d0/d21/d56/d126 0 2023-12-07T16:21:48.199 INFO:tasks.workunit.client.0.smithi063.stdout:2/902: creat d0/d21/d56/d11/d52/da9/daf/f127 x:0 0 0 2023-12-07T16:21:48.204 INFO:tasks.workunit.client.0.smithi063.stdout:7/814: truncate d2/d34/d46/d48/f4f 3923520 0 2023-12-07T16:21:48.204 INFO:tasks.workunit.client.0.smithi063.stdout:7/815: chown d2/d34/d46/d48/d70/fc0 54896209 1 2023-12-07T16:21:48.208 INFO:tasks.workunit.client.0.smithi063.stdout:7/816: write d2/d96/fd4 [892080,50717] 0 2023-12-07T16:21:48.221 INFO:tasks.workunit.client.0.smithi063.stdout:2/903: dwrite d0/d21/d56/d11/f89 [0,4194304] 0 2023-12-07T16:21:48.223 INFO:tasks.workunit.client.0.smithi063.stdout:9/806: dwrite d0/d13/fb0 [0,4194304] 0 2023-12-07T16:21:48.229 INFO:tasks.workunit.client.0.smithi063.stdout:7/817: dwrite d2/d2c/f68 [4194304,4194304] 0 2023-12-07T16:21:48.229 INFO:tasks.workunit.client.0.smithi063.stdout:7/818: dread - d2/f118 zero size 2023-12-07T16:21:48.234 INFO:tasks.workunit.client.0.smithi063.stdout:9/807: getdents d0/d13/d95/ded/d57 0 2023-12-07T16:21:48.234 INFO:tasks.workunit.client.0.smithi063.stdout:6/796: sync 2023-12-07T16:21:48.235 INFO:tasks.workunit.client.0.smithi063.stdout:7/819: creat d2/d34/d46/f129 x:0 0 0 2023-12-07T16:21:48.237 INFO:tasks.workunit.client.0.smithi063.stdout:9/808: creat d0/d13/d6f/d9b/f10d x:0 0 0 2023-12-07T16:21:48.237 INFO:tasks.workunit.client.0.smithi063.stdout:7/820: dread d2/d21/dc6/f10a [0,4194304] 0 2023-12-07T16:21:48.238 INFO:tasks.workunit.client.0.smithi063.stdout:6/797: dread d0/f2c [0,4194304] 0 2023-12-07T16:21:48.250 INFO:tasks.workunit.client.0.smithi063.stdout:7/821: dread d2/d21/f3f [0,4194304] 0 2023-12-07T16:21:48.257 INFO:tasks.workunit.client.0.smithi063.stdout:9/809: dwrite d0/d21/d64/d6a/d8f/d92/fd6 [0,4194304] 0 2023-12-07T16:21:48.257 INFO:tasks.workunit.client.0.smithi063.stdout:9/810: fsync d0/d13/d39/d3a/f4d 0 2023-12-07T16:21:48.257 INFO:tasks.workunit.client.0.smithi063.stdout:6/798: dwrite d0/d79/f10c [0,4194304] 0 2023-12-07T16:21:48.259 INFO:tasks.workunit.client.0.smithi063.stdout:6/799: dread d0/f2c [0,4194304] 0 2023-12-07T16:21:48.262 INFO:tasks.workunit.client.0.smithi063.stdout:6/800: creat d0/d1e/d29/f11d x:0 0 0 2023-12-07T16:21:48.264 INFO:tasks.workunit.client.0.smithi063.stdout:6/801: mknod d0/d79/db9/df6/c11e 0 2023-12-07T16:21:48.264 INFO:tasks.workunit.client.0.smithi063.stdout:6/802: write d0/d1e/d20/d4a/fec [5179765,14206] 0 2023-12-07T16:21:48.265 INFO:tasks.workunit.client.0.smithi063.stdout:6/803: mkdir d0/d54/d11f 0 2023-12-07T16:21:48.268 INFO:tasks.workunit.client.0.smithi063.stdout:6/804: unlink d0/d1e/d60/d68/d76/da4/d107/cf1 0 2023-12-07T16:21:48.268 INFO:tasks.workunit.client.0.smithi063.stdout:6/805: truncate d0/d17/f5d 4515206 0 2023-12-07T16:21:48.268 INFO:tasks.workunit.client.0.smithi063.stdout:6/806: dread - d0/d17/d46/f109 zero size 2023-12-07T16:21:48.268 INFO:tasks.workunit.client.0.smithi063.stdout:6/807: fsync d0/d17/d1a/f74 0 2023-12-07T16:21:48.269 INFO:tasks.workunit.client.0.smithi063.stdout:6/808: creat d0/d17/d1a/d38/f120 x:0 0 0 2023-12-07T16:21:48.269 INFO:tasks.workunit.client.0.smithi063.stdout:6/809: readlink d0/d1e/d20/l89 0 2023-12-07T16:21:48.270 INFO:tasks.workunit.client.0.smithi063.stdout:6/810: mkdir d0/d1e/d60/d68/d78/df2/d121 0 2023-12-07T16:21:48.270 INFO:tasks.workunit.client.0.smithi063.stdout:6/811: fdatasync d0/d17/d46/fc7 0 2023-12-07T16:21:48.271 INFO:tasks.workunit.client.0.smithi063.stdout:6/812: rename d0/d79/d94/fdd to d0/d1e/d60/d68/d78/d9c/f122 0 2023-12-07T16:21:48.272 INFO:tasks.workunit.client.0.smithi063.stdout:6/813: mknod d0/d1e/d60/d68/c123 0 2023-12-07T16:21:48.274 INFO:tasks.workunit.client.0.smithi063.stdout:6/814: rename d0/fe to d0/d1e/d60/d68/f124 0 2023-12-07T16:21:48.275 INFO:tasks.workunit.client.0.smithi063.stdout:9/811: dwrite d0/d13/d95/ded/d57/fb9 [0,4194304] 0 2023-12-07T16:21:48.275 INFO:tasks.workunit.client.0.smithi063.stdout:6/815: symlink d0/d1e/d60/d68/d76/da4/dcc/l125 0 2023-12-07T16:21:48.275 INFO:tasks.workunit.client.0.smithi063.stdout:6/816: dread - d0/d1e/d1d/d4f/d88/fe7 zero size 2023-12-07T16:21:48.275 INFO:tasks.workunit.client.0.smithi063.stdout:6/817: fsync d0/d1e/d1d/d1f/f21 0 2023-12-07T16:21:48.276 INFO:tasks.workunit.client.0.smithi063.stdout:6/818: read d0/d17/d95/dd6/d8b/fa2 [94306,21020] 0 2023-12-07T16:21:48.277 INFO:tasks.workunit.client.0.smithi063.stdout:6/819: write d0/d17/d1a/f4c [3309185,57019] 0 2023-12-07T16:21:48.277 INFO:tasks.workunit.client.0.smithi063.stdout:9/812: creat d0/d13/d6f/daf/f10e x:0 0 0 2023-12-07T16:21:48.278 INFO:tasks.workunit.client.0.smithi063.stdout:6/820: unlink d0/d17/f25 0 2023-12-07T16:21:48.280 INFO:tasks.workunit.client.0.smithi063.stdout:9/813: creat d0/d13/d6f/daf/dbc/ddc/f10f x:0 0 0 2023-12-07T16:21:48.280 INFO:tasks.workunit.client.0.smithi063.stdout:9/814: write d0/d21/d64/d6a/d8f/d92/dbb/fcc [767861,51255] 0 2023-12-07T16:21:48.282 INFO:tasks.workunit.client.0.smithi063.stdout:9/815: mknod d0/d13/d6f/d9b/d102/c110 0 2023-12-07T16:21:48.285 INFO:tasks.workunit.client.0.smithi063.stdout:9/816: creat d0/d13/dd2/f111 x:0 0 0 2023-12-07T16:21:48.285 INFO:tasks.workunit.client.0.smithi063.stdout:9/817: write d0/d13/f49 [4847694,90478] 0 2023-12-07T16:21:48.285 INFO:tasks.workunit.client.0.smithi063.stdout:9/818: chown d0/d13/d95/ded/d57/l100 6331864 1 2023-12-07T16:21:48.289 INFO:tasks.workunit.client.0.smithi063.stdout:9/819: creat d0/d13/d39/d3a/f112 x:0 0 0 2023-12-07T16:21:48.289 INFO:tasks.workunit.client.0.smithi063.stdout:9/820: readlink d0/d21/l2d 0 2023-12-07T16:21:48.289 INFO:tasks.workunit.client.0.smithi063.stdout:9/821: stat d0/d21/d64/d6a/d8f/d92/ca8 0 2023-12-07T16:21:48.290 INFO:tasks.workunit.client.0.smithi063.stdout:9/822: mkdir d0/d13/d95/ded/d113 0 2023-12-07T16:21:48.296 INFO:tasks.workunit.client.0.smithi063.stdout:9/823: write d0/d13/f5d [2425550,97225] 0 2023-12-07T16:21:48.299 INFO:tasks.workunit.client.0.smithi063.stdout:9/824: unlink d0/d13/d95/ded/d57/lfb 0 2023-12-07T16:21:48.301 INFO:tasks.workunit.client.0.smithi063.stdout:9/825: symlink d0/d21/d64/l114 0 2023-12-07T16:21:48.301 INFO:tasks.workunit.client.0.smithi063.stdout:9/826: chown d0/d13/f25 505 1 2023-12-07T16:21:48.301 INFO:tasks.workunit.client.0.smithi063.stdout:9/827: fdatasync d0/d13/fb0 0 2023-12-07T16:21:48.301 INFO:tasks.workunit.client.0.smithi063.stdout:9/828: read d0/d13/f25 [295287,61234] 0 2023-12-07T16:21:48.304 INFO:tasks.workunit.client.0.smithi063.stdout:9/829: read d0/d21/d64/d6a/d8f/fe3 [547757,49250] 0 2023-12-07T16:21:48.304 INFO:tasks.workunit.client.0.smithi063.stdout:6/821: dwrite d0/d17/d46/f109 [0,4194304] 0 2023-12-07T16:21:48.305 INFO:tasks.workunit.client.0.smithi063.stdout:9/830: mkdir d0/d13/d39/d3a/d78/d115 0 2023-12-07T16:21:48.311 INFO:tasks.workunit.client.0.smithi063.stdout:9/831: rename d0/d21/d64/d6a/fd9 to d0/d8d/f116 0 2023-12-07T16:21:48.312 INFO:tasks.workunit.client.0.smithi063.stdout:9/832: rename d0/d13/d39/d3a/d78/de8/cfc to d0/d13/d39/d3a/c117 0 2023-12-07T16:21:48.313 INFO:tasks.workunit.client.0.smithi063.stdout:6/822: dread d0/d1e/f26 [0,4194304] 0 2023-12-07T16:21:48.313 INFO:tasks.workunit.client.0.smithi063.stdout:9/833: link d0/d13/d6f/daf/dbc/leb d0/d13/d6f/d9b/l118 0 2023-12-07T16:21:48.316 INFO:tasks.workunit.client.0.smithi063.stdout:6/823: unlink d0/d17/d1a/fc8 0 2023-12-07T16:21:48.316 INFO:tasks.workunit.client.0.smithi063.stdout:9/834: mknod d0/d13/d95/d106/c119 0 2023-12-07T16:21:48.317 INFO:tasks.workunit.client.0.smithi063.stdout:6/824: creat d0/d17/d46/f126 x:0 0 0 2023-12-07T16:21:48.318 INFO:tasks.workunit.client.0.smithi063.stdout:9/835: mknod d0/d21/d64/d6a/d8f/d92/c11a 0 2023-12-07T16:21:48.344 INFO:tasks.workunit.client.0.smithi063.stdout:6/825: dwrite d0/d1e/d60/d68/d69/d7d/f80 [0,4194304] 0 2023-12-07T16:21:48.344 INFO:tasks.workunit.client.0.smithi063.stdout:9/836: dwrite d0/d21/d64/d6a/d8f/d92/dbb/ff7 [0,4194304] 0 2023-12-07T16:21:48.348 INFO:tasks.workunit.client.0.smithi063.stdout:6/826: dread d0/d1e/f63 [0,4194304] 0 2023-12-07T16:21:48.350 INFO:tasks.workunit.client.0.smithi063.stdout:6/827: creat d0/d1e/d60/d68/d78/f127 x:0 0 0 2023-12-07T16:21:48.351 INFO:tasks.workunit.client.0.smithi063.stdout:6/828: creat d0/d1e/d20/f128 x:0 0 0 2023-12-07T16:21:48.354 INFO:tasks.workunit.client.0.smithi063.stdout:6/829: rename d0/d1e/d60/d68/d76/da4/fb2 to d0/d1e/d60/d68/d76/da4/dcc/d108/f129 0 2023-12-07T16:21:48.355 INFO:tasks.workunit.client.0.smithi063.stdout:9/837: dread d0/d13/d95/ded/fc9 [0,4194304] 0 2023-12-07T16:21:48.355 INFO:tasks.workunit.client.0.smithi063.stdout:9/838: truncate d0/d21/d64/ffa 694772 0 2023-12-07T16:21:48.356 INFO:tasks.workunit.client.0.smithi063.stdout:6/830: rmdir d0/d17/d95/dd6/d8b 39 2023-12-07T16:21:48.357 INFO:tasks.workunit.client.0.smithi063.stdout:9/839: symlink d0/d13/dd2/l11b 0 2023-12-07T16:21:48.359 INFO:tasks.workunit.client.0.smithi063.stdout:6/831: getdents d0/d1e/d1d/d1f/d4b 0 2023-12-07T16:21:48.361 INFO:tasks.workunit.client.0.smithi063.stdout:6/832: dread d0/d1e/d60/d68/d78/d9c/d9f/de4/f117 [0,4194304] 0 2023-12-07T16:21:48.362 INFO:tasks.workunit.client.0.smithi063.stdout:6/833: write d0/d1e/d29/f36 [735753,126254] 0 2023-12-07T16:21:48.363 INFO:tasks.workunit.client.0.smithi063.stdout:6/834: mkdir d0/d17/d46/d12a 0 2023-12-07T16:21:48.367 INFO:tasks.workunit.client.0.smithi063.stdout:9/840: dread d0/d13/d39/d3a/d78/f8a [0,4194304] 0 2023-12-07T16:21:48.368 INFO:tasks.workunit.client.0.smithi063.stdout:9/841: chown d0/d13/d39/d3a/d78/d115 50736572 1 2023-12-07T16:21:48.372 INFO:tasks.workunit.client.0.smithi063.stdout:9/842: write d0/d21/d64/d6a/d85/da4/f70 [241759,95127] 0 2023-12-07T16:21:48.372 INFO:tasks.workunit.client.0.smithi063.stdout:9/843: chown d0/d21/fe2 156727 1 2023-12-07T16:21:48.372 INFO:tasks.workunit.client.0.smithi063.stdout:9/844: readlink d0/d21/l3b 0 2023-12-07T16:21:48.381 INFO:tasks.workunit.client.0.smithi063.stdout:8/985: sync 2023-12-07T16:21:48.381 INFO:tasks.workunit.client.0.smithi063.stdout:5/817: sync 2023-12-07T16:21:48.381 INFO:tasks.workunit.client.0.smithi063.stdout:8/986: read - d7/db6/fcc zero size 2023-12-07T16:21:48.383 INFO:tasks.workunit.client.0.smithi063.stdout:5/818: dread d1/f7 [0,4194304] 0 2023-12-07T16:21:48.383 INFO:tasks.workunit.client.0.smithi063.stdout:6/835: dwrite d0/d17/d46/f55 [4194304,4194304] 0 2023-12-07T16:21:48.384 INFO:tasks.workunit.client.0.smithi063.stdout:8/987: rename d7/d38/d73/ced to d7/db6/c139 0 2023-12-07T16:21:48.384 INFO:tasks.workunit.client.0.smithi063.stdout:8/988: write d7/d14/d1a/dce/fdd [1393086,80999] 0 2023-12-07T16:21:48.384 INFO:tasks.workunit.client.0.smithi063.stdout:8/989: chown d7/d14/d15/d2b/dda/f12f 1 1 2023-12-07T16:21:48.384 INFO:tasks.workunit.client.0.smithi063.stdout:8/990: write d7/d14/d15/db4/f106 [200716,67906] 0 2023-12-07T16:21:48.384 INFO:tasks.workunit.client.0.smithi063.stdout:8/991: truncate d7/d14/d1a/fc9 1764002 0 2023-12-07T16:21:48.388 INFO:tasks.workunit.client.0.smithi063.stdout:6/836: rename d0/d1e/d60/d68/d69/d7d/ldb to d0/d1e/d60/d68/d78/d9c/d9f/df7/l12b 0 2023-12-07T16:21:48.388 INFO:tasks.workunit.client.0.smithi063.stdout:6/837: truncate d0/d1e/f3e 4584741 0 2023-12-07T16:21:48.391 INFO:tasks.workunit.client.0.smithi063.stdout:6/838: unlink d0/d1e/d1d/d1f/c83 0 2023-12-07T16:21:48.391 INFO:tasks.workunit.client.0.smithi063.stdout:6/839: write d0/d17/d1a/d38/f120 [641498,40286] 0 2023-12-07T16:21:48.392 INFO:tasks.workunit.client.0.smithi063.stdout:6/840: symlink d0/d1e/d60/d68/d76/da4/dcc/d108/l12c 0 2023-12-07T16:21:48.397 INFO:tasks.workunit.client.0.smithi063.stdout:6/841: creat d0/d1e/d60/d68/d78/df2/f12d x:0 0 0 2023-12-07T16:21:48.397 INFO:tasks.workunit.client.0.smithi063.stdout:6/842: chown d0/d17/d1a/f61 14067789 1 2023-12-07T16:21:48.399 INFO:tasks.workunit.client.0.smithi063.stdout:6/843: mkdir d0/d1e/d60/d68/d78/d112/d12e 0 2023-12-07T16:21:48.399 INFO:tasks.workunit.client.0.smithi063.stdout:9/845: dwrite d0/fda [0,4194304] 0 2023-12-07T16:21:48.400 INFO:tasks.workunit.client.0.smithi063.stdout:6/844: rename d0/d1e/d20/c34 to d0/d1e/d60/d68/d76/da4/dcc/d108/c12f 0 2023-12-07T16:21:48.400 INFO:tasks.workunit.client.0.smithi063.stdout:6/845: truncate d0/d1e/d1d/d1f/d4b/fb3 1481497 0 2023-12-07T16:21:48.401 INFO:tasks.workunit.client.0.smithi063.stdout:6/846: rmdir d0/d79 39 2023-12-07T16:21:48.405 INFO:tasks.workunit.client.0.smithi063.stdout:8/992: dwrite d7/d14/d1a/f5c [4194304,4194304] 0 2023-12-07T16:21:48.405 INFO:tasks.workunit.client.0.smithi063.stdout:8/993: write d7/d38/d73/f127 [324145,48670] 0 2023-12-07T16:21:48.405 INFO:tasks.workunit.client.0.smithi063.stdout:8/994: write d7/f4a [4740269,38846] 0 2023-12-07T16:21:48.409 INFO:tasks.workunit.client.0.smithi063.stdout:8/995: creat d7/d14/f13a x:0 0 0 2023-12-07T16:21:48.411 INFO:tasks.workunit.client.0.smithi063.stdout:8/996: creat d7/d14/d15/dac/f13b x:0 0 0 2023-12-07T16:21:48.411 INFO:tasks.workunit.client.0.smithi063.stdout:8/997: stat d7 0 2023-12-07T16:21:48.411 INFO:tasks.workunit.client.0.smithi063.stdout:8/998: write d7/d14/d15/dde/d63/d75/d98/f101 [400385,67745] 0 2023-12-07T16:21:48.413 INFO:tasks.workunit.client.0.smithi063.stdout:8/999: truncate d7/d14/f35 383219 0 2023-12-07T16:21:48.422 INFO:tasks.workunit.client.0.smithi063.stdout:6/847: dwrite d0/d1e/f12 [8388608,4194304] 0 2023-12-07T16:21:48.424 INFO:tasks.workunit.client.0.smithi063.stdout:6/848: link d0/d1e/d1d/d1f/d6c/ca3 d0/d1e/d60/d68/c130 0 2023-12-07T16:21:48.434 INFO:tasks.workunit.client.0.smithi063.stdout:9/846: dwrite d0/d13/d95/ded/fff [0,4194304] 0 2023-12-07T16:21:48.434 INFO:tasks.workunit.client.0.smithi063.stdout:9/847: fsync d0/d13/d39/d3a/d78/de8/ff9 0 2023-12-07T16:21:48.435 INFO:tasks.workunit.client.0.smithi063.stdout:6/849: write d0/d1e/f24 [3459973,73222] 0 2023-12-07T16:21:48.442 INFO:tasks.workunit.client.0.smithi063.stdout:9/848: rename d0/d21/l3c to d0/d13/d6f/daf/dbc/l11c 0 2023-12-07T16:21:48.444 INFO:tasks.workunit.client.0.smithi063.stdout:9/849: symlink d0/d21/d64/d6a/d85/dfd/l11d 0 2023-12-07T16:21:48.447 INFO:tasks.workunit.client.0.smithi063.stdout:1/698: sync 2023-12-07T16:21:48.447 INFO:tasks.workunit.client.0.smithi063.stdout:4/669: sync 2023-12-07T16:21:48.449 INFO:tasks.workunit.client.0.smithi063.stdout:4/670: unlink d1/d3/db/d2c/d63/d99/lbc 0 2023-12-07T16:21:48.449 INFO:tasks.workunit.client.0.smithi063.stdout:4/671: fdatasync d1/d3/db/d2c/d63/d62/d86/fc1 0 2023-12-07T16:21:48.449 INFO:tasks.workunit.client.0.smithi063.stdout:4/672: write d1/d3/db/d73/fb8 [273382,15911] 0 2023-12-07T16:21:48.449 INFO:tasks.workunit.client.0.smithi063.stdout:4/673: mknod d1/d3/db/d2c/ccb 0 2023-12-07T16:21:48.487 INFO:tasks.workunit.client.0.smithi063.stdout:4/674: dread d1/d3/f4e [0,4194304] 0 2023-12-07T16:21:48.490 INFO:tasks.workunit.client.0.smithi063.stdout:4/675: creat d1/d3/d3f/d44/fcc x:0 0 0 2023-12-07T16:21:48.490 INFO:tasks.workunit.client.0.smithi063.stdout:4/676: stat d1/d3/d3a 0 2023-12-07T16:21:48.490 INFO:tasks.workunit.client.0.smithi063.stdout:4/677: dread - d1/d3/db/d2c/fa3 zero size 2023-12-07T16:21:48.490 INFO:tasks.workunit.client.0.smithi063.stdout:4/678: creat d1/dc6/fcd x:0 0 0 2023-12-07T16:21:48.498 INFO:tasks.workunit.client.0.smithi063.stdout:9/850: dwrite d0/d13/d6f/d9b/ff6 [0,4194304] 0 2023-12-07T16:21:48.498 INFO:tasks.workunit.client.0.smithi063.stdout:1/699: dwrite d0/dd/d19/d50/d72/fd3 [0,4194304] 0 2023-12-07T16:21:48.504 INFO:tasks.workunit.client.0.smithi063.stdout:1/700: mkdir d0/dd/d10/d1b/d68/db7/dda/dd5/df8 0 2023-12-07T16:21:48.504 INFO:tasks.workunit.client.0.smithi063.stdout:1/701: chown d0/dd/d19/cf0 4 1 2023-12-07T16:21:48.505 INFO:tasks.workunit.client.0.smithi063.stdout:1/702: getdents d0/dd/d10/d46 0 2023-12-07T16:21:48.508 INFO:tasks.workunit.client.0.smithi063.stdout:1/703: link d0/d47/c48 d0/dd/cf9 0 2023-12-07T16:21:48.508 INFO:tasks.workunit.client.0.smithi063.stdout:1/704: fdatasync d0/dd/d19/d50/d72/f83 0 2023-12-07T16:21:48.508 INFO:tasks.workunit.client.0.smithi063.stdout:1/705: readlink d0/dd/d19/d50/l6c 0 2023-12-07T16:21:48.518 INFO:tasks.workunit.client.0.smithi063.stdout:1/706: mknod d0/dd/d1f/d75/cfa 0 2023-12-07T16:21:48.518 INFO:tasks.workunit.client.0.smithi063.stdout:1/707: stat d0/dd/d19/d50/d71/l88 0 2023-12-07T16:21:48.518 INFO:tasks.workunit.client.0.smithi063.stdout:1/708: chown d0/dd/d10/d46/l96 22 1 2023-12-07T16:21:48.522 INFO:tasks.workunit.client.0.smithi063.stdout:4/679: dwrite d1/d3/db/d2c/d63/f33 [0,4194304] 0 2023-12-07T16:21:48.522 INFO:tasks.workunit.client.0.smithi063.stdout:4/680: truncate d1/d3/db/d73/fbf 586656 0 2023-12-07T16:21:48.524 INFO:tasks.workunit.client.0.smithi063.stdout:9/851: dwrite d0/d21/d64/d6a/d8f/d92/dbb/fcc [0,4194304] 0 2023-12-07T16:21:48.524 INFO:tasks.workunit.client.0.smithi063.stdout:9/852: stat d0/f47 0 2023-12-07T16:21:48.524 INFO:tasks.workunit.client.0.smithi063.stdout:9/853: write d0/d13/d39/f48 [1227487,90406] 0 2023-12-07T16:21:48.526 INFO:tasks.workunit.client.0.smithi063.stdout:1/709: link d0/dd/l18 d0/lfb 0 2023-12-07T16:21:48.526 INFO:tasks.workunit.client.0.smithi063.stdout:9/854: mknod d0/d21/d64/d6a/d85/da4/c11e 0 2023-12-07T16:21:48.526 INFO:tasks.workunit.client.0.smithi063.stdout:9/855: chown d0/d13/dd2/fdb 89 1 2023-12-07T16:21:48.527 INFO:tasks.workunit.client.0.smithi063.stdout:1/710: link d0/dd/d10/d13/d2f/f7c d0/dd/d19/d50/d72/ffc 0 2023-12-07T16:21:48.528 INFO:tasks.workunit.client.0.smithi063.stdout:9/856: creat d0/d8d/f11f x:0 0 0 2023-12-07T16:21:48.529 INFO:tasks.workunit.client.0.smithi063.stdout:9/857: read d0/d21/d64/d6a/d85/da4/ff [5438969,125081] 0 2023-12-07T16:21:48.531 INFO:tasks.workunit.client.0.smithi063.stdout:9/858: write d0/d13/d95/ded/f50 [1116533,120989] 0 2023-12-07T16:21:48.532 INFO:tasks.workunit.client.0.smithi063.stdout:9/859: mknod d0/d13/d95/c120 0 2023-12-07T16:21:48.534 INFO:tasks.workunit.client.0.smithi063.stdout:9/860: write d0/fda [2638850,74154] 0 2023-12-07T16:21:48.534 INFO:tasks.workunit.client.0.smithi063.stdout:9/861: fdatasync d0/d13/d39/d3a/fbf 0 2023-12-07T16:21:48.535 INFO:tasks.workunit.client.0.smithi063.stdout:9/862: write d0/d13/f40 [4696549,124693] 0 2023-12-07T16:21:48.549 INFO:tasks.workunit.client.0.smithi063.stdout:1/711: dwrite d0/dd/d10/d13/f3d [0,4194304] 0 2023-12-07T16:21:48.566 INFO:tasks.workunit.client.0.smithi063.stdout:1/712: dwrite d0/d47/fe1 [0,4194304] 0 2023-12-07T16:21:48.568 INFO:tasks.workunit.client.0.smithi063.stdout:1/713: symlink d0/dd/d10/d6f/dd8/lfd 0 2023-12-07T16:21:48.569 INFO:tasks.workunit.client.0.smithi063.stdout:1/714: write d0/dd/d19/d50/d72/ffc [2888572,48999] 0 2023-12-07T16:21:48.570 INFO:tasks.workunit.client.0.smithi063.stdout:1/715: mkdir d0/dd/d1f/d75/dfe 0 2023-12-07T16:21:48.573 INFO:tasks.workunit.client.0.smithi063.stdout:1/716: unlink d0/dd/d10/d6f/fd0 0 2023-12-07T16:21:48.573 INFO:tasks.workunit.client.0.smithi063.stdout:1/717: truncate d0/dd/d10/d1b/f51 1027557 0 2023-12-07T16:21:48.574 INFO:tasks.workunit.client.0.smithi063.stdout:1/718: mknod d0/dd/d1f/d75/dfe/cff 0 2023-12-07T16:21:48.575 INFO:tasks.workunit.client.0.smithi063.stdout:1/719: mkdir d0/dd/d19/d50/d72/dc0/d100 0 2023-12-07T16:21:48.576 INFO:tasks.workunit.client.0.smithi063.stdout:1/720: write d0/dd/d10/d13/f3d [1904015,23777] 0 2023-12-07T16:21:48.579 INFO:tasks.workunit.client.0.smithi063.stdout:1/721: creat d0/dd/d10/d1b/d68/db7/dda/f101 x:0 0 0 2023-12-07T16:21:48.579 INFO:tasks.workunit.client.0.smithi063.stdout:1/722: dread - d0/dd/d1f/fe3 zero size 2023-12-07T16:21:48.579 INFO:tasks.workunit.client.0.smithi063.stdout:1/723: chown d0/lfb 80653 1 2023-12-07T16:21:48.579 INFO:tasks.workunit.client.0.smithi063.stdout:1/724: truncate d0/dd/d10/d6f/da0/fcc 115987 0 2023-12-07T16:21:48.580 INFO:tasks.workunit.client.0.smithi063.stdout:1/725: mknod d0/dd/c102 0 2023-12-07T16:21:48.589 INFO:tasks.workunit.client.0.smithi063.stdout:1/726: dread d0/dd/d19/f21 [0,4194304] 0 2023-12-07T16:21:48.609 INFO:tasks.workunit.client.0.smithi063.stdout:1/727: dwrite d0/dd/d10/fa3 [0,4194304] 0 2023-12-07T16:21:48.611 INFO:tasks.workunit.client.0.smithi063.stdout:1/728: mknod d0/dd/d1f/c103 0 2023-12-07T16:21:48.612 INFO:tasks.workunit.client.0.smithi063.stdout:1/729: mknod d0/dd/d10/d13/d2f/d79/c104 0 2023-12-07T16:21:48.613 INFO:tasks.workunit.client.0.smithi063.stdout:1/730: link d0/dd/d19/c7b d0/d47/c105 0 2023-12-07T16:21:48.617 INFO:tasks.workunit.client.0.smithi063.stdout:0/868: sync 2023-12-07T16:21:48.617 INFO:tasks.workunit.client.0.smithi063.stdout:7/822: sync 2023-12-07T16:21:48.617 INFO:tasks.workunit.client.0.smithi063.stdout:2/904: sync 2023-12-07T16:21:48.617 INFO:tasks.workunit.client.0.smithi063.stdout:3/803: sync 2023-12-07T16:21:48.618 INFO:tasks.workunit.client.0.smithi063.stdout:7/823: symlink d2/d21/d11e/l12a 0 2023-12-07T16:21:48.618 INFO:tasks.workunit.client.0.smithi063.stdout:7/824: stat d2/d34/d46/d48/d56/f82 0 2023-12-07T16:21:48.618 INFO:tasks.workunit.client.0.smithi063.stdout:0/869: write d4/d25/f7d [2469215,8033] 0 2023-12-07T16:21:48.621 INFO:tasks.workunit.client.0.smithi063.stdout:0/870: creat d4/dd/de/d15/d1f/f128 x:0 0 0 2023-12-07T16:21:48.621 INFO:tasks.workunit.client.0.smithi063.stdout:3/804: write d7/d9/f12 [5094087,27073] 0 2023-12-07T16:21:48.621 INFO:tasks.workunit.client.0.smithi063.stdout:3/805: fdatasync d7/d9/dd/f19 0 2023-12-07T16:21:48.622 INFO:tasks.workunit.client.0.smithi063.stdout:3/806: chown d7/d9/d1b/d5c/f91 442308 1 2023-12-07T16:21:48.622 INFO:tasks.workunit.client.0.smithi063.stdout:3/807: chown d7/d9/dd/d56/c65 17 1 2023-12-07T16:21:48.622 INFO:tasks.workunit.client.0.smithi063.stdout:7/825: creat d2/d2c/dbe/f12b x:0 0 0 2023-12-07T16:21:48.622 INFO:tasks.workunit.client.0.smithi063.stdout:7/826: chown d2/d34/d5a/d5f/d2a/f2f 117 1 2023-12-07T16:21:48.623 INFO:tasks.workunit.client.0.smithi063.stdout:0/871: creat d4/dd/d26/d2b/db5/d5b/d63/d74/df4/f129 x:0 0 0 2023-12-07T16:21:48.626 INFO:tasks.workunit.client.0.smithi063.stdout:3/808: unlink d7/d49/f77 0 2023-12-07T16:21:48.626 INFO:tasks.workunit.client.0.smithi063.stdout:7/827: creat d2/d34/d5a/d5f/d53/d9f/f12c x:0 0 0 2023-12-07T16:21:48.626 INFO:tasks.workunit.client.0.smithi063.stdout:7/828: read - d2/d34/d5a/fd3 zero size 2023-12-07T16:21:48.635 INFO:tasks.workunit.client.0.smithi063.stdout:3/809: getdents d7/d9 0 2023-12-07T16:21:48.636 INFO:tasks.workunit.client.0.smithi063.stdout:3/810: write d7/d49/d4b/f5e [1760727,48871] 0 2023-12-07T16:21:48.636 INFO:tasks.workunit.client.0.smithi063.stdout:7/829: dread d2/d34/d5a/d5f/d53/dab/fd0 [0,4194304] 0 2023-12-07T16:21:48.638 INFO:tasks.workunit.client.0.smithi063.stdout:7/830: creat d2/d34/f12d x:0 0 0 2023-12-07T16:21:48.638 INFO:tasks.workunit.client.0.smithi063.stdout:7/831: write d2/d34/fa7 [4394136,100767] 0 2023-12-07T16:21:48.638 INFO:tasks.workunit.client.0.smithi063.stdout:7/832: fdatasync d2/d34/d5a/d5f/d61/f6a 0 2023-12-07T16:21:48.639 INFO:tasks.workunit.client.0.smithi063.stdout:1/731: dwrite d0/dd/f6d [0,4194304] 0 2023-12-07T16:21:48.639 INFO:tasks.workunit.client.0.smithi063.stdout:7/833: mknod d2/d34/d46/d48/d70/c12e 0 2023-12-07T16:21:48.639 INFO:tasks.workunit.client.0.smithi063.stdout:3/811: dread d7/d4f/d53/d72/db1/d41/f86 [0,4194304] 0 2023-12-07T16:21:48.640 INFO:tasks.workunit.client.0.smithi063.stdout:0/872: dwrite d4/dd/d26/d2b/db5/d5b/d63/d6b/fc3 [0,4194304] 0 2023-12-07T16:21:48.640 INFO:tasks.workunit.client.0.smithi063.stdout:1/732: symlink d0/dd/d10/d1b/d68/l106 0 2023-12-07T16:21:48.641 INFO:tasks.workunit.client.0.smithi063.stdout:3/812: creat d7/d9/d103/f107 x:0 0 0 2023-12-07T16:21:48.641 INFO:tasks.workunit.client.0.smithi063.stdout:3/813: write d7/d9/dd/f66 [3690343,99562] 0 2023-12-07T16:21:48.641 INFO:tasks.workunit.client.0.smithi063.stdout:3/814: fdatasync d7/d9/dd/d56/f8c 0 2023-12-07T16:21:48.641 INFO:tasks.workunit.client.0.smithi063.stdout:7/834: write d2/f8 [1732740,122639] 0 2023-12-07T16:21:48.644 INFO:tasks.workunit.client.0.smithi063.stdout:3/815: dread d7/d4f/d53/d72/db1/d41/f86 [0,4194304] 0 2023-12-07T16:21:48.644 INFO:tasks.workunit.client.0.smithi063.stdout:0/873: creat d4/dd/de/d15/d1f/d4c/da1/db3/f12a x:0 0 0 2023-12-07T16:21:48.644 INFO:tasks.workunit.client.0.smithi063.stdout:0/874: chown d4/dd/de/d15/d59 186202839 1 2023-12-07T16:21:48.644 INFO:tasks.workunit.client.0.smithi063.stdout:0/875: write d4/dd/de/d15/f5f [906771,53004] 0 2023-12-07T16:21:48.644 INFO:tasks.workunit.client.0.smithi063.stdout:7/835: write d2/d2c/f68 [8056092,112467] 0 2023-12-07T16:21:48.644 INFO:tasks.workunit.client.0.smithi063.stdout:1/733: mknod d0/dd/d10/d13/d2f/d79/c107 0 2023-12-07T16:21:48.644 INFO:tasks.workunit.client.0.smithi063.stdout:1/734: readlink d0/dd/d1f/d75/l7f 0 2023-12-07T16:21:48.644 INFO:tasks.workunit.client.0.smithi063.stdout:7/836: fsync d2/d21/dc6/d109/f108 0 2023-12-07T16:21:48.644 INFO:tasks.workunit.client.0.smithi063.stdout:1/735: fdatasync d0/dd/d19/d50/d72/ffc 0 2023-12-07T16:21:48.644 INFO:tasks.workunit.client.0.smithi063.stdout:7/837: fdatasync d2/d34/d5a/d5f/d53/fbf 0 2023-12-07T16:21:48.645 INFO:tasks.workunit.client.0.smithi063.stdout:3/816: symlink d7/d49/dd9/l108 0 2023-12-07T16:21:48.645 INFO:tasks.workunit.client.0.smithi063.stdout:7/838: dread d2/d34/d46/d48/d70/daf/dd6/fea [0,4194304] 0 2023-12-07T16:21:48.645 INFO:tasks.workunit.client.0.smithi063.stdout:3/817: readlink d7/d21/l2f 0 2023-12-07T16:21:48.646 INFO:tasks.workunit.client.0.smithi063.stdout:0/876: getdents d4/dd/d26/d2b/db5/d5b/d63/d74/df4 0 2023-12-07T16:21:48.650 INFO:tasks.workunit.client.0.smithi063.stdout:7/839: unlink d2/d34/d5a/d5f/d2a/d7e/f86 0 2023-12-07T16:21:48.651 INFO:tasks.workunit.client.0.smithi063.stdout:3/818: mkdir d7/d9/d1b/df3/d109 0 2023-12-07T16:21:48.652 INFO:tasks.workunit.client.0.smithi063.stdout:0/877: creat d4/dd/d26/d2b/d5e/d69/f12b x:0 0 0 2023-12-07T16:21:48.653 INFO:tasks.workunit.client.0.smithi063.stdout:7/840: symlink d2/d34/d5a/d5f/d53/l12f 0 2023-12-07T16:21:48.655 INFO:tasks.workunit.client.0.smithi063.stdout:3/819: mknod d7/d4f/d53/d54/d76/c10a 0 2023-12-07T16:21:48.655 INFO:tasks.workunit.client.0.smithi063.stdout:1/736: dread d0/dd/d10/d13/f3d [0,4194304] 0 2023-12-07T16:21:48.655 INFO:tasks.workunit.client.0.smithi063.stdout:0/878: mknod d4/dd/d26/d2b/db5/c12c 0 2023-12-07T16:21:48.655 INFO:tasks.workunit.client.0.smithi063.stdout:0/879: stat d4/dd/d26/d2b/d5e/f65 0 2023-12-07T16:21:48.656 INFO:tasks.workunit.client.0.smithi063.stdout:0/880: write d4/dd/fd1 [288991,48609] 0 2023-12-07T16:21:48.656 INFO:tasks.workunit.client.0.smithi063.stdout:7/841: link d2/d34/d46/d48/f4f d2/d96/f130 0 2023-12-07T16:21:48.657 INFO:tasks.workunit.client.0.smithi063.stdout:1/737: creat d0/dd/d19/d50/d72/de9/f108 x:0 0 0 2023-12-07T16:21:48.657 INFO:tasks.workunit.client.0.smithi063.stdout:1/738: stat d0/dd/d19/d50/d71 0 2023-12-07T16:21:48.657 INFO:tasks.workunit.client.0.smithi063.stdout:1/739: stat d0/dd/d19/f43 0 2023-12-07T16:21:48.658 INFO:tasks.workunit.client.0.smithi063.stdout:0/881: creat d4/dd/d26/d2b/db5/d5b/d63/d74/d84/dcc/f12d x:0 0 0 2023-12-07T16:21:48.659 INFO:tasks.workunit.client.0.smithi063.stdout:7/842: mknod d2/c131 0 2023-12-07T16:21:48.660 INFO:tasks.workunit.client.0.smithi063.stdout:1/740: creat d0/f109 x:0 0 0 2023-12-07T16:21:48.662 INFO:tasks.workunit.client.0.smithi063.stdout:0/882: rename d4/dd/d26/d2b/db5/d5b/d63/d6b/da8 to d4/dd/d26/d2b/db5/d5b/d63/d74/df4/d12e 0 2023-12-07T16:21:48.663 INFO:tasks.workunit.client.0.smithi063.stdout:1/741: creat d0/dd/d55/f10a x:0 0 0 2023-12-07T16:21:48.664 INFO:tasks.workunit.client.0.smithi063.stdout:0/883: symlink d4/dd/d26/d2b/db5/d5b/d63/d74/df4/l12f 0 2023-12-07T16:21:48.664 INFO:tasks.workunit.client.0.smithi063.stdout:1/742: getdents d0/dd/d19 0 2023-12-07T16:21:48.665 INFO:tasks.workunit.client.0.smithi063.stdout:1/743: read d0/dd/d1f/d75/feb [1525527,26942] 0 2023-12-07T16:21:48.667 INFO:tasks.workunit.client.0.smithi063.stdout:0/884: mkdir d4/dd/d26/d2b/db5/d130 0 2023-12-07T16:21:48.669 INFO:tasks.workunit.client.0.smithi063.stdout:7/843: dread d2/d34/d5a/d5f/d6d/f72 [0,4194304] 0 2023-12-07T16:21:48.669 INFO:tasks.workunit.client.0.smithi063.stdout:7/844: readlink d2/d34/d5a/d5f/d78/d7c/lca 0 2023-12-07T16:21:48.670 INFO:tasks.workunit.client.0.smithi063.stdout:7/845: read d2/d2c/f68 [7793247,26668] 0 2023-12-07T16:21:48.670 INFO:tasks.workunit.client.0.smithi063.stdout:7/846: write d2/d34/d46/d48/d70/daf/dd6/fea [372448,107054] 0 2023-12-07T16:21:48.670 INFO:tasks.workunit.client.0.smithi063.stdout:7/847: write d2/d34/d46/d48/f4f [4154277,326] 0 2023-12-07T16:21:48.670 INFO:tasks.workunit.client.0.smithi063.stdout:7/848: fdatasync d2/d34/d5a/d5f/d53/f91 0 2023-12-07T16:21:48.670 INFO:tasks.workunit.client.0.smithi063.stdout:0/885: rename d4/dd/d26/d2b/db5/d5b/d63/d74/df4/d12e/ff3 to d4/dd/d26/d2b/db5/d5b/d63/d6b/dbe/f131 0 2023-12-07T16:21:48.672 INFO:tasks.workunit.client.0.smithi063.stdout:7/849: rmdir d2/d21/dc6 39 2023-12-07T16:21:48.675 INFO:tasks.workunit.client.0.smithi063.stdout:7/850: rename d2/d34/d5a/d5f/d2a/d7e/lf7 to d2/d21/l132 0 2023-12-07T16:21:48.676 INFO:tasks.workunit.client.0.smithi063.stdout:3/820: dwrite d7/d8d/fda [0,4194304] 0 2023-12-07T16:21:48.680 INFO:tasks.workunit.client.0.smithi063.stdout:1/744: rmdir d0/dd/d19/d50/d72/de9 39 2023-12-07T16:21:48.680 INFO:tasks.workunit.client.0.smithi063.stdout:1/745: write d0/dd/d10/d6f/da0/fbc [932560,130407] 0 2023-12-07T16:21:48.680 INFO:tasks.workunit.client.0.smithi063.stdout:1/746: dread - d0/dd/d10/d6f/faf zero size 2023-12-07T16:21:48.684 INFO:tasks.workunit.client.0.smithi063.stdout:7/851: dread d2/d34/d5a/f66 [0,4194304] 0 2023-12-07T16:21:48.693 INFO:tasks.workunit.client.0.smithi063.stdout:0/886: dwrite d4/dd/d26/d2b/d5e/f101 [0,4194304] 0 2023-12-07T16:21:48.694 INFO:tasks.workunit.client.0.smithi063.stdout:0/887: fsync d4/d25/f71 0 2023-12-07T16:21:48.694 INFO:tasks.workunit.client.0.smithi063.stdout:0/888: truncate d4/f10f 867625 0 2023-12-07T16:21:48.694 INFO:tasks.workunit.client.0.smithi063.stdout:0/889: write d4/dd/f14 [542111,110628] 0 2023-12-07T16:21:48.700 INFO:tasks.workunit.client.0.smithi063.stdout:1/747: link d0/cf2 d0/dd/d10/d1b/c10b 0 2023-12-07T16:21:48.709 INFO:tasks.workunit.client.0.smithi063.stdout:0/890: read d4/dd/d26/d2b/db5/d5b/fce [6244,73482] 0 2023-12-07T16:21:48.709 INFO:tasks.workunit.client.0.smithi063.stdout:1/748: creat d0/dd/d1f/f10c x:0 0 0 2023-12-07T16:21:48.709 INFO:tasks.workunit.client.0.smithi063.stdout:7/852: dwrite d2/d34/d5a/d5f/f27 [4194304,4194304] 0 2023-12-07T16:21:48.710 INFO:tasks.workunit.client.0.smithi063.stdout:0/891: mkdir d4/dd/d26/d2b/db5/d5b/d63/d132 0 2023-12-07T16:21:48.710 INFO:tasks.workunit.client.0.smithi063.stdout:0/892: fsync d4/dd/d26/d2b/db5/d5b/d63/f80 0 2023-12-07T16:21:48.710 INFO:tasks.workunit.client.0.smithi063.stdout:0/893: write d4/f8a [926838,59723] 0 2023-12-07T16:21:48.711 INFO:tasks.workunit.client.0.smithi063.stdout:1/749: mknod d0/dd/d10/d46/c10d 0 2023-12-07T16:21:48.711 INFO:tasks.workunit.client.0.smithi063.stdout:1/750: write d0/dd/d4f/ff4 [69237,37041] 0 2023-12-07T16:21:48.715 INFO:tasks.workunit.client.0.smithi063.stdout:1/751: rename d0/dd/d19/d50/d72/ca8 to d0/dd/d19/d50/c10e 0 2023-12-07T16:21:48.717 INFO:tasks.workunit.client.0.smithi063.stdout:0/894: rmdir d4/dd/d26/d2b 39 2023-12-07T16:21:48.719 INFO:tasks.workunit.client.0.smithi063.stdout:7/853: dread d2/d2c/f75 [0,4194304] 0 2023-12-07T16:21:48.719 INFO:tasks.workunit.client.0.smithi063.stdout:7/854: getdents d2/d34/d46/d48/d56 0 2023-12-07T16:21:48.721 INFO:tasks.workunit.client.0.smithi063.stdout:7/855: unlink d2/d34/d5a/d5f/d53/ded/c115 0 2023-12-07T16:21:48.723 INFO:tasks.workunit.client.0.smithi063.stdout:7/856: creat d2/d34/d46/d48/d56/d113/f133 x:0 0 0 2023-12-07T16:21:48.724 INFO:tasks.workunit.client.0.smithi063.stdout:7/857: truncate d2/d21/f2d 1439869 0 2023-12-07T16:21:48.724 INFO:tasks.workunit.client.0.smithi063.stdout:7/858: chown d2/d34/d5a/d5f/d2a/d7e/fdd 11 1 2023-12-07T16:21:48.726 INFO:tasks.workunit.client.0.smithi063.stdout:7/859: symlink d2/d34/d5a/d5f/d78/d9a/l134 0 2023-12-07T16:21:48.727 INFO:tasks.workunit.client.0.smithi063.stdout:7/860: write d2/fa [2854318,91627] 0 2023-12-07T16:21:48.729 INFO:tasks.workunit.client.0.smithi063.stdout:7/861: truncate d2/d34/d5a/d5f/d2a/f2f 3688306 0 2023-12-07T16:21:48.730 INFO:tasks.workunit.client.0.smithi063.stdout:7/862: rmdir d2/d34/d5a/d5f/d6d 39 2023-12-07T16:21:48.749 INFO:tasks.workunit.client.0.smithi063.stdout:7/863: dwrite d2/d34/d5a/d5f/d78/f111 [0,4194304] 0 2023-12-07T16:21:48.750 INFO:tasks.workunit.client.0.smithi063.stdout:5/819: sync 2023-12-07T16:21:48.752 INFO:tasks.workunit.client.0.smithi063.stdout:5/820: dread d1/d3/de/f1f [0,4194304] 0 2023-12-07T16:21:48.753 INFO:tasks.workunit.client.0.smithi063.stdout:7/864: rename d2/d34/d5a/d5f/d61/ce6 to d2/d34/d46/d48/d70/c135 0 2023-12-07T16:21:48.753 INFO:tasks.workunit.client.0.smithi063.stdout:7/865: dread - d2/d34/f12d zero size 2023-12-07T16:21:48.753 INFO:tasks.workunit.client.0.smithi063.stdout:7/866: getdents d2/d34/d5a/d5f/d78/d7c/d9b/d11d 0 2023-12-07T16:21:48.753 INFO:tasks.workunit.client.0.smithi063.stdout:7/867: fsync d2/d34/d46/d48/d70/daf/fe0 0 2023-12-07T16:21:48.753 INFO:tasks.workunit.client.0.smithi063.stdout:7/868: chown d2/d34/d5a/d5f/d53/dab/c105 1550513 1 2023-12-07T16:21:48.754 INFO:tasks.workunit.client.0.smithi063.stdout:5/821: creat d1/d3/de6/df0/ff5 x:0 0 0 2023-12-07T16:21:48.768 INFO:tasks.workunit.client.0.smithi063.stdout:7/869: dwrite d2/d21/dc6/f10a [0,4194304] 0 2023-12-07T16:21:48.771 INFO:tasks.workunit.client.0.smithi063.stdout:7/870: creat d2/d2c/dbe/d124/f136 x:0 0 0 2023-12-07T16:21:48.771 INFO:tasks.workunit.client.0.smithi063.stdout:7/871: dread - d2/d34/d46/d48/d56/f7d zero size 2023-12-07T16:21:50.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:49 smithi152 ceph-mon[121113]: pgmap v32: 65 pgs: 65 active+clean; 3.8 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 250 MiB/s rd, 513 MiB/s wr, 753 op/s 2023-12-07T16:21:50.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:49 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:50.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:49 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:50.340 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:49 smithi063 ceph-mon[112095]: pgmap v32: 65 pgs: 65 active+clean; 3.8 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 250 MiB/s rd, 513 MiB/s wr, 753 op/s 2023-12-07T16:21:50.340 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:49 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:50.340 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:49 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:52.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:51 smithi152 ceph-mon[121113]: pgmap v33: 65 pgs: 65 active+clean; 3.8 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 172 MiB/s rd, 344 MiB/s wr, 513 op/s 2023-12-07T16:21:52.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:51 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:21:52.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:51 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:52.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:51 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:52.257 INFO:tasks.workunit.client.0.smithi063.stdout:6/850: sync 2023-12-07T16:21:52.257 INFO:tasks.workunit.client.0.smithi063.stdout:4/681: sync 2023-12-07T16:21:52.257 INFO:tasks.workunit.client.0.smithi063.stdout:9/863: sync 2023-12-07T16:21:52.257 INFO:tasks.workunit.client.0.smithi063.stdout:9/864: chown d0/d8d/fc7 947 1 2023-12-07T16:21:52.257 INFO:tasks.workunit.client.0.smithi063.stdout:2/905: sync 2023-12-07T16:21:52.257 INFO:tasks.workunit.client.0.smithi063.stdout:3/821: sync 2023-12-07T16:21:52.258 INFO:tasks.workunit.client.0.smithi063.stdout:0/895: sync 2023-12-07T16:21:52.260 INFO:tasks.workunit.client.0.smithi063.stdout:1/752: sync 2023-12-07T16:21:52.260 INFO:tasks.workunit.client.0.smithi063.stdout:1/753: readlink d0/dd/d19/d50/d71/l88 0 2023-12-07T16:21:52.260 INFO:tasks.workunit.client.0.smithi063.stdout:5/822: sync 2023-12-07T16:21:52.260 INFO:tasks.workunit.client.0.smithi063.stdout:5/823: chown d1/d31/db8 151239019 1 2023-12-07T16:21:52.260 INFO:tasks.workunit.client.0.smithi063.stdout:7/872: sync 2023-12-07T16:21:52.260 INFO:tasks.workunit.client.0.smithi063.stdout:7/873: write d2/d34/f55 [930206,88098] 0 2023-12-07T16:21:52.260 INFO:tasks.workunit.client.0.smithi063.stdout:7/874: fdatasync d2/d34/d5a/d5f/d2a/d7e/d119/f11c 0 2023-12-07T16:21:52.260 INFO:tasks.workunit.client.0.smithi063.stdout:4/682: link d1/d3/d3f/f9a d1/d3/db/d73/fce 0 2023-12-07T16:21:52.260 INFO:tasks.workunit.client.0.smithi063.stdout:4/683: chown d1/d3/d3f/d44/c55 1 1 2023-12-07T16:21:52.261 INFO:tasks.workunit.client.0.smithi063.stdout:1/754: getdents d0/dd/d10/d13/d2f 0 2023-12-07T16:21:52.261 INFO:tasks.workunit.client.0.smithi063.stdout:0/896: write d4/dd/de/d15/d1f/d22/fb0 [3242169,73864] 0 2023-12-07T16:21:52.261 INFO:tasks.workunit.client.0.smithi063.stdout:7/875: rmdir d2/d34/d5a/d5f/d2a/db8 39 2023-12-07T16:21:52.264 INFO:tasks.workunit.client.0.smithi063.stdout:1/755: mkdir d0/dd/d10/d6f/dd8/d10f 0 2023-12-07T16:21:52.264 INFO:tasks.workunit.client.0.smithi063.stdout:1/756: truncate d0/dd/d19/d50/d71/d9b/fb6 571742 0 2023-12-07T16:21:52.265 INFO:tasks.workunit.client.0.smithi063.stdout:7/876: link d2/d34/d5a/d5f/lae d2/d34/d46/d48/d56/d113/l137 0 2023-12-07T16:21:52.266 INFO:tasks.workunit.client.0.smithi063.stdout:3/822: dread d7/fcd [0,4194304] 0 2023-12-07T16:21:52.271 INFO:tasks.workunit.client.0.smithi063.stdout:6/851: dread d0/d17/d46/f50 [0,4194304] 0 2023-12-07T16:21:52.271 INFO:tasks.workunit.client.0.smithi063.stdout:6/852: write d0/f1b [1896883,48509] 0 2023-12-07T16:21:52.296 INFO:tasks.workunit.client.0.smithi063.stdout:6/853: dread d0/d79/fff [0,4194304] 0 2023-12-07T16:21:52.298 INFO:tasks.workunit.client.0.smithi063.stdout:6/854: dread d0/d1e/f63 [0,4194304] 0 2023-12-07T16:21:52.298 INFO:tasks.workunit.client.0.smithi063.stdout:6/855: fdatasync d0/d1e/d20/d4a/fce 0 2023-12-07T16:21:52.298 INFO:tasks.workunit.client.0.smithi063.stdout:6/856: dread - d0/d1e/d29/f114 zero size 2023-12-07T16:21:52.302 INFO:tasks.workunit.client.0.smithi063.stdout:6/857: creat d0/d1e/d20/d4a/f131 x:0 0 0 2023-12-07T16:21:52.302 INFO:tasks.workunit.client.0.smithi063.stdout:6/858: fsync d0/d79/db9/fbe 0 2023-12-07T16:21:52.302 INFO:tasks.workunit.client.0.smithi063.stdout:6/859: fsync d0/d1e/d60/d68/d76/dae/fba 0 2023-12-07T16:21:52.305 INFO:tasks.workunit.client.0.smithi063.stdout:6/860: unlink d0/d1e/d20/d4a/fce 0 2023-12-07T16:21:52.305 INFO:tasks.workunit.client.0.smithi063.stdout:5/824: dwrite d1/d3/de/d1e/f24 [0,4194304] 0 2023-12-07T16:21:52.305 INFO:tasks.workunit.client.0.smithi063.stdout:5/825: write d1/d3/d3a/fe8 [423573,23772] 0 2023-12-07T16:21:52.305 INFO:tasks.workunit.client.0.smithi063.stdout:3/823: dwrite d7/d49/fe5 [0,4194304] 0 2023-12-07T16:21:52.306 INFO:tasks.workunit.client.0.smithi063.stdout:0/897: dwrite d4/dd/d26/d2b/d5e/d8e/f9c [0,4194304] 0 2023-12-07T16:21:52.306 INFO:tasks.workunit.client.0.smithi063.stdout:0/898: getdents d4/dd/de/d15/d1f/d4c/da1/dea 0 2023-12-07T16:21:52.307 INFO:tasks.workunit.client.0.smithi063.stdout:6/861: creat d0/d1e/d60/d68/d76/da4/dc6/f132 x:0 0 0 2023-12-07T16:21:52.309 INFO:tasks.workunit.client.0.smithi063.stdout:3/824: mkdir d7/d49/d10b 0 2023-12-07T16:21:52.313 INFO:tasks.workunit.client.0.smithi063.stdout:6/862: link d0/d1e/d60/d68/d76/dae/c106 d0/d17/d46/d93/c133 0 2023-12-07T16:21:52.313 INFO:tasks.workunit.client.0.smithi063.stdout:6/863: truncate d0/d1e/d20/d4a/f7a 401068 0 2023-12-07T16:21:52.313 INFO:tasks.workunit.client.0.smithi063.stdout:6/864: stat d0/d1e/d60/d68/d78/d112/d12e 0 2023-12-07T16:21:52.314 INFO:tasks.workunit.client.0.smithi063.stdout:3/825: mknod d7/d9/d103/c10c 0 2023-12-07T16:21:52.316 INFO:tasks.workunit.client.0.smithi063.stdout:0/899: symlink d4/dd/d26/d2b/d5e/d8e/l133 0 2023-12-07T16:21:52.328 INFO:tasks.workunit.client.0.smithi063.stdout:3/826: rmdir d7/d49/dd9 39 2023-12-07T16:21:52.328 INFO:tasks.workunit.client.0.smithi063.stdout:9/865: mknod d0/d13/d39/d3a/c121 0 2023-12-07T16:21:52.328 INFO:tasks.workunit.client.0.smithi063.stdout:0/900: creat d4/dd/d26/d2b/db5/d5b/d63/d132/f134 x:0 0 0 2023-12-07T16:21:52.328 INFO:tasks.workunit.client.0.smithi063.stdout:6/865: symlink d0/d1e/d60/d68/d78/d9c/l134 0 2023-12-07T16:21:52.331 INFO:tasks.workunit.client.0.smithi063.stdout:5/826: dwrite d1/d31/db8/dee/d8f/fd8 [0,4194304] 0 2023-12-07T16:21:52.332 INFO:tasks.workunit.client.0.smithi063.stdout:3/827: creat d7/d9/d1b/db8/f10d x:0 0 0 2023-12-07T16:21:52.332 INFO:tasks.workunit.client.0.smithi063.stdout:9/866: creat d0/d13/d6f/daf/dbc/ddc/f122 x:0 0 0 2023-12-07T16:21:52.332 INFO:tasks.workunit.client.0.smithi063.stdout:9/867: chown d0/d21/d64/d6a/d85/da4/f6d 2653 1 2023-12-07T16:21:52.332 INFO:tasks.workunit.client.0.smithi063.stdout:9/868: fsync d0/d21/d64/d6a/d8f/d92/dbb/ff7 0 2023-12-07T16:21:52.333 INFO:tasks.workunit.client.0.smithi063.stdout:9/869: dread - d0/d21/d64/ffe zero size 2023-12-07T16:21:52.333 INFO:tasks.workunit.client.0.smithi063.stdout:0/901: mknod d4/dd/d26/d2b/db5/d5b/d63/c135 0 2023-12-07T16:21:52.333 INFO:tasks.workunit.client.0.smithi063.stdout:0/902: write d4/dd/d26/d2b/d5e/f65 [4303576,49019] 0 2023-12-07T16:21:52.333 INFO:tasks.workunit.client.0.smithi063.stdout:0/903: read d4/dd/d26/d2b/db5/d5b/fce [5403,58179] 0 2023-12-07T16:21:52.333 INFO:tasks.workunit.client.0.smithi063.stdout:5/827: getdents d1/d3 0 2023-12-07T16:21:52.337 INFO:tasks.workunit.client.0.smithi063.stdout:6/866: write d0/d17/d46/f109 [4053913,73814] 0 2023-12-07T16:21:52.337 INFO:tasks.workunit.client.0.smithi063.stdout:6/867: chown d0/d1e/d1d/d1f/laf 1804943 1 2023-12-07T16:21:52.351 INFO:tasks.workunit.client.0.smithi063.stdout:5/828: dread d1/d3/de/d1e/d6b/dd0/fe0 [0,4194304] 0 2023-12-07T16:21:52.356 INFO:tasks.workunit.client.0.smithi063.stdout:0/904: dwrite d4/dd/d26/d2b/db5/d5b/d63/d6b/f104 [0,4194304] 0 2023-12-07T16:21:52.356 INFO:tasks.workunit.client.0.smithi063.stdout:0/905: dread - d4/dd/de/d15/d1f/d22/f127 zero size 2023-12-07T16:21:52.357 INFO:tasks.workunit.client.0.smithi063.stdout:0/906: truncate d4/dd/d26/d2b/db5/d5b/d63/d6b/dc0/f117 997643 0 2023-12-07T16:21:52.357 INFO:tasks.workunit.client.0.smithi063.stdout:0/907: truncate d4/dd/d26/d2b/db5/f87 1228787 0 2023-12-07T16:21:52.360 INFO:tasks.workunit.client.0.smithi063.stdout:0/908: mkdir d4/dd/de/d15/d1f/d4c/da1/dd4/d136 0 2023-12-07T16:21:52.360 INFO:tasks.workunit.client.0.smithi063.stdout:0/909: fdatasync d4/dd/f6a 0 2023-12-07T16:21:52.366 INFO:tasks.workunit.client.0.smithi063.stdout:0/910: creat d4/dd/d26/d2b/d5e/d8e/d95/f137 x:0 0 0 2023-12-07T16:21:52.366 INFO:tasks.workunit.client.0.smithi063.stdout:6/868: mknod d0/d1e/d1d/c135 0 2023-12-07T16:21:52.366 INFO:tasks.workunit.client.0.smithi063.stdout:9/870: creat d0/d13/d39/f123 x:0 0 0 2023-12-07T16:21:52.367 INFO:tasks.workunit.client.0.smithi063.stdout:6/869: creat d0/d1e/d60/f136 x:0 0 0 2023-12-07T16:21:52.369 INFO:tasks.workunit.client.0.smithi063.stdout:0/911: mkdir d4/dd/d26/d2b/db5/d5b/d63/d6b/dbe/d138 0 2023-12-07T16:21:52.370 INFO:tasks.workunit.client.0.smithi063.stdout:9/871: creat d0/d21/d64/d6a/f124 x:0 0 0 2023-12-07T16:21:52.370 INFO:tasks.workunit.client.0.smithi063.stdout:9/872: dread - d0/d8d/fa0 zero size 2023-12-07T16:21:52.374 INFO:tasks.workunit.client.0.smithi063.stdout:9/873: link d0/d21/d64/d6a/d8f/fa2 d0/d13/d6f/daf/dbc/f125 0 2023-12-07T16:21:52.377 INFO:tasks.workunit.client.0.smithi063.stdout:0/912: dread d4/f10f [0,4194304] 0 2023-12-07T16:21:52.381 INFO:tasks.workunit.client.0.smithi063.stdout:0/913: dread d4/dd/d26/d2b/db5/f87 [0,4194304] 0 2023-12-07T16:21:52.384 INFO:tasks.workunit.client.0.smithi063.stdout:0/914: mkdir d4/dd/de/d15/d59/d43/d91/d139 0 2023-12-07T16:21:52.386 INFO:tasks.workunit.client.0.smithi063.stdout:0/915: mknod d4/dd/d26/d2b/d5e/d69/c13a 0 2023-12-07T16:21:52.386 INFO:tasks.workunit.client.0.smithi063.stdout:0/916: fdatasync d4/dd/f14 0 2023-12-07T16:21:52.391 INFO:tasks.workunit.client.0.smithi063.stdout:9/874: unlink d0/l93 0 2023-12-07T16:21:52.393 INFO:tasks.workunit.client.0.smithi063.stdout:9/875: mknod d0/d21/d64/d6a/d85/dfd/c126 0 2023-12-07T16:21:52.394 INFO:tasks.workunit.client.0.smithi063.stdout:2/906: rename d0/d21/d56/d11/d52/da9/daf/fe9 to d0/d21/d39/f128 0 2023-12-07T16:21:52.394 INFO:tasks.workunit.client.0.smithi063.stdout:2/907: dread - d0/d21/d56/d11/fb4 zero size 2023-12-07T16:21:52.394 INFO:tasks.workunit.client.0.smithi063.stdout:2/908: read - d0/d67/d5b/f98 zero size 2023-12-07T16:21:52.394 INFO:tasks.workunit.client.0.smithi063.stdout:2/909: write d0/d21/d56/d11/d52/da9/daf/f127 [951464,61608] 0 2023-12-07T16:21:52.394 INFO:tasks.workunit.client.0.smithi063.stdout:9/876: creat d0/d21/d64/d6a/d85/dfd/f127 x:0 0 0 2023-12-07T16:21:52.396 INFO:tasks.workunit.client.0.smithi063.stdout:4/684: rename d1/d3/db/d2c/d63/d62/l82 to d1/d3/d51/lcf 0 2023-12-07T16:21:52.396 INFO:tasks.workunit.client.0.smithi063.stdout:4/685: write d1/f81 [509041,14540] 0 2023-12-07T16:21:52.397 INFO:tasks.workunit.client.0.smithi063.stdout:9/877: unlink d0/l11 0 2023-12-07T16:21:52.398 INFO:tasks.workunit.client.0.smithi063.stdout:1/757: rename d0/dd/d10/d13/le5 to d0/d47/l110 0 2023-12-07T16:21:52.399 INFO:tasks.workunit.client.0.smithi063.stdout:1/758: readlink d0/dd/d10/d1b/d68/l106 0 2023-12-07T16:21:52.400 INFO:tasks.workunit.client.0.smithi063.stdout:7/877: rename d2/d34/d5a/d5f/d61/l67 to d2/d34/d5a/d5f/d78/l138 0 2023-12-07T16:21:52.400 INFO:tasks.workunit.client.0.smithi063.stdout:7/878: truncate d2/d34/d46/d48/f4c 683559 0 2023-12-07T16:21:52.401 INFO:tasks.workunit.client.0.smithi063.stdout:7/879: chown d2/d34/d5a/c100 149 1 2023-12-07T16:21:52.401 INFO:tasks.workunit.client.0.smithi063.stdout:1/759: symlink d0/dd/d19/d50/l111 0 2023-12-07T16:21:52.401 INFO:tasks.workunit.client.0.smithi063.stdout:1/760: write d0/f1 [5661846,80758] 0 2023-12-07T16:21:52.402 INFO:tasks.workunit.client.0.smithi063.stdout:4/686: dread d1/f98 [0,4194304] 0 2023-12-07T16:21:52.402 INFO:tasks.workunit.client.0.smithi063.stdout:4/687: dread - d1/d3/db/d16/f7f zero size 2023-12-07T16:21:52.404 INFO:tasks.workunit.client.0.smithi063.stdout:3/828: rename d7/d49/fb4 to d7/d9/d1b/d5c/f10e 0 2023-12-07T16:21:52.404 INFO:tasks.workunit.client.0.smithi063.stdout:3/829: write d7/d9/d1b/d5c/f101 [801064,123099] 0 2023-12-07T16:21:52.404 INFO:tasks.workunit.client.0.smithi063.stdout:2/910: dread d0/d21/d56/d11/d52/da9/daf/fbc [0,4194304] 0 2023-12-07T16:21:52.404 INFO:tasks.workunit.client.0.smithi063.stdout:7/880: mkdir d2/d34/d5a/d5f/d53/d9f/d139 0 2023-12-07T16:21:52.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:51 smithi063 ceph-mon[112095]: pgmap v33: 65 pgs: 65 active+clean; 3.8 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 172 MiB/s rd, 344 MiB/s wr, 513 op/s 2023-12-07T16:21:52.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:51 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:21:52.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:51 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:52.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:51 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:52.406 INFO:tasks.workunit.client.0.smithi063.stdout:1/761: creat d0/dd/d10/d1b/f112 x:0 0 0 2023-12-07T16:21:52.406 INFO:tasks.workunit.client.0.smithi063.stdout:1/762: chown d0/dd/d10/d6f/da0/fe6 235164616 1 2023-12-07T16:21:52.407 INFO:tasks.workunit.client.0.smithi063.stdout:0/917: symlink d4/dd/d26/d2b/l13b 0 2023-12-07T16:21:52.407 INFO:tasks.workunit.client.0.smithi063.stdout:5/829: rmdir d1 39 2023-12-07T16:21:52.413 INFO:tasks.workunit.client.0.smithi063.stdout:9/878: rename d0/d21/d64/d6a/d8f/d92/dbb/l105 to d0/d13/d95/ded/d113/l128 0 2023-12-07T16:21:52.413 INFO:tasks.workunit.client.0.smithi063.stdout:0/918: mknod d4/dd/d26/d2b/db5/d5b/c13c 0 2023-12-07T16:21:52.413 INFO:tasks.workunit.client.0.smithi063.stdout:5/830: creat d1/d3/d3a/d5a/ff6 x:0 0 0 2023-12-07T16:21:52.416 INFO:tasks.workunit.client.0.smithi063.stdout:3/830: symlink d7/l10f 0 2023-12-07T16:21:52.416 INFO:tasks.workunit.client.0.smithi063.stdout:0/919: creat d4/dd/d26/d2b/d5e/d8e/dee/f13d x:0 0 0 2023-12-07T16:21:52.420 INFO:tasks.workunit.client.0.smithi063.stdout:4/688: write d1/d3/db/d2c/d63/f39 [2149458,28492] 0 2023-12-07T16:21:52.422 INFO:tasks.workunit.client.0.smithi063.stdout:3/831: dread d7/d8d/f81 [0,4194304] 0 2023-12-07T16:21:52.435 INFO:tasks.workunit.client.0.smithi063.stdout:2/911: dread d0/d21/d56/d11/d52/da9/dbe/f9a [0,4194304] 0 2023-12-07T16:21:52.443 INFO:tasks.workunit.client.0.smithi063.stdout:5/831: dread d1/d3/d3a/f89 [0,4194304] 0 2023-12-07T16:21:52.443 INFO:tasks.workunit.client.0.smithi063.stdout:5/832: chown d1/d3/d3a/fa4 2205 1 2023-12-07T16:21:52.444 INFO:tasks.workunit.client.0.smithi063.stdout:2/912: write d0/d21/d56/d11/d52/da9/dbe/f9a [5429665,43858] 0 2023-12-07T16:21:52.444 INFO:tasks.workunit.client.0.smithi063.stdout:9/879: dwrite d0/d13/d39/d3a/d78/f7f [0,4194304] 0 2023-12-07T16:21:52.444 INFO:tasks.workunit.client.0.smithi063.stdout:9/880: write d0/d13/d39/f123 [1005700,127265] 0 2023-12-07T16:21:52.445 INFO:tasks.workunit.client.0.smithi063.stdout:9/881: chown d0/d13/d95/ded/d57/c89 117927933 1 2023-12-07T16:21:52.446 INFO:tasks.workunit.client.0.smithi063.stdout:5/833: unlink d1/d3/de/d1e/faa 0 2023-12-07T16:21:52.447 INFO:tasks.workunit.client.0.smithi063.stdout:2/913: rmdir d0/d21/d56/d11/d52/da9/daf 39 2023-12-07T16:21:52.449 INFO:tasks.workunit.client.0.smithi063.stdout:3/832: dread d7/d4f/f64 [0,4194304] 0 2023-12-07T16:21:52.452 INFO:tasks.workunit.client.0.smithi063.stdout:5/834: link d1/d3/fd2 d1/d3/de/d1e/d6b/dd0/ff7 0 2023-12-07T16:21:52.453 INFO:tasks.workunit.client.0.smithi063.stdout:3/833: getdents d7/d9/dd/d56 0 2023-12-07T16:21:52.454 INFO:tasks.workunit.client.0.smithi063.stdout:5/835: creat d1/d31/dc8/ff8 x:0 0 0 2023-12-07T16:21:52.455 INFO:tasks.workunit.client.0.smithi063.stdout:7/881: dwrite d2/f1a [4194304,4194304] 0 2023-12-07T16:21:52.455 INFO:tasks.workunit.client.0.smithi063.stdout:7/882: stat d2/d2c/dbe 0 2023-12-07T16:21:52.456 INFO:tasks.workunit.client.0.smithi063.stdout:9/882: dread d0/d21/d64/d6a/d85/da4/ff [4194304,4194304] 0 2023-12-07T16:21:52.456 INFO:tasks.workunit.client.0.smithi063.stdout:9/883: stat d0/f86 0 2023-12-07T16:21:52.456 INFO:tasks.workunit.client.0.smithi063.stdout:9/884: stat d0/d21/d64/d6a/d8f/ld0 0 2023-12-07T16:21:52.457 INFO:tasks.workunit.client.0.smithi063.stdout:3/834: rmdir d7/d9/dd/d7f 39 2023-12-07T16:21:52.457 INFO:tasks.workunit.client.0.smithi063.stdout:3/835: readlink d7/d9/d1b/ld1 0 2023-12-07T16:21:52.457 INFO:tasks.workunit.client.0.smithi063.stdout:4/689: dwrite d1/d3/db/d41/f6a [0,4194304] 0 2023-12-07T16:21:52.457 INFO:tasks.workunit.client.0.smithi063.stdout:4/690: dread - d1/d3/db/d16/d66/f76 zero size 2023-12-07T16:21:52.457 INFO:tasks.workunit.client.0.smithi063.stdout:9/885: write d0/d13/d95/ded/d57/f76 [652049,101330] 0 2023-12-07T16:21:52.457 INFO:tasks.workunit.client.0.smithi063.stdout:1/763: dwrite d0/dd/d10/d1b/d68/db7/fb9 [0,4194304] 0 2023-12-07T16:21:52.460 INFO:tasks.workunit.client.0.smithi063.stdout:7/883: mkdir d2/d34/d5a/d5f/d78/d7c/d125/d13a 0 2023-12-07T16:21:52.462 INFO:tasks.workunit.client.0.smithi063.stdout:5/836: write d1/d3/d3a/d5a/f85 [2855775,129941] 0 2023-12-07T16:21:52.462 INFO:tasks.workunit.client.0.smithi063.stdout:0/920: dwrite d4/f10f [0,4194304] 0 2023-12-07T16:21:52.462 INFO:tasks.workunit.client.0.smithi063.stdout:0/921: stat d4/dd/d106 0 2023-12-07T16:21:52.463 INFO:tasks.workunit.client.0.smithi063.stdout:9/886: rename d0/d13/d39/d3a/lc6 to d0/d13/d39/d3a/d78/de8/l129 0 2023-12-07T16:21:52.468 INFO:tasks.workunit.client.0.smithi063.stdout:9/887: write d0/d13/d95/ded/f50 [992946,94796] 0 2023-12-07T16:21:52.470 INFO:tasks.workunit.client.0.smithi063.stdout:4/691: dread d1/f34 [0,4194304] 0 2023-12-07T16:21:52.473 INFO:tasks.workunit.client.0.smithi063.stdout:1/764: dread d0/dd/d10/d13/f90 [0,4194304] 0 2023-12-07T16:21:52.483 INFO:tasks.workunit.client.0.smithi063.stdout:9/888: dread d0/d13/d39/f123 [0,4194304] 0 2023-12-07T16:21:52.484 INFO:tasks.workunit.client.0.smithi063.stdout:5/837: getdents d1/d3/d3a 0 2023-12-07T16:21:52.484 INFO:tasks.workunit.client.0.smithi063.stdout:4/692: rmdir d1/d3/db/d73 39 2023-12-07T16:21:52.484 INFO:tasks.workunit.client.0.smithi063.stdout:5/838: write d1/d31/dc8/fc7 [365146,8999] 0 2023-12-07T16:21:52.484 INFO:tasks.workunit.client.0.smithi063.stdout:5/839: chown d1/d3/de/d1e/d6b/fdb 198 1 2023-12-07T16:21:52.484 INFO:tasks.workunit.client.0.smithi063.stdout:5/840: truncate d1/d3/fd2 117905 0 2023-12-07T16:21:52.484 INFO:tasks.workunit.client.0.smithi063.stdout:5/841: fdatasync d1/d31/db8/dee/d8f/fd8 0 2023-12-07T16:21:52.487 INFO:tasks.workunit.client.0.smithi063.stdout:4/693: write d1/d3/db/d2c/d63/f48 [375317,128022] 0 2023-12-07T16:21:52.493 INFO:tasks.workunit.client.0.smithi063.stdout:0/922: dwrite d4/dd/de/f13 [4194304,4194304] 0 2023-12-07T16:21:52.494 INFO:tasks.workunit.client.0.smithi063.stdout:3/836: dwrite d7/d4f/d53/d72/d7d/f85 [0,4194304] 0 2023-12-07T16:21:52.498 INFO:tasks.workunit.client.0.smithi063.stdout:7/884: dwrite d2/d34/d46/d48/f62 [0,4194304] 0 2023-12-07T16:21:52.499 INFO:tasks.workunit.client.0.smithi063.stdout:1/765: dwrite d0/dd/d10/d1b/fca [4194304,4194304] 0 2023-12-07T16:21:52.500 INFO:tasks.workunit.client.0.smithi063.stdout:1/766: fsync d0/dd/d19/fd7 0 2023-12-07T16:21:52.500 INFO:tasks.workunit.client.0.smithi063.stdout:1/767: truncate d0/dd/d10/d1b/f112 479173 0 2023-12-07T16:21:52.506 INFO:tasks.workunit.client.0.smithi063.stdout:5/842: mknod d1/d31/db8/dee/d8f/ddf/cf9 0 2023-12-07T16:21:52.506 INFO:tasks.workunit.client.0.smithi063.stdout:9/889: rmdir d0/d21/d64/d6a/d8f/ddd 39 2023-12-07T16:21:52.506 INFO:tasks.workunit.client.0.smithi063.stdout:4/694: truncate d1/d3/db/d2c/fc4 1683276 0 2023-12-07T16:21:52.507 INFO:tasks.workunit.client.0.smithi063.stdout:3/837: link d7/d9/dd/f90 d7/f110 0 2023-12-07T16:21:52.508 INFO:tasks.workunit.client.0.smithi063.stdout:7/885: creat d2/d34/d5a/d5f/d53/d9f/d139/f13b x:0 0 0 2023-12-07T16:21:52.509 INFO:tasks.workunit.client.0.smithi063.stdout:4/695: dread d1/d3/db/d16/d66/fac [0,4194304] 0 2023-12-07T16:21:52.509 INFO:tasks.workunit.client.0.smithi063.stdout:1/768: truncate d0/dd/d1f/f4e 3051282 0 2023-12-07T16:21:52.511 INFO:tasks.workunit.client.0.smithi063.stdout:5/843: symlink d1/d3/lfa 0 2023-12-07T16:21:52.513 INFO:tasks.workunit.client.0.smithi063.stdout:4/696: dread d1/d3/db/d2c/d63/d62/f67 [0,4194304] 0 2023-12-07T16:21:52.513 INFO:tasks.workunit.client.0.smithi063.stdout:3/838: link d7/d4f/d53/d72/db1/f62 d7/d21/f111 0 2023-12-07T16:21:52.514 INFO:tasks.workunit.client.0.smithi063.stdout:7/886: write d2/d34/d5a/d5f/d78/d7c/f94 [537092,42257] 0 2023-12-07T16:21:52.514 INFO:tasks.workunit.client.0.smithi063.stdout:7/887: chown d2/d34/d5a/d5f/d78/d7c/d9b/cf2 19 1 2023-12-07T16:21:52.514 INFO:tasks.workunit.client.0.smithi063.stdout:7/888: chown d2/d34/d5a/d5f/d78/d9a/ce9 0 1 2023-12-07T16:21:52.514 INFO:tasks.workunit.client.0.smithi063.stdout:7/889: readlink d2/d34/d5a/d5f/d2a/dc9/le7 0 2023-12-07T16:21:52.514 INFO:tasks.workunit.client.0.smithi063.stdout:7/890: dread - d2/d37/da0/ff4 zero size 2023-12-07T16:21:52.516 INFO:tasks.workunit.client.0.smithi063.stdout:1/769: truncate d0/dd/d19/d50/d71/f2c 2052591 0 2023-12-07T16:21:52.516 INFO:tasks.workunit.client.0.smithi063.stdout:9/890: mkdir d0/d13/d39/d3a/d12a 0 2023-12-07T16:21:52.517 INFO:tasks.workunit.client.0.smithi063.stdout:4/697: mkdir d1/d3/db/d2c/d63/d99/dd0 0 2023-12-07T16:21:52.518 INFO:tasks.workunit.client.0.smithi063.stdout:4/698: chown d1/d3/db/d2c/d63/d62 4264 1 2023-12-07T16:21:52.518 INFO:tasks.workunit.client.0.smithi063.stdout:4/699: truncate d1/d3/f4a 1226876 0 2023-12-07T16:21:52.518 INFO:tasks.workunit.client.0.smithi063.stdout:4/700: truncate d1/d3/db/d16/f7f 216141 0 2023-12-07T16:21:52.518 INFO:tasks.workunit.client.0.smithi063.stdout:0/923: dwrite d4/dd/de/f13 [0,4194304] 0 2023-12-07T16:21:52.518 INFO:tasks.workunit.client.0.smithi063.stdout:0/924: write d4/dd/d26/d2b/db5/d5b/ff2 [1410290,74188] 0 2023-12-07T16:21:52.518 INFO:tasks.workunit.client.0.smithi063.stdout:3/839: read d7/d9/dd/f1e [7991869,36116] 0 2023-12-07T16:21:52.518 INFO:tasks.workunit.client.0.smithi063.stdout:7/891: creat d2/d34/d5a/d5f/d53/d9f/d139/f13c x:0 0 0 2023-12-07T16:21:52.518 INFO:tasks.workunit.client.0.smithi063.stdout:7/892: chown d2/d96/f130 3121 1 2023-12-07T16:21:52.518 INFO:tasks.workunit.client.0.smithi063.stdout:1/770: mkdir d0/dd/d1f/d75/dfe/d113 0 2023-12-07T16:21:52.520 INFO:tasks.workunit.client.0.smithi063.stdout:4/701: truncate d1/d3/db/d2c/d63/f84 4709734 0 2023-12-07T16:21:52.520 INFO:tasks.workunit.client.0.smithi063.stdout:4/702: fsync d1/d3/d3a/f9b 0 2023-12-07T16:21:52.524 INFO:tasks.workunit.client.0.smithi063.stdout:3/840: symlink d7/d9/dd/l112 0 2023-12-07T16:21:52.525 INFO:tasks.workunit.client.0.smithi063.stdout:7/893: mknod d2/d34/d5a/d5f/d78/d7c/d9b/d11d/c13d 0 2023-12-07T16:21:52.526 INFO:tasks.workunit.client.0.smithi063.stdout:1/771: stat d0/dd/d19/d50/d72/d80/c8c 0 2023-12-07T16:21:52.529 INFO:tasks.workunit.client.0.smithi063.stdout:9/891: rmdir d0/d8d 39 2023-12-07T16:21:52.533 INFO:tasks.workunit.client.0.smithi063.stdout:3/841: symlink d7/d9/d1b/df3/d109/l113 0 2023-12-07T16:21:52.536 INFO:tasks.workunit.client.0.smithi063.stdout:5/844: dwrite d1/d31/dc8/fd9 [0,4194304] 0 2023-12-07T16:21:52.536 INFO:tasks.workunit.client.0.smithi063.stdout:1/772: creat d0/dd/d55/dc9/f114 x:0 0 0 2023-12-07T16:21:52.537 INFO:tasks.workunit.client.0.smithi063.stdout:9/892: fsync d0/f1a 0 2023-12-07T16:21:52.539 INFO:tasks.workunit.client.0.smithi063.stdout:3/842: symlink d7/d4f/d53/d72/l114 0 2023-12-07T16:21:52.543 INFO:tasks.workunit.client.0.smithi063.stdout:5/845: write d1/d3/de/d1e/d6b/f88 [3669053,22058] 0 2023-12-07T16:21:52.543 INFO:tasks.workunit.client.0.smithi063.stdout:4/703: dread d1/d3/db/d2c/d63/f18 [0,4194304] 0 2023-12-07T16:21:52.543 INFO:tasks.workunit.client.0.smithi063.stdout:1/773: mknod d0/dd/d10/d1b/c115 0 2023-12-07T16:21:52.545 INFO:tasks.workunit.client.0.smithi063.stdout:1/774: fsync d0/dd/d19/d50/d71/f86 0 2023-12-07T16:21:52.545 INFO:tasks.workunit.client.0.smithi063.stdout:1/775: chown d0/dd 483961 1 2023-12-07T16:21:52.546 INFO:tasks.workunit.client.0.smithi063.stdout:1/776: mknod d0/dd/d10/d46/c116 0 2023-12-07T16:21:52.546 INFO:tasks.workunit.client.0.smithi063.stdout:1/777: write d0/dd/d10/d1b/d68/fde [469320,119282] 0 2023-12-07T16:21:52.551 INFO:tasks.workunit.client.0.smithi063.stdout:3/843: dread d7/fcd [4194304,4194304] 0 2023-12-07T16:21:52.551 INFO:tasks.workunit.client.0.smithi063.stdout:0/925: dwrite d4/dd/d26/d2b/d5e/d8e/d95/f94 [0,4194304] 0 2023-12-07T16:21:52.552 INFO:tasks.workunit.client.0.smithi063.stdout:7/894: truncate d2/d34/d46/d48/f4c 390261 0 2023-12-07T16:21:52.552 INFO:tasks.workunit.client.0.smithi063.stdout:9/893: dread d0/d21/f71 [0,4194304] 0 2023-12-07T16:21:52.553 INFO:tasks.workunit.client.0.smithi063.stdout:1/778: write d0/dd/d19/d50/d72/fb8 [2975936,108751] 0 2023-12-07T16:21:52.553 INFO:tasks.workunit.client.0.smithi063.stdout:1/779: read - d0/f109 zero size 2023-12-07T16:21:52.553 INFO:tasks.workunit.client.0.smithi063.stdout:1/780: truncate d0/dd/d19/dbd/fc8 276725 0 2023-12-07T16:21:52.554 INFO:tasks.workunit.client.0.smithi063.stdout:0/926: dread d4/dd/de/d15/f3d [0,4194304] 0 2023-12-07T16:21:52.556 INFO:tasks.workunit.client.0.smithi063.stdout:3/844: symlink d7/d9/dd/d56/db5/l115 0 2023-12-07T16:21:52.556 INFO:tasks.workunit.client.0.smithi063.stdout:7/895: truncate d2/d34/d5a/d5f/d53/dab/fd0 882563 0 2023-12-07T16:21:52.556 INFO:tasks.workunit.client.0.smithi063.stdout:7/896: dread - d2/d21/dc6/ffc zero size 2023-12-07T16:21:52.556 INFO:tasks.workunit.client.0.smithi063.stdout:9/894: creat d0/d13/dd2/f12b x:0 0 0 2023-12-07T16:21:52.556 INFO:tasks.workunit.client.0.smithi063.stdout:9/895: fsync d0/d21/d64/d6a/d85/dfd/f10b 0 2023-12-07T16:21:52.556 INFO:tasks.workunit.client.0.smithi063.stdout:9/896: fsync d0/d8d/fa0 0 2023-12-07T16:21:52.556 INFO:tasks.workunit.client.0.smithi063.stdout:1/781: write d0/d47/fe1 [2099644,32280] 0 2023-12-07T16:21:52.559 INFO:tasks.workunit.client.0.smithi063.stdout:0/927: creat d4/dd/d26/d2b/db5/d5b/d63/d6b/dc0/f13e x:0 0 0 2023-12-07T16:21:52.561 INFO:tasks.workunit.client.0.smithi063.stdout:3/845: dread d7/d9/d1b/d5c/f10e [0,4194304] 0 2023-12-07T16:21:52.561 INFO:tasks.workunit.client.0.smithi063.stdout:3/846: readlink d7/d49/dd9/l108 0 2023-12-07T16:21:52.561 INFO:tasks.workunit.client.0.smithi063.stdout:3/847: readlink d7/d9/d1b/l95 0 2023-12-07T16:21:52.561 INFO:tasks.workunit.client.0.smithi063.stdout:7/897: mknod d2/d21/d11e/c13e 0 2023-12-07T16:21:52.562 INFO:tasks.workunit.client.0.smithi063.stdout:9/897: unlink d0/d13/d6f/fd8 0 2023-12-07T16:21:52.562 INFO:tasks.workunit.client.0.smithi063.stdout:9/898: chown d0/d8d/f116 65869093 1 2023-12-07T16:21:52.565 INFO:tasks.workunit.client.0.smithi063.stdout:3/848: creat d7/d49/d10b/f116 x:0 0 0 2023-12-07T16:21:52.566 INFO:tasks.workunit.client.0.smithi063.stdout:7/898: creat d2/d34/d5a/d5f/d2a/dc9/f13f x:0 0 0 2023-12-07T16:21:52.571 INFO:tasks.workunit.client.0.smithi063.stdout:9/899: symlink d0/d21/d64/d6a/d8f/ddd/l12c 0 2023-12-07T16:21:52.571 INFO:tasks.workunit.client.0.smithi063.stdout:9/900: fsync d0/d21/d64/d6a/d8f/d92/dbb/fcc 0 2023-12-07T16:21:52.571 INFO:tasks.workunit.client.0.smithi063.stdout:7/899: link d2/d96/fd4 d2/d34/d5a/d5f/d53/dab/db5/f140 0 2023-12-07T16:21:52.571 INFO:tasks.workunit.client.0.smithi063.stdout:5/846: dwrite d1/d3/de/d1e/d6b/dd0/f3c [4194304,4194304] 0 2023-12-07T16:21:52.571 INFO:tasks.workunit.client.0.smithi063.stdout:5/847: chown d1/d3/de/d1e/d6b/cac 7589684 1 2023-12-07T16:21:52.572 INFO:tasks.workunit.client.0.smithi063.stdout:5/848: write d1/d3/de/d1e/f24 [5441599,105551] 0 2023-12-07T16:21:52.574 INFO:tasks.workunit.client.0.smithi063.stdout:9/901: stat d0/d13/d6f/cb6 0 2023-12-07T16:21:52.574 INFO:tasks.workunit.client.0.smithi063.stdout:9/902: stat d0/d13/d39/d3a/f81 0 2023-12-07T16:21:52.574 INFO:tasks.workunit.client.0.smithi063.stdout:9/903: fsync d0/d13/d6f/faa 0 2023-12-07T16:21:52.574 INFO:tasks.workunit.client.0.smithi063.stdout:9/904: chown d0/d13/f3d 12254 1 2023-12-07T16:21:52.574 INFO:tasks.workunit.client.0.smithi063.stdout:9/905: stat d0/d13/d39/l53 0 2023-12-07T16:21:52.574 INFO:tasks.workunit.client.0.smithi063.stdout:9/906: stat d0/d21/d64/lab 0 2023-12-07T16:21:52.574 INFO:tasks.workunit.client.0.smithi063.stdout:9/907: write d0/d13/dd2/f12b [85822,120498] 0 2023-12-07T16:21:52.577 INFO:tasks.workunit.client.0.smithi063.stdout:1/782: dwrite d0/dd/d10/d13/d2f/fdb [0,4194304] 0 2023-12-07T16:21:52.581 INFO:tasks.workunit.client.0.smithi063.stdout:1/783: mknod d0/dd/d1f/d75/dfe/c117 0 2023-12-07T16:21:52.581 INFO:tasks.workunit.client.0.smithi063.stdout:1/784: write d0/dd/d1f/f10c [167616,85063] 0 2023-12-07T16:21:52.583 INFO:tasks.workunit.client.0.smithi063.stdout:1/785: getdents d0/dd/d10/d46 0 2023-12-07T16:21:52.601 INFO:tasks.workunit.client.0.smithi063.stdout:1/786: dread d0/dd/d10/d1b/f51 [0,4194304] 0 2023-12-07T16:21:52.605 INFO:tasks.workunit.client.0.smithi063.stdout:1/787: mknod d0/dd/d10/d6f/dd8/d10f/c118 0 2023-12-07T16:21:52.606 INFO:tasks.workunit.client.0.smithi063.stdout:1/788: chown d0/dd/d1f/c103 62 1 2023-12-07T16:21:52.606 INFO:tasks.workunit.client.0.smithi063.stdout:1/789: fsync d0/dd/d10/d1b/d68/f95 0 2023-12-07T16:21:52.616 INFO:tasks.workunit.client.0.smithi063.stdout:1/790: rmdir d0/dd/d10/d6f/da0 39 2023-12-07T16:21:52.632 INFO:tasks.workunit.client.0.smithi063.stdout:0/928: dwrite d4/dd/d26/d2b/db5/d5b/d63/d6b/dbe/f131 [0,4194304] 0 2023-12-07T16:21:52.632 INFO:tasks.workunit.client.0.smithi063.stdout:0/929: write d4/dd/d26/d2b/db5/d5b/d63/d9b/fe2 [416778,121173] 0 2023-12-07T16:21:52.637 INFO:tasks.workunit.client.0.smithi063.stdout:0/930: rmdir d4/dd/d26/d2b/d5e/d8e 39 2023-12-07T16:21:52.638 INFO:tasks.workunit.client.0.smithi063.stdout:0/931: rmdir d4/dd/d26 39 2023-12-07T16:21:52.638 INFO:tasks.workunit.client.0.smithi063.stdout:7/900: dwrite d2/d34/d5a/d5f/d2a/f41 [0,4194304] 0 2023-12-07T16:21:52.639 INFO:tasks.workunit.client.0.smithi063.stdout:0/932: rmdir d4/dd/d26/d2b/db5/d5b/d63/d74/d84 39 2023-12-07T16:21:52.640 INFO:tasks.workunit.client.0.smithi063.stdout:9/908: dwrite d0/d13/d95/ded/d57/f76 [0,4194304] 0 2023-12-07T16:21:52.641 INFO:tasks.workunit.client.0.smithi063.stdout:7/901: creat d2/d34/d46/d48/d70/daf/de8/d10b/f141 x:0 0 0 2023-12-07T16:21:52.642 INFO:tasks.workunit.client.0.smithi063.stdout:0/933: mkdir d4/dd/d26/d2b/d5e/d8e/d95/d68/ded/d13f 0 2023-12-07T16:21:52.642 INFO:tasks.workunit.client.0.smithi063.stdout:0/934: dread - d4/dd/de/d15/d59/d43/d10a/f116 zero size 2023-12-07T16:21:52.644 INFO:tasks.workunit.client.0.smithi063.stdout:9/909: symlink d0/d21/l12d 0 2023-12-07T16:21:52.644 INFO:tasks.workunit.client.0.smithi063.stdout:0/935: getdents d4/d7e 0 2023-12-07T16:21:52.645 INFO:tasks.workunit.client.0.smithi063.stdout:9/910: symlink d0/d13/d6f/d9b/d102/l12e 0 2023-12-07T16:21:52.647 INFO:tasks.workunit.client.0.smithi063.stdout:0/936: rename d4/dd/d26/d2b/db5/ff8 to d4/dd/f140 0 2023-12-07T16:21:52.648 INFO:tasks.workunit.client.0.smithi063.stdout:9/911: symlink d0/d13/d39/d3a/d78/d115/l12f 0 2023-12-07T16:21:52.648 INFO:tasks.workunit.client.0.smithi063.stdout:3/849: dwrite d7/d9/dd/f90 [0,4194304] 0 2023-12-07T16:21:52.648 INFO:tasks.workunit.client.0.smithi063.stdout:5/849: dwrite d1/d3/d3a/dcd/dd3/d7e/f84 [0,4194304] 0 2023-12-07T16:21:52.649 INFO:tasks.workunit.client.0.smithi063.stdout:9/912: dread d0/d21/d64/d6a/d8f/fa2 [0,4194304] 0 2023-12-07T16:21:52.649 INFO:tasks.workunit.client.0.smithi063.stdout:9/913: chown d0/d13/d6f/l87 22658363 1 2023-12-07T16:21:52.649 INFO:tasks.workunit.client.0.smithi063.stdout:0/937: symlink d4/dd/de/d15/d1f/d4c/l141 0 2023-12-07T16:21:52.660 INFO:tasks.workunit.client.0.smithi063.stdout:9/914: creat d0/d13/dd2/f130 x:0 0 0 2023-12-07T16:21:52.660 INFO:tasks.workunit.client.0.smithi063.stdout:9/915: readlink d0/d13/d39/d3a/l6b 0 2023-12-07T16:21:52.660 INFO:tasks.workunit.client.0.smithi063.stdout:3/850: symlink d7/d9/d1b/df3/l117 0 2023-12-07T16:21:52.660 INFO:tasks.workunit.client.0.smithi063.stdout:0/938: unlink d4/dd/d26/d2b/d5e/d8e/fb8 0 2023-12-07T16:21:52.660 INFO:tasks.workunit.client.0.smithi063.stdout:5/850: creat d1/d3/d3a/d5a/dc6/ffb x:0 0 0 2023-12-07T16:21:52.662 INFO:tasks.workunit.client.0.smithi063.stdout:9/916: symlink d0/d13/d39/l131 0 2023-12-07T16:21:52.663 INFO:tasks.workunit.client.0.smithi063.stdout:5/851: link d1/c4e d1/d3/de/cfc 0 2023-12-07T16:21:52.664 INFO:tasks.workunit.client.0.smithi063.stdout:9/917: mknod d0/d13/d6f/d9b/d102/c132 0 2023-12-07T16:21:52.665 INFO:tasks.workunit.client.0.smithi063.stdout:3/851: read d7/d4f/d53/d72/db1/f9f [790806,35515] 0 2023-12-07T16:21:52.665 INFO:tasks.workunit.client.0.smithi063.stdout:5/852: getdents d1/d31/d56/db7 0 2023-12-07T16:21:52.666 INFO:tasks.workunit.client.0.smithi063.stdout:9/918: creat d0/d21/d64/d6a/d8f/f133 x:0 0 0 2023-12-07T16:21:52.666 INFO:tasks.workunit.client.0.smithi063.stdout:9/919: fsync d0/d13/d39/d3a/f74 0 2023-12-07T16:21:52.667 INFO:tasks.workunit.client.0.smithi063.stdout:3/852: symlink d7/l118 0 2023-12-07T16:21:52.679 INFO:tasks.workunit.client.0.smithi063.stdout:9/920: rename d0/d21/d64/d6a/la5 to d0/d21/d64/d6a/d8f/d92/dbb/l134 0 2023-12-07T16:21:52.679 INFO:tasks.workunit.client.0.smithi063.stdout:3/853: creat d7/d9/dd/d56/f119 x:0 0 0 2023-12-07T16:21:52.679 INFO:tasks.workunit.client.0.smithi063.stdout:3/854: chown d7/d4f/d53/d72/db1/cc0 1824 1 2023-12-07T16:21:52.687 INFO:tasks.workunit.client.0.smithi063.stdout:9/921: creat d0/d13/f135 x:0 0 0 2023-12-07T16:21:52.688 INFO:tasks.workunit.client.0.smithi063.stdout:3/855: mkdir d7/d9/dd/d60/d11a 0 2023-12-07T16:21:52.688 INFO:tasks.workunit.client.0.smithi063.stdout:3/856: write d7/d4f/d53/d72/db1/f62 [135241,54470] 0 2023-12-07T16:21:52.690 INFO:tasks.workunit.client.0.smithi063.stdout:3/857: rename d7/d9/dd/d7f/fe2 to d7/d4f/d53/d72/d7d/f11b 0 2023-12-07T16:21:52.691 INFO:tasks.workunit.client.0.smithi063.stdout:9/922: dread d0/d21/fc1 [0,4194304] 0 2023-12-07T16:21:52.691 INFO:tasks.workunit.client.0.smithi063.stdout:9/923: write d0/d13/d39/d3a/d78/de8/ff9 [329609,125093] 0 2023-12-07T16:21:52.691 INFO:tasks.workunit.client.0.smithi063.stdout:9/924: chown d0/d21/d64/d6a/f75 3102 1 2023-12-07T16:21:52.692 INFO:tasks.workunit.client.0.smithi063.stdout:9/925: truncate d0/d21/d64/d6a/d8f/d92/dbb/ff2 1054790 0 2023-12-07T16:21:52.692 INFO:tasks.workunit.client.0.smithi063.stdout:0/939: dwrite d4/dd/de/d15/f21 [0,4194304] 0 2023-12-07T16:21:52.693 INFO:tasks.workunit.client.0.smithi063.stdout:7/902: dwrite d2/d34/d5a/d5f/f9e [0,4194304] 0 2023-12-07T16:21:52.693 INFO:tasks.workunit.client.0.smithi063.stdout:7/903: fsync d2/d34/f55 0 2023-12-07T16:21:52.694 INFO:tasks.workunit.client.0.smithi063.stdout:9/926: mkdir d0/d21/d64/d6a/d136 0 2023-12-07T16:21:52.694 INFO:tasks.workunit.client.0.smithi063.stdout:5/853: dwrite d1/d3/de/d1e/f47 [4194304,4194304] 0 2023-12-07T16:21:52.694 INFO:tasks.workunit.client.0.smithi063.stdout:0/940: creat d4/dd/d26/d2b/db5/d5b/d63/d74/d84/dcc/f142 x:0 0 0 2023-12-07T16:21:52.697 INFO:tasks.workunit.client.0.smithi063.stdout:7/904: truncate d2/d34/d5a/d5f/f16 2466014 0 2023-12-07T16:21:52.698 INFO:tasks.workunit.client.0.smithi063.stdout:9/927: creat d0/d21/d64/d6a/d85/dfd/f137 x:0 0 0 2023-12-07T16:21:52.700 INFO:tasks.workunit.client.0.smithi063.stdout:5/854: mknod d1/d3/d3a/dcd/dd3/d7e/cfd 0 2023-12-07T16:21:52.700 INFO:tasks.workunit.client.0.smithi063.stdout:5/855: rename d1/d3/d3a/dcd to d1/d3/d3a/dcd/dd3/d7e/dfe 22 2023-12-07T16:21:52.701 INFO:tasks.workunit.client.0.smithi063.stdout:9/928: dread d0/d13/d6f/daf/dbc/fc2 [0,4194304] 0 2023-12-07T16:21:52.702 INFO:tasks.workunit.client.0.smithi063.stdout:0/941: link d4/dd/d26/d2b/db5/d5b/c8f d4/dd/d26/d2b/d5e/d8e/d95/c143 0 2023-12-07T16:21:52.702 INFO:tasks.workunit.client.0.smithi063.stdout:0/942: dread - d4/dd/d26/d2b/db5/d5b/d63/d132/f134 zero size 2023-12-07T16:21:52.702 INFO:tasks.workunit.client.0.smithi063.stdout:0/943: fsync d4/dd/d26/d2b/db5/d5b/d63/d74/df4/d12e/fc5 0 2023-12-07T16:21:52.710 INFO:tasks.workunit.client.0.smithi063.stdout:5/856: rename d1/d3/de/d1e/d6b/dd0 to d1/d3/d3a/dcd/dff 0 2023-12-07T16:21:52.718 INFO:tasks.workunit.client.0.smithi063.stdout:0/944: unlink d4/dd/d26/d2b/d5e/d8e/dee/fb2 0 2023-12-07T16:21:52.722 INFO:tasks.workunit.client.0.smithi063.stdout:0/945: creat d4/dd/d26/d2b/db5/d5b/d63/d74/f144 x:0 0 0 2023-12-07T16:21:52.722 INFO:tasks.workunit.client.0.smithi063.stdout:0/946: fsync d4/dd/de/f13 0 2023-12-07T16:21:52.722 INFO:tasks.workunit.client.0.smithi063.stdout:7/905: dwrite d2/d34/d46/d48/f4c [0,4194304] 0 2023-12-07T16:21:52.736 INFO:tasks.workunit.client.0.smithi063.stdout:9/929: dwrite d0/f68 [0,4194304] 0 2023-12-07T16:21:52.739 INFO:tasks.workunit.client.0.smithi063.stdout:9/930: symlink d0/d13/d6f/d9b/l138 0 2023-12-07T16:21:52.752 INFO:tasks.workunit.client.0.smithi063.stdout:9/931: dread d0/f73 [0,4194304] 0 2023-12-07T16:21:52.753 INFO:tasks.workunit.client.0.smithi063.stdout:9/932: creat d0/f139 x:0 0 0 2023-12-07T16:21:52.753 INFO:tasks.workunit.client.0.smithi063.stdout:9/933: truncate d0/d13/d95/ded/fff 3077808 0 2023-12-07T16:21:52.756 INFO:tasks.workunit.client.0.smithi063.stdout:5/857: dwrite d1/d3/d3a/d5a/f66 [0,4194304] 0 2023-12-07T16:21:52.756 INFO:tasks.workunit.client.0.smithi063.stdout:7/906: dwrite d2/d34/fe3 [0,4194304] 0 2023-12-07T16:21:52.757 INFO:tasks.workunit.client.0.smithi063.stdout:0/947: dwrite d4/dd/de/d15/f5f [0,4194304] 0 2023-12-07T16:21:52.757 INFO:tasks.workunit.client.0.smithi063.stdout:0/948: fsync d4/dd/de/d15/f8c 0 2023-12-07T16:21:52.760 INFO:tasks.workunit.client.0.smithi063.stdout:9/934: write d0/d13/d95/ded/d57/fb9 [3775193,60214] 0 2023-12-07T16:21:52.768 INFO:tasks.workunit.client.0.smithi063.stdout:5/858: unlink d1/d31/dc8/cdd 0 2023-12-07T16:21:52.768 INFO:tasks.workunit.client.0.smithi063.stdout:7/907: creat d2/d34/d46/d48/d70/daf/dd6/df6/f142 x:0 0 0 2023-12-07T16:21:52.768 INFO:tasks.workunit.client.0.smithi063.stdout:0/949: rename d4/dd/d26/d2b/db5/d5b/c13c to d4/dd/d26/d2b/db5/d5b/d63/d74/d84/d122/c145 0 2023-12-07T16:21:52.768 INFO:tasks.workunit.client.0.smithi063.stdout:5/859: write d1/d31/db8/dee/fcc [1062822,44696] 0 2023-12-07T16:21:52.768 INFO:tasks.workunit.client.0.smithi063.stdout:0/950: readlink d4/dd/de/d15/d1f/d4c/da1/ldc 0 2023-12-07T16:21:52.768 INFO:tasks.workunit.client.0.smithi063.stdout:5/860: write d1/d31/dc8/fc7 [1376806,82107] 0 2023-12-07T16:21:52.769 INFO:tasks.workunit.client.0.smithi063.stdout:9/935: creat d0/d21/d64/d6a/d8f/d92/dbb/f13a x:0 0 0 2023-12-07T16:21:52.769 INFO:tasks.workunit.client.0.smithi063.stdout:7/908: getdents d2/d21/dc6 0 2023-12-07T16:21:52.772 INFO:tasks.workunit.client.0.smithi063.stdout:0/951: rename d4/d7e/fbf to d4/dd/de/d15/d1f/d4c/f146 0 2023-12-07T16:21:52.772 INFO:tasks.workunit.client.0.smithi063.stdout:9/936: write d0/d21/d64/d6a/d8f/d92/dbb/ff7 [279004,52810] 0 2023-12-07T16:21:52.772 INFO:tasks.workunit.client.0.smithi063.stdout:0/952: stat d4/dd/d26/d2b/db5/d5b/fa9 0 2023-12-07T16:21:52.772 INFO:tasks.workunit.client.0.smithi063.stdout:9/937: chown d0/d13/d39/d3a/d78/de8/fee 14259 1 2023-12-07T16:21:52.773 INFO:tasks.workunit.client.0.smithi063.stdout:5/861: write d1/f7 [215952,112257] 0 2023-12-07T16:21:52.775 INFO:tasks.workunit.client.0.smithi063.stdout:0/953: creat d4/dd/d26/d2b/db5/d130/f147 x:0 0 0 2023-12-07T16:21:52.776 INFO:tasks.workunit.client.0.smithi063.stdout:5/862: symlink d1/d3/l100 0 2023-12-07T16:21:52.779 INFO:tasks.workunit.client.0.smithi063.stdout:0/954: symlink d4/dd/d26/d2b/db5/d5b/d63/d74/l148 0 2023-12-07T16:21:52.779 INFO:tasks.workunit.client.0.smithi063.stdout:5/863: creat d1/d31/dc8/de5/f101 x:0 0 0 2023-12-07T16:21:52.781 INFO:tasks.workunit.client.0.smithi063.stdout:0/955: creat d4/dd/de/d15/d59/d43/d91/f149 x:0 0 0 2023-12-07T16:21:52.781 INFO:tasks.workunit.client.0.smithi063.stdout:5/864: write d1/f40 [3402081,29756] 0 2023-12-07T16:21:52.782 INFO:tasks.workunit.client.0.smithi063.stdout:0/956: creat d4/dd/de/d15/d1f/d4c/da1/f14a x:0 0 0 2023-12-07T16:21:52.783 INFO:tasks.workunit.client.0.smithi063.stdout:9/938: dread d0/d13/dd2/fdb [0,4194304] 0 2023-12-07T16:21:52.785 INFO:tasks.workunit.client.0.smithi063.stdout:5/865: rename d1/f18 to d1/d3/de/f102 0 2023-12-07T16:21:52.785 INFO:tasks.workunit.client.0.smithi063.stdout:5/866: chown d1/d3/d3a/d5a/dc6/fc9 77 1 2023-12-07T16:21:52.786 INFO:tasks.workunit.client.0.smithi063.stdout:0/957: getdents d4/d25 0 2023-12-07T16:21:52.787 INFO:tasks.workunit.client.0.smithi063.stdout:9/939: creat d0/d13/d6f/daf/dbc/f13b x:0 0 0 2023-12-07T16:21:52.787 INFO:tasks.workunit.client.0.smithi063.stdout:5/867: symlink d1/d3/de/l103 0 2023-12-07T16:21:52.789 INFO:tasks.workunit.client.0.smithi063.stdout:7/909: dwrite d2/f17 [0,4194304] 0 2023-12-07T16:21:52.790 INFO:tasks.workunit.client.0.smithi063.stdout:0/958: creat d4/dd/d26/d2b/db5/d5b/d63/d6b/dbe/d138/f14b x:0 0 0 2023-12-07T16:21:52.792 INFO:tasks.workunit.client.0.smithi063.stdout:9/940: rename d0/d13/c8b to d0/d21/d64/d6a/d85/c13c 0 2023-12-07T16:21:52.795 INFO:tasks.workunit.client.0.smithi063.stdout:0/959: write d4/dd/d26/d2b/db5/d5b/d63/d6b/dbe/f131 [841534,118099] 0 2023-12-07T16:21:52.795 INFO:tasks.workunit.client.0.smithi063.stdout:0/960: stat d4/dd/d26/d2b/f126 0 2023-12-07T16:21:52.795 INFO:tasks.workunit.client.0.smithi063.stdout:0/961: write d4/dd/de/d15/d59/d43/d91/f149 [310193,29033] 0 2023-12-07T16:21:52.795 INFO:tasks.workunit.client.0.smithi063.stdout:0/962: chown d4/f8a 421529256 1 2023-12-07T16:21:52.795 INFO:tasks.workunit.client.0.smithi063.stdout:0/963: chown d4/dd/de/d15/d59/le7 29576302 1 2023-12-07T16:21:52.795 INFO:tasks.workunit.client.0.smithi063.stdout:9/941: symlink d0/d13/d39/l13d 0 2023-12-07T16:21:52.797 INFO:tasks.workunit.client.0.smithi063.stdout:0/964: symlink d4/dd/de/d15/d59/d43/d91/l14c 0 2023-12-07T16:21:52.800 INFO:tasks.workunit.client.0.smithi063.stdout:9/942: symlink d0/d13/d6f/daf/dbc/l13e 0 2023-12-07T16:21:52.801 INFO:tasks.workunit.client.0.smithi063.stdout:0/965: mknod d4/d7e/c14d 0 2023-12-07T16:21:52.801 INFO:tasks.workunit.client.0.smithi063.stdout:5/868: dread d1/f32 [0,4194304] 0 2023-12-07T16:21:52.803 INFO:tasks.workunit.client.0.smithi063.stdout:9/943: mkdir d0/d13/d39/d3a/d78/d13f 0 2023-12-07T16:21:52.804 INFO:tasks.workunit.client.0.smithi063.stdout:0/966: dread d4/d25/f71 [0,4194304] 0 2023-12-07T16:21:52.804 INFO:tasks.workunit.client.0.smithi063.stdout:0/967: chown d4/dd/d26/d2b/db5/d5b/ff2 258 1 2023-12-07T16:21:52.805 INFO:tasks.workunit.client.0.smithi063.stdout:5/869: symlink d1/d31/db8/dee/d8f/df1/l104 0 2023-12-07T16:21:52.808 INFO:tasks.workunit.client.0.smithi063.stdout:0/968: mkdir d4/dd/de/d15/d1f/d4c/da1/dd4/d136/d14e 0 2023-12-07T16:21:52.813 INFO:tasks.workunit.client.0.smithi063.stdout:5/870: creat d1/d3/de/d1e/f105 x:0 0 0 2023-12-07T16:21:52.813 INFO:tasks.workunit.client.0.smithi063.stdout:5/871: fsync d1/d31/db8/ff3 0 2023-12-07T16:21:52.813 INFO:tasks.workunit.client.0.smithi063.stdout:9/944: dread d0/d13/d95/ded/ff0 [0,4194304] 0 2023-12-07T16:21:52.815 INFO:tasks.workunit.client.0.smithi063.stdout:5/872: rmdir d1/d31/dc8 39 2023-12-07T16:21:52.815 INFO:tasks.workunit.client.0.smithi063.stdout:5/873: stat d1/d3/d3a/dcd/dd3/d7e/dcf 0 2023-12-07T16:21:52.815 INFO:tasks.workunit.client.0.smithi063.stdout:5/874: dread - d1/d3/de/d1e/fa1 zero size 2023-12-07T16:21:52.815 INFO:tasks.workunit.client.0.smithi063.stdout:5/875: fsync d1/d3/de/f4a 0 2023-12-07T16:21:52.817 INFO:tasks.workunit.client.0.smithi063.stdout:0/969: dread d4/f10f [0,4194304] 0 2023-12-07T16:21:52.818 INFO:tasks.workunit.client.0.smithi063.stdout:5/876: creat d1/d31/db8/dee/d8f/ddf/f106 x:0 0 0 2023-12-07T16:21:52.820 INFO:tasks.workunit.client.0.smithi063.stdout:5/877: creat d1/d31/dc8/de5/f107 x:0 0 0 2023-12-07T16:21:52.820 INFO:tasks.workunit.client.0.smithi063.stdout:5/878: truncate d1/d3/de/d1e/fa1 625188 0 2023-12-07T16:21:52.821 INFO:tasks.workunit.client.0.smithi063.stdout:7/910: dwrite d2/d34/d5a/d5f/d78/d7c/d9b/fad [4194304,4194304] 0 2023-12-07T16:21:52.822 INFO:tasks.workunit.client.0.smithi063.stdout:7/911: fdatasync d2/d34/d5a/d5f/d2a/f2f 0 2023-12-07T16:21:52.822 INFO:tasks.workunit.client.0.smithi063.stdout:0/970: truncate d4/dd/d26/d2b/d5e/f88 1093611 0 2023-12-07T16:21:52.832 INFO:tasks.workunit.client.0.smithi063.stdout:7/912: symlink d2/d34/d5a/d5f/d2a/l143 0 2023-12-07T16:21:52.832 INFO:tasks.workunit.client.0.smithi063.stdout:5/879: mkdir d1/d31/d56/d108 0 2023-12-07T16:21:52.843 INFO:tasks.workunit.client.0.smithi063.stdout:7/913: mkdir d2/d34/d5a/d5f/d53/dab/db5/d101/d144 0 2023-12-07T16:21:52.843 INFO:tasks.workunit.client.0.smithi063.stdout:5/880: rmdir d1/d31/db8/dee/d8f/ddf/de4 39 2023-12-07T16:21:52.847 INFO:tasks.workunit.client.0.smithi063.stdout:9/945: dwrite d0/f56 [0,4194304] 0 2023-12-07T16:21:52.850 INFO:tasks.workunit.client.0.smithi063.stdout:5/881: dread d1/f65 [0,4194304] 0 2023-12-07T16:21:52.850 INFO:tasks.workunit.client.0.smithi063.stdout:5/882: dread - d1/d3/de/d1e/f105 zero size 2023-12-07T16:21:52.851 INFO:tasks.workunit.client.0.smithi063.stdout:7/914: mknod d2/d34/dc2/c145 0 2023-12-07T16:21:52.852 INFO:tasks.workunit.client.0.smithi063.stdout:0/971: dread d4/dd/d26/d2b/db5/d5b/d63/d6b/dbe/f131 [0,4194304] 0 2023-12-07T16:21:52.853 INFO:tasks.workunit.client.0.smithi063.stdout:9/946: rename d0/d21/d64/d6a/d8f/ddd/lf3 to d0/d13/dd2/l140 0 2023-12-07T16:21:52.853 INFO:tasks.workunit.client.0.smithi063.stdout:9/947: write d0/d13/d95/f98 [65617,12300] 0 2023-12-07T16:21:52.854 INFO:tasks.workunit.client.0.smithi063.stdout:7/915: symlink d2/d64/l146 0 2023-12-07T16:21:52.856 INFO:tasks.workunit.client.0.smithi063.stdout:0/972: rename d4/dd/d26/d2b/db5/d5b/d63/d74/d84/f11c to d4/dd/d26/d2b/db5/d5b/d63/d74/d84/ddb/f14f 0 2023-12-07T16:21:52.858 INFO:tasks.workunit.client.0.smithi063.stdout:7/916: creat d2/d37/de4/f147 x:0 0 0 2023-12-07T16:21:52.858 INFO:tasks.workunit.client.0.smithi063.stdout:7/917: chown d2/f8 97 1 2023-12-07T16:21:52.858 INFO:tasks.workunit.client.0.smithi063.stdout:7/918: truncate d2/d21/f49 1722248 0 2023-12-07T16:21:52.858 INFO:tasks.workunit.client.0.smithi063.stdout:7/919: chown d2/d34/d5a/d5f/d2a 174514 1 2023-12-07T16:21:52.863 INFO:tasks.workunit.client.0.smithi063.stdout:0/973: truncate d4/dd/d26/d2b/db5/d5b/d63/d74/df4/d12e/f110 3131043 0 2023-12-07T16:21:52.864 INFO:tasks.workunit.client.0.smithi063.stdout:9/948: write d0/f99 [2516782,45427] 0 2023-12-07T16:21:52.865 INFO:tasks.workunit.client.0.smithi063.stdout:9/949: mknod d0/d13/d6f/d9b/c141 0 2023-12-07T16:21:52.866 INFO:tasks.workunit.client.0.smithi063.stdout:9/950: read d0/d13/d39/f123 [400781,3221] 0 2023-12-07T16:21:52.866 INFO:tasks.workunit.client.0.smithi063.stdout:9/951: dread - d0/d21/fae zero size 2023-12-07T16:21:52.866 INFO:tasks.workunit.client.0.smithi063.stdout:9/952: read - d0/d13/d6f/daf/dbc/ddc/f122 zero size 2023-12-07T16:21:52.867 INFO:tasks.workunit.client.0.smithi063.stdout:0/974: mknod d4/dd/de/d15/d1f/d4c/da1/db3/c150 0 2023-12-07T16:21:52.867 INFO:tasks.workunit.client.0.smithi063.stdout:0/975: stat d4/dd/d26/f4f 0 2023-12-07T16:21:52.873 INFO:tasks.workunit.client.0.smithi063.stdout:0/976: read d4/dd/d26/d2b/db5/d5b/ff2 [982070,125602] 0 2023-12-07T16:21:52.874 INFO:tasks.workunit.client.0.smithi063.stdout:0/977: truncate d4/d25/f7d 4145539 0 2023-12-07T16:21:52.874 INFO:tasks.workunit.client.0.smithi063.stdout:5/883: dwrite d1/d31/db8/dee/d8f/ddf/f106 [0,4194304] 0 2023-12-07T16:21:52.878 INFO:tasks.workunit.client.0.smithi063.stdout:5/884: creat d1/d3/de/d1e/d6b/f109 x:0 0 0 2023-12-07T16:21:52.882 INFO:tasks.workunit.client.0.smithi063.stdout:0/978: write d4/dd/d26/d2b/db5/d5b/d63/d74/df4/d12e/fd5 [1988876,116284] 0 2023-12-07T16:21:52.883 INFO:tasks.workunit.client.0.smithi063.stdout:5/885: mknod d1/d3/de/d1e/c10a 0 2023-12-07T16:21:52.883 INFO:tasks.workunit.client.0.smithi063.stdout:5/886: write d1/d3/d3a/dcd/dff/ff7 [1043611,3289] 0 2023-12-07T16:21:52.884 INFO:tasks.workunit.client.0.smithi063.stdout:0/979: mkdir d4/dd/d26/d2b/d5e/d151 0 2023-12-07T16:21:52.887 INFO:tasks.workunit.client.0.smithi063.stdout:5/887: rename d1/d31/lbf to d1/d3/d3a/d91/l10b 0 2023-12-07T16:21:52.889 INFO:tasks.workunit.client.0.smithi063.stdout:0/980: mkdir d4/dd/d26/d2b/d152 0 2023-12-07T16:21:52.890 INFO:tasks.workunit.client.0.smithi063.stdout:0/981: creat d4/d7e/f153 x:0 0 0 2023-12-07T16:21:52.890 INFO:tasks.workunit.client.0.smithi063.stdout:0/982: write d4/dd/d26/d2b/db5/d5b/d63/f80 [1893488,4691] 0 2023-12-07T16:21:52.901 INFO:tasks.workunit.client.0.smithi063.stdout:9/953: dwrite d0/d13/d95/ded/ff0 [0,4194304] 0 2023-12-07T16:21:52.902 INFO:tasks.workunit.client.0.smithi063.stdout:9/954: write d0/d21/d64/d6a/d85/dfd/f127 [19005,127327] 0 2023-12-07T16:21:52.902 INFO:tasks.workunit.client.0.smithi063.stdout:0/983: dread d4/dd/de/f20 [4194304,4194304] 0 2023-12-07T16:21:52.912 INFO:tasks.workunit.client.0.smithi063.stdout:5/888: dwrite d1/d3/d3a/d5a/f66 [4194304,4194304] 0 2023-12-07T16:21:52.918 INFO:tasks.workunit.client.0.smithi063.stdout:5/889: write d1/d3/d3a/dcd/dd3/fa3 [1905909,106730] 0 2023-12-07T16:21:52.926 INFO:tasks.workunit.client.0.smithi063.stdout:0/984: dwrite d4/dd/de/d15/d59/d43/d91/f149 [0,4194304] 0 2023-12-07T16:21:52.928 INFO:tasks.workunit.client.0.smithi063.stdout:9/955: dwrite d0/d8d/f116 [0,4194304] 0 2023-12-07T16:21:52.928 INFO:tasks.workunit.client.0.smithi063.stdout:9/956: write d0/d13/dd2/f12b [610088,111565] 0 2023-12-07T16:21:52.929 INFO:tasks.workunit.client.0.smithi063.stdout:0/985: mknod d4/dd/de/d15/d59/c154 0 2023-12-07T16:21:52.929 INFO:tasks.workunit.client.0.smithi063.stdout:9/957: mknod d0/d13/d39/c142 0 2023-12-07T16:21:52.950 INFO:tasks.workunit.client.0.smithi063.stdout:9/958: dread d0/d21/d64/d6a/d8f/d92/fd6 [0,4194304] 0 2023-12-07T16:21:52.955 INFO:tasks.workunit.client.0.smithi063.stdout:0/986: dwrite d4/d25/f8d [0,4194304] 0 2023-12-07T16:21:52.955 INFO:tasks.workunit.client.0.smithi063.stdout:0/987: write d4/d7e/ffe [1033333,56528] 0 2023-12-07T16:21:52.955 INFO:tasks.workunit.client.0.smithi063.stdout:0/988: fsync d4/f90 0 2023-12-07T16:21:52.957 INFO:tasks.workunit.client.0.smithi063.stdout:5/890: dwrite d1/d3/d3a/dcd/dd3/fa3 [0,4194304] 0 2023-12-07T16:21:52.957 INFO:tasks.workunit.client.0.smithi063.stdout:5/891: readlink d1/d3/lb1 0 2023-12-07T16:21:52.959 INFO:tasks.workunit.client.0.smithi063.stdout:0/989: creat d4/dd/de/d15/d1f/f155 x:0 0 0 2023-12-07T16:21:52.959 INFO:tasks.workunit.client.0.smithi063.stdout:0/990: chown d4/dd/de/d15/d1f/d4c/da1/db3/c150 7972429 1 2023-12-07T16:21:52.960 INFO:tasks.workunit.client.0.smithi063.stdout:5/892: creat d1/d31/dc8/f10c x:0 0 0 2023-12-07T16:21:52.976 INFO:tasks.workunit.client.0.smithi063.stdout:9/959: dwrite d0/d21/d64/d6a/d8f/d92/dbb/f13a [0,4194304] 0 2023-12-07T16:21:52.979 INFO:tasks.workunit.client.0.smithi063.stdout:9/960: mkdir d0/d13/d39/d3a/d12a/d143 0 2023-12-07T16:21:52.980 INFO:tasks.workunit.client.0.smithi063.stdout:9/961: fsync d0/d21/d64/d6a/d8f/d92/dbb/f13a 0 2023-12-07T16:21:52.983 INFO:tasks.workunit.client.0.smithi063.stdout:9/962: symlink d0/d21/d64/d6a/d85/dfd/l144 0 2023-12-07T16:21:52.984 INFO:tasks.workunit.client.0.smithi063.stdout:0/991: dwrite d4/d7e/f153 [0,4194304] 0 2023-12-07T16:21:52.984 INFO:tasks.workunit.client.0.smithi063.stdout:0/992: truncate d4/dd/de/d15/d59/d43/dd8/f118 967583 0 2023-12-07T16:21:52.984 INFO:tasks.workunit.client.0.smithi063.stdout:0/993: chown d4/dd/d26/d2b/l92 422 1 2023-12-07T16:21:52.984 INFO:tasks.workunit.client.0.smithi063.stdout:0/994: dread - d4/dd/d26/d2b/db5/d5b/d63/d74/d84/dcc/ffd zero size 2023-12-07T16:21:52.986 INFO:tasks.workunit.client.0.smithi063.stdout:9/963: mkdir d0/d13/d39/d3a/d78/d115/d145 0 2023-12-07T16:21:52.986 INFO:tasks.workunit.client.0.smithi063.stdout:9/964: truncate d0/d21/d64/d6a/d85/fe7 627839 0 2023-12-07T16:21:52.986 INFO:tasks.workunit.client.0.smithi063.stdout:9/965: chown d0/d13/dd2/fdb 431833 1 2023-12-07T16:21:52.989 INFO:tasks.workunit.client.0.smithi063.stdout:0/995: unlink d4/d25/lf6 0 2023-12-07T16:21:52.993 INFO:tasks.workunit.client.0.smithi063.stdout:0/996: unlink d4/dd/de/l78 0 2023-12-07T16:21:53.013 INFO:tasks.workunit.client.0.smithi063.stdout:0/997: dwrite d4/dd/de/d15/d59/d43/dd8/f10d [0,4194304] 0 2023-12-07T16:21:53.038 INFO:tasks.workunit.client.0.smithi063.stdout:0/998: dwrite d4/dd/d26/d2b/d5e/d8e/d95/d68/f107 [0,4194304] 0 2023-12-07T16:21:53.038 INFO:tasks.workunit.client.0.smithi063.stdout:0/999: getdents d4/dd/de/d15/d59/d43/d91/d139 0 2023-12-07T16:21:53.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:53 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:53.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:53 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:53.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:53 smithi152 ceph-mon[121113]: pgmap v34: 65 pgs: 65 active+clean; 3.4 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 189 MiB/s rd, 381 MiB/s wr, 642 op/s 2023-12-07T16:21:54.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:53 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:54.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:53 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:54.045 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:53 smithi063 ceph-mon[112095]: pgmap v34: 65 pgs: 65 active+clean; 3.4 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 189 MiB/s rd, 381 MiB/s wr, 642 op/s 2023-12-07T16:21:55.982 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:55 smithi063 ceph-mon[112095]: pgmap v35: 65 pgs: 65 active+clean; 3.4 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 97 MiB/s rd, 203 MiB/s wr, 374 op/s 2023-12-07T16:21:56.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:55 smithi152 ceph-mon[121113]: pgmap v35: 65 pgs: 65 active+clean; 3.4 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 97 MiB/s rd, 203 MiB/s wr, 374 op/s 2023-12-07T16:21:57.032 INFO:tasks.workunit.client.0.smithi063.stdout:9/966: sync 2023-12-07T16:21:57.032 INFO:tasks.workunit.client.0.smithi063.stdout:5/893: sync 2023-12-07T16:21:57.032 INFO:tasks.workunit.client.0.smithi063.stdout:7/920: sync 2023-12-07T16:21:57.032 INFO:tasks.workunit.client.0.smithi063.stdout:2/914: sync 2023-12-07T16:21:57.032 INFO:tasks.workunit.client.0.smithi063.stdout:4/704: sync 2023-12-07T16:21:57.032 INFO:tasks.workunit.client.0.smithi063.stdout:4/705: stat d1/d3/d3f/f9a 0 2023-12-07T16:21:57.032 INFO:tasks.workunit.client.0.smithi063.stdout:2/915: readlink d0/d21/d56/l112 0 2023-12-07T16:21:57.032 INFO:tasks.workunit.client.0.smithi063.stdout:3/858: sync 2023-12-07T16:21:57.033 INFO:tasks.workunit.client.0.smithi063.stdout:6/870: sync 2023-12-07T16:21:57.033 INFO:tasks.workunit.client.0.smithi063.stdout:6/871: fsync d0/d1e/d1d/d4f/d88/fea 0 2023-12-07T16:21:57.033 INFO:tasks.workunit.client.0.smithi063.stdout:1/791: sync 2023-12-07T16:21:57.033 INFO:tasks.workunit.client.0.smithi063.stdout:9/967: write d0/d21/f43 [1672719,10304] 0 2023-12-07T16:21:57.033 INFO:tasks.workunit.client.0.smithi063.stdout:9/968: truncate d0/d21/d64/f4a 3333903 0 2023-12-07T16:21:57.034 INFO:tasks.workunit.client.0.smithi063.stdout:5/894: rename d1/d3/de/l103 to d1/d3/d3a/dcd/dd3/l10d 0 2023-12-07T16:21:57.034 INFO:tasks.workunit.client.0.smithi063.stdout:4/706: creat d1/d3/d3f/fd1 x:0 0 0 2023-12-07T16:21:57.035 INFO:tasks.workunit.client.0.smithi063.stdout:4/707: readlink d1/d3/db/d41/l5b 0 2023-12-07T16:21:57.037 INFO:tasks.workunit.client.0.smithi063.stdout:3/859: getdents d7/d49/d4b/d8e 0 2023-12-07T16:21:57.039 INFO:tasks.workunit.client.0.smithi063.stdout:1/792: rmdir d0/dd/d10/d6f/dd8 39 2023-12-07T16:21:57.039 INFO:tasks.workunit.client.0.smithi063.stdout:1/793: truncate d0/dd/d10/d6f/da0/fe6 436386 0 2023-12-07T16:21:57.040 INFO:tasks.workunit.client.0.smithi063.stdout:6/872: write d0/d1e/d2a/faa [1314409,107865] 0 2023-12-07T16:21:57.040 INFO:tasks.workunit.client.0.smithi063.stdout:9/969: creat d0/d21/d64/f146 x:0 0 0 2023-12-07T16:21:57.040 INFO:tasks.workunit.client.0.smithi063.stdout:4/708: symlink d1/ld2 0 2023-12-07T16:21:57.040 INFO:tasks.workunit.client.0.smithi063.stdout:3/860: dread d7/d9/d1b/d5c/f101 [0,4194304] 0 2023-12-07T16:21:57.040 INFO:tasks.workunit.client.0.smithi063.stdout:3/861: getdents d7/d4f/d53/d54 0 2023-12-07T16:21:57.050 INFO:tasks.workunit.client.0.smithi063.stdout:4/709: symlink d1/d3/db/d2c/d63/d62/ld3 0 2023-12-07T16:21:57.050 INFO:tasks.workunit.client.0.smithi063.stdout:9/970: unlink d0/d13/d39/f48 0 2023-12-07T16:21:57.050 INFO:tasks.workunit.client.0.smithi063.stdout:3/862: rename d7/d9/d1b/c36 to d7/d8d/c11c 0 2023-12-07T16:21:57.054 INFO:tasks.workunit.client.0.smithi063.stdout:9/971: creat d0/d13/d95/ded/d113/f147 x:0 0 0 2023-12-07T16:21:57.054 INFO:tasks.workunit.client.0.smithi063.stdout:9/972: readlink d0/d13/d39/l131 0 2023-12-07T16:21:57.056 INFO:tasks.workunit.client.0.smithi063.stdout:4/710: rename d1/d3/db/cc7 to d1/d3/d51/cd4 0 2023-12-07T16:21:57.057 INFO:tasks.workunit.client.0.smithi063.stdout:6/873: dread d0/d1e/d29/f57 [0,4194304] 0 2023-12-07T16:21:57.057 INFO:tasks.workunit.client.0.smithi063.stdout:4/711: write d1/dc6/fcd [234331,100877] 0 2023-12-07T16:21:57.057 INFO:tasks.workunit.client.0.smithi063.stdout:6/874: write d0/d1e/d60/d68/d76/da4/dcc/d108/f129 [4541029,60070] 0 2023-12-07T16:21:57.057 INFO:tasks.workunit.client.0.smithi063.stdout:6/875: chown d0/d79/fa0 1599 1 2023-12-07T16:21:57.057 INFO:tasks.workunit.client.0.smithi063.stdout:3/863: symlink d7/d49/l11d 0 2023-12-07T16:21:57.059 INFO:tasks.workunit.client.0.smithi063.stdout:4/712: read d1/d3/db/d2c/f77 [2449028,64885] 0 2023-12-07T16:21:57.059 INFO:tasks.workunit.client.0.smithi063.stdout:9/973: chown d0/l27 32 1 2023-12-07T16:21:57.059 INFO:tasks.workunit.client.0.smithi063.stdout:9/974: write d0/d21/d64/d6a/f79 [719681,83275] 0 2023-12-07T16:21:57.059 INFO:tasks.workunit.client.0.smithi063.stdout:9/975: chown d0/d21/d64/cb3 1649167005 1 2023-12-07T16:21:57.064 INFO:tasks.workunit.client.0.smithi063.stdout:6/876: rmdir d0/d1e/d1d/d1f 39 2023-12-07T16:21:57.064 INFO:tasks.workunit.client.0.smithi063.stdout:3/864: mkdir d7/d49/d4b/d11e 0 2023-12-07T16:21:57.067 INFO:tasks.workunit.client.0.smithi063.stdout:3/865: rename d7/d9/d1b/dc8 to d7/d9/dfa/d11f 0 2023-12-07T16:21:57.067 INFO:tasks.workunit.client.0.smithi063.stdout:9/976: creat d0/d13/d39/d3a/d78/d115/d145/f148 x:0 0 0 2023-12-07T16:21:57.068 INFO:tasks.workunit.client.0.smithi063.stdout:3/866: readlink d7/l8a 0 2023-12-07T16:21:57.068 INFO:tasks.workunit.client.0.smithi063.stdout:9/977: write d0/d13/d6f/daf/f10e [802735,104707] 0 2023-12-07T16:21:57.069 INFO:tasks.workunit.client.0.smithi063.stdout:3/867: creat d7/d4f/d53/d54/d76/f120 x:0 0 0 2023-12-07T16:21:57.073 INFO:tasks.workunit.client.0.smithi063.stdout:2/916: dwrite d0/d21/d56/d11/d6d/dcb/ff2 [0,4194304] 0 2023-12-07T16:21:57.074 INFO:tasks.workunit.client.0.smithi063.stdout:5/895: dwrite d1/d31/db8/dee/f64 [0,4194304] 0 2023-12-07T16:21:57.074 INFO:tasks.workunit.client.0.smithi063.stdout:1/794: dwrite d0/dd/d19/d50/d71/f52 [0,4194304] 0 2023-12-07T16:21:57.076 INFO:tasks.workunit.client.0.smithi063.stdout:9/978: readlink d0/l34 0 2023-12-07T16:21:57.079 INFO:tasks.workunit.client.0.smithi063.stdout:2/917: mknod d0/d21/d56/d11/dc0/c129 0 2023-12-07T16:21:57.082 INFO:tasks.workunit.client.0.smithi063.stdout:9/979: dread d0/d13/d39/d3a/d78/de8/ff9 [0,4194304] 0 2023-12-07T16:21:57.089 INFO:tasks.workunit.client.0.smithi063.stdout:2/918: link d0/d21/d56/fd5 d0/d21/d56/d11/db0/d106/f12a 0 2023-12-07T16:21:57.090 INFO:tasks.workunit.client.0.smithi063.stdout:2/919: fdatasync d0/d21/d56/d11/f1b 0 2023-12-07T16:21:57.092 INFO:tasks.workunit.client.0.smithi063.stdout:9/980: rename d0/d13/d6f/cb8 to d0/d13/d6f/daf/c149 0 2023-12-07T16:21:57.095 INFO:tasks.workunit.client.0.smithi063.stdout:5/896: dread d1/d31/d56/fdc [0,4194304] 0 2023-12-07T16:21:57.095 INFO:tasks.workunit.client.0.smithi063.stdout:2/920: rename d0/d21/d56/d11/d6d/dcb to d0/d21/d56/d11/d52/da9/d124/d12b 0 2023-12-07T16:21:57.096 INFO:tasks.workunit.client.0.smithi063.stdout:5/897: rmdir d1/d3/d3a/dcd/dd3/d7e 39 2023-12-07T16:21:57.097 INFO:tasks.workunit.client.0.smithi063.stdout:2/921: mknod d0/d21/d56/d11/d52/d63/d8c/db9/dd2/c12c 0 2023-12-07T16:21:57.098 INFO:tasks.workunit.client.0.smithi063.stdout:5/898: mknod d1/d31/d56/c10e 0 2023-12-07T16:21:57.102 INFO:tasks.workunit.client.0.smithi063.stdout:5/899: link d1/c5 d1/d31/dc8/de5/c10f 0 2023-12-07T16:21:57.102 INFO:tasks.workunit.client.0.smithi063.stdout:2/922: rename d0/d67/d65/fa5 to d0/d21/d39/d117/f12d 0 2023-12-07T16:21:57.103 INFO:tasks.workunit.client.0.smithi063.stdout:5/900: mknod d1/d3/de/d1e/d6b/c110 0 2023-12-07T16:21:57.104 INFO:tasks.workunit.client.0.smithi063.stdout:9/981: dread d0/d21/f33 [4194304,4194304] 0 2023-12-07T16:21:57.105 INFO:tasks.workunit.client.0.smithi063.stdout:5/901: creat d1/d3/d3a/dcd/dd3/f111 x:0 0 0 2023-12-07T16:21:57.106 INFO:tasks.workunit.client.0.smithi063.stdout:9/982: creat d0/d13/d95/d106/f14a x:0 0 0 2023-12-07T16:21:57.106 INFO:tasks.workunit.client.0.smithi063.stdout:9/983: dread - d0/d13/d39/d3a/d78/de8/fee zero size 2023-12-07T16:21:57.106 INFO:tasks.workunit.client.0.smithi063.stdout:5/902: creat d1/d3/de6/f112 x:0 0 0 2023-12-07T16:21:57.109 INFO:tasks.workunit.client.0.smithi063.stdout:9/984: unlink d0/d13/f40 0 2023-12-07T16:21:57.110 INFO:tasks.workunit.client.0.smithi063.stdout:5/903: symlink d1/d3/l113 0 2023-12-07T16:21:57.111 INFO:tasks.workunit.client.0.smithi063.stdout:5/904: mknod d1/d3/de/c114 0 2023-12-07T16:21:57.112 INFO:tasks.workunit.client.0.smithi063.stdout:5/905: write d1/d3/d3a/fa4 [84380,70751] 0 2023-12-07T16:21:57.112 INFO:tasks.workunit.client.0.smithi063.stdout:5/906: stat d1/d31/db8/dee/f64 0 2023-12-07T16:21:57.112 INFO:tasks.workunit.client.0.smithi063.stdout:5/907: truncate d1/d3/d3a/dcd/dd3/d7e/fa2 33292 0 2023-12-07T16:21:57.116 INFO:tasks.workunit.client.0.smithi063.stdout:9/985: write d0/d21/d64/f4a [913271,66889] 0 2023-12-07T16:21:57.116 INFO:tasks.workunit.client.0.smithi063.stdout:9/986: dread - d0/d13/d95/d106/f10a zero size 2023-12-07T16:21:57.120 INFO:tasks.workunit.client.0.smithi063.stdout:9/987: rename d0/f99 to d0/d13/d39/f14b 0 2023-12-07T16:21:57.120 INFO:tasks.workunit.client.0.smithi063.stdout:9/988: chown d0/d13/d6f/daf/f10e 7 1 2023-12-07T16:21:57.120 INFO:tasks.workunit.client.0.smithi063.stdout:9/989: truncate d0/d13/d6f/daf/fbd 584734 0 2023-12-07T16:21:57.120 INFO:tasks.workunit.client.0.smithi063.stdout:9/990: readlink d0/d21/d64/d6a/d8f/ld0 0 2023-12-07T16:21:57.120 INFO:tasks.workunit.client.0.smithi063.stdout:9/991: fsync d0/d21/fc1 0 2023-12-07T16:21:57.121 INFO:tasks.workunit.client.0.smithi063.stdout:9/992: symlink d0/d13/d95/ded/d113/l14c 0 2023-12-07T16:21:57.121 INFO:tasks.workunit.client.0.smithi063.stdout:9/993: readlink d0/d8d/ldf 0 2023-12-07T16:21:57.121 INFO:tasks.workunit.client.0.smithi063.stdout:9/994: truncate d0/d21/f23 493470 0 2023-12-07T16:21:57.122 INFO:tasks.workunit.client.0.smithi063.stdout:9/995: mknod d0/d13/d95/d106/c14d 0 2023-12-07T16:21:57.123 INFO:tasks.workunit.client.0.smithi063.stdout:9/996: creat d0/d13/d6f/d9b/d102/f14e x:0 0 0 2023-12-07T16:21:57.129 INFO:tasks.workunit.client.0.smithi063.stdout:7/921: dwrite d2/d34/d46/d48/d70/fc0 [0,4194304] 0 2023-12-07T16:21:57.129 INFO:tasks.workunit.client.0.smithi063.stdout:9/997: dread d0/d13/d95/f98 [0,4194304] 0 2023-12-07T16:21:57.129 INFO:tasks.workunit.client.0.smithi063.stdout:9/998: stat d0/d21/d64/d6a/d85/da4/f70 0 2023-12-07T16:21:57.131 INFO:tasks.workunit.client.0.smithi063.stdout:7/922: creat d2/d34/d46/d48/d103/f148 x:0 0 0 2023-12-07T16:21:57.137 INFO:tasks.workunit.client.0.smithi063.stdout:9/999: dread d0/d13/dd2/fdb [0,4194304] 0 2023-12-07T16:21:57.142 INFO:tasks.workunit.client.0.smithi063.stdout:7/923: dread d2/d34/d5a/d5f/d53/da3/f8e [0,4194304] 0 2023-12-07T16:21:57.143 INFO:tasks.workunit.client.0.smithi063.stdout:7/924: creat d2/d37/de4/f149 x:0 0 0 2023-12-07T16:21:57.143 INFO:tasks.workunit.client.0.smithi063.stdout:7/925: chown d2/d21/dc6 40 1 2023-12-07T16:21:57.143 INFO:tasks.workunit.client.0.smithi063.stdout:7/926: write d2/d34/d46/d48/d103/f148 [222102,56095] 0 2023-12-07T16:21:57.144 INFO:tasks.workunit.client.0.smithi063.stdout:7/927: symlink d2/d21/dc6/l14a 0 2023-12-07T16:21:57.144 INFO:tasks.workunit.client.0.smithi063.stdout:7/928: dread - d2/d34/d5a/d5f/d2a/dc9/f13f zero size 2023-12-07T16:21:57.145 INFO:tasks.workunit.client.0.smithi063.stdout:7/929: unlink d2/d34/d5a/d5f/d78/d7c/f94 0 2023-12-07T16:21:57.149 INFO:tasks.workunit.client.0.smithi063.stdout:7/930: dread d2/d21/f2d [0,4194304] 0 2023-12-07T16:21:57.150 INFO:tasks.workunit.client.0.smithi063.stdout:7/931: mkdir d2/d37/da0/d14b 0 2023-12-07T16:21:57.152 INFO:tasks.workunit.client.0.smithi063.stdout:7/932: rename d2/d21/dc6/d109/c106 to d2/d34/d46/d48/d56/ddb/c14c 0 2023-12-07T16:21:57.152 INFO:tasks.workunit.client.0.smithi063.stdout:7/933: write d2/d21/dc6/ffc [664429,19255] 0 2023-12-07T16:21:57.153 INFO:tasks.workunit.client.0.smithi063.stdout:3/868: dwrite d7/d9/dd/d56/f8c [0,4194304] 0 2023-12-07T16:21:57.154 INFO:tasks.workunit.client.0.smithi063.stdout:6/877: dwrite d0/d1e/d1d/f3d [4194304,4194304] 0 2023-12-07T16:21:57.154 INFO:tasks.workunit.client.0.smithi063.stdout:2/923: dwrite d0/d21/d56/d11/d6d/f81 [0,4194304] 0 2023-12-07T16:21:57.154 INFO:tasks.workunit.client.0.smithi063.stdout:7/934: mkdir d2/d64/d14d 0 2023-12-07T16:21:57.154 INFO:tasks.workunit.client.0.smithi063.stdout:5/908: dwrite d1/f98 [0,4194304] 0 2023-12-07T16:21:57.156 INFO:tasks.workunit.client.0.smithi063.stdout:6/878: symlink d0/d17/d1a/d38/d64/l137 0 2023-12-07T16:21:57.158 INFO:tasks.workunit.client.0.smithi063.stdout:7/935: mkdir d2/d34/d5a/d5f/d2a/d14e 0 2023-12-07T16:21:57.158 INFO:tasks.workunit.client.0.smithi063.stdout:7/936: readlink d2/d34/l71 0 2023-12-07T16:21:57.160 INFO:tasks.workunit.client.0.smithi063.stdout:6/879: dread d0/d17/d95/fa7 [0,4194304] 0 2023-12-07T16:21:57.160 INFO:tasks.workunit.client.0.smithi063.stdout:2/924: creat d0/d21/d56/d11/d52/da9/d124/d12b/f12e x:0 0 0 2023-12-07T16:21:57.161 INFO:tasks.workunit.client.0.smithi063.stdout:6/880: rmdir d0/d1e/d60/d68/d78/d9c/d9f/de4 39 2023-12-07T16:21:57.161 INFO:tasks.workunit.client.0.smithi063.stdout:6/881: dread - d0/d1e/d60/d68/d78/d9c/d9f/db8/fed zero size 2023-12-07T16:21:57.161 INFO:tasks.workunit.client.0.smithi063.stdout:6/882: read - d0/d1e/d1d/d1f/d4b/f85 zero size 2023-12-07T16:21:57.163 INFO:tasks.workunit.client.0.smithi063.stdout:2/925: unlink d0/d67/c79 0 2023-12-07T16:21:57.164 INFO:tasks.workunit.client.0.smithi063.stdout:1/795: dwrite d0/dd/d19/d50/d71/fba [0,4194304] 0 2023-12-07T16:21:57.165 INFO:tasks.workunit.client.0.smithi063.stdout:2/926: mkdir d0/d21/d56/d11/d52/d12f 0 2023-12-07T16:21:57.165 INFO:tasks.workunit.client.0.smithi063.stdout:2/927: fsync d0/d67/d65/d6a/d8e/ff0 0 2023-12-07T16:21:57.170 INFO:tasks.workunit.client.0.smithi063.stdout:1/796: symlink d0/dd/d1f/l119 0 2023-12-07T16:21:57.170 INFO:tasks.workunit.client.0.smithi063.stdout:1/797: chown d0/dd/d10/d1b/f51 1 1 2023-12-07T16:21:57.171 INFO:tasks.workunit.client.0.smithi063.stdout:2/928: rmdir d0/d21/d56/d11/d52/d63/df3 39 2023-12-07T16:21:57.173 INFO:tasks.workunit.client.0.smithi063.stdout:3/869: dwrite d7/d8d/f81 [0,4194304] 0 2023-12-07T16:21:57.173 INFO:tasks.workunit.client.0.smithi063.stdout:3/870: dread - d7/d9/dd/d56/fa7 zero size 2023-12-07T16:21:57.174 INFO:tasks.workunit.client.0.smithi063.stdout:2/929: creat d0/d21/d56/d71/f130 x:0 0 0 2023-12-07T16:21:57.176 INFO:tasks.workunit.client.0.smithi063.stdout:3/871: write d7/d4f/d53/d72/d7d/f85 [1812138,27280] 0 2023-12-07T16:21:57.181 INFO:tasks.workunit.client.0.smithi063.stdout:7/937: dwrite d2/d34/d5a/d5f/d53/d9f/d139/f13b [0,4194304] 0 2023-12-07T16:21:57.181 INFO:tasks.workunit.client.0.smithi063.stdout:7/938: stat d2/d2c/dbe/d124/f136 0 2023-12-07T16:21:57.186 INFO:tasks.workunit.client.0.smithi063.stdout:7/939: mknod d2/d34/d5a/d5f/d78/d7c/c14f 0 2023-12-07T16:21:57.190 INFO:tasks.workunit.client.0.smithi063.stdout:7/940: mknod d2/d34/d5a/d5f/d53/c150 0 2023-12-07T16:21:57.192 INFO:tasks.workunit.client.0.smithi063.stdout:7/941: mknod d2/d34/d5a/d5f/d53/dab/db5/d101/c151 0 2023-12-07T16:21:57.193 INFO:tasks.workunit.client.0.smithi063.stdout:7/942: creat d2/d34/d46/d48/d70/daf/de8/f152 x:0 0 0 2023-12-07T16:21:57.196 INFO:tasks.workunit.client.0.smithi063.stdout:7/943: mkdir d2/d96/d153 0 2023-12-07T16:21:57.206 INFO:tasks.workunit.client.0.smithi063.stdout:1/798: dwrite d0/dd/d10/fa3 [0,4194304] 0 2023-12-07T16:21:57.210 INFO:tasks.workunit.client.0.smithi063.stdout:1/799: write d0/dd/d10/f93 [3738138,32273] 0 2023-12-07T16:21:57.210 INFO:tasks.workunit.client.0.smithi063.stdout:2/930: dwrite d0/d21/d56/d11/d52/d5d/dbb/fda [0,4194304] 0 2023-12-07T16:21:57.210 INFO:tasks.workunit.client.0.smithi063.stdout:2/931: read - d0/d21/d56/d11/d52/dad/f107 zero size 2023-12-07T16:21:57.210 INFO:tasks.workunit.client.0.smithi063.stdout:2/932: chown d0/d21/d56/d11/d52/d63/d8c/db9/dd2/c12c 122713013 1 2023-12-07T16:21:57.211 INFO:tasks.workunit.client.0.smithi063.stdout:2/933: stat d0/d67/d65/d6a/d8e/cb6 0 2023-12-07T16:21:57.217 INFO:tasks.workunit.client.0.smithi063.stdout:7/944: dwrite d2/d34/d5a/d5f/d53/fbf [0,4194304] 0 2023-12-07T16:21:57.219 INFO:tasks.workunit.client.0.smithi063.stdout:7/945: dread d2/d34/d5a/d5f/d6d/f88 [0,4194304] 0 2023-12-07T16:21:57.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:56 smithi152 ceph-mon[121113]: Standby manager daemon smithi063.yohyyx restarted 2023-12-07T16:21:57.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:56 smithi152 ceph-mon[121113]: Standby manager daemon smithi063.yohyyx started 2023-12-07T16:21:57.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:56 smithi152 ceph-mon[121113]: from='mgr.? 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi063.yohyyx/crt"}]: dispatch 2023-12-07T16:21:57.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:56 smithi152 ceph-mon[121113]: from='mgr.? 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-07T16:21:57.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:56 smithi152 ceph-mon[121113]: from='mgr.? 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi063.yohyyx/key"}]: dispatch 2023-12-07T16:21:57.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:56 smithi152 ceph-mon[121113]: from='mgr.? 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-07T16:21:57.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:56 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:57.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:56 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:57.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:56 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:21:57.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:56 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:21:57.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:56 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:57.249 INFO:tasks.workunit.client.0.smithi063.stdout:2/934: dwrite d0/d21/d56/d11/f58 [4194304,4194304] 0 2023-12-07T16:21:57.250 INFO:tasks.workunit.client.0.smithi063.stdout:7/946: unlink d2/d34/d5a/d5f/d61/cbb 0 2023-12-07T16:21:57.252 INFO:tasks.workunit.client.0.smithi063.stdout:7/947: creat d2/d34/d46/d48/d70/daf/dd6/df6/f154 x:0 0 0 2023-12-07T16:21:57.254 INFO:tasks.workunit.client.0.smithi063.stdout:7/948: symlink d2/d34/d5a/d5f/d53/ded/l155 0 2023-12-07T16:21:57.266 INFO:tasks.workunit.client.0.smithi063.stdout:7/949: mknod d2/d34/d5a/d5f/d53/d9f/d139/c156 0 2023-12-07T16:21:57.266 INFO:tasks.workunit.client.0.smithi063.stdout:7/950: dread - d2/d34/d5a/d5f/d2a/d7e/d119/f11c zero size 2023-12-07T16:21:57.267 INFO:tasks.workunit.client.0.smithi063.stdout:7/951: chown d2/c32 1443374 1 2023-12-07T16:21:57.269 INFO:tasks.workunit.client.0.smithi063.stdout:7/952: unlink d2/d34/d46/d48/d70/l7b 0 2023-12-07T16:21:57.271 INFO:tasks.workunit.client.0.smithi063.stdout:7/953: read d2/f1e [2275482,107215] 0 2023-12-07T16:21:57.292 INFO:tasks.workunit.client.0.smithi063.stdout:7/954: dread d2/d34/d5a/d5f/d2a/f41 [0,4194304] 0 2023-12-07T16:21:57.293 INFO:tasks.workunit.client.0.smithi063.stdout:7/955: chown d2/d34/d5a/d5f/d78/d9a 9 1 2023-12-07T16:21:57.293 INFO:tasks.workunit.client.0.smithi063.stdout:7/956: chown d2/d34/d5a/d5f/d2a/l59 0 1 2023-12-07T16:21:57.295 INFO:tasks.workunit.client.0.smithi063.stdout:7/957: mkdir d2/d34/d5a/d5f/d61/d157 0 2023-12-07T16:21:57.295 INFO:tasks.workunit.client.0.smithi063.stdout:7/958: stat d2/d34/d5a/d5f/d78/f111 0 2023-12-07T16:21:57.295 INFO:tasks.workunit.client.0.smithi063.stdout:7/959: chown d2/d34/d46/d48/d103/f148 6300 1 2023-12-07T16:21:57.297 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:56 smithi063 ceph-mon[112095]: Standby manager daemon smithi063.yohyyx restarted 2023-12-07T16:21:57.298 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:56 smithi063 ceph-mon[112095]: Standby manager daemon smithi063.yohyyx started 2023-12-07T16:21:57.298 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:56 smithi063 ceph-mon[112095]: from='mgr.? 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi063.yohyyx/crt"}]: dispatch 2023-12-07T16:21:57.298 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:56 smithi063 ceph-mon[112095]: from='mgr.? 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-07T16:21:57.298 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:56 smithi063 ceph-mon[112095]: from='mgr.? 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi063.yohyyx/key"}]: dispatch 2023-12-07T16:21:57.298 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:56 smithi063 ceph-mon[112095]: from='mgr.? 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-07T16:21:57.298 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:56 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:57.298 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:56 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:57.298 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:56 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:21:57.298 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:56 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:21:57.298 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:56 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' 2023-12-07T16:21:57.299 INFO:tasks.workunit.client.0.smithi063.stdout:2/935: dwrite d0/d21/d56/d11/d52/da9/dbe/f76 [0,4194304] 0 2023-12-07T16:21:57.299 INFO:tasks.workunit.client.0.smithi063.stdout:2/936: chown d0/d67/d65/d6a/d8e/f91 822143 1 2023-12-07T16:21:57.300 INFO:tasks.workunit.client.0.smithi063.stdout:1/800: link d0/dd/d10/d13/d2f/fb1 d0/dd/d10/d1b/d68/db7/dda/f11a 0 2023-12-07T16:21:57.300 INFO:tasks.workunit.client.0.smithi063.stdout:1/801: readlink d0/dd/d19/d50/l87 0 2023-12-07T16:21:57.302 INFO:tasks.workunit.client.0.smithi063.stdout:2/937: symlink d0/d21/d56/d11/d52/da9/d124/d12b/l131 0 2023-12-07T16:21:57.303 INFO:tasks.workunit.client.0.smithi063.stdout:1/802: creat d0/dd/d1f/d75/f11b x:0 0 0 2023-12-07T16:21:57.303 INFO:tasks.workunit.client.0.smithi063.stdout:1/803: fsync d0/dd/d19/d50/d71/f7e 0 2023-12-07T16:21:57.304 INFO:tasks.workunit.client.0.smithi063.stdout:2/938: getdents d0/d21/d56/d11/d52 0 2023-12-07T16:21:57.306 INFO:tasks.workunit.client.0.smithi063.stdout:1/804: rename d0/dd/f6d to d0/dd/d10/d13/f11c 0 2023-12-07T16:21:57.308 INFO:tasks.workunit.client.0.smithi063.stdout:1/805: dread d0/dd/d10/d1b/f112 [0,4194304] 0 2023-12-07T16:21:57.311 INFO:tasks.workunit.client.0.smithi063.stdout:7/960: dwrite d2/d34/d5a/d5f/d78/d7c/d9b/faa [0,4194304] 0 2023-12-07T16:21:57.316 INFO:tasks.workunit.client.0.smithi063.stdout:7/961: unlink d2/d34/d5a/d5f/d6d/lc5 0 2023-12-07T16:21:57.318 INFO:tasks.workunit.client.0.smithi063.stdout:7/962: symlink d2/d2c/dbe/l158 0 2023-12-07T16:21:57.321 INFO:tasks.workunit.client.0.smithi063.stdout:7/963: rmdir d2/d96 39 2023-12-07T16:21:57.324 INFO:tasks.workunit.client.0.smithi063.stdout:7/964: mknod d2/d34/d46/d48/d70/daf/de8/c159 0 2023-12-07T16:21:57.324 INFO:tasks.workunit.client.0.smithi063.stdout:7/965: chown d2/d34/d5a/d5f/d61 1 1 2023-12-07T16:21:57.336 INFO:tasks.workunit.client.0.smithi063.stdout:7/966: truncate d2/d2c/fba 589733 0 2023-12-07T16:21:57.336 INFO:tasks.workunit.client.0.smithi063.stdout:2/939: dwrite d0/d21/d56/d11/d52/d5d/f5f [4194304,4194304] 0 2023-12-07T16:21:57.336 INFO:tasks.workunit.client.0.smithi063.stdout:1/806: dwrite d0/dd/d10/d1b/f67 [0,4194304] 0 2023-12-07T16:21:57.336 INFO:tasks.workunit.client.0.smithi063.stdout:1/807: write d0/dd/d10/d46/f58 [1571050,68175] 0 2023-12-07T16:21:57.340 INFO:tasks.workunit.client.0.smithi063.stdout:1/808: creat d0/dd/d10/d13/d2f/d79/f11d x:0 0 0 2023-12-07T16:21:57.340 INFO:tasks.workunit.client.0.smithi063.stdout:1/809: stat d0/dd/d19/lb4 0 2023-12-07T16:21:57.340 INFO:tasks.workunit.client.0.smithi063.stdout:1/810: write d0/dd/d55/dc9/f114 [128832,17912] 0 2023-12-07T16:21:57.341 INFO:tasks.workunit.client.0.smithi063.stdout:2/940: unlink d0/d21/f37 0 2023-12-07T16:21:57.343 INFO:tasks.workunit.client.0.smithi063.stdout:1/811: mkdir d0/dd/d55/d11e 0 2023-12-07T16:21:57.349 INFO:tasks.workunit.client.0.smithi063.stdout:1/812: write d0/dd/d10/f27 [4157793,38142] 0 2023-12-07T16:21:57.349 INFO:tasks.workunit.client.0.smithi063.stdout:7/967: dwrite d2/d34/d5a/d5f/d53/d9f/f12c [0,4194304] 0 2023-12-07T16:21:57.352 INFO:tasks.workunit.client.0.smithi063.stdout:7/968: creat d2/d34/d5a/d5f/d6d/f15a x:0 0 0 2023-12-07T16:21:57.353 INFO:tasks.workunit.client.0.smithi063.stdout:7/969: write d2/d37/de4/f149 [142996,94471] 0 2023-12-07T16:21:57.353 INFO:tasks.workunit.client.0.smithi063.stdout:1/813: dread d0/dd/d10/d1b/d68/fd2 [0,4194304] 0 2023-12-07T16:21:57.354 INFO:tasks.workunit.client.0.smithi063.stdout:7/970: rmdir d2/d34/d5a/d5f/d53/d9f/d139 39 2023-12-07T16:21:57.355 INFO:tasks.workunit.client.0.smithi063.stdout:1/814: creat d0/dd/d19/f11f x:0 0 0 2023-12-07T16:21:57.357 INFO:tasks.workunit.client.0.smithi063.stdout:1/815: rename d0/dd/d10/d13/d2f/fb1 to d0/dd/d55/f120 0 2023-12-07T16:21:57.358 INFO:tasks.workunit.client.0.smithi063.stdout:2/941: dwrite d0/d21/d56/d11/d52/d5d/dbb/f6e [0,4194304] 0 2023-12-07T16:21:57.363 INFO:tasks.workunit.client.0.smithi063.stdout:2/942: write d0/d67/f55 [2855041,119234] 0 2023-12-07T16:21:57.365 INFO:tasks.workunit.client.0.smithi063.stdout:2/943: creat d0/d67/d65/d6a/f132 x:0 0 0 2023-12-07T16:21:57.365 INFO:tasks.workunit.client.0.smithi063.stdout:2/944: chown d0/d67/d5b/l73 84 1 2023-12-07T16:21:57.365 INFO:tasks.workunit.client.0.smithi063.stdout:2/945: chown d0/fe6 1669661 1 2023-12-07T16:21:57.365 INFO:tasks.workunit.client.0.smithi063.stdout:2/946: write d0/f44 [2776176,34958] 0 2023-12-07T16:21:57.384 INFO:tasks.workunit.client.0.smithi063.stdout:1/816: dwrite d0/dd/d19/d50/d71/f64 [4194304,4194304] 0 2023-12-07T16:21:57.398 INFO:tasks.workunit.client.0.smithi063.stdout:7/971: dwrite d2/d34/d5a/d5f/f27 [4194304,4194304] 0 2023-12-07T16:21:57.442 INFO:tasks.workunit.client.0.smithi063.stdout:2/947: dwrite d0/d67/d65/d6a/d8e/ff7 [0,4194304] 0 2023-12-07T16:21:57.442 INFO:tasks.workunit.client.0.smithi063.stdout:2/948: fsync d0/d21/d56/d11/dc0/f122 0 2023-12-07T16:21:57.442 INFO:tasks.workunit.client.0.smithi063.stdout:1/817: dwrite d0/dd/d19/d50/d72/de9/f108 [0,4194304] 0 2023-12-07T16:21:57.442 INFO:tasks.workunit.client.0.smithi063.stdout:1/818: write d0/dd/d10/d13/ff1 [283688,130209] 0 2023-12-07T16:21:57.451 INFO:tasks.workunit.client.0.smithi063.stdout:2/949: dread d0/d21/d56/d11/d52/d5d/dbb/fb1 [0,4194304] 0 2023-12-07T16:21:57.453 INFO:tasks.workunit.client.0.smithi063.stdout:2/950: symlink d0/d21/d56/d11/l133 0 2023-12-07T16:21:57.453 INFO:tasks.workunit.client.0.smithi063.stdout:2/951: chown d0/d21/d56/d11/f1b 972 1 2023-12-07T16:21:57.454 INFO:tasks.workunit.client.0.smithi063.stdout:2/952: write d0/d67/d65/d6a/d8e/f91 [3137126,81396] 0 2023-12-07T16:21:57.454 INFO:tasks.workunit.client.0.smithi063.stdout:2/953: write d0/d21/d56/d71/f130 [446077,79968] 0 2023-12-07T16:21:57.456 INFO:tasks.workunit.client.0.smithi063.stdout:7/972: dwrite d2/d2c/f75 [0,4194304] 0 2023-12-07T16:21:57.460 INFO:tasks.workunit.client.0.smithi063.stdout:2/954: link d0/d21/d56/fd5 d0/d21/f134 0 2023-12-07T16:21:57.461 INFO:tasks.workunit.client.0.smithi063.stdout:7/973: rmdir d2/d34/d5a/d5f/d78/d7c/d9b 39 2023-12-07T16:21:57.461 INFO:tasks.workunit.client.0.smithi063.stdout:7/974: chown d2/d34/d5a/d5f/d78 201662555 1 2023-12-07T16:21:57.461 INFO:tasks.workunit.client.0.smithi063.stdout:1/819: dread d0/f1 [0,4194304] 0 2023-12-07T16:21:57.462 INFO:tasks.workunit.client.0.smithi063.stdout:2/955: rmdir d0/d21/d56/d11/db0/d106 39 2023-12-07T16:21:57.464 INFO:tasks.workunit.client.0.smithi063.stdout:7/975: rmdir d2/d34/d5a/d5f/d6d 39 2023-12-07T16:21:57.469 INFO:tasks.workunit.client.0.smithi063.stdout:7/976: mkdir d2/d34/d46/d48/d103/d15b 0 2023-12-07T16:21:57.471 INFO:tasks.workunit.client.0.smithi063.stdout:7/977: mkdir d2/d34/d46/d48/d56/d113/d15c 0 2023-12-07T16:21:57.472 INFO:tasks.workunit.client.0.smithi063.stdout:7/978: read d2/d34/d5a/d5f/d53/d9f/f12c [34657,30974] 0 2023-12-07T16:21:57.486 INFO:tasks.workunit.client.0.smithi063.stdout:2/956: dwrite d0/d21/d56/d11/d52/d5d/fe8 [0,4194304] 0 2023-12-07T16:21:57.490 INFO:tasks.workunit.client.0.smithi063.stdout:2/957: rmdir d0/d67/d5b/db3 39 2023-12-07T16:21:57.492 INFO:tasks.workunit.client.0.smithi063.stdout:2/958: creat d0/d21/d56/d11/d52/d5d/dbb/f135 x:0 0 0 2023-12-07T16:21:57.494 INFO:tasks.workunit.client.0.smithi063.stdout:2/959: creat d0/d21/d56/d11/d52/da9/d115/f136 x:0 0 0 2023-12-07T16:21:57.494 INFO:tasks.workunit.client.0.smithi063.stdout:2/960: write d0/d21/d56/d11/d52/da9/dbe/fb7 [51071,100191] 0 2023-12-07T16:21:57.494 INFO:tasks.workunit.client.0.smithi063.stdout:2/961: chown d0/d10f/c11b 81168 1 2023-12-07T16:21:57.495 INFO:tasks.workunit.client.0.smithi063.stdout:2/962: creat d0/d21/d56/d11/db0/d106/d116/f137 x:0 0 0 2023-12-07T16:21:57.495 INFO:tasks.workunit.client.0.smithi063.stdout:2/963: chown d0/d21/d56/d11/d52/da9/dbe/f29 15197 1 2023-12-07T16:21:57.496 INFO:tasks.workunit.client.0.smithi063.stdout:2/964: mknod d0/d21/d56/d11/d52/da9/d124/d12b/c138 0 2023-12-07T16:21:57.497 INFO:tasks.workunit.client.0.smithi063.stdout:1/820: dwrite d0/dd/d10/d1b/fca [4194304,4194304] 0 2023-12-07T16:21:57.497 INFO:tasks.workunit.client.0.smithi063.stdout:1/821: truncate d0/dd/d10/d1b/f112 784243 0 2023-12-07T16:21:57.497 INFO:tasks.workunit.client.0.smithi063.stdout:1/822: stat d0/dd/d10/d6f/f7a 0 2023-12-07T16:21:57.497 INFO:tasks.workunit.client.0.smithi063.stdout:7/979: dwrite d2/d34/fa7 [0,4194304] 0 2023-12-07T16:21:57.497 INFO:tasks.workunit.client.0.smithi063.stdout:7/980: read - d2/d34/d5a/d5f/d53/dab/fd8 zero size 2023-12-07T16:21:57.498 INFO:tasks.workunit.client.0.smithi063.stdout:2/965: creat d0/d21/d56/d11/d52/da9/d115/f139 x:0 0 0 2023-12-07T16:21:57.499 INFO:tasks.workunit.client.0.smithi063.stdout:1/823: link d0/d47/c48 d0/dd/d19/c121 0 2023-12-07T16:21:57.501 INFO:tasks.workunit.client.0.smithi063.stdout:7/981: creat d2/d2c/f15d x:0 0 0 2023-12-07T16:21:57.503 INFO:tasks.workunit.client.0.smithi063.stdout:2/966: rename d0/d21/db2/l100 to d0/d21/d56/d11/db0/d106/d116/l13a 0 2023-12-07T16:21:57.505 INFO:tasks.workunit.client.0.smithi063.stdout:2/967: write d0/d21/d39/fcf [3318017,26005] 0 2023-12-07T16:21:57.505 INFO:tasks.workunit.client.0.smithi063.stdout:2/968: write d0/d21/d56/d11/d6d/fd8 [130529,28153] 0 2023-12-07T16:21:57.505 INFO:tasks.workunit.client.0.smithi063.stdout:2/969: truncate d0/d21/db2/dce/ffc 743660 0 2023-12-07T16:21:57.505 INFO:tasks.workunit.client.0.smithi063.stdout:2/970: chown d0/d21/d56/d11/d52/da9/d124/d12b/c138 1605284 1 2023-12-07T16:21:57.505 INFO:tasks.workunit.client.0.smithi063.stdout:2/971: truncate d0/d21/d56/fd5 314350 0 2023-12-07T16:21:57.505 INFO:tasks.workunit.client.0.smithi063.stdout:1/824: write d0/dd/d10/f93 [2846001,36779] 0 2023-12-07T16:21:57.510 INFO:tasks.workunit.client.0.smithi063.stdout:2/972: symlink d0/d21/d56/d11/d52/d5d/l13b 0 2023-12-07T16:21:57.513 INFO:tasks.workunit.client.0.smithi063.stdout:7/982: dread d2/d34/d5a/d5f/d6d/f72 [0,4194304] 0 2023-12-07T16:21:57.515 INFO:tasks.workunit.client.0.smithi063.stdout:7/983: rename d2/d34/d46/d48/d70/daf/de8/fee to d2/d64/f15e 0 2023-12-07T16:21:57.516 INFO:tasks.workunit.client.0.smithi063.stdout:2/973: write d0/d67/d65/d6a/d8e/f91 [3342871,13582] 0 2023-12-07T16:21:57.517 INFO:tasks.workunit.client.0.smithi063.stdout:7/984: write d2/d2c/fa9 [3762257,76800] 0 2023-12-07T16:21:57.517 INFO:tasks.workunit.client.0.smithi063.stdout:7/985: read - d2/d2c/dbe/f12b zero size 2023-12-07T16:21:57.517 INFO:tasks.workunit.client.0.smithi063.stdout:7/986: chown d2/d21/d11e 1 1 2023-12-07T16:21:57.524 INFO:tasks.workunit.client.0.smithi063.stdout:2/974: truncate d0/d21/f69 1476138 0 2023-12-07T16:21:57.526 INFO:tasks.workunit.client.0.smithi063.stdout:7/987: creat d2/d21/dc6/f15f x:0 0 0 2023-12-07T16:21:57.528 INFO:tasks.workunit.client.0.smithi063.stdout:2/975: rename d0/d21/d56/d11/d52/d5d/fe8 to d0/d21/d56/d11/db0/d106/d116/f13c 0 2023-12-07T16:21:57.530 INFO:tasks.workunit.client.0.smithi063.stdout:7/988: symlink d2/d34/d5a/d5f/d53/da3/l160 0 2023-12-07T16:21:57.530 INFO:tasks.workunit.client.0.smithi063.stdout:7/989: write d2/d34/d46/f129 [702152,62027] 0 2023-12-07T16:21:57.531 INFO:tasks.workunit.client.0.smithi063.stdout:2/976: mkdir d0/d67/d13d 0 2023-12-07T16:21:57.533 INFO:tasks.workunit.client.0.smithi063.stdout:7/990: creat d2/d34/d46/d48/d56/f161 x:0 0 0 2023-12-07T16:21:57.533 INFO:tasks.workunit.client.0.smithi063.stdout:7/991: fdatasync d2/f118 0 2023-12-07T16:21:57.533 INFO:tasks.workunit.client.0.smithi063.stdout:7/992: write d2/d34/d5a/d5f/d53/f91 [680290,6488] 0 2023-12-07T16:21:57.533 INFO:tasks.workunit.client.0.smithi063.stdout:2/977: getdents d0 0 2023-12-07T16:21:57.540 INFO:tasks.workunit.client.0.smithi063.stdout:7/993: mknod d2/d34/d46/d48/d70/daf/dd6/c162 0 2023-12-07T16:21:57.540 INFO:tasks.workunit.client.0.smithi063.stdout:2/978: mknod d0/d21/d56/d11/db0/d106/d116/c13e 0 2023-12-07T16:21:57.540 INFO:tasks.workunit.client.0.smithi063.stdout:7/994: chown d2/d64/l6b 247201 1 2023-12-07T16:21:57.541 INFO:tasks.workunit.client.0.smithi063.stdout:7/995: dread - d2/d34/d46/d48/d56/d113/f133 zero size 2023-12-07T16:21:57.542 INFO:tasks.workunit.client.0.smithi063.stdout:2/979: creat d0/f13f x:0 0 0 2023-12-07T16:21:57.543 INFO:tasks.workunit.client.0.smithi063.stdout:2/980: dread d0/fe6 [0,4194304] 0 2023-12-07T16:21:57.565 INFO:tasks.workunit.client.0.smithi063.stdout:7/996: dwrite d2/d34/d5a/d5f/d53/d9f/d139/f13b [4194304,4194304] 0 2023-12-07T16:21:57.566 INFO:tasks.workunit.client.0.smithi063.stdout:7/997: readlink d2/d34/d5a/d5f/d53/ded/l155 0 2023-12-07T16:21:57.576 INFO:tasks.workunit.client.0.smithi063.stdout:7/998: link d2/d34/d5a/d5f/d78/d7c/d9b/cf2 d2/d34/d46/d48/d56/c163 0 2023-12-07T16:21:57.576 INFO:tasks.workunit.client.0.smithi063.stdout:2/981: dwrite d0/d21/d56/d11/d52/dad/fdc [0,4194304] 0 2023-12-07T16:21:57.580 INFO:tasks.workunit.client.0.smithi063.stdout:2/982: link d0/d21/d56/d11/d52/da9/ffd d0/d21/d56/d11/f140 0 2023-12-07T16:21:57.582 INFO:tasks.workunit.client.0.smithi063.stdout:2/983: mknod d0/d21/db2/c141 0 2023-12-07T16:21:57.584 INFO:tasks.workunit.client.0.smithi063.stdout:2/984: getdents d0/d21/d56/d11/d52/d63/d8c/db9/dd2 0 2023-12-07T16:21:57.604 INFO:tasks.workunit.client.0.smithi063.stdout:2/985: dwrite d0/d21/f134 [0,4194304] 0 2023-12-07T16:21:57.605 INFO:tasks.workunit.client.0.smithi063.stdout:2/986: write d0/f16 [2873102,59388] 0 2023-12-07T16:21:57.608 INFO:tasks.workunit.client.0.smithi063.stdout:2/987: symlink d0/d21/d56/d11/d52/d63/df3/l142 0 2023-12-07T16:21:57.611 INFO:tasks.workunit.client.0.smithi063.stdout:2/988: link d0/d21/d56/d11/d52/d63/d8c/fa3 d0/d21/d56/d11/d52/da9/f143 0 2023-12-07T16:21:57.613 INFO:tasks.workunit.client.0.smithi063.stdout:2/989: mknod d0/d21/d56/d11/d52/d63/d8c/db9/c144 0 2023-12-07T16:21:57.613 INFO:tasks.workunit.client.0.smithi063.stdout:2/990: stat d0/d67/d65/d6a/c8a 0 2023-12-07T16:21:57.615 INFO:tasks.workunit.client.0.smithi063.stdout:2/991: dread d0/d67/d65/f96 [4194304,4194304] 0 2023-12-07T16:21:57.630 INFO:tasks.workunit.client.0.smithi063.stdout:2/992: dwrite d0/d21/d56/d11/f94 [0,4194304] 0 2023-12-07T16:21:57.630 INFO:tasks.workunit.client.0.smithi063.stdout:2/993: readlink d0/d67/d65/d6a/la8 0 2023-12-07T16:21:57.632 INFO:tasks.workunit.client.0.smithi063.stdout:2/994: mknod d0/d67/d13d/c145 0 2023-12-07T16:21:57.634 INFO:tasks.workunit.client.0.smithi063.stdout:2/995: mkdir d0/d21/d56/d11/dc0/d146 0 2023-12-07T16:21:57.637 INFO:tasks.workunit.client.0.smithi063.stdout:2/996: unlink d0/d21/c9d 0 2023-12-07T16:21:57.639 INFO:tasks.workunit.client.0.smithi063.stdout:2/997: mknod d0/d21/d39/d117/c147 0 2023-12-07T16:21:57.640 INFO:tasks.workunit.client.0.smithi063.stdout:2/998: write d0/d67/d65/d6a/d8e/ff0 [159269,117690] 0 2023-12-07T16:21:57.641 INFO:tasks.workunit.client.0.smithi063.stdout:2/999: truncate d0/d21/d56/d11/f1b 774627 0 2023-12-07T16:21:58.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: mgrmap e26: smithi152.sxayfb(active, since 66s), standbys: smithi063.yohyyx 2023-12-07T16:21:58.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:21:58.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mgr fail", "who": "smithi152.sxayfb"}]: dispatch 2023-12-07T16:21:58.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mgr fail", "who": "smithi152.sxayfb"}]: dispatch 2023-12-07T16:21:58.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: osdmap e48: 6 total, 6 up, 6 in 2023-12-07T16:21:58.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' cmd='[{"prefix": "mgr fail", "who": "smithi152.sxayfb"}]': finished 2023-12-07T16:21:58.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: mgrmap e27: smithi063.yohyyx(active, starting, since 0.00753703s) 2023-12-07T16:21:58.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-07T16:21:58.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:21:58.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.yidolg"}]: dispatch 2023-12-07T16:21:58.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.gsjgcq"}]: dispatch 2023-12-07T16:21:58.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.mrvngf"}]: dispatch 2023-12-07T16:21:58.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.aovwwd"}]: dispatch 2023-12-07T16:21:58.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr metadata", "who": "smithi063.yohyyx", "id": "smithi063.yohyyx"}]: dispatch 2023-12-07T16:21:58.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-07T16:21:58.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-07T16:21:58.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T16:21:58.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T16:21:58.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-07T16:21:58.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-07T16:21:58.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-07T16:21:58.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-07T16:21:58.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-07T16:21:58.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: Manager daemon smithi063.yohyyx is now available 2023-12-07T16:21:58.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:21:58.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:21:58.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:21:58.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.yohyyx/mirror_snapshot_schedule"}]: dispatch 2023-12-07T16:21:58.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:57 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.yohyyx/trash_purge_schedule"}]: dispatch 2023-12-07T16:21:58.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: mgrmap e26: smithi152.sxayfb(active, since 66s), standbys: smithi063.yohyyx 2023-12-07T16:21:58.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:21:58.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.14614 172.21.15.152:0/3624139459' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mgr fail", "who": "smithi152.sxayfb"}]: dispatch 2023-12-07T16:21:58.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "mgr fail", "who": "smithi152.sxayfb"}]: dispatch 2023-12-07T16:21:58.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: osdmap e48: 6 total, 6 up, 6 in 2023-12-07T16:21:58.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.14614 ' entity='mgr.smithi152.sxayfb' cmd='[{"prefix": "mgr fail", "who": "smithi152.sxayfb"}]': finished 2023-12-07T16:21:58.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: mgrmap e27: smithi063.yohyyx(active, starting, since 0.00753703s) 2023-12-07T16:21:58.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-07T16:21:58.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:21:58.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.yidolg"}]: dispatch 2023-12-07T16:21:58.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.gsjgcq"}]: dispatch 2023-12-07T16:21:58.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.mrvngf"}]: dispatch 2023-12-07T16:21:58.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.aovwwd"}]: dispatch 2023-12-07T16:21:58.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr metadata", "who": "smithi063.yohyyx", "id": "smithi063.yohyyx"}]: dispatch 2023-12-07T16:21:58.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-07T16:21:58.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-07T16:21:58.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T16:21:58.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T16:21:58.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-07T16:21:58.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-07T16:21:58.408 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-07T16:21:58.408 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-07T16:21:58.408 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-07T16:21:58.408 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: Manager daemon smithi063.yohyyx is now available 2023-12-07T16:21:58.408 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:21:58.408 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:21:58.408 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:21:58.408 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.yohyyx/mirror_snapshot_schedule"}]: dispatch 2023-12-07T16:21:58.408 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:57 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.yohyyx/trash_purge_schedule"}]: dispatch 2023-12-07T16:21:58.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.573+0000 7f3629d15700 1 -- 172.21.15.63:0/2304034598 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36240ffd70 msgr2=0x7f36241021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:58.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.573+0000 7f3629d15700 1 --2- 172.21.15.63:0/2304034598 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36240ffd70 0x7f36241021d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3618004940 tx=0x7f3618009e30 comp rx=0 tx=0).stop 2023-12-07T16:21:58.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.573+0000 7f3629d15700 1 -- 172.21.15.63:0/2304034598 shutdown_connections 2023-12-07T16:21:58.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.573+0000 7f3629d15700 1 --2- 172.21.15.63:0/2304034598 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36240ffd70 0x7f36241021d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:58.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.573+0000 7f3629d15700 1 --2- 172.21.15.63:0/2304034598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3624066090 0x7f36240ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:58.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.573+0000 7f3629d15700 1 -- 172.21.15.63:0/2304034598 >> 172.21.15.63:0/2304034598 conn(0x7f36240f7190 msgr2=0x7f36240f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:21:58.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.573+0000 7f3629d15700 1 -- 172.21.15.63:0/2304034598 shutdown_connections 2023-12-07T16:21:58.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.573+0000 7f3629d15700 1 -- 172.21.15.63:0/2304034598 wait complete. 2023-12-07T16:21:58.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.574+0000 7f3629d15700 1 Processor -- start 2023-12-07T16:21:58.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.574+0000 7f3629d15700 1 -- start start 2023-12-07T16:21:58.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.574+0000 7f3629d15700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3624066090 0x7f362410d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:58.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.574+0000 7f3629d15700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36240ffd70 0x7f362410da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:58.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.574+0000 7f3629d15700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362410e020 con 0x7f36240ffd70 2023-12-07T16:21:58.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.574+0000 7f3629d15700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362410e8c0 con 0x7f3624066090 2023-12-07T16:21:58.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.574+0000 7f3622ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36240ffd70 0x7f362410da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:58.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.575+0000 7f3622ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36240ffd70 0x7f362410da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48832/0 (socket says 172.21.15.63:48832) 2023-12-07T16:21:58.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.575+0000 7f3622ffd700 1 -- 172.21.15.63:0/3180544851 learned_addr learned my addr 172.21.15.63:0/3180544851 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:21:58.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.575+0000 7f36237fe700 1 --2- 172.21.15.63:0/3180544851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3624066090 0x7f362410d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:58.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.575+0000 7f3622ffd700 1 -- 172.21.15.63:0/3180544851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3624066090 msgr2=0x7f362410d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:58.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.575+0000 7f3622ffd700 1 --2- 172.21.15.63:0/3180544851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3624066090 0x7f362410d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:58.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.575+0000 7f3622ffd700 1 -- 172.21.15.63:0/3180544851 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3618005040 con 0x7f36240ffd70 2023-12-07T16:21:58.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.575+0000 7f36237fe700 1 --2- 172.21.15.63:0/3180544851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3624066090 0x7f362410d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T16:21:58.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.575+0000 7f3622ffd700 1 --2- 172.21.15.63:0/3180544851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36240ffd70 0x7f362410da20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3618000c00 tx=0x7f3618009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:21:58.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.575+0000 7f360bfff700 1 -- 172.21.15.63:0/3180544851 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3618021070 con 0x7f36240ffd70 2023-12-07T16:21:58.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.575+0000 7f360bfff700 1 -- 172.21.15.63:0/3180544851 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f361801c400 con 0x7f36240ffd70 2023-12-07T16:21:58.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.575+0000 7f3629d15700 1 -- 172.21.15.63:0/3180544851 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f362410eb40 con 0x7f36240ffd70 2023-12-07T16:21:58.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.575+0000 7f360bfff700 1 -- 172.21.15.63:0/3180544851 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f361800e070 con 0x7f36240ffd70 2023-12-07T16:21:58.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.575+0000 7f3629d15700 1 -- 172.21.15.63:0/3180544851 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362410f020 con 0x7f36240ffd70 2023-12-07T16:21:58.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.576+0000 7f360bfff700 1 -- 172.21.15.63:0/3180544851 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 28) v1 ==== 45377+0+0 (secure 0 0 0) 0x7f361800b760 con 0x7f36240ffd70 2023-12-07T16:21:58.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.576+0000 7f360bfff700 1 --2- 172.21.15.63:0/3180544851 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f360c038350 0x7f360c03a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:58.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.576+0000 7f3629d15700 1 -- 172.21.15.63:0/3180544851 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f362404bb80 con 0x7f36240ffd70 2023-12-07T16:21:58.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.576+0000 7f360bfff700 1 -- 172.21.15.63:0/3180544851 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f361804cde0 con 0x7f36240ffd70 2023-12-07T16:21:58.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.577+0000 7f36237fe700 1 --2- 172.21.15.63:0/3180544851 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f360c038350 0x7f360c03a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:58.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.577+0000 7f36237fe700 1 --2- 172.21.15.63:0/3180544851 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f360c038350 0x7f360c03a800 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3614009b80 tx=0x7f361400b040 comp rx=0 tx=0).ready entity=mgr.24453 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:21:58.580 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.582+0000 7f360bfff700 1 -- 172.21.15.63:0/3180544851 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f3618024310 con 0x7f36240ffd70 2023-12-07T16:21:58.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.828+0000 7f3629d15700 1 -- 172.21.15.63:0/3180544851 --> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f362410f480 con 0x7f360c038350 2023-12-07T16:21:58.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.830+0000 7f360bfff700 1 -- 172.21.15.63:0/3180544851 <== mgr.24453 v2:172.21.15.63:6800/2671097541 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f362410f480 con 0x7f360c038350 2023-12-07T16:21:58.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.832+0000 7f3629d15700 1 -- 172.21.15.63:0/3180544851 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f360c038350 msgr2=0x7f360c03a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:58.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.832+0000 7f3629d15700 1 --2- 172.21.15.63:0/3180544851 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f360c038350 0x7f360c03a800 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3614009b80 tx=0x7f361400b040 comp rx=0 tx=0).stop 2023-12-07T16:21:58.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.832+0000 7f3629d15700 1 -- 172.21.15.63:0/3180544851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36240ffd70 msgr2=0x7f362410da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:58.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.832+0000 7f3629d15700 1 --2- 172.21.15.63:0/3180544851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36240ffd70 0x7f362410da20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3618000c00 tx=0x7f3618009e30 comp rx=0 tx=0).stop 2023-12-07T16:21:58.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.834+0000 7f3629d15700 1 -- 172.21.15.63:0/3180544851 shutdown_connections 2023-12-07T16:21:58.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.834+0000 7f3629d15700 1 --2- 172.21.15.63:0/3180544851 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f360c038350 0x7f360c03a800 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:58.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.834+0000 7f3629d15700 1 --2- 172.21.15.63:0/3180544851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3624066090 0x7f362410d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:58.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.834+0000 7f3629d15700 1 --2- 172.21.15.63:0/3180544851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36240ffd70 0x7f362410da20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:58.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.834+0000 7f3629d15700 1 -- 172.21.15.63:0/3180544851 >> 172.21.15.63:0/3180544851 conn(0x7f36240f7190 msgr2=0x7f36240f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:21:58.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.834+0000 7f3629d15700 1 -- 172.21.15.63:0/3180544851 shutdown_connections 2023-12-07T16:21:58.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.834+0000 7f3629d15700 1 -- 172.21.15.63:0/3180544851 wait complete. 2023-12-07T16:21:58.843 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-07T16:21:58.908 INFO:tasks.workunit.client.0.smithi063.stdout:1/825: sync 2023-12-07T16:21:58.935 INFO:tasks.workunit.client.0.smithi063.stdout:1/826: dwrite d0/dd/d10/d13/d2f/d79/f7d [0,4194304] 0 2023-12-07T16:21:58.962 INFO:tasks.workunit.client.0.smithi063.stdout:1/827: dwrite d0/dd/d19/d50/d71/f52 [0,4194304] 0 2023-12-07T16:21:58.964 INFO:tasks.workunit.client.0.smithi063.stdout:1/828: creat d0/dd/d10/d13/d2f/d79/f122 x:0 0 0 2023-12-07T16:21:58.990 INFO:tasks.workunit.client.0.smithi063.stdout:1/829: dwrite d0/dd/d10/d13/d2f/d79/f8e [0,4194304] 0 2023-12-07T16:21:58.991 INFO:tasks.workunit.client.0.smithi063.stdout:1/830: creat d0/dd/d10/d13/d2f/f123 x:0 0 0 2023-12-07T16:21:58.993 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.993+0000 7efd98634700 1 -- 172.21.15.63:0/150993954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd90070570 msgr2=0x7efd900709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:58.994 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.993+0000 7efd98634700 1 --2- 172.21.15.63:0/150993954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd90070570 0x7efd900709c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efd8c004940 tx=0x7efd8c009e30 comp rx=0 tx=0).stop 2023-12-07T16:21:58.994 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.993+0000 7efd98634700 1 -- 172.21.15.63:0/150993954 shutdown_connections 2023-12-07T16:21:58.994 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.993+0000 7efd98634700 1 --2- 172.21.15.63:0/150993954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd90070570 0x7efd900709c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:58.994 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.993+0000 7efd98634700 1 --2- 172.21.15.63:0/150993954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd90071bc0 0x7efd90070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:58.994 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.993+0000 7efd98634700 1 -- 172.21.15.63:0/150993954 >> 172.21.15.63:0/150993954 conn(0x7efd900f82d0 msgr2=0x7efd900fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:21:58.994 INFO:tasks.workunit.client.0.smithi063.stdout:1/831: mkdir d0/dd/d10/d6f/d124 0 2023-12-07T16:21:58.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.995+0000 7efd98634700 1 -- 172.21.15.63:0/150993954 shutdown_connections 2023-12-07T16:21:58.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.995+0000 7efd98634700 1 -- 172.21.15.63:0/150993954 wait complete. 2023-12-07T16:21:58.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.996+0000 7efd98634700 1 Processor -- start 2023-12-07T16:21:58.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.996+0000 7efd98634700 1 -- start start 2023-12-07T16:21:58.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.996+0000 7efd98634700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd90070570 0x7efd90113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:58.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.996+0000 7efd98634700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd90071bc0 0x7efd90114060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:58.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.996+0000 7efd98634700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd901146f0 con 0x7efd90071bc0 2023-12-07T16:21:58.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.996+0000 7efd98634700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd90114f30 con 0x7efd90070570 2023-12-07T16:21:58.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.997+0000 7efd963d0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd90070570 0x7efd90113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:58.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.997+0000 7efd963d0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd90070570 0x7efd90113b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.63:33672/0 (socket says 172.21.15.63:33672) 2023-12-07T16:21:58.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.997+0000 7efd963d0700 1 -- 172.21.15.63:0/3137954931 learned_addr learned my addr 172.21.15.63:0/3137954931 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:21:58.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.997+0000 7efd95bcf700 1 --2- 172.21.15.63:0/3137954931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd90071bc0 0x7efd90114060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:58.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.997+0000 7efd963d0700 1 -- 172.21.15.63:0/3137954931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd90071bc0 msgr2=0x7efd90114060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:58.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.997+0000 7efd963d0700 1 --2- 172.21.15.63:0/3137954931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd90071bc0 0x7efd90114060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:58.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.997+0000 7efd963d0700 1 -- 172.21.15.63:0/3137954931 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8c005040 con 0x7efd90070570 2023-12-07T16:21:58.998 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.997+0000 7efd963d0700 1 --2- 172.21.15.63:0/3137954931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd90070570 0x7efd90113b20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efd8000b790 tx=0x7efd80009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:21:58.998 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.998+0000 7efd86ffd700 1 -- 172.21.15.63:0/3137954931 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd8000f6f0 con 0x7efd90070570 2023-12-07T16:21:58.998 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.998+0000 7efd86ffd700 1 -- 172.21.15.63:0/3137954931 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efd8000fd00 con 0x7efd90070570 2023-12-07T16:21:58.998 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.998+0000 7efd86ffd700 1 -- 172.21.15.63:0/3137954931 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd800103a0 con 0x7efd90070570 2023-12-07T16:21:58.999 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.998+0000 7efd98634700 1 -- 172.21.15.63:0/3137954931 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd90115210 con 0x7efd90070570 2023-12-07T16:21:58.999 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:58.999+0000 7efd98634700 1 -- 172.21.15.63:0/3137954931 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd90115720 con 0x7efd90070570 2023-12-07T16:21:58.999 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.000+0000 7efd98634700 1 -- 172.21.15.63:0/3137954931 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd9004bb80 con 0x7efd90070570 2023-12-07T16:21:59.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.000+0000 7efd86ffd700 1 -- 172.21.15.63:0/3137954931 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 28) v1 ==== 45377+0+0 (secure 0 0 0) 0x7efd8000f850 con 0x7efd90070570 2023-12-07T16:21:59.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.000+0000 7efd86ffd700 1 --2- 172.21.15.63:0/3137954931 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7efd7c038350 0x7efd7c03a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:59.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.000+0000 7efd86ffd700 1 -- 172.21.15.63:0/3137954931 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7efd8004b470 con 0x7efd90070570 2023-12-07T16:21:59.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.000+0000 7efd95bcf700 1 --2- 172.21.15.63:0/3137954931 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7efd7c038350 0x7efd7c03a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:59.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.001+0000 7efd95bcf700 1 --2- 172.21.15.63:0/3137954931 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7efd7c038350 0x7efd7c03a800 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efd8c00b3b0 tx=0x7efd8c009e30 comp rx=0 tx=0).ready entity=mgr.24453 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:21:59.006 INFO:tasks.workunit.client.0.smithi063.stdout:1/832: dread d0/dd/d10/d1b/f67 [0,4194304] 0 2023-12-07T16:21:59.007 INFO:tasks.workunit.client.0.smithi063.stdout:1/833: rmdir d0/dd/d10/d1b/d68/db7/dda/dd5 39 2023-12-07T16:21:59.007 INFO:tasks.workunit.client.0.smithi063.stdout:1/834: readlink d0/dd/d1f/l119 0 2023-12-07T16:21:59.007 INFO:tasks.workunit.client.0.smithi063.stdout:1/835: readlink d0/dd/d4f/lef 0 2023-12-07T16:21:59.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.009+0000 7efd86ffd700 1 -- 172.21.15.63:0/3137954931 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7efd8000d290 con 0x7efd90070570 2023-12-07T16:21:59.009 INFO:tasks.workunit.client.0.smithi063.stdout:1/836: symlink d0/dd/d1f/d75/l125 0 2023-12-07T16:21:59.012 INFO:tasks.workunit.client.0.smithi063.stdout:1/837: symlink d0/dd/d10/d6f/da0/l126 0 2023-12-07T16:21:59.012 INFO:tasks.workunit.client.0.smithi063.stdout:1/838: read - d0/dd/d1f/f94 zero size 2023-12-07T16:21:59.025 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:59 smithi063 ceph-mon[112095]: mgrmap e28: smithi063.yohyyx(active, since 1.01025s) 2023-12-07T16:21:59.025 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:21:59 smithi063 ceph-mon[112095]: pgmap v3: 65 pgs: 65 active+clean; 2.5 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail 2023-12-07T16:21:59.033 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.033+0000 7efd86ffd700 1 -- 172.21.15.63:0/3137954931 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mgrmap(e 29) v1 ==== 45671+0+0 (secure 0 0 0) 0x7efd80010a20 con 0x7efd90070570 2023-12-07T16:21:59.042 INFO:tasks.workunit.client.0.smithi063.stdout:1/839: dread d0/dd/d10/d1b/fca [0,4194304] 0 2023-12-07T16:21:59.042 INFO:tasks.workunit.client.0.smithi063.stdout:1/840: dread - d0/dd/d55/f10a zero size 2023-12-07T16:21:59.076 INFO:tasks.workunit.client.0.smithi063.stdout:1/841: dwrite d0/dd/d10/d6f/da0/fe6 [0,4194304] 0 2023-12-07T16:21:59.076 INFO:tasks.workunit.client.0.smithi063.stdout:1/842: write d0/dd/d1f/d75/f11b [569346,36030] 0 2023-12-07T16:21:59.080 INFO:tasks.workunit.client.0.smithi063.stdout:1/843: getdents d0/dd/d10/d13/d2f/d79 0 2023-12-07T16:21:59.081 INFO:tasks.workunit.client.0.smithi063.stdout:1/844: rename d0/dd/d10/c78 to d0/dd/d19/d50/d71/d9b/c127 0 2023-12-07T16:21:59.082 INFO:tasks.workunit.client.0.smithi063.stdout:7/999: sync 2023-12-07T16:21:59.083 INFO:tasks.workunit.client.0.smithi063.stdout:4/713: sync 2023-12-07T16:21:59.109 INFO:tasks.workunit.client.0.smithi063.stdout:4/714: dwrite d1/dc6/fcd [0,4194304] 0 2023-12-07T16:21:59.109 INFO:tasks.workunit.client.0.smithi063.stdout:1/845: dwrite d0/dd/d10/d1b/d68/db7/dda/f101 [0,4194304] 0 2023-12-07T16:21:59.110 INFO:tasks.workunit.client.0.smithi063.stdout:4/715: symlink d1/d3/d51/ld5 0 2023-12-07T16:21:59.110 INFO:tasks.workunit.client.0.smithi063.stdout:1/846: dread d0/dd/d19/d50/d71/f5a [0,4194304] 0 2023-12-07T16:21:59.110 INFO:tasks.workunit.client.0.smithi063.stdout:1/847: rmdir d0/dd/d10/d46 39 2023-12-07T16:21:59.110 INFO:tasks.workunit.client.0.smithi063.stdout:1/848: fsync d0/dd/d19/d50/fc7 0 2023-12-07T16:21:59.110 INFO:tasks.workunit.client.0.smithi063.stdout:1/849: dread - d0/dd/d10/d13/d2f/d79/f122 zero size 2023-12-07T16:21:59.111 INFO:tasks.workunit.client.0.smithi063.stdout:1/850: creat d0/dd/d10/d6f/dd8/d10f/f128 x:0 0 0 2023-12-07T16:21:59.114 INFO:tasks.workunit.client.0.smithi063.stdout:1/851: rename d0/d47/l110 to d0/dd/d19/d50/d71/l129 0 2023-12-07T16:21:59.119 INFO:tasks.workunit.client.0.smithi063.stdout:1/852: read d0/dd/d10/d1b/d68/f95 [1871178,49137] 0 2023-12-07T16:21:59.120 INFO:tasks.workunit.client.0.smithi063.stdout:1/853: creat d0/dd/d10/d1b/d68/f12a x:0 0 0 2023-12-07T16:21:59.121 INFO:tasks.workunit.client.0.smithi063.stdout:1/854: dread - d0/dd/d55/f10a zero size 2023-12-07T16:21:59.121 INFO:tasks.workunit.client.0.smithi063.stdout:1/855: dread - d0/dd/d19/f11f zero size 2023-12-07T16:21:59.121 INFO:tasks.workunit.client.0.smithi063.stdout:4/716: dwrite d1/d3/db/d2c/d63/f48 [0,4194304] 0 2023-12-07T16:21:59.122 INFO:tasks.workunit.client.0.smithi063.stdout:1/856: rename d0/dd/d10/d1b/d68/db7 to d0/dd/d19/d50/d12b 0 2023-12-07T16:21:59.122 INFO:tasks.workunit.client.0.smithi063.stdout:1/857: read d0/dd/d10/d13/ff1 [347834,124334] 0 2023-12-07T16:21:59.125 INFO:tasks.workunit.client.0.smithi063.stdout:4/717: rename d1/d3/d3f/d49/f5e to d1/d3/db/d2c/d63/d99/fd6 0 2023-12-07T16:21:59.125 INFO:tasks.workunit.client.0.smithi063.stdout:6/883: sync 2023-12-07T16:21:59.127 INFO:tasks.workunit.client.0.smithi063.stdout:1/858: creat d0/dd/d4f/f12c x:0 0 0 2023-12-07T16:21:59.127 INFO:tasks.workunit.client.0.smithi063.stdout:1/859: readlink d0/dd/d1f/d75/l125 0 2023-12-07T16:21:59.127 INFO:tasks.workunit.client.0.smithi063.stdout:1/860: chown d0/dd/d19/d50/d71/fba 15613984 1 2023-12-07T16:21:59.127 INFO:tasks.workunit.client.0.smithi063.stdout:1/861: mkdir d0/dd/d10/d6f/dd8/dc3/d12d 0 2023-12-07T16:21:59.128 INFO:tasks.workunit.client.0.smithi063.stdout:1/862: mkdir d0/dd/d10/d1b/d12e 0 2023-12-07T16:21:59.131 INFO:tasks.workunit.client.0.smithi063.stdout:1/863: dread d0/dd/d10/d1b/d68/fd2 [0,4194304] 0 2023-12-07T16:21:59.133 INFO:tasks.workunit.client.0.smithi063.stdout:6/884: dread d0/ff [0,4194304] 0 2023-12-07T16:21:59.133 INFO:tasks.workunit.client.0.smithi063.stdout:6/885: truncate d0/d1e/f26 4840266 0 2023-12-07T16:21:59.135 INFO:tasks.workunit.client.0.smithi063.stdout:6/886: mkdir d0/d1e/d2a/d138 0 2023-12-07T16:21:59.135 INFO:tasks.workunit.client.0.smithi063.stdout:6/887: readlink d0/d1e/d1d/d1f/d4b/la6 0 2023-12-07T16:21:59.135 INFO:tasks.workunit.client.0.smithi063.stdout:1/864: write d0/dd/d10/d6f/fac [3183339,67851] 0 2023-12-07T16:21:59.136 INFO:tasks.workunit.client.0.smithi063.stdout:6/888: getdents d0/d1e/d60/d68/d78/d9c 0 2023-12-07T16:21:59.139 INFO:tasks.workunit.client.0.smithi063.stdout:1/865: rename d0/dd/d10/d13 to d0/dd/d19/d50/d12b/dda/d12f 0 2023-12-07T16:21:59.139 INFO:tasks.workunit.client.0.smithi063.stdout:1/866: chown d0/dd/d19/cd4 111751054 1 2023-12-07T16:21:59.145 INFO:tasks.workunit.client.0.smithi063.stdout:6/889: dread d0/f1b [0,4194304] 0 2023-12-07T16:21:59.145 INFO:tasks.workunit.client.0.smithi063.stdout:4/718: dwrite d1/d3/db/d73/f78 [4194304,4194304] 0 2023-12-07T16:21:59.145 INFO:tasks.workunit.client.0.smithi063.stdout:4/719: chown d1/d3/d51/fa8 1 1 2023-12-07T16:21:59.145 INFO:tasks.workunit.client.0.smithi063.stdout:4/720: read d1/d3/db/d41/f95 [1220802,55885] 0 2023-12-07T16:21:59.145 INFO:tasks.workunit.client.0.smithi063.stdout:6/890: symlink d0/d1e/d60/d68/d76/dae/l139 0 2023-12-07T16:21:59.146 INFO:tasks.workunit.client.0.smithi063.stdout:5/909: sync 2023-12-07T16:21:59.146 INFO:tasks.workunit.client.0.smithi063.stdout:3/872: sync 2023-12-07T16:21:59.148 INFO:tasks.workunit.client.0.smithi063.stdout:6/891: getdents d0/d1e/d60/d68/d78/d9c/d9f 0 2023-12-07T16:21:59.148 INFO:tasks.workunit.client.0.smithi063.stdout:6/892: chown d0/d1e/d1d/d1f/f21 63 1 2023-12-07T16:21:59.148 INFO:tasks.workunit.client.0.smithi063.stdout:6/893: write d0/d17/d46/f50 [4832654,63899] 0 2023-12-07T16:21:59.151 INFO:tasks.workunit.client.0.smithi063.stdout:5/910: symlink d1/d31/db8/dee/l115 0 2023-12-07T16:21:59.151 INFO:tasks.workunit.client.0.smithi063.stdout:5/911: readlink d1/d3/d3a/d5a/ld4 0 2023-12-07T16:21:59.152 INFO:tasks.workunit.client.0.smithi063.stdout:3/873: mkdir d7/d49/dbf/d121 0 2023-12-07T16:21:59.152 INFO:tasks.workunit.client.0.smithi063.stdout:3/874: write d7/d9/f45 [604366,114958] 0 2023-12-07T16:21:59.156 INFO:tasks.workunit.client.0.smithi063.stdout:6/894: rename d0/d79/d94/fb7 to d0/d1e/d60/d68/d76/da4/d107/f13a 0 2023-12-07T16:21:59.158 INFO:tasks.workunit.client.0.smithi063.stdout:5/912: creat d1/d31/d56/d108/f116 x:0 0 0 2023-12-07T16:21:59.158 INFO:tasks.workunit.client.0.smithi063.stdout:5/913: readlink d1/d3/de/d1e/l3e 0 2023-12-07T16:21:59.159 INFO:tasks.workunit.client.0.smithi063.stdout:3/875: creat d7/d49/d10b/f122 x:0 0 0 2023-12-07T16:21:59.160 INFO:tasks.workunit.client.0.smithi063.stdout:1/867: rmdir d0/dd/d4f 39 2023-12-07T16:21:59.162 INFO:tasks.workunit.client.0.smithi063.stdout:6/895: symlink d0/d54/d11f/l13b 0 2023-12-07T16:21:59.164 INFO:tasks.workunit.client.0.smithi063.stdout:5/914: rmdir d1/d31/db8/dee/d5e 39 2023-12-07T16:21:59.166 INFO:tasks.workunit.client.0.smithi063.stdout:3/876: rename f6 to d7/d49/dd9/f123 0 2023-12-07T16:21:59.166 INFO:tasks.workunit.client.0.smithi063.stdout:3/877: chown d7/d4f/d53/cc4 567 1 2023-12-07T16:21:59.167 INFO:tasks.workunit.client.0.smithi063.stdout:1/868: symlink d0/dd/d55/d11e/l130 0 2023-12-07T16:21:59.167 INFO:tasks.workunit.client.0.smithi063.stdout:1/869: write d0/dd/d1f/f10c [598951,16015] 0 2023-12-07T16:21:59.169 INFO:tasks.workunit.client.0.smithi063.stdout:5/915: creat d1/d31/db8/dee/d8f/ddf/de4/f117 x:0 0 0 2023-12-07T16:21:59.170 INFO:tasks.workunit.client.0.smithi063.stdout:3/878: unlink d7/lff 0 2023-12-07T16:21:59.173 INFO:tasks.workunit.client.0.smithi063.stdout:3/879: creat d7/d21/f124 x:0 0 0 2023-12-07T16:21:59.183 INFO:tasks.workunit.client.0.smithi063.stdout:4/721: dwrite d1/d3/db/f20 [0,4194304] 0 2023-12-07T16:21:59.183 INFO:tasks.workunit.client.0.smithi063.stdout:4/722: stat d1/d3/db/d2c/fb7 0 2023-12-07T16:21:59.183 INFO:tasks.workunit.client.0.smithi063.stdout:4/723: truncate d1/d3/db/d2c/d63/d62/d86/f8d 260598 0 2023-12-07T16:21:59.183 INFO:tasks.workunit.client.0.smithi063.stdout:4/724: chown d1/l7c 881 1 2023-12-07T16:21:59.184 INFO:tasks.workunit.client.0.smithi063.stdout:6/896: dread d0/d17/d46/f50 [0,4194304] 0 2023-12-07T16:21:59.184 INFO:tasks.workunit.client.0.smithi063.stdout:6/897: readlink d0/d1e/d2a/l87 0 2023-12-07T16:21:59.184 INFO:tasks.workunit.client.0.smithi063.stdout:6/898: stat d0/d1e/d29/fd7 0 2023-12-07T16:21:59.187 INFO:tasks.workunit.client.0.smithi063.stdout:4/725: unlink d1/d3/laf 0 2023-12-07T16:21:59.190 INFO:tasks.workunit.client.0.smithi063.stdout:6/899: rename d0/d1e/d60/d68/d76/da4/fc4 to d0/d17/d46/d93/f13c 0 2023-12-07T16:21:59.190 INFO:tasks.workunit.client.0.smithi063.stdout:6/900: truncate d0/d79/db9/fcf 634346 0 2023-12-07T16:21:59.190 INFO:tasks.workunit.client.0.smithi063.stdout:6/901: truncate d0/d1e/d60/d68/d78/df2/f100 1010182 0 2023-12-07T16:21:59.190 INFO:tasks.workunit.client.0.smithi063.stdout:6/902: write d0/d79/db9/fcf [409724,30463] 0 2023-12-07T16:21:59.190 INFO:tasks.workunit.client.0.smithi063.stdout:6/903: read - d0/d17/d46/f111 zero size 2023-12-07T16:21:59.192 INFO:tasks.workunit.client.0.smithi063.stdout:4/726: creat d1/d3/db/d2c/d63/d99/dd0/fd7 x:0 0 0 2023-12-07T16:21:59.192 INFO:tasks.workunit.client.0.smithi063.stdout:4/727: read d1/f6d [2183049,115822] 0 2023-12-07T16:21:59.194 INFO:tasks.workunit.client.0.smithi063.stdout:6/904: mknod d0/d1e/d60/d68/d78/d9c/d9f/db8/c13d 0 2023-12-07T16:21:59.194 INFO:tasks.workunit.client.0.smithi063.stdout:6/905: chown d0/d79/d94 8 1 2023-12-07T16:21:59.195 INFO:tasks.workunit.client.0.smithi063.stdout:4/728: creat d1/d3/d51/fd8 x:0 0 0 2023-12-07T16:21:59.195 INFO:tasks.workunit.client.0.smithi063.stdout:4/729: chown d1/d3/d3f/fd1 3792 1 2023-12-07T16:21:59.195 INFO:tasks.workunit.client.0.smithi063.stdout:4/730: stat d1/dc6 0 2023-12-07T16:21:59.196 INFO:tasks.workunit.client.0.smithi063.stdout:6/906: mkdir d0/d1e/d60/d68/d76/da4/dc6/d13e 0 2023-12-07T16:21:59.198 INFO:tasks.workunit.client.0.smithi063.stdout:6/907: mknod d0/d1e/c13f 0 2023-12-07T16:21:59.198 INFO:tasks.workunit.client.0.smithi063.stdout:6/908: chown d0/d17/d95/dd6/d5a/d9d/ce1 129654 1 2023-12-07T16:21:59.198 INFO:tasks.workunit.client.0.smithi063.stdout:6/909: getdents d0/d17/df4 0 2023-12-07T16:21:59.198 INFO:tasks.workunit.client.0.smithi063.stdout:6/910: dread - d0/d1e/d1d/d4f/d88/fd0 zero size 2023-12-07T16:21:59.198 INFO:tasks.workunit.client.0.smithi063.stdout:3/880: dwrite d7/d4f/d53/d72/db1/ffc [0,4194304] 0 2023-12-07T16:21:59.200 INFO:tasks.workunit.client.0.smithi063.stdout:1/870: dwrite d0/dd/d19/d50/d71/f64 [8388608,4194304] 0 2023-12-07T16:21:59.203 INFO:tasks.workunit.client.0.smithi063.stdout:6/911: readlink d0/l13 0 2023-12-07T16:21:59.203 INFO:tasks.workunit.client.0.smithi063.stdout:3/881: getdents d7/d9/d1b/d5c 0 2023-12-07T16:21:59.203 INFO:tasks.workunit.client.0.smithi063.stdout:3/882: fdatasync d7/d9/dd/f2e 0 2023-12-07T16:21:59.205 INFO:tasks.workunit.client.0.smithi063.stdout:1/871: link d0/dd/d10/d6f/da0/fe6 d0/dd/d55/dc9/f131 0 2023-12-07T16:21:59.205 INFO:tasks.workunit.client.0.smithi063.stdout:1/872: fsync d0/d47/fe2 0 2023-12-07T16:21:59.207 INFO:tasks.workunit.client.0.smithi063.stdout:3/883: creat d7/d4f/d53/d54/d76/f125 x:0 0 0 2023-12-07T16:21:59.211 INFO:tasks.workunit.client.0.smithi063.stdout:3/884: rename d7/d21/fbd to d7/d9/dd/f126 0 2023-12-07T16:21:59.211 INFO:tasks.workunit.client.0.smithi063.stdout:3/885: fdatasync d7/d9/dd/d7f/fac 0 2023-12-07T16:21:59.219 INFO:tasks.workunit.client.0.smithi063.stdout:4/731: dwrite d1/d3/f5a [0,4194304] 0 2023-12-07T16:21:59.220 INFO:tasks.workunit.client.0.smithi063.stdout:4/732: fsync d1/d3/db/d2c/fc4 0 2023-12-07T16:21:59.227 INFO:tasks.workunit.client.0.smithi063.stdout:4/733: rename d1/d3/db/d2c/d63/d62/d86 to d1/d3/d3f/d49/d64/dd9 0 2023-12-07T16:21:59.227 INFO:tasks.workunit.client.0.smithi063.stdout:4/734: stat d1/d3/db/d2c/f77 0 2023-12-07T16:21:59.227 INFO:tasks.workunit.client.0.smithi063.stdout:4/735: truncate d1/d3/db/d73/fce 1469890 0 2023-12-07T16:21:59.235 INFO:tasks.workunit.client.0.smithi063.stdout:3/886: dwrite d7/d4f/d53/fa1 [0,4194304] 0 2023-12-07T16:21:59.240 INFO:tasks.workunit.client.0.smithi063.stdout:4/736: dread d1/d3/f68 [0,4194304] 0 2023-12-07T16:21:59.241 INFO:tasks.workunit.client.0.smithi063.stdout:4/737: dread - d1/d3/db/d16/d66/f76 zero size 2023-12-07T16:21:59.241 INFO:tasks.workunit.client.0.smithi063.stdout:4/738: fsync d1/d3/db/f56 0 2023-12-07T16:21:59.245 INFO:tasks.workunit.client.0.smithi063.stdout:3/887: mkdir d7/d9/dd/d7f/dcb/d127 0 2023-12-07T16:21:59.245 INFO:tasks.workunit.client.0.smithi063.stdout:1/873: dwrite d0/dd/d10/d1b/f51 [0,4194304] 0 2023-12-07T16:21:59.246 INFO:tasks.workunit.client.0.smithi063.stdout:4/739: creat d1/d3/d51/fda x:0 0 0 2023-12-07T16:21:59.246 INFO:tasks.workunit.client.0.smithi063.stdout:4/740: readlink d1/d3/l19 0 2023-12-07T16:21:59.247 INFO:tasks.workunit.client.0.smithi063.stdout:3/888: truncate d7/d49/d4b/fd6 565746 0 2023-12-07T16:21:59.250 INFO:tasks.workunit.client.0.smithi063.stdout:1/874: mknod d0/dd/d19/d50/d12b/dda/dd5/df8/c132 0 2023-12-07T16:21:59.257 INFO:tasks.workunit.client.0.smithi063.stdout:3/889: dread d7/d9/f18 [0,4194304] 0 2023-12-07T16:21:59.257 INFO:tasks.workunit.client.0.smithi063.stdout:4/741: dread d1/d3/db/f56 [0,4194304] 0 2023-12-07T16:21:59.258 INFO:tasks.workunit.client.0.smithi063.stdout:3/890: mknod d7/d4f/d53/d72/db1/d41/c128 0 2023-12-07T16:21:59.263 INFO:tasks.workunit.client.0.smithi063.stdout:3/891: rename d7/d9/dd/f42 to d7/d4f/d53/f129 0 2023-12-07T16:21:59.263 INFO:tasks.workunit.client.0.smithi063.stdout:3/892: chown d7/d49/d4b/l70 181515749 1 2023-12-07T16:21:59.264 INFO:tasks.workunit.client.0.smithi063.stdout:4/742: dread d1/d3/db/d2c/d63/f18 [0,4194304] 0 2023-12-07T16:21:59.264 INFO:tasks.workunit.client.0.smithi063.stdout:4/743: truncate d1/d3/db/d2c/fa3 1018772 0 2023-12-07T16:21:59.265 INFO:tasks.workunit.client.0.smithi063.stdout:4/744: mkdir d1/d3/d9f/ddb 0 2023-12-07T16:21:59.267 INFO:tasks.workunit.client.0.smithi063.stdout:3/893: dread d7/d9/d1b/d5c/f101 [0,4194304] 0 2023-12-07T16:21:59.269 INFO:tasks.workunit.client.0.smithi063.stdout:1/875: dwrite d0/dd/d55/dc9/f131 [0,4194304] 0 2023-12-07T16:21:59.271 INFO:tasks.workunit.client.0.smithi063.stdout:1/876: creat d0/dd/d19/d50/d72/d80/f133 x:0 0 0 2023-12-07T16:21:59.272 INFO:tasks.workunit.client.0.smithi063.stdout:3/894: dread d7/fe8 [0,4194304] 0 2023-12-07T16:21:59.274 INFO:tasks.workunit.client.0.smithi063.stdout:3/895: mkdir d7/d4f/d53/d72/db1/de6/d12a 0 2023-12-07T16:21:59.275 INFO:tasks.workunit.client.0.smithi063.stdout:3/896: chown d7/d49/d4b/d8e/fa4 85195 1 2023-12-07T16:21:59.276 INFO:tasks.workunit.client.0.smithi063.stdout:3/897: unlink d7/d4f/fde 0 2023-12-07T16:21:59.277 INFO:tasks.workunit.client.0.smithi063.stdout:3/898: unlink d7/d9/dd/l1a 0 2023-12-07T16:21:59.277 INFO:tasks.workunit.client.0.smithi063.stdout:3/899: write d7/d9/d1b/ffb [280672,29380] 0 2023-12-07T16:21:59.277 INFO:tasks.workunit.client.0.smithi063.stdout:3/900: write d7/d9/dd/d7f/fac [844125,49513] 0 2023-12-07T16:21:59.305 INFO:tasks.workunit.client.0.smithi063.stdout:3/901: dwrite d7/d4f/d53/d54/d76/fdc [0,4194304] 0 2023-12-07T16:21:59.306 INFO:tasks.workunit.client.0.smithi063.stdout:3/902: chown d7/d9/d1b/db8/f10d 7125290 1 2023-12-07T16:21:59.306 INFO:tasks.workunit.client.0.smithi063.stdout:1/877: dwrite d0/dd/d19/d50/d12b/dda/f11a [0,4194304] 0 2023-12-07T16:21:59.306 INFO:tasks.workunit.client.0.smithi063.stdout:1/878: readlink d0/dd/l18 0 2023-12-07T16:21:59.306 INFO:tasks.workunit.client.0.smithi063.stdout:1/879: dread - d0/dd/d19/fd7 zero size 2023-12-07T16:21:59.307 INFO:tasks.workunit.client.0.smithi063.stdout:3/903: getdents d7/d4f/d53/d72 0 2023-12-07T16:21:59.310 INFO:tasks.workunit.client.0.smithi063.stdout:1/880: getdents d0/dd/d4f 0 2023-12-07T16:21:59.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.314+0000 7efd98634700 1 -- 172.21.15.63:0/3137954931 --> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efd90115d00 con 0x7efd7c038350 2023-12-07T16:21:59.313 INFO:tasks.workunit.client.0.smithi063.stdout:1/881: mkdir d0/dd/d19/d50/d72/dc0/d134 0 2023-12-07T16:21:59.313 INFO:tasks.workunit.client.0.smithi063.stdout:1/882: chown d0/dd/d1f/f5b 56319 1 2023-12-07T16:21:59.313 INFO:tasks.workunit.client.0.smithi063.stdout:1/883: dread - d0/dd/d4f/f12c zero size 2023-12-07T16:21:59.313 INFO:tasks.workunit.client.0.smithi063.stdout:1/884: chown d0/dd/d19/d50/d71/fad 410740457 1 2023-12-07T16:21:59.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.315+0000 7efd86ffd700 1 -- 172.21.15.63:0/3137954931 <== mgr.24453 v2:172.21.15.63:6800/2671097541 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7efd90115d00 con 0x7efd7c038350 2023-12-07T16:21:59.314 INFO:tasks.workunit.client.0.smithi063.stdout:1/885: dread d0/dd/d4f/ff4 [0,4194304] 0 2023-12-07T16:21:59.314 INFO:tasks.workunit.client.0.smithi063.stdout:1/886: readlink d0/dd/d19/lb4 0 2023-12-07T16:21:59.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.318+0000 7efd98634700 1 -- 172.21.15.63:0/3137954931 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7efd7c038350 msgr2=0x7efd7c03a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:59.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.318+0000 7efd98634700 1 --2- 172.21.15.63:0/3137954931 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7efd7c038350 0x7efd7c03a800 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efd8c00b3b0 tx=0x7efd8c009e30 comp rx=0 tx=0).stop 2023-12-07T16:21:59.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.318+0000 7efd98634700 1 -- 172.21.15.63:0/3137954931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd90070570 msgr2=0x7efd90113b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:59.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.318+0000 7efd98634700 1 --2- 172.21.15.63:0/3137954931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd90070570 0x7efd90113b20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efd8000b790 tx=0x7efd80009250 comp rx=0 tx=0).stop 2023-12-07T16:21:59.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.319+0000 7efd98634700 1 -- 172.21.15.63:0/3137954931 shutdown_connections 2023-12-07T16:21:59.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.319+0000 7efd98634700 1 --2- 172.21.15.63:0/3137954931 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7efd7c038350 0x7efd7c03a800 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:59.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.319+0000 7efd98634700 1 --2- 172.21.15.63:0/3137954931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd90070570 0x7efd90113b20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:59.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.319+0000 7efd98634700 1 --2- 172.21.15.63:0/3137954931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efd90071bc0 0x7efd90114060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:59.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.319+0000 7efd98634700 1 -- 172.21.15.63:0/3137954931 >> 172.21.15.63:0/3137954931 conn(0x7efd900f82d0 msgr2=0x7efd900fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:21:59.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.319+0000 7efd98634700 1 -- 172.21.15.63:0/3137954931 shutdown_connections 2023-12-07T16:21:59.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.319+0000 7efd98634700 1 -- 172.21.15.63:0/3137954931 wait complete. 2023-12-07T16:21:59.319 INFO:tasks.workunit.client.0.smithi063.stdout:3/904: dread d7/f110 [0,4194304] 0 2023-12-07T16:21:59.319 INFO:tasks.workunit.client.0.smithi063.stdout:3/905: write d7/d9/dd/fc1 [4022845,82642] 0 2023-12-07T16:21:59.319 INFO:tasks.workunit.client.0.smithi063.stdout:3/906: chown d7/d9/d1b/d5c/f91 1 1 2023-12-07T16:21:59.319 INFO:tasks.workunit.client.0.smithi063.stdout:3/907: readlink d7/d9/d1b/df3/d109/l113 0 2023-12-07T16:21:59.328 INFO:tasks.workunit.client.0.smithi063.stdout:3/908: dread d7/d4f/d53/fa1 [0,4194304] 0 2023-12-07T16:21:59.328 INFO:tasks.workunit.client.0.smithi063.stdout:3/909: readlink d7/d9/d1b/l95 0 2023-12-07T16:21:59.335 INFO:tasks.workunit.client.0.smithi063.stdout:1/887: dwrite d0/dd/d4f/ff7 [0,4194304] 0 2023-12-07T16:21:59.341 INFO:tasks.workunit.client.0.smithi063.stdout:1/888: dread d0/dd/d19/d50/d12b/dda/d12f/f60 [0,4194304] 0 2023-12-07T16:21:59.346 INFO:tasks.workunit.client.0.smithi063.stdout:3/910: dwrite d7/d49/d4b/d8e/ff4 [0,4194304] 0 2023-12-07T16:21:59.346 INFO:tasks.workunit.client.0.smithi063.stdout:3/911: write d7/d21/f124 [778992,8068] 0 2023-12-07T16:21:59.352 INFO:tasks.workunit.client.0.smithi063.stdout:3/912: mkdir d7/d9/dfa/d12b 0 2023-12-07T16:21:59.365 INFO:tasks.workunit.client.0.smithi063.stdout:1/889: dwrite d0/dd/d10/f27 [0,4194304] 0 2023-12-07T16:21:59.369 INFO:tasks.workunit.client.0.smithi063.stdout:1/890: write d0/dd/f39 [3898109,71846] 0 2023-12-07T16:21:59.370 INFO:tasks.workunit.client.0.smithi063.stdout:1/891: dread - d0/dd/d19/d50/fc7 zero size 2023-12-07T16:21:59.386 INFO:tasks.workunit.client.0.smithi063.stdout:1/892: dwrite d0/dd/d19/d50/fc7 [0,4194304] 0 2023-12-07T16:21:59.388 INFO:tasks.workunit.client.0.smithi063.stdout:1/893: link d0/dd/d19/d50/d12b/dda/d12f/f11c d0/dd/d10/d6f/da0/f135 0 2023-12-07T16:21:59.389 INFO:tasks.workunit.client.0.smithi063.stdout:1/894: creat d0/dd/d19/d50/f136 x:0 0 0 2023-12-07T16:21:59.390 INFO:tasks.workunit.client.0.smithi063.stdout:1/895: creat d0/dd/d55/f137 x:0 0 0 2023-12-07T16:21:59.391 INFO:tasks.workunit.client.0.smithi063.stdout:1/896: write d0/dd/d4f/f69 [449043,71482] 0 2023-12-07T16:21:59.391 INFO:tasks.workunit.client.0.smithi063.stdout:1/897: write d0/dd/d19/d50/d72/dc0/fcf [632954,14614] 0 2023-12-07T16:21:59.392 INFO:tasks.workunit.client.0.smithi063.stdout:1/898: symlink d0/dd/d19/d50/l138 0 2023-12-07T16:21:59.393 INFO:tasks.workunit.client.0.smithi063.stdout:1/899: dread d0/dd/d10/d46/f91 [0,4194304] 0 2023-12-07T16:21:59.400 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:59 smithi152 ceph-mon[121113]: mgrmap e28: smithi063.yohyyx(active, since 1.01025s) 2023-12-07T16:21:59.400 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:21:59 smithi152 ceph-mon[121113]: pgmap v3: 65 pgs: 65 active+clean; 2.5 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail 2023-12-07T16:21:59.406 INFO:tasks.workunit.client.0.smithi063.stdout:1/900: dread d0/dd/d1f/f4e [0,4194304] 0 2023-12-07T16:21:59.406 INFO:tasks.workunit.client.0.smithi063.stdout:1/901: chown d0/dd/d19/d50/d12b/dda/d12f/d2f/d79/f11d 0 1 2023-12-07T16:21:59.411 INFO:tasks.workunit.client.0.smithi063.stdout:3/913: dwrite d7/fcd [4194304,4194304] 0 2023-12-07T16:21:59.413 INFO:tasks.workunit.client.0.smithi063.stdout:3/914: unlink d7/d4f/d53/d72/d7d/f85 0 2023-12-07T16:21:59.413 INFO:tasks.workunit.client.0.smithi063.stdout:3/915: rename d7/d9/dd/d56 to d7/d9/dd/d56/d12c 22 2023-12-07T16:21:59.413 INFO:tasks.workunit.client.0.smithi063.stdout:3/916: write d7/d9/dd/f2e [4303120,111821] 0 2023-12-07T16:21:59.414 INFO:tasks.workunit.client.0.smithi063.stdout:3/917: creat d7/d4f/d53/d72/db1/de6/f12d x:0 0 0 2023-12-07T16:21:59.418 INFO:tasks.workunit.client.0.smithi063.stdout:1/902: dread d0/dd/d10/d6f/fd6 [4194304,4194304] 0 2023-12-07T16:21:59.419 INFO:tasks.workunit.client.0.smithi063.stdout:1/903: creat d0/dd/d19/d50/d72/dc0/f139 x:0 0 0 2023-12-07T16:21:59.428 INFO:tasks.workunit.client.0.smithi063.stdout:1/904: dread d0/dd/d19/d50/d12b/dda/d12f/d2f/d79/f7d [0,4194304] 0 2023-12-07T16:21:59.436 INFO:tasks.workunit.client.0.smithi063.stdout:3/918: dwrite d7/d21/f124 [0,4194304] 0 2023-12-07T16:21:59.436 INFO:tasks.workunit.client.0.smithi063.stdout:3/919: fdatasync d7/d4f/d53/f102 0 2023-12-07T16:21:59.440 INFO:tasks.workunit.client.0.smithi063.stdout:3/920: rename d7/d4f/d53/d72/db1/ffc to d7/d9/dd/d7f/f12e 0 2023-12-07T16:21:59.442 INFO:tasks.workunit.client.0.smithi063.stdout:3/921: mknod d7/d9/dfa/d12b/c12f 0 2023-12-07T16:21:59.442 INFO:tasks.workunit.client.0.smithi063.stdout:3/922: readlink d7/d4f/d53/d72/l87 0 2023-12-07T16:21:59.443 INFO:tasks.workunit.client.0.smithi063.stdout:1/905: dread d0/dd/d19/d50/d12b/dda/d12f/d2f/f7c [0,4194304] 0 2023-12-07T16:21:59.443 INFO:tasks.workunit.client.0.smithi063.stdout:1/906: chown d0/c44 1189146496 1 2023-12-07T16:21:59.443 INFO:tasks.workunit.client.0.smithi063.stdout:1/907: truncate d0/dd/d19/d50/d71/f86 4202820 0 2023-12-07T16:21:59.443 INFO:tasks.workunit.client.0.smithi063.stdout:1/908: chown d0/dd/d10/d1b/d68/f95 4159088 1 2023-12-07T16:21:59.444 INFO:tasks.workunit.client.0.smithi063.stdout:3/923: creat d7/d4f/f130 x:0 0 0 2023-12-07T16:21:59.446 INFO:tasks.workunit.client.0.smithi063.stdout:3/924: mkdir d7/d9/d1b/df3/d131 0 2023-12-07T16:21:59.446 INFO:tasks.workunit.client.0.smithi063.stdout:3/925: chown d7/d4f/d53/d54/f71 31689699 1 2023-12-07T16:21:59.447 INFO:tasks.workunit.client.0.smithi063.stdout:3/926: symlink d7/d9/d1b/df3/l132 0 2023-12-07T16:21:59.448 INFO:tasks.workunit.client.0.smithi063.stdout:3/927: write d7/d49/d4b/fd5 [622629,47732] 0 2023-12-07T16:21:59.448 INFO:tasks.workunit.client.0.smithi063.stdout:3/928: write d7/d9/d1b/d5c/f101 [1540088,17856] 0 2023-12-07T16:21:59.450 INFO:tasks.workunit.client.0.smithi063.stdout:3/929: rename d7/d4f/d53/d54/d76/laa to d7/d49/db0/l133 0 2023-12-07T16:21:59.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.465+0000 7fa512ec3700 1 -- 172.21.15.63:0/2261501248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa50c0fcd00 msgr2=0x7fa50c0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:59.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.465+0000 7fa512ec3700 1 --2- 172.21.15.63:0/2261501248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa50c0fcd00 0x7fa50c0fd150 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa500004940 tx=0x7fa500009e30 comp rx=0 tx=0).stop 2023-12-07T16:21:59.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.465+0000 7fa512ec3700 1 -- 172.21.15.63:0/2261501248 shutdown_connections 2023-12-07T16:21:59.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.465+0000 7fa512ec3700 1 --2- 172.21.15.63:0/2261501248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa50c0fcd00 0x7fa50c0fd150 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:59.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.465+0000 7fa512ec3700 1 --2- 172.21.15.63:0/2261501248 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa50c0fbaf0 0x7fa50c0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:59.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.465+0000 7fa512ec3700 1 -- 172.21.15.63:0/2261501248 >> 172.21.15.63:0/2261501248 conn(0x7fa50c0f7190 msgr2=0x7fa50c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:21:59.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.465+0000 7fa512ec3700 1 -- 172.21.15.63:0/2261501248 shutdown_connections 2023-12-07T16:21:59.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.465+0000 7fa512ec3700 1 -- 172.21.15.63:0/2261501248 wait complete. 2023-12-07T16:21:59.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.466+0000 7fa512ec3700 1 Processor -- start 2023-12-07T16:21:59.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.466+0000 7fa512ec3700 1 -- start start 2023-12-07T16:21:59.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.466+0000 7fa512ec3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa50c0fbaf0 0x7fa50c1101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:59.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.466+0000 7fa512ec3700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa50c0fcd00 0x7fa50c112720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:59.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.466+0000 7fa512ec3700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c066130 con 0x7fa50c0fcd00 2023-12-07T16:21:59.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.466+0000 7fa512ec3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c066270 con 0x7fa50c0fbaf0 2023-12-07T16:21:59.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.467+0000 7fa50bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa50c0fcd00 0x7fa50c112720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:59.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.467+0000 7fa50bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa50c0fcd00 0x7fa50c112720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51974/0 (socket says 172.21.15.63:51974) 2023-12-07T16:21:59.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.467+0000 7fa50bfff700 1 -- 172.21.15.63:0/3496745698 learned_addr learned my addr 172.21.15.63:0/3496745698 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:21:59.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.467+0000 7fa510c5f700 1 --2- 172.21.15.63:0/3496745698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa50c0fbaf0 0x7fa50c1101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:59.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.467+0000 7fa50bfff700 1 -- 172.21.15.63:0/3496745698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa50c0fbaf0 msgr2=0x7fa50c1101d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:59.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.467+0000 7fa50bfff700 1 --2- 172.21.15.63:0/3496745698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa50c0fbaf0 0x7fa50c1101d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:59.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.467+0000 7fa50bfff700 1 -- 172.21.15.63:0/3496745698 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa500005040 con 0x7fa50c0fcd00 2023-12-07T16:21:59.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.467+0000 7fa50bfff700 1 --2- 172.21.15.63:0/3496745698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa50c0fcd00 0x7fa50c112720 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa500009380 tx=0x7fa500009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:21:59.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.467+0000 7fa5097fa700 1 -- 172.21.15.63:0/3496745698 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa50000e040 con 0x7fa50c0fcd00 2023-12-07T16:21:59.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.467+0000 7fa5097fa700 1 -- 172.21.15.63:0/3496745698 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa50000bd20 con 0x7fa50c0fcd00 2023-12-07T16:21:59.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.467+0000 7fa512ec3700 1 -- 172.21.15.63:0/3496745698 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50c112d20 con 0x7fa50c0fcd00 2023-12-07T16:21:59.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.467+0000 7fa5097fa700 1 -- 172.21.15.63:0/3496745698 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa50001c630 con 0x7fa50c0fcd00 2023-12-07T16:21:59.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.468+0000 7fa512ec3700 1 -- 172.21.15.63:0/3496745698 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50c113210 con 0x7fa50c0fcd00 2023-12-07T16:21:59.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.469+0000 7fa5097fa700 1 -- 172.21.15.63:0/3496745698 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 29) v1 ==== 45671+0+0 (secure 0 0 0) 0x7fa50001c8a0 con 0x7fa50c0fcd00 2023-12-07T16:21:59.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.469+0000 7fa5097fa700 1 --2- 172.21.15.63:0/3496745698 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fa4fc0386e0 0x7fa4fc03ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:59.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.469+0000 7fa512ec3700 1 -- 172.21.15.63:0/3496745698 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50c04bb80 con 0x7fa50c0fcd00 2023-12-07T16:21:59.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.469+0000 7fa5097fa700 1 -- 172.21.15.63:0/3496745698 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fa50004d5f0 con 0x7fa50c0fcd00 2023-12-07T16:21:59.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.469+0000 7fa510c5f700 1 --2- 172.21.15.63:0/3496745698 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fa4fc0386e0 0x7fa4fc03ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:59.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.469+0000 7fa510c5f700 1 --2- 172.21.15.63:0/3496745698 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fa4fc0386e0 0x7fa4fc03ab90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa50c065db0 tx=0x7fa4f800b040 comp rx=0 tx=0).ready entity=mgr.24453 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:21:59.469 INFO:tasks.workunit.client.0.smithi063.stdout:1/909: dwrite d0/dd/d19/d50/d71/f5a [0,4194304] 0 2023-12-07T16:21:59.470 INFO:tasks.workunit.client.0.smithi063.stdout:3/930: dwrite d7/d4f/d53/d72/db1/d41/f9a [0,4194304] 0 2023-12-07T16:21:59.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.476+0000 7fa5097fa700 1 -- 172.21.15.63:0/3496745698 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fa500023300 con 0x7fa50c0fcd00 2023-12-07T16:21:59.485 INFO:tasks.workunit.client.0.smithi063.stdout:1/910: dread d0/dd/d10/d6f/da0/f135 [0,4194304] 0 2023-12-07T16:21:59.485 INFO:tasks.workunit.client.0.smithi063.stdout:1/911: chown d0/dd/d19/d50/d12b/dda/d12f/ff1 2 1 2023-12-07T16:21:59.500 INFO:tasks.workunit.client.0.smithi063.stdout:1/912: dwrite d0/dd/d10/d6f/fd6 [4194304,4194304] 0 2023-12-07T16:21:59.500 INFO:tasks.workunit.client.0.smithi063.stdout:1/913: chown d0/dd/d10/d46 446730 1 2023-12-07T16:21:59.501 INFO:tasks.workunit.client.0.smithi063.stdout:1/914: mkdir d0/dd/d19/d50/d72/d80/d13a 0 2023-12-07T16:21:59.501 INFO:tasks.workunit.client.0.smithi063.stdout:1/915: mknod d0/d47/c13b 0 2023-12-07T16:21:59.517 INFO:tasks.workunit.client.0.smithi063.stdout:1/916: dwrite d0/f4b [0,4194304] 0 2023-12-07T16:21:59.537 INFO:tasks.workunit.client.0.smithi063.stdout:1/917: dwrite d0/dd/d55/f10a [0,4194304] 0 2023-12-07T16:21:59.539 INFO:tasks.workunit.client.0.smithi063.stdout:1/918: symlink d0/dd/d10/d46/l13c 0 2023-12-07T16:21:59.541 INFO:tasks.workunit.client.0.smithi063.stdout:1/919: rename d0/dd/d10/d1b/fca to d0/dd/d55/dc9/f13d 0 2023-12-07T16:21:59.541 INFO:tasks.workunit.client.0.smithi063.stdout:1/920: read - d0/dd/d19/d50/d12b/dda/d12f/d2f/f123 zero size 2023-12-07T16:21:59.542 INFO:tasks.workunit.client.0.smithi063.stdout:1/921: creat d0/dd/d19/d50/d12b/dda/dd5/f13e x:0 0 0 2023-12-07T16:21:59.563 INFO:tasks.workunit.client.0.smithi063.stdout:1/922: dwrite d0/dd/f1c [0,4194304] 0 2023-12-07T16:21:59.566 INFO:tasks.workunit.client.0.smithi063.stdout:1/923: dread d0/dd/d10/d46/f58 [0,4194304] 0 2023-12-07T16:21:59.581 INFO:tasks.workunit.client.0.smithi063.stdout:1/924: dwrite d0/dd/d10/d1b/d68/f12a [0,4194304] 0 2023-12-07T16:21:59.581 INFO:tasks.workunit.client.0.smithi063.stdout:1/925: dread - d0/dd/d19/f11f zero size 2023-12-07T16:21:59.584 INFO:tasks.workunit.client.0.smithi063.stdout:1/926: mknod d0/dd/d10/d6f/d124/c13f 0 2023-12-07T16:21:59.584 INFO:tasks.workunit.client.0.smithi063.stdout:5/916: sync 2023-12-07T16:21:59.584 INFO:tasks.workunit.client.0.smithi063.stdout:5/917: chown d1/d3/d3a/fe8 1346 1 2023-12-07T16:21:59.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.751+0000 7fa512ec3700 1 -- 172.21.15.63:0/3496745698 --> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa50c101650 con 0x7fa4fc0386e0 2023-12-07T16:21:59.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.761+0000 7fa5097fa700 1 -- 172.21.15.63:0/3496745698 <== mgr.24453 v2:172.21.15.63:6800/2671097541 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fa50c101650 con 0x7fa4fc0386e0 2023-12-07T16:21:59.759 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-07T16:21:59.760 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (50s) 8s ago 6m 20.2M - 0.25.0 c8568f914cd2 c0526812d5fe 2023-12-07T16:21:59.760 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (6m) 8s ago 6m 7428k - 17.2.7-115-g4f62d9ad fcdfd00f81c7 80bed1094ab4 2023-12-07T16:21:59.760 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi152 smithi152 running (5m) 0s ago 5m 7495k - 17.2.7-115-g4f62d9ad fcdfd00f81c7 e2cd5532384b 2023-12-07T16:21:59.760 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (47s) 8s ago 6m 83.5M - 9.4.7 954c08fa6188 cc2cde9a664f 2023-12-07T16:21:59.760 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.gsjgcq smithi063 running (2m) 8s ago 2m 13.2M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 f70e4f098e4c 2023-12-07T16:21:59.760 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.yidolg smithi063 running (2m) 8s ago 2m 3179M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5b053ef5fb7f 2023-12-07T16:21:59.760 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.aovwwd smithi152 running (2m) 0s ago 2m 14.4M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 80190948a595 2023-12-07T16:21:59.760 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.mrvngf smithi152 running (2m) 0s ago 2m 1519M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5f60b893f840 2023-12-07T16:21:59.760 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.yohyyx smithi063 *:8443,9283,8765 running (13s) 8s ago 7m 60.2M - 19.0.0-13-ge6605fb8 104f332cd0a9 b605f882784d 2023-12-07T16:21:59.760 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi152.sxayfb smithi152 *:8443,9283 running (77s) 0s ago 5m 76.8M - 19.0.0-13-ge6605fb8 104f332cd0a9 bfc7027421d2 2023-12-07T16:21:59.760 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (7m) 8s ago 7m 88.9M 2048M 17.2.7-115-g4f62d9ad fcdfd00f81c7 736281f5463c 2023-12-07T16:21:59.760 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi152 smithi152 running (5m) 0s ago 5m 61.8M 2048M 17.2.7-115-g4f62d9ad fcdfd00f81c7 ecfe3add39d6 2023-12-07T16:21:59.760 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (54s) 8s ago 6m 9315k - 1.5.0 0da6a335fe13 50d63981f746 2023-12-07T16:21:59.761 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi152 smithi152 *:9100 running (24s) 0s ago 5m 9009k - 1.5.0 0da6a335fe13 627cda14f1a9 2023-12-07T16:21:59.761 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (5m) 8s ago 5m 447M 1568M 17.2.7-115-g4f62d9ad fcdfd00f81c7 bbdd7f82a7c3 2023-12-07T16:21:59.761 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (4m) 8s ago 4m 557M 1568M 17.2.7-115-g4f62d9ad fcdfd00f81c7 4372601f899e 2023-12-07T16:21:59.761 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (4m) 8s ago 4m 369M 1568M 17.2.7-115-g4f62d9ad fcdfd00f81c7 b0d432bbca05 2023-12-07T16:21:59.761 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi152 running (4m) 0s ago 4m 636M 2592M 17.2.7-115-g4f62d9ad fcdfd00f81c7 94d14402b489 2023-12-07T16:21:59.761 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi152 running (4m) 0s ago 4m 500M 2592M 17.2.7-115-g4f62d9ad fcdfd00f81c7 d3b8b2f12489 2023-12-07T16:21:59.761 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi152 running (3m) 0s ago 3m 608M 2592M 17.2.7-115-g4f62d9ad fcdfd00f81c7 e7f8d9f716bb 2023-12-07T16:21:59.761 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (44s) 8s ago 6m 47.6M - 2.43.0 a07b618ecd1d 90b29d3794d1 2023-12-07T16:21:59.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.764+0000 7fa512ec3700 1 -- 172.21.15.63:0/3496745698 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fa4fc0386e0 msgr2=0x7fa4fc03ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:59.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.764+0000 7fa512ec3700 1 --2- 172.21.15.63:0/3496745698 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fa4fc0386e0 0x7fa4fc03ab90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa50c065db0 tx=0x7fa4f800b040 comp rx=0 tx=0).stop 2023-12-07T16:21:59.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.764+0000 7fa512ec3700 1 -- 172.21.15.63:0/3496745698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa50c0fcd00 msgr2=0x7fa50c112720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:59.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.764+0000 7fa512ec3700 1 --2- 172.21.15.63:0/3496745698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa50c0fcd00 0x7fa50c112720 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa500009380 tx=0x7fa500009e30 comp rx=0 tx=0).stop 2023-12-07T16:21:59.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.764+0000 7fa512ec3700 1 -- 172.21.15.63:0/3496745698 shutdown_connections 2023-12-07T16:21:59.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.764+0000 7fa512ec3700 1 --2- 172.21.15.63:0/3496745698 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fa4fc0386e0 0x7fa4fc03ab90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:59.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.764+0000 7fa512ec3700 1 --2- 172.21.15.63:0/3496745698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa50c0fbaf0 0x7fa50c1101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:59.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.764+0000 7fa512ec3700 1 --2- 172.21.15.63:0/3496745698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa50c0fcd00 0x7fa50c112720 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:59.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.764+0000 7fa512ec3700 1 -- 172.21.15.63:0/3496745698 >> 172.21.15.63:0/3496745698 conn(0x7fa50c0f7190 msgr2=0x7fa50c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:21:59.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.764+0000 7fa512ec3700 1 -- 172.21.15.63:0/3496745698 shutdown_connections 2023-12-07T16:21:59.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.764+0000 7fa512ec3700 1 -- 172.21.15.63:0/3496745698 wait complete. 2023-12-07T16:21:59.776 INFO:tasks.workunit.client.0.smithi063.stdout:6/912: sync 2023-12-07T16:21:59.778 INFO:tasks.workunit.client.0.smithi063.stdout:6/913: dread d0/d17/d1a/d38/f120 [0,4194304] 0 2023-12-07T16:21:59.789 INFO:tasks.workunit.client.0.smithi063.stdout:6/914: dread d0/d1e/f3e [0,4194304] 0 2023-12-07T16:21:59.789 INFO:tasks.workunit.client.0.smithi063.stdout:6/915: write d0/ff [3111234,1704] 0 2023-12-07T16:21:59.790 INFO:tasks.workunit.client.0.smithi063.stdout:6/916: read d0/d1e/d60/d68/fc9 [222195,117363] 0 2023-12-07T16:21:59.791 INFO:tasks.workunit.client.0.smithi063.stdout:6/917: mknod d0/d54/c140 0 2023-12-07T16:21:59.795 INFO:tasks.workunit.client.0.smithi063.stdout:6/918: dread d0/ff [4194304,4194304] 0 2023-12-07T16:21:59.796 INFO:tasks.workunit.client.0.smithi063.stdout:6/919: read d0/d17/d95/dd6/d8b/ffa [3293324,62340] 0 2023-12-07T16:21:59.801 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-07T16:21:59.801 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2023-12-07T16:21:59.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.903+0000 7f1eab544700 1 -- 172.21.15.63:0/2667215620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea40fee00 msgr2=0x7f1ea40ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:59.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.903+0000 7f1eab544700 1 --2- 172.21.15.63:0/2667215620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea40fee00 0x7f1ea40ff210 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0004940 tx=0x7f1ea0009e30 comp rx=0 tx=0).stop 2023-12-07T16:21:59.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.903+0000 7f1eab544700 1 -- 172.21.15.63:0/2667215620 shutdown_connections 2023-12-07T16:21:59.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.903+0000 7f1eab544700 1 --2- 172.21.15.63:0/2667215620 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ea40fff70 0x7f1ea41003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:59.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.903+0000 7f1eab544700 1 --2- 172.21.15.63:0/2667215620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea40fee00 0x7f1ea40ff210 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:59.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.903+0000 7f1eab544700 1 -- 172.21.15.63:0/2667215620 >> 172.21.15.63:0/2667215620 conn(0x7f1ea40fa5d0 msgr2=0x7f1ea40fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:21:59.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.903+0000 7f1eab544700 1 -- 172.21.15.63:0/2667215620 shutdown_connections 2023-12-07T16:21:59.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.903+0000 7f1eab544700 1 -- 172.21.15.63:0/2667215620 wait complete. 2023-12-07T16:21:59.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.904+0000 7f1eab544700 1 Processor -- start 2023-12-07T16:21:59.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.904+0000 7f1eab544700 1 -- start start 2023-12-07T16:21:59.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.904+0000 7f1eab544700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ea40fee00 0x7f1ea410b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:59.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.904+0000 7f1eab544700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea40fff70 0x7f1ea410b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:59.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.904+0000 7f1eab544700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea410be30 con 0x7f1ea40fff70 2023-12-07T16:21:59.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.904+0000 7f1eab544700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea410f920 con 0x7f1ea40fee00 2023-12-07T16:21:59.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.904+0000 7f1ea8adf700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea40fff70 0x7f1ea410b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:59.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.904+0000 7f1ea8adf700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea40fff70 0x7f1ea410b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51994/0 (socket says 172.21.15.63:51994) 2023-12-07T16:21:59.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.904+0000 7f1ea8adf700 1 -- 172.21.15.63:0/3622143261 learned_addr learned my addr 172.21.15.63:0/3622143261 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:21:59.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.905+0000 7f1ea8adf700 1 -- 172.21.15.63:0/3622143261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ea40fee00 msgr2=0x7f1ea410b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:21:59.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.905+0000 7f1ea8adf700 1 --2- 172.21.15.63:0/3622143261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ea40fee00 0x7f1ea410b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:21:59.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.905+0000 7f1ea8adf700 1 -- 172.21.15.63:0/3622143261 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea0005040 con 0x7f1ea40fff70 2023-12-07T16:21:59.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.905+0000 7f1ea8adf700 1 --2- 172.21.15.63:0/3622143261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea40fff70 0x7f1ea410b7e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1e9400eb40 tx=0x7f1e9400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:21:59.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.905+0000 7f1e99ffb700 1 -- 172.21.15.63:0/3622143261 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e94007cc0 con 0x7f1ea40fff70 2023-12-07T16:21:59.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.905+0000 7f1eab544700 1 -- 172.21.15.63:0/3622143261 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea410fb20 con 0x7f1ea40fff70 2023-12-07T16:21:59.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.905+0000 7f1eab544700 1 -- 172.21.15.63:0/3622143261 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea4110030 con 0x7f1ea40fff70 2023-12-07T16:21:59.905 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.906+0000 7f1e99ffb700 1 -- 172.21.15.63:0/3622143261 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1e9400f040 con 0x7f1ea40fff70 2023-12-07T16:21:59.905 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.906+0000 7f1e99ffb700 1 -- 172.21.15.63:0/3622143261 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e94009570 con 0x7f1ea40fff70 2023-12-07T16:21:59.905 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.907+0000 7f1e99ffb700 1 -- 172.21.15.63:0/3622143261 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 29) v1 ==== 45671+0+0 (secure 0 0 0) 0x7f1e940096d0 con 0x7f1ea40fff70 2023-12-07T16:21:59.905 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.907+0000 7f1eab544700 1 -- 172.21.15.63:0/3622143261 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e880052e0 con 0x7f1ea40fff70 2023-12-07T16:21:59.905 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.907+0000 7f1e99ffb700 1 --2- 172.21.15.63:0/3622143261 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f1e90038730 0x7f1e9003abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:21:59.905 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.907+0000 7f1e99ffb700 1 -- 172.21.15.63:0/3622143261 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f1e9404c100 con 0x7f1ea40fff70 2023-12-07T16:21:59.912 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.909+0000 7f1ea92e0700 1 --2- 172.21.15.63:0/3622143261 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f1e90038730 0x7f1e9003abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:21:59.912 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.910+0000 7f1ea92e0700 1 --2- 172.21.15.63:0/3622143261 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f1e90038730 0x7f1e9003abe0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0004890 tx=0x7f1ea0009e30 comp rx=0 tx=0).ready entity=mgr.24453 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:21:59.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:21:59.914+0000 7f1e99ffb700 1 -- 172.21.15.63:0/3622143261 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f1e94019080 con 0x7f1ea40fff70 2023-12-07T16:22:00.019 INFO:tasks.workunit.client.0.smithi063.stdout:4/745: sync 2023-12-07T16:22:00.020 INFO:tasks.workunit.client.0.smithi063.stdout:4/746: chown d1/d3/db/d2c/d63/c3d 0 1 2023-12-07T16:22:00.029 INFO:tasks.workunit.client.0.smithi063.stdout:4/747: dread d1/d3/d3a/f97 [0,4194304] 0 2023-12-07T16:22:00.031 INFO:tasks.workunit.client.0.smithi063.stdout:4/748: getdents d1/d3/d3f/d44 0 2023-12-07T16:22:00.032 INFO:tasks.workunit.client.0.smithi063.stdout:4/749: getdents d1/d3/db/d73 0 2023-12-07T16:22:00.034 INFO:tasks.workunit.client.0.smithi063.stdout:4/750: write d1/d3/db/d16/f7a [1726161,124472] 0 2023-12-07T16:22:00.034 INFO:tasks.workunit.client.0.smithi063.stdout:4/751: chown d1/d3/d51/fd8 382764327 1 2023-12-07T16:22:00.052 INFO:tasks.workunit.client.0.smithi063.stdout:4/752: dwrite d1/d3/db/d73/f78 [0,4194304] 0 2023-12-07T16:22:00.053 INFO:tasks.workunit.client.0.smithi063.stdout:4/753: write d1/d3/d3a/f97 [2001863,98052] 0 2023-12-07T16:22:00.057 INFO:tasks.workunit.client.0.smithi063.stdout:4/754: rename d1/d3/d3f/d49 to d1/dc6/ddc 0 2023-12-07T16:22:00.057 INFO:tasks.workunit.client.0.smithi063.stdout:4/755: truncate d1/d3/d3f/d44/fcc 389007 0 2023-12-07T16:22:00.168 INFO:tasks.workunit.client.0.smithi063.stdout:3/931: sync 2023-12-07T16:22:00.168 INFO:tasks.workunit.client.0.smithi063.stdout:3/932: dread - d7/d4f/d53/f68 zero size 2023-12-07T16:22:00.177 INFO:tasks.workunit.client.0.smithi063.stdout:3/933: dread d7/d4f/d53/f6a [0,4194304] 0 2023-12-07T16:22:00.179 INFO:tasks.workunit.client.0.smithi063.stdout:3/934: dread d7/d9/dd/d7f/ff9 [0,4194304] 0 2023-12-07T16:22:00.181 INFO:tasks.workunit.client.0.smithi063.stdout:3/935: dread d7/d9/dd/d7f/fb2 [0,4194304] 0 2023-12-07T16:22:00.181 INFO:tasks.workunit.client.0.smithi063.stdout:3/936: chown d7/d9/dd/f1e 22333 1 2023-12-07T16:22:00.182 INFO:tasks.workunit.client.0.smithi063.stdout:3/937: write d7/d9/d1b/fc6 [3522514,44334] 0 2023-12-07T16:22:00.190 INFO:tasks.workunit.client.0.smithi063.stdout:3/938: dread d7/d9/d1b/d5c/fe0 [0,4194304] 0 2023-12-07T16:22:00.191 INFO:tasks.workunit.client.0.smithi063.stdout:3/939: creat d7/d4f/d53/d72/d7d/f134 x:0 0 0 2023-12-07T16:22:00.192 INFO:tasks.workunit.client.0.smithi063.stdout:3/940: unlink d7/d4f/d53/d54/d76/f125 0 2023-12-07T16:22:00.192 INFO:tasks.workunit.client.0.smithi063.stdout:3/941: read - d7/d4f/d53/d72/d7d/f11b zero size 2023-12-07T16:22:00.192 INFO:tasks.workunit.client.0.smithi063.stdout:3/942: chown d7/d4f/d53/f68 65073 1 2023-12-07T16:22:00.193 INFO:tasks.workunit.client.0.smithi063.stdout:3/943: write d7/d9/dd/f2a [3438272,99509] 0 2023-12-07T16:22:00.193 INFO:tasks.workunit.client.0.smithi063.stdout:3/944: chown d7/d9/dd/d56/c6f 15812 1 2023-12-07T16:22:00.194 INFO:tasks.workunit.client.0.smithi063.stdout:3/945: stat d7/l10f 0 2023-12-07T16:22:00.194 INFO:tasks.workunit.client.0.smithi063.stdout:3/946: dread - d7/d49/dbf/fe1 zero size 2023-12-07T16:22:00.194 INFO:tasks.workunit.client.0.smithi063.stdout:3/947: fdatasync d7/d4f/d53/f102 0 2023-12-07T16:22:00.194 INFO:tasks.workunit.client.0.smithi063.stdout:3/948: dread - d7/d4f/d53/d72/d7d/f11b zero size 2023-12-07T16:22:00.194 INFO:tasks.workunit.client.0.smithi063.stdout:3/949: stat d7/d21/l2f 0 2023-12-07T16:22:00.210 INFO:tasks.workunit.client.0.smithi063.stdout:3/950: dwrite d7/d49/d4b/fdd [0,4194304] 0 2023-12-07T16:22:00.214 INFO:tasks.workunit.client.0.smithi063.stdout:3/951: dread d7/d9/dd/d7f/fac [0,4194304] 0 2023-12-07T16:22:00.214 INFO:tasks.workunit.client.0.smithi063.stdout:3/952: stat d7/d49/d4b/f5e 0 2023-12-07T16:22:00.216 INFO:tasks.workunit.client.0.smithi063.stdout:3/953: truncate d7/fa 2724092 0 2023-12-07T16:22:00.217 INFO:tasks.workunit.client.0.smithi063.stdout:3/954: truncate d7/d9/dd/fbb 1040369 0 2023-12-07T16:22:00.220 INFO:tasks.workunit.client.0.smithi063.stdout:6/920: sync 2023-12-07T16:22:00.220 INFO:tasks.workunit.client.0.smithi063.stdout:5/918: sync 2023-12-07T16:22:00.220 INFO:tasks.workunit.client.0.smithi063.stdout:1/927: sync 2023-12-07T16:22:00.220 INFO:tasks.workunit.client.0.smithi063.stdout:5/919: fsync d1/d3/d3a/f89 0 2023-12-07T16:22:00.221 INFO:tasks.workunit.client.0.smithi063.stdout:1/928: unlink d0/dd/d1f/d75/l7f 0 2023-12-07T16:22:00.221 INFO:tasks.workunit.client.0.smithi063.stdout:1/929: write d0/dd/d10/d6f/f7a [1099524,118121] 0 2023-12-07T16:22:00.224 INFO:tasks.workunit.client.0.smithi063.stdout:6/921: creat d0/d1e/d60/d68/d78/d9c/d9f/de4/d101/f141 x:0 0 0 2023-12-07T16:22:00.226 INFO:tasks.workunit.client.0.smithi063.stdout:5/920: rename d1/d31/d56/c70 to d1/d3/de/d1e/d6b/c118 0 2023-12-07T16:22:00.226 INFO:tasks.workunit.client.0.smithi063.stdout:5/921: chown d1/d31/db8/dee/d5e/c6d 0 1 2023-12-07T16:22:00.227 INFO:tasks.workunit.client.0.smithi063.stdout:3/955: dread d7/d49/d4b/d8e/ff4 [0,4194304] 0 2023-12-07T16:22:00.227 INFO:tasks.workunit.client.0.smithi063.stdout:1/930: symlink d0/dd/d10/d6f/da0/l140 0 2023-12-07T16:22:00.228 INFO:tasks.workunit.client.0.smithi063.stdout:6/922: symlink d0/d17/d95/dd6/l142 0 2023-12-07T16:22:00.229 INFO:tasks.workunit.client.0.smithi063.stdout:5/922: mknod d1/d31/db8/dee/c119 0 2023-12-07T16:22:00.231 INFO:tasks.workunit.client.0.smithi063.stdout:3/956: unlink d7/d9/dd/d56/fa7 0 2023-12-07T16:22:00.232 INFO:tasks.workunit.client.0.smithi063.stdout:3/957: readlink d7/d9/dd/l16 0 2023-12-07T16:22:00.232 INFO:tasks.workunit.client.0.smithi063.stdout:3/958: chown d7/d49/db0/ce9 70 1 2023-12-07T16:22:00.233 INFO:tasks.workunit.client.0.smithi063.stdout:1/931: creat d0/dd/d19/d50/d72/dc0/d134/f141 x:0 0 0 2023-12-07T16:22:00.236 INFO:tasks.workunit.client.0.smithi063.stdout:6/923: unlink d0/d17/d95/dd6/ce3 0 2023-12-07T16:22:00.238 INFO:tasks.workunit.client.0.smithi063.stdout:5/923: rename d1/d3/de/d1e/c63 to d1/d3/d3a/dcd/dd3/c11a 0 2023-12-07T16:22:00.242 INFO:tasks.workunit.client.0.smithi063.stdout:3/959: truncate d7/d9/d1b/fc6 230255 0 2023-12-07T16:22:00.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:00 smithi152 ceph-mon[121113]: mgrmap e29: smithi063.yohyyx(active, since 2s) 2023-12-07T16:22:00.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:00 smithi152 ceph-mon[121113]: [07/Dec/2023:16:21:59] ENGINE Bus STARTING 2023-12-07T16:22:00.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:00 smithi152 ceph-mon[121113]: [07/Dec/2023:16:21:59] ENGINE Serving on http://172.21.15.63:8765 2023-12-07T16:22:00.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:00 smithi152 ceph-mon[121113]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:22:00.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:00 smithi152 ceph-mon[121113]: [07/Dec/2023:16:21:59] ENGINE Serving on https://172.21.15.63:7150 2023-12-07T16:22:00.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:00 smithi152 ceph-mon[121113]: [07/Dec/2023:16:21:59] ENGINE Bus STARTED 2023-12-07T16:22:00.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:00 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:00.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:00 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:00.243 INFO:tasks.workunit.client.0.smithi063.stdout:1/932: creat d0/dd/d55/f142 x:0 0 0 2023-12-07T16:22:00.245 INFO:tasks.workunit.client.0.smithi063.stdout:5/924: mknod d1/d31/db8/dee/de3/c11b 0 2023-12-07T16:22:00.245 INFO:tasks.workunit.client.0.smithi063.stdout:6/924: dread d0/d17/d95/dd6/d8b/ffa [0,4194304] 0 2023-12-07T16:22:00.246 INFO:tasks.workunit.client.0.smithi063.stdout:1/933: creat d0/dd/d4f/f143 x:0 0 0 2023-12-07T16:22:00.251 INFO:tasks.workunit.client.0.smithi063.stdout:5/925: creat d1/d3/de/d1e/d6b/f11c x:0 0 0 2023-12-07T16:22:00.251 INFO:tasks.workunit.client.0.smithi063.stdout:6/925: creat d0/d1e/d60/d68/d78/d9c/f143 x:0 0 0 2023-12-07T16:22:00.253 INFO:tasks.workunit.client.0.smithi063.stdout:6/926: write d0/d1e/d60/d68/f70 [2868853,32851] 0 2023-12-07T16:22:00.254 INFO:tasks.workunit.client.0.smithi063.stdout:1/934: creat d0/dd/d1f/d75/dfe/d113/f144 x:0 0 0 2023-12-07T16:22:00.255 INFO:tasks.workunit.client.0.smithi063.stdout:5/926: creat d1/d3/de/d1e/d6b/f11d x:0 0 0 2023-12-07T16:22:00.255 INFO:tasks.workunit.client.0.smithi063.stdout:5/927: chown d1/d3/de/d1e/f1d 969907383 1 2023-12-07T16:22:00.257 INFO:tasks.workunit.client.0.smithi063.stdout:6/927: symlink d0/d1e/d60/d68/d78/df2/l144 0 2023-12-07T16:22:00.260 INFO:tasks.workunit.client.0.smithi063.stdout:1/935: unlink d0/dd/d10/d46/c10d 0 2023-12-07T16:22:00.262 INFO:tasks.workunit.client.0.smithi063.stdout:1/936: rename d0/dd/d10/d46/l96 to d0/dd/l145 0 2023-12-07T16:22:00.264 INFO:tasks.workunit.client.0.smithi063.stdout:1/937: mknod d0/dd/d19/d50/d72/dc0/d100/c146 0 2023-12-07T16:22:00.264 INFO:tasks.workunit.client.0.smithi063.stdout:1/938: fsync d0/dd/d10/d46/f73 0 2023-12-07T16:22:00.264 INFO:tasks.workunit.client.0.smithi063.stdout:1/939: write d0/d47/fe1 [4664254,53979] 0 2023-12-07T16:22:00.264 INFO:tasks.workunit.client.0.smithi063.stdout:3/960: dwrite d7/d49/dbf/fe1 [0,4194304] 0 2023-12-07T16:22:00.268 INFO:tasks.workunit.client.0.smithi063.stdout:3/961: unlink d7/d9/d1b/db8/cc3 0 2023-12-07T16:22:00.269 INFO:tasks.workunit.client.0.smithi063.stdout:3/962: creat d7/d49/d10b/f135 x:0 0 0 2023-12-07T16:22:00.270 INFO:tasks.workunit.client.0.smithi063.stdout:1/940: dread d0/dd/d10/d1b/d68/fde [0,4194304] 0 2023-12-07T16:22:00.272 INFO:tasks.workunit.client.0.smithi063.stdout:1/941: unlink d0/dd/d1f/f94 0 2023-12-07T16:22:00.272 INFO:tasks.workunit.client.0.smithi063.stdout:1/942: chown d0/dd/d19/d50/d71/l129 19 1 2023-12-07T16:22:00.272 INFO:tasks.workunit.client.0.smithi063.stdout:1/943: stat d0/dd/d19/f8b 0 2023-12-07T16:22:00.272 INFO:tasks.workunit.client.0.smithi063.stdout:6/928: dread d0/d1e/d60/d68/d69/d7d/f86 [0,4194304] 0 2023-12-07T16:22:00.275 INFO:tasks.workunit.client.0.smithi063.stdout:1/944: creat d0/dd/d10/d1b/f147 x:0 0 0 2023-12-07T16:22:00.275 INFO:tasks.workunit.client.0.smithi063.stdout:1/945: dread - d0/dd/d4f/f143 zero size 2023-12-07T16:22:00.277 INFO:tasks.workunit.client.0.smithi063.stdout:6/929: rename d0/d1e/d60/d68/d76 to d0/d17/d95/d145 0 2023-12-07T16:22:00.280 INFO:tasks.workunit.client.0.smithi063.stdout:6/930: creat d0/d1e/d60/d68/d78/df2/d121/f146 x:0 0 0 2023-12-07T16:22:00.280 INFO:tasks.workunit.client.0.smithi063.stdout:5/928: dwrite d1/d31/db8/dee/d8f/ddf/de4/f117 [0,4194304] 0 2023-12-07T16:22:00.285 INFO:tasks.workunit.client.0.smithi063.stdout:6/931: rename d0/d17/d1a/l42 to d0/d17/d95/d145/dae/l147 0 2023-12-07T16:22:00.292 INFO:tasks.workunit.client.0.smithi063.stdout:3/963: dwrite d7/d4f/d53/fa1 [0,4194304] 0 2023-12-07T16:22:00.293 INFO:tasks.workunit.client.0.smithi063.stdout:1/946: fsync d0/d47/fe1 0 2023-12-07T16:22:00.293 INFO:tasks.workunit.client.0.smithi063.stdout:3/964: unlink d7/d8d/fda 0 2023-12-07T16:22:00.296 INFO:tasks.workunit.client.0.smithi063.stdout:1/947: unlink d0/dd/d10/c6b 0 2023-12-07T16:22:00.304 INFO:tasks.workunit.client.0.smithi063.stdout:5/929: dwrite d1/d3/de/f1f [0,4194304] 0 2023-12-07T16:22:00.306 INFO:tasks.workunit.client.0.smithi063.stdout:6/932: dwrite d0/d1e/d60/d68/d78/d9c/d9f/de4/f117 [0,4194304] 0 2023-12-07T16:22:00.306 INFO:tasks.workunit.client.0.smithi063.stdout:6/933: write d0/d1e/d60/d68/d78/df2/f12d [590326,124711] 0 2023-12-07T16:22:00.306 INFO:tasks.workunit.client.0.smithi063.stdout:6/934: write d0/d1e/d20/d4a/f131 [521495,57004] 0 2023-12-07T16:22:00.306 INFO:tasks.workunit.client.0.smithi063.stdout:5/930: mknod d1/c11e 0 2023-12-07T16:22:00.306 INFO:tasks.workunit.client.0.smithi063.stdout:5/931: chown d1/d31/db8/dee/d5e/cde 134562 1 2023-12-07T16:22:00.306 INFO:tasks.workunit.client.0.smithi063.stdout:5/932: write d1/d3/de/d1e/f1d [4905559,85577] 0 2023-12-07T16:22:00.308 INFO:tasks.workunit.client.0.smithi063.stdout:6/935: mknod d0/d79/c148 0 2023-12-07T16:22:00.309 INFO:tasks.workunit.client.0.smithi063.stdout:5/933: mknod d1/c11f 0 2023-12-07T16:22:00.314 INFO:tasks.workunit.client.0.smithi063.stdout:1/948: dwrite d0/dd/d19/d50/fc7 [0,4194304] 0 2023-12-07T16:22:00.319 INFO:tasks.workunit.client.0.smithi063.stdout:6/936: rename d0/d1e/d60/d68/d78/d9c/f122 to d0/d1e/d60/d68/d69/d7d/f149 0 2023-12-07T16:22:00.324 INFO:tasks.workunit.client.0.smithi063.stdout:5/934: mkdir d1/d31/dc8/de5/d120 0 2023-12-07T16:22:00.324 INFO:tasks.workunit.client.0.smithi063.stdout:5/935: fdatasync d1/d3/d3a/f77 0 2023-12-07T16:22:00.325 INFO:tasks.workunit.client.0.smithi063.stdout:6/937: creat d0/d54/f14a x:0 0 0 2023-12-07T16:22:00.326 INFO:tasks.workunit.client.0.smithi063.stdout:5/936: getdents d1/d3/d3a/dcd/dff 0 2023-12-07T16:22:00.327 INFO:tasks.workunit.client.0.smithi063.stdout:5/937: dread - d1/d3/d3a/d5a/ff6 zero size 2023-12-07T16:22:00.327 INFO:tasks.workunit.client.0.smithi063.stdout:5/938: stat d1/d3/de6/df0 0 2023-12-07T16:22:00.328 INFO:tasks.workunit.client.0.smithi063.stdout:5/939: mknod d1/d31/d56/c121 0 2023-12-07T16:22:00.333 INFO:tasks.workunit.client.0.smithi063.stdout:5/940: rename d1/d3/de/f16 to d1/d3/d3a/d91/f122 0 2023-12-07T16:22:00.333 INFO:tasks.workunit.client.0.smithi063.stdout:4/756: sync 2023-12-07T16:22:00.334 INFO:tasks.workunit.client.0.smithi063.stdout:5/941: symlink d1/d3/d3a/d5a/dc6/l123 0 2023-12-07T16:22:00.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.336+0000 7f1eab544700 1 -- 172.21.15.63:0/3622143261 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1e88005860 con 0x7f1ea40fff70 2023-12-07T16:22:00.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.338+0000 7f1e99ffb700 1 -- 172.21.15.63:0/3622143261 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f1e9401b2c0 con 0x7f1ea40fff70 2023-12-07T16:22:00.337 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:22:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-07T16:22:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 2 2023-12-07T16:22:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:22:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-07T16:22:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 1 2023-12-07T16:22:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:22:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-07T16:22:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 6 2023-12-07T16:22:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:22:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-07T16:22:00.338 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 4 2023-12-07T16:22:00.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:22:00.338 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-07T16:22:00.338 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 12, 2023-12-07T16:22:00.338 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 1 2023-12-07T16:22:00.338 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-07T16:22:00.338 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:22:00.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.340+0000 7f1eab544700 1 -- 172.21.15.63:0/3622143261 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f1e90038730 msgr2=0x7f1e9003abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:00.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.340+0000 7f1eab544700 1 --2- 172.21.15.63:0/3622143261 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f1e90038730 0x7f1e9003abe0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0004890 tx=0x7f1ea0009e30 comp rx=0 tx=0).stop 2023-12-07T16:22:00.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.340+0000 7f1eab544700 1 -- 172.21.15.63:0/3622143261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea40fff70 msgr2=0x7f1ea410b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:00.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.340+0000 7f1eab544700 1 --2- 172.21.15.63:0/3622143261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea40fff70 0x7f1ea410b7e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1e9400eb40 tx=0x7f1e9400b040 comp rx=0 tx=0).stop 2023-12-07T16:22:00.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.340+0000 7f1eab544700 1 -- 172.21.15.63:0/3622143261 shutdown_connections 2023-12-07T16:22:00.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.340+0000 7f1eab544700 1 --2- 172.21.15.63:0/3622143261 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f1e90038730 0x7f1e9003abe0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:00.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.340+0000 7f1eab544700 1 --2- 172.21.15.63:0/3622143261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ea40fee00 0x7f1ea410b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:00.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.340+0000 7f1eab544700 1 --2- 172.21.15.63:0/3622143261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea40fff70 0x7f1ea410b7e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:00.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.340+0000 7f1eab544700 1 -- 172.21.15.63:0/3622143261 >> 172.21.15.63:0/3622143261 conn(0x7f1ea40fa5d0 msgr2=0x7f1ea4103230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:22:00.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.341+0000 7f1eab544700 1 -- 172.21.15.63:0/3622143261 shutdown_connections 2023-12-07T16:22:00.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.341+0000 7f1eab544700 1 -- 172.21.15.63:0/3622143261 wait complete. 2023-12-07T16:22:00.340 INFO:tasks.workunit.client.0.smithi063.stdout:1/949: dwrite d0/f1 [4194304,4194304] 0 2023-12-07T16:22:00.340 INFO:tasks.workunit.client.0.smithi063.stdout:1/950: truncate d0/dd/d1f/fe3 173367 0 2023-12-07T16:22:00.349 INFO:tasks.workunit.client.0.smithi063.stdout:4/757: dread d1/d3/db/d2c/f77 [0,4194304] 0 2023-12-07T16:22:00.350 INFO:tasks.workunit.client.0.smithi063.stdout:6/938: dread d0/d17/d1a/f4c [0,4194304] 0 2023-12-07T16:22:00.354 INFO:tasks.workunit.client.0.smithi063.stdout:4/758: rmdir d1/d3/d9f/ddb 0 2023-12-07T16:22:00.354 INFO:tasks.workunit.client.0.smithi063.stdout:6/939: creat d0/d1e/d60/d68/f14b x:0 0 0 2023-12-07T16:22:00.356 INFO:tasks.workunit.client.0.smithi063.stdout:4/759: creat d1/d3/db/d16/fdd x:0 0 0 2023-12-07T16:22:00.356 INFO:tasks.workunit.client.0.smithi063.stdout:4/760: read - d1/dc6/ddc/d8b/fa4 zero size 2023-12-07T16:22:00.357 INFO:tasks.workunit.client.0.smithi063.stdout:5/942: dwrite d1/d31/db8/dee/d8f/ddf/f106 [0,4194304] 0 2023-12-07T16:22:00.358 INFO:tasks.workunit.client.0.smithi063.stdout:6/940: rename d0/d17/d95/d145/da4 to d0/d1e/d60/d68/d78/d112/d12e/d14c 0 2023-12-07T16:22:00.359 INFO:tasks.workunit.client.0.smithi063.stdout:4/761: mkdir d1/dc6/ddc/d64/d80/dde 0 2023-12-07T16:22:00.360 INFO:tasks.workunit.client.0.smithi063.stdout:5/943: mknod d1/d31/db8/dee/d8f/c124 0 2023-12-07T16:22:00.360 INFO:tasks.workunit.client.0.smithi063.stdout:5/944: stat d1/d3/d3a/dcd/dd3/d7e/c94 0 2023-12-07T16:22:00.360 INFO:tasks.workunit.client.0.smithi063.stdout:6/941: truncate d0/d54/f56 2829236 0 2023-12-07T16:22:00.361 INFO:tasks.workunit.client.0.smithi063.stdout:4/762: unlink d1/dc6/ddc/f61 0 2023-12-07T16:22:00.362 INFO:tasks.workunit.client.0.smithi063.stdout:5/945: creat d1/d31/d56/db7/f125 x:0 0 0 2023-12-07T16:22:00.365 INFO:tasks.workunit.client.0.smithi063.stdout:6/942: rename d0/d1e/d60/d68/d78/d112/d12e/d14c/dcc/d108 to d0/d17/d95/dd6/d8b/d14d 0 2023-12-07T16:22:00.366 INFO:tasks.workunit.client.0.smithi063.stdout:4/763: mkdir d1/d3/db/d2c/ddf 0 2023-12-07T16:22:00.366 INFO:tasks.workunit.client.0.smithi063.stdout:1/951: dwrite d0/dd/d4f/f143 [0,4194304] 0 2023-12-07T16:22:00.369 INFO:tasks.workunit.client.0.smithi063.stdout:4/764: unlink d1/dc6/ddc/d64/d80/fa6 0 2023-12-07T16:22:00.373 INFO:tasks.workunit.client.0.smithi063.stdout:4/765: creat d1/d3/fe0 x:0 0 0 2023-12-07T16:22:00.385 INFO:tasks.workunit.client.0.smithi063.stdout:6/943: dwrite d0/d54/f14a [0,4194304] 0 2023-12-07T16:22:00.393 INFO:tasks.workunit.client.0.smithi063.stdout:4/766: dwrite d1/d3/db/d16/fdd [0,4194304] 0 2023-12-07T16:22:00.393 INFO:tasks.workunit.client.0.smithi063.stdout:6/944: dread d0/d79/f10c [0,4194304] 0 2023-12-07T16:22:00.395 INFO:tasks.workunit.client.0.smithi063.stdout:6/945: symlink d0/d17/d95/d145/dae/l14e 0 2023-12-07T16:22:00.395 INFO:tasks.workunit.client.0.smithi063.stdout:4/767: write d1/d3/f4e [2921770,63208] 0 2023-12-07T16:22:00.396 INFO:tasks.workunit.client.0.smithi063.stdout:6/946: creat d0/d1e/f14f x:0 0 0 2023-12-07T16:22:00.397 INFO:tasks.workunit.client.0.smithi063.stdout:4/768: rename d1/dc6/ddc/d8b/fab to d1/d3/db/d16/d66/fe1 0 2023-12-07T16:22:00.399 INFO:tasks.workunit.client.0.smithi063.stdout:6/947: creat d0/d1e/d60/d68/d78/d9c/d9f/df7/f150 x:0 0 0 2023-12-07T16:22:00.400 INFO:tasks.workunit.client.0.smithi063.stdout:4/769: mkdir d1/d3/de2 0 2023-12-07T16:22:00.400 INFO:tasks.workunit.client.0.smithi063.stdout:4/770: chown d1/c93 114 1 2023-12-07T16:22:00.400 INFO:tasks.workunit.client.0.smithi063.stdout:6/948: creat d0/d17/d1a/f151 x:0 0 0 2023-12-07T16:22:00.401 INFO:tasks.workunit.client.0.smithi063.stdout:4/771: mknod d1/d3/db/d16/ce3 0 2023-12-07T16:22:00.402 INFO:tasks.workunit.client.0.smithi063.stdout:6/949: write d0/d17/d1a/f4c [1958337,17724] 0 2023-12-07T16:22:00.402 INFO:tasks.workunit.client.0.smithi063.stdout:4/772: symlink d1/dc6/ddc/d64/dd9/le4 0 2023-12-07T16:22:00.402 INFO:tasks.workunit.client.0.smithi063.stdout:4/773: getdents d1/d3/de2 0 2023-12-07T16:22:00.403 INFO:tasks.workunit.client.0.smithi063.stdout:6/950: rmdir d0/d1e/d1d 39 2023-12-07T16:22:00.403 INFO:tasks.workunit.client.0.smithi063.stdout:6/951: write d0/d17/d95/dd6/d5a/fc0 [634768,93210] 0 2023-12-07T16:22:00.403 INFO:tasks.workunit.client.0.smithi063.stdout:6/952: stat d0/d17/d95/dd6/d5a 0 2023-12-07T16:22:00.403 INFO:tasks.workunit.client.0.smithi063.stdout:4/774: getdents d1 0 2023-12-07T16:22:00.403 INFO:tasks.workunit.client.0.smithi063.stdout:4/775: write d1/d3/d3f/fd1 [799215,113094] 0 2023-12-07T16:22:00.405 INFO:tasks.workunit.client.0.smithi063.stdout:6/953: creat d0/d1e/d1d/d4f/f152 x:0 0 0 2023-12-07T16:22:00.405 INFO:tasks.workunit.client.0.smithi063.stdout:6/954: fsync d0/d1e/d1d/f27 0 2023-12-07T16:22:00.405 INFO:tasks.workunit.client.0.smithi063.stdout:4/776: creat d1/dc6/fe5 x:0 0 0 2023-12-07T16:22:00.405 INFO:tasks.workunit.client.0.smithi063.stdout:4/777: fdatasync d1/f81 0 2023-12-07T16:22:00.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:00 smithi063 ceph-mon[112095]: mgrmap e29: smithi063.yohyyx(active, since 2s) 2023-12-07T16:22:00.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:00 smithi063 ceph-mon[112095]: [07/Dec/2023:16:21:59] ENGINE Bus STARTING 2023-12-07T16:22:00.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:00 smithi063 ceph-mon[112095]: [07/Dec/2023:16:21:59] ENGINE Serving on http://172.21.15.63:8765 2023-12-07T16:22:00.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:00 smithi063 ceph-mon[112095]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:22:00.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:00 smithi063 ceph-mon[112095]: [07/Dec/2023:16:21:59] ENGINE Serving on https://172.21.15.63:7150 2023-12-07T16:22:00.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:00 smithi063 ceph-mon[112095]: [07/Dec/2023:16:21:59] ENGINE Bus STARTED 2023-12-07T16:22:00.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:00 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:00.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:00 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:00.406 INFO:tasks.workunit.client.0.smithi063.stdout:6/955: truncate d0/d1e/d1d/d1f/d4b/fc1 336945 0 2023-12-07T16:22:00.408 INFO:tasks.workunit.client.0.smithi063.stdout:6/956: link d0/d1e/d1d/c135 d0/d17/d95/c153 0 2023-12-07T16:22:00.408 INFO:tasks.workunit.client.0.smithi063.stdout:6/957: readlink d0/d17/l23 0 2023-12-07T16:22:00.408 INFO:tasks.workunit.client.0.smithi063.stdout:4/778: rename d1/d3/db/d16/d66/fac to d1/d3/db/d41/fe6 0 2023-12-07T16:22:00.409 INFO:tasks.workunit.client.0.smithi063.stdout:6/958: mkdir d0/d17/d1a/d38/d154 0 2023-12-07T16:22:00.410 INFO:tasks.workunit.client.0.smithi063.stdout:4/779: truncate d1/d3/db/d2c/d63/f48 2160671 0 2023-12-07T16:22:00.410 INFO:tasks.workunit.client.0.smithi063.stdout:4/780: stat d1/d3/d51/c69 0 2023-12-07T16:22:00.410 INFO:tasks.workunit.client.0.smithi063.stdout:4/781: write d1/d3/db/d73/fb8 [471509,71446] 0 2023-12-07T16:22:00.418 INFO:tasks.workunit.client.0.smithi063.stdout:6/959: dread d0/d17/d46/f9e [0,4194304] 0 2023-12-07T16:22:00.420 INFO:tasks.workunit.client.0.smithi063.stdout:6/960: write d0/d79/fff [876500,59489] 0 2023-12-07T16:22:00.422 INFO:tasks.workunit.client.0.smithi063.stdout:6/961: link d0/d54/l104 d0/d54/d11f/l155 0 2023-12-07T16:22:00.430 INFO:tasks.workunit.client.0.smithi063.stdout:4/782: dwrite d1/d3/db/d2c/d63/d62/f8a [0,4194304] 0 2023-12-07T16:22:00.433 INFO:tasks.workunit.client.0.smithi063.stdout:6/962: dread d0/d1e/d60/d68/d78/d9c/d9f/de4/f117 [0,4194304] 0 2023-12-07T16:22:00.433 INFO:tasks.workunit.client.0.smithi063.stdout:4/783: creat d1/dc6/ddc/d64/fe7 x:0 0 0 2023-12-07T16:22:00.436 INFO:tasks.workunit.client.0.smithi063.stdout:4/784: dread d1/d3/db/d2c/d63/d62/f67 [0,4194304] 0 2023-12-07T16:22:00.438 INFO:tasks.workunit.client.0.smithi063.stdout:4/785: link d1/d3/db/d2c/d63/c1b d1/d3/d3f/ce8 0 2023-12-07T16:22:00.439 INFO:tasks.workunit.client.0.smithi063.stdout:4/786: mknod d1/d3/db/d73/ce9 0 2023-12-07T16:22:00.439 INFO:tasks.workunit.client.0.smithi063.stdout:4/787: fdatasync d1/dc6/ddc/d64/dd9/fc1 0 2023-12-07T16:22:00.441 INFO:tasks.workunit.client.0.smithi063.stdout:6/963: write d0/d1e/d2a/f52 [3783862,19896] 0 2023-12-07T16:22:00.443 INFO:tasks.workunit.client.0.smithi063.stdout:6/964: rename d0/d17/df4 to d0/d54/d156 0 2023-12-07T16:22:00.444 INFO:tasks.workunit.client.0.smithi063.stdout:6/965: chown d0/d1e/d1d/d4f/d88/fea 333795 1 2023-12-07T16:22:00.445 INFO:tasks.workunit.client.0.smithi063.stdout:6/966: mknod d0/d1e/d60/d68/d78/d112/d12e/c157 0 2023-12-07T16:22:00.446 INFO:tasks.workunit.client.0.smithi063.stdout:6/967: rmdir d0/d17/d1a/d38 39 2023-12-07T16:22:00.460 INFO:tasks.workunit.client.0.smithi063.stdout:4/788: dwrite d1/dc6/ddc/d64/d80/f9c [0,4194304] 0 2023-12-07T16:22:00.462 INFO:tasks.workunit.client.0.smithi063.stdout:4/789: creat d1/d3/d9f/fea x:0 0 0 2023-12-07T16:22:00.464 INFO:tasks.workunit.client.0.smithi063.stdout:4/790: creat d1/d3/db/d2c/d63/d62/feb x:0 0 0 2023-12-07T16:22:00.466 INFO:tasks.workunit.client.0.smithi063.stdout:4/791: symlink d1/d3/lec 0 2023-12-07T16:22:00.466 INFO:tasks.workunit.client.0.smithi063.stdout:4/792: creat d1/dc6/ddc/dc8/fed x:0 0 0 2023-12-07T16:22:00.469 INFO:tasks.workunit.client.0.smithi063.stdout:6/968: dwrite d0/d1e/d60/d68/d69/d7d/f86 [4194304,4194304] 0 2023-12-07T16:22:00.469 INFO:tasks.workunit.client.0.smithi063.stdout:6/969: dread - d0/d17/d46/d93/f13c zero size 2023-12-07T16:22:00.475 INFO:tasks.workunit.client.0.smithi063.stdout:4/793: dread d1/d3/d3f/d44/f70 [0,4194304] 0 2023-12-07T16:22:00.477 INFO:tasks.workunit.client.0.smithi063.stdout:4/794: write d1/d3/db/d73/f78 [7586614,53112] 0 2023-12-07T16:22:00.487 INFO:tasks.workunit.client.0.smithi063.stdout:4/795: dread d1/d3/d3f/d44/f59 [0,4194304] 0 2023-12-07T16:22:00.488 INFO:tasks.workunit.client.0.smithi063.stdout:6/970: dwrite d0/d1e/d1d/d1f/f32 [0,4194304] 0 2023-12-07T16:22:00.488 INFO:tasks.workunit.client.0.smithi063.stdout:6/971: chown d0/d1e/d1d/d1f/d6c/fa8 72010092 1 2023-12-07T16:22:00.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.491+0000 7f6a55e5b700 1 -- 172.21.15.63:0/2293833034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a50104c40 msgr2=0x7f6a50107020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:00.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.491+0000 7f6a55e5b700 1 --2- 172.21.15.63:0/2293833034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a50104c40 0x7f6a50107020 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6a40004940 tx=0x7f6a40009e30 comp rx=0 tx=0).stop 2023-12-07T16:22:00.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.491+0000 7f6a55e5b700 1 -- 172.21.15.63:0/2293833034 shutdown_connections 2023-12-07T16:22:00.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.491+0000 7f6a55e5b700 1 --2- 172.21.15.63:0/2293833034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a50107560 0x7f6a50109940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:00.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.491+0000 7f6a55e5b700 1 --2- 172.21.15.63:0/2293833034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a50104c40 0x7f6a50107020 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:00.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.491+0000 7f6a55e5b700 1 -- 172.21.15.63:0/2293833034 >> 172.21.15.63:0/2293833034 conn(0x7f6a50069b20 msgr2=0x7f6a5006bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:22:00.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.491+0000 7f6a55e5b700 1 -- 172.21.15.63:0/2293833034 shutdown_connections 2023-12-07T16:22:00.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.491+0000 7f6a55e5b700 1 -- 172.21.15.63:0/2293833034 wait complete. 2023-12-07T16:22:00.490 INFO:tasks.workunit.client.0.smithi063.stdout:4/796: unlink d1/d3/db/c11 0 2023-12-07T16:22:00.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.492+0000 7f6a55e5b700 1 Processor -- start 2023-12-07T16:22:00.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.492+0000 7f6a55e5b700 1 -- start start 2023-12-07T16:22:00.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.492+0000 7f6a55e5b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a50104c40 0x7f6a50116790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:00.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.492+0000 7f6a55e5b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a50107560 0x7f6a50118ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:00.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.492+0000 7f6a55e5b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5006f8a0 con 0x7f6a50107560 2023-12-07T16:22:00.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.492+0000 7f6a55e5b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5006f9e0 con 0x7f6a50104c40 2023-12-07T16:22:00.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.492+0000 7f6a4effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a50107560 0x7f6a50118ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:00.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.493+0000 7f6a4effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a50107560 0x7f6a50118ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52016/0 (socket says 172.21.15.63:52016) 2023-12-07T16:22:00.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.493+0000 7f6a4effd700 1 -- 172.21.15.63:0/967150707 learned_addr learned my addr 172.21.15.63:0/967150707 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:22:00.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.493+0000 7f6a4f7fe700 1 --2- 172.21.15.63:0/967150707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a50104c40 0x7f6a50116790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:00.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.493+0000 7f6a4effd700 1 -- 172.21.15.63:0/967150707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a50104c40 msgr2=0x7f6a50116790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:00.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.493+0000 7f6a4effd700 1 --2- 172.21.15.63:0/967150707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a50104c40 0x7f6a50116790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:00.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.493+0000 7f6a4effd700 1 -- 172.21.15.63:0/967150707 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a40005040 con 0x7f6a50107560 2023-12-07T16:22:00.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.493+0000 7f6a4f7fe700 1 --2- 172.21.15.63:0/967150707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a50104c40 0x7f6a50116790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T16:22:00.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.493+0000 7f6a4effd700 1 --2- 172.21.15.63:0/967150707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a50107560 0x7f6a50118ce0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400eb70 tx=0x7f6a4400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:22:00.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.494+0000 7f6a37fff700 1 -- 172.21.15.63:0/967150707 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a44007cc0 con 0x7f6a50107560 2023-12-07T16:22:00.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.494+0000 7f6a37fff700 1 -- 172.21.15.63:0/967150707 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6a4400f040 con 0x7f6a50107560 2023-12-07T16:22:00.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.494+0000 7f6a37fff700 1 -- 172.21.15.63:0/967150707 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a44009580 con 0x7f6a50107560 2023-12-07T16:22:00.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.494+0000 7f6a55e5b700 1 -- 172.21.15.63:0/967150707 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a501192e0 con 0x7f6a50107560 2023-12-07T16:22:00.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.494+0000 7f6a55e5b700 1 -- 172.21.15.63:0/967150707 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a50119820 con 0x7f6a50107560 2023-12-07T16:22:00.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.495+0000 7f6a55e5b700 1 -- 172.21.15.63:0/967150707 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5004bb80 con 0x7f6a50107560 2023-12-07T16:22:00.494 INFO:tasks.workunit.client.0.smithi063.stdout:6/972: link d0/d54/c140 d0/d1e/d60/d68/d78/d9c/d9f/df7/c158 0 2023-12-07T16:22:00.496 INFO:tasks.workunit.client.0.smithi063.stdout:6/973: creat d0/d1e/d60/d68/d78/df2/f159 x:0 0 0 2023-12-07T16:22:00.496 INFO:tasks.workunit.client.0.smithi063.stdout:6/974: chown d0/d79/db9/fcf 148 1 2023-12-07T16:22:00.496 INFO:tasks.workunit.client.0.smithi063.stdout:4/797: dread d1/d3/db/d73/fbf [0,4194304] 0 2023-12-07T16:22:00.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.495+0000 7f6a37fff700 1 -- 172.21.15.63:0/967150707 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 29) v1 ==== 45671+0+0 (secure 0 0 0) 0x7f6a440096e0 con 0x7f6a50107560 2023-12-07T16:22:00.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.496+0000 7f6a37fff700 1 --2- 172.21.15.63:0/967150707 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f6a380386e0 0x7f6a3803ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:00.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.496+0000 7f6a37fff700 1 -- 172.21.15.63:0/967150707 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f6a4404c1e0 con 0x7f6a50107560 2023-12-07T16:22:00.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.496+0000 7f6a4f7fe700 1 --2- 172.21.15.63:0/967150707 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f6a380386e0 0x7f6a3803ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:00.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.496+0000 7f6a4f7fe700 1 --2- 172.21.15.63:0/967150707 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f6a380386e0 0x7f6a3803ab90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009fd0 tx=0x7f6a40009e30 comp rx=0 tx=0).ready entity=mgr.24453 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:22:00.498 INFO:tasks.workunit.client.0.smithi063.stdout:6/975: mkdir d0/d1e/d60/d68/d78/d112/d12e/d14c/d107/d15a 0 2023-12-07T16:22:00.499 INFO:tasks.workunit.client.0.smithi063.stdout:6/976: fsync d0/d17/d46/fee 0 2023-12-07T16:22:00.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.500+0000 7f6a37fff700 1 -- 172.21.15.63:0/967150707 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f6a4401c540 con 0x7f6a50107560 2023-12-07T16:22:00.500 INFO:tasks.workunit.client.0.smithi063.stdout:4/798: link d1/dc6/ddc/d64/fc2 d1/d3/d3a/fee 0 2023-12-07T16:22:00.500 INFO:tasks.workunit.client.0.smithi063.stdout:4/799: stat d1/d3/d3a/f97 0 2023-12-07T16:22:00.501 INFO:tasks.workunit.client.0.smithi063.stdout:6/977: symlink d0/d1e/d1d/d1f/d4b/l15b 0 2023-12-07T16:22:00.504 INFO:tasks.workunit.client.0.smithi063.stdout:4/800: truncate d1/d3/d3f/d44/f70 3964267 0 2023-12-07T16:22:00.506 INFO:tasks.workunit.client.0.smithi063.stdout:6/978: symlink d0/d1e/d60/d68/d78/l15c 0 2023-12-07T16:22:00.506 INFO:tasks.workunit.client.0.smithi063.stdout:4/801: write d1/d3/db/d2c/d63/f33 [2376093,94454] 0 2023-12-07T16:22:00.508 INFO:tasks.workunit.client.0.smithi063.stdout:6/979: rename d0/d1e/d1d/d4f/d88/d118 to d0/d1e/d60/d15d 0 2023-12-07T16:22:00.510 INFO:tasks.workunit.client.0.smithi063.stdout:6/980: symlink d0/d1e/d29/l15e 0 2023-12-07T16:22:00.522 INFO:tasks.workunit.client.0.smithi063.stdout:6/981: creat d0/d1e/d60/d68/d78/d112/d12e/d14c/d107/f15f x:0 0 0 2023-12-07T16:22:00.526 INFO:tasks.workunit.client.0.smithi063.stdout:4/802: dread d1/d3/d3a/f9b [0,4194304] 0 2023-12-07T16:22:00.526 INFO:tasks.workunit.client.0.smithi063.stdout:4/803: chown d1/dc6/ddc/d64/l92 81423 1 2023-12-07T16:22:00.526 INFO:tasks.workunit.client.0.smithi063.stdout:4/804: stat d1/d3/db/f3e 0 2023-12-07T16:22:00.528 INFO:tasks.workunit.client.0.smithi063.stdout:4/805: getdents d1/d3 0 2023-12-07T16:22:00.530 INFO:tasks.workunit.client.0.smithi063.stdout:4/806: truncate d1/dc6/ddc/d64/d80/fad 1154713 0 2023-12-07T16:22:00.532 INFO:tasks.workunit.client.0.smithi063.stdout:4/807: write d1/d3/db/f20 [2681516,113524] 0 2023-12-07T16:22:00.534 INFO:tasks.workunit.client.0.smithi063.stdout:6/982: dread d0/d1e/d1d/f3d [0,4194304] 0 2023-12-07T16:22:00.536 INFO:tasks.workunit.client.0.smithi063.stdout:4/808: creat d1/d3/d3f/fef x:0 0 0 2023-12-07T16:22:00.541 INFO:tasks.workunit.client.0.smithi063.stdout:4/809: rmdir d1/d3/de2 0 2023-12-07T16:22:00.548 INFO:tasks.workunit.client.0.smithi063.stdout:4/810: dread d1/d3/db/d41/f6a [0,4194304] 0 2023-12-07T16:22:00.550 INFO:tasks.workunit.client.0.smithi063.stdout:4/811: creat d1/dc6/ddc/d64/ff0 x:0 0 0 2023-12-07T16:22:00.550 INFO:tasks.workunit.client.0.smithi063.stdout:4/812: chown d1/d3/d3f/fef 3042 1 2023-12-07T16:22:00.551 INFO:tasks.workunit.client.0.smithi063.stdout:4/813: mkdir d1/d3/db/d2c/d63/d99/df1 0 2023-12-07T16:22:00.562 INFO:tasks.workunit.client.0.smithi063.stdout:6/983: dwrite d0/d17/fa9 [0,4194304] 0 2023-12-07T16:22:00.562 INFO:tasks.workunit.client.0.smithi063.stdout:6/984: read - d0/d1e/d1d/d4f/f152 zero size 2023-12-07T16:22:00.565 INFO:tasks.workunit.client.0.smithi063.stdout:6/985: symlink d0/d17/d95/d145/dae/l160 0 2023-12-07T16:22:00.565 INFO:tasks.workunit.client.0.smithi063.stdout:6/986: dread - d0/d1e/d60/d68/d78/d9c/d9f/db8/fed zero size 2023-12-07T16:22:00.565 INFO:tasks.workunit.client.0.smithi063.stdout:4/814: dwrite d1/d3/db/d2c/d63/d99/dd0/fd7 [0,4194304] 0 2023-12-07T16:22:00.565 INFO:tasks.workunit.client.0.smithi063.stdout:4/815: fsync d1/d3/f1e 0 2023-12-07T16:22:00.571 INFO:tasks.workunit.client.0.smithi063.stdout:4/816: dread d1/d3/d3f/d44/f70 [0,4194304] 0 2023-12-07T16:22:00.572 INFO:tasks.workunit.client.0.smithi063.stdout:6/987: rmdir d0/d1e/d60/d68/d78/d9c/d9f/de4/d101 39 2023-12-07T16:22:00.574 INFO:tasks.workunit.client.0.smithi063.stdout:4/817: creat d1/d3/db/d2c/ff2 x:0 0 0 2023-12-07T16:22:00.574 INFO:tasks.workunit.client.0.smithi063.stdout:4/818: chown d1/d3/d3f/f9a 359477121 1 2023-12-07T16:22:00.575 INFO:tasks.workunit.client.0.smithi063.stdout:6/988: rename d0/d17/d1a/d38/l3c to d0/d17/l161 0 2023-12-07T16:22:00.578 INFO:tasks.workunit.client.0.smithi063.stdout:4/819: creat d1/dc6/ddc/d64/d80/ff3 x:0 0 0 2023-12-07T16:22:00.583 INFO:tasks.workunit.client.0.smithi063.stdout:5/946: sync 2023-12-07T16:22:00.583 INFO:tasks.workunit.client.0.smithi063.stdout:1/952: sync 2023-12-07T16:22:00.583 INFO:tasks.workunit.client.0.smithi063.stdout:3/965: sync 2023-12-07T16:22:00.583 INFO:tasks.workunit.client.0.smithi063.stdout:5/947: readlink d1/d3/de/l71 0 2023-12-07T16:22:00.586 INFO:tasks.workunit.client.0.smithi063.stdout:3/966: rename d7/d4f/d53/dc7 to d7/d9/d1b/d136 0 2023-12-07T16:22:00.587 INFO:tasks.workunit.client.0.smithi063.stdout:1/953: symlink d0/dd/d1f/d75/dfe/d113/l148 0 2023-12-07T16:22:00.589 INFO:tasks.workunit.client.0.smithi063.stdout:5/948: symlink d1/l126 0 2023-12-07T16:22:00.590 INFO:tasks.workunit.client.0.smithi063.stdout:5/949: fsync d1/d3/fc5 0 2023-12-07T16:22:00.590 INFO:tasks.workunit.client.0.smithi063.stdout:1/954: mknod d0/dd/d55/c149 0 2023-12-07T16:22:00.595 INFO:tasks.workunit.client.0.smithi063.stdout:5/950: creat d1/d3/de6/df0/f127 x:0 0 0 2023-12-07T16:22:00.596 INFO:tasks.workunit.client.0.smithi063.stdout:1/955: link d0/dd/f41 d0/dd/d55/f14a 0 2023-12-07T16:22:00.596 INFO:tasks.workunit.client.0.smithi063.stdout:1/956: chown d0/dd/d1f/cce 213742 1 2023-12-07T16:22:00.598 INFO:tasks.workunit.client.0.smithi063.stdout:5/951: creat d1/d3/de/d1e/f128 x:0 0 0 2023-12-07T16:22:00.600 INFO:tasks.workunit.client.0.smithi063.stdout:1/957: creat d0/dd/d10/d6f/da0/f14b x:0 0 0 2023-12-07T16:22:00.603 INFO:tasks.workunit.client.0.smithi063.stdout:1/958: truncate d0/dd/d19/d50/d71/f64 2806379 0 2023-12-07T16:22:00.603 INFO:tasks.workunit.client.0.smithi063.stdout:1/959: chown d0/dd/d10/d6f/dd8/dc3 833805 1 2023-12-07T16:22:00.605 INFO:tasks.workunit.client.0.smithi063.stdout:1/960: link d0/dd/d19/d50/d71/d9b/c127 d0/dd/d55/d11e/c14c 0 2023-12-07T16:22:00.607 INFO:tasks.workunit.client.0.smithi063.stdout:1/961: dread d0/dd/f56 [0,4194304] 0 2023-12-07T16:22:00.608 INFO:tasks.workunit.client.0.smithi063.stdout:1/962: symlink d0/dd/d19/dbd/l14d 0 2023-12-07T16:22:00.614 INFO:tasks.workunit.client.0.smithi063.stdout:6/989: dwrite d0/d1e/d60/d68/fc9 [0,4194304] 0 2023-12-07T16:22:00.619 INFO:tasks.workunit.client.0.smithi063.stdout:1/963: symlink d0/dd/d10/l14e 0 2023-12-07T16:22:00.622 INFO:tasks.workunit.client.0.smithi063.stdout:4/820: dwrite d1/d3/db/d2c/d63/f84 [4194304,4194304] 0 2023-12-07T16:22:00.625 INFO:tasks.workunit.client.0.smithi063.stdout:1/964: write d0/dd/d4f/f143 [1638264,114166] 0 2023-12-07T16:22:00.625 INFO:tasks.workunit.client.0.smithi063.stdout:1/965: truncate d0/dd/d19/fa1 1674410 0 2023-12-07T16:22:00.625 INFO:tasks.workunit.client.0.smithi063.stdout:4/821: link d1/d3/d3a/l42 d1/dc6/lf4 0 2023-12-07T16:22:00.625 INFO:tasks.workunit.client.0.smithi063.stdout:4/822: dread - d1/d3/db/d2c/ff2 zero size 2023-12-07T16:22:00.625 INFO:tasks.workunit.client.0.smithi063.stdout:4/823: chown d1/d3/db/f56 4 1 2023-12-07T16:22:00.625 INFO:tasks.workunit.client.0.smithi063.stdout:4/824: stat d1/d3/fe0 0 2023-12-07T16:22:00.626 INFO:tasks.workunit.client.0.smithi063.stdout:4/825: stat d1/d3/db/d73 0 2023-12-07T16:22:00.627 INFO:tasks.workunit.client.0.smithi063.stdout:5/952: dwrite d1/d3/de6/df0/ff5 [0,4194304] 0 2023-12-07T16:22:00.628 INFO:tasks.workunit.client.0.smithi063.stdout:3/967: dwrite d7/d49/d4b/d8e/fa4 [0,4194304] 0 2023-12-07T16:22:00.632 INFO:tasks.workunit.client.0.smithi063.stdout:5/953: creat d1/d3/d3a/dcd/dd3/f129 x:0 0 0 2023-12-07T16:22:00.634 INFO:tasks.workunit.client.0.smithi063.stdout:3/968: creat d7/d49/d4b/f137 x:0 0 0 2023-12-07T16:22:00.639 INFO:tasks.workunit.client.0.smithi063.stdout:3/969: creat d7/d4f/d53/d72/db1/de6/f138 x:0 0 0 2023-12-07T16:22:00.644 INFO:tasks.workunit.client.0.smithi063.stdout:6/990: dwrite d0/d1e/d60/d68/f124 [0,4194304] 0 2023-12-07T16:22:00.648 INFO:tasks.workunit.client.0.smithi063.stdout:5/954: write d1/d31/db8/dee/f58 [3868249,50342] 0 2023-12-07T16:22:00.651 INFO:tasks.workunit.client.0.smithi063.stdout:5/955: rmdir d1/d31/dc8/de5 39 2023-12-07T16:22:00.661 INFO:tasks.workunit.client.0.smithi063.stdout:6/991: dwrite d0/d1e/d60/d68/d69/d7d/f149 [0,4194304] 0 2023-12-07T16:22:00.668 INFO:tasks.workunit.client.0.smithi063.stdout:5/956: dwrite d1/d31/d56/db7/f125 [0,4194304] 0 2023-12-07T16:22:00.669 INFO:tasks.workunit.client.0.smithi063.stdout:5/957: write d1/d3/f35 [1286389,65684] 0 2023-12-07T16:22:00.670 INFO:tasks.workunit.client.0.smithi063.stdout:5/958: creat d1/d3/d3a/d5a/f12a x:0 0 0 2023-12-07T16:22:00.689 INFO:tasks.workunit.client.0.smithi063.stdout:5/959: dwrite d1/d31/db8/dee/d8f/ddf/f106 [0,4194304] 0 2023-12-07T16:22:00.691 INFO:tasks.workunit.client.0.smithi063.stdout:5/960: rename d1/d31/db8/dee/d8f/ddf to d1/d12b 0 2023-12-07T16:22:00.692 INFO:tasks.workunit.client.0.smithi063.stdout:5/961: creat d1/d3/d3a/d5a/dc6/f12c x:0 0 0 2023-12-07T16:22:00.702 INFO:tasks.workunit.client.0.smithi063.stdout:5/962: dread d1/d3/d3a/f97 [0,4194304] 0 2023-12-07T16:22:00.703 INFO:tasks.workunit.client.0.smithi063.stdout:5/963: symlink d1/d31/db8/dee/d5e/l12d 0 2023-12-07T16:22:00.705 INFO:tasks.workunit.client.0.smithi063.stdout:5/964: dread d1/d3/fd2 [0,4194304] 0 2023-12-07T16:22:00.707 INFO:tasks.workunit.client.0.smithi063.stdout:5/965: rename d1/d31/d56/db7/cc4 to d1/d12b/de4/c12e 0 2023-12-07T16:22:00.708 INFO:tasks.workunit.client.0.smithi063.stdout:5/966: creat d1/d3/d3a/d91/f12f x:0 0 0 2023-12-07T16:22:00.839 INFO:teuthology.orchestra.run.smithi063.stdout:e16 2023-12-07T16:22:00.839 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-07T16:22:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:22:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-07T16:22:00.840 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:22:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-07T16:22:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-07T16:22:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 16 2023-12-07T16:22:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-07T16:22:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-07T16:19:08.352640+0000 2023-12-07T16:22:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-07T16:21:04.340763+0000 2023-12-07T16:22:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-07T16:22:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-07T16:22:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-07T16:22:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-07T16:22:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-07T16:22:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-07T16:22:00.840 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-07T16:22:00.841 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 45 2023-12-07T16:22:00.841 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:22:00.841 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 2 2023-12-07T16:22:00.841 INFO:teuthology.orchestra.run.smithi063.stdout:in 0,1 2023-12-07T16:22:00.841 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14478,1=24269} 2023-12-07T16:22:00.841 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-07T16:22:00.841 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-07T16:22:00.841 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-07T16:22:00.841 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-07T16:22:00.841 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-07T16:22:00.841 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-07T16:22:00.841 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-07T16:22:00.841 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-07T16:22:00.841 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.yidolg{0:14478} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:22:00.841 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.mrvngf{1:24269} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.152:6824/3157779064,v1:172.21.15.152:6825/3157779064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:22:00.841 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:22:00.841 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:22:00.842 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-07T16:22:00.842 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:22:00.842 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.gsjgcq{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/3063200414,v1:172.21.15.63:6827/3063200414] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:22:00.842 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.aovwwd{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/2906349729,v1:172.21.15.152:6827/2906349729] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:22:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.816+0000 7f6a55e5b700 1 -- 172.21.15.63:0/967150707 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6a50119470 con 0x7f6a50107560 2023-12-07T16:22:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.816+0000 7f6a37fff700 1 -- 172.21.15.63:0/967150707 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1836 (secure 0 0 0) 0x7f6a50119470 con 0x7f6a50107560 2023-12-07T16:22:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.818+0000 7f6a55e5b700 1 -- 172.21.15.63:0/967150707 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f6a380386e0 msgr2=0x7f6a3803ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.818+0000 7f6a55e5b700 1 --2- 172.21.15.63:0/967150707 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f6a380386e0 0x7f6a3803ab90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009fd0 tx=0x7f6a40009e30 comp rx=0 tx=0).stop 2023-12-07T16:22:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.818+0000 7f6a55e5b700 1 -- 172.21.15.63:0/967150707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a50107560 msgr2=0x7f6a50118ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.818+0000 7f6a55e5b700 1 --2- 172.21.15.63:0/967150707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a50107560 0x7f6a50118ce0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400eb70 tx=0x7f6a4400b040 comp rx=0 tx=0).stop 2023-12-07T16:22:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.818+0000 7f6a55e5b700 1 -- 172.21.15.63:0/967150707 shutdown_connections 2023-12-07T16:22:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.818+0000 7f6a55e5b700 1 --2- 172.21.15.63:0/967150707 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f6a380386e0 0x7f6a3803ab90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.818+0000 7f6a55e5b700 1 --2- 172.21.15.63:0/967150707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a50104c40 0x7f6a50116790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.818+0000 7f6a55e5b700 1 --2- 172.21.15.63:0/967150707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a50107560 0x7f6a50118ce0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.818+0000 7f6a55e5b700 1 -- 172.21.15.63:0/967150707 >> 172.21.15.63:0/967150707 conn(0x7f6a50069b20 msgr2=0x7f6a5006bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:22:00.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.818+0000 7f6a55e5b700 1 -- 172.21.15.63:0/967150707 shutdown_connections 2023-12-07T16:22:00.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.818+0000 7f6a55e5b700 1 -- 172.21.15.63:0/967150707 wait complete. 2023-12-07T16:22:00.843 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 16 2023-12-07T16:22:00.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.957+0000 7f36cab9f700 1 -- 172.21.15.63:0/2640566431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36c40fbaf0 msgr2=0x7f36c40fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:00.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.957+0000 7f36cab9f700 1 --2- 172.21.15.63:0/2640566431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36c40fbaf0 0x7f36c40fbf00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f36b8004940 tx=0x7f36b8009e30 comp rx=0 tx=0).stop 2023-12-07T16:22:00.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.957+0000 7f36cab9f700 1 -- 172.21.15.63:0/2640566431 shutdown_connections 2023-12-07T16:22:00.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.957+0000 7f36cab9f700 1 --2- 172.21.15.63:0/2640566431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36c40fcd00 0x7f36c40fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:00.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.957+0000 7f36cab9f700 1 --2- 172.21.15.63:0/2640566431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36c40fbaf0 0x7f36c40fbf00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:00.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.957+0000 7f36cab9f700 1 -- 172.21.15.63:0/2640566431 >> 172.21.15.63:0/2640566431 conn(0x7f36c40f71d0 msgr2=0x7f36c40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:22:00.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.957+0000 7f36cab9f700 1 -- 172.21.15.63:0/2640566431 shutdown_connections 2023-12-07T16:22:00.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.957+0000 7f36cab9f700 1 -- 172.21.15.63:0/2640566431 wait complete. 2023-12-07T16:22:00.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.958+0000 7f36cab9f700 1 Processor -- start 2023-12-07T16:22:00.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.959+0000 7f36cab9f700 1 -- start start 2023-12-07T16:22:00.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.959+0000 7f36cab9f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36c40fbaf0 0x7f36c406ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:00.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.959+0000 7f36cab9f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36c40fcd00 0x7f36c406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:00.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.959+0000 7f36cab9f700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c406f800 con 0x7f36c40fcd00 2023-12-07T16:22:00.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.959+0000 7f36cab9f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c4114eb0 con 0x7f36c40fbaf0 2023-12-07T16:22:00.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.959+0000 7f36c3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36c40fcd00 0x7f36c406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:00.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.959+0000 7f36c3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36c40fcd00 0x7f36c406f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52042/0 (socket says 172.21.15.63:52042) 2023-12-07T16:22:00.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.959+0000 7f36c3fff700 1 -- 172.21.15.63:0/1408046616 learned_addr learned my addr 172.21.15.63:0/1408046616 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:22:00.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.959+0000 7f36c893b700 1 --2- 172.21.15.63:0/1408046616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36c40fbaf0 0x7f36c406ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:00.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.960+0000 7f36c3fff700 1 -- 172.21.15.63:0/1408046616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36c40fbaf0 msgr2=0x7f36c406ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:00.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.960+0000 7f36c3fff700 1 --2- 172.21.15.63:0/1408046616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36c40fbaf0 0x7f36c406ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:00.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.960+0000 7f36c3fff700 1 -- 172.21.15.63:0/1408046616 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b8005040 con 0x7f36c40fcd00 2023-12-07T16:22:00.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.960+0000 7f36c3fff700 1 --2- 172.21.15.63:0/1408046616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36c40fcd00 0x7f36c406f1b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f36b000eb40 tx=0x7f36b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:22:00.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.960+0000 7f36c17fa700 1 -- 172.21.15.63:0/1408046616 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36b0007cc0 con 0x7f36c40fcd00 2023-12-07T16:22:00.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.960+0000 7f36cab9f700 1 -- 172.21.15.63:0/1408046616 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c4115130 con 0x7f36c40fcd00 2023-12-07T16:22:00.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.960+0000 7f36c17fa700 1 -- 172.21.15.63:0/1408046616 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f36b000f040 con 0x7f36c40fcd00 2023-12-07T16:22:00.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.960+0000 7f36c17fa700 1 -- 172.21.15.63:0/1408046616 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36b000c990 con 0x7f36c40fcd00 2023-12-07T16:22:00.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.960+0000 7f36cab9f700 1 -- 172.21.15.63:0/1408046616 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c4115670 con 0x7f36c40fcd00 2023-12-07T16:22:00.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.962+0000 7f36cab9f700 1 -- 172.21.15.63:0/1408046616 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c404bb80 con 0x7f36c40fcd00 2023-12-07T16:22:00.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.962+0000 7f36c17fa700 1 -- 172.21.15.63:0/1408046616 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 29) v1 ==== 45671+0+0 (secure 0 0 0) 0x7f36b000cc00 con 0x7f36c40fcd00 2023-12-07T16:22:00.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.962+0000 7f36c17fa700 1 --2- 172.21.15.63:0/1408046616 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f36b403a8e0 0x7f36b403cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:00.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.963+0000 7f36c893b700 1 --2- 172.21.15.63:0/1408046616 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f36b403a8e0 0x7f36b403cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:00.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.963+0000 7f36c893b700 1 --2- 172.21.15.63:0/1408046616 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f36b403a8e0 0x7f36b403cd90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009fd0 tx=0x7f36b8009e30 comp rx=0 tx=0).ready entity=mgr.24453 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:22:00.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.963+0000 7f36c17fa700 1 -- 172.21.15.63:0/1408046616 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f36b0007e20 con 0x7f36c40fcd00 2023-12-07T16:22:00.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:00.970+0000 7f36c17fa700 1 -- 172.21.15.63:0/1408046616 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f36b0051060 con 0x7f36c40fcd00 2023-12-07T16:22:01.009 INFO:tasks.workunit.client.0.smithi063.stdout:1/966: sync 2023-12-07T16:22:01.010 INFO:tasks.workunit.client.0.smithi063.stdout:1/967: symlink d0/dd/d19/d50/d12b/dda/dd5/df8/l14f 0 2023-12-07T16:22:01.011 INFO:tasks.workunit.client.0.smithi063.stdout:1/968: creat d0/dd/d1f/d75/dfe/f150 x:0 0 0 2023-12-07T16:22:01.012 INFO:tasks.workunit.client.0.smithi063.stdout:1/969: creat d0/dd/d10/d6f/f151 x:0 0 0 2023-12-07T16:22:01.012 INFO:tasks.workunit.client.0.smithi063.stdout:1/970: creat d0/dd/d10/d6f/f152 x:0 0 0 2023-12-07T16:22:01.013 INFO:tasks.workunit.client.0.smithi063.stdout:1/971: mkdir d0/dd/d19/d50/d12b/dda/d12f/d153 0 2023-12-07T16:22:01.014 INFO:tasks.workunit.client.0.smithi063.stdout:1/972: creat d0/dd/d19/d50/d12b/dda/d12f/d2f/d79/f154 x:0 0 0 2023-12-07T16:22:01.015 INFO:tasks.workunit.client.0.smithi063.stdout:1/973: chown d0/dd/d10 12 1 2023-12-07T16:22:01.015 INFO:tasks.workunit.client.0.smithi063.stdout:1/974: creat d0/dd/d10/f155 x:0 0 0 2023-12-07T16:22:01.035 INFO:tasks.workunit.client.0.smithi063.stdout:1/975: dread d0/dd/d19/d50/d71/f5a [0,4194304] 0 2023-12-07T16:22:01.035 INFO:tasks.workunit.client.0.smithi063.stdout:1/976: fsync d0/dd/d1f/d75/fcb 0 2023-12-07T16:22:01.035 INFO:tasks.workunit.client.0.smithi063.stdout:1/977: fdatasync d0/dd/d10/d6f/da0/fbc 0 2023-12-07T16:22:01.036 INFO:tasks.workunit.client.0.smithi063.stdout:1/978: symlink d0/dd/d19/d50/d12b/dda/d12f/d153/l156 0 2023-12-07T16:22:01.037 INFO:tasks.workunit.client.0.smithi063.stdout:1/979: mknod d0/dd/c157 0 2023-12-07T16:22:01.037 INFO:tasks.workunit.client.0.smithi063.stdout:1/980: write d0/dd/d10/d1b/d68/fd2 [1338950,123260] 0 2023-12-07T16:22:01.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.042+0000 7f36c17fa700 1 -- 172.21.15.63:0/1408046616 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mgrmap(e 30) v1 ==== 45727+0+0 (secure 0 0 0) 0x7f36b00090d0 con 0x7f36c40fcd00 2023-12-07T16:22:01.045 INFO:tasks.workunit.client.0.smithi063.stdout:1/981: dread d0/dd/d19/d50/d71/f5a [0,4194304] 0 2023-12-07T16:22:01.046 INFO:tasks.workunit.client.0.smithi063.stdout:1/982: getdents d0/dd/d19/dbd 0 2023-12-07T16:22:01.048 INFO:tasks.workunit.client.0.smithi063.stdout:1/983: symlink d0/dd/d10/d6f/l158 0 2023-12-07T16:22:01.048 INFO:tasks.workunit.client.0.smithi063.stdout:1/984: read d0/dd/d10/d6f/f7a [460607,104609] 0 2023-12-07T16:22:01.048 INFO:tasks.workunit.client.0.smithi063.stdout:1/985: fsync d0/dd/d19/d50/fc7 0 2023-12-07T16:22:01.049 INFO:tasks.workunit.client.0.smithi063.stdout:1/986: mknod d0/dd/d19/d50/d12b/dda/d12f/c159 0 2023-12-07T16:22:01.050 INFO:tasks.workunit.client.0.smithi063.stdout:1/987: unlink d0/dd/d19/d50/d71/fba 0 2023-12-07T16:22:01.058 INFO:tasks.workunit.client.0.smithi063.stdout:1/988: dread d0/dd/d1f/f5b [0,4194304] 0 2023-12-07T16:22:01.059 INFO:tasks.workunit.client.0.smithi063.stdout:1/989: symlink d0/dd/l15a 0 2023-12-07T16:22:01.060 INFO:tasks.workunit.client.0.smithi063.stdout:1/990: mknod d0/dd/d10/d6f/dd8/dc3/c15b 0 2023-12-07T16:22:01.061 INFO:tasks.workunit.client.0.smithi063.stdout:1/991: rename d0/dd/d19/d50/d12b/dda/d12f/d2f/c63 to d0/dd/d19/d50/d12b/dda/d12f/d2f/c15c 0 2023-12-07T16:22:01.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:01 smithi063 ceph-mon[112095]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:22:01.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:01 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/3622143261' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:22:01.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:01 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:01.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:01 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:01.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:01 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/967150707' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:22:01.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.249+0000 7f36cab9f700 1 -- 172.21.15.63:0/1408046616 --> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f36c4115b70 con 0x7f36b403a8e0 2023-12-07T16:22:01.258 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:22:01.258 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-07T16:22:01.258 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-07T16:22:01.258 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-07T16:22:01.258 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [ 2023-12-07T16:22:01.258 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr" 2023-12-07T16:22:01.258 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2023-12-07T16:22:01.258 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "2/21 daemons upgraded", 2023-12-07T16:22:01.258 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "", 2023-12-07T16:22:01.258 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-07T16:22:01.259 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:22:01.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.250+0000 7f36c17fa700 1 -- 172.21.15.63:0/1408046616 <== mgr.24453 v2:172.21.15.63:6800/2671097541 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f36c4115b70 con 0x7f36b403a8e0 2023-12-07T16:22:01.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.254+0000 7f36cab9f700 1 -- 172.21.15.63:0/1408046616 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f36b403a8e0 msgr2=0x7f36b403cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:01.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.254+0000 7f36cab9f700 1 --2- 172.21.15.63:0/1408046616 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f36b403a8e0 0x7f36b403cd90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009fd0 tx=0x7f36b8009e30 comp rx=0 tx=0).stop 2023-12-07T16:22:01.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.254+0000 7f36cab9f700 1 -- 172.21.15.63:0/1408046616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36c40fcd00 msgr2=0x7f36c406f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:01.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.254+0000 7f36cab9f700 1 --2- 172.21.15.63:0/1408046616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36c40fcd00 0x7f36c406f1b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f36b000eb40 tx=0x7f36b000b040 comp rx=0 tx=0).stop 2023-12-07T16:22:01.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.254+0000 7f36cab9f700 1 -- 172.21.15.63:0/1408046616 shutdown_connections 2023-12-07T16:22:01.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.254+0000 7f36cab9f700 1 --2- 172.21.15.63:0/1408046616 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f36b403a8e0 0x7f36b403cd90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:01.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.254+0000 7f36cab9f700 1 --2- 172.21.15.63:0/1408046616 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36c40fbaf0 0x7f36c406ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:01.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.254+0000 7f36cab9f700 1 --2- 172.21.15.63:0/1408046616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36c40fcd00 0x7f36c406f1b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:01.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.254+0000 7f36cab9f700 1 -- 172.21.15.63:0/1408046616 >> 172.21.15.63:0/1408046616 conn(0x7f36c40f71d0 msgr2=0x7f36c40fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:22:01.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.254+0000 7f36cab9f700 1 -- 172.21.15.63:0/1408046616 shutdown_connections 2023-12-07T16:22:01.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.254+0000 7f36cab9f700 1 -- 172.21.15.63:0/1408046616 wait complete. 2023-12-07T16:22:01.260 INFO:tasks.workunit.client.0.smithi063.stdout:4/826: sync 2023-12-07T16:22:01.264 INFO:tasks.workunit.client.0.smithi063.stdout:4/827: symlink d1/d3/db/d2c/lf5 0 2023-12-07T16:22:01.265 INFO:tasks.workunit.client.0.smithi063.stdout:4/828: mknod d1/d3/db/d2c/d63/d99/df1/cf6 0 2023-12-07T16:22:01.265 INFO:tasks.workunit.client.0.smithi063.stdout:4/829: creat d1/d3/d3a/ff7 x:0 0 0 2023-12-07T16:22:01.283 INFO:tasks.workunit.client.0.smithi063.stdout:4/830: dwrite d1/dc6/ddc/d64/f74 [0,4194304] 0 2023-12-07T16:22:01.283 INFO:tasks.workunit.client.0.smithi063.stdout:4/831: write d1/d3/db/d16/f7f [621833,103388] 0 2023-12-07T16:22:01.285 INFO:tasks.workunit.client.0.smithi063.stdout:4/832: unlink d1/d3/d3f/d44/f70 0 2023-12-07T16:22:01.300 INFO:tasks.workunit.client.0.smithi063.stdout:4/833: dwrite d1/d3/db/d2c/f91 [0,4194304] 0 2023-12-07T16:22:01.300 INFO:tasks.workunit.client.0.smithi063.stdout:4/834: readlink d1/l7c 0 2023-12-07T16:22:01.301 INFO:tasks.workunit.client.0.smithi063.stdout:4/835: symlink d1/d3/db/d2c/d63/d99/dd0/lf8 0 2023-12-07T16:22:01.302 INFO:tasks.workunit.client.0.smithi063.stdout:4/836: mknod d1/d3/db/d2c/d63/d99/dd0/cf9 0 2023-12-07T16:22:01.302 INFO:tasks.workunit.client.0.smithi063.stdout:4/837: truncate d1/d3/db/d2c/d63/f45 2238509 0 2023-12-07T16:22:01.302 INFO:tasks.workunit.client.0.smithi063.stdout:4/838: chown d1/d3/d3a/fc9 8045020 1 2023-12-07T16:22:01.302 INFO:tasks.workunit.client.0.smithi063.stdout:4/839: mknod d1/d3/d3a/cfa 0 2023-12-07T16:22:01.304 INFO:tasks.workunit.client.0.smithi063.stdout:4/840: getdents d1/d3/db/d41 0 2023-12-07T16:22:01.304 INFO:tasks.workunit.client.0.smithi063.stdout:4/841: chown d1/dc6/ddc/d64/dd9/fc1 10 1 2023-12-07T16:22:01.304 INFO:tasks.workunit.client.0.smithi063.stdout:4/842: readlink d1/ld2 0 2023-12-07T16:22:01.306 INFO:tasks.workunit.client.0.smithi063.stdout:4/843: truncate d1/dc6/ddc/d64/d80/fad 1053005 0 2023-12-07T16:22:01.307 INFO:tasks.workunit.client.0.smithi063.stdout:4/844: creat d1/dc6/ffb x:0 0 0 2023-12-07T16:22:01.307 INFO:tasks.workunit.client.0.smithi063.stdout:4/845: dread - d1/d3/d3a/ff7 zero size 2023-12-07T16:22:01.307 INFO:tasks.workunit.client.0.smithi063.stdout:4/846: chown d1/dc6/ddc/d8b/fc5 12 1 2023-12-07T16:22:01.307 INFO:tasks.workunit.client.0.smithi063.stdout:4/847: fdatasync d1/d3/d51/fa1 0 2023-12-07T16:22:01.308 INFO:tasks.workunit.client.0.smithi063.stdout:4/848: creat d1/dc6/ddc/d8b/ffc x:0 0 0 2023-12-07T16:22:01.308 INFO:tasks.workunit.client.0.smithi063.stdout:4/849: write d1/dc6/ddc/d64/d80/ff3 [403804,62693] 0 2023-12-07T16:22:01.308 INFO:tasks.workunit.client.0.smithi063.stdout:4/850: creat d1/dc6/ddc/d64/ffd x:0 0 0 2023-12-07T16:22:01.309 INFO:tasks.workunit.client.0.smithi063.stdout:4/851: rmdir d1 39 2023-12-07T16:22:01.310 INFO:tasks.workunit.client.0.smithi063.stdout:4/852: rename d1/dc6/fe5 to d1/d3/d3a/ffe 0 2023-12-07T16:22:01.311 INFO:tasks.workunit.client.0.smithi063.stdout:4/853: unlink d1/d3/db/d2c/d63/f48 0 2023-12-07T16:22:01.312 INFO:tasks.workunit.client.0.smithi063.stdout:4/854: creat d1/d3/db/d16/fff x:0 0 0 2023-12-07T16:22:01.314 INFO:tasks.workunit.client.0.smithi063.stdout:4/855: rename d1/d3/db/d16/c21 to d1/d3/db/d2c/d63/c100 0 2023-12-07T16:22:01.330 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:01 smithi152 ceph-mon[121113]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:22:01.331 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:01 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/3622143261' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:22:01.331 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:01 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:01.331 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:01 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:01.331 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:01 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/967150707' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:22:01.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.384+0000 7f458f2e7700 1 -- 172.21.15.63:0/11574405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4588066090 msgr2=0x7f4588101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:01.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.384+0000 7f458f2e7700 1 --2- 172.21.15.63:0/11574405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4588066090 0x7f4588101ba0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4584004940 tx=0x7f4584009e30 comp rx=0 tx=0).stop 2023-12-07T16:22:01.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.384+0000 7f458f2e7700 1 -- 172.21.15.63:0/11574405 shutdown_connections 2023-12-07T16:22:01.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.384+0000 7f458f2e7700 1 --2- 172.21.15.63:0/11574405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45881020e0 0x7f45881044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:01.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.384+0000 7f458f2e7700 1 --2- 172.21.15.63:0/11574405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4588066090 0x7f4588101ba0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:01.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.384+0000 7f458f2e7700 1 -- 172.21.15.63:0/11574405 >> 172.21.15.63:0/11574405 conn(0x7f45880f7190 msgr2=0x7f45880f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:22:01.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.384+0000 7f458f2e7700 1 -- 172.21.15.63:0/11574405 shutdown_connections 2023-12-07T16:22:01.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.384+0000 7f458f2e7700 1 -- 172.21.15.63:0/11574405 wait complete. 2023-12-07T16:22:01.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.385+0000 7f458f2e7700 1 Processor -- start 2023-12-07T16:22:01.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.385+0000 7f458f2e7700 1 -- start start 2023-12-07T16:22:01.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.385+0000 7f458f2e7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4588066090 0x7f458810f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:01.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.385+0000 7f458f2e7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45881020e0 0x7f458810fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:01.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.385+0000 7f458f2e7700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4588110210 con 0x7f4588066090 2023-12-07T16:22:01.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.385+0000 7f458f2e7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4588110ab0 con 0x7f45881020e0 2023-12-07T16:22:01.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.385+0000 7f458d083700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4588066090 0x7f458810f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:01.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.386+0000 7f458d083700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4588066090 0x7f458810f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52056/0 (socket says 172.21.15.63:52056) 2023-12-07T16:22:01.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.386+0000 7f458d083700 1 -- 172.21.15.63:0/469854192 learned_addr learned my addr 172.21.15.63:0/469854192 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:22:01.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.386+0000 7f458c882700 1 --2- 172.21.15.63:0/469854192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45881020e0 0x7f458810fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:01.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.386+0000 7f458d083700 1 -- 172.21.15.63:0/469854192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45881020e0 msgr2=0x7f458810fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:01.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.386+0000 7f458d083700 1 --2- 172.21.15.63:0/469854192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45881020e0 0x7f458810fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:01.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.386+0000 7f458d083700 1 -- 172.21.15.63:0/469854192 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4584005040 con 0x7f4588066090 2023-12-07T16:22:01.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.386+0000 7f458d083700 1 --2- 172.21.15.63:0/469854192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4588066090 0x7f458810f6d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4584000c00 tx=0x7f4584009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:22:01.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.386+0000 7f457dffb700 1 -- 172.21.15.63:0/469854192 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4584021070 con 0x7f4588066090 2023-12-07T16:22:01.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.386+0000 7f458f2e7700 1 -- 172.21.15.63:0/469854192 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4588110d30 con 0x7f4588066090 2023-12-07T16:22:01.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.386+0000 7f457dffb700 1 -- 172.21.15.63:0/469854192 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f458401c400 con 0x7f4588066090 2023-12-07T16:22:01.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.386+0000 7f457dffb700 1 -- 172.21.15.63:0/469854192 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f458400e070 con 0x7f4588066090 2023-12-07T16:22:01.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.387+0000 7f458f2e7700 1 -- 172.21.15.63:0/469854192 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4588111210 con 0x7f4588066090 2023-12-07T16:22:01.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.387+0000 7f457dffb700 1 -- 172.21.15.63:0/469854192 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 30) v1 ==== 45727+0+0 (secure 0 0 0) 0x7f458401c9c0 con 0x7f4588066090 2023-12-07T16:22:01.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.388+0000 7f458f2e7700 1 -- 172.21.15.63:0/469854192 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f458804bb80 con 0x7f4588066090 2023-12-07T16:22:01.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.388+0000 7f457dffb700 1 --2- 172.21.15.63:0/469854192 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f4574038760 0x7f457403ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:01.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.388+0000 7f457dffb700 1 -- 172.21.15.63:0/469854192 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f458404d490 con 0x7f4588066090 2023-12-07T16:22:01.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.388+0000 7f458c882700 1 --2- 172.21.15.63:0/469854192 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f4574038760 0x7f457403ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:01.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.388+0000 7f458c882700 1 --2- 172.21.15.63:0/469854192 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f4574038760 0x7f457403ac10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4578009b80 tx=0x7f457800b040 comp rx=0 tx=0).ready entity=mgr.24453 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:22:01.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.394+0000 7f457dffb700 1 -- 172.21.15.63:0/469854192 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f4584011d40 con 0x7f4588066090 2023-12-07T16:22:01.437 INFO:tasks.workunit.client.0.smithi063.stdout:5/967: sync 2023-12-07T16:22:01.437 INFO:tasks.workunit.client.0.smithi063.stdout:3/970: sync 2023-12-07T16:22:01.437 INFO:tasks.workunit.client.0.smithi063.stdout:6/992: sync 2023-12-07T16:22:01.437 INFO:tasks.workunit.client.0.smithi063.stdout:6/993: write d0/d17/fb0 [57912,43675] 0 2023-12-07T16:22:01.438 INFO:tasks.workunit.client.0.smithi063.stdout:5/968: mkdir d1/d3/de/d1e/d6b/d130 0 2023-12-07T16:22:01.440 INFO:tasks.workunit.client.0.smithi063.stdout:3/971: creat d7/d9/dd/d7f/f139 x:0 0 0 2023-12-07T16:22:01.442 INFO:tasks.workunit.client.0.smithi063.stdout:6/994: rename d0/d1e/f24 to d0/d17/d46/d93/f162 0 2023-12-07T16:22:01.444 INFO:tasks.workunit.client.0.smithi063.stdout:6/995: creat d0/d17/d95/dd6/d8b/f163 x:0 0 0 2023-12-07T16:22:01.444 INFO:tasks.workunit.client.0.smithi063.stdout:6/996: chown d0/d1e/d1d/d4f 84 1 2023-12-07T16:22:01.445 INFO:tasks.workunit.client.0.smithi063.stdout:6/997: creat d0/d79/f164 x:0 0 0 2023-12-07T16:22:01.449 INFO:tasks.workunit.client.0.smithi063.stdout:6/998: symlink d0/d17/d1a/l165 0 2023-12-07T16:22:01.451 INFO:tasks.workunit.client.0.smithi063.stdout:6/999: symlink d0/d1e/d60/d15d/l166 0 2023-12-07T16:22:01.457 INFO:tasks.workunit.client.0.smithi063.stdout:3/972: dwrite d7/d4f/d53/d72/d7d/f11b [0,4194304] 0 2023-12-07T16:22:01.478 INFO:tasks.workunit.client.0.smithi063.stdout:3/973: dwrite d7/d4f/d53/f129 [0,4194304] 0 2023-12-07T16:22:01.478 INFO:tasks.workunit.client.0.smithi063.stdout:3/974: chown d7/d9/dd/d7f/cd8 711 1 2023-12-07T16:22:01.485 INFO:tasks.workunit.client.0.smithi063.stdout:3/975: dread d7/d9/d1b/f38 [0,4194304] 0 2023-12-07T16:22:01.486 INFO:tasks.workunit.client.0.smithi063.stdout:3/976: write d7/d4f/d53/d72/db1/de6/f12d [206486,90732] 0 2023-12-07T16:22:01.508 INFO:tasks.workunit.client.0.smithi063.stdout:3/977: dwrite d7/d4f/d53/d54/f58 [0,4194304] 0 2023-12-07T16:22:01.508 INFO:tasks.workunit.client.0.smithi063.stdout:3/978: dread - d7/d49/d10b/f116 zero size 2023-12-07T16:22:01.525 INFO:tasks.workunit.client.0.smithi063.stdout:3/979: dwrite d7/d9/d1b/f2c [0,4194304] 0 2023-12-07T16:22:01.541 INFO:tasks.workunit.client.0.smithi063.stdout:3/980: dwrite d7/d49/d10b/f135 [0,4194304] 0 2023-12-07T16:22:01.541 INFO:tasks.workunit.client.0.smithi063.stdout:3/981: truncate d7/d4f/d53/d54/d76/fb7 766799 0 2023-12-07T16:22:01.544 INFO:tasks.workunit.client.0.smithi063.stdout:3/982: mkdir d7/d9/d1b/d5c/d13a 0 2023-12-07T16:22:01.545 INFO:tasks.workunit.client.0.smithi063.stdout:3/983: write d7/f110 [2215499,83655] 0 2023-12-07T16:22:01.552 INFO:tasks.workunit.client.0.smithi063.stdout:3/984: dread d7/d9/dd/f126 [0,4194304] 0 2023-12-07T16:22:01.553 INFO:tasks.workunit.client.0.smithi063.stdout:3/985: unlink d7/d9/d1b/l95 0 2023-12-07T16:22:01.554 INFO:tasks.workunit.client.0.smithi063.stdout:3/986: symlink d7/d9/dd/d56/db5/l13b 0 2023-12-07T16:22:01.656 INFO:tasks.workunit.client.0.smithi063.stdout:1/992: sync 2023-12-07T16:22:01.658 INFO:tasks.workunit.client.0.smithi063.stdout:1/993: symlink d0/dd/d19/d50/d72/d80/d13a/l15d 0 2023-12-07T16:22:01.659 INFO:tasks.workunit.client.0.smithi063.stdout:1/994: creat d0/dd/d10/f15e x:0 0 0 2023-12-07T16:22:01.659 INFO:tasks.workunit.client.0.smithi063.stdout:1/995: chown d0/dd/d10/d1b/d68/f12a 97 1 2023-12-07T16:22:01.659 INFO:tasks.workunit.client.0.smithi063.stdout:1/996: rmdir d0/dd 39 2023-12-07T16:22:01.660 INFO:tasks.workunit.client.0.smithi063.stdout:1/997: mknod d0/dd/d4f/c15f 0 2023-12-07T16:22:01.664 INFO:tasks.workunit.client.0.smithi063.stdout:1/998: rename d0/dd/d19/d50/d72 to d0/dd/d19/d50/d71/d9b/d160 0 2023-12-07T16:22:01.666 INFO:tasks.workunit.client.0.smithi063.stdout:1/999: unlink d0/dd/d1f/d75/l125 0 2023-12-07T16:22:01.873 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-07T16:22:01.873 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-07T16:22:01.873 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-07T16:22:01.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.874+0000 7f458f2e7700 1 -- 172.21.15.63:0/469854192 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f45881077a0 con 0x7f4588066090 2023-12-07T16:22:01.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.874+0000 7f457dffb700 1 -- 172.21.15.63:0/469854192 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f4584011b60 con 0x7f4588066090 2023-12-07T16:22:01.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.876+0000 7f458f2e7700 1 -- 172.21.15.63:0/469854192 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f4574038760 msgr2=0x7f457403ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:01.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.876+0000 7f458f2e7700 1 --2- 172.21.15.63:0/469854192 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f4574038760 0x7f457403ac10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4578009b80 tx=0x7f457800b040 comp rx=0 tx=0).stop 2023-12-07T16:22:01.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.876+0000 7f458f2e7700 1 -- 172.21.15.63:0/469854192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4588066090 msgr2=0x7f458810f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:01.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.876+0000 7f458f2e7700 1 --2- 172.21.15.63:0/469854192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4588066090 0x7f458810f6d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4584000c00 tx=0x7f4584009e30 comp rx=0 tx=0).stop 2023-12-07T16:22:01.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.876+0000 7f458f2e7700 1 -- 172.21.15.63:0/469854192 shutdown_connections 2023-12-07T16:22:01.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.876+0000 7f458f2e7700 1 --2- 172.21.15.63:0/469854192 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f4574038760 0x7f457403ac10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:01.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.876+0000 7f458f2e7700 1 --2- 172.21.15.63:0/469854192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4588066090 0x7f458810f6d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:01.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.876+0000 7f458f2e7700 1 --2- 172.21.15.63:0/469854192 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f45881020e0 0x7f458810fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:01.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.876+0000 7f458f2e7700 1 -- 172.21.15.63:0/469854192 >> 172.21.15.63:0/469854192 conn(0x7f45880f7190 msgr2=0x7f45880f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:22:01.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.877+0000 7f458f2e7700 1 -- 172.21.15.63:0/469854192 shutdown_connections 2023-12-07T16:22:01.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:01.877+0000 7f458f2e7700 1 -- 172.21.15.63:0/469854192 wait complete. 2023-12-07T16:22:02.250 INFO:tasks.workunit.client.0.smithi063.stdout:4/856: sync 2023-12-07T16:22:02.250 INFO:tasks.workunit.client.0.smithi063.stdout:3/987: sync 2023-12-07T16:22:02.251 INFO:tasks.workunit.client.0.smithi063.stdout:5/969: sync 2023-12-07T16:22:02.251 INFO:tasks.workunit.client.0.smithi063.stdout:5/970: write d1/d3/de/d1e/f24 [2234033,30374] 0 2023-12-07T16:22:02.257 INFO:tasks.workunit.client.0.smithi063.stdout:3/988: symlink d7/d4f/d53/l13c 0 2023-12-07T16:22:02.257 INFO:tasks.workunit.client.0.smithi063.stdout:5/971: rmdir d1/d12b/de4 39 2023-12-07T16:22:02.257 INFO:tasks.workunit.client.0.smithi063.stdout:3/989: chown d7/d49/d4b/c89 133783878 1 2023-12-07T16:22:02.257 INFO:tasks.workunit.client.0.smithi063.stdout:5/972: fdatasync d1/d3/d3a/dcd/dd3/d7e/f84 0 2023-12-07T16:22:02.259 INFO:tasks.workunit.client.0.smithi063.stdout:3/990: mknod d7/d9/dfa/d11f/c13d 0 2023-12-07T16:22:02.261 INFO:tasks.workunit.client.0.smithi063.stdout:4/857: dread d1/d3/f68 [0,4194304] 0 2023-12-07T16:22:02.261 INFO:tasks.workunit.client.0.smithi063.stdout:4/858: dread - d1/d3/db/d16/d66/f76 zero size 2023-12-07T16:22:02.261 INFO:tasks.workunit.client.0.smithi063.stdout:4/859: write d1/d3/d3f/d44/f59 [1392950,1448] 0 2023-12-07T16:22:02.287 INFO:tasks.workunit.client.0.smithi063.stdout:3/991: dwrite d7/d4f/d53/d72/db1/de6/f138 [0,4194304] 0 2023-12-07T16:22:02.291 INFO:tasks.workunit.client.0.smithi063.stdout:4/860: dwrite d1/d3/db/d2c/d63/d99/fd6 [0,4194304] 0 2023-12-07T16:22:02.291 INFO:tasks.workunit.client.0.smithi063.stdout:5/973: dwrite d1/d3/f3b [0,4194304] 0 2023-12-07T16:22:02.293 INFO:tasks.workunit.client.0.smithi063.stdout:3/992: symlink d7/d4f/d53/d72/db1/l13e 0 2023-12-07T16:22:02.299 INFO:tasks.workunit.client.0.smithi063.stdout:5/974: creat d1/d12b/de4/f131 x:0 0 0 2023-12-07T16:22:02.299 INFO:tasks.workunit.client.0.smithi063.stdout:5/975: write d1/d31/dc8/fc7 [2057987,121858] 0 2023-12-07T16:22:02.299 INFO:tasks.workunit.client.0.smithi063.stdout:5/976: fsync d1/d3/de/d1e/d6b/f11d 0 2023-12-07T16:22:02.300 INFO:tasks.workunit.client.0.smithi063.stdout:4/861: truncate d1/dc6/ddc/d64/d80/fad 314247 0 2023-12-07T16:22:02.302 INFO:tasks.workunit.client.0.smithi063.stdout:5/977: creat d1/d3/d3a/dcd/f132 x:0 0 0 2023-12-07T16:22:02.307 INFO:tasks.workunit.client.0.smithi063.stdout:5/978: creat d1/d3/d3a/dcd/dd3/d7e/f133 x:0 0 0 2023-12-07T16:22:02.310 INFO:tasks.workunit.client.0.smithi063.stdout:5/979: rename d1/d3/d3a/d91/l10b to d1/d3/de6/l134 0 2023-12-07T16:22:02.312 INFO:tasks.workunit.client.0.smithi063.stdout:5/980: mkdir d1/d3/d3a/dcd/dd3/d7e/dcf/d135 0 2023-12-07T16:22:02.319 INFO:tasks.workunit.client.0.smithi063.stdout:3/993: dwrite d7/d4f/d53/d72/d7d/fbc [0,4194304] 0 2023-12-07T16:22:02.321 INFO:tasks.workunit.client.0.smithi063.stdout:5/981: write d1/d3/d3a/d5a/f85 [7129694,28257] 0 2023-12-07T16:22:02.322 INFO:tasks.workunit.client.0.smithi063.stdout:4/862: dwrite d1/d3/f8 [0,4194304] 0 2023-12-07T16:22:02.324 INFO:tasks.workunit.client.0.smithi063.stdout:3/994: unlink d7/d4f/d53/c74 0 2023-12-07T16:22:02.324 INFO:tasks.workunit.client.0.smithi063.stdout:3/995: write d7/d9/d1b/d136/fee [598020,79863] 0 2023-12-07T16:22:02.324 INFO:tasks.workunit.client.0.smithi063.stdout:4/863: write d1/d3/db/d2c/d63/d99/fd6 [238647,90829] 0 2023-12-07T16:22:02.325 INFO:tasks.workunit.client.0.smithi063.stdout:4/864: read d1/d3/db/d41/f95 [3251951,22738] 0 2023-12-07T16:22:02.325 INFO:tasks.workunit.client.0.smithi063.stdout:3/996: symlink d7/d9/d1b/d5c/d13a/l13f 0 2023-12-07T16:22:02.328 INFO:tasks.workunit.client.0.smithi063.stdout:3/997: mkdir d7/d9/d1b/df3/d131/d140 0 2023-12-07T16:22:02.330 INFO:tasks.workunit.client.0.smithi063.stdout:4/865: fdatasync d1/d3/db/d2c/d63/d99/fd6 0 2023-12-07T16:22:02.330 INFO:tasks.workunit.client.0.smithi063.stdout:5/982: dread d1/d3/de/d1e/f78 [0,4194304] 0 2023-12-07T16:22:02.331 INFO:tasks.workunit.client.0.smithi063.stdout:3/998: symlink d7/d49/dbf/l141 0 2023-12-07T16:22:02.332 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:02 smithi152 ceph-mon[121113]: pgmap v5: 65 pgs: 65 active+clean; 2.5 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail 2023-12-07T16:22:02.332 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:02 smithi152 ceph-mon[121113]: mgrmap e30: smithi063.yohyyx(active, since 4s) 2023-12-07T16:22:02.332 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:02 smithi152 ceph-mon[121113]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:22:02.332 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:02 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/469854192' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:22:02.332 INFO:tasks.workunit.client.0.smithi063.stdout:5/983: creat d1/d3/de6/df0/f136 x:0 0 0 2023-12-07T16:22:02.333 INFO:tasks.workunit.client.0.smithi063.stdout:5/984: chown d1/d3/de6/df0/f127 385278734 1 2023-12-07T16:22:02.333 INFO:tasks.workunit.client.0.smithi063.stdout:5/985: readlink d1/d3/l72 0 2023-12-07T16:22:02.335 INFO:tasks.workunit.client.0.smithi063.stdout:4/866: dread d1/d3/db/d2c/fc4 [0,4194304] 0 2023-12-07T16:22:02.335 INFO:tasks.workunit.client.0.smithi063.stdout:5/986: rename d1/f11 to d1/d3/d3a/dcd/dd3/d7e/dcf/f137 0 2023-12-07T16:22:02.335 INFO:tasks.workunit.client.0.smithi063.stdout:5/987: dread - d1/d3/de/d1e/d6b/f11d zero size 2023-12-07T16:22:02.339 INFO:tasks.workunit.client.0.smithi063.stdout:4/867: truncate d1/d3/d3f/d44/fcc 1214285 0 2023-12-07T16:22:02.345 INFO:tasks.workunit.client.0.smithi063.stdout:4/868: rename d1/d3/db/d73/fb8 to d1/dc6/ddc/d8b/f101 0 2023-12-07T16:22:02.345 INFO:tasks.workunit.client.0.smithi063.stdout:4/869: chown d1/dc6/ddc/fa2 530 1 2023-12-07T16:22:02.345 INFO:tasks.workunit.client.0.smithi063.stdout:4/870: truncate d1/d3/db/d2c/ff2 706083 0 2023-12-07T16:22:02.347 INFO:tasks.workunit.client.0.smithi063.stdout:4/871: symlink d1/d3/db/d2c/l102 0 2023-12-07T16:22:02.348 INFO:tasks.workunit.client.0.smithi063.stdout:4/872: creat d1/d3/db/f103 x:0 0 0 2023-12-07T16:22:02.349 INFO:tasks.workunit.client.0.smithi063.stdout:4/873: rename d1/d3/db/d2c/f77 to d1/d3/d3f/f104 0 2023-12-07T16:22:02.349 INFO:tasks.workunit.client.0.smithi063.stdout:4/874: write d1/d3/d51/fa8 [187642,119882] 0 2023-12-07T16:22:02.350 INFO:tasks.workunit.client.0.smithi063.stdout:4/875: mkdir d1/d3/d105 0 2023-12-07T16:22:02.352 INFO:tasks.workunit.client.0.smithi063.stdout:4/876: rename d1/d3/d3f/fd1 to d1/d3/db/d2c/d63/d99/df1/f106 0 2023-12-07T16:22:02.397 INFO:tasks.workunit.client.0.smithi063.stdout:4/877: dwrite d1/f98 [0,4194304] 0 2023-12-07T16:22:02.398 INFO:tasks.workunit.client.0.smithi063.stdout:4/878: symlink d1/d3/d3a/l107 0 2023-12-07T16:22:02.399 INFO:tasks.workunit.client.0.smithi063.stdout:4/879: getdents d1/d3/db/d2c/d63/d99 0 2023-12-07T16:22:02.401 INFO:tasks.workunit.client.0.smithi063.stdout:4/880: mkdir d1/d3/d105/d108 0 2023-12-07T16:22:02.403 INFO:tasks.workunit.client.0.smithi063.stdout:4/881: link d1/d3/d51/c5c d1/dc6/ddc/d64/dd9/c109 0 2023-12-07T16:22:02.403 INFO:tasks.workunit.client.0.smithi063.stdout:4/882: fsync d1/d3/db/f20 0 2023-12-07T16:22:02.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:02 smithi063 ceph-mon[112095]: pgmap v5: 65 pgs: 65 active+clean; 2.5 GiB data, 9.5 GiB used, 527 GiB / 536 GiB avail 2023-12-07T16:22:02.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:02 smithi063 ceph-mon[112095]: mgrmap e30: smithi063.yohyyx(active, since 4s) 2023-12-07T16:22:02.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:02 smithi063 ceph-mon[112095]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:22:02.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:02 smithi063 ceph-mon[112095]: from='client.? 172.21.15.63:0/469854192' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:22:02.418 INFO:tasks.workunit.client.0.smithi063.stdout:4/883: dwrite d1/dc6/fcd [4194304,4194304] 0 2023-12-07T16:22:02.419 INFO:tasks.workunit.client.0.smithi063.stdout:4/884: chown d1/d3/db/d41/f95 790797 1 2023-12-07T16:22:02.421 INFO:tasks.workunit.client.0.smithi063.stdout:4/885: mkdir d1/d3/d105/d108/d10a 0 2023-12-07T16:22:02.421 INFO:tasks.workunit.client.0.smithi063.stdout:4/886: stat d1/d3/d9f 0 2023-12-07T16:22:02.421 INFO:tasks.workunit.client.0.smithi063.stdout:4/887: fsync d1/d3/db/d2c/f91 0 2023-12-07T16:22:02.421 INFO:tasks.workunit.client.0.smithi063.stdout:4/888: write d1/d3/db/d2c/fb7 [507355,51470] 0 2023-12-07T16:22:02.421 INFO:tasks.workunit.client.0.smithi063.stdout:4/889: read - d1/d3/db/d16/d66/fe1 zero size 2023-12-07T16:22:02.436 INFO:tasks.workunit.client.0.smithi063.stdout:4/890: dwrite d1/d3/db/d41/f95 [0,4194304] 0 2023-12-07T16:22:02.439 INFO:tasks.workunit.client.0.smithi063.stdout:4/891: creat d1/d3/db/d2c/ddf/f10b x:0 0 0 2023-12-07T16:22:02.441 INFO:tasks.workunit.client.0.smithi063.stdout:4/892: unlink d1/d3/db/d16/d66/f7d 0 2023-12-07T16:22:02.441 INFO:tasks.workunit.client.0.smithi063.stdout:4/893: fdatasync d1/d3/db/d73/fbf 0 2023-12-07T16:22:02.458 INFO:tasks.workunit.client.0.smithi063.stdout:4/894: dwrite d1/d3/db/d16/f7f [0,4194304] 0 2023-12-07T16:22:02.474 INFO:tasks.workunit.client.0.smithi063.stdout:4/895: dwrite d1/d3/db/f3e [4194304,4194304] 0 2023-12-07T16:22:02.476 INFO:tasks.workunit.client.0.smithi063.stdout:4/896: link d1/d3/d3f/d44/ca5 d1/d3/d105/d108/c10c 0 2023-12-07T16:22:02.502 INFO:tasks.workunit.client.0.smithi063.stdout:4/897: dwrite d1/f28 [0,4194304] 0 2023-12-07T16:22:02.502 INFO:tasks.workunit.client.0.smithi063.stdout:4/898: dread - d1/dc6/ddc/fbd zero size 2023-12-07T16:22:02.502 INFO:tasks.workunit.client.0.smithi063.stdout:4/899: write d1/d3/d51/fd8 [52899,113067] 0 2023-12-07T16:22:02.522 INFO:tasks.workunit.client.0.smithi063.stdout:4/900: dwrite d1/d3/db/d73/fce [0,4194304] 0 2023-12-07T16:22:02.525 INFO:tasks.workunit.client.0.smithi063.stdout:4/901: mknod d1/dc6/ddc/d8b/c10d 0 2023-12-07T16:22:02.525 INFO:tasks.workunit.client.0.smithi063.stdout:4/902: truncate d1/d3/f4e 4209453 0 2023-12-07T16:22:02.547 INFO:tasks.workunit.client.0.smithi063.stdout:4/903: dwrite d1/dc6/ddc/fa2 [0,4194304] 0 2023-12-07T16:22:02.563 INFO:tasks.workunit.client.0.smithi063.stdout:4/904: dwrite d1/dc6/ddc/fbd [0,4194304] 0 2023-12-07T16:22:02.572 INFO:tasks.workunit.client.0.smithi063.stdout:4/905: dread d1/d3/db/d2c/d63/f84 [4194304,4194304] 0 2023-12-07T16:22:02.573 INFO:tasks.workunit.client.0.smithi063.stdout:4/906: creat d1/dc6/ddc/d64/f10e x:0 0 0 2023-12-07T16:22:02.574 INFO:tasks.workunit.client.0.smithi063.stdout:4/907: write d1/dc6/ddc/fbd [4147837,53447] 0 2023-12-07T16:22:02.574 INFO:tasks.workunit.client.0.smithi063.stdout:4/908: chown d1/d3/db/cf 254118009 1 2023-12-07T16:22:02.575 INFO:tasks.workunit.client.0.smithi063.stdout:4/909: mkdir d1/d3/db/d2c/d63/d62/d10f 0 2023-12-07T16:22:02.576 INFO:tasks.workunit.client.0.smithi063.stdout:4/910: mknod d1/dc6/ddc/c110 0 2023-12-07T16:22:02.577 INFO:tasks.workunit.client.0.smithi063.stdout:4/911: link d1/d3/l19 d1/dc6/ddc/d64/l111 0 2023-12-07T16:22:02.577 INFO:tasks.workunit.client.0.smithi063.stdout:4/912: chown d1/d3/db/d16/c85 32 1 2023-12-07T16:22:02.577 INFO:tasks.workunit.client.0.smithi063.stdout:4/913: readlink d1/d3/d51/ld5 0 2023-12-07T16:22:02.579 INFO:tasks.workunit.client.0.smithi063.stdout:4/914: rename d1/d3/db/d2c/d63/d99/dd0 to d1/d3/db/d16/d112 0 2023-12-07T16:22:02.580 INFO:tasks.workunit.client.0.smithi063.stdout:4/915: creat d1/d3/db/d16/f113 x:0 0 0 2023-12-07T16:22:02.580 INFO:tasks.workunit.client.0.smithi063.stdout:4/916: readlink d1/d3/db/d2c/lb2 0 2023-12-07T16:22:02.584 INFO:tasks.workunit.client.0.smithi063.stdout:4/917: rmdir d1/d3/db/d16/d112 39 2023-12-07T16:22:02.585 INFO:tasks.workunit.client.0.smithi063.stdout:4/918: rename d1/dc6/ddc/d64/f10e to d1/d3/d51/f114 0 2023-12-07T16:22:02.585 INFO:tasks.workunit.client.0.smithi063.stdout:4/919: readlink d1/dc6/ddc/d64/l111 0 2023-12-07T16:22:02.586 INFO:tasks.workunit.client.0.smithi063.stdout:4/920: creat d1/d3/d105/d108/f115 x:0 0 0 2023-12-07T16:22:02.610 INFO:tasks.workunit.client.0.smithi063.stdout:4/921: dwrite d1/d3/d51/fa1 [0,4194304] 0 2023-12-07T16:22:02.612 INFO:tasks.workunit.client.0.smithi063.stdout:4/922: mknod d1/d3/d51/c116 0 2023-12-07T16:22:02.629 INFO:tasks.workunit.client.0.smithi063.stdout:4/923: dwrite d1/d3/db/d73/f78 [4194304,4194304] 0 2023-12-07T16:22:02.630 INFO:tasks.workunit.client.0.smithi063.stdout:4/924: symlink d1/d3/db/d2c/d63/l117 0 2023-12-07T16:22:02.642 INFO:tasks.workunit.client.0.smithi063.stdout:4/925: dread d1/d3/db/d73/fce [0,4194304] 0 2023-12-07T16:22:02.643 INFO:tasks.workunit.client.0.smithi063.stdout:4/926: symlink d1/d3/d3f/l118 0 2023-12-07T16:22:02.644 INFO:tasks.workunit.client.0.smithi063.stdout:4/927: symlink d1/dc6/ddc/d64/d80/l119 0 2023-12-07T16:22:02.644 INFO:tasks.workunit.client.0.smithi063.stdout:4/928: write d1/dc6/ddc/d8b/fc5 [119404,115610] 0 2023-12-07T16:22:03.148 INFO:tasks.workunit.client.0.smithi063.stdout:4/929: sync 2023-12-07T16:22:03.148 INFO:tasks.workunit.client.0.smithi063.stdout:3/999: sync 2023-12-07T16:22:03.148 INFO:tasks.workunit.client.0.smithi063.stdout:5/988: sync 2023-12-07T16:22:03.149 INFO:tasks.workunit.client.0.smithi063.stdout:5/989: truncate d1/d3/de/f10 919120 0 2023-12-07T16:22:03.149 INFO:tasks.workunit.client.0.smithi063.stdout:5/990: fdatasync d1/d3/de/d1e/f24 0 2023-12-07T16:22:03.149 INFO:tasks.workunit.client.0.smithi063.stdout:4/930: creat d1/d3/db/d16/f11a x:0 0 0 2023-12-07T16:22:03.150 INFO:tasks.workunit.client.0.smithi063.stdout:4/931: stat d1/dc6/ddc/d64/d80/l119 0 2023-12-07T16:22:03.151 INFO:tasks.workunit.client.0.smithi063.stdout:4/932: mknod d1/d3/d105/c11b 0 2023-12-07T16:22:03.151 INFO:tasks.workunit.client.0.smithi063.stdout:4/933: fsync d1/d3/db/d2c/fb7 0 2023-12-07T16:22:03.151 INFO:tasks.workunit.client.0.smithi063.stdout:4/934: write d1/d3/fe0 [606026,17177] 0 2023-12-07T16:22:03.151 INFO:tasks.workunit.client.0.smithi063.stdout:4/935: fsync d1/d3/d105/d108/f115 0 2023-12-07T16:22:03.152 INFO:tasks.workunit.client.0.smithi063.stdout:4/936: symlink d1/d3/d3a/l11c 0 2023-12-07T16:22:03.154 INFO:tasks.workunit.client.0.smithi063.stdout:4/937: mkdir d1/d3/d51/d11d 0 2023-12-07T16:22:03.159 INFO:tasks.workunit.client.0.smithi063.stdout:4/938: rename d1/d3/f1e to d1/d3/d105/f11e 0 2023-12-07T16:22:03.161 INFO:tasks.workunit.client.0.smithi063.stdout:4/939: symlink d1/d3/db/d16/d112/l11f 0 2023-12-07T16:22:03.163 INFO:tasks.workunit.client.0.smithi063.stdout:4/940: dread d1/d3/db/d2c/ff2 [0,4194304] 0 2023-12-07T16:22:03.165 INFO:tasks.workunit.client.0.smithi063.stdout:5/991: dwrite d1/f98 [4194304,4194304] 0 2023-12-07T16:22:03.165 INFO:tasks.workunit.client.0.smithi063.stdout:5/992: write d1/d31/d56/db7/f125 [148659,2007] 0 2023-12-07T16:22:03.166 INFO:tasks.workunit.client.0.smithi063.stdout:5/993: truncate d1/f34 4219903 0 2023-12-07T16:22:03.166 INFO:tasks.workunit.client.0.smithi063.stdout:5/994: fdatasync d1/d3/de/d1e/d6b/f7d 0 2023-12-07T16:22:03.168 INFO:tasks.workunit.client.0.smithi063.stdout:5/995: creat d1/d3/de/f138 x:0 0 0 2023-12-07T16:22:03.172 INFO:tasks.workunit.client.0.smithi063.stdout:5/996: rename d1/d3/d3a/dcd/dd3/f9b to d1/d31/f139 0 2023-12-07T16:22:03.172 INFO:tasks.workunit.client.0.smithi063.stdout:5/997: read - d1/d3/de/d1e/d6b/f11d zero size 2023-12-07T16:22:03.174 INFO:tasks.workunit.client.0.smithi063.stdout:5/998: creat d1/d31/dc8/f13a x:0 0 0 2023-12-07T16:22:03.178 INFO:tasks.workunit.client.0.smithi063.stdout:5/999: rename d1/d3/de6/df0/f127 to d1/d3/de6/df0/f13b 0 2023-12-07T16:22:03.183 INFO:tasks.workunit.client.0.smithi063.stdout:4/941: dwrite d1/d3/db/d2c/ff2 [0,4194304] 0 2023-12-07T16:22:03.198 INFO:tasks.workunit.client.0.smithi063.stdout:4/942: dwrite d1/d3/db/d16/f7a [4194304,4194304] 0 2023-12-07T16:22:03.200 INFO:tasks.workunit.client.0.smithi063.stdout:4/943: rename d1/d3/d3f/l118 to d1/dc6/ddc/d64/d80/l120 0 2023-12-07T16:22:03.200 INFO:tasks.workunit.client.0.smithi063.stdout:4/944: truncate d1/d3/db/d73/fbf 929871 0 2023-12-07T16:22:03.201 INFO:tasks.workunit.client.0.smithi063.stdout:4/945: link d1/d3/db/f56 d1/d3/db/f121 0 2023-12-07T16:22:03.202 INFO:tasks.workunit.client.0.smithi063.stdout:4/946: creat d1/d3/db/f122 x:0 0 0 2023-12-07T16:22:03.202 INFO:tasks.workunit.client.0.smithi063.stdout:4/947: stat d1/d3/d3f/d44/fca 0 2023-12-07T16:22:03.203 INFO:tasks.workunit.client.0.smithi063.stdout:4/948: truncate d1/d3/f5 1499116 0 2023-12-07T16:22:03.204 INFO:tasks.workunit.client.0.smithi063.stdout:4/949: mknod d1/d3/db/d73/c123 0 2023-12-07T16:22:03.206 INFO:tasks.workunit.client.0.smithi063.stdout:4/950: creat d1/d3/db/d2c/f124 x:0 0 0 2023-12-07T16:22:03.207 INFO:tasks.workunit.client.0.smithi063.stdout:4/951: symlink d1/d3/db/d2c/ddf/l125 0 2023-12-07T16:22:03.207 INFO:tasks.workunit.client.0.smithi063.stdout:4/952: dread - d1/dc6/ddc/d64/fe7 zero size 2023-12-07T16:22:03.209 INFO:tasks.workunit.client.0.smithi063.stdout:4/953: rename d1/d3/d3a/cfa to d1/d3/d51/c126 0 2023-12-07T16:22:03.233 INFO:tasks.workunit.client.0.smithi063.stdout:4/954: dwrite d1/d3/db/d2c/d63/f45 [0,4194304] 0 2023-12-07T16:22:03.234 INFO:tasks.workunit.client.0.smithi063.stdout:4/955: getdents d1/d3/db/d2c/d63/d99/df1 0 2023-12-07T16:22:03.235 INFO:tasks.workunit.client.0.smithi063.stdout:4/956: unlink d1/d3/db/d41/f6a 0 2023-12-07T16:22:03.236 INFO:tasks.workunit.client.0.smithi063.stdout:4/957: mkdir d1/dc6/ddc/dc8/d127 0 2023-12-07T16:22:03.237 INFO:tasks.workunit.client.0.smithi063.stdout:4/958: symlink d1/dc6/ddc/d64/dd9/l128 0 2023-12-07T16:22:03.237 INFO:tasks.workunit.client.0.smithi063.stdout:4/959: fdatasync d1/f81 0 2023-12-07T16:22:03.237 INFO:tasks.workunit.client.0.smithi063.stdout:4/960: symlink d1/d3/d3f/l129 0 2023-12-07T16:22:03.254 INFO:tasks.workunit.client.0.smithi063.stdout:4/961: dwrite d1/dc6/ffb [0,4194304] 0 2023-12-07T16:22:03.274 INFO:tasks.workunit.client.0.smithi063.stdout:4/962: dwrite d1/d3/db/d16/fdd [0,4194304] 0 2023-12-07T16:22:03.274 INFO:tasks.workunit.client.0.smithi063.stdout:4/963: rename d1 to d1/d3/d12a 22 2023-12-07T16:22:03.274 INFO:tasks.workunit.client.0.smithi063.stdout:4/964: fdatasync d1/d3/db/f122 0 2023-12-07T16:22:03.292 INFO:tasks.workunit.client.0.smithi063.stdout:4/965: dwrite d1/f81 [0,4194304] 0 2023-12-07T16:22:03.295 INFO:tasks.workunit.client.0.smithi063.stdout:4/966: symlink d1/d3/db/d16/d112/l12b 0 2023-12-07T16:22:03.304 INFO:tasks.workunit.client.0.smithi063.stdout:4/967: dread d1/dc6/ffb [0,4194304] 0 2023-12-07T16:22:03.305 INFO:tasks.workunit.client.0.smithi063.stdout:4/968: mknod d1/dc6/ddc/c12c 0 2023-12-07T16:22:03.305 INFO:tasks.workunit.client.0.smithi063.stdout:4/969: stat d1/dc6/ddc/d64/d80/cc0 0 2023-12-07T16:22:03.306 INFO:tasks.workunit.client.0.smithi063.stdout:4/970: dread - d1/d3/db/f122 zero size 2023-12-07T16:22:03.314 INFO:tasks.workunit.client.0.smithi063.stdout:4/971: dread d1/f81 [0,4194304] 0 2023-12-07T16:22:03.314 INFO:tasks.workunit.client.0.smithi063.stdout:4/972: readlink d1/d3/db/d16/d112/l12b 0 2023-12-07T16:22:03.316 INFO:tasks.workunit.client.0.smithi063.stdout:4/973: truncate d1/d3/db/d2c/d63/f18 1860233 0 2023-12-07T16:22:03.316 INFO:tasks.workunit.client.0.smithi063.stdout:4/974: stat d1/dc6/ddc/d64/dd9/c109 0 2023-12-07T16:22:03.317 INFO:tasks.workunit.client.0.smithi063.stdout:4/975: readlink d1/dc6/lf4 0 2023-12-07T16:22:03.578 INFO:tasks.workunit.client.0.smithi063.stdout:4/976: sync 2023-12-07T16:22:03.595 INFO:tasks.workunit.client.0.smithi063.stdout:4/977: dwrite d1/d3/db/d2c/d63/f84 [0,4194304] 0 2023-12-07T16:22:03.595 INFO:tasks.workunit.client.0.smithi063.stdout:4/978: fdatasync d1/d3/db/d41/fb5 0 2023-12-07T16:22:03.595 INFO:tasks.workunit.client.0.smithi063.stdout:4/979: fsync d1/d3/db/d16/f11a 0 2023-12-07T16:22:03.596 INFO:tasks.workunit.client.0.smithi063.stdout:4/980: creat d1/d3/db/d2c/d63/d99/df1/f12d x:0 0 0 2023-12-07T16:22:03.597 INFO:tasks.workunit.client.0.smithi063.stdout:4/981: write d1/d3/db/d2c/fc4 [349748,51075] 0 2023-12-07T16:22:03.597 INFO:tasks.workunit.client.0.smithi063.stdout:4/982: chown d1/d3/db/d16/d112/cf9 60871 1 2023-12-07T16:22:03.598 INFO:tasks.workunit.client.0.smithi063.stdout:4/983: unlink d1/d3/d3f/d44/cc3 0 2023-12-07T16:22:03.598 INFO:tasks.workunit.client.0.smithi063.stdout:4/984: fsync d1/dc6/ddc/dc8/fed 0 2023-12-07T16:22:03.598 INFO:tasks.workunit.client.0.smithi063.stdout:4/985: read - d1/d3/d9f/fea zero size 2023-12-07T16:22:03.599 INFO:tasks.workunit.client.0.smithi063.stdout:4/986: creat d1/d3/db/d16/d112/f12e x:0 0 0 2023-12-07T16:22:03.600 INFO:tasks.workunit.client.0.smithi063.stdout:4/987: rmdir d1/d3/d3a 39 2023-12-07T16:22:03.602 INFO:tasks.workunit.client.0.smithi063.stdout:4/988: truncate d1/f98 391560 0 2023-12-07T16:22:03.602 INFO:tasks.workunit.client.0.smithi063.stdout:4/989: write d1/d3/db/f122 [871755,67594] 0 2023-12-07T16:22:03.602 INFO:tasks.workunit.client.0.smithi063.stdout:4/990: readlink d1/l7c 0 2023-12-07T16:22:03.603 INFO:tasks.workunit.client.0.smithi063.stdout:4/991: creat d1/d3/db/d73/f12f x:0 0 0 2023-12-07T16:22:03.604 INFO:tasks.workunit.client.0.smithi063.stdout:4/992: stat d1/d3/db/d2c/fa3 0 2023-12-07T16:22:03.604 INFO:tasks.workunit.client.0.smithi063.stdout:4/993: mknod d1/d3/c130 0 2023-12-07T16:22:03.626 INFO:tasks.workunit.client.0.smithi063.stdout:4/994: dwrite d1/d3/d3a/f97 [4194304,4194304] 0 2023-12-07T16:22:03.627 INFO:tasks.workunit.client.0.smithi063.stdout:4/995: creat d1/dc6/f131 x:0 0 0 2023-12-07T16:22:03.628 INFO:tasks.workunit.client.0.smithi063.stdout:4/996: creat d1/dc6/ddc/d64/f132 x:0 0 0 2023-12-07T16:22:03.628 INFO:tasks.workunit.client.0.smithi063.stdout:4/997: chown d1/dc6/ddc/dc8/fed 1049 1 2023-12-07T16:22:03.632 INFO:tasks.workunit.client.0.smithi063.stdout:4/998: write d1/d3/f5 [30658,40678] 0 2023-12-07T16:22:03.633 INFO:tasks.workunit.client.0.smithi063.stdout:4/999: creat d1/dc6/ddc/f133 x:0 0 0 2023-12-07T16:22:03.636 INFO:tasks.workunit.client.0.smithi063.stderr:+ rm -rf -- ./tmp.8at1iWBuHS 2023-12-07T16:22:04.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:04 smithi063 ceph-mon[112095]: pgmap v6: 65 pgs: 65 active+clean; 2.4 GiB data, 8.9 GiB used, 528 GiB / 536 GiB avail; 29 MiB/s rd, 52 MiB/s wr, 230 op/s 2023-12-07T16:22:04.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:04 smithi152 ceph-mon[121113]: pgmap v6: 65 pgs: 65 active+clean; 2.4 GiB data, 8.9 GiB used, 528 GiB / 536 GiB avail; 29 MiB/s rd, 52 MiB/s wr, 230 op/s 2023-12-07T16:22:05.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:05 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:05.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:05 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:05.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:05 smithi152 ceph-mon[121113]: pgmap v7: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 26 MiB/s rd, 47 MiB/s wr, 225 op/s 2023-12-07T16:22:05.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:05 smithi152 ceph-mon[121113]: Standby manager daemon smithi152.sxayfb started 2023-12-07T16:22:05.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:05 smithi152 ceph-mon[121113]: from='mgr.? 172.21.15.152:0/4244391923' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.sxayfb/crt"}]: dispatch 2023-12-07T16:22:05.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:05 smithi152 ceph-mon[121113]: from='mgr.? 172.21.15.152:0/4244391923' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-07T16:22:05.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:05 smithi152 ceph-mon[121113]: from='mgr.? 172.21.15.152:0/4244391923' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.sxayfb/key"}]: dispatch 2023-12-07T16:22:05.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:05 smithi152 ceph-mon[121113]: from='mgr.? 172.21.15.152:0/4244391923' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-07T16:22:05.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:05 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:06.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:05 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:06.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:05 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:06.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:05 smithi063 ceph-mon[112095]: pgmap v7: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 26 MiB/s rd, 47 MiB/s wr, 225 op/s 2023-12-07T16:22:06.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:05 smithi063 ceph-mon[112095]: Standby manager daemon smithi152.sxayfb started 2023-12-07T16:22:06.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:05 smithi063 ceph-mon[112095]: from='mgr.? 172.21.15.152:0/4244391923' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.sxayfb/crt"}]: dispatch 2023-12-07T16:22:06.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:05 smithi063 ceph-mon[112095]: from='mgr.? 172.21.15.152:0/4244391923' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-07T16:22:06.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:05 smithi063 ceph-mon[112095]: from='mgr.? 172.21.15.152:0/4244391923' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.sxayfb/key"}]: dispatch 2023-12-07T16:22:06.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:05 smithi063 ceph-mon[112095]: from='mgr.? 172.21.15.152:0/4244391923' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-07T16:22:06.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:05 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:06.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:06 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:06.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:06 smithi063 ceph-mon[112095]: mgrmap e31: smithi063.yohyyx(active, since 8s), standbys: smithi152.sxayfb 2023-12-07T16:22:06.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:06 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr metadata", "who": "smithi152.sxayfb", "id": "smithi152.sxayfb"}]: dispatch 2023-12-07T16:22:06.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:06 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:06.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:06 smithi152 ceph-mon[121113]: mgrmap e31: smithi063.yohyyx(active, since 8s), standbys: smithi152.sxayfb 2023-12-07T16:22:06.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:06 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr metadata", "who": "smithi152.sxayfb", "id": "smithi152.sxayfb"}]: dispatch 2023-12-07T16:22:08.653 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:08 smithi063 ceph-mon[112095]: pgmap v8: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 20 MiB/s rd, 37 MiB/s wr, 175 op/s 2023-12-07T16:22:08.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:08 smithi152 ceph-mon[121113]: pgmap v8: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 20 MiB/s rd, 37 MiB/s wr, 175 op/s 2023-12-07T16:22:09.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:09 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:09.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:09 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:09.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:09 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:22:09.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:09 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:22:09.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:09 smithi152 ceph-mon[121113]: Updating smithi063:/etc/ceph/ceph.conf 2023-12-07T16:22:09.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:09 smithi152 ceph-mon[121113]: Updating smithi152:/etc/ceph/ceph.conf 2023-12-07T16:22:09.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:09 smithi152 ceph-mon[121113]: Updating smithi152:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-07T16:22:09.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:09 smithi152 ceph-mon[121113]: Updating smithi063:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-07T16:22:09.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:09 smithi152 ceph-mon[121113]: pgmap v9: 65 pgs: 65 active+clean; 1.7 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 17 MiB/s rd, 34 MiB/s wr, 346 op/s 2023-12-07T16:22:09.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:09 smithi152 ceph-mon[121113]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2023-12-07T16:22:09.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:09 smithi152 ceph-mon[121113]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2023-12-07T16:22:10.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:09 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:10.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:09 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:10.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:09 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:22:10.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:09 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:22:10.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:09 smithi063 ceph-mon[112095]: Updating smithi063:/etc/ceph/ceph.conf 2023-12-07T16:22:10.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:09 smithi063 ceph-mon[112095]: Updating smithi152:/etc/ceph/ceph.conf 2023-12-07T16:22:10.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:09 smithi063 ceph-mon[112095]: Updating smithi152:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-07T16:22:10.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:09 smithi063 ceph-mon[112095]: Updating smithi063:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-07T16:22:10.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:09 smithi063 ceph-mon[112095]: pgmap v9: 65 pgs: 65 active+clean; 1.7 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 17 MiB/s rd, 34 MiB/s wr, 346 op/s 2023-12-07T16:22:10.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:09 smithi063 ceph-mon[112095]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2023-12-07T16:22:10.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:09 smithi063 ceph-mon[112095]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2023-12-07T16:22:11.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:10 smithi152 ceph-mon[121113]: Updating smithi152:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-07T16:22:11.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:10 smithi152 ceph-mon[121113]: Updating smithi063:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-07T16:22:11.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:10 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:11.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:10 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:11.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:10 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:11.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:10 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:11.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:10 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:11.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:10 smithi152 ceph-mon[121113]: Reconfiguring prometheus.smithi063 (dependencies changed)... 2023-12-07T16:22:11.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:10 smithi152 ceph-mon[121113]: Reconfiguring daemon prometheus.smithi063 on smithi063 2023-12-07T16:22:11.310 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:10 smithi063 ceph-mon[112095]: Updating smithi152:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-07T16:22:11.310 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:10 smithi063 ceph-mon[112095]: Updating smithi063:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-07T16:22:11.311 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:10 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:11.311 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:10 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:11.311 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:10 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:11.311 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:10 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:11.311 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:10 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:11.311 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:10 smithi063 ceph-mon[112095]: Reconfiguring prometheus.smithi063 (dependencies changed)... 2023-12-07T16:22:11.311 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:10 smithi063 ceph-mon[112095]: Reconfiguring daemon prometheus.smithi063 on smithi063 2023-12-07T16:22:12.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:11 smithi152 ceph-mon[121113]: pgmap v10: 65 pgs: 65 active+clean; 1.7 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 16 MiB/s rd, 32 MiB/s wr, 317 op/s 2023-12-07T16:22:12.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:11 smithi063 ceph-mon[112095]: pgmap v10: 65 pgs: 65 active+clean; 1.7 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 16 MiB/s rd, 32 MiB/s wr, 317 op/s 2023-12-07T16:22:13.108 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:12 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:22:13.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:12 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:22:13.356 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-07T16:22:13.356 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-07T16:22:14.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:14 smithi063 ceph-mon[112095]: pgmap v11: 65 pgs: 65 active+clean; 862 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 16 MiB/s rd, 33 MiB/s wr, 493 op/s 2023-12-07T16:22:14.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:14 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:14.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:14 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:14.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:14 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-07T16:22:14.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:14 smithi063 ceph-mon[112095]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-07T16:22:14.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:14 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:22:14.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:14 smithi152 ceph-mon[121113]: pgmap v11: 65 pgs: 65 active+clean; 862 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 16 MiB/s rd, 33 MiB/s wr, 493 op/s 2023-12-07T16:22:14.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:14 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:14.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:14 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:14.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:14 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-07T16:22:14.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:14 smithi152 ceph-mon[121113]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-07T16:22:14.743 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:14 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:22:16.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:16 smithi063 ceph-mon[112095]: pgmap v12: 65 pgs: 65 active+clean; 742 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 4.1 MiB/s rd, 11 MiB/s wr, 419 op/s 2023-12-07T16:22:16.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:16 smithi152 ceph-mon[121113]: pgmap v12: 65 pgs: 65 active+clean; 742 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 4.1 MiB/s rd, 11 MiB/s wr, 419 op/s 2023-12-07T16:22:18.636 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:18 smithi152 ceph-mon[121113]: pgmap v13: 65 pgs: 65 active+clean; 742 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 724 KiB/s rd, 5.0 MiB/s wr, 383 op/s 2023-12-07T16:22:18.636 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:18 smithi152 ceph-mon[121113]: Upgrade: Updating mgr.smithi152.sxayfb 2023-12-07T16:22:18.636 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:18 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.sxayfb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-07T16:22:18.636 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:18 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-07T16:22:18.636 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:18 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:22:18.636 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:18 smithi152 ceph-mon[121113]: Deploying daemon mgr.smithi152.sxayfb on smithi152 2023-12-07T16:22:18.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:18 smithi063 ceph-mon[112095]: pgmap v13: 65 pgs: 65 active+clean; 742 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail; 724 KiB/s rd, 5.0 MiB/s wr, 383 op/s 2023-12-07T16:22:18.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:18 smithi063 ceph-mon[112095]: Upgrade: Updating mgr.smithi152.sxayfb 2023-12-07T16:22:18.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:18 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.sxayfb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-07T16:22:18.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:18 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-07T16:22:18.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:18 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:22:18.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:18 smithi063 ceph-mon[112095]: Deploying daemon mgr.smithi152.sxayfb on smithi152 2023-12-07T16:22:20.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:20 smithi063 ceph-mon[112095]: pgmap v14: 65 pgs: 65 active+clean; 314 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 743 KiB/s rd, 5.9 MiB/s wr, 539 op/s 2023-12-07T16:22:20.677 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:20 smithi152 ceph-mon[121113]: pgmap v14: 65 pgs: 65 active+clean; 314 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 743 KiB/s rd, 5.9 MiB/s wr, 539 op/s 2023-12-07T16:22:21.606 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:21 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:21.606 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:21 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:21.606 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:21 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:22:21.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:21 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:21.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:21 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:21.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:21 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:22:22.622 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:22 smithi152 ceph-mon[121113]: pgmap v15: 65 pgs: 65 active+clean; 314 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 2.0 MiB/s wr, 353 op/s 2023-12-07T16:22:22.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:22 smithi063 ceph-mon[112095]: pgmap v15: 65 pgs: 65 active+clean; 314 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 2.0 MiB/s wr, 353 op/s 2023-12-07T16:22:23.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:23 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:23.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:23 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:23.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:23 smithi152 ceph-mon[121113]: pgmap v16: 65 pgs: 65 active+clean; 297 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 2.7 MiB/s wr, 438 op/s 2023-12-07T16:22:23.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:23 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:24.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:23 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:24.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:23 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:24.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:23 smithi063 ceph-mon[112095]: pgmap v16: 65 pgs: 65 active+clean; 297 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 2.7 MiB/s wr, 438 op/s 2023-12-07T16:22:24.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:23 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:24.982 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:24 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:24.982 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:24 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:24.982 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:24 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:25.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:24 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:25.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:24 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:25.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:24 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:25.955 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:25 smithi152 ceph-mon[121113]: pgmap v17: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.9 MiB/s wr, 281 op/s 2023-12-07T16:22:26.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:25 smithi063 ceph-mon[112095]: pgmap v17: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.9 MiB/s wr, 281 op/s 2023-12-07T16:22:27.619 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:27 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:27.619 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:27 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:27.619 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:27 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:22:27.619 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:27 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:22:27.619 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:27 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:27.619 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:27 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:22:27.619 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:27 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:22:27.620 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:27 smithi063 ceph-mon[112095]: Upgrade: Setting container_image for all mgr 2023-12-07T16:22:27.620 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:27 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:27.620 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:27 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi063.yohyyx"}]: dispatch 2023-12-07T16:22:27.620 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:27 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi063.yohyyx"}]': finished 2023-12-07T16:22:27.620 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:27 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi152.sxayfb"}]: dispatch 2023-12-07T16:22:27.620 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:27 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi152.sxayfb"}]': finished 2023-12-07T16:22:27.620 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:27 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-07T16:22:27.620 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:27 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:22:27.684 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:27 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:27.684 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:27 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:27.684 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:27 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:22:27.684 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:27 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:22:27.684 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:27 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:27.684 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:27 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:22:27.684 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:27 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:22:27.685 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:27 smithi152 ceph-mon[121113]: Upgrade: Setting container_image for all mgr 2023-12-07T16:22:27.685 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:27 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:27.685 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:27 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi063.yohyyx"}]: dispatch 2023-12-07T16:22:27.685 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:27 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi063.yohyyx"}]': finished 2023-12-07T16:22:27.685 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:27 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi152.sxayfb"}]: dispatch 2023-12-07T16:22:27.685 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:27 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi152.sxayfb"}]': finished 2023-12-07T16:22:27.685 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:27 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-07T16:22:27.685 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:27 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:22:28.769 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:28 smithi063 ceph-mon[112095]: pgmap v18: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.9 MiB/s wr, 259 op/s 2023-12-07T16:22:28.769 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:28 smithi063 ceph-mon[112095]: fsmap cephfs:2 {0=cephfs.smithi063.yidolg=up:active,1=cephfs.smithi152.mrvngf=up:active} 2 up:standby 2023-12-07T16:22:28.769 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:28 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:28.769 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:28 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-07T16:22:28.769 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:28 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-07T16:22:28.770 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:28 smithi063 ceph-mon[112095]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:22:28.944 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:28 smithi152 ceph-mon[121113]: pgmap v18: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.9 MiB/s wr, 259 op/s 2023-12-07T16:22:28.945 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:28 smithi152 ceph-mon[121113]: fsmap cephfs:2 {0=cephfs.smithi063.yidolg=up:active,1=cephfs.smithi152.mrvngf=up:active} 2 up:standby 2023-12-07T16:22:28.945 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:28 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:28.945 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:28 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-07T16:22:28.945 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:28 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-07T16:22:28.945 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:28 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:22:29.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:28 smithi063 systemd[1]: Stopping Ceph mon.smithi063 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:22:29.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:29 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-mon-smithi063[112072]: 2023-12-07T16:22:29.428+0000 7f9af2fa8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi063 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-07T16:22:29.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:29 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-mon-smithi063[112072]: 2023-12-07T16:22:29.428+0000 7f9af2fa8700 -1 mon.smithi063@0(leader) e2 *** Got Signal Terminated *** 2023-12-07T16:22:30.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:30 smithi063 bash[191766]: ceph-8c493298-951b-11ee-95a2-87774f69a715-mon-smithi063 2023-12-07T16:22:31.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:31 smithi063 systemd[1]: ceph-8c493298-951b-11ee-95a2-87774f69a715@mon.smithi063.service: Succeeded. 2023-12-07T16:22:31.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:31 smithi063 systemd[1]: Stopped Ceph mon.smithi063 for 8c493298-951b-11ee-95a2-87774f69a715. 2023-12-07T16:22:31.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:31 smithi063 systemd[1]: Starting Ceph mon.smithi063 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:22:32.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.007+0000 7fbb28c32700 1 -- 172.21.15.63:0/1114953728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb240fcd00 msgr2=0x7fbb240fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:32.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.007+0000 7fbb28c32700 1 --2- 172.21.15.63:0/1114953728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb240fcd00 0x7fbb240fd150 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbb18004940 tx=0x7fbb18009e30 comp rx=0 tx=0).stop 2023-12-07T16:22:32.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.007+0000 7fbb28c32700 1 -- 172.21.15.63:0/1114953728 shutdown_connections 2023-12-07T16:22:32.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.007+0000 7fbb28c32700 1 --2- 172.21.15.63:0/1114953728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb240fcd00 0x7fbb240fd150 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:32.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.007+0000 7fbb28c32700 1 --2- 172.21.15.63:0/1114953728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb240fbaf0 0x7fbb240fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:32.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.007+0000 7fbb28c32700 1 -- 172.21.15.63:0/1114953728 >> 172.21.15.63:0/1114953728 conn(0x7fbb240f71b0 msgr2=0x7fbb240f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:22:32.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.007+0000 7fbb28c32700 1 -- 172.21.15.63:0/1114953728 shutdown_connections 2023-12-07T16:22:32.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.007+0000 7fbb28c32700 1 -- 172.21.15.63:0/1114953728 wait complete. 2023-12-07T16:22:32.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.008+0000 7fbb28c32700 1 Processor -- start 2023-12-07T16:22:32.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.008+0000 7fbb28c32700 1 -- start start 2023-12-07T16:22:32.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.008+0000 7fbb28c32700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb240fbaf0 0x7fbb2410c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:32.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.008+0000 7fbb28c32700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb240fcd00 0x7fbb2410ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:32.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.008+0000 7fbb28c32700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2410d0f0 con 0x7fbb240fbaf0 2023-12-07T16:22:32.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.008+0000 7fbb28c32700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2410d930 con 0x7fbb240fcd00 2023-12-07T16:22:32.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.008+0000 7fbb2259c700 1 -- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb240fbaf0 msgr2=0x7fbb2410c520 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:3300/0 2023-12-07T16:22:32.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.008+0000 7fbb2259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb240fbaf0 0x7fbb2410c520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-07T16:22:32.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.008+0000 7fbb21d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb240fcd00 0x7fbb2410ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:32.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.008+0000 7fbb21d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb240fcd00 0x7fbb2410ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.63:46020/0 (socket says 172.21.15.63:46020) 2023-12-07T16:22:32.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.008+0000 7fbb21d9b700 1 -- 172.21.15.63:0/2935143712 learned_addr learned my addr 172.21.15.63:0/2935143712 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:22:32.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.008+0000 7fbb21d9b700 1 -- 172.21.15.63:0/2935143712 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb240fbaf0 msgr2=0x7fbb2410c520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-07T16:22:32.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.008+0000 7fbb21d9b700 1 --2- 172.21.15.63:0/2935143712 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb240fbaf0 0x7fbb2410c520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:32.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.008+0000 7fbb21d9b700 1 -- 172.21.15.63:0/2935143712 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb18005040 con 0x7fbb240fcd00 2023-12-07T16:22:32.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.009+0000 7fbb21d9b700 1 --2- 172.21.15.63:0/2935143712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb240fcd00 0x7fbb2410ca60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbb18008f80 tx=0x7fbb18009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:22:32.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.009+0000 7fbb12ffd700 1 -- 172.21.15.63:0/2935143712 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb1800e070 con 0x7fbb240fcd00 2023-12-07T16:22:32.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.009+0000 7fbb12ffd700 1 -- 172.21.15.63:0/2935143712 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbb18013420 con 0x7fbb240fcd00 2023-12-07T16:22:32.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.009+0000 7fbb28c32700 1 -- 172.21.15.63:0/2935143712 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2410dbb0 con 0x7fbb240fcd00 2023-12-07T16:22:32.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.009+0000 7fbb12ffd700 1 -- 172.21.15.63:0/2935143712 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb1801c640 con 0x7fbb240fcd00 2023-12-07T16:22:32.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.009+0000 7fbb28c32700 1 -- 172.21.15.63:0/2935143712 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2410e090 con 0x7fbb240fcd00 2023-12-07T16:22:32.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.010+0000 7fbb28c32700 1 -- 172.21.15.63:0/2935143712 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2404bb80 con 0x7fbb240fcd00 2023-12-07T16:22:32.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.011+0000 7fbb12ffd700 1 -- 172.21.15.63:0/2935143712 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 31) v1 ==== 90899+0+0 (secure 0 0 0) 0x7fbb1800bb80 con 0x7fbb240fcd00 2023-12-07T16:22:32.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.011+0000 7fbb12ffd700 1 --2- 172.21.15.63:0/2935143712 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fbb0c06cba0 0x7fbb0c06f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:32.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.011+0000 7fbb12ffd700 1 -- 172.21.15.63:0/2935143712 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fbb1808d760 con 0x7fbb240fcd00 2023-12-07T16:22:32.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.011+0000 7fbb2259c700 1 --2- 172.21.15.63:0/2935143712 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fbb0c06cba0 0x7fbb0c06f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:32.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.012+0000 7fbb2259c700 1 --2- 172.21.15.63:0/2935143712 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fbb0c06cba0 0x7fbb0c06f050 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbb240fcb60 tx=0x7fbb14006dc0 comp rx=0 tx=0).ready entity=mgr.24453 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:22:32.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.016+0000 7fbb12ffd700 1 -- 172.21.15.63:0/2935143712 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fbb1805b450 con 0x7fbb240fcd00 2023-12-07T16:22:32.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.356+0000 7fbb28c32700 1 -- 172.21.15.63:0/2935143712 --> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb2410e740 con 0x7fbb0c06cba0 2023-12-07T16:22:32.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.358+0000 7fbb12ffd700 1 -- 172.21.15.63:0/2935143712 <== mgr.24453 v2:172.21.15.63:6800/2671097541 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fbb2410e740 con 0x7fbb0c06cba0 2023-12-07T16:22:32.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.361+0000 7fbb28c32700 1 -- 172.21.15.63:0/2935143712 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fbb0c06cba0 msgr2=0x7fbb0c06f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:32.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.361+0000 7fbb28c32700 1 --2- 172.21.15.63:0/2935143712 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fbb0c06cba0 0x7fbb0c06f050 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbb240fcb60 tx=0x7fbb14006dc0 comp rx=0 tx=0).stop 2023-12-07T16:22:32.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.361+0000 7fbb28c32700 1 -- 172.21.15.63:0/2935143712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb240fcd00 msgr2=0x7fbb2410ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:32.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.361+0000 7fbb28c32700 1 --2- 172.21.15.63:0/2935143712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb240fcd00 0x7fbb2410ca60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbb18008f80 tx=0x7fbb18009e30 comp rx=0 tx=0).stop 2023-12-07T16:22:32.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.361+0000 7fbb28c32700 1 -- 172.21.15.63:0/2935143712 shutdown_connections 2023-12-07T16:22:32.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.361+0000 7fbb28c32700 1 --2- 172.21.15.63:0/2935143712 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fbb0c06cba0 0x7fbb0c06f050 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:32.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.361+0000 7fbb28c32700 1 --2- 172.21.15.63:0/2935143712 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbb240fbaf0 0x7fbb2410c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:32.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.361+0000 7fbb28c32700 1 --2- 172.21.15.63:0/2935143712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb240fcd00 0x7fbb2410ca60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:32.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.361+0000 7fbb28c32700 1 -- 172.21.15.63:0/2935143712 >> 172.21.15.63:0/2935143712 conn(0x7fbb240f71b0 msgr2=0x7fbb240fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:22:32.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.361+0000 7fbb28c32700 1 -- 172.21.15.63:0/2935143712 shutdown_connections 2023-12-07T16:22:32.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.361+0000 7fbb28c32700 1 -- 172.21.15.63:0/2935143712 wait complete. 2023-12-07T16:22:32.379 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-07T16:22:32.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.514+0000 7f34fbfe0700 1 -- 172.21.15.63:0/568174669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34f40fd0e0 msgr2=0x7f34f40fd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:32.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.514+0000 7f34fbfe0700 1 --2- 172.21.15.63:0/568174669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34f40fd0e0 0x7f34f40fd4f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f34f0004940 tx=0x7f34f0009e30 comp rx=0 tx=0).stop 2023-12-07T16:22:32.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.514+0000 7f34fbfe0700 1 -- 172.21.15.63:0/568174669 shutdown_connections 2023-12-07T16:22:32.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.514+0000 7f34fbfe0700 1 --2- 172.21.15.63:0/568174669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34f40fbd50 0x7f34f40fc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:32.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.514+0000 7f34fbfe0700 1 --2- 172.21.15.63:0/568174669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34f40fd0e0 0x7f34f40fd4f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:32.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.514+0000 7f34fbfe0700 1 -- 172.21.15.63:0/568174669 >> 172.21.15.63:0/568174669 conn(0x7f34f40f6950 msgr2=0x7f34f40f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:22:32.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.515+0000 7f34fbfe0700 1 -- 172.21.15.63:0/568174669 shutdown_connections 2023-12-07T16:22:32.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.515+0000 7f34fbfe0700 1 -- 172.21.15.63:0/568174669 wait complete. 2023-12-07T16:22:32.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.515+0000 7f34fbfe0700 1 Processor -- start 2023-12-07T16:22:32.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.515+0000 7f34fbfe0700 1 -- start start 2023-12-07T16:22:32.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.515+0000 7f34fbfe0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34f40fbd50 0x7f34f40ffc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:32.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.515+0000 7f34fbfe0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34f40fd0e0 0x7f34f40fe0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:32.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.515+0000 7f34fbfe0700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f40fe730 con 0x7f34f40fbd50 2023-12-07T16:22:32.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.515+0000 7f34fbfe0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f40fe8a0 con 0x7f34f40fd0e0 2023-12-07T16:22:32.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.515+0000 7f34f9d7c700 1 -- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34f40fbd50 msgr2=0x7f34f40ffc20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:3300/0 2023-12-07T16:22:32.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.515+0000 7f34f9d7c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34f40fbd50 0x7f34f40ffc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-07T16:22:32.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.516+0000 7f34f957b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34f40fd0e0 0x7f34f40fe0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:32.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.516+0000 7f34f957b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34f40fd0e0 0x7f34f40fe0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.63:46044/0 (socket says 172.21.15.63:46044) 2023-12-07T16:22:32.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.516+0000 7f34f957b700 1 -- 172.21.15.63:0/2693646399 learned_addr learned my addr 172.21.15.63:0/2693646399 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:22:32.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.516+0000 7f34f957b700 1 -- 172.21.15.63:0/2693646399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34f40fbd50 msgr2=0x7f34f40ffc20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-07T16:22:32.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.516+0000 7f34f957b700 1 --2- 172.21.15.63:0/2693646399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34f40fbd50 0x7f34f40ffc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:32.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.516+0000 7f34f957b700 1 -- 172.21.15.63:0/2693646399 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f0005040 con 0x7f34f40fd0e0 2023-12-07T16:22:32.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.516+0000 7f34f957b700 1 --2- 172.21.15.63:0/2693646399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34f40fd0e0 0x7f34f40fe0a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f34e400b790 tx=0x7f34e40091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:22:32.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.516+0000 7f34ea7fc700 1 -- 172.21.15.63:0/2693646399 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34e4010790 con 0x7f34f40fd0e0 2023-12-07T16:22:32.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.516+0000 7f34fbfe0700 1 -- 172.21.15.63:0/2693646399 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f40feb80 con 0x7f34f40fd0e0 2023-12-07T16:22:32.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.516+0000 7f34ea7fc700 1 -- 172.21.15.63:0/2693646399 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f34e4010da0 con 0x7f34f40fd0e0 2023-12-07T16:22:32.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.516+0000 7f34ea7fc700 1 -- 172.21.15.63:0/2693646399 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34e4011e90 con 0x7f34f40fd0e0 2023-12-07T16:22:32.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.517+0000 7f34fbfe0700 1 -- 172.21.15.63:0/2693646399 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f40fef00 con 0x7f34f40fd0e0 2023-12-07T16:22:32.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.518+0000 7f34fbfe0700 1 -- 172.21.15.63:0/2693646399 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f404bb80 con 0x7f34f40fd0e0 2023-12-07T16:22:32.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.518+0000 7f34ea7fc700 1 -- 172.21.15.63:0/2693646399 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 31) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f34e40108f0 con 0x7f34f40fd0e0 2023-12-07T16:22:32.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.519+0000 7f34ea7fc700 1 --2- 172.21.15.63:0/2693646399 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f34e006cb50 0x7f34e006f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:32.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.519+0000 7f34ea7fc700 1 -- 172.21.15.63:0/2693646399 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f34e408bf80 con 0x7f34f40fd0e0 2023-12-07T16:22:32.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.520+0000 7f34f9d7c700 1 --2- 172.21.15.63:0/2693646399 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f34e006cb50 0x7f34e006f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:32.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.521+0000 7f34f9d7c700 1 --2- 172.21.15.63:0/2693646399 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f34e006cb50 0x7f34e006f000 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f34f0000c00 tx=0x7f34f0009e30 comp rx=0 tx=0).ready entity=mgr.24453 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:22:32.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.524+0000 7f34ea7fc700 1 -- 172.21.15.63:0/2693646399 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f34e4059c60 con 0x7f34f40fd0e0 2023-12-07T16:22:32.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.799+0000 7f34fbfe0700 1 -- 172.21.15.63:0/2693646399 --> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f34f40fb350 con 0x7f34e006cb50 2023-12-07T16:22:32.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.801+0000 7f34ea7fc700 1 -- 172.21.15.63:0/2693646399 <== mgr.24453 v2:172.21.15.63:6800/2671097541 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f34f40fb350 con 0x7f34e006cb50 2023-12-07T16:22:32.802 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.803+0000 7f34fbfe0700 1 -- 172.21.15.63:0/2693646399 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f34e006cb50 msgr2=0x7f34e006f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:32.802 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.803+0000 7f34fbfe0700 1 --2- 172.21.15.63:0/2693646399 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f34e006cb50 0x7f34e006f000 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f34f0000c00 tx=0x7f34f0009e30 comp rx=0 tx=0).stop 2023-12-07T16:22:32.802 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.803+0000 7f34fbfe0700 1 -- 172.21.15.63:0/2693646399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34f40fd0e0 msgr2=0x7f34f40fe0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:32.802 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.803+0000 7f34fbfe0700 1 --2- 172.21.15.63:0/2693646399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34f40fd0e0 0x7f34f40fe0a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f34e400b790 tx=0x7f34e40091d0 comp rx=0 tx=0).stop 2023-12-07T16:22:32.802 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.803+0000 7f34fbfe0700 1 -- 172.21.15.63:0/2693646399 shutdown_connections 2023-12-07T16:22:32.802 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.803+0000 7f34fbfe0700 1 --2- 172.21.15.63:0/2693646399 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f34e006cb50 0x7f34e006f000 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:32.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.803+0000 7f34fbfe0700 1 --2- 172.21.15.63:0/2693646399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34f40fbd50 0x7f34f40ffc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:32.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.803+0000 7f34fbfe0700 1 --2- 172.21.15.63:0/2693646399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34f40fd0e0 0x7f34f40fe0a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:32.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.803+0000 7f34fbfe0700 1 -- 172.21.15.63:0/2693646399 >> 172.21.15.63:0/2693646399 conn(0x7f34f40f6950 msgr2=0x7f34f40fac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:22:32.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.803+0000 7f34fbfe0700 1 -- 172.21.15.63:0/2693646399 shutdown_connections 2023-12-07T16:22:32.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.803+0000 7f34fbfe0700 1 -- 172.21.15.63:0/2693646399 wait complete. 2023-12-07T16:22:32.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: set uid:gid to 167:167 (ceph:ceph) 2023-12-07T16:22:32.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev), process ceph-mon, pid 7 2023-12-07T16:22:32.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: pidfile_write: ignore empty --pid-file 2023-12-07T16:22:32.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: load: jerasure load: lrc 2023-12-07T16:22:32.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: RocksDB version: 7.9.2 2023-12-07T16:22:32.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Git sha 0 2023-12-07T16:22:32.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Compile date 2023-12-05 09:15:47 2023-12-07T16:22:32.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: DB SUMMARY 2023-12-07T16:22:32.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: DB Session ID: 2EIY0VVK9VTVM7VC99HX 2023-12-07T16:22:32.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: CURRENT file: CURRENT 2023-12-07T16:22:32.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: IDENTITY file: IDENTITY 2023-12-07T16:22:32.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: MANIFEST file: MANIFEST-000015 size: 785 Bytes 2023-12-07T16:22:32.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi063/store.db dir, Total Num: 1, files: 000027.sst 2023-12-07T16:22:32.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi063/store.db: 000025.log size: 1152070 ; 2023-12-07T16:22:32.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.error_if_exists: 0 2023-12-07T16:22:32.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.create_if_missing: 0 2023-12-07T16:22:32.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.paranoid_checks: 1 2023-12-07T16:22:32.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-07T16:22:32.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-07T16:22:32.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-07T16:22:32.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.env: 0x55d856ee3a60 2023-12-07T16:22:32.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.fs: PosixFileSystem 2023-12-07T16:22:32.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.info_log: 0x55d857e89600 2023-12-07T16:22:32.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_file_opening_threads: 16 2023-12-07T16:22:32.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.statistics: (nil) 2023-12-07T16:22:32.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.use_fsync: 0 2023-12-07T16:22:32.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_log_file_size: 0 2023-12-07T16:22:32.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-07T16:22:32.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-07T16:22:32.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.keep_log_file_num: 1000 2023-12-07T16:22:32.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.recycle_log_file_num: 0 2023-12-07T16:22:32.908 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.allow_fallocate: 1 2023-12-07T16:22:32.908 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.allow_mmap_reads: 0 2023-12-07T16:22:32.908 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.allow_mmap_writes: 0 2023-12-07T16:22:32.908 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.use_direct_reads: 0 2023-12-07T16:22:32.908 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-07T16:22:32.908 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.create_missing_column_families: 0 2023-12-07T16:22:32.908 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.db_log_dir: 2023-12-07T16:22:32.908 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.wal_dir: 2023-12-07T16:22:32.909 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-07T16:22:32.909 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-07T16:22:32.910 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-07T16:22:32.910 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-07T16:22:32.910 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-07T16:22:32.910 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-07T16:22:32.910 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.advise_random_on_open: 1 2023-12-07T16:22:32.910 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.db_write_buffer_size: 0 2023-12-07T16:22:32.910 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.write_buffer_manager: 0x55d857e3f360 2023-12-07T16:22:32.910 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-07T16:22:32.910 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-07T16:22:32.910 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 bash[191924]: 8d7d0c6bfea31929bec16240bf67d1bdd19f08174b79857e6500eb02fd04d706 2023-12-07T16:22:32.910 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-07T16:22:32.911 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.rate_limiter: (nil) 2023-12-07T16:22:32.911 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-07T16:22:32.911 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.wal_recovery_mode: 2 2023-12-07T16:22:32.911 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.enable_thread_tracking: 0 2023-12-07T16:22:32.911 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.enable_pipelined_write: 0 2023-12-07T16:22:32.911 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.unordered_write: 0 2023-12-07T16:22:32.911 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-07T16:22:32.911 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-07T16:22:32.911 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-07T16:22:32.911 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-07T16:22:32.911 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.row_cache: None 2023-12-07T16:22:32.911 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.wal_filter: None 2023-12-07T16:22:32.911 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-07T16:22:32.911 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.allow_ingest_behind: 0 2023-12-07T16:22:32.911 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.two_write_queues: 0 2023-12-07T16:22:32.912 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.manual_wal_flush: 0 2023-12-07T16:22:32.912 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.wal_compression: 0 2023-12-07T16:22:32.912 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.atomic_flush: 0 2023-12-07T16:22:32.912 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-07T16:22:32.912 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-07T16:22:32.912 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-07T16:22:32.912 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.log_readahead_size: 0 2023-12-07T16:22:32.912 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-07T16:22:32.912 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.best_efforts_recovery: 0 2023-12-07T16:22:32.912 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-07T16:22:32.912 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-07T16:22:32.912 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.allow_data_in_errors: 0 2023-12-07T16:22:32.912 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.db_host_id: __hostname__ 2023-12-07T16:22:32.912 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-07T16:22:32.913 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_background_jobs: 2 2023-12-07T16:22:32.913 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_background_compactions: -1 2023-12-07T16:22:32.913 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_subcompactions: 1 2023-12-07T16:22:32.913 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-07T16:22:32.913 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-07T16:22:32.913 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-07T16:22:32.913 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_total_wal_size: 0 2023-12-07T16:22:32.913 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-07T16:22:32.913 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-07T16:22:32.913 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-07T16:22:32.913 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-07T16:22:32.913 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_open_files: -1 2023-12-07T16:22:32.913 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.bytes_per_sync: 0 2023-12-07T16:22:32.913 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-07T16:22:32.913 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-07T16:22:32.914 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.compaction_readahead_size: 0 2023-12-07T16:22:32.914 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_background_flushes: -1 2023-12-07T16:22:32.914 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Compression algorithms supported: 2023-12-07T16:22:32.914 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-07T16:22:32.914 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: kZSTD supported: 0 2023-12-07T16:22:32.914 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: kXpressCompression supported: 0 2023-12-07T16:22:32.914 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: kLZ4HCCompression supported: 1 2023-12-07T16:22:32.914 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: kZlibCompression supported: 1 2023-12-07T16:22:32.914 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: kSnappyCompression supported: 1 2023-12-07T16:22:32.914 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: kLZ4Compression supported: 1 2023-12-07T16:22:32.914 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: kBZip2Compression supported: 0 2023-12-07T16:22:32.914 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-07T16:22:32.914 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-07T16:22:32.915 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi063/store.db/MANIFEST-000015 2023-12-07T16:22:32.915 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-07T16:22:32.915 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-07T16:22:32.915 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.merge_operator: 2023-12-07T16:22:32.915 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.compaction_filter: None 2023-12-07T16:22:32.915 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.compaction_filter_factory: None 2023-12-07T16:22:32.915 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.sst_partitioner_factory: None 2023-12-07T16:22:32.915 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-07T16:22:32.915 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-07T16:22:32.915 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d857e89700) 2023-12-07T16:22:32.915 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: cache_index_and_filter_blocks: 1 2023-12-07T16:22:32.915 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-07T16:22:32.916 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-07T16:22:32.916 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: pin_top_level_index_and_filter: 1 2023-12-07T16:22:32.916 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: index_type: 0 2023-12-07T16:22:32.916 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: data_block_index_type: 0 2023-12-07T16:22:32.916 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: index_shortening: 1 2023-12-07T16:22:32.916 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-07T16:22:32.916 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: checksum: 4 2023-12-07T16:22:32.916 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: no_block_cache: 0 2023-12-07T16:22:32.916 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_cache: 0x55d857edf090 2023-12-07T16:22:32.916 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_cache_name: BinnedLRUCache 2023-12-07T16:22:32.916 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_cache_options: 2023-12-07T16:22:32.916 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: capacity : 536870912 2023-12-07T16:22:32.916 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: num_shard_bits : 4 2023-12-07T16:22:32.916 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: strict_capacity_limit : 0 2023-12-07T16:22:32.916 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: high_pri_pool_ratio: 0.000 2023-12-07T16:22:32.917 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_cache_compressed: (nil) 2023-12-07T16:22:32.917 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: persistent_cache: (nil) 2023-12-07T16:22:32.917 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_size: 4096 2023-12-07T16:22:32.917 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_size_deviation: 10 2023-12-07T16:22:32.917 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_restart_interval: 16 2023-12-07T16:22:32.917 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: index_block_restart_interval: 1 2023-12-07T16:22:32.917 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: metadata_block_size: 4096 2023-12-07T16:22:32.917 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: partition_filters: 0 2023-12-07T16:22:32.917 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: use_delta_encoding: 1 2023-12-07T16:22:32.917 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: filter_policy: bloomfilter 2023-12-07T16:22:32.917 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: whole_key_filtering: 1 2023-12-07T16:22:32.917 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: verify_compression: 0 2023-12-07T16:22:32.917 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: read_amp_bytes_per_bit: 0 2023-12-07T16:22:32.917 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: format_version: 5 2023-12-07T16:22:32.917 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: enable_index_compression: 1 2023-12-07T16:22:32.918 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: block_align: 0 2023-12-07T16:22:32.918 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: max_auto_readahead_size: 262144 2023-12-07T16:22:32.918 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: prepopulate_block_cache: 0 2023-12-07T16:22:32.918 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: initial_auto_readahead_size: 8192 2023-12-07T16:22:32.918 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: num_file_reads_for_auto_readahead: 2 2023-12-07T16:22:32.918 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.write_buffer_size: 33554432 2023-12-07T16:22:32.918 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_write_buffer_number: 2 2023-12-07T16:22:32.918 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.compression: NoCompression 2023-12-07T16:22:32.918 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.bottommost_compression: Disabled 2023-12-07T16:22:32.918 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.prefix_extractor: nullptr 2023-12-07T16:22:32.918 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-07T16:22:32.918 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.num_levels: 7 2023-12-07T16:22:32.918 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-07T16:22:32.918 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-07T16:22:32.919 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-07T16:22:32.919 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-07T16:22:32.919 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-07T16:22:32.919 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-07T16:22:32.919 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-07T16:22:32.919 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-07T16:22:32.919 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-07T16:22:32.919 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-07T16:22:32.919 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-07T16:22:32.919 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-07T16:22:32.919 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-07T16:22:32.919 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.compression_opts.level: 32767 2023-12-07T16:22:32.919 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.compression_opts.strategy: 0 2023-12-07T16:22:32.919 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-07T16:22:32.919 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-07T16:22:32.920 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-07T16:22:32.920 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-07T16:22:32.920 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.compression_opts.enabled: false 2023-12-07T16:22:32.920 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-07T16:22:32.920 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-07T16:22:32.920 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-07T16:22:32.920 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-07T16:22:32.920 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.target_file_size_base: 67108864 2023-12-07T16:22:32.920 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-07T16:22:32.920 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-07T16:22:32.920 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-07T16:22:32.920 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-07T16:22:32.920 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-07T16:22:32.920 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-07T16:22:32.920 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-07T16:22:32.921 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-07T16:22:32.921 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-07T16:22:32.921 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-07T16:22:32.921 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-07T16:22:32.921 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-07T16:22:32.921 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-07T16:22:32.921 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-07T16:22:32.921 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.arena_block_size: 1048576 2023-12-07T16:22:32.921 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-07T16:22:32.921 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-07T16:22:32.921 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.disable_auto_compactions: 0 2023-12-07T16:22:32.921 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-07T16:22:32.921 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-07T16:22:32.921 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-07T16:22:32.921 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-07T16:22:32.922 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-07T16:22:32.922 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-07T16:22:32.922 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-07T16:22:32.922 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-07T16:22:32.922 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-07T16:22:32.922 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-07T16:22:32.922 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.table_properties_collectors: 2023-12-07T16:22:32.922 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.inplace_update_support: 0 2023-12-07T16:22:32.922 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-07T16:22:32.922 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-07T16:22:32.922 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-07T16:22:32.922 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-07T16:22:32.922 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.bloom_locality: 0 2023-12-07T16:22:32.923 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.max_successive_merges: 0 2023-12-07T16:22:32.923 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-07T16:22:32.923 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.paranoid_file_checks: 0 2023-12-07T16:22:32.923 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.force_consistency_checks: 1 2023-12-07T16:22:32.923 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.report_bg_io_stats: 0 2023-12-07T16:22:32.923 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.ttl: 2592000 2023-12-07T16:22:32.923 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-07T16:22:32.923 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-07T16:22:32.923 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-07T16:22:32.923 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.enable_blob_files: false 2023-12-07T16:22:32.923 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.min_blob_size: 0 2023-12-07T16:22:32.923 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.blob_file_size: 268435456 2023-12-07T16:22:32.923 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-07T16:22:32.923 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-07T16:22:32.924 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-07T16:22:32.924 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-07T16:22:32.924 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-07T16:22:32.924 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.blob_file_starting_level: 0 2023-12-07T16:22:32.924 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-07T16:22:32.924 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2023-12-07T16:22:32.924 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-07T16:22:32.924 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi063/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 29, last_sequence is 9763, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-07T16:22:32.924 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2023-12-07T16:22:32.924 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5786e436-ccb7-44a9-bf38-54fead31b530 2023-12-07T16:22:32.924 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701966152622790, "job": 1, "event": "recovery_started", "wal_files": [25]} 2023-12-07T16:22:32.924 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2023-12-07T16:22:32.924 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 systemd[1]: Started Ceph mon.smithi063 for 8c493298-951b-11ee-95a2-87774f69a715. 2023-12-07T16:22:32.924 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701966152627509, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 1016108, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 9764, "largest_seqno": 10390, "table_properties": {"data_size": 1012594, "index_size": 1796, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 6605, "raw_average_key_size": 23, "raw_value_size": 1006405, "raw_average_value_size": 3607, "num_data_blocks": 82, "num_entries": 279, "num_filter_entries": 279, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1701966152, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5786e436-ccb7-44a9-bf38-54fead31b530", "db_session_id": "2EIY0VVK9VTVM7VC99HX", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2023-12-07T16:22:32.925 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701966152627667, "job": 1, "event": "recovery_finished"} 2023-12-07T16:22:32.925 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2023-12-07T16:22:32.925 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-07T16:22:32.925 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi063/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-07T16:22:32.925 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d857f7a000 2023-12-07T16:22:32.925 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: DB pointer 0x55d857f66000 2023-12-07T16:22:32.925 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-07T16:22:32.925 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-07T16:22:32.925 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ** DB Stats ** 2023-12-07T16:22:32.925 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-07T16:22:32.925 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-07T16:22:32.925 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-07T16:22:32.925 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-07T16:22:32.925 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-07T16:22:32.926 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-07T16:22:32.926 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-07T16:22:32.926 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-07T16:22:32.926 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ** Compaction Stats [default] ** 2023-12-07T16:22:32.926 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-07T16:22:32.926 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-07T16:22:32.926 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: L0 1/0 992.29 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 346.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-07T16:22:32.926 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: L6 1/0 5.95 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-07T16:22:32.926 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Sum 2/0 6.92 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 346.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-07T16:22:32.926 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 346.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-07T16:22:32.926 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-07T16:22:32.926 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ** Compaction Stats [default] ** 2023-12-07T16:22:32.926 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-07T16:22:32.927 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-07T16:22:32.927 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 346.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2023-12-07T16:22:32.927 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-07T16:22:32.927 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-07T16:22:32.927 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-07T16:22:32.927 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-07T16:22:32.927 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Flush(GB): cumulative 0.001, interval 0.001 2023-12-07T16:22:32.927 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-07T16:22:32.927 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-07T16:22:32.927 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-07T16:22:32.927 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-07T16:22:32.927 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Cumulative compaction: 0.00 GB write, 124.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-07T16:22:32.927 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Interval compaction: 0.00 GB write, 124.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-07T16:22:32.927 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-07T16:22:32.927 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Block cache BinnedLRUCache@0x55d857edf090#7 capacity: 512.00 MB usage: 2.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2023-12-07T16:22:32.928 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.78 KB,0.000149012%) IndexBlock(1,2.08 KB,0.000396371%) Misc(1,0.00 KB,0%) 2023-12-07T16:22:32.928 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-07T16:22:32.928 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-07T16:22:32.928 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: starting mon.smithi063 rank 0 at public addrs [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] at bind addrs [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi063 fsid 8c493298-951b-11ee-95a2-87774f69a715 2023-12-07T16:22:32.928 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: mon.smithi063@-1(???) e2 preinit fsid 8c493298-951b-11ee-95a2-87774f69a715 2023-12-07T16:22:32.928 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: mon.smithi063@-1(???).mds e17 new map 2023-12-07T16:22:32.928 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: mon.smithi063@-1(???).mds e17 print_map 2023-12-07T16:22:32.928 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: e17 2023-12-07T16:22:32.928 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-07T16:22:32.928 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:22:32.928 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: legacy client fscid: 1 2023-12-07T16:22:32.928 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-07T16:22:32.928 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Filesystem 'cephfs' (1) 2023-12-07T16:22:32.928 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: fs_name cephfs 2023-12-07T16:22:32.928 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: epoch 17 2023-12-07T16:22:32.929 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-07T16:22:32.929 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: created 2023-12-07T16:19:08.352640+0000 2023-12-07T16:22:32.929 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: modified 2023-12-07T16:22:27.604525+0000 2023-12-07T16:22:32.929 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: tableserver 0 2023-12-07T16:22:32.929 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: root 0 2023-12-07T16:22:32.929 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: session_timeout 60 2023-12-07T16:22:32.929 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: session_autoclose 300 2023-12-07T16:22:32.929 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: max_file_size 1099511627776 2023-12-07T16:22:32.929 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: max_xattr_size 65536 2023-12-07T16:22:32.929 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: required_client_features {} 2023-12-07T16:22:32.929 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: last_failure 0 2023-12-07T16:22:32.929 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: last_failure_osd_epoch 45 2023-12-07T16:22:32.929 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:22:32.929 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: max_mds 2 2023-12-07T16:22:32.930 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: in 0,1 2023-12-07T16:22:32.930 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: up {0=14478,1=24269} 2023-12-07T16:22:32.930 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: failed 2023-12-07T16:22:32.930 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: damaged 2023-12-07T16:22:32.930 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: stopped 2023-12-07T16:22:32.930 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: data_pools [3] 2023-12-07T16:22:32.930 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: metadata_pool 2 2023-12-07T16:22:32.930 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: inline_data enabled 2023-12-07T16:22:32.930 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: balancer 2023-12-07T16:22:32.930 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: bal_rank_mask -1 2023-12-07T16:22:32.930 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: standby_count_wanted 1 2023-12-07T16:22:32.930 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: [mds.cephfs.smithi063.yidolg{0:14478} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:22:32.930 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: [mds.cephfs.smithi152.mrvngf{1:24269} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.152:6824/3157779064,v1:172.21.15.152:6825/3157779064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:22:32.930 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-07T16:22:32.931 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-07T16:22:32.931 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: Standby daemons: 2023-12-07T16:22:32.931 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: 2023-12-07T16:22:32.931 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: [mds.cephfs.smithi063.gsjgcq{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/3063200414,v1:172.21.15.63:6827/3063200414] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:22:32.931 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout: [mds.cephfs.smithi152.aovwwd{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/2906349729,v1:172.21.15.152:6827/2906349729] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:22:32.931 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: mon.smithi063@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-07T16:22:32.931 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: mon.smithi063@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2023-12-07T16:22:32.931 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: mon.smithi063@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2023-12-07T16:22:32.931 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: mon.smithi063@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2023-12-07T16:22:32.931 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:32 smithi063 ceph-mon[192008]: mon.smithi063@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2023-12-07T16:22:32.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.916+0000 7fa8c7eff700 1 -- 172.21.15.63:0/2193088039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c00faed0 msgr2=0x7fa8c00fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:32.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.916+0000 7fa8c7eff700 1 --2- 172.21.15.63:0/2193088039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c00faed0 0x7fa8c00fb2e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc004880 tx=0x7fa8bc009e30 comp rx=0 tx=0).stop 2023-12-07T16:22:32.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.916+0000 7fa8c7eff700 1 -- 172.21.15.63:0/2193088039 shutdown_connections 2023-12-07T16:22:32.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.916+0000 7fa8c7eff700 1 --2- 172.21.15.63:0/2193088039 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8c00fdf60 0x7fa8c00fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:32.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.916+0000 7fa8c7eff700 1 --2- 172.21.15.63:0/2193088039 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c00faed0 0x7fa8c00fb2e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:32.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.916+0000 7fa8c7eff700 1 -- 172.21.15.63:0/2193088039 >> 172.21.15.63:0/2193088039 conn(0x7fa8c00f6950 msgr2=0x7fa8c00f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:22:32.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.917+0000 7fa8c7eff700 1 -- 172.21.15.63:0/2193088039 shutdown_connections 2023-12-07T16:22:32.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.917+0000 7fa8c7eff700 1 -- 172.21.15.63:0/2193088039 wait complete. 2023-12-07T16:22:32.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.917+0000 7fa8c7eff700 1 Processor -- start 2023-12-07T16:22:32.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.917+0000 7fa8c7eff700 1 -- start start 2023-12-07T16:22:32.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.918+0000 7fa8c7eff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8c00faed0 0x7fa8c00fd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:32.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.918+0000 7fa8c7eff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c00fdf60 0x7fa8c00fbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:32.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.918+0000 7fa8c7eff700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c00fc470 con 0x7fa8c00faed0 2023-12-07T16:22:32.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.918+0000 7fa8c7eff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c00fc5e0 con 0x7fa8c00fdf60 2023-12-07T16:22:32.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.918+0000 7fa8c5c9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8c00faed0 0x7fa8c00fd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:32.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.918+0000 7fa8c549a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c00fdf60 0x7fa8c00fbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:32.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.918+0000 7fa8c5c9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8c00faed0 0x7fa8c00fd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33530/0 (socket says 172.21.15.63:33530) 2023-12-07T16:22:32.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.918+0000 7fa8c5c9b700 1 -- 172.21.15.63:0/2145357764 learned_addr learned my addr 172.21.15.63:0/2145357764 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:22:32.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.918+0000 7fa8c5c9b700 1 -- 172.21.15.63:0/2145357764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8c00faed0 msgr2=0x7fa8c00fd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-07T16:22:32.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.918+0000 7fa8c5c9b700 1 -- 172.21.15.63:0/2145357764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8c00faed0 msgr2=0x7fa8c00fd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-07T16:22:32.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.918+0000 7fa8c5c9b700 1 --2- 172.21.15.63:0/2145357764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8c00faed0 0x7fa8c00fd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-07T16:22:32.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.918+0000 7fa8c5c9b700 1 --2- 172.21.15.63:0/2145357764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8c00faed0 0x7fa8c00fd9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-07T16:22:32.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.918+0000 7fa8c549a700 1 -- 172.21.15.63:0/2145357764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8c00faed0 msgr2=0x7fa8c00fd9f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-07T16:22:32.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.918+0000 7fa8c549a700 1 --2- 172.21.15.63:0/2145357764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8c00faed0 0x7fa8c00fd9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:32.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.918+0000 7fa8c549a700 1 -- 172.21.15.63:0/2145357764 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc005040 con 0x7fa8c00fdf60 2023-12-07T16:22:32.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.918+0000 7fa8c549a700 1 --2- 172.21.15.63:0/2145357764 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c00fdf60 0x7fa8c00fbe70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0002a50 tx=0x7fa8b0009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:22:32.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.919+0000 7fa8b67fc700 1 -- 172.21.15.63:0/2145357764 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8b0007cc0 con 0x7fa8c00fdf60 2023-12-07T16:22:32.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.919+0000 7fa8b67fc700 1 -- 172.21.15.63:0/2145357764 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa8b000f040 con 0x7fa8c00fdf60 2023-12-07T16:22:32.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.919+0000 7fa8b67fc700 1 -- 172.21.15.63:0/2145357764 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8b000d900 con 0x7fa8c00fdf60 2023-12-07T16:22:32.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.919+0000 7fa8c7eff700 1 -- 172.21.15.63:0/2145357764 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c00fc8c0 con 0x7fa8c00fdf60 2023-12-07T16:22:32.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.919+0000 7fa8c7eff700 1 -- 172.21.15.63:0/2145357764 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c01155d0 con 0x7fa8c00fdf60 2023-12-07T16:22:32.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.920+0000 7fa8c7eff700 1 -- 172.21.15.63:0/2145357764 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c0107610 con 0x7fa8c00fdf60 2023-12-07T16:22:32.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.921+0000 7fa8b67fc700 1 -- 172.21.15.63:0/2145357764 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 31) v1 ==== 90899+0+0 (secure 0 0 0) 0x7fa8b000da60 con 0x7fa8c00fdf60 2023-12-07T16:22:32.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.922+0000 7fa8b67fc700 1 --2- 172.21.15.63:0/2145357764 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fa8ac06cc00 0x7fa8ac06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:32.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.922+0000 7fa8b67fc700 1 -- 172.21.15.63:0/2145357764 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fa8b008bbd0 con 0x7fa8c00fdf60 2023-12-07T16:22:32.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.922+0000 7fa8c5c9b700 1 --2- 172.21.15.63:0/2145357764 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fa8ac06cc00 0x7fa8ac06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:32.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.922+0000 7fa8c5c9b700 1 --2- 172.21.15.63:0/2145357764 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fa8ac06cc00 0x7fa8ac06f0b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009fd0 tx=0x7fa8bc009e30 comp rx=0 tx=0).ready entity=mgr.24453 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:22:32.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:32.925+0000 7fa8b67fc700 1 -- 172.21.15.63:0/2145357764 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fa8b008be60 con 0x7fa8c00fdf60 2023-12-07T16:22:33.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.168+0000 7fa8c7eff700 1 -- 172.21.15.63:0/2145357764 --> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8c002b1f0 con 0x7fa8ac06cc00 2023-12-07T16:22:33.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.178+0000 7fa8b67fc700 1 -- 172.21.15.63:0/2145357764 <== mgr.24453 v2:172.21.15.63:6800/2671097541 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fa8c002b1f0 con 0x7fa8ac06cc00 2023-12-07T16:22:33.177 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-07T16:22:33.177 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (84s) 9s ago 7m 20.2M - 0.25.0 c8568f914cd2 c0526812d5fe 2023-12-07T16:22:33.177 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (7m) 9s ago 7m 7428k - 17.2.7-115-g4f62d9ad fcdfd00f81c7 80bed1094ab4 2023-12-07T16:22:33.177 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi152 smithi152 running (6m) 10s ago 6m 7495k - 17.2.7-115-g4f62d9ad fcdfd00f81c7 e2cd5532384b 2023-12-07T16:22:33.177 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (80s) 9s ago 6m 85.7M - 9.4.7 954c08fa6188 cc2cde9a664f 2023-12-07T16:22:33.177 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.gsjgcq smithi063 running (3m) 9s ago 3m 13.7M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 f70e4f098e4c 2023-12-07T16:22:33.177 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.yidolg smithi063 running (3m) 9s ago 3m 4591M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5b053ef5fb7f 2023-12-07T16:22:33.177 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.aovwwd smithi152 running (3m) 10s ago 3m 14.6M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 80190948a595 2023-12-07T16:22:33.177 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.mrvngf smithi152 running (3m) 10s ago 3m 2729M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5f60b893f840 2023-12-07T16:22:33.177 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.yohyyx smithi063 *:8443,9283,8765 running (47s) 9s ago 8m 499M - 19.0.0-13-ge6605fb8 104f332cd0a9 b605f882784d 2023-12-07T16:22:33.178 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi152.sxayfb smithi152 *:8443,9283,8765 running (12s) 10s ago 6m 54.3M - 19.0.0-13-ge6605fb8 104f332cd0a9 71716998ccc3 2023-12-07T16:22:33.178 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 starting - - - 2048M 2023-12-07T16:22:33.178 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi152 smithi152 running (6m) 10s ago 6m 62.9M 2048M 17.2.7-115-g4f62d9ad fcdfd00f81c7 ecfe3add39d6 2023-12-07T16:22:33.178 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (87s) 9s ago 7m 17.7M - 1.5.0 0da6a335fe13 50d63981f746 2023-12-07T16:22:33.178 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi152 smithi152 *:9100 running (57s) 10s ago 6m 16.3M - 1.5.0 0da6a335fe13 627cda14f1a9 2023-12-07T16:22:33.178 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (5m) 9s ago 5m 547M 1568M 17.2.7-115-g4f62d9ad fcdfd00f81c7 bbdd7f82a7c3 2023-12-07T16:22:33.178 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (5m) 9s ago 5m 625M 1568M 17.2.7-115-g4f62d9ad fcdfd00f81c7 4372601f899e 2023-12-07T16:22:33.178 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (5m) 9s ago 5m 470M 1568M 17.2.7-115-g4f62d9ad fcdfd00f81c7 b0d432bbca05 2023-12-07T16:22:33.178 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi152 running (4m) 10s ago 4m 749M 2592M 17.2.7-115-g4f62d9ad fcdfd00f81c7 94d14402b489 2023-12-07T16:22:33.178 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi152 running (4m) 10s ago 4m 587M 2592M 17.2.7-115-g4f62d9ad fcdfd00f81c7 d3b8b2f12489 2023-12-07T16:22:33.178 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi152 running (4m) 10s ago 4m 668M 2592M 17.2.7-115-g4f62d9ad fcdfd00f81c7 e7f8d9f716bb 2023-12-07T16:22:33.178 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (20s) 9s ago 6m 41.2M - 2.43.0 a07b618ecd1d 8a323520d9fd 2023-12-07T16:22:33.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.181+0000 7fa8c7eff700 1 -- 172.21.15.63:0/2145357764 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fa8ac06cc00 msgr2=0x7fa8ac06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:33.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.181+0000 7fa8c7eff700 1 --2- 172.21.15.63:0/2145357764 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fa8ac06cc00 0x7fa8ac06f0b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009fd0 tx=0x7fa8bc009e30 comp rx=0 tx=0).stop 2023-12-07T16:22:33.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.181+0000 7fa8c7eff700 1 -- 172.21.15.63:0/2145357764 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c00fdf60 msgr2=0x7fa8c00fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:33.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.181+0000 7fa8c7eff700 1 --2- 172.21.15.63:0/2145357764 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c00fdf60 0x7fa8c00fbe70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0002a50 tx=0x7fa8b0009f90 comp rx=0 tx=0).stop 2023-12-07T16:22:33.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.181+0000 7fa8c7eff700 1 -- 172.21.15.63:0/2145357764 shutdown_connections 2023-12-07T16:22:33.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.181+0000 7fa8c7eff700 1 --2- 172.21.15.63:0/2145357764 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fa8ac06cc00 0x7fa8ac06f0b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:33.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.181+0000 7fa8c7eff700 1 --2- 172.21.15.63:0/2145357764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8c00faed0 0x7fa8c00fd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:33.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.181+0000 7fa8c7eff700 1 --2- 172.21.15.63:0/2145357764 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8c00fdf60 0x7fa8c00fbe70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:33.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.181+0000 7fa8c7eff700 1 -- 172.21.15.63:0/2145357764 >> 172.21.15.63:0/2145357764 conn(0x7fa8c00f6950 msgr2=0x7fa8c00f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:22:33.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.181+0000 7fa8c7eff700 1 -- 172.21.15.63:0/2145357764 shutdown_connections 2023-12-07T16:22:33.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.181+0000 7fa8c7eff700 1 -- 172.21.15.63:0/2145357764 wait complete. 2023-12-07T16:22:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.298+0000 7fe83b71c700 1 -- 172.21.15.63:0/1394038972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8340fbdd0 msgr2=0x7fe8340fc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.298+0000 7fe83b71c700 1 --2- 172.21.15.63:0/1394038972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8340fbdd0 0x7fe8340fc240 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe828004880 tx=0x7fe828009e30 comp rx=0 tx=0).stop 2023-12-07T16:22:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.298+0000 7fe83b71c700 1 -- 172.21.15.63:0/1394038972 shutdown_connections 2023-12-07T16:22:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.298+0000 7fe83b71c700 1 --2- 172.21.15.63:0/1394038972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8340fbdd0 0x7fe8340fc240 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.298+0000 7fe83b71c700 1 --2- 172.21.15.63:0/1394038972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8340fd110 0x7fe8340fd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.298+0000 7fe83b71c700 1 -- 172.21.15.63:0/1394038972 >> 172.21.15.63:0/1394038972 conn(0x7fe8340f6950 msgr2=0x7fe8340f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:22:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.299+0000 7fe83b71c700 1 -- 172.21.15.63:0/1394038972 shutdown_connections 2023-12-07T16:22:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.299+0000 7fe83b71c700 1 -- 172.21.15.63:0/1394038972 wait complete. 2023-12-07T16:22:33.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.299+0000 7fe83b71c700 1 Processor -- start 2023-12-07T16:22:33.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.299+0000 7fe83b71c700 1 -- start start 2023-12-07T16:22:33.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.299+0000 7fe83b71c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8340fbdd0 0x7fe83410d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:33.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.299+0000 7fe83b71c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8340fd110 0x7fe83410dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:33.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.299+0000 7fe83b71c700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83410e0d0 con 0x7fe8340fd110 2023-12-07T16:22:33.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.299+0000 7fe83b71c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83410e970 con 0x7fe8340fbdd0 2023-12-07T16:22:33.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.300+0000 7fe838cb7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8340fd110 0x7fe83410dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:33.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.300+0000 7fe838cb7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8340fd110 0x7fe83410dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33548/0 (socket says 172.21.15.63:33548) 2023-12-07T16:22:33.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.300+0000 7fe838cb7700 1 -- 172.21.15.63:0/2221442303 learned_addr learned my addr 172.21.15.63:0/2221442303 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:22:33.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.300+0000 7fe838cb7700 1 -- 172.21.15.63:0/2221442303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8340fd110 msgr2=0x7fe83410dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-07T16:22:33.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.300+0000 7fe838cb7700 1 -- 172.21.15.63:0/2221442303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8340fd110 msgr2=0x7fe83410dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-07T16:22:33.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.300+0000 7fe838cb7700 1 --2- 172.21.15.63:0/2221442303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8340fd110 0x7fe83410dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-07T16:22:33.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.300+0000 7fe838cb7700 1 --2- 172.21.15.63:0/2221442303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8340fd110 0x7fe83410dad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-07T16:22:33.301 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.301+0000 7fe8394b8700 1 --2- 172.21.15.63:0/2221442303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8340fbdd0 0x7fe83410d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:33.301 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.302+0000 7fe8394b8700 1 -- 172.21.15.63:0/2221442303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8340fd110 msgr2=0x7fe83410dad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-07T16:22:33.301 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.302+0000 7fe8394b8700 1 --2- 172.21.15.63:0/2221442303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8340fd110 0x7fe83410dad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:33.301 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.302+0000 7fe8394b8700 1 -- 172.21.15.63:0/2221442303 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe828005040 con 0x7fe8340fbdd0 2023-12-07T16:22:33.301 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.302+0000 7fe8394b8700 1 --2- 172.21.15.63:0/2221442303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8340fbdd0 0x7fe83410d590 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe82400dad0 tx=0x7fe824004dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:22:33.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.303+0000 7fe831ffb700 1 -- 172.21.15.63:0/2221442303 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe824012a10 con 0x7fe8340fbdd0 2023-12-07T16:22:33.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.303+0000 7fe831ffb700 1 -- 172.21.15.63:0/2221442303 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe824012b70 con 0x7fe8340fbdd0 2023-12-07T16:22:33.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.303+0000 7fe831ffb700 1 -- 172.21.15.63:0/2221442303 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe824019660 con 0x7fe8340fbdd0 2023-12-07T16:22:33.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.303+0000 7fe83b71c700 1 -- 172.21.15.63:0/2221442303 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83410ebf0 con 0x7fe8340fbdd0 2023-12-07T16:22:33.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.304+0000 7fe83b71c700 1 -- 172.21.15.63:0/2221442303 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83410f130 con 0x7fe8340fbdd0 2023-12-07T16:22:33.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.305+0000 7fe83b71c700 1 -- 172.21.15.63:0/2221442303 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe83404bb80 con 0x7fe8340fbdd0 2023-12-07T16:22:33.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.307+0000 7fe831ffb700 1 -- 172.21.15.63:0/2221442303 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 31) v1 ==== 90899+0+0 (secure 0 0 0) 0x7fe824012ce0 con 0x7fe8340fbdd0 2023-12-07T16:22:33.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.308+0000 7fe831ffb700 1 --2- 172.21.15.63:0/2221442303 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fe81c06ccd0 0x7fe81c06f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:33.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.308+0000 7fe831ffb700 1 -- 172.21.15.63:0/2221442303 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fe824090660 con 0x7fe8340fbdd0 2023-12-07T16:22:33.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.308+0000 7fe838cb7700 1 --2- 172.21.15.63:0/2221442303 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fe81c06ccd0 0x7fe81c06f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:33.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.309+0000 7fe838cb7700 1 --2- 172.21.15.63:0/2221442303 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fe81c06ccd0 0x7fe81c06f180 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe828000c00 tx=0x7fe828009e30 comp rx=0 tx=0).ready entity=mgr.24453 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:22:33.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.314+0000 7fe831ffb700 1 -- 172.21.15.63:0/2221442303 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fe82405e3a0 con 0x7fe8340fbdd0 2023-12-07T16:22:33.667 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.669+0000 7fe83b71c700 1 -- 172.21.15.63:0/2221442303 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe83410ed80 con 0x7fe8340fbdd0 2023-12-07T16:22:33.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.670+0000 7fe831ffb700 1 -- 172.21.15.63:0/2221442303 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7fe83410ed80 con 0x7fe8340fbdd0 2023-12-07T16:22:33.668 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:22:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-07T16:22:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 2 2023-12-07T16:22:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:22:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-07T16:22:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-07T16:22:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:22:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-07T16:22:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 6 2023-12-07T16:22:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:22:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-07T16:22:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 4 2023-12-07T16:22:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:22:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-07T16:22:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 12, 2023-12-07T16:22:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-07T16:22:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-07T16:22:33.669 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:22:33.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.673+0000 7fe83b71c700 1 -- 172.21.15.63:0/2221442303 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fe81c06ccd0 msgr2=0x7fe81c06f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:33.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.673+0000 7fe83b71c700 1 --2- 172.21.15.63:0/2221442303 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fe81c06ccd0 0x7fe81c06f180 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe828000c00 tx=0x7fe828009e30 comp rx=0 tx=0).stop 2023-12-07T16:22:33.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.673+0000 7fe83b71c700 1 -- 172.21.15.63:0/2221442303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8340fbdd0 msgr2=0x7fe83410d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:33.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.673+0000 7fe83b71c700 1 --2- 172.21.15.63:0/2221442303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8340fbdd0 0x7fe83410d590 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe82400dad0 tx=0x7fe824004dc0 comp rx=0 tx=0).stop 2023-12-07T16:22:33.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.673+0000 7fe83b71c700 1 -- 172.21.15.63:0/2221442303 shutdown_connections 2023-12-07T16:22:33.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.673+0000 7fe83b71c700 1 --2- 172.21.15.63:0/2221442303 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fe81c06ccd0 0x7fe81c06f180 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:33.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.673+0000 7fe83b71c700 1 --2- 172.21.15.63:0/2221442303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8340fbdd0 0x7fe83410d590 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:33.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.673+0000 7fe83b71c700 1 --2- 172.21.15.63:0/2221442303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8340fd110 0x7fe83410dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:33.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.673+0000 7fe83b71c700 1 -- 172.21.15.63:0/2221442303 >> 172.21.15.63:0/2221442303 conn(0x7fe8340f6950 msgr2=0x7fe8340facc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:22:33.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.673+0000 7fe83b71c700 1 -- 172.21.15.63:0/2221442303 shutdown_connections 2023-12-07T16:22:33.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.673+0000 7fe83b71c700 1 -- 172.21.15.63:0/2221442303 wait complete. 2023-12-07T16:22:33.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.796+0000 7f13cfdc7700 1 -- 172.21.15.63:0/4115792746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13c80fbaf0 msgr2=0x7f13c80fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:33.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.797+0000 7f13cfdc7700 1 --2- 172.21.15.63:0/4115792746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13c80fbaf0 0x7f13c80fbf00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f13c4004880 tx=0x7f13c4009e30 comp rx=0 tx=0).stop 2023-12-07T16:22:33.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.797+0000 7f13cfdc7700 1 -- 172.21.15.63:0/4115792746 shutdown_connections 2023-12-07T16:22:33.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.797+0000 7f13cfdc7700 1 --2- 172.21.15.63:0/4115792746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13c80fcd00 0x7f13c80fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:33.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.797+0000 7f13cfdc7700 1 --2- 172.21.15.63:0/4115792746 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13c80fbaf0 0x7f13c80fbf00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:33.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.797+0000 7f13cfdc7700 1 -- 172.21.15.63:0/4115792746 >> 172.21.15.63:0/4115792746 conn(0x7f13c80f7190 msgr2=0x7f13c80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:22:33.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.797+0000 7f13cfdc7700 1 -- 172.21.15.63:0/4115792746 shutdown_connections 2023-12-07T16:22:33.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.797+0000 7f13cfdc7700 1 -- 172.21.15.63:0/4115792746 wait complete. 2023-12-07T16:22:33.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.797+0000 7f13cfdc7700 1 Processor -- start 2023-12-07T16:22:33.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.797+0000 7f13cfdc7700 1 -- start start 2023-12-07T16:22:33.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.797+0000 7f13cfdc7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13c80fbaf0 0x7f13c80ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:33.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.798+0000 7f13cfdc7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13c80fcd00 0x7f13c80fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:33.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.798+0000 7f13cfdc7700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c80fe640 con 0x7f13c80fbaf0 2023-12-07T16:22:33.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.798+0000 7f13cfdc7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c80fe7b0 con 0x7f13c80fcd00 2023-12-07T16:22:33.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.798+0000 7f13cdb63700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13c80fbaf0 0x7f13c80ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:33.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.798+0000 7f13cdb63700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13c80fbaf0 0x7f13c80ffbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33558/0 (socket says 172.21.15.63:33558) 2023-12-07T16:22:33.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.798+0000 7f13cdb63700 1 -- 172.21.15.63:0/1422696293 learned_addr learned my addr 172.21.15.63:0/1422696293 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:22:33.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.798+0000 7f13cd362700 1 --2- 172.21.15.63:0/1422696293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13c80fcd00 0x7f13c80fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:33.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.798+0000 7f13cdb63700 1 -- 172.21.15.63:0/1422696293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13c80fbaf0 msgr2=0x7f13c80ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-07T16:22:33.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.798+0000 7f13cdb63700 1 -- 172.21.15.63:0/1422696293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13c80fbaf0 msgr2=0x7f13c80ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-07T16:22:33.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.798+0000 7f13cdb63700 1 --2- 172.21.15.63:0/1422696293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13c80fbaf0 0x7f13c80ffbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-07T16:22:33.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.798+0000 7f13cdb63700 1 --2- 172.21.15.63:0/1422696293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13c80fbaf0 0x7f13c80ffbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-07T16:22:33.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.798+0000 7f13cd362700 1 -- 172.21.15.63:0/1422696293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13c80fbaf0 msgr2=0x7f13c80ffbc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-07T16:22:33.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.798+0000 7f13cd362700 1 --2- 172.21.15.63:0/1422696293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13c80fbaf0 0x7f13c80ffbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:33.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.798+0000 7f13cd362700 1 -- 172.21.15.63:0/1422696293 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c4005040 con 0x7f13c80fcd00 2023-12-07T16:22:33.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.798+0000 7f13cd362700 1 --2- 172.21.15.63:0/1422696293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13c80fcd00 0x7f13c80fe040 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f13b8002a50 tx=0x7f13b8009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:22:33.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.798+0000 7f13be7fc700 1 -- 172.21.15.63:0/1422696293 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13b8007cc0 con 0x7f13c80fcd00 2023-12-07T16:22:33.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.798+0000 7f13be7fc700 1 -- 172.21.15.63:0/1422696293 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f13b800f040 con 0x7f13c80fcd00 2023-12-07T16:22:33.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.799+0000 7f13cfdc7700 1 -- 172.21.15.63:0/1422696293 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c80fea90 con 0x7f13c80fcd00 2023-12-07T16:22:33.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.799+0000 7f13be7fc700 1 -- 172.21.15.63:0/1422696293 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13b800d900 con 0x7f13c80fcd00 2023-12-07T16:22:33.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.799+0000 7f13cfdc7700 1 -- 172.21.15.63:0/1422696293 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c8115540 con 0x7f13c80fcd00 2023-12-07T16:22:33.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.800+0000 7f13cfdc7700 1 -- 172.21.15.63:0/1422696293 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c804bb80 con 0x7f13c80fcd00 2023-12-07T16:22:33.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.800+0000 7f13be7fc700 1 -- 172.21.15.63:0/1422696293 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 31) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f13b800db00 con 0x7f13c80fcd00 2023-12-07T16:22:33.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.801+0000 7f13be7fc700 1 --2- 172.21.15.63:0/1422696293 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f13b406cc00 0x7f13b406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:33.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.801+0000 7f13be7fc700 1 -- 172.21.15.63:0/1422696293 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f13b808bd80 con 0x7f13c80fcd00 2023-12-07T16:22:33.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.801+0000 7f13cdb63700 1 --2- 172.21.15.63:0/1422696293 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f13b406cc00 0x7f13b406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:33.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.801+0000 7f13cdb63700 1 --2- 172.21.15.63:0/1422696293 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f13b406cc00 0x7f13b406f0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f13c4009fd0 tx=0x7f13c4009e30 comp rx=0 tx=0).ready entity=mgr.24453 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:22:33.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:33.806+0000 7f13be7fc700 1 -- 172.21.15.63:0/1422696293 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f13b8059930 con 0x7f13c80fcd00 2023-12-07T16:22:34.080 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:34.082+0000 7f13cfdc7700 1 -- 172.21.15.63:0/1422696293 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f13c8115730 con 0x7f13c80fcd00 2023-12-07T16:22:35.659 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.660+0000 7f13be7fc700 1 -- 172.21.15.63:0/1422696293 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1853 (secure 0 0 0) 0x7f13c8115730 con 0x7f13c80fcd00 2023-12-07T16:22:35.659 INFO:teuthology.orchestra.run.smithi063.stdout:e17 2023-12-07T16:22:35.660 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-07T16:22:35.660 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:22:35.660 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-07T16:22:35.660 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:22:35.660 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-07T16:22:35.660 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-07T16:22:35.660 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 17 2023-12-07T16:22:35.660 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-07T16:22:35.660 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-07T16:19:08.352640+0000 2023-12-07T16:22:35.660 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-07T16:22:27.604525+0000 2023-12-07T16:22:35.660 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-07T16:22:35.661 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-07T16:22:35.661 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-07T16:22:35.661 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-07T16:22:35.661 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-07T16:22:35.661 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-07T16:22:35.661 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-07T16:22:35.661 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 45 2023-12-07T16:22:35.661 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:22:35.661 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 2 2023-12-07T16:22:35.661 INFO:teuthology.orchestra.run.smithi063.stdout:in 0,1 2023-12-07T16:22:35.661 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14478,1=24269} 2023-12-07T16:22:35.662 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-07T16:22:35.662 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-07T16:22:35.662 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-07T16:22:35.662 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-07T16:22:35.662 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-07T16:22:35.662 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-07T16:22:35.662 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-07T16:22:35.662 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-07T16:22:35.662 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.yidolg{0:14478} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:22:35.662 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.mrvngf{1:24269} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.152:6824/3157779064,v1:172.21.15.152:6825/3157779064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:22:35.663 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:22:35.663 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:22:35.663 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-07T16:22:35.663 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:22:35.663 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.gsjgcq{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/3063200414,v1:172.21.15.63:6827/3063200414] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:22:35.663 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.aovwwd{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/2906349729,v1:172.21.15.152:6827/2906349729] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:22:35.664 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.663+0000 7f13cfdc7700 1 -- 172.21.15.63:0/1422696293 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f13b406cc00 msgr2=0x7f13b406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:35.664 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.663+0000 7f13cfdc7700 1 --2- 172.21.15.63:0/1422696293 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f13b406cc00 0x7f13b406f0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f13c4009fd0 tx=0x7f13c4009e30 comp rx=0 tx=0).stop 2023-12-07T16:22:35.664 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.664+0000 7f13cfdc7700 1 -- 172.21.15.63:0/1422696293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13c80fcd00 msgr2=0x7f13c80fe040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:35.664 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.664+0000 7f13cfdc7700 1 --2- 172.21.15.63:0/1422696293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13c80fcd00 0x7f13c80fe040 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f13b8002a50 tx=0x7f13b8009f90 comp rx=0 tx=0).stop 2023-12-07T16:22:35.664 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.664+0000 7f13cfdc7700 1 -- 172.21.15.63:0/1422696293 shutdown_connections 2023-12-07T16:22:35.664 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.664+0000 7f13cfdc7700 1 --2- 172.21.15.63:0/1422696293 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7f13b406cc00 0x7f13b406f0b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:35.664 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.664+0000 7f13cfdc7700 1 --2- 172.21.15.63:0/1422696293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13c80fbaf0 0x7f13c80ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:35.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.664+0000 7f13cfdc7700 1 --2- 172.21.15.63:0/1422696293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13c80fcd00 0x7f13c80fe040 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:35.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.664+0000 7f13cfdc7700 1 -- 172.21.15.63:0/1422696293 >> 172.21.15.63:0/1422696293 conn(0x7f13c80f7190 msgr2=0x7f13c8065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:22:35.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.664+0000 7f13cfdc7700 1 -- 172.21.15.63:0/1422696293 shutdown_connections 2023-12-07T16:22:35.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.664+0000 7f13cfdc7700 1 -- 172.21.15.63:0/1422696293 wait complete. 2023-12-07T16:22:35.665 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2023-12-07T16:22:35.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.796+0000 7fd71c0f3700 1 -- 172.21.15.63:0/3512832510 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7140fdf60 msgr2=0x7fd7140fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:35.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.796+0000 7fd71c0f3700 1 --2- 172.21.15.63:0/3512832510 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7140fdf60 0x7fd7140fe3b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd704004940 tx=0x7fd704009e30 comp rx=0 tx=0).stop 2023-12-07T16:22:35.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.797+0000 7fd71c0f3700 1 -- 172.21.15.63:0/3512832510 shutdown_connections 2023-12-07T16:22:35.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.797+0000 7fd71c0f3700 1 --2- 172.21.15.63:0/3512832510 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7140fdf60 0x7fd7140fe3b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:35.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.797+0000 7fd71c0f3700 1 --2- 172.21.15.63:0/3512832510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7140faed0 0x7fd7140fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:35.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.797+0000 7fd71c0f3700 1 -- 172.21.15.63:0/3512832510 >> 172.21.15.63:0/3512832510 conn(0x7fd7140f6950 msgr2=0x7fd7140f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:22:35.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.797+0000 7fd71c0f3700 1 -- 172.21.15.63:0/3512832510 shutdown_connections 2023-12-07T16:22:35.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.797+0000 7fd71c0f3700 1 -- 172.21.15.63:0/3512832510 wait complete. 2023-12-07T16:22:35.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.797+0000 7fd71c0f3700 1 Processor -- start 2023-12-07T16:22:35.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.797+0000 7fd71c0f3700 1 -- start start 2023-12-07T16:22:35.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.798+0000 7fd71c0f3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7140faed0 0x7fd71410d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:35.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.798+0000 7fd71c0f3700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7140fdf60 0x7fd71410dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:35.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.798+0000 7fd71c0f3700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71410e280 con 0x7fd7140fdf60 2023-12-07T16:22:35.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.798+0000 7fd71c0f3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71410eac0 con 0x7fd7140faed0 2023-12-07T16:22:35.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.798+0000 7fd719e8f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7140faed0 0x7fd71410d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:35.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.798+0000 7fd719e8f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7140faed0 0x7fd71410d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.63:46198/0 (socket says 172.21.15.63:46198) 2023-12-07T16:22:35.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.798+0000 7fd719e8f700 1 -- 172.21.15.63:0/4203189803 learned_addr learned my addr 172.21.15.63:0/4203189803 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:22:35.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.798+0000 7fd71968e700 1 --2- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7140fdf60 0x7fd71410dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:35.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.798+0000 7fd719e8f700 1 -- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7140fdf60 msgr2=0x7fd71410dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:35.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.798+0000 7fd719e8f700 1 --2- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7140fdf60 0x7fd71410dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:35.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.798+0000 7fd719e8f700 1 -- 172.21.15.63:0/4203189803 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd704005040 con 0x7fd7140faed0 2023-12-07T16:22:35.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.798+0000 7fd719e8f700 1 --2- 172.21.15.63:0/4203189803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7140faed0 0x7fd71410d6b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd71000b760 tx=0x7fd7100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:22:35.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.799+0000 7fd70a7fc700 1 -- 172.21.15.63:0/4203189803 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd71000f6f0 con 0x7fd7140faed0 2023-12-07T16:22:35.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.799+0000 7fd70a7fc700 1 -- 172.21.15.63:0/4203189803 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd71000fd00 con 0x7fd7140faed0 2023-12-07T16:22:35.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.799+0000 7fd71c0f3700 1 -- 172.21.15.63:0/4203189803 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71410eda0 con 0x7fd7140faed0 2023-12-07T16:22:35.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.799+0000 7fd70a7fc700 1 -- 172.21.15.63:0/4203189803 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd710011d90 con 0x7fd7140faed0 2023-12-07T16:22:35.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.799+0000 7fd71c0f3700 1 -- 172.21.15.63:0/4203189803 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71410f2e0 con 0x7fd7140faed0 2023-12-07T16:22:35.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.800+0000 7fd71c0f3700 1 -- 172.21.15.63:0/4203189803 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd714107690 con 0x7fd7140faed0 2023-12-07T16:22:35.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.800+0000 7fd70a7fc700 1 -- 172.21.15.63:0/4203189803 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 32) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fd71000f850 con 0x7fd7140faed0 2023-12-07T16:22:35.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.801+0000 7fd70a7fc700 1 --2- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fd70006cf80 0x7fd70006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:35.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.801+0000 7fd71968e700 1 -- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fd70006cf80 msgr2=0x7fd70006f430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/2671097541 2023-12-07T16:22:35.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.801+0000 7fd70a7fc700 1 -- 172.21.15.63:0/4203189803 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fd71008bfe0 con 0x7fd7140faed0 2023-12-07T16:22:35.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.801+0000 7fd71968e700 1 --2- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fd70006cf80 0x7fd70006f430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-07T16:22:35.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:35.806+0000 7fd70a7fc700 1 -- 172.21.15.63:0/4203189803 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd7100bf2f0 con 0x7fd7140faed0 2023-12-07T16:22:35.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:35 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-07T16:22:35.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:35 smithi152 ceph-mon[121113]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:22:35.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:35 smithi152 ceph-mon[121113]: pgmap v20: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 2.2 MiB/s wr, 271 op/s 2023-12-07T16:22:35.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:35 smithi152 ceph-mon[121113]: from='client.24495 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:22:35.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:35 smithi152 ceph-mon[121113]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:22:35.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:35 smithi152 ceph-mon[121113]: pgmap v21: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 2.5 MiB/s wr, 428 op/s 2023-12-07T16:22:35.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:35 smithi152 ceph-mon[121113]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:22:35.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:35 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/2221442303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:22:35.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:35 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/1422696293' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:22:35.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:35 smithi152 ceph-mon[121113]: pgmap v22: 65 pgs: 65 active+clean; 316 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 2.6 MiB/s wr, 405 op/s 2023-12-07T16:22:35.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:35 smithi152 ceph-mon[121113]: mon.smithi063 calling monitor election 2023-12-07T16:22:35.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:35 smithi152 ceph-mon[121113]: mon.smithi063 is new leader, mons smithi063,smithi152 in quorum (ranks 0,1) 2023-12-07T16:22:35.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:35 smithi152 ceph-mon[121113]: monmap e2: 2 mons at {smithi063=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0],smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-07T16:22:35.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:35 smithi152 ceph-mon[121113]: fsmap cephfs:2 {0=cephfs.smithi063.yidolg=up:active,1=cephfs.smithi152.mrvngf=up:active} 2 up:standby 2023-12-07T16:22:35.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:35 smithi152 ceph-mon[121113]: osdmap e48: 6 total, 6 up, 6 in 2023-12-07T16:22:35.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:35 smithi152 ceph-mon[121113]: mgrmap e31: smithi063.yohyyx(active, since 38s), standbys: smithi152.sxayfb 2023-12-07T16:22:35.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:35 smithi152 ceph-mon[121113]: from='mgr.24453 ' entity='' 2023-12-07T16:22:35.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:35 smithi152 ceph-mon[121113]: Standby manager daemon smithi152.sxayfb restarted 2023-12-07T16:22:35.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:35 smithi152 ceph-mon[121113]: Standby manager daemon smithi152.sxayfb started 2023-12-07T16:22:35.995 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:35 smithi152 ceph-mon[121113]: mgrmap e32: smithi063.yohyyx(active, since 38s), standbys: smithi152.sxayfb 2023-12-07T16:22:35.995 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:35 smithi152 ceph-mon[121113]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-07T16:22:35.995 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:35 smithi152 ceph-mon[121113]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-07T16:22:35.995 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:35 smithi152 ceph-mon[121113]: fs cephfs has deprecated feature inline_data enabled. 2023-12-07T16:22:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:36.002+0000 7fd71968e700 1 -- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fd70006cf80 msgr2=0x7fd70006f430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/2671097541 2023-12-07T16:22:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:36.002+0000 7fd71968e700 1 --2- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fd70006cf80 0x7fd70006f430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-07T16:22:36.127 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:35 smithi063 ceph-mon[192008]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-07T16:22:36.128 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:35 smithi063 ceph-mon[192008]: from='mgr.24453 172.21.15.63:0/2167185500' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:22:36.128 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:35 smithi063 ceph-mon[192008]: pgmap v20: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 2.2 MiB/s wr, 271 op/s 2023-12-07T16:22:36.128 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:35 smithi063 ceph-mon[192008]: from='client.24495 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:22:36.128 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:35 smithi063 ceph-mon[192008]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:22:36.128 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:35 smithi063 ceph-mon[192008]: pgmap v21: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 2.5 MiB/s wr, 428 op/s 2023-12-07T16:22:36.128 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:35 smithi063 ceph-mon[192008]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:22:36.128 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:35 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/2221442303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:22:36.128 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:35 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/1422696293' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:22:36.128 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:35 smithi063 ceph-mon[192008]: pgmap v22: 65 pgs: 65 active+clean; 316 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 2.6 MiB/s wr, 405 op/s 2023-12-07T16:22:36.128 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:35 smithi063 ceph-mon[192008]: mon.smithi063 calling monitor election 2023-12-07T16:22:36.129 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:35 smithi063 ceph-mon[192008]: mon.smithi063 is new leader, mons smithi063,smithi152 in quorum (ranks 0,1) 2023-12-07T16:22:36.129 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:35 smithi063 ceph-mon[192008]: monmap e2: 2 mons at {smithi063=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0],smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-07T16:22:36.129 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:35 smithi063 ceph-mon[192008]: fsmap cephfs:2 {0=cephfs.smithi063.yidolg=up:active,1=cephfs.smithi152.mrvngf=up:active} 2 up:standby 2023-12-07T16:22:36.129 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:35 smithi063 ceph-mon[192008]: osdmap e48: 6 total, 6 up, 6 in 2023-12-07T16:22:36.129 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:35 smithi063 ceph-mon[192008]: mgrmap e31: smithi063.yohyyx(active, since 38s), standbys: smithi152.sxayfb 2023-12-07T16:22:36.129 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:35 smithi063 ceph-mon[192008]: from='mgr.24453 ' entity='' 2023-12-07T16:22:36.129 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:35 smithi063 ceph-mon[192008]: Standby manager daemon smithi152.sxayfb restarted 2023-12-07T16:22:36.129 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:35 smithi063 ceph-mon[192008]: Standby manager daemon smithi152.sxayfb started 2023-12-07T16:22:36.129 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:35 smithi063 ceph-mon[192008]: mgrmap e32: smithi063.yohyyx(active, since 38s), standbys: smithi152.sxayfb 2023-12-07T16:22:36.129 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:35 smithi063 ceph-mon[192008]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-07T16:22:36.129 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:35 smithi063 ceph-mon[192008]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-07T16:22:36.130 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:35 smithi063 ceph-mon[192008]: fs cephfs has deprecated feature inline_data enabled. 2023-12-07T16:22:36.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:36.170+0000 7fd71c0f3700 1 -- 172.21.15.63:0/4203189803 --> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd71410f5c0 con 0x7fd70006cf80 2023-12-07T16:22:36.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:36.404+0000 7fd71968e700 1 -- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fd70006cf80 msgr2=0x7fd70006f430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/2671097541 2023-12-07T16:22:36.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:36.404+0000 7fd71968e700 1 --2- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fd70006cf80 0x7fd70006f430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-07T16:22:36.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:36.693+0000 7fd70a7fc700 1 -- 172.21.15.63:0/4203189803 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mgrmap(e 33) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fd71008a290 con 0x7fd7140faed0 2023-12-07T16:22:37.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:37.205+0000 7fd71968e700 1 -- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fd70006cf80 msgr2=0x7fd70006f430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/2671097541 2023-12-07T16:22:37.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:37.205+0000 7fd71968e700 1 --2- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fd70006cf80 0x7fd70006f430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-07T16:22:37.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:37 smithi063 ceph-mon[192008]: mgrmap e33: smithi063.yohyyx(active, since 39s), standbys: smithi152.sxayfb 2023-12-07T16:22:37.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:37 smithi152 ceph-mon[121113]: mgrmap e33: smithi063.yohyyx(active, since 39s), standbys: smithi152.sxayfb 2023-12-07T16:22:38.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:38.806+0000 7fd71968e700 1 -- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fd70006cf80 msgr2=0x7fd70006f430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/2671097541 2023-12-07T16:22:38.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:38.806+0000 7fd71968e700 1 --2- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fd70006cf80 0x7fd70006f430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-07T16:22:42.006 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:42.009+0000 7fd71968e700 1 -- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fd70006cf80 msgr2=0x7fd70006f430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/2671097541 2023-12-07T16:22:42.006 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:42.009+0000 7fd71968e700 1 --2- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fd70006cf80 0x7fd70006f430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-12-07T16:22:43.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:43.921+0000 7fd70a7fc700 1 -- 172.21.15.63:0/4203189803 <== mon.1 v2:172.21.15.152:3300/0 8 ==== mgrmap(e 34) v1 ==== 90561+0+0 (secure 0 0 0) 0x7fd710056260 con 0x7fd7140faed0 2023-12-07T16:22:43.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:43.921+0000 7fd70a7fc700 1 -- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fd70006cf80 msgr2=0x7fd70006f430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-07T16:22:43.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:43.921+0000 7fd70a7fc700 1 --2- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fd70006cf80 0x7fd70006f430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:43.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:43 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-mon-smithi152[121089]: 2023-12-07T16:22:43.909+0000 7f3b512ec700 -1 mon.smithi152@1(peon).osd e49 update_from_paxos full map CRC mismatch, resetting to canonical 2023-12-07T16:22:43.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:43 smithi152 ceph-mon[121113]: Active manager daemon smithi063.yohyyx restarted 2023-12-07T16:22:43.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:43 smithi152 ceph-mon[121113]: Activating manager daemon smithi063.yohyyx 2023-12-07T16:22:43.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:43 smithi152 ceph-mon[121113]: osdmap e49: 6 total, 6 up, 6 in 2023-12-07T16:22:43.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:43 smithi152 ceph-mon[121113]: mgrmap e34: smithi063.yohyyx(active, starting, since 0.0069795s), standbys: smithi152.sxayfb 2023-12-07T16:22:43.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:43 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-07T16:22:43.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:43 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:22:43.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:43 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.yidolg"}]: dispatch 2023-12-07T16:22:43.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:43 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.gsjgcq"}]: dispatch 2023-12-07T16:22:43.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:43 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.mrvngf"}]: dispatch 2023-12-07T16:22:43.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:43 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.aovwwd"}]: dispatch 2023-12-07T16:22:43.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:43 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr metadata", "who": "smithi063.yohyyx", "id": "smithi063.yohyyx"}]: dispatch 2023-12-07T16:22:43.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:43 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr metadata", "who": "smithi152.sxayfb", "id": "smithi152.sxayfb"}]: dispatch 2023-12-07T16:22:43.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:43 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-07T16:22:43.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:43 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-07T16:22:43.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:43 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T16:22:43.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:43 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T16:22:43.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:43 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-07T16:22:43.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:43 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-07T16:22:43.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:43 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-07T16:22:43.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:43 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-07T16:22:43.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:43 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-07T16:22:43.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:43 smithi152 ceph-mon[121113]: Manager daemon smithi063.yohyyx is now available 2023-12-07T16:22:43.998 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:43 smithi063 ceph-mon[192008]: Active manager daemon smithi063.yohyyx restarted 2023-12-07T16:22:43.998 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:43 smithi063 ceph-mon[192008]: Activating manager daemon smithi063.yohyyx 2023-12-07T16:22:43.998 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:43 smithi063 ceph-mon[192008]: osdmap e49: 6 total, 6 up, 6 in 2023-12-07T16:22:43.998 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:43 smithi063 ceph-mon[192008]: mgrmap e34: smithi063.yohyyx(active, starting, since 0.0069795s), standbys: smithi152.sxayfb 2023-12-07T16:22:43.998 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:43 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-07T16:22:43.998 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:43 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:22:43.999 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:43 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.yidolg"}]: dispatch 2023-12-07T16:22:43.999 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:43 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi063.gsjgcq"}]: dispatch 2023-12-07T16:22:43.999 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:43 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.mrvngf"}]: dispatch 2023-12-07T16:22:43.999 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:43 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.aovwwd"}]: dispatch 2023-12-07T16:22:43.999 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:43 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr metadata", "who": "smithi063.yohyyx", "id": "smithi063.yohyyx"}]: dispatch 2023-12-07T16:22:43.999 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:43 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr metadata", "who": "smithi152.sxayfb", "id": "smithi152.sxayfb"}]: dispatch 2023-12-07T16:22:43.999 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:43 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-07T16:22:43.999 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:43 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-07T16:22:43.999 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:43 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T16:22:43.999 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:43 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T16:22:43.999 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:43 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-07T16:22:43.999 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:43 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-07T16:22:43.999 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:43 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-07T16:22:43.999 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:43 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-07T16:22:43.999 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:43 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-07T16:22:43.999 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:43 smithi063 ceph-mon[192008]: Manager daemon smithi063.yohyyx is now available 2023-12-07T16:22:44.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:44.919+0000 7fd70a7fc700 1 -- 172.21.15.63:0/4203189803 <== mon.1 v2:172.21.15.152:3300/0 9 ==== mgrmap(e 35) v1 ==== 90688+0+0 (secure 0 0 0) 0x7fd71006c070 con 0x7fd7140faed0 2023-12-07T16:22:44.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:44.919+0000 7fd70a7fc700 1 --2- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fd70001c8e0 0x7fd70001ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:44.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:44.920+0000 7fd70a7fc700 1 -- 172.21.15.63:0/4203189803 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd71410f5c0 con 0x7fd70001c8e0 2023-12-07T16:22:44.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:44.921+0000 7fd71968e700 1 --2- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fd70001c8e0 0x7fd70001ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:44.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:44.922+0000 7fd71968e700 1 --2- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fd70001c8e0 0x7fd70001ccb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd70400b3b0 tx=0x7fd704009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:22:44.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:44.924+0000 7fd70a7fc700 1 -- 172.21.15.63:0/4203189803 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fd71410f5c0 con 0x7fd70001c8e0 2023-12-07T16:22:44.924 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:22:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-07T16:22:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-07T16:22:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-07T16:22:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [ 2023-12-07T16:22:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr" 2023-12-07T16:22:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2023-12-07T16:22:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "2/21 daemons upgraded", 2023-12-07T16:22:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "", 2023-12-07T16:22:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-07T16:22:44.925 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:22:44.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:44.928+0000 7fd71c0f3700 1 -- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fd70001c8e0 msgr2=0x7fd70001ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:44.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:44.928+0000 7fd71c0f3700 1 --2- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fd70001c8e0 0x7fd70001ccb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd70400b3b0 tx=0x7fd704009e30 comp rx=0 tx=0).stop 2023-12-07T16:22:44.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:44.928+0000 7fd71c0f3700 1 -- 172.21.15.63:0/4203189803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7140faed0 msgr2=0x7fd71410d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:44.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:44.928+0000 7fd71c0f3700 1 --2- 172.21.15.63:0/4203189803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7140faed0 0x7fd71410d6b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd71000b760 tx=0x7fd7100091a0 comp rx=0 tx=0).stop 2023-12-07T16:22:44.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:44.928+0000 7fd71c0f3700 1 -- 172.21.15.63:0/4203189803 shutdown_connections 2023-12-07T16:22:44.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:44.928+0000 7fd71c0f3700 1 --2- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fd70001c8e0 0x7fd70001ccb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:44.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:44.928+0000 7fd71c0f3700 1 --2- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:6800/2671097541,v1:172.21.15.63:6801/2671097541] conn(0x7fd70006cf80 0x7fd70006f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:44.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:44.928+0000 7fd71c0f3700 1 --2- 172.21.15.63:0/4203189803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7140faed0 0x7fd71410d6b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:44.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:44.928+0000 7fd71c0f3700 1 --2- 172.21.15.63:0/4203189803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7140fdf60 0x7fd71410dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:44.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:44.928+0000 7fd71c0f3700 1 -- 172.21.15.63:0/4203189803 >> 172.21.15.63:0/4203189803 conn(0x7fd7140f6950 msgr2=0x7fd7140f8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:22:44.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:44.928+0000 7fd71c0f3700 1 -- 172.21.15.63:0/4203189803 shutdown_connections 2023-12-07T16:22:44.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:44.928+0000 7fd71c0f3700 1 -- 172.21.15.63:0/4203189803 wait complete. 2023-12-07T16:22:45.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.063+0000 7f971286f700 1 -- 172.21.15.63:0/4144315258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f970c0fc4a0 msgr2=0x7f970c0fc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:45.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.063+0000 7f971286f700 1 --2- 172.21.15.63:0/4144315258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f970c0fc4a0 0x7f970c0fc8f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f97000049c0 tx=0x7f9700009e30 comp rx=0 tx=0).stop 2023-12-07T16:22:45.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.063+0000 7f971286f700 1 -- 172.21.15.63:0/4144315258 shutdown_connections 2023-12-07T16:22:45.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.063+0000 7f971286f700 1 --2- 172.21.15.63:0/4144315258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f970c0fc4a0 0x7f970c0fc8f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:45.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.063+0000 7f971286f700 1 --2- 172.21.15.63:0/4144315258 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f970c0fb290 0x7f970c0fb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:45.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.063+0000 7f971286f700 1 -- 172.21.15.63:0/4144315258 >> 172.21.15.63:0/4144315258 conn(0x7f970c0f6950 msgr2=0x7f970c0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:22:45.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.064+0000 7f971286f700 1 -- 172.21.15.63:0/4144315258 shutdown_connections 2023-12-07T16:22:45.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.064+0000 7f971286f700 1 -- 172.21.15.63:0/4144315258 wait complete. 2023-12-07T16:22:45.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.064+0000 7f971286f700 1 Processor -- start 2023-12-07T16:22:45.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.064+0000 7f971286f700 1 -- start start 2023-12-07T16:22:45.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.065+0000 7f971286f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f970c0fb290 0x7f970c10f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:45.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.065+0000 7f971286f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f970c0fc4a0 0x7f970c10fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:45.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.065+0000 7f971286f700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c110270 con 0x7f970c0fb290 2023-12-07T16:22:45.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.065+0000 7f971286f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c110b10 con 0x7f970c0fc4a0 2023-12-07T16:22:45.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.065+0000 7f970bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f970c0fb290 0x7f970c10f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:45.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.065+0000 7f970bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f970c0fb290 0x7f970c10f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47024/0 (socket says 172.21.15.63:47024) 2023-12-07T16:22:45.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.065+0000 7f970bfff700 1 -- 172.21.15.63:0/4248265490 learned_addr learned my addr 172.21.15.63:0/4248265490 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:22:45.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.065+0000 7f970b7fe700 1 --2- 172.21.15.63:0/4248265490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f970c0fc4a0 0x7f970c10fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:45.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.065+0000 7f970bfff700 1 -- 172.21.15.63:0/4248265490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f970c0fc4a0 msgr2=0x7f970c10fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:45.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.065+0000 7f970bfff700 1 --2- 172.21.15.63:0/4248265490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f970c0fc4a0 0x7f970c10fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:45.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.065+0000 7f970bfff700 1 -- 172.21.15.63:0/4248265490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9700005040 con 0x7f970c0fb290 2023-12-07T16:22:45.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.065+0000 7f970bfff700 1 --2- 172.21.15.63:0/4248265490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f970c0fb290 0x7f970c10f730 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f96fc00a6d0 tx=0x7f96fc00c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:22:45.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.066+0000 7f9708ff9700 1 -- 172.21.15.63:0/4248265490 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96fc00f040 con 0x7f970c0fb290 2023-12-07T16:22:45.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.066+0000 7f971286f700 1 -- 172.21.15.63:0/4248265490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f970c110df0 con 0x7f970c0fb290 2023-12-07T16:22:45.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.066+0000 7f971286f700 1 -- 172.21.15.63:0/4248265490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f970c111330 con 0x7f970c0fb290 2023-12-07T16:22:45.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.067+0000 7f9708ff9700 1 -- 172.21.15.63:0/4248265490 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f96fc00ede0 con 0x7f970c0fb290 2023-12-07T16:22:45.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.067+0000 7f9708ff9700 1 -- 172.21.15.63:0/4248265490 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96fc0153e0 con 0x7f970c0fb290 2023-12-07T16:22:45.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.067+0000 7f971286f700 1 -- 172.21.15.63:0/4248265490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f80052e0 con 0x7f970c0fb290 2023-12-07T16:22:45.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.068+0000 7f9708ff9700 1 -- 172.21.15.63:0/4248265490 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 35) v1 ==== 90688+0+0 (secure 0 0 0) 0x7f96fc00e930 con 0x7f970c0fb290 2023-12-07T16:22:45.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.069+0000 7f9708ff9700 1 --2- 172.21.15.63:0/4248265490 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f96f406cb60 0x7f96f406f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:22:45.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.069+0000 7f9708ff9700 1 -- 172.21.15.63:0/4248265490 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f96fc08bc80 con 0x7f970c0fb290 2023-12-07T16:22:45.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.069+0000 7f970b7fe700 1 --2- 172.21.15.63:0/4248265490 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f96f406cb60 0x7f96f406f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:22:45.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.069+0000 7f970b7fe700 1 --2- 172.21.15.63:0/4248265490 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f96f406cb60 0x7f96f406f010 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f970000d5c0 tx=0x7f970000b040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:22:45.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.074+0000 7f9708ff9700 1 -- 172.21.15.63:0/4248265490 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f96fc0502f0 con 0x7f970c0fb290 2023-12-07T16:22:45.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:44 smithi152 ceph-mon[121113]: failed to encode map e49 with expected crc 2023-12-07T16:22:45.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:44 smithi152 ceph-mon[121113]: failed to encode map e49 with expected crc 2023-12-07T16:22:45.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:44 smithi152 ceph-mon[121113]: failed to encode map e49 with expected crc 2023-12-07T16:22:45.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:44 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:22:45.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:44 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:22:45.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:44 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:22:45.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:44 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.yohyyx/mirror_snapshot_schedule"}]: dispatch 2023-12-07T16:22:45.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:44 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.yohyyx/trash_purge_schedule"}]: dispatch 2023-12-07T16:22:45.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:44 smithi152 ceph-mon[121113]: failed to encode map e49 with expected crc 2023-12-07T16:22:45.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:44 smithi152 ceph-mon[121113]: Standby manager daemon smithi152.sxayfb restarted 2023-12-07T16:22:45.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:44 smithi152 ceph-mon[121113]: Standby manager daemon smithi152.sxayfb started 2023-12-07T16:22:45.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:44 smithi152 ceph-mon[121113]: from='mgr.? 172.21.15.152:0/4159935209' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.sxayfb/crt"}]: dispatch 2023-12-07T16:22:45.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:44 smithi152 ceph-mon[121113]: from='mgr.? 172.21.15.152:0/4159935209' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-07T16:22:45.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:44 smithi152 ceph-mon[121113]: from='mgr.? 172.21.15.152:0/4159935209' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.sxayfb/key"}]: dispatch 2023-12-07T16:22:45.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:44 smithi152 ceph-mon[121113]: from='mgr.? 172.21.15.152:0/4159935209' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-07T16:22:45.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:44 smithi152 ceph-mon[121113]: mgrmap e35: smithi063.yohyyx(active, since 1.01018s), standbys: smithi152.sxayfb 2023-12-07T16:22:45.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:44 smithi063 ceph-mon[192008]: failed to encode map e49 with expected crc 2023-12-07T16:22:45.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:44 smithi063 ceph-mon[192008]: failed to encode map e49 with expected crc 2023-12-07T16:22:45.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:44 smithi063 ceph-mon[192008]: failed to encode map e49 with expected crc 2023-12-07T16:22:45.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:44 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:22:45.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:44 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:22:45.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:44 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:22:45.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:44 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.yohyyx/mirror_snapshot_schedule"}]: dispatch 2023-12-07T16:22:45.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:44 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi063.yohyyx/trash_purge_schedule"}]: dispatch 2023-12-07T16:22:45.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:44 smithi063 ceph-mon[192008]: failed to encode map e49 with expected crc 2023-12-07T16:22:45.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:44 smithi063 ceph-mon[192008]: Standby manager daemon smithi152.sxayfb restarted 2023-12-07T16:22:45.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:44 smithi063 ceph-mon[192008]: Standby manager daemon smithi152.sxayfb started 2023-12-07T16:22:45.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:44 smithi063 ceph-mon[192008]: from='mgr.? 172.21.15.152:0/4159935209' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.sxayfb/crt"}]: dispatch 2023-12-07T16:22:45.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:44 smithi063 ceph-mon[192008]: from='mgr.? 172.21.15.152:0/4159935209' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-07T16:22:45.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:44 smithi063 ceph-mon[192008]: from='mgr.? 172.21.15.152:0/4159935209' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.sxayfb/key"}]: dispatch 2023-12-07T16:22:45.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:44 smithi063 ceph-mon[192008]: from='mgr.? 172.21.15.152:0/4159935209' entity='mgr.smithi152.sxayfb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-07T16:22:45.407 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:44 smithi063 ceph-mon[192008]: mgrmap e35: smithi063.yohyyx(active, since 1.01018s), standbys: smithi152.sxayfb 2023-12-07T16:22:45.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.497+0000 7f971286f700 1 -- 172.21.15.63:0/4248265490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f96f8005590 con 0x7f970c0fb290 2023-12-07T16:22:45.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.498+0000 7f9708ff9700 1 -- 172.21.15.63:0/4248265490 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f96fc01b020 con 0x7f970c0fb290 2023-12-07T16:22:45.496 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-07T16:22:45.496 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-07T16:22:45.496 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-07T16:22:45.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.502+0000 7f971286f700 1 -- 172.21.15.63:0/4248265490 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f96f406cb60 msgr2=0x7f96f406f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:45.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.502+0000 7f971286f700 1 --2- 172.21.15.63:0/4248265490 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f96f406cb60 0x7f96f406f010 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f970000d5c0 tx=0x7f970000b040 comp rx=0 tx=0).stop 2023-12-07T16:22:45.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.502+0000 7f971286f700 1 -- 172.21.15.63:0/4248265490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f970c0fb290 msgr2=0x7f970c10f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:22:45.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.502+0000 7f971286f700 1 --2- 172.21.15.63:0/4248265490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f970c0fb290 0x7f970c10f730 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f96fc00a6d0 tx=0x7f96fc00c040 comp rx=0 tx=0).stop 2023-12-07T16:22:45.500 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.502+0000 7f971286f700 1 -- 172.21.15.63:0/4248265490 shutdown_connections 2023-12-07T16:22:45.500 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.502+0000 7f971286f700 1 --2- 172.21.15.63:0/4248265490 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f96f406cb60 0x7f96f406f010 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:45.500 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.502+0000 7f971286f700 1 --2- 172.21.15.63:0/4248265490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f970c0fb290 0x7f970c10f730 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:45.500 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.502+0000 7f971286f700 1 --2- 172.21.15.63:0/4248265490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f970c0fc4a0 0x7f970c10fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:22:45.500 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.502+0000 7f971286f700 1 -- 172.21.15.63:0/4248265490 >> 172.21.15.63:0/4248265490 conn(0x7f970c0f6950 msgr2=0x7f970c0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:22:45.500 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.502+0000 7f971286f700 1 -- 172.21.15.63:0/4248265490 shutdown_connections 2023-12-07T16:22:45.500 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:22:45.503+0000 7f971286f700 1 -- 172.21.15.63:0/4248265490 wait complete. 2023-12-07T16:22:46.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:45 smithi152 ceph-mon[121113]: from='client.? 172.21.15.63:0/4248265490' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:22:46.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:45 smithi152 ceph-mon[121113]: [07/Dec/2023:16:22:45] ENGINE Bus STARTING 2023-12-07T16:22:46.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:45 smithi152 ceph-mon[121113]: [07/Dec/2023:16:22:45] ENGINE Serving on http://172.21.15.63:8765 2023-12-07T16:22:46.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:45 smithi152 ceph-mon[121113]: [07/Dec/2023:16:22:45] ENGINE Serving on https://172.21.15.63:7150 2023-12-07T16:22:46.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:45 smithi152 ceph-mon[121113]: [07/Dec/2023:16:22:45] ENGINE Bus STARTED 2023-12-07T16:22:46.291 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:45 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/4248265490' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:22:46.291 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:45 smithi063 ceph-mon[192008]: [07/Dec/2023:16:22:45] ENGINE Bus STARTING 2023-12-07T16:22:46.292 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:45 smithi063 ceph-mon[192008]: [07/Dec/2023:16:22:45] ENGINE Serving on http://172.21.15.63:8765 2023-12-07T16:22:46.292 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:45 smithi063 ceph-mon[192008]: [07/Dec/2023:16:22:45] ENGINE Serving on https://172.21.15.63:7150 2023-12-07T16:22:46.292 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:45 smithi063 ceph-mon[192008]: [07/Dec/2023:16:22:45] ENGINE Bus STARTED 2023-12-07T16:22:47.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:46 smithi063 ceph-mon[192008]: pgmap v4: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:22:47.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:46 smithi063 ceph-mon[192008]: mgrmap e36: smithi063.yohyyx(active, since 3s), standbys: smithi152.sxayfb 2023-12-07T16:22:47.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:46 smithi152 ceph-mon[121113]: pgmap v4: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:22:47.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:46 smithi152 ceph-mon[121113]: mgrmap e36: smithi063.yohyyx(active, since 3s), standbys: smithi152.sxayfb 2023-12-07T16:22:48.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:48 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:48.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:48 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:48.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:48 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:48.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:48 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:48.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:48 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:48.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:48 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:48.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:48 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:48.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:48 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:48.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:48 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:48.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:48 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:48.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:48 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:48.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:48 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:50.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:49 smithi063 ceph-mon[192008]: pgmap v5: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:22:50.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:49 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:50.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:49 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:50.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:49 smithi063 ceph-mon[192008]: mgrmap e37: smithi063.yohyyx(active, since 4s), standbys: smithi152.sxayfb 2023-12-07T16:22:50.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:49 smithi152 ceph-mon[121113]: pgmap v5: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:22:50.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:49 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:50.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:49 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:50.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:49 smithi152 ceph-mon[121113]: mgrmap e37: smithi063.yohyyx(active, since 4s), standbys: smithi152.sxayfb 2023-12-07T16:22:51.786 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2023-12-07T16:22:51.786 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2023-12-07T16:22:52.108 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:51 smithi152 ceph-mon[121113]: pgmap v6: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 93 KiB/s rd, 2.5 MiB/s wr, 536 op/s 2023-12-07T16:22:52.108 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:51 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:52.109 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:51 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:52.109 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:51 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:22:52.109 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:51 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:22:52.110 DEBUG:teuthology.parallel:result is None 2023-12-07T16:22:52.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:51 smithi063 ceph-mon[192008]: pgmap v6: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 93 KiB/s rd, 2.5 MiB/s wr, 536 op/s 2023-12-07T16:22:52.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:51 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:52.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:51 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:52.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:51 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:22:52.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:51 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:22:52.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:52 smithi152 ceph-mon[121113]: Updating smithi063:/etc/ceph/ceph.conf 2023-12-07T16:22:52.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:52 smithi152 ceph-mon[121113]: Updating smithi152:/etc/ceph/ceph.conf 2023-12-07T16:22:52.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:52 smithi152 ceph-mon[121113]: Updating smithi152:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-07T16:22:52.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:52 smithi152 ceph-mon[121113]: Updating smithi063:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-07T16:22:52.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:52 smithi152 ceph-mon[121113]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2023-12-07T16:22:52.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:52 smithi152 ceph-mon[121113]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2023-12-07T16:22:52.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:52 smithi152 ceph-mon[121113]: Updating smithi152:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-07T16:22:52.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:52 smithi152 ceph-mon[121113]: Updating smithi063:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-07T16:22:52.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:52 smithi152 ceph-mon[121113]: pgmap v7: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 66 KiB/s rd, 1.8 MiB/s wr, 382 op/s 2023-12-07T16:22:52.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:52 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:52.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:52 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:52.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:52 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:52.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:52 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:52.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:52 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:52.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:52 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:22:52.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:52 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:22:52.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:52 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-07T16:22:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:52 smithi063 ceph-mon[192008]: Updating smithi063:/etc/ceph/ceph.conf 2023-12-07T16:22:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:52 smithi063 ceph-mon[192008]: Updating smithi152:/etc/ceph/ceph.conf 2023-12-07T16:22:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:52 smithi063 ceph-mon[192008]: Updating smithi152:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-07T16:22:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:52 smithi063 ceph-mon[192008]: Updating smithi063:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-07T16:22:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:52 smithi063 ceph-mon[192008]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2023-12-07T16:22:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:52 smithi063 ceph-mon[192008]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2023-12-07T16:22:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:52 smithi063 ceph-mon[192008]: Updating smithi152:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-07T16:22:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:52 smithi063 ceph-mon[192008]: Updating smithi063:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-07T16:22:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:52 smithi063 ceph-mon[192008]: pgmap v7: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 66 KiB/s rd, 1.8 MiB/s wr, 382 op/s 2023-12-07T16:22:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:52 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:52 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:53.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:52 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:53.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:52 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:53.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:52 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:53.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:52 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:22:53.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:52 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:22:53.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:52 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-07T16:22:54.600 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:54 smithi152 ceph-mon[121113]: Upgrade: Updating mon.smithi152 2023-12-07T16:22:54.601 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:54 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:54.601 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:54 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-07T16:22:54.601 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:54 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-07T16:22:54.601 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:54 smithi152 ceph-mon[121113]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:22:54.601 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:54 smithi152 ceph-mon[121113]: Deploying daemon mon.smithi152 on smithi152 2023-12-07T16:22:54.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:54 smithi063 ceph-mon[192008]: Upgrade: Updating mon.smithi152 2023-12-07T16:22:54.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:54 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:54.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:54 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-07T16:22:54.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:54 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-07T16:22:54.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:54 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:22:54.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:54 smithi063 ceph-mon[192008]: Deploying daemon mon.smithi152 on smithi152 2023-12-07T16:22:54.990 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:54 smithi152 systemd[1]: Stopping Ceph mon.smithi152 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:22:54.990 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:54 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-mon-smithi152[121089]: 2023-12-07T16:22:54.989+0000 7f3b56af7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi152 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-07T16:22:54.990 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:54 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-mon-smithi152[121089]: 2023-12-07T16:22:54.989+0000 7f3b56af7700 -1 mon.smithi152@1(peon) e2 *** Got Signal Terminated *** 2023-12-07T16:22:55.702 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:55 smithi152 bash[175461]: ceph-8c493298-951b-11ee-95a2-87774f69a715-mon-smithi152 2023-12-07T16:22:55.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:55 smithi152 systemd[1]: ceph-8c493298-951b-11ee-95a2-87774f69a715@mon.smithi152.service: Succeeded. 2023-12-07T16:22:55.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:55 smithi152 systemd[1]: Stopped Ceph mon.smithi152 for 8c493298-951b-11ee-95a2-87774f69a715. 2023-12-07T16:22:55.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:55 smithi152 systemd[1]: Starting Ceph mon.smithi152 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:22:57.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:56 smithi063 ceph-mon[192008]: pgmap v8: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 1.4 MiB/s wr, 297 op/s 2023-12-07T16:22:57.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 bash[175608]: 883bb3425cf09acf0294cb2b7037ca9b2c794e6918e3c6a4e6455161a9749199 2023-12-07T16:22:57.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: set uid:gid to 167:167 (ceph:ceph) 2023-12-07T16:22:57.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 systemd[1]: Started Ceph mon.smithi152 for 8c493298-951b-11ee-95a2-87774f69a715. 2023-12-07T16:22:57.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev), process ceph-mon, pid 7 2023-12-07T16:22:57.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: pidfile_write: ignore empty --pid-file 2023-12-07T16:22:57.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: load: jerasure load: lrc 2023-12-07T16:22:57.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: RocksDB version: 7.9.2 2023-12-07T16:22:57.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Git sha 0 2023-12-07T16:22:57.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Compile date 2023-12-05 09:15:47 2023-12-07T16:22:57.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: DB SUMMARY 2023-12-07T16:22:57.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: DB Session ID: EYU6LZKOJAWKDFGCK9V9 2023-12-07T16:22:57.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: CURRENT file: CURRENT 2023-12-07T16:22:57.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: IDENTITY file: IDENTITY 2023-12-07T16:22:57.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: MANIFEST file: MANIFEST-000009 size: 710 Bytes 2023-12-07T16:22:57.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi152/store.db dir, Total Num: 1, files: 000021.sst 2023-12-07T16:22:57.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi152/store.db: 000019.log size: 4516010 ; 2023-12-07T16:22:57.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.error_if_exists: 0 2023-12-07T16:22:57.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.create_if_missing: 0 2023-12-07T16:22:57.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.paranoid_checks: 1 2023-12-07T16:22:57.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-07T16:22:57.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-07T16:22:57.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-07T16:22:57.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.env: 0x55aa0886ca60 2023-12-07T16:22:57.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.fs: PosixFileSystem 2023-12-07T16:22:57.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.info_log: 0x55aa092cf600 2023-12-07T16:22:57.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_file_opening_threads: 16 2023-12-07T16:22:57.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.statistics: (nil) 2023-12-07T16:22:57.245 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.use_fsync: 0 2023-12-07T16:22:57.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_log_file_size: 0 2023-12-07T16:22:57.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-07T16:22:57.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-07T16:22:57.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.keep_log_file_num: 1000 2023-12-07T16:22:57.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.recycle_log_file_num: 0 2023-12-07T16:22:57.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.allow_fallocate: 1 2023-12-07T16:22:57.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.allow_mmap_reads: 0 2023-12-07T16:22:57.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.allow_mmap_writes: 0 2023-12-07T16:22:57.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.use_direct_reads: 0 2023-12-07T16:22:57.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-07T16:22:57.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.create_missing_column_families: 0 2023-12-07T16:22:57.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.db_log_dir: 2023-12-07T16:22:57.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.wal_dir: 2023-12-07T16:22:57.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-07T16:22:57.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-07T16:22:57.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-07T16:22:57.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-07T16:22:57.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-07T16:22:57.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-07T16:22:57.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.advise_random_on_open: 1 2023-12-07T16:22:57.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.db_write_buffer_size: 0 2023-12-07T16:22:57.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.write_buffer_manager: 0x55aa09285360 2023-12-07T16:22:57.248 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-07T16:22:57.248 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-07T16:22:57.248 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-07T16:22:57.248 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.rate_limiter: (nil) 2023-12-07T16:22:57.248 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-07T16:22:57.248 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.wal_recovery_mode: 2 2023-12-07T16:22:57.248 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.enable_thread_tracking: 0 2023-12-07T16:22:57.248 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.enable_pipelined_write: 0 2023-12-07T16:22:57.248 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.unordered_write: 0 2023-12-07T16:22:57.248 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-07T16:22:57.248 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-07T16:22:57.249 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-07T16:22:57.249 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-07T16:22:57.249 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.row_cache: None 2023-12-07T16:22:57.249 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.wal_filter: None 2023-12-07T16:22:57.249 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-07T16:22:57.249 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.allow_ingest_behind: 0 2023-12-07T16:22:57.249 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.two_write_queues: 0 2023-12-07T16:22:57.249 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.manual_wal_flush: 0 2023-12-07T16:22:57.249 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.wal_compression: 0 2023-12-07T16:22:57.249 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.atomic_flush: 0 2023-12-07T16:22:57.249 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-07T16:22:57.249 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-07T16:22:57.249 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-07T16:22:57.250 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.log_readahead_size: 0 2023-12-07T16:22:57.250 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-07T16:22:57.250 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.best_efforts_recovery: 0 2023-12-07T16:22:57.250 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-07T16:22:57.250 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-07T16:22:57.251 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.allow_data_in_errors: 0 2023-12-07T16:22:57.251 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.db_host_id: __hostname__ 2023-12-07T16:22:57.252 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-07T16:22:57.252 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_background_jobs: 2 2023-12-07T16:22:57.252 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_background_compactions: -1 2023-12-07T16:22:57.252 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_subcompactions: 1 2023-12-07T16:22:57.252 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-07T16:22:57.252 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-07T16:22:57.252 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-07T16:22:57.252 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_total_wal_size: 0 2023-12-07T16:22:57.252 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-07T16:22:57.252 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-07T16:22:57.252 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-07T16:22:57.253 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-07T16:22:57.253 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_open_files: -1 2023-12-07T16:22:57.253 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.bytes_per_sync: 0 2023-12-07T16:22:57.253 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-07T16:22:57.253 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-07T16:22:57.253 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.compaction_readahead_size: 0 2023-12-07T16:22:57.253 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_background_flushes: -1 2023-12-07T16:22:57.253 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Compression algorithms supported: 2023-12-07T16:22:57.253 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-07T16:22:57.253 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: kZSTD supported: 0 2023-12-07T16:22:57.253 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: kXpressCompression supported: 0 2023-12-07T16:22:57.253 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: kLZ4HCCompression supported: 1 2023-12-07T16:22:57.254 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: kZlibCompression supported: 1 2023-12-07T16:22:57.254 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: kSnappyCompression supported: 1 2023-12-07T16:22:57.254 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: kLZ4Compression supported: 1 2023-12-07T16:22:57.254 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: kBZip2Compression supported: 0 2023-12-07T16:22:57.254 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-07T16:22:57.254 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-07T16:22:57.254 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi152/store.db/MANIFEST-000009 2023-12-07T16:22:57.254 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-07T16:22:57.254 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-07T16:22:57.254 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.merge_operator: 2023-12-07T16:22:57.254 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.compaction_filter: None 2023-12-07T16:22:57.255 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.compaction_filter_factory: None 2023-12-07T16:22:57.255 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.sst_partitioner_factory: None 2023-12-07T16:22:57.255 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-07T16:22:57.255 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-07T16:22:57.255 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55aa092cf700) 2023-12-07T16:22:57.255 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: cache_index_and_filter_blocks: 1 2023-12-07T16:22:57.255 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-07T16:22:57.255 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-07T16:22:57.255 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: pin_top_level_index_and_filter: 1 2023-12-07T16:22:57.255 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: index_type: 0 2023-12-07T16:22:57.255 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: data_block_index_type: 0 2023-12-07T16:22:57.255 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: index_shortening: 1 2023-12-07T16:22:57.256 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-07T16:22:57.256 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: checksum: 4 2023-12-07T16:22:57.256 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: no_block_cache: 0 2023-12-07T16:22:57.256 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache: 0x55aa093251f0 2023-12-07T16:22:57.256 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache_name: BinnedLRUCache 2023-12-07T16:22:57.256 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache_options: 2023-12-07T16:22:57.256 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: capacity : 536870912 2023-12-07T16:22:57.256 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: num_shard_bits : 4 2023-12-07T16:22:57.256 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: strict_capacity_limit : 0 2023-12-07T16:22:57.256 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: high_pri_pool_ratio: 0.000 2023-12-07T16:22:57.256 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache_compressed: (nil) 2023-12-07T16:22:57.256 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: persistent_cache: (nil) 2023-12-07T16:22:57.256 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_size: 4096 2023-12-07T16:22:57.257 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_size_deviation: 10 2023-12-07T16:22:57.257 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_restart_interval: 16 2023-12-07T16:22:57.257 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: index_block_restart_interval: 1 2023-12-07T16:22:57.257 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: metadata_block_size: 4096 2023-12-07T16:22:57.257 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: partition_filters: 0 2023-12-07T16:22:57.257 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: use_delta_encoding: 1 2023-12-07T16:22:57.257 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: filter_policy: bloomfilter 2023-12-07T16:22:57.257 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: whole_key_filtering: 1 2023-12-07T16:22:57.257 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: verify_compression: 0 2023-12-07T16:22:57.257 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: read_amp_bytes_per_bit: 0 2023-12-07T16:22:57.257 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: format_version: 5 2023-12-07T16:22:57.257 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: enable_index_compression: 1 2023-12-07T16:22:57.258 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_align: 0 2023-12-07T16:22:57.258 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: max_auto_readahead_size: 262144 2023-12-07T16:22:57.258 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: prepopulate_block_cache: 0 2023-12-07T16:22:57.258 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: initial_auto_readahead_size: 8192 2023-12-07T16:22:57.258 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: num_file_reads_for_auto_readahead: 2 2023-12-07T16:22:57.258 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.write_buffer_size: 33554432 2023-12-07T16:22:57.258 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_write_buffer_number: 2 2023-12-07T16:22:57.258 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.compression: NoCompression 2023-12-07T16:22:57.258 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.bottommost_compression: Disabled 2023-12-07T16:22:57.258 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.prefix_extractor: nullptr 2023-12-07T16:22:57.258 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-07T16:22:57.259 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.num_levels: 7 2023-12-07T16:22:57.259 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-07T16:22:57.259 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-07T16:22:57.259 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-07T16:22:57.259 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-07T16:22:57.259 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-07T16:22:57.259 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-07T16:22:57.259 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-07T16:22:57.259 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-07T16:22:57.259 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-07T16:22:57.259 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-07T16:22:57.259 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-07T16:22:57.260 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-07T16:22:57.260 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-07T16:22:57.260 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.compression_opts.level: 32767 2023-12-07T16:22:57.260 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.compression_opts.strategy: 0 2023-12-07T16:22:57.260 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-07T16:22:57.260 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-07T16:22:57.260 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-07T16:22:57.260 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-07T16:22:57.260 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.compression_opts.enabled: false 2023-12-07T16:22:57.260 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-07T16:22:57.260 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-07T16:22:57.261 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-07T16:22:57.261 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-07T16:22:57.261 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.target_file_size_base: 67108864 2023-12-07T16:22:57.261 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-07T16:22:57.261 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-07T16:22:57.261 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-07T16:22:57.261 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-07T16:22:57.261 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-07T16:22:57.261 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-07T16:22:57.261 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-07T16:22:57.261 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-07T16:22:57.261 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-07T16:22:57.262 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-07T16:22:57.262 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-07T16:22:57.262 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-07T16:22:57.262 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-07T16:22:57.262 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-07T16:22:57.262 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.arena_block_size: 1048576 2023-12-07T16:22:57.262 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-07T16:22:57.262 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-07T16:22:57.262 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.disable_auto_compactions: 0 2023-12-07T16:22:57.262 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-07T16:22:57.262 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-07T16:22:57.262 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-07T16:22:57.263 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-07T16:22:57.263 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-07T16:22:57.263 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-07T16:22:57.263 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-07T16:22:57.263 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-07T16:22:57.263 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-07T16:22:57.263 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-07T16:22:57.263 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.table_properties_collectors: 2023-12-07T16:22:57.263 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.inplace_update_support: 0 2023-12-07T16:22:57.263 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-07T16:22:57.263 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-07T16:22:57.263 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-07T16:22:57.263 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-07T16:22:57.264 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.bloom_locality: 0 2023-12-07T16:22:57.264 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.max_successive_merges: 0 2023-12-07T16:22:57.264 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-07T16:22:57.264 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.paranoid_file_checks: 0 2023-12-07T16:22:57.264 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.force_consistency_checks: 1 2023-12-07T16:22:57.264 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.report_bg_io_stats: 0 2023-12-07T16:22:57.264 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.ttl: 2592000 2023-12-07T16:22:57.264 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-07T16:22:57.264 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-07T16:22:57.264 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-07T16:22:57.264 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.enable_blob_files: false 2023-12-07T16:22:57.264 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.min_blob_size: 0 2023-12-07T16:22:57.264 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.blob_file_size: 268435456 2023-12-07T16:22:57.265 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-07T16:22:57.265 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-07T16:22:57.265 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-07T16:22:57.265 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-07T16:22:57.265 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-07T16:22:57.265 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.blob_file_starting_level: 0 2023-12-07T16:22:57.265 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-07T16:22:57.265 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 21.sst 2023-12-07T16:22:57.265 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-07T16:22:57.265 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi152/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 23, last_sequence is 9770, log_number is 19,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-07T16:22:57.265 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 19 2023-12-07T16:22:57.265 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 56f1f507-e1ff-4ebe-bba7-c98e4d0f369d 2023-12-07T16:22:57.266 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701966176757654, "job": 1, "event": "recovery_started", "wal_files": [19]} 2023-12-07T16:22:57.266 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #19 mode 2 2023-12-07T16:22:57.266 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701966176770517, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 24, "file_size": 2775796, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 9775, "largest_seqno": 10972, "table_properties": {"data_size": 2770377, "index_size": 3120, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1285, "raw_key_size": 11562, "raw_average_key_size": 23, "raw_value_size": 2759861, "raw_average_value_size": 5643, "num_data_blocks": 144, "num_entries": 489, "num_filter_entries": 489, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1701966176, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "56f1f507-e1ff-4ebe-bba7-c98e4d0f369d", "db_session_id": "EYU6LZKOJAWKDFGCK9V9", "orig_file_number": 24, "seqno_to_time_mapping": "N/A"}} 2023-12-07T16:22:57.266 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701966176770821, "job": 1, "event": "recovery_finished"} 2023-12-07T16:22:57.266 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: [db/version_set.cc:5047] Creating manifest 26 2023-12-07T16:22:57.266 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-07T16:22:57.266 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi152/store.db/000019.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-07T16:22:57.266 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55aa093c0000 2023-12-07T16:22:57.266 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: DB pointer 0x55aa093ac000 2023-12-07T16:22:57.266 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-07T16:22:57.266 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-07T16:22:57.266 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** DB Stats ** 2023-12-07T16:22:57.267 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-07T16:22:57.267 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-07T16:22:57.267 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-07T16:22:57.267 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-07T16:22:57.267 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-07T16:22:57.267 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-07T16:22:57.267 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-07T16:22:57.267 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-07T16:22:57.267 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** Compaction Stats [default] ** 2023-12-07T16:22:57.267 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-07T16:22:57.267 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-07T16:22:57.267 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: L0 1/0 2.65 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 541.5 0.00 0.00 1 0.005 0 0 0.0 0.0 2023-12-07T16:22:57.267 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: L6 1/0 5.95 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-07T16:22:57.268 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Sum 2/0 8.59 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 541.5 0.00 0.00 1 0.005 0 0 0.0 0.0 2023-12-07T16:22:57.268 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 541.5 0.00 0.00 1 0.005 0 0 0.0 0.0 2023-12-07T16:22:57.268 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-07T16:22:57.268 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** Compaction Stats [default] ** 2023-12-07T16:22:57.268 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-07T16:22:57.268 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-07T16:22:57.268 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 541.5 0.00 0.00 1 0.005 0 0 0.0 0.0 2023-12-07T16:22:57.268 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-07T16:22:57.268 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-07T16:22:57.268 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-07T16:22:57.268 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-07T16:22:57.268 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Flush(GB): cumulative 0.003, interval 0.003 2023-12-07T16:22:57.269 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-07T16:22:57.269 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-07T16:22:57.269 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-07T16:22:57.269 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-07T16:22:57.269 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative compaction: 0.00 GB write, 127.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-07T16:22:57.269 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval compaction: 0.00 GB write, 127.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-07T16:22:57.269 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-07T16:22:57.269 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Block cache BinnedLRUCache@0x55aa093251f0#7 capacity: 512.00 MB usage: 4.73 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.5e-05 secs_since: 0 2023-12-07T16:22:57.269 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.41 KB,0.000268221%) IndexBlock(1,3.33 KB,0.000634789%) Misc(1,0.00 KB,0%) 2023-12-07T16:22:57.269 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-07T16:22:57.269 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-07T16:22:57.269 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: starting mon.smithi152 rank 1 at public addrs [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] at bind addrs [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi152 fsid 8c493298-951b-11ee-95a2-87774f69a715 2023-12-07T16:22:57.269 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: mon.smithi152@-1(???) e2 preinit fsid 8c493298-951b-11ee-95a2-87774f69a715 2023-12-07T16:22:57.270 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: mon.smithi152@-1(???).mds e17 new map 2023-12-07T16:22:57.270 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: mon.smithi152@-1(???).mds e17 print_map 2023-12-07T16:22:57.270 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: e17 2023-12-07T16:22:57.270 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-07T16:22:57.270 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:22:57.270 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: legacy client fscid: 1 2023-12-07T16:22:57.270 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-07T16:22:57.270 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Filesystem 'cephfs' (1) 2023-12-07T16:22:57.270 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: fs_name cephfs 2023-12-07T16:22:57.270 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: epoch 17 2023-12-07T16:22:57.270 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-07T16:22:57.270 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: created 2023-12-07T16:19:08.352640+0000 2023-12-07T16:22:57.271 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: modified 2023-12-07T16:22:27.604525+0000 2023-12-07T16:22:57.271 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: tableserver 0 2023-12-07T16:22:57.271 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: root 0 2023-12-07T16:22:57.271 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: session_timeout 60 2023-12-07T16:22:57.271 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: session_autoclose 300 2023-12-07T16:22:57.271 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: max_file_size 1099511627776 2023-12-07T16:22:57.271 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: max_xattr_size 65536 2023-12-07T16:22:57.271 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: required_client_features {} 2023-12-07T16:22:57.271 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: last_failure 0 2023-12-07T16:22:57.271 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: last_failure_osd_epoch 45 2023-12-07T16:22:57.271 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:22:57.271 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: max_mds 2 2023-12-07T16:22:57.271 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: in 0,1 2023-12-07T16:22:57.272 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: up {0=14478,1=24269} 2023-12-07T16:22:57.272 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: failed 2023-12-07T16:22:57.272 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: damaged 2023-12-07T16:22:57.272 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: stopped 2023-12-07T16:22:57.272 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: data_pools [3] 2023-12-07T16:22:57.272 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: metadata_pool 2 2023-12-07T16:22:57.272 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: inline_data enabled 2023-12-07T16:22:57.272 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: balancer 2023-12-07T16:22:57.272 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: bal_rank_mask -1 2023-12-07T16:22:57.272 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: standby_count_wanted 1 2023-12-07T16:22:57.272 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: [mds.cephfs.smithi063.yidolg{0:14478} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:22:57.272 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: [mds.cephfs.smithi152.mrvngf{1:24269} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.152:6824/3157779064,v1:172.21.15.152:6825/3157779064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:22:57.272 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-07T16:22:57.273 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-07T16:22:57.273 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Standby daemons: 2023-12-07T16:22:57.273 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-07T16:22:57.273 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: [mds.cephfs.smithi063.gsjgcq{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/3063200414,v1:172.21.15.63:6827/3063200414] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:22:57.273 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: [mds.cephfs.smithi152.aovwwd{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/2906349729,v1:172.21.15.152:6827/2906349729] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:22:57.273 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: mon.smithi152@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-07T16:22:57.273 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: mon.smithi152@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2023-12-07T16:22:57.273 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: mon.smithi152@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2023-12-07T16:22:57.273 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: mon.smithi152@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2023-12-07T16:22:57.273 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: mon.smithi152@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2023-12-07T16:22:57.273 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:56 smithi152 ceph-mon[175645]: pgmap v8: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 1.4 MiB/s wr, 297 op/s 2023-12-07T16:22:58.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:57 smithi063 ceph-mon[192008]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-07T16:22:58.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:57 smithi063 ceph-mon[192008]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-07T16:22:58.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:57 smithi063 ceph-mon[192008]: fs cephfs has deprecated feature inline_data enabled. 2023-12-07T16:22:58.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:57 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-07T16:22:58.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:57 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:22:58.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:57 smithi063 ceph-mon[192008]: mon.smithi063 calling monitor election 2023-12-07T16:22:58.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:57 smithi063 ceph-mon[192008]: mon.smithi152 calling monitor election 2023-12-07T16:22:58.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:57 smithi063 ceph-mon[192008]: mon.smithi063 is new leader, mons smithi063,smithi152 in quorum (ranks 0,1) 2023-12-07T16:22:58.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:57 smithi063 ceph-mon[192008]: monmap e3: 2 mons at {smithi063=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0],smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-07T16:22:58.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:57 smithi063 ceph-mon[192008]: fsmap cephfs:2 {0=cephfs.smithi063.yidolg=up:active,1=cephfs.smithi152.mrvngf=up:active} 2 up:standby 2023-12-07T16:22:58.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:57 smithi063 ceph-mon[192008]: osdmap e49: 6 total, 6 up, 6 in 2023-12-07T16:22:58.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:57 smithi063 ceph-mon[192008]: mgrmap e37: smithi063.yohyyx(active, since 12s), standbys: smithi152.sxayfb 2023-12-07T16:22:58.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:57 smithi063 ceph-mon[192008]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-07T16:22:58.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:57 smithi063 ceph-mon[192008]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-07T16:22:58.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:57 smithi063 ceph-mon[192008]: fs cephfs has deprecated feature inline_data enabled. 2023-12-07T16:22:58.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:57 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:58.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:57 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:58.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:57 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:22:58.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:57 smithi152 ceph-mon[175645]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-07T16:22:58.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:57 smithi152 ceph-mon[175645]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-07T16:22:58.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:57 smithi152 ceph-mon[175645]: fs cephfs has deprecated feature inline_data enabled. 2023-12-07T16:22:58.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:57 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi063"}]: dispatch 2023-12-07T16:22:58.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:57 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-07T16:22:58.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:57 smithi152 ceph-mon[175645]: mon.smithi063 calling monitor election 2023-12-07T16:22:58.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:57 smithi152 ceph-mon[175645]: mon.smithi152 calling monitor election 2023-12-07T16:22:58.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:57 smithi152 ceph-mon[175645]: mon.smithi063 is new leader, mons smithi063,smithi152 in quorum (ranks 0,1) 2023-12-07T16:22:58.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:57 smithi152 ceph-mon[175645]: monmap e3: 2 mons at {smithi063=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0],smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-07T16:22:58.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:57 smithi152 ceph-mon[175645]: fsmap cephfs:2 {0=cephfs.smithi063.yidolg=up:active,1=cephfs.smithi152.mrvngf=up:active} 2 up:standby 2023-12-07T16:22:58.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:57 smithi152 ceph-mon[175645]: osdmap e49: 6 total, 6 up, 6 in 2023-12-07T16:22:58.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:57 smithi152 ceph-mon[175645]: mgrmap e37: smithi063.yohyyx(active, since 12s), standbys: smithi152.sxayfb 2023-12-07T16:22:58.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:57 smithi152 ceph-mon[175645]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-07T16:22:58.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:57 smithi152 ceph-mon[175645]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-07T16:22:58.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:57 smithi152 ceph-mon[175645]: fs cephfs has deprecated feature inline_data enabled. 2023-12-07T16:22:58.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:57 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:58.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:57 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:22:58.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:57 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:22:59.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:58 smithi063 ceph-mon[192008]: pgmap v10: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 57 KiB/s rd, 1.8 MiB/s wr, 402 op/s 2023-12-07T16:22:59.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:58 smithi152 ceph-mon[175645]: pgmap v10: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 57 KiB/s rd, 1.8 MiB/s wr, 402 op/s 2023-12-07T16:23:00.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:59 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:00.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:59 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:00.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:59 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:23:00.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:59 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:00.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:22:59 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:00.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:59 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:00.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:59 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:00.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:59 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:23:00.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:59 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:00.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:22:59 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:00.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:00 smithi152 ceph-mon[175645]: pgmap v11: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 70 KiB/s rd, 2.5 MiB/s wr, 534 op/s 2023-12-07T16:23:01.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:00 smithi063 ceph-mon[192008]: pgmap v11: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 70 KiB/s rd, 2.5 MiB/s wr, 534 op/s 2023-12-07T16:23:03.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:03 smithi152 ceph-mon[175645]: pgmap v12: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.4 MiB/s wr, 311 op/s 2023-12-07T16:23:03.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:03 smithi063 ceph-mon[192008]: pgmap v12: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.4 MiB/s wr, 311 op/s 2023-12-07T16:23:05.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:05 smithi063 ceph-mon[192008]: pgmap v13: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.4 MiB/s wr, 311 op/s 2023-12-07T16:23:05.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:05 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:05.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:05 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:05.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:05 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:05.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:05 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:23:05.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:05 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:05.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:05 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-07T16:23:05.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:05 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-07T16:23:05.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:05 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:05.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:05 smithi152 ceph-mon[175645]: pgmap v13: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.4 MiB/s wr, 311 op/s 2023-12-07T16:23:05.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:05 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:05.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:05 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:05.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:05 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:05.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:05 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:23:05.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:05 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:05.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:05 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-07T16:23:05.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:05 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-07T16:23:05.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:05 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:06.764 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2023-12-07T16:23:06.765 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-07T16:23:06.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:06 smithi063 ceph-mon[192008]: Reconfiguring mon.smithi063 (monmap changed)... 2023-12-07T16:23:06.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:06 smithi063 ceph-mon[192008]: Reconfiguring daemon mon.smithi063 on smithi063 2023-12-07T16:23:06.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:06 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:06.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:06 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:06.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:06 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi063.yohyyx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-07T16:23:06.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:06 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-07T16:23:06.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:06 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:06.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:06 smithi152 ceph-mon[175645]: Reconfiguring mon.smithi063 (monmap changed)... 2023-12-07T16:23:06.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:06 smithi152 ceph-mon[175645]: Reconfiguring daemon mon.smithi063 on smithi063 2023-12-07T16:23:06.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:06 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:06.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:06 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:06.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:06 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi063.yohyyx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-07T16:23:06.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:06 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-07T16:23:06.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:06 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:07.086 DEBUG:teuthology.parallel:result is None 2023-12-07T16:23:07.087 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-07T16:23:07.130 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-07T16:23:07.130 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2023-12-07T16:23:07.173 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2023-12-07T16:23:07.173 DEBUG:teuthology.parallel:result is None 2023-12-07T16:23:07.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:07 smithi063 ceph-mon[192008]: pgmap v14: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.0 MiB/s wr, 440 op/s 2023-12-07T16:23:07.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:07 smithi063 ceph-mon[192008]: Reconfiguring mgr.smithi063.yohyyx (monmap changed)... 2023-12-07T16:23:07.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:07 smithi063 ceph-mon[192008]: Reconfiguring daemon mgr.smithi063.yohyyx on smithi063 2023-12-07T16:23:07.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:07 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:07.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:07 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:07.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:07 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi063", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-07T16:23:07.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:07 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:07.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:07 smithi152 ceph-mon[175645]: pgmap v14: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.0 MiB/s wr, 440 op/s 2023-12-07T16:23:07.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:07 smithi152 ceph-mon[175645]: Reconfiguring mgr.smithi063.yohyyx (monmap changed)... 2023-12-07T16:23:07.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:07 smithi152 ceph-mon[175645]: Reconfiguring daemon mgr.smithi063.yohyyx on smithi063 2023-12-07T16:23:07.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:07 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:07.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:07 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:07.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:07 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi063", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-07T16:23:07.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:07 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:08.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:08 smithi063 ceph-mon[192008]: Reconfiguring crash.smithi063 (monmap changed)... 2023-12-07T16:23:08.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:08 smithi063 ceph-mon[192008]: Reconfiguring daemon crash.smithi063 on smithi063 2023-12-07T16:23:08.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:08 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:08.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:08 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:08.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:08 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-07T16:23:08.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:08 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:08.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:08 smithi152 ceph-mon[175645]: Reconfiguring crash.smithi063 (monmap changed)... 2023-12-07T16:23:08.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:08 smithi152 ceph-mon[175645]: Reconfiguring daemon crash.smithi063 on smithi063 2023-12-07T16:23:08.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:08 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:08.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:08 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:08.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:08 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-07T16:23:08.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:08 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:09.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:09 smithi063 ceph-mon[192008]: pgmap v15: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.2 MiB/s wr, 261 op/s 2023-12-07T16:23:09.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:09 smithi063 ceph-mon[192008]: Reconfiguring osd.0 (monmap changed)... 2023-12-07T16:23:09.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:09 smithi063 ceph-mon[192008]: Reconfiguring daemon osd.0 on smithi063 2023-12-07T16:23:09.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:09 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:09.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:09 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:09.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:09 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-07T16:23:09.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:09 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:09.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:09 smithi152 ceph-mon[175645]: pgmap v15: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.2 MiB/s wr, 261 op/s 2023-12-07T16:23:09.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:09 smithi152 ceph-mon[175645]: Reconfiguring osd.0 (monmap changed)... 2023-12-07T16:23:09.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:09 smithi152 ceph-mon[175645]: Reconfiguring daemon osd.0 on smithi063 2023-12-07T16:23:09.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:09 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:09.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:09 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:09.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:09 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-07T16:23:09.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:09 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:10.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:10 smithi063 ceph-mon[192008]: Reconfiguring osd.1 (monmap changed)... 2023-12-07T16:23:10.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:10 smithi063 ceph-mon[192008]: Reconfiguring daemon osd.1 on smithi063 2023-12-07T16:23:10.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:10 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:10.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:10 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:10.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:10 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-07T16:23:10.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:10 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:10.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:10 smithi152 ceph-mon[175645]: Reconfiguring osd.1 (monmap changed)... 2023-12-07T16:23:10.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:10 smithi152 ceph-mon[175645]: Reconfiguring daemon osd.1 on smithi063 2023-12-07T16:23:10.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:10 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:10.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:10 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:10.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:10 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-07T16:23:10.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:10 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:11.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:11 smithi063 ceph-mon[192008]: pgmap v16: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.4 MiB/s wr, 337 op/s 2023-12-07T16:23:11.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:11 smithi063 ceph-mon[192008]: Reconfiguring osd.2 (monmap changed)... 2023-12-07T16:23:11.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:11 smithi063 ceph-mon[192008]: Reconfiguring daemon osd.2 on smithi063 2023-12-07T16:23:11.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:11 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:11.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:11 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:11.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:11 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi063.gsjgcq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-07T16:23:11.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:11 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:11.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:11 smithi152 ceph-mon[175645]: pgmap v16: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.4 MiB/s wr, 337 op/s 2023-12-07T16:23:11.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:11 smithi152 ceph-mon[175645]: Reconfiguring osd.2 (monmap changed)... 2023-12-07T16:23:11.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:11 smithi152 ceph-mon[175645]: Reconfiguring daemon osd.2 on smithi063 2023-12-07T16:23:11.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:11 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:11.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:11 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:11.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:11 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi063.gsjgcq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-07T16:23:11.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:11 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:12.883 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:12 smithi063 ceph-mon[192008]: Reconfiguring mds.cephfs.smithi063.gsjgcq (monmap changed)... 2023-12-07T16:23:12.883 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:12 smithi063 ceph-mon[192008]: Reconfiguring daemon mds.cephfs.smithi063.gsjgcq on smithi063 2023-12-07T16:23:12.883 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:12 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:12.883 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:12 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:12.884 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:12 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi063.yidolg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-07T16:23:12.884 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:12 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:12.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:12 smithi152 ceph-mon[175645]: Reconfiguring mds.cephfs.smithi063.gsjgcq (monmap changed)... 2023-12-07T16:23:12.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:12 smithi152 ceph-mon[175645]: Reconfiguring daemon mds.cephfs.smithi063.gsjgcq on smithi063 2023-12-07T16:23:12.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:12 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:12.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:12 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:12.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:12 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi063.yidolg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-07T16:23:12.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:12 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:13.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:13 smithi152 ceph-mon[175645]: pgmap v17: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 818 KiB/s wr, 205 op/s 2023-12-07T16:23:13.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:13 smithi152 ceph-mon[175645]: Reconfiguring mds.cephfs.smithi063.yidolg (monmap changed)... 2023-12-07T16:23:13.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:13 smithi152 ceph-mon[175645]: Reconfiguring daemon mds.cephfs.smithi063.yidolg on smithi063 2023-12-07T16:23:13.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:13 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:13.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:13 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:13.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:13 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-07T16:23:13.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:13 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:14.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:13 smithi063 ceph-mon[192008]: pgmap v17: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 818 KiB/s wr, 205 op/s 2023-12-07T16:23:14.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:13 smithi063 ceph-mon[192008]: Reconfiguring mds.cephfs.smithi063.yidolg (monmap changed)... 2023-12-07T16:23:14.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:13 smithi063 ceph-mon[192008]: Reconfiguring daemon mds.cephfs.smithi063.yidolg on smithi063 2023-12-07T16:23:14.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:13 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:14.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:13 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:14.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:13 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-07T16:23:14.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:13 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:14.839 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:14 smithi152 ceph-mon[175645]: Reconfiguring crash.smithi152 (monmap changed)... 2023-12-07T16:23:14.839 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:14 smithi152 ceph-mon[175645]: Reconfiguring daemon crash.smithi152 on smithi152 2023-12-07T16:23:14.839 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:23:15.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:14 smithi063 ceph-mon[192008]: Reconfiguring crash.smithi152 (monmap changed)... 2023-12-07T16:23:15.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:14 smithi063 ceph-mon[192008]: Reconfiguring daemon crash.smithi152 on smithi152 2023-12-07T16:23:15.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:23:15.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.629+0000 7fca3db33700 1 -- 172.21.15.63:0/117308788 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca380fde00 msgr2=0x7fca380fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:15.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.629+0000 7fca3db33700 1 --2- 172.21.15.63:0/117308788 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca380fde00 0x7fca380fe250 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fca20004940 tx=0x7fca20009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:15.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.629+0000 7fca3db33700 1 -- 172.21.15.63:0/117308788 shutdown_connections 2023-12-07T16:23:15.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.629+0000 7fca3db33700 1 --2- 172.21.15.63:0/117308788 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca380fde00 0x7fca380fe250 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:15.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.629+0000 7fca3db33700 1 --2- 172.21.15.63:0/117308788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca380fcbf0 0x7fca380fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:15.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.629+0000 7fca3db33700 1 -- 172.21.15.63:0/117308788 >> 172.21.15.63:0/117308788 conn(0x7fca380f82d0 msgr2=0x7fca380fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:15.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.629+0000 7fca3db33700 1 -- 172.21.15.63:0/117308788 shutdown_connections 2023-12-07T16:23:15.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.629+0000 7fca3db33700 1 -- 172.21.15.63:0/117308788 wait complete. 2023-12-07T16:23:15.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.629+0000 7fca3db33700 1 Processor -- start 2023-12-07T16:23:15.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.629+0000 7fca3db33700 1 -- start start 2023-12-07T16:23:15.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.630+0000 7fca3db33700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca380fcbf0 0x7fca38071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:15.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.630+0000 7fca3db33700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca380fde00 0x7fca3806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:15.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.630+0000 7fca3db33700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca38070590 con 0x7fca380fcbf0 2023-12-07T16:23:15.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.630+0000 7fca3db33700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca38070700 con 0x7fca380fde00 2023-12-07T16:23:15.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.630+0000 7fca377fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca380fcbf0 0x7fca38071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:15.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.630+0000 7fca377fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca380fcbf0 0x7fca38071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43168/0 (socket says 172.21.15.63:43168) 2023-12-07T16:23:15.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.630+0000 7fca377fe700 1 -- 172.21.15.63:0/4240366102 learned_addr learned my addr 172.21.15.63:0/4240366102 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:23:15.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.630+0000 7fca36ffd700 1 --2- 172.21.15.63:0/4240366102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca380fde00 0x7fca3806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:15.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.630+0000 7fca377fe700 1 -- 172.21.15.63:0/4240366102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca380fde00 msgr2=0x7fca3806ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:15.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.630+0000 7fca377fe700 1 --2- 172.21.15.63:0/4240366102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca380fde00 0x7fca3806ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:15.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.630+0000 7fca377fe700 1 -- 172.21.15.63:0/4240366102 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca20005040 con 0x7fca380fcbf0 2023-12-07T16:23:15.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.630+0000 7fca377fe700 1 --2- 172.21.15.63:0/4240366102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca380fcbf0 0x7fca38071b10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fca2800c8e0 tx=0x7fca280044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:15.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.630+0000 7fca2ffff700 1 -- 172.21.15.63:0/4240366102 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca2800a760 con 0x7fca380fcbf0 2023-12-07T16:23:15.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.631+0000 7fca2ffff700 1 -- 172.21.15.63:0/4240366102 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fca2800ad70 con 0x7fca380fcbf0 2023-12-07T16:23:15.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.631+0000 7fca3db33700 1 -- 172.21.15.63:0/4240366102 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca380709e0 con 0x7fca380fcbf0 2023-12-07T16:23:15.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.631+0000 7fca2ffff700 1 -- 172.21.15.63:0/4240366102 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca280113a0 con 0x7fca380fcbf0 2023-12-07T16:23:15.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.631+0000 7fca3db33700 1 -- 172.21.15.63:0/4240366102 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca38115570 con 0x7fca380fcbf0 2023-12-07T16:23:15.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.632+0000 7fca3db33700 1 -- 172.21.15.63:0/4240366102 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca3804bb80 con 0x7fca380fcbf0 2023-12-07T16:23:15.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.632+0000 7fca2ffff700 1 -- 172.21.15.63:0/4240366102 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fca28012400 con 0x7fca380fcbf0 2023-12-07T16:23:15.630 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.633+0000 7fca2ffff700 1 --2- 172.21.15.63:0/4240366102 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fca2406cf80 0x7fca2406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:15.630 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.633+0000 7fca36ffd700 1 --2- 172.21.15.63:0/4240366102 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fca2406cf80 0x7fca2406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:15.630 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.633+0000 7fca2ffff700 1 -- 172.21.15.63:0/4240366102 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fca2808c390 con 0x7fca380fcbf0 2023-12-07T16:23:15.630 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.633+0000 7fca36ffd700 1 --2- 172.21.15.63:0/4240366102 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fca2406cf80 0x7fca2406f430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fca20004890 tx=0x7fca20009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:15.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.638+0000 7fca2ffff700 1 -- 172.21.15.63:0/4240366102 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fca28059cb0 con 0x7fca380fcbf0 2023-12-07T16:23:15.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.858+0000 7fca3db33700 1 -- 172.21.15.63:0/4240366102 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fca38102750 con 0x7fca2406cf80 2023-12-07T16:23:15.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.859+0000 7fca2ffff700 1 -- 172.21.15.63:0/4240366102 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fca38102750 con 0x7fca2406cf80 2023-12-07T16:23:15.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.862+0000 7fca3db33700 1 -- 172.21.15.63:0/4240366102 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fca2406cf80 msgr2=0x7fca2406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:15.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.862+0000 7fca3db33700 1 --2- 172.21.15.63:0/4240366102 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fca2406cf80 0x7fca2406f430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fca20004890 tx=0x7fca20009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:15.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.862+0000 7fca3db33700 1 -- 172.21.15.63:0/4240366102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca380fcbf0 msgr2=0x7fca38071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:15.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.862+0000 7fca3db33700 1 --2- 172.21.15.63:0/4240366102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca380fcbf0 0x7fca38071b10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fca2800c8e0 tx=0x7fca280044c0 comp rx=0 tx=0).stop 2023-12-07T16:23:15.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.862+0000 7fca3db33700 1 -- 172.21.15.63:0/4240366102 shutdown_connections 2023-12-07T16:23:15.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.862+0000 7fca3db33700 1 --2- 172.21.15.63:0/4240366102 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fca2406cf80 0x7fca2406f430 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:15.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.862+0000 7fca3db33700 1 --2- 172.21.15.63:0/4240366102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca380fcbf0 0x7fca38071b10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:15.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.862+0000 7fca3db33700 1 --2- 172.21.15.63:0/4240366102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca380fde00 0x7fca3806ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:15.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.862+0000 7fca3db33700 1 -- 172.21.15.63:0/4240366102 >> 172.21.15.63:0/4240366102 conn(0x7fca380f82d0 msgr2=0x7fca38101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:15.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.862+0000 7fca3db33700 1 -- 172.21.15.63:0/4240366102 shutdown_connections 2023-12-07T16:23:15.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.862+0000 7fca3db33700 1 -- 172.21.15.63:0/4240366102 wait complete. 2023-12-07T16:23:15.870 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-07T16:23:15.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.968+0000 7f5c11005700 1 -- 172.21.15.63:0/2827137030 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c0c0fbaf0 msgr2=0x7f5c0c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:15.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.968+0000 7f5c11005700 1 --2- 172.21.15.63:0/2827137030 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c0c0fbaf0 0x7f5c0c0fbf00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc004940 tx=0x7f5bfc009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:15.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.968+0000 7f5c11005700 1 -- 172.21.15.63:0/2827137030 shutdown_connections 2023-12-07T16:23:15.966 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.968+0000 7f5c11005700 1 --2- 172.21.15.63:0/2827137030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c0c0fcd00 0x7f5c0c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:15.966 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.968+0000 7f5c11005700 1 --2- 172.21.15.63:0/2827137030 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c0c0fbaf0 0x7f5c0c0fbf00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:15.966 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.968+0000 7f5c11005700 1 -- 172.21.15.63:0/2827137030 >> 172.21.15.63:0/2827137030 conn(0x7f5c0c0f7190 msgr2=0x7f5c0c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:15.966 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.968+0000 7f5c11005700 1 -- 172.21.15.63:0/2827137030 shutdown_connections 2023-12-07T16:23:15.966 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.968+0000 7f5c11005700 1 -- 172.21.15.63:0/2827137030 wait complete. 2023-12-07T16:23:15.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.969+0000 7f5c11005700 1 Processor -- start 2023-12-07T16:23:15.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.969+0000 7f5c11005700 1 -- start start 2023-12-07T16:23:15.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.969+0000 7f5c11005700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c0c0fbaf0 0x7f5c0c10d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:15.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.969+0000 7f5c11005700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c0c0fcd00 0x7f5c0c10dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:15.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.969+0000 7f5c11005700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c10e0c0 con 0x7f5c0c0fbaf0 2023-12-07T16:23:15.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.969+0000 7f5c11005700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c10e960 con 0x7f5c0c0fcd00 2023-12-07T16:23:15.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.969+0000 7f5c0ad9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c0c0fbaf0 0x7f5c0c10d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:15.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.969+0000 7f5c0ad9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c0c0fbaf0 0x7f5c0c10d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43194/0 (socket says 172.21.15.63:43194) 2023-12-07T16:23:15.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.969+0000 7f5c0ad9d700 1 -- 172.21.15.63:0/2428805675 learned_addr learned my addr 172.21.15.63:0/2428805675 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:23:15.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.969+0000 7f5c0a59c700 1 --2- 172.21.15.63:0/2428805675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c0c0fcd00 0x7f5c0c10dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:15.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.969+0000 7f5c0ad9d700 1 -- 172.21.15.63:0/2428805675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c0c0fcd00 msgr2=0x7f5c0c10dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:15.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.969+0000 7f5c0ad9d700 1 --2- 172.21.15.63:0/2428805675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c0c0fcd00 0x7f5c0c10dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:15.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.969+0000 7f5c0ad9d700 1 -- 172.21.15.63:0/2428805675 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bfc005040 con 0x7f5c0c0fbaf0 2023-12-07T16:23:15.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.970+0000 7f5c0ad9d700 1 --2- 172.21.15.63:0/2428805675 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c0c0fbaf0 0x7f5c0c10d580 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc004f90 tx=0x7f5bfc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:15.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.970+0000 7f5c037fe700 1 -- 172.21.15.63:0/2428805675 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bfc00e040 con 0x7f5c0c0fbaf0 2023-12-07T16:23:15.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.970+0000 7f5c037fe700 1 -- 172.21.15.63:0/2428805675 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5bfc00bc50 con 0x7f5c0c0fbaf0 2023-12-07T16:23:15.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.970+0000 7f5c11005700 1 -- 172.21.15.63:0/2428805675 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0c10ebe0 con 0x7f5c0c0fbaf0 2023-12-07T16:23:15.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.970+0000 7f5c037fe700 1 -- 172.21.15.63:0/2428805675 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bfc01c630 con 0x7f5c0c0fbaf0 2023-12-07T16:23:15.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.970+0000 7f5c11005700 1 -- 172.21.15.63:0/2428805675 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c0c10f120 con 0x7f5c0c0fbaf0 2023-12-07T16:23:15.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.971+0000 7f5c11005700 1 -- 172.21.15.63:0/2428805675 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c0c04bb80 con 0x7f5c0c0fbaf0 2023-12-07T16:23:15.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.971+0000 7f5c037fe700 1 -- 172.21.15.63:0/2428805675 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f5bfc013420 con 0x7f5c0c0fbaf0 2023-12-07T16:23:15.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.972+0000 7f5c037fe700 1 --2- 172.21.15.63:0/2428805675 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f5bf806cf80 0x7f5bf806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:15.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.972+0000 7f5c037fe700 1 -- 172.21.15.63:0/2428805675 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f5bfc08d890 con 0x7f5c0c0fbaf0 2023-12-07T16:23:15.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.972+0000 7f5c0a59c700 1 --2- 172.21.15.63:0/2428805675 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f5bf806cf80 0x7f5bf806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:15.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.972+0000 7f5c0a59c700 1 --2- 172.21.15.63:0/2428805675 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f5bf806cf80 0x7f5bf806f430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4004f40 tx=0x7f5bf400b040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:15.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:15.977+0000 7f5c037fe700 1 -- 172.21.15.63:0/2428805675 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5bfc05b0a0 con 0x7f5c0c0fbaf0 2023-12-07T16:23:15.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:15 smithi152 ceph-mon[175645]: pgmap v18: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 818 KiB/s wr, 205 op/s 2023-12-07T16:23:15.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:15 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:15.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:15 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:15.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:15 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.sxayfb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-07T16:23:15.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:15 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-07T16:23:15.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:15 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:16.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:15 smithi063 ceph-mon[192008]: pgmap v18: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 818 KiB/s wr, 205 op/s 2023-12-07T16:23:16.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:15 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:16.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:15 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:16.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:15 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.sxayfb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-07T16:23:16.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:15 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-07T16:23:16.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:15 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:16.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.197+0000 7f5c11005700 1 -- 172.21.15.63:0/2428805675 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c0c10f590 con 0x7f5bf806cf80 2023-12-07T16:23:16.196 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.199+0000 7f5c037fe700 1 -- 172.21.15.63:0/2428805675 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f5c0c10f590 con 0x7f5bf806cf80 2023-12-07T16:23:16.198 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.201+0000 7f5c11005700 1 -- 172.21.15.63:0/2428805675 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f5bf806cf80 msgr2=0x7f5bf806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:16.198 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.201+0000 7f5c11005700 1 --2- 172.21.15.63:0/2428805675 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f5bf806cf80 0x7f5bf806f430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4004f40 tx=0x7f5bf400b040 comp rx=0 tx=0).stop 2023-12-07T16:23:16.198 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.201+0000 7f5c11005700 1 -- 172.21.15.63:0/2428805675 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c0c0fbaf0 msgr2=0x7f5c0c10d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:16.198 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.201+0000 7f5c11005700 1 --2- 172.21.15.63:0/2428805675 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c0c0fbaf0 0x7f5c0c10d580 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc004f90 tx=0x7f5bfc009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:16.198 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.201+0000 7f5c11005700 1 -- 172.21.15.63:0/2428805675 shutdown_connections 2023-12-07T16:23:16.198 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.201+0000 7f5c11005700 1 --2- 172.21.15.63:0/2428805675 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f5bf806cf80 0x7f5bf806f430 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:16.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.201+0000 7f5c11005700 1 --2- 172.21.15.63:0/2428805675 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c0c0fbaf0 0x7f5c0c10d580 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:16.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.201+0000 7f5c11005700 1 --2- 172.21.15.63:0/2428805675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c0c0fcd00 0x7f5c0c10dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:16.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.201+0000 7f5c11005700 1 -- 172.21.15.63:0/2428805675 >> 172.21.15.63:0/2428805675 conn(0x7f5c0c0f7190 msgr2=0x7f5c0c065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:16.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.201+0000 7f5c11005700 1 -- 172.21.15.63:0/2428805675 shutdown_connections 2023-12-07T16:23:16.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.201+0000 7f5c11005700 1 -- 172.21.15.63:0/2428805675 wait complete. 2023-12-07T16:23:16.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.305+0000 7f94b5432700 1 -- 172.21.15.63:0/987623265 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94b0100050 msgr2=0x7f94b0102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:16.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.305+0000 7f94b5432700 1 --2- 172.21.15.63:0/987623265 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94b0100050 0x7f94b0102430 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f94a4004940 tx=0x7f94a4009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:16.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.305+0000 7f94b5432700 1 -- 172.21.15.63:0/987623265 shutdown_connections 2023-12-07T16:23:16.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.305+0000 7f94b5432700 1 --2- 172.21.15.63:0/987623265 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94b0100050 0x7f94b0102430 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:16.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.305+0000 7f94b5432700 1 --2- 172.21.15.63:0/987623265 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94b00fd730 0x7f94b00ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:16.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.305+0000 7f94b5432700 1 -- 172.21.15.63:0/987623265 >> 172.21.15.63:0/987623265 conn(0x7f94b00f71d0 msgr2=0x7f94b00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:16.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.305+0000 7f94b5432700 1 -- 172.21.15.63:0/987623265 shutdown_connections 2023-12-07T16:23:16.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.306+0000 7f94b5432700 1 -- 172.21.15.63:0/987623265 wait complete. 2023-12-07T16:23:16.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.306+0000 7f94b5432700 1 Processor -- start 2023-12-07T16:23:16.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.306+0000 7f94b5432700 1 -- start start 2023-12-07T16:23:16.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.307+0000 7f94b5432700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94b00fd730 0x7f94b010d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:16.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.307+0000 7f94b5432700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94b0100050 0x7f94b010d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:16.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.307+0000 7f94b5432700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b010dfd0 con 0x7f94b00fd730 2023-12-07T16:23:16.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.307+0000 7f94b5432700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b010e870 con 0x7f94b0100050 2023-12-07T16:23:16.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.307+0000 7f94aeffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94b00fd730 0x7f94b010d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:16.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.307+0000 7f94aeffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94b00fd730 0x7f94b010d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43212/0 (socket says 172.21.15.63:43212) 2023-12-07T16:23:16.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.307+0000 7f94aeffd700 1 -- 172.21.15.63:0/1721385229 learned_addr learned my addr 172.21.15.63:0/1721385229 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:23:16.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.307+0000 7f94ae7fc700 1 --2- 172.21.15.63:0/1721385229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94b0100050 0x7f94b010d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:16.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.307+0000 7f94aeffd700 1 -- 172.21.15.63:0/1721385229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94b0100050 msgr2=0x7f94b010d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:16.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.307+0000 7f94aeffd700 1 --2- 172.21.15.63:0/1721385229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94b0100050 0x7f94b010d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:16.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.307+0000 7f94aeffd700 1 -- 172.21.15.63:0/1721385229 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a4005040 con 0x7f94b00fd730 2023-12-07T16:23:16.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.307+0000 7f94aeffd700 1 --2- 172.21.15.63:0/1721385229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94b00fd730 0x7f94b010d490 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f94a000eb40 tx=0x7f94a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:16.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.307+0000 7f94977fe700 1 -- 172.21.15.63:0/1721385229 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94a0007cc0 con 0x7f94b00fd730 2023-12-07T16:23:16.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.307+0000 7f94b5432700 1 -- 172.21.15.63:0/1721385229 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b010eaf0 con 0x7f94b00fd730 2023-12-07T16:23:16.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.307+0000 7f94977fe700 1 -- 172.21.15.63:0/1721385229 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f94a000f040 con 0x7f94b00fd730 2023-12-07T16:23:16.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.307+0000 7f94977fe700 1 -- 172.21.15.63:0/1721385229 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94a000c990 con 0x7f94b00fd730 2023-12-07T16:23:16.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.307+0000 7f94b5432700 1 -- 172.21.15.63:0/1721385229 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b010f030 con 0x7f94b00fd730 2023-12-07T16:23:16.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.309+0000 7f94b5432700 1 -- 172.21.15.63:0/1721385229 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b004bb80 con 0x7f94b00fd730 2023-12-07T16:23:16.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.309+0000 7f94977fe700 1 -- 172.21.15.63:0/1721385229 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f94a000cc00 con 0x7f94b00fd730 2023-12-07T16:23:16.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.309+0000 7f94977fe700 1 --2- 172.21.15.63:0/1721385229 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f949806cf80 0x7f949806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:16.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.309+0000 7f94977fe700 1 -- 172.21.15.63:0/1721385229 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f94a008c1d0 con 0x7f94b00fd730 2023-12-07T16:23:16.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.309+0000 7f94ae7fc700 1 --2- 172.21.15.63:0/1721385229 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f949806cf80 0x7f949806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:16.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.310+0000 7f94ae7fc700 1 --2- 172.21.15.63:0/1721385229 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f949806cf80 0x7f949806f430 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f94a4000c00 tx=0x7f94a4009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:16.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.314+0000 7f94977fe700 1 -- 172.21.15.63:0/1721385229 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f94a0059970 con 0x7f94b00fd730 2023-12-07T16:23:16.522 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.525+0000 7f94b5432700 1 -- 172.21.15.63:0/1721385229 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f94b010f450 con 0x7f949806cf80 2023-12-07T16:23:16.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.535+0000 7f94977fe700 1 -- 172.21.15.63:0/1721385229 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f94b010f450 con 0x7f949806cf80 2023-12-07T16:23:16.532 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-07T16:23:16.533 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (2m) 28s ago 7m 25.8M - 0.25.0 c8568f914cd2 c0526812d5fe 2023-12-07T16:23:16.533 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (8m) 28s ago 8m 7428k - 17.2.7-115-g4f62d9ad fcdfd00f81c7 80bed1094ab4 2023-12-07T16:23:16.533 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi152 smithi152 running (7m) 17s ago 7m 7499k - 17.2.7-115-g4f62d9ad fcdfd00f81c7 e2cd5532384b 2023-12-07T16:23:16.533 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (2m) 28s ago 7m 85.7M - 9.4.7 954c08fa6188 cc2cde9a664f 2023-12-07T16:23:16.533 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.gsjgcq smithi063 running (4m) 28s ago 4m 14.2M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 f70e4f098e4c 2023-12-07T16:23:16.533 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.yidolg smithi063 running (4m) 28s ago 4m 5425M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5b053ef5fb7f 2023-12-07T16:23:16.533 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.aovwwd smithi152 running (4m) 17s ago 4m 15.4M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 80190948a595 2023-12-07T16:23:16.533 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.mrvngf smithi152 running (4m) 17s ago 4m 4728M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5f60b893f840 2023-12-07T16:23:16.533 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.yohyyx smithi063 *:8443,9283,8765 running (90s) 28s ago 9m 476M - 19.0.0-13-ge6605fb8 104f332cd0a9 b605f882784d 2023-12-07T16:23:16.533 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi152.sxayfb smithi152 *:8443,9283,8765 running (56s) 17s ago 7m 449M - 19.0.0-13-ge6605fb8 104f332cd0a9 71716998ccc3 2023-12-07T16:23:16.533 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (44s) 28s ago 9m 32.4M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 8d7d0c6bfea3 2023-12-07T16:23:16.533 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi152 smithi152 running (20s) 17s ago 7m 25.8M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 883bb3425cf0 2023-12-07T16:23:16.533 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (2m) 28s ago 8m 17.8M - 1.5.0 0da6a335fe13 50d63981f746 2023-12-07T16:23:16.534 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi152 smithi152 *:9100 running (100s) 17s ago 7m 19.5M - 1.5.0 0da6a335fe13 627cda14f1a9 2023-12-07T16:23:16.534 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (6m) 28s ago 6m 664M 1568M 17.2.7-115-g4f62d9ad fcdfd00f81c7 bbdd7f82a7c3 2023-12-07T16:23:16.534 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (6m) 28s ago 6m 739M 1568M 17.2.7-115-g4f62d9ad fcdfd00f81c7 4372601f899e 2023-12-07T16:23:16.534 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (5m) 28s ago 5m 562M 1568M 17.2.7-115-g4f62d9ad fcdfd00f81c7 b0d432bbca05 2023-12-07T16:23:16.534 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi152 running (5m) 17s ago 5m 941M 2592M 17.2.7-115-g4f62d9ad fcdfd00f81c7 94d14402b489 2023-12-07T16:23:16.534 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi152 running (5m) 17s ago 5m 729M 2592M 17.2.7-115-g4f62d9ad fcdfd00f81c7 d3b8b2f12489 2023-12-07T16:23:16.534 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi152 running (5m) 17s ago 5m 819M 2592M 17.2.7-115-g4f62d9ad fcdfd00f81c7 e7f8d9f716bb 2023-12-07T16:23:16.534 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (63s) 28s ago 7m 50.4M - 2.43.0 a07b618ecd1d 8a323520d9fd 2023-12-07T16:23:16.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.537+0000 7f94b5432700 1 -- 172.21.15.63:0/1721385229 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f949806cf80 msgr2=0x7f949806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:16.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.537+0000 7f94b5432700 1 --2- 172.21.15.63:0/1721385229 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f949806cf80 0x7f949806f430 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f94a4000c00 tx=0x7f94a4009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:16.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.537+0000 7f94b5432700 1 -- 172.21.15.63:0/1721385229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94b00fd730 msgr2=0x7f94b010d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:16.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.537+0000 7f94b5432700 1 --2- 172.21.15.63:0/1721385229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94b00fd730 0x7f94b010d490 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f94a000eb40 tx=0x7f94a000b040 comp rx=0 tx=0).stop 2023-12-07T16:23:16.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.537+0000 7f94b5432700 1 -- 172.21.15.63:0/1721385229 shutdown_connections 2023-12-07T16:23:16.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.537+0000 7f94b5432700 1 --2- 172.21.15.63:0/1721385229 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f949806cf80 0x7f949806f430 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:16.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.537+0000 7f94b5432700 1 --2- 172.21.15.63:0/1721385229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94b00fd730 0x7f94b010d490 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:16.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.537+0000 7f94b5432700 1 --2- 172.21.15.63:0/1721385229 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94b0100050 0x7f94b010d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:16.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.537+0000 7f94b5432700 1 -- 172.21.15.63:0/1721385229 >> 172.21.15.63:0/1721385229 conn(0x7f94b00f71d0 msgr2=0x7f94b00f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:16.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.537+0000 7f94b5432700 1 -- 172.21.15.63:0/1721385229 shutdown_connections 2023-12-07T16:23:16.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.537+0000 7f94b5432700 1 -- 172.21.15.63:0/1721385229 wait complete. 2023-12-07T16:23:16.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.640+0000 7fae4d248700 1 -- 172.21.15.63:0/1523484683 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae480fde00 msgr2=0x7fae480fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:16.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.640+0000 7fae4d248700 1 --2- 172.21.15.63:0/1523484683 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae480fde00 0x7fae480fe250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fae30004940 tx=0x7fae30009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:16.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.640+0000 7fae4d248700 1 -- 172.21.15.63:0/1523484683 shutdown_connections 2023-12-07T16:23:16.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.640+0000 7fae4d248700 1 --2- 172.21.15.63:0/1523484683 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae480fde00 0x7fae480fe250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:16.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.640+0000 7fae4d248700 1 --2- 172.21.15.63:0/1523484683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae480fcbf0 0x7fae480fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:16.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.640+0000 7fae4d248700 1 -- 172.21.15.63:0/1523484683 >> 172.21.15.63:0/1523484683 conn(0x7fae480f82d0 msgr2=0x7fae480fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:16.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.640+0000 7fae4d248700 1 -- 172.21.15.63:0/1523484683 shutdown_connections 2023-12-07T16:23:16.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.640+0000 7fae4d248700 1 -- 172.21.15.63:0/1523484683 wait complete. 2023-12-07T16:23:16.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.640+0000 7fae4d248700 1 Processor -- start 2023-12-07T16:23:16.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.641+0000 7fae4d248700 1 -- start start 2023-12-07T16:23:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.641+0000 7fae4d248700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae480fcbf0 0x7fae4810d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.641+0000 7fae4d248700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae480fde00 0x7fae4810dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.641+0000 7fae4d248700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4810e0c0 con 0x7fae480fcbf0 2023-12-07T16:23:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.641+0000 7fae4d248700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4810e960 con 0x7fae480fde00 2023-12-07T16:23:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.641+0000 7fae46d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae480fcbf0 0x7fae4810d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.641+0000 7fae46d9d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae480fcbf0 0x7fae4810d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43238/0 (socket says 172.21.15.63:43238) 2023-12-07T16:23:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.641+0000 7fae46d9d700 1 -- 172.21.15.63:0/3104734196 learned_addr learned my addr 172.21.15.63:0/3104734196 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:23:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.641+0000 7fae4659c700 1 --2- 172.21.15.63:0/3104734196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae480fde00 0x7fae4810dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.641+0000 7fae46d9d700 1 -- 172.21.15.63:0/3104734196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae480fde00 msgr2=0x7fae4810dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.641+0000 7fae46d9d700 1 --2- 172.21.15.63:0/3104734196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae480fde00 0x7fae4810dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.641+0000 7fae46d9d700 1 -- 172.21.15.63:0/3104734196 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae30005040 con 0x7fae480fcbf0 2023-12-07T16:23:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.641+0000 7fae46d9d700 1 --2- 172.21.15.63:0/3104734196 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae480fcbf0 0x7fae4810d580 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fae38002a80 tx=0x7fae38004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.641+0000 7fae3f7fe700 1 -- 172.21.15.63:0/3104734196 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae38007cc0 con 0x7fae480fcbf0 2023-12-07T16:23:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.641+0000 7fae3f7fe700 1 -- 172.21.15.63:0/3104734196 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fae3800f040 con 0x7fae480fcbf0 2023-12-07T16:23:16.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.641+0000 7fae4d248700 1 -- 172.21.15.63:0/3104734196 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4810ec40 con 0x7fae480fcbf0 2023-12-07T16:23:16.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.642+0000 7fae3f7fe700 1 -- 172.21.15.63:0/3104734196 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae3800d9c0 con 0x7fae480fcbf0 2023-12-07T16:23:16.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.642+0000 7fae4d248700 1 -- 172.21.15.63:0/3104734196 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4810f180 con 0x7fae480fcbf0 2023-12-07T16:23:16.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.642+0000 7fae4d248700 1 -- 172.21.15.63:0/3104734196 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae4804bb80 con 0x7fae480fcbf0 2023-12-07T16:23:16.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.643+0000 7fae3f7fe700 1 -- 172.21.15.63:0/3104734196 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fae3800db20 con 0x7fae480fcbf0 2023-12-07T16:23:16.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.643+0000 7fae3f7fe700 1 --2- 172.21.15.63:0/3104734196 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fae3406cf80 0x7fae3406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:16.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.643+0000 7fae3f7fe700 1 -- 172.21.15.63:0/3104734196 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fae3808c200 con 0x7fae480fcbf0 2023-12-07T16:23:16.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.643+0000 7fae4659c700 1 --2- 172.21.15.63:0/3104734196 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fae3406cf80 0x7fae3406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:16.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.644+0000 7fae4659c700 1 --2- 172.21.15.63:0/3104734196 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fae3406cf80 0x7fae3406f430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fae300043d0 tx=0x7fae30009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:16.645 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.648+0000 7fae3f7fe700 1 -- 172.21.15.63:0/3104734196 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fae38059970 con 0x7fae480fcbf0 2023-12-07T16:23:16.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.931+0000 7fae4d248700 1 -- 172.21.15.63:0/3104734196 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fae4810f510 con 0x7fae480fcbf0 2023-12-07T16:23:16.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.932+0000 7fae3f7fe700 1 -- 172.21.15.63:0/3104734196 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+727 (secure 0 0 0) 0x7fae38059500 con 0x7fae480fcbf0 2023-12-07T16:23:16.929 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:23:16.929 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-07T16:23:16.929 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-07T16:23:16.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:23:16.929 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-07T16:23:16.929 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-07T16:23:16.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:23:16.930 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-07T16:23:16.930 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 6 2023-12-07T16:23:16.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:23:16.930 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-07T16:23:16.930 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 4 2023-12-07T16:23:16.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:23:16.930 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-07T16:23:16.930 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 10, 2023-12-07T16:23:16.930 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 4 2023-12-07T16:23:16.930 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-07T16:23:16.930 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:23:16.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.934+0000 7fae4d248700 1 -- 172.21.15.63:0/3104734196 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fae3406cf80 msgr2=0x7fae3406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:16.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.934+0000 7fae4d248700 1 --2- 172.21.15.63:0/3104734196 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fae3406cf80 0x7fae3406f430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fae300043d0 tx=0x7fae30009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:16.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.934+0000 7fae4d248700 1 -- 172.21.15.63:0/3104734196 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae480fcbf0 msgr2=0x7fae4810d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:16.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.934+0000 7fae4d248700 1 --2- 172.21.15.63:0/3104734196 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae480fcbf0 0x7fae4810d580 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fae38002a80 tx=0x7fae38004600 comp rx=0 tx=0).stop 2023-12-07T16:23:16.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.934+0000 7fae4d248700 1 -- 172.21.15.63:0/3104734196 shutdown_connections 2023-12-07T16:23:16.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.934+0000 7fae4d248700 1 --2- 172.21.15.63:0/3104734196 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fae3406cf80 0x7fae3406f430 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:16.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.934+0000 7fae4d248700 1 --2- 172.21.15.63:0/3104734196 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae480fcbf0 0x7fae4810d580 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:16.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.934+0000 7fae4d248700 1 --2- 172.21.15.63:0/3104734196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae480fde00 0x7fae4810dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:16.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.934+0000 7fae4d248700 1 -- 172.21.15.63:0/3104734196 >> 172.21.15.63:0/3104734196 conn(0x7fae480f82d0 msgr2=0x7fae48101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:16.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.934+0000 7fae4d248700 1 -- 172.21.15.63:0/3104734196 shutdown_connections 2023-12-07T16:23:16.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:16.934+0000 7fae4d248700 1 -- 172.21.15.63:0/3104734196 wait complete. 2023-12-07T16:23:16.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:16 smithi152 ceph-mon[175645]: Reconfiguring mgr.smithi152.sxayfb (monmap changed)... 2023-12-07T16:23:16.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:16 smithi152 ceph-mon[175645]: Reconfiguring daemon mgr.smithi152.sxayfb on smithi152 2023-12-07T16:23:16.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:16 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:16.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:16 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:16.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:16 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-07T16:23:16.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:16 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-07T16:23:16.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:16 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:17.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.039+0000 7f99ca966700 1 -- 172.21.15.63:0/181433483 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99c40fbaf0 msgr2=0x7f99c40fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:17.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.039+0000 7f99ca966700 1 --2- 172.21.15.63:0/181433483 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99c40fbaf0 0x7f99c40fbf00 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f99b4004880 tx=0x7f99b4009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:17.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.039+0000 7f99ca966700 1 -- 172.21.15.63:0/181433483 shutdown_connections 2023-12-07T16:23:17.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.039+0000 7f99ca966700 1 --2- 172.21.15.63:0/181433483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99c40fcd00 0x7f99c40fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:17.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.039+0000 7f99ca966700 1 --2- 172.21.15.63:0/181433483 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99c40fbaf0 0x7f99c40fbf00 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:17.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.039+0000 7f99ca966700 1 -- 172.21.15.63:0/181433483 >> 172.21.15.63:0/181433483 conn(0x7f99c40f7190 msgr2=0x7f99c40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:17.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.039+0000 7f99ca966700 1 -- 172.21.15.63:0/181433483 shutdown_connections 2023-12-07T16:23:17.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.039+0000 7f99ca966700 1 -- 172.21.15.63:0/181433483 wait complete. 2023-12-07T16:23:17.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.040+0000 7f99ca966700 1 Processor -- start 2023-12-07T16:23:17.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.040+0000 7f99ca966700 1 -- start start 2023-12-07T16:23:17.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.040+0000 7f99ca966700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99c40fbaf0 0x7f99c4110210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:17.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.040+0000 7f99ca966700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99c40fcd00 0x7f99c4112760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:17.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.040+0000 7f99ca966700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c4066110 con 0x7f99c40fbaf0 2023-12-07T16:23:17.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.040+0000 7f99ca966700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c4066250 con 0x7f99c40fcd00 2023-12-07T16:23:17.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.040+0000 7f99c3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99c40fbaf0 0x7f99c4110210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:17.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.040+0000 7f99c3fff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99c40fbaf0 0x7f99c4110210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43260/0 (socket says 172.21.15.63:43260) 2023-12-07T16:23:17.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.040+0000 7f99c3fff700 1 -- 172.21.15.63:0/1815805128 learned_addr learned my addr 172.21.15.63:0/1815805128 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:23:17.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.041+0000 7f99c37fe700 1 --2- 172.21.15.63:0/1815805128 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99c40fcd00 0x7f99c4112760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:17.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.041+0000 7f99c3fff700 1 -- 172.21.15.63:0/1815805128 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99c40fcd00 msgr2=0x7f99c4112760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:17.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.041+0000 7f99c3fff700 1 --2- 172.21.15.63:0/1815805128 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99c40fcd00 0x7f99c4112760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:17.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.041+0000 7f99c3fff700 1 -- 172.21.15.63:0/1815805128 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b8005040 con 0x7f99c40fbaf0 2023-12-07T16:23:17.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.041+0000 7f99c3fff700 1 --2- 172.21.15.63:0/1815805128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99c40fbaf0 0x7f99c4110210 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f99b40040d0 tx=0x7f99b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:17.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.041+0000 7f99c0ff9700 1 -- 172.21.15.63:0/1815805128 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99b400e030 con 0x7f99c40fbaf0 2023-12-07T16:23:17.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.041+0000 7f99c0ff9700 1 -- 172.21.15.63:0/1815805128 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f99b401c400 con 0x7f99c40fbaf0 2023-12-07T16:23:17.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.041+0000 7f99ca966700 1 -- 172.21.15.63:0/1815805128 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b4005040 con 0x7f99c40fbaf0 2023-12-07T16:23:17.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.041+0000 7f99c0ff9700 1 -- 172.21.15.63:0/1815805128 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99b4012600 con 0x7f99c40fbaf0 2023-12-07T16:23:17.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.041+0000 7f99ca966700 1 -- 172.21.15.63:0/1815805128 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c4113110 con 0x7f99c40fbaf0 2023-12-07T16:23:17.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.042+0000 7f99ca966700 1 -- 172.21.15.63:0/1815805128 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c404bb80 con 0x7f99c40fbaf0 2023-12-07T16:23:17.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.043+0000 7f99c0ff9700 1 -- 172.21.15.63:0/1815805128 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f99b401c570 con 0x7f99c40fbaf0 2023-12-07T16:23:17.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.043+0000 7f99c0ff9700 1 --2- 172.21.15.63:0/1815805128 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f99ac06cf80 0x7f99ac06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:17.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.043+0000 7f99c0ff9700 1 -- 172.21.15.63:0/1815805128 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f99b408df40 con 0x7f99c40fbaf0 2023-12-07T16:23:17.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.043+0000 7f99c37fe700 1 --2- 172.21.15.63:0/1815805128 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f99ac06cf80 0x7f99ac06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:17.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.044+0000 7f99c37fe700 1 --2- 172.21.15.63:0/1815805128 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f99ac06cf80 0x7f99ac06f430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009fd0 tx=0x7f99b800b040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:17.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.048+0000 7f99c0ff9700 1 -- 172.21.15.63:0/1815805128 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f99b40c12f0 con 0x7f99c40fbaf0 2023-12-07T16:23:17.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:16 smithi063 ceph-mon[192008]: Reconfiguring mgr.smithi152.sxayfb (monmap changed)... 2023-12-07T16:23:17.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:16 smithi063 ceph-mon[192008]: Reconfiguring daemon mgr.smithi152.sxayfb on smithi152 2023-12-07T16:23:17.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:16 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:17.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:16 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:17.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:16 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-07T16:23:17.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:16 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-07T16:23:17.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:16 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:17.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.291+0000 7f99ca966700 1 -- 172.21.15.63:0/1815805128 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f99c4113530 con 0x7f99c40fbaf0 2023-12-07T16:23:17.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.292+0000 7f99c0ff9700 1 -- 172.21.15.63:0/1815805128 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1891 (secure 0 0 0) 0x7f99b4057c20 con 0x7f99c40fbaf0 2023-12-07T16:23:17.289 INFO:teuthology.orchestra.run.smithi063.stdout:e17 2023-12-07T16:23:17.289 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-07T16:23:17.289 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:23:17.289 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-07T16:23:17.289 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:23:17.290 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-07T16:23:17.290 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-07T16:23:17.290 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 17 2023-12-07T16:23:17.290 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-07T16:23:17.290 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-07T16:19:08.352640+0000 2023-12-07T16:23:17.290 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-07T16:22:27.604525+0000 2023-12-07T16:23:17.290 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-07T16:23:17.290 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-07T16:23:17.290 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-07T16:23:17.290 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-07T16:23:17.290 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-07T16:23:17.290 INFO:teuthology.orchestra.run.smithi063.stdout:max_xattr_size 65536 2023-12-07T16:23:17.290 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-07T16:23:17.290 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-07T16:23:17.290 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 45 2023-12-07T16:23:17.291 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:23:17.291 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 2 2023-12-07T16:23:17.291 INFO:teuthology.orchestra.run.smithi063.stdout:in 0,1 2023-12-07T16:23:17.291 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14478,1=24269} 2023-12-07T16:23:17.291 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-07T16:23:17.291 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-07T16:23:17.291 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-07T16:23:17.291 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-07T16:23:17.291 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-07T16:23:17.291 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-07T16:23:17.291 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-07T16:23:17.291 INFO:teuthology.orchestra.run.smithi063.stdout:bal_rank_mask -1 2023-12-07T16:23:17.291 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-07T16:23:17.291 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.yidolg{0:14478} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:23:17.291 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.mrvngf{1:24269} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.152:6824/3157779064,v1:172.21.15.152:6825/3157779064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:23:17.291 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:23:17.292 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:23:17.292 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-07T16:23:17.292 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:23:17.292 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.gsjgcq{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/3063200414,v1:172.21.15.63:6827/3063200414] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:23:17.292 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.aovwwd{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/2906349729,v1:172.21.15.152:6827/2906349729] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:23:17.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.294+0000 7f99ca966700 1 -- 172.21.15.63:0/1815805128 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f99ac06cf80 msgr2=0x7f99ac06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:17.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.294+0000 7f99ca966700 1 --2- 172.21.15.63:0/1815805128 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f99ac06cf80 0x7f99ac06f430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009fd0 tx=0x7f99b800b040 comp rx=0 tx=0).stop 2023-12-07T16:23:17.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.294+0000 7f99ca966700 1 -- 172.21.15.63:0/1815805128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99c40fbaf0 msgr2=0x7f99c4110210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:17.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.294+0000 7f99ca966700 1 --2- 172.21.15.63:0/1815805128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99c40fbaf0 0x7f99c4110210 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f99b40040d0 tx=0x7f99b4009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:17.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.294+0000 7f99ca966700 1 -- 172.21.15.63:0/1815805128 shutdown_connections 2023-12-07T16:23:17.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.294+0000 7f99ca966700 1 --2- 172.21.15.63:0/1815805128 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f99ac06cf80 0x7f99ac06f430 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:17.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.294+0000 7f99ca966700 1 --2- 172.21.15.63:0/1815805128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99c40fbaf0 0x7f99c4110210 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:17.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.294+0000 7f99ca966700 1 --2- 172.21.15.63:0/1815805128 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99c40fcd00 0x7f99c4112760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:17.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.294+0000 7f99ca966700 1 -- 172.21.15.63:0/1815805128 >> 172.21.15.63:0/1815805128 conn(0x7f99c40f7190 msgr2=0x7f99c40fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:17.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.294+0000 7f99ca966700 1 -- 172.21.15.63:0/1815805128 shutdown_connections 2023-12-07T16:23:17.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.294+0000 7f99ca966700 1 -- 172.21.15.63:0/1815805128 wait complete. 2023-12-07T16:23:17.293 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2023-12-07T16:23:17.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.400+0000 7efc1df39700 1 -- 172.21.15.63:0/608954730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc180fde00 msgr2=0x7efc180fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:17.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.400+0000 7efc1df39700 1 --2- 172.21.15.63:0/608954730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc180fde00 0x7efc180fe250 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efc00004940 tx=0x7efc00009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:17.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.400+0000 7efc1df39700 1 -- 172.21.15.63:0/608954730 shutdown_connections 2023-12-07T16:23:17.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.400+0000 7efc1df39700 1 --2- 172.21.15.63:0/608954730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc180fde00 0x7efc180fe250 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:17.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.400+0000 7efc1df39700 1 --2- 172.21.15.63:0/608954730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc180fcbf0 0x7efc180fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:17.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.400+0000 7efc1df39700 1 -- 172.21.15.63:0/608954730 >> 172.21.15.63:0/608954730 conn(0x7efc180f82d0 msgr2=0x7efc180fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:17.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.400+0000 7efc1df39700 1 -- 172.21.15.63:0/608954730 shutdown_connections 2023-12-07T16:23:17.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.400+0000 7efc1df39700 1 -- 172.21.15.63:0/608954730 wait complete. 2023-12-07T16:23:17.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.400+0000 7efc1df39700 1 Processor -- start 2023-12-07T16:23:17.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.401+0000 7efc1df39700 1 -- start start 2023-12-07T16:23:17.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.401+0000 7efc1df39700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc180fcbf0 0x7efc1810d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:17.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.401+0000 7efc1df39700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc180fde00 0x7efc1810da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:17.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.401+0000 7efc1df39700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1810e030 con 0x7efc180fcbf0 2023-12-07T16:23:17.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.401+0000 7efc1df39700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1810e8d0 con 0x7efc180fde00 2023-12-07T16:23:17.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.401+0000 7efc177fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc180fcbf0 0x7efc1810d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:17.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.401+0000 7efc177fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc180fcbf0 0x7efc1810d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43290/0 (socket says 172.21.15.63:43290) 2023-12-07T16:23:17.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.401+0000 7efc177fe700 1 -- 172.21.15.63:0/2450215016 learned_addr learned my addr 172.21.15.63:0/2450215016 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:23:17.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.401+0000 7efc0effd700 1 --2- 172.21.15.63:0/2450215016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc180fde00 0x7efc1810da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:17.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.401+0000 7efc177fe700 1 -- 172.21.15.63:0/2450215016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc180fde00 msgr2=0x7efc1810da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:17.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.401+0000 7efc177fe700 1 --2- 172.21.15.63:0/2450215016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc180fde00 0x7efc1810da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:17.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.401+0000 7efc177fe700 1 -- 172.21.15.63:0/2450215016 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc00005040 con 0x7efc180fcbf0 2023-12-07T16:23:17.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.402+0000 7efc177fe700 1 --2- 172.21.15.63:0/2450215016 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc180fcbf0 0x7efc1810d4f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efc0800eb70 tx=0x7efc0800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:17.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.402+0000 7efc14ff9700 1 -- 172.21.15.63:0/2450215016 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc08007cc0 con 0x7efc180fcbf0 2023-12-07T16:23:17.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.402+0000 7efc14ff9700 1 -- 172.21.15.63:0/2450215016 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efc0800f040 con 0x7efc180fcbf0 2023-12-07T16:23:17.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.402+0000 7efc1df39700 1 -- 172.21.15.63:0/2450215016 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1810eb50 con 0x7efc180fcbf0 2023-12-07T16:23:17.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.402+0000 7efc14ff9700 1 -- 172.21.15.63:0/2450215016 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc0800c9d0 con 0x7efc180fcbf0 2023-12-07T16:23:17.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.402+0000 7efc1df39700 1 -- 172.21.15.63:0/2450215016 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1810f090 con 0x7efc180fcbf0 2023-12-07T16:23:17.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.403+0000 7efc1df39700 1 -- 172.21.15.63:0/2450215016 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc1804bb80 con 0x7efc180fcbf0 2023-12-07T16:23:17.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.403+0000 7efc14ff9700 1 -- 172.21.15.63:0/2450215016 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7efc0800cb30 con 0x7efc180fcbf0 2023-12-07T16:23:17.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.404+0000 7efc14ff9700 1 --2- 172.21.15.63:0/2450215016 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7efc0406cf80 0x7efc0406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:17.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.404+0000 7efc14ff9700 1 -- 172.21.15.63:0/2450215016 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7efc0808bfc0 con 0x7efc180fcbf0 2023-12-07T16:23:17.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.404+0000 7efc0effd700 1 --2- 172.21.15.63:0/2450215016 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7efc0406cf80 0x7efc0406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:17.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.404+0000 7efc0effd700 1 --2- 172.21.15.63:0/2450215016 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7efc0406cf80 0x7efc0406f430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efc00013600 tx=0x7efc00009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:17.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.408+0000 7efc14ff9700 1 -- 172.21.15.63:0/2450215016 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7efc080597e0 con 0x7efc180fcbf0 2023-12-07T16:23:17.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.631+0000 7efc1df39700 1 -- 172.21.15.63:0/2450215016 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efc1810f530 con 0x7efc0406cf80 2023-12-07T16:23:17.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.632+0000 7efc14ff9700 1 -- 172.21.15.63:0/2450215016 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7efc1810f530 con 0x7efc0406cf80 2023-12-07T16:23:17.629 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:23:17.630 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-07T16:23:17.630 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-07T16:23:17.630 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-07T16:23:17.630 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [ 2023-12-07T16:23:17.630 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr", 2023-12-07T16:23:17.630 INFO:teuthology.orchestra.run.smithi063.stdout: "mon" 2023-12-07T16:23:17.630 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2023-12-07T16:23:17.630 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "4/21 daemons upgraded", 2023-12-07T16:23:17.630 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "Currently upgrading mon daemons", 2023-12-07T16:23:17.630 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-07T16:23:17.630 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:23:17.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.634+0000 7efc1df39700 1 -- 172.21.15.63:0/2450215016 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7efc0406cf80 msgr2=0x7efc0406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:17.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.634+0000 7efc1df39700 1 --2- 172.21.15.63:0/2450215016 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7efc0406cf80 0x7efc0406f430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efc00013600 tx=0x7efc00009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:17.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.634+0000 7efc1df39700 1 -- 172.21.15.63:0/2450215016 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc180fcbf0 msgr2=0x7efc1810d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:17.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.634+0000 7efc1df39700 1 --2- 172.21.15.63:0/2450215016 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc180fcbf0 0x7efc1810d4f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efc0800eb70 tx=0x7efc0800b040 comp rx=0 tx=0).stop 2023-12-07T16:23:17.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.634+0000 7efc1df39700 1 -- 172.21.15.63:0/2450215016 shutdown_connections 2023-12-07T16:23:17.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.634+0000 7efc1df39700 1 --2- 172.21.15.63:0/2450215016 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7efc0406cf80 0x7efc0406f430 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:17.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.634+0000 7efc1df39700 1 --2- 172.21.15.63:0/2450215016 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc180fcbf0 0x7efc1810d4f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:17.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.634+0000 7efc1df39700 1 --2- 172.21.15.63:0/2450215016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc180fde00 0x7efc1810da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:17.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.634+0000 7efc1df39700 1 -- 172.21.15.63:0/2450215016 >> 172.21.15.63:0/2450215016 conn(0x7efc180f82d0 msgr2=0x7efc18101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:17.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.634+0000 7efc1df39700 1 -- 172.21.15.63:0/2450215016 shutdown_connections 2023-12-07T16:23:17.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.634+0000 7efc1df39700 1 -- 172.21.15.63:0/2450215016 wait complete. 2023-12-07T16:23:17.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.739+0000 7f130f53b700 1 -- 172.21.15.63:0/333370541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13080fd730 msgr2=0x7f13080ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:17.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.739+0000 7f130f53b700 1 --2- 172.21.15.63:0/333370541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13080fd730 0x7f13080ffb10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1304004940 tx=0x7f1304009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:17.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.739+0000 7f130f53b700 1 -- 172.21.15.63:0/333370541 shutdown_connections 2023-12-07T16:23:17.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.739+0000 7f130f53b700 1 --2- 172.21.15.63:0/333370541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1308100050 0x7f1308102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:17.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.739+0000 7f130f53b700 1 --2- 172.21.15.63:0/333370541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13080fd730 0x7f13080ffb10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:17.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.739+0000 7f130f53b700 1 -- 172.21.15.63:0/333370541 >> 172.21.15.63:0/333370541 conn(0x7f13080f7190 msgr2=0x7f13080f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:17.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.739+0000 7f130f53b700 1 -- 172.21.15.63:0/333370541 shutdown_connections 2023-12-07T16:23:17.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.739+0000 7f130f53b700 1 -- 172.21.15.63:0/333370541 wait complete. 2023-12-07T16:23:17.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.739+0000 7f130f53b700 1 Processor -- start 2023-12-07T16:23:17.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.740+0000 7f130f53b700 1 -- start start 2023-12-07T16:23:17.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.740+0000 7f130f53b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13080fd730 0x7f130810d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:17.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.740+0000 7f130f53b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1308100050 0x7f130810d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:17.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.740+0000 7f130f53b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130810dfd0 con 0x7f1308100050 2023-12-07T16:23:17.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.740+0000 7f130f53b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130810e870 con 0x7f13080fd730 2023-12-07T16:23:17.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.740+0000 7f130cad6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1308100050 0x7f130810d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:17.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.740+0000 7f130cad6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1308100050 0x7f130810d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43308/0 (socket says 172.21.15.63:43308) 2023-12-07T16:23:17.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.740+0000 7f130cad6700 1 -- 172.21.15.63:0/2357154973 learned_addr learned my addr 172.21.15.63:0/2357154973 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:23:17.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.740+0000 7f130d2d7700 1 --2- 172.21.15.63:0/2357154973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13080fd730 0x7f130810d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:17.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.740+0000 7f130cad6700 1 -- 172.21.15.63:0/2357154973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13080fd730 msgr2=0x7f130810d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:17.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.740+0000 7f130cad6700 1 --2- 172.21.15.63:0/2357154973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13080fd730 0x7f130810d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:17.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.740+0000 7f130cad6700 1 -- 172.21.15.63:0/2357154973 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1304005040 con 0x7f1308100050 2023-12-07T16:23:17.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.740+0000 7f130cad6700 1 --2- 172.21.15.63:0/2357154973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1308100050 0x7f130810d9d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f12f800eb40 tx=0x7f12f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:17.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.740+0000 7f12fdffb700 1 -- 172.21.15.63:0/2357154973 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12f8007cc0 con 0x7f1308100050 2023-12-07T16:23:17.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.740+0000 7f12fdffb700 1 -- 172.21.15.63:0/2357154973 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f12f800f040 con 0x7f1308100050 2023-12-07T16:23:17.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.740+0000 7f130f53b700 1 -- 172.21.15.63:0/2357154973 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f130810eaf0 con 0x7f1308100050 2023-12-07T16:23:17.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.741+0000 7f12fdffb700 1 -- 172.21.15.63:0/2357154973 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12f800c990 con 0x7f1308100050 2023-12-07T16:23:17.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.741+0000 7f130f53b700 1 -- 172.21.15.63:0/2357154973 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130810f030 con 0x7f1308100050 2023-12-07T16:23:17.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.742+0000 7f130f53b700 1 -- 172.21.15.63:0/2357154973 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f130804bb80 con 0x7f1308100050 2023-12-07T16:23:17.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.742+0000 7f12fdffb700 1 -- 172.21.15.63:0/2357154973 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f12f800cc00 con 0x7f1308100050 2023-12-07T16:23:17.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.742+0000 7f12fdffb700 1 --2- 172.21.15.63:0/2357154973 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f12f406cf80 0x7f12f406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:17.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.742+0000 7f12fdffb700 1 -- 172.21.15.63:0/2357154973 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f12f808c1b0 con 0x7f1308100050 2023-12-07T16:23:17.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.742+0000 7f130d2d7700 1 --2- 172.21.15.63:0/2357154973 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f12f406cf80 0x7f12f406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:17.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.743+0000 7f130d2d7700 1 --2- 172.21.15.63:0/2357154973 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f12f406cf80 0x7f12f406f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1304000c00 tx=0x7f1304009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:17.744 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:17.747+0000 7f12fdffb700 1 -- 172.21.15.63:0/2357154973 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f12f8059950 con 0x7f1308100050 2023-12-07T16:23:17.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:17 smithi152 ceph-mon[175645]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:23:17.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:17 smithi152 ceph-mon[175645]: pgmap v19: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 819 KiB/s wr, 206 op/s 2023-12-07T16:23:17.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:17 smithi152 ceph-mon[175645]: Reconfiguring mon.smithi152 (monmap changed)... 2023-12-07T16:23:17.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:17 smithi152 ceph-mon[175645]: Reconfiguring daemon mon.smithi152 on smithi152 2023-12-07T16:23:17.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:17 smithi152 ceph-mon[175645]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:23:17.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:17 smithi152 ceph-mon[175645]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:23:17.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:17 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/3104734196' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:23:17.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:17 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:17.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:17 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:17.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:17 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-07T16:23:17.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:17 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:17.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:17 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/1815805128' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:23:18.027 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:18.030+0000 7f130f53b700 1 -- 172.21.15.63:0/2357154973 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1308105580 con 0x7f1308100050 2023-12-07T16:23:18.028 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:18.030+0000 7f12fdffb700 1 -- 172.21.15.63:0/2357154973 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f12f80594e0 con 0x7f1308100050 2023-12-07T16:23:18.028 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-07T16:23:18.028 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-07T16:23:18.028 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-07T16:23:18.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:18.034+0000 7f130f53b700 1 -- 172.21.15.63:0/2357154973 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f12f406cf80 msgr2=0x7f12f406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:18.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:18.034+0000 7f130f53b700 1 --2- 172.21.15.63:0/2357154973 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f12f406cf80 0x7f12f406f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1304000c00 tx=0x7f1304009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:18.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:18.034+0000 7f130f53b700 1 -- 172.21.15.63:0/2357154973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1308100050 msgr2=0x7f130810d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:18.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:18.034+0000 7f130f53b700 1 --2- 172.21.15.63:0/2357154973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1308100050 0x7f130810d9d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f12f800eb40 tx=0x7f12f800b040 comp rx=0 tx=0).stop 2023-12-07T16:23:18.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:18.034+0000 7f130f53b700 1 -- 172.21.15.63:0/2357154973 shutdown_connections 2023-12-07T16:23:18.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:18.034+0000 7f130f53b700 1 --2- 172.21.15.63:0/2357154973 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f12f406cf80 0x7f12f406f430 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:18.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:18.034+0000 7f130f53b700 1 --2- 172.21.15.63:0/2357154973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13080fd730 0x7f130810d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:18.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:18.034+0000 7f130f53b700 1 --2- 172.21.15.63:0/2357154973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1308100050 0x7f130810d9d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:18.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:18.034+0000 7f130f53b700 1 -- 172.21.15.63:0/2357154973 >> 172.21.15.63:0/2357154973 conn(0x7f13080f7190 msgr2=0x7f13080f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:18.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:18.034+0000 7f130f53b700 1 -- 172.21.15.63:0/2357154973 shutdown_connections 2023-12-07T16:23:18.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:18.034+0000 7f130f53b700 1 -- 172.21.15.63:0/2357154973 wait complete. 2023-12-07T16:23:18.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:17 smithi063 ceph-mon[192008]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:23:18.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:17 smithi063 ceph-mon[192008]: pgmap v19: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 819 KiB/s wr, 206 op/s 2023-12-07T16:23:18.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:17 smithi063 ceph-mon[192008]: Reconfiguring mon.smithi152 (monmap changed)... 2023-12-07T16:23:18.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:17 smithi063 ceph-mon[192008]: Reconfiguring daemon mon.smithi152 on smithi152 2023-12-07T16:23:18.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:17 smithi063 ceph-mon[192008]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:23:18.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:17 smithi063 ceph-mon[192008]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:23:18.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:17 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/3104734196' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:23:18.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:17 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:18.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:17 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:18.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:17 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-07T16:23:18.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:17 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:18.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:17 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/1815805128' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:23:18.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:18 smithi152 ceph-mon[175645]: Reconfiguring osd.3 (monmap changed)... 2023-12-07T16:23:18.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:18 smithi152 ceph-mon[175645]: Reconfiguring daemon osd.3 on smithi152 2023-12-07T16:23:18.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:18 smithi152 ceph-mon[175645]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:23:18.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:18 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:18.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:18 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:18.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:18 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-07T16:23:18.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:18 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:18.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:18 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/2357154973' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:23:19.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:18 smithi063 ceph-mon[192008]: Reconfiguring osd.3 (monmap changed)... 2023-12-07T16:23:19.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:18 smithi063 ceph-mon[192008]: Reconfiguring daemon osd.3 on smithi152 2023-12-07T16:23:19.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:18 smithi063 ceph-mon[192008]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:23:19.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:18 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:19.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:18 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:19.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:18 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-07T16:23:19.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:18 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:19.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:18 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/2357154973' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:23:19.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:19 smithi152 ceph-mon[175645]: pgmap v20: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 8.4 KiB/s rd, 235 KiB/s wr, 76 op/s 2023-12-07T16:23:19.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:19 smithi152 ceph-mon[175645]: Reconfiguring osd.4 (monmap changed)... 2023-12-07T16:23:19.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:19 smithi152 ceph-mon[175645]: Reconfiguring daemon osd.4 on smithi152 2023-12-07T16:23:19.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:19 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:19.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:19 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:19.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:19 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-07T16:23:19.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:19 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:20.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:19 smithi063 ceph-mon[192008]: pgmap v20: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 8.4 KiB/s rd, 235 KiB/s wr, 76 op/s 2023-12-07T16:23:20.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:19 smithi063 ceph-mon[192008]: Reconfiguring osd.4 (monmap changed)... 2023-12-07T16:23:20.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:19 smithi063 ceph-mon[192008]: Reconfiguring daemon osd.4 on smithi152 2023-12-07T16:23:20.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:19 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:20.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:19 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:20.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:19 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-07T16:23:20.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:19 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:20.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:20 smithi152 ceph-mon[175645]: Reconfiguring osd.5 (monmap changed)... 2023-12-07T16:23:20.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:20 smithi152 ceph-mon[175645]: Reconfiguring daemon osd.5 on smithi152 2023-12-07T16:23:20.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:20 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:20.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:20 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:20.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:20 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.mrvngf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-07T16:23:20.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:20 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:21.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:20 smithi063 ceph-mon[192008]: Reconfiguring osd.5 (monmap changed)... 2023-12-07T16:23:21.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:20 smithi063 ceph-mon[192008]: Reconfiguring daemon osd.5 on smithi152 2023-12-07T16:23:21.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:20 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:21.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:20 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:21.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:20 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.mrvngf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-07T16:23:21.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:20 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:21 smithi152 ceph-mon[175645]: pgmap v21: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 8.5 KiB/s rd, 235 KiB/s wr, 77 op/s 2023-12-07T16:23:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:21 smithi152 ceph-mon[175645]: Reconfiguring mds.cephfs.smithi152.mrvngf (monmap changed)... 2023-12-07T16:23:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:21 smithi152 ceph-mon[175645]: Reconfiguring daemon mds.cephfs.smithi152.mrvngf on smithi152 2023-12-07T16:23:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:21 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:21 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:21 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.aovwwd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-07T16:23:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:21 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:22.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:21 smithi063 ceph-mon[192008]: pgmap v21: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 8.5 KiB/s rd, 235 KiB/s wr, 77 op/s 2023-12-07T16:23:22.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:21 smithi063 ceph-mon[192008]: Reconfiguring mds.cephfs.smithi152.mrvngf (monmap changed)... 2023-12-07T16:23:22.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:21 smithi063 ceph-mon[192008]: Reconfiguring daemon mds.cephfs.smithi152.mrvngf on smithi152 2023-12-07T16:23:22.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:21 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:22.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:21 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:22.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:21 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.aovwwd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-07T16:23:22.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:21 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:22.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:22 smithi152 ceph-mon[175645]: Reconfiguring mds.cephfs.smithi152.aovwwd (monmap changed)... 2023-12-07T16:23:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:22 smithi152 ceph-mon[175645]: Reconfiguring daemon mds.cephfs.smithi152.aovwwd on smithi152 2023-12-07T16:23:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:22 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:22 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:22 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:23:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:22 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:23:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:22 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:23:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:22 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:22 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi063"}]: dispatch 2023-12-07T16:23:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:22 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi063"}]': finished 2023-12-07T16:23:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:22 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi152"}]: dispatch 2023-12-07T16:23:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:22 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi152"}]': finished 2023-12-07T16:23:23.027 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:22 smithi063 ceph-mon[192008]: Reconfiguring mds.cephfs.smithi152.aovwwd (monmap changed)... 2023-12-07T16:23:23.027 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:22 smithi063 ceph-mon[192008]: Reconfiguring daemon mds.cephfs.smithi152.aovwwd on smithi152 2023-12-07T16:23:23.027 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:22 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:23.028 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:22 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:23.028 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:22 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:23:23.028 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:22 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:23:23.028 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:22 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:23:23.028 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:22 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:23.028 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:22 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi063"}]: dispatch 2023-12-07T16:23:23.028 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:22 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi063"}]': finished 2023-12-07T16:23:23.028 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:22 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi152"}]: dispatch 2023-12-07T16:23:23.028 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:22 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi152"}]': finished 2023-12-07T16:23:23.891 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:23 smithi063 ceph-mon[192008]: pgmap v22: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 1 op/s 2023-12-07T16:23:23.891 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:23 smithi063 ceph-mon[192008]: Upgrade: Setting container_image for all mon 2023-12-07T16:23:23.891 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:23 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:23.891 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:23 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi063", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-07T16:23:23.891 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:23 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:23.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:23 smithi152 ceph-mon[175645]: pgmap v22: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 1 op/s 2023-12-07T16:23:23.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:23 smithi152 ceph-mon[175645]: Upgrade: Setting container_image for all mon 2023-12-07T16:23:23.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:23 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:23.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:23 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi063", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-07T16:23:23.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:23 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:24.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:24 smithi063 ceph-mon[192008]: Upgrade: Updating crash.smithi063 (1/2) 2023-12-07T16:23:24.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:24 smithi063 ceph-mon[192008]: Deploying daemon crash.smithi063 on smithi063 2023-12-07T16:23:24.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:24 smithi152 ceph-mon[175645]: Upgrade: Updating crash.smithi063 (1/2) 2023-12-07T16:23:24.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:24 smithi152 ceph-mon[175645]: Deploying daemon crash.smithi063 on smithi063 2023-12-07T16:23:25.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:25 smithi152 ceph-mon[175645]: pgmap v23: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 1 op/s 2023-12-07T16:23:25.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:25 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:25.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:25 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:26.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:25 smithi063 ceph-mon[192008]: pgmap v23: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 1 op/s 2023-12-07T16:23:26.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:25 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:26.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:25 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:27.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:27 smithi063 ceph-mon[192008]: pgmap v24: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 1 op/s 2023-12-07T16:23:27.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:27 smithi063 ceph-mon[192008]: Upgrade: Updating crash.smithi152 (2/2) 2023-12-07T16:23:27.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:27 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:27.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:27 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-07T16:23:27.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:27 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:27.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:27 smithi063 ceph-mon[192008]: Deploying daemon crash.smithi152 on smithi152 2023-12-07T16:23:27.963 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:27 smithi152 ceph-mon[175645]: pgmap v24: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 1 op/s 2023-12-07T16:23:27.964 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:27 smithi152 ceph-mon[175645]: Upgrade: Updating crash.smithi152 (2/2) 2023-12-07T16:23:27.964 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:27 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:27.964 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:27 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-07T16:23:27.964 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:27 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:27.964 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:27 smithi152 ceph-mon[175645]: Deploying daemon crash.smithi152 on smithi152 2023-12-07T16:23:29.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:29 smithi063 ceph-mon[192008]: pgmap v25: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2023-12-07T16:23:29.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:29 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:29.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:29 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:29.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:29 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:23:29.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:29 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:23:29.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:29 smithi152 ceph-mon[175645]: pgmap v25: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2023-12-07T16:23:29.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:29 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:29.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:29 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:29.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:29 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:23:29.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:29 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:23:31.831 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:31 smithi063 ceph-mon[192008]: pgmap v26: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2023-12-07T16:23:31.831 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:31 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:31.831 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:31 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:31.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:31 smithi152 ceph-mon[175645]: pgmap v26: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2023-12-07T16:23:31.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:31 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:31.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:31 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:32.897 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:32 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:32.897 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:32 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:32.897 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:32 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:32.897 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:32 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:33.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:32 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:33.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:32 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:33.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:32 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:33.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:32 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:33.973 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:33 smithi063 ceph-mon[192008]: pgmap v27: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:23:33.973 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:33 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:33.973 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:33 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:33.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:33 smithi152 ceph-mon[175645]: pgmap v27: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:23:33.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:33 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:33.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:33 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:35.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:35 smithi152 ceph-mon[175645]: pgmap v28: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:23:35.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:35 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:35.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:35 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:35.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:35 smithi063 ceph-mon[192008]: pgmap v28: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:23:35.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:35 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:35.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:35 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:37.342 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:37 smithi063 ceph-mon[192008]: pgmap v29: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:23:37.342 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:37 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:37.342 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:37 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:37.342 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:37 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:37.343 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:37 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:23:37.343 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:37 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:37.343 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:37 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:23:37.343 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:37 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:23:37.343 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:37 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:23:37.343 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:37 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:23:37.343 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:37 smithi063 ceph-mon[192008]: Upgrade: Setting container_image for all crash 2023-12-07T16:23:37.343 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:37 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:37.343 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:37 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi063"}]: dispatch 2023-12-07T16:23:37.343 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:37 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi063"}]': finished 2023-12-07T16:23:37.344 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:37 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi152"}]: dispatch 2023-12-07T16:23:37.344 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:37 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi152"}]': finished 2023-12-07T16:23:37.344 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:37 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-07T16:23:37.344 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:37 smithi063 ceph-mon[192008]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-07T16:23:37.344 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:37 smithi063 ceph-mon[192008]: Upgrade: osd.0 is safe to restart 2023-12-07T16:23:37.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:37 smithi152 ceph-mon[175645]: pgmap v29: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:23:37.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:37 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:37.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:37 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:37.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:37 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:37.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:37 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:23:37.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:37 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:37.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:37 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:23:37.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:37 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:23:37.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:37 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:23:37.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:37 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:23:37.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:37 smithi152 ceph-mon[175645]: Upgrade: Setting container_image for all crash 2023-12-07T16:23:37.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:37 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:37.494 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:37 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi063"}]: dispatch 2023-12-07T16:23:37.494 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:37 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi063"}]': finished 2023-12-07T16:23:37.494 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:37 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi152"}]: dispatch 2023-12-07T16:23:37.494 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:37 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi152"}]': finished 2023-12-07T16:23:37.494 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:37 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-07T16:23:37.494 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:37 smithi152 ceph-mon[175645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-07T16:23:37.494 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:37 smithi152 ceph-mon[175645]: Upgrade: osd.0 is safe to restart 2023-12-07T16:23:38.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:38 smithi152 ceph-mon[175645]: Upgrade: Updating osd.0 2023-12-07T16:23:38.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:38 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:38.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:38 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-07T16:23:38.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:38 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:38.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:38 smithi152 ceph-mon[175645]: Deploying daemon osd.0 on smithi063 2023-12-07T16:23:38.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:38 smithi063 ceph-mon[192008]: Upgrade: Updating osd.0 2023-12-07T16:23:38.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:38 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:38.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:38 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-07T16:23:38.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:38 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:38.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:38 smithi063 ceph-mon[192008]: Deploying daemon osd.0 on smithi063 2023-12-07T16:23:39.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:39 smithi063 ceph-mon[192008]: pgmap v30: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:23:39.906 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:23:39 smithi063 systemd[1]: Stopping Ceph osd.0 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:23:39.906 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:23:39 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-0[134949]: 2023-12-07T16:23:39.802+0000 7f5d2e606700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-07T16:23:39.906 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:23:39 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-0[134949]: 2023-12-07T16:23:39.802+0000 7f5d2e606700 -1 osd.0 49 *** Got signal Terminated *** 2023-12-07T16:23:39.906 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:23:39 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-0[134949]: 2023-12-07T16:23:39.802+0000 7f5d2e606700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-07T16:23:39.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:39 smithi152 ceph-mon[175645]: pgmap v30: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:23:40.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:40 smithi063 ceph-mon[192008]: osd.0 marked itself down and dead 2023-12-07T16:23:40.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:40 smithi152 ceph-mon[175645]: osd.0 marked itself down and dead 2023-12-07T16:23:41.654 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:23:41 smithi063 bash[201421]: ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-0 2023-12-07T16:23:41.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:41 smithi063 ceph-mon[192008]: pgmap v31: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:23:41.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:41 smithi063 ceph-mon[192008]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-07T16:23:41.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:41 smithi063 ceph-mon[192008]: failed to encode map e50 with expected crc 2023-12-07T16:23:41.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:41 smithi063 ceph-mon[192008]: osdmap e50: 6 total, 5 up, 6 in 2023-12-07T16:23:41.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:41 smithi152 ceph-mon[175645]: pgmap v31: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:23:41.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:41 smithi152 ceph-mon[175645]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-07T16:23:41.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:41 smithi152 ceph-mon[175645]: failed to encode map e50 with expected crc 2023-12-07T16:23:41.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:41 smithi152 ceph-mon[175645]: osdmap e50: 6 total, 5 up, 6 in 2023-12-07T16:23:42.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:42 smithi063 ceph-mon[192008]: failed to encode map e51 with expected crc 2023-12-07T16:23:42.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:42 smithi063 ceph-mon[192008]: osdmap e51: 6 total, 5 up, 6 in 2023-12-07T16:23:42.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:42 smithi063 ceph-mon[192008]: failed to encode map e51 with expected crc 2023-12-07T16:23:42.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:42 smithi063 ceph-mon[192008]: failed to encode map e51 with expected crc 2023-12-07T16:23:42.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:42 smithi063 ceph-mon[192008]: failed to encode map e51 with expected crc 2023-12-07T16:23:42.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:42 smithi063 ceph-mon[192008]: failed to encode map e51 with expected crc 2023-12-07T16:23:42.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:42 smithi063 ceph-mon[192008]: failed to encode map e51 with expected crc 2023-12-07T16:23:42.906 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:23:42 smithi063 systemd[1]: ceph-8c493298-951b-11ee-95a2-87774f69a715@osd.0.service: Succeeded. 2023-12-07T16:23:42.906 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:23:42 smithi063 systemd[1]: Stopped Ceph osd.0 for 8c493298-951b-11ee-95a2-87774f69a715. 2023-12-07T16:23:42.906 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:23:42 smithi063 systemd[1]: Starting Ceph osd.0 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:23:42.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:42 smithi152 ceph-mon[175645]: failed to encode map e51 with expected crc 2023-12-07T16:23:42.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:42 smithi152 ceph-mon[175645]: osdmap e51: 6 total, 5 up, 6 in 2023-12-07T16:23:42.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:42 smithi152 ceph-mon[175645]: failed to encode map e51 with expected crc 2023-12-07T16:23:42.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:42 smithi152 ceph-mon[175645]: failed to encode map e51 with expected crc 2023-12-07T16:23:42.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:42 smithi152 ceph-mon[175645]: failed to encode map e51 with expected crc 2023-12-07T16:23:42.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:42 smithi152 ceph-mon[175645]: failed to encode map e51 with expected crc 2023-12-07T16:23:42.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:42 smithi152 ceph-mon[175645]: failed to encode map e51 with expected crc 2023-12-07T16:23:43.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:43 smithi063 ceph-mon[192008]: pgmap v34: 65 pgs: 9 stale+active+clean, 56 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:23:43.905 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:23:43 smithi063 bash[201691]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-07T16:23:43.906 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:23:43 smithi063 bash[201691]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-07T16:23:43.906 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:23:43 smithi063 bash[201691]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-07T16:23:43.906 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:23:43 smithi063 bash[201691]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-07T16:23:43.906 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:23:43 smithi063 bash[201691]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2023-12-07T16:23:43.906 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:23:43 smithi063 bash[201691]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-07T16:23:43.906 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:23:43 smithi063 bash[201691]: --> ceph-volume raw activate successful for osd ID: 0 2023-12-07T16:23:43.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:43 smithi152 ceph-mon[175645]: pgmap v34: 65 pgs: 9 stale+active+clean, 56 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:23:44.655 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:23:44 smithi063 ceph-osd[201986]: -- 172.21.15.63:0/2490444308 <== mon.0 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5566378871e0 con 0x556637857000 2023-12-07T16:23:44.655 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:23:44 smithi063 bash[201949]: 5fab981f1333b440d2e3486f51744c1e7c48bfc2647b6c1ab3185d2f413b18b2 2023-12-07T16:23:44.655 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:23:44 smithi063 systemd[1]: Started Ceph osd.0 for 8c493298-951b-11ee-95a2-87774f69a715. 2023-12-07T16:23:44.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:44 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [3, 2]}]: dispatch 2023-12-07T16:23:44.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:44 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [3, 0]}]: dispatch 2023-12-07T16:23:44.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:44 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [3, 0]}]: dispatch 2023-12-07T16:23:44.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:44 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 5]}]: dispatch 2023-12-07T16:23:44.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:44 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [3, 0]}]: dispatch 2023-12-07T16:23:44.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:44 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 0]}]: dispatch 2023-12-07T16:23:44.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:44 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [1, 2]}]: dispatch 2023-12-07T16:23:44.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:44 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [3, 2]}]: dispatch 2023-12-07T16:23:44.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:44 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [1, 0]}]: dispatch 2023-12-07T16:23:44.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:44 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:44.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:44 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:23:44.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:44 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:44.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:44 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:44.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:44 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:23:45.155 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:23:44 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-0[201963]: 2023-12-07T16:23:44.701+0000 7f0ceb584640 -1 Falling back to public interface 2023-12-07T16:23:45.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:44 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [3, 2]}]: dispatch 2023-12-07T16:23:45.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:44 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [3, 0]}]: dispatch 2023-12-07T16:23:45.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:44 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [3, 0]}]: dispatch 2023-12-07T16:23:45.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:44 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 5]}]: dispatch 2023-12-07T16:23:45.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:44 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [3, 0]}]: dispatch 2023-12-07T16:23:45.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:44 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 0]}]: dispatch 2023-12-07T16:23:45.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:44 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [1, 2]}]: dispatch 2023-12-07T16:23:45.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:44 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [3, 2]}]: dispatch 2023-12-07T16:23:45.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:44 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [1, 0]}]: dispatch 2023-12-07T16:23:45.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:44 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:45.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:44 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:23:45.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:44 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:45.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:44 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:45.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:44 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:23:45.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:45 smithi152 ceph-mon[175645]: pgmap v35: 65 pgs: 9 stale+active+clean, 56 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:23:45.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:45 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [3, 2]}]': finished 2023-12-07T16:23:45.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:45 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [3, 0]}]': finished 2023-12-07T16:23:45.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:45 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [3, 0]}]': finished 2023-12-07T16:23:45.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:45 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 5]}]': finished 2023-12-07T16:23:45.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:45 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [3, 0]}]': finished 2023-12-07T16:23:45.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:45 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 0]}]': finished 2023-12-07T16:23:45.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:45 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [1, 2]}]': finished 2023-12-07T16:23:45.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:45 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [3, 2]}]': finished 2023-12-07T16:23:45.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:45 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [1, 0]}]': finished 2023-12-07T16:23:45.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:45 smithi152 ceph-mon[175645]: failed to encode map e52 with expected crc 2023-12-07T16:23:45.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:45 smithi152 ceph-mon[175645]: osdmap e52: 6 total, 5 up, 6 in 2023-12-07T16:23:46.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:45 smithi063 ceph-mon[192008]: pgmap v35: 65 pgs: 9 stale+active+clean, 56 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:23:46.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:45 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [3, 2]}]': finished 2023-12-07T16:23:46.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:45 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [3, 0]}]': finished 2023-12-07T16:23:46.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:45 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [3, 0]}]': finished 2023-12-07T16:23:46.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:45 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 5]}]': finished 2023-12-07T16:23:46.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:45 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [3, 0]}]': finished 2023-12-07T16:23:46.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:45 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 0]}]': finished 2023-12-07T16:23:46.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:45 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [1, 2]}]': finished 2023-12-07T16:23:46.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:45 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [3, 2]}]': finished 2023-12-07T16:23:46.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:45 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [1, 0]}]': finished 2023-12-07T16:23:46.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:45 smithi063 ceph-mon[192008]: failed to encode map e52 with expected crc 2023-12-07T16:23:46.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:45 smithi063 ceph-mon[192008]: osdmap e52: 6 total, 5 up, 6 in 2023-12-07T16:23:46.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:46 smithi152 ceph-mon[175645]: failed to encode map e53 with expected crc 2023-12-07T16:23:46.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:46 smithi152 ceph-mon[175645]: osdmap e53: 6 total, 5 up, 6 in 2023-12-07T16:23:46.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:46 smithi152 ceph-mon[175645]: failed to encode map e53 with expected crc 2023-12-07T16:23:46.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:46 smithi152 ceph-mon[175645]: failed to encode map e53 with expected crc 2023-12-07T16:23:46.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:46 smithi152 ceph-mon[175645]: failed to encode map e53 with expected crc 2023-12-07T16:23:46.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:46 smithi152 ceph-mon[175645]: failed to encode map e53 with expected crc 2023-12-07T16:23:46.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:46 smithi152 ceph-mon[175645]: failed to encode map e53 with expected crc 2023-12-07T16:23:47.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:46 smithi063 ceph-mon[192008]: failed to encode map e53 with expected crc 2023-12-07T16:23:47.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:46 smithi063 ceph-mon[192008]: osdmap e53: 6 total, 5 up, 6 in 2023-12-07T16:23:47.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:46 smithi063 ceph-mon[192008]: failed to encode map e53 with expected crc 2023-12-07T16:23:47.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:46 smithi063 ceph-mon[192008]: failed to encode map e53 with expected crc 2023-12-07T16:23:47.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:46 smithi063 ceph-mon[192008]: failed to encode map e53 with expected crc 2023-12-07T16:23:47.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:46 smithi063 ceph-mon[192008]: failed to encode map e53 with expected crc 2023-12-07T16:23:47.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:46 smithi063 ceph-mon[192008]: failed to encode map e53 with expected crc 2023-12-07T16:23:47.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:47 smithi152 ceph-mon[175645]: pgmap v38: 65 pgs: 6 peering, 18 active+undersized+degraded, 12 active+undersized, 29 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 67/360 objects degraded (18.611%) 2023-12-07T16:23:47.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:47 smithi152 ceph-mon[175645]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-07T16:23:47.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:47 smithi152 ceph-mon[175645]: Health check failed: Degraded data redundancy: 67/360 objects degraded (18.611%), 18 pgs degraded (PG_DEGRADED) 2023-12-07T16:23:47.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:47 smithi152 ceph-mon[175645]: failed to encode map e54 with expected crc 2023-12-07T16:23:47.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:47 smithi152 ceph-mon[175645]: osdmap e54: 6 total, 5 up, 6 in 2023-12-07T16:23:47.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:47 smithi152 ceph-mon[175645]: failed to encode map e54 with expected crc 2023-12-07T16:23:47.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:47 smithi152 ceph-mon[175645]: failed to encode map e54 with expected crc 2023-12-07T16:23:47.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:47 smithi152 ceph-mon[175645]: failed to encode map e54 with expected crc 2023-12-07T16:23:47.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:47 smithi152 ceph-mon[175645]: failed to encode map e54 with expected crc 2023-12-07T16:23:47.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:47 smithi152 ceph-mon[175645]: osdmap e55: 6 total, 5 up, 6 in 2023-12-07T16:23:48.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:47 smithi063 ceph-mon[192008]: pgmap v38: 65 pgs: 6 peering, 18 active+undersized+degraded, 12 active+undersized, 29 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 67/360 objects degraded (18.611%) 2023-12-07T16:23:48.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:47 smithi063 ceph-mon[192008]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-07T16:23:48.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:47 smithi063 ceph-mon[192008]: Health check failed: Degraded data redundancy: 67/360 objects degraded (18.611%), 18 pgs degraded (PG_DEGRADED) 2023-12-07T16:23:48.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:47 smithi063 ceph-mon[192008]: failed to encode map e54 with expected crc 2023-12-07T16:23:48.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:47 smithi063 ceph-mon[192008]: osdmap e54: 6 total, 5 up, 6 in 2023-12-07T16:23:48.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:47 smithi063 ceph-mon[192008]: failed to encode map e54 with expected crc 2023-12-07T16:23:48.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:47 smithi063 ceph-mon[192008]: failed to encode map e54 with expected crc 2023-12-07T16:23:48.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:47 smithi063 ceph-mon[192008]: failed to encode map e54 with expected crc 2023-12-07T16:23:48.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:47 smithi063 ceph-mon[192008]: failed to encode map e54 with expected crc 2023-12-07T16:23:48.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:47 smithi063 ceph-mon[192008]: osdmap e55: 6 total, 5 up, 6 in 2023-12-07T16:23:48.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.168+0000 7f8c8d267700 1 -- 172.21.15.63:0/2274215020 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c880fb290 msgr2=0x7f8c880fb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:48.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.168+0000 7f8c8d267700 1 --2- 172.21.15.63:0/2274215020 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c880fb290 0x7f8c880fb6a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8c78004940 tx=0x7f8c78009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:48.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.168+0000 7f8c8d267700 1 -- 172.21.15.63:0/2274215020 shutdown_connections 2023-12-07T16:23:48.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.168+0000 7f8c8d267700 1 --2- 172.21.15.63:0/2274215020 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c880fc4a0 0x7f8c880fc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:48.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.168+0000 7f8c8d267700 1 --2- 172.21.15.63:0/2274215020 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c880fb290 0x7f8c880fb6a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:48.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.168+0000 7f8c8d267700 1 -- 172.21.15.63:0/2274215020 >> 172.21.15.63:0/2274215020 conn(0x7f8c880f6950 msgr2=0x7f8c880f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:48.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.168+0000 7f8c8d267700 1 -- 172.21.15.63:0/2274215020 shutdown_connections 2023-12-07T16:23:48.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.168+0000 7f8c8d267700 1 -- 172.21.15.63:0/2274215020 wait complete. 2023-12-07T16:23:48.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.169+0000 7f8c8d267700 1 Processor -- start 2023-12-07T16:23:48.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.169+0000 7f8c8d267700 1 -- start start 2023-12-07T16:23:48.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.169+0000 7f8c8d267700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c880fb290 0x7f8c88104490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:48.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.169+0000 7f8c8d267700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c880fc4a0 0x7f8c88102910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:48.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.169+0000 7f8c8d267700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c88102f10 con 0x7f8c880fc4a0 2023-12-07T16:23:48.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.169+0000 7f8c8d267700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c88103080 con 0x7f8c880fb290 2023-12-07T16:23:48.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.170+0000 7f8c867fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c880fc4a0 0x7f8c88102910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:48.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.170+0000 7f8c867fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c880fc4a0 0x7f8c88102910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54226/0 (socket says 172.21.15.63:54226) 2023-12-07T16:23:48.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.170+0000 7f8c867fc700 1 -- 172.21.15.63:0/846649737 learned_addr learned my addr 172.21.15.63:0/846649737 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:23:48.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.170+0000 7f8c86ffd700 1 --2- 172.21.15.63:0/846649737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c880fb290 0x7f8c88104490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:48.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.170+0000 7f8c86ffd700 1 -- 172.21.15.63:0/846649737 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c880fc4a0 msgr2=0x7f8c88102910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:48.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.170+0000 7f8c86ffd700 1 --2- 172.21.15.63:0/846649737 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c880fc4a0 0x7f8c88102910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:48.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.170+0000 7f8c86ffd700 1 -- 172.21.15.63:0/846649737 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c78005040 con 0x7f8c880fb290 2023-12-07T16:23:48.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.170+0000 7f8c867fc700 1 --2- 172.21.15.63:0/846649737 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c880fc4a0 0x7f8c88102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T16:23:48.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.170+0000 7f8c86ffd700 1 --2- 172.21.15.63:0/846649737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c880fb290 0x7f8c88104490 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8c78000c00 tx=0x7f8c78009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:48.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.171+0000 7f8c6f7fe700 1 -- 172.21.15.63:0/846649737 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c78021070 con 0x7f8c880fb290 2023-12-07T16:23:48.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.171+0000 7f8c6f7fe700 1 -- 172.21.15.63:0/846649737 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8c7801c400 con 0x7f8c880fb290 2023-12-07T16:23:48.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.171+0000 7f8c8d267700 1 -- 172.21.15.63:0/846649737 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c88103300 con 0x7f8c880fb290 2023-12-07T16:23:48.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.171+0000 7f8c6f7fe700 1 -- 172.21.15.63:0/846649737 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c7800e070 con 0x7f8c880fb290 2023-12-07T16:23:48.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.171+0000 7f8c8d267700 1 -- 172.21.15.63:0/846649737 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c881155e0 con 0x7f8c880fb290 2023-12-07T16:23:48.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.172+0000 7f8c8d267700 1 -- 172.21.15.63:0/846649737 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c88107610 con 0x7f8c880fb290 2023-12-07T16:23:48.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.176+0000 7f8c6f7fe700 1 -- 172.21.15.63:0/846649737 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f8c7801c9c0 con 0x7f8c880fb290 2023-12-07T16:23:48.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.176+0000 7f8c6f7fe700 1 --2- 172.21.15.63:0/846649737 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f8c7006cf80 0x7f8c7006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:48.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.176+0000 7f8c6f7fe700 1 -- 172.21.15.63:0/846649737 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 7046+0+0 (secure 0 0 0) 0x7f8c7808d810 con 0x7f8c880fb290 2023-12-07T16:23:48.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.176+0000 7f8c867fc700 1 --2- 172.21.15.63:0/846649737 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f8c7006cf80 0x7f8c7006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:48.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.177+0000 7f8c867fc700 1 --2- 172.21.15.63:0/846649737 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f8c7006cf80 0x7f8c7006f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c007fd0 tx=0x7f8c7c00b040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:48.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.182+0000 7f8c6f7fe700 1 -- 172.21.15.63:0/846649737 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f8c7805ae00 con 0x7f8c880fb290 2023-12-07T16:23:48.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.459+0000 7f8c8d267700 1 -- 172.21.15.63:0/846649737 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c8802b1a0 con 0x7f8c7006cf80 2023-12-07T16:23:48.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.460+0000 7f8c6f7fe700 1 -- 172.21.15.63:0/846649737 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8c8802b1a0 con 0x7f8c7006cf80 2023-12-07T16:23:48.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.462+0000 7f8c8d267700 1 -- 172.21.15.63:0/846649737 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f8c7006cf80 msgr2=0x7f8c7006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:48.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.462+0000 7f8c8d267700 1 --2- 172.21.15.63:0/846649737 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f8c7006cf80 0x7f8c7006f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c007fd0 tx=0x7f8c7c00b040 comp rx=0 tx=0).stop 2023-12-07T16:23:48.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.462+0000 7f8c8d267700 1 -- 172.21.15.63:0/846649737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c880fb290 msgr2=0x7f8c88104490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:48.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.462+0000 7f8c8d267700 1 --2- 172.21.15.63:0/846649737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c880fb290 0x7f8c88104490 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8c78000c00 tx=0x7f8c78009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:48.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.462+0000 7f8c8d267700 1 -- 172.21.15.63:0/846649737 shutdown_connections 2023-12-07T16:23:48.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.462+0000 7f8c8d267700 1 --2- 172.21.15.63:0/846649737 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f8c7006cf80 0x7f8c7006f430 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:48.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.462+0000 7f8c8d267700 1 --2- 172.21.15.63:0/846649737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c880fb290 0x7f8c88104490 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:48.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.462+0000 7f8c8d267700 1 --2- 172.21.15.63:0/846649737 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c880fc4a0 0x7f8c88102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:48.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.462+0000 7f8c8d267700 1 -- 172.21.15.63:0/846649737 >> 172.21.15.63:0/846649737 conn(0x7f8c880f6950 msgr2=0x7f8c880f8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:48.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.462+0000 7f8c8d267700 1 -- 172.21.15.63:0/846649737 shutdown_connections 2023-12-07T16:23:48.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.462+0000 7f8c8d267700 1 -- 172.21.15.63:0/846649737 wait complete. 2023-12-07T16:23:48.471 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-07T16:23:48.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.572+0000 7feea5ebf700 1 -- 172.21.15.63:0/1543958447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feea00fff70 msgr2=0x7feea01003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:48.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.572+0000 7feea5ebf700 1 --2- 172.21.15.63:0/1543958447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feea00fff70 0x7feea01003e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fee94004940 tx=0x7fee94009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:48.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.572+0000 7feea5ebf700 1 -- 172.21.15.63:0/1543958447 shutdown_connections 2023-12-07T16:23:48.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.572+0000 7feea5ebf700 1 --2- 172.21.15.63:0/1543958447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feea00fff70 0x7feea01003e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:48.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.572+0000 7feea5ebf700 1 --2- 172.21.15.63:0/1543958447 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feea00fee00 0x7feea00ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:48.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.572+0000 7feea5ebf700 1 -- 172.21.15.63:0/1543958447 >> 172.21.15.63:0/1543958447 conn(0x7feea00fa5d0 msgr2=0x7feea00fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:48.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.572+0000 7feea5ebf700 1 -- 172.21.15.63:0/1543958447 shutdown_connections 2023-12-07T16:23:48.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.572+0000 7feea5ebf700 1 -- 172.21.15.63:0/1543958447 wait complete. 2023-12-07T16:23:48.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.573+0000 7feea5ebf700 1 Processor -- start 2023-12-07T16:23:48.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.573+0000 7feea5ebf700 1 -- start start 2023-12-07T16:23:48.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.573+0000 7feea5ebf700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feea00fee00 0x7feea010f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:48.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.573+0000 7feea5ebf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feea00fff70 0x7feea010fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:48.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.573+0000 7feea5ebf700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea01101f0 con 0x7feea00fee00 2023-12-07T16:23:48.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.573+0000 7feea5ebf700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea0110a90 con 0x7feea00fff70 2023-12-07T16:23:48.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.573+0000 7fee9f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feea00fee00 0x7feea010f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:48.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.573+0000 7fee9f7fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feea00fee00 0x7feea010f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54240/0 (socket says 172.21.15.63:54240) 2023-12-07T16:23:48.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.574+0000 7fee9f7fe700 1 -- 172.21.15.63:0/2100902469 learned_addr learned my addr 172.21.15.63:0/2100902469 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:23:48.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.574+0000 7fee9effd700 1 --2- 172.21.15.63:0/2100902469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feea00fff70 0x7feea010fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:48.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.574+0000 7fee9f7fe700 1 -- 172.21.15.63:0/2100902469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feea00fff70 msgr2=0x7feea010fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:48.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.574+0000 7fee9f7fe700 1 --2- 172.21.15.63:0/2100902469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feea00fff70 0x7feea010fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:48.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.574+0000 7fee9f7fe700 1 -- 172.21.15.63:0/2100902469 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee94005040 con 0x7feea00fee00 2023-12-07T16:23:48.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.574+0000 7fee9f7fe700 1 --2- 172.21.15.63:0/2100902469 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feea00fee00 0x7feea010f6b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fee90002a80 tx=0x7fee900046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:48.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.574+0000 7fee87fff700 1 -- 172.21.15.63:0/2100902469 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee90007cc0 con 0x7feea00fee00 2023-12-07T16:23:48.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.574+0000 7feea5ebf700 1 -- 172.21.15.63:0/2100902469 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea0110d70 con 0x7feea00fee00 2023-12-07T16:23:48.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.574+0000 7fee87fff700 1 -- 172.21.15.63:0/2100902469 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fee9000f040 con 0x7feea00fee00 2023-12-07T16:23:48.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.574+0000 7fee87fff700 1 -- 172.21.15.63:0/2100902469 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee9000da60 con 0x7feea00fee00 2023-12-07T16:23:48.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.574+0000 7feea5ebf700 1 -- 172.21.15.63:0/2100902469 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea01112b0 con 0x7feea00fee00 2023-12-07T16:23:48.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.575+0000 7feea5ebf700 1 -- 172.21.15.63:0/2100902469 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea004bb80 con 0x7feea00fee00 2023-12-07T16:23:48.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.576+0000 7fee87fff700 1 -- 172.21.15.63:0/2100902469 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fee9000dbc0 con 0x7feea00fee00 2023-12-07T16:23:48.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.576+0000 7fee87fff700 1 --2- 172.21.15.63:0/2100902469 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fee8806cf80 0x7fee8806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:48.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.576+0000 7fee87fff700 1 -- 172.21.15.63:0/2100902469 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 7046+0+0 (secure 0 0 0) 0x7fee9008c430 con 0x7feea00fee00 2023-12-07T16:23:48.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.576+0000 7fee9effd700 1 --2- 172.21.15.63:0/2100902469 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fee8806cf80 0x7fee8806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:48.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.577+0000 7fee9effd700 1 --2- 172.21.15.63:0/2100902469 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fee8806cf80 0x7fee8806f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fee94004890 tx=0x7fee94009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:48.580 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.581+0000 7fee87fff700 1 -- 172.21.15.63:0/2100902469 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fee90059900 con 0x7feea00fee00 2023-12-07T16:23:48.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.817+0000 7feea5ebf700 1 -- 172.21.15.63:0/2100902469 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feea01116d0 con 0x7fee8806cf80 2023-12-07T16:23:48.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.819+0000 7fee87fff700 1 -- 172.21.15.63:0/2100902469 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7feea01116d0 con 0x7fee8806cf80 2023-12-07T16:23:48.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.821+0000 7feea5ebf700 1 -- 172.21.15.63:0/2100902469 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fee8806cf80 msgr2=0x7fee8806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:48.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.821+0000 7feea5ebf700 1 --2- 172.21.15.63:0/2100902469 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fee8806cf80 0x7fee8806f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fee94004890 tx=0x7fee94009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:48.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.821+0000 7feea5ebf700 1 -- 172.21.15.63:0/2100902469 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feea00fee00 msgr2=0x7feea010f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:48.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.821+0000 7feea5ebf700 1 --2- 172.21.15.63:0/2100902469 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feea00fee00 0x7feea010f6b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fee90002a80 tx=0x7fee900046b0 comp rx=0 tx=0).stop 2023-12-07T16:23:48.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.821+0000 7feea5ebf700 1 -- 172.21.15.63:0/2100902469 shutdown_connections 2023-12-07T16:23:48.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.821+0000 7feea5ebf700 1 --2- 172.21.15.63:0/2100902469 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fee8806cf80 0x7fee8806f430 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:48.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.821+0000 7feea5ebf700 1 --2- 172.21.15.63:0/2100902469 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feea00fee00 0x7feea010f6b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:48.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.821+0000 7feea5ebf700 1 --2- 172.21.15.63:0/2100902469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feea00fff70 0x7feea010fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:48.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.821+0000 7feea5ebf700 1 -- 172.21.15.63:0/2100902469 >> 172.21.15.63:0/2100902469 conn(0x7feea00fa5d0 msgr2=0x7feea0103230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:48.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.821+0000 7feea5ebf700 1 -- 172.21.15.63:0/2100902469 shutdown_connections 2023-12-07T16:23:48.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.821+0000 7feea5ebf700 1 -- 172.21.15.63:0/2100902469 wait complete. 2023-12-07T16:23:48.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.951+0000 7f5319942700 1 -- 172.21.15.63:0/3920997279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5314066920 msgr2=0x7f53140ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:48.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.951+0000 7f5319942700 1 --2- 172.21.15.63:0/3920997279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5314066920 0x7f53140ff7a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5304004940 tx=0x7f5304009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:48.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.951+0000 7f5319942700 1 -- 172.21.15.63:0/3920997279 shutdown_connections 2023-12-07T16:23:48.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.952+0000 7f5319942700 1 --2- 172.21.15.63:0/3920997279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53140ffd70 0x7f53141021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:48.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.952+0000 7f5319942700 1 --2- 172.21.15.63:0/3920997279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5314066920 0x7f53140ff7a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:48.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.952+0000 7f5319942700 1 -- 172.21.15.63:0/3920997279 >> 172.21.15.63:0/3920997279 conn(0x7f53140f71b0 msgr2=0x7f53140f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:48.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.952+0000 7f5319942700 1 -- 172.21.15.63:0/3920997279 shutdown_connections 2023-12-07T16:23:48.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.952+0000 7f5319942700 1 -- 172.21.15.63:0/3920997279 wait complete. 2023-12-07T16:23:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.953+0000 7f5319942700 1 Processor -- start 2023-12-07T16:23:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.953+0000 7f5319942700 1 -- start start 2023-12-07T16:23:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.953+0000 7f5319942700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5314066920 0x7f531410d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.953+0000 7f5319942700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53140ffd70 0x7f531410da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.953+0000 7f5319942700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531410e090 con 0x7f53140ffd70 2023-12-07T16:23:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.953+0000 7f5319942700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531410e930 con 0x7f5314066920 2023-12-07T16:23:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.953+0000 7f53127fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53140ffd70 0x7f531410da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.953+0000 7f53127fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53140ffd70 0x7f531410da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54252/0 (socket says 172.21.15.63:54252) 2023-12-07T16:23:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.953+0000 7f53127fc700 1 -- 172.21.15.63:0/649017465 learned_addr learned my addr 172.21.15.63:0/649017465 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:23:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.953+0000 7f5312ffd700 1 --2- 172.21.15.63:0/649017465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5314066920 0x7f531410d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:48.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.954+0000 7f53127fc700 1 -- 172.21.15.63:0/649017465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5314066920 msgr2=0x7f531410d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:48.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.954+0000 7f53127fc700 1 --2- 172.21.15.63:0/649017465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5314066920 0x7f531410d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:48.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.954+0000 7f53127fc700 1 -- 172.21.15.63:0/649017465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5304005040 con 0x7f53140ffd70 2023-12-07T16:23:48.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.954+0000 7f53127fc700 1 --2- 172.21.15.63:0/649017465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53140ffd70 0x7f531410da90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5308002a50 tx=0x7f5308004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:48.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.954+0000 7f52fb7fe700 1 -- 172.21.15.63:0/649017465 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5308007cc0 con 0x7f53140ffd70 2023-12-07T16:23:48.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.954+0000 7f52fb7fe700 1 -- 172.21.15.63:0/649017465 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f530800f040 con 0x7f53140ffd70 2023-12-07T16:23:48.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.954+0000 7f5319942700 1 -- 172.21.15.63:0/649017465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f531410ec10 con 0x7f53140ffd70 2023-12-07T16:23:48.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.954+0000 7f52fb7fe700 1 -- 172.21.15.63:0/649017465 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f530800d920 con 0x7f53140ffd70 2023-12-07T16:23:48.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.954+0000 7f5319942700 1 -- 172.21.15.63:0/649017465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531410f150 con 0x7f53140ffd70 2023-12-07T16:23:48.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.955+0000 7f5319942700 1 -- 172.21.15.63:0/649017465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53141075e0 con 0x7f53140ffd70 2023-12-07T16:23:48.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.956+0000 7f52fb7fe700 1 -- 172.21.15.63:0/649017465 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f5308009680 con 0x7f53140ffd70 2023-12-07T16:23:48.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.957+0000 7f52fb7fe700 1 --2- 172.21.15.63:0/649017465 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f52fc06cfd0 0x7f52fc06f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:48.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.957+0000 7f52fb7fe700 1 -- 172.21.15.63:0/649017465 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 7050+0+0 (secure 0 0 0) 0x7f530808cc20 con 0x7f53140ffd70 2023-12-07T16:23:48.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.957+0000 7f5312ffd700 1 --2- 172.21.15.63:0/649017465 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f52fc06cfd0 0x7f52fc06f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:48.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.958+0000 7f5312ffd700 1 --2- 172.21.15.63:0/649017465 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f52fc06cfd0 0x7f52fc06f480 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f530400b3b0 tx=0x7f5304009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:48.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:48.962+0000 7f52fb7fe700 1 -- 172.21.15.63:0/649017465 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f530805a0d0 con 0x7f53140ffd70 2023-12-07T16:23:49.072 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:23:48 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-0[201963]: 2023-12-07T16:23:48.900+0000 7f0ceb584640 -1 osd.0 0 read_superblock omap replica is missing. 2023-12-07T16:23:49.073 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:48 smithi063 ceph-mon[192008]: failed to encode map e55 with expected crc 2023-12-07T16:23:49.073 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:48 smithi063 ceph-mon[192008]: failed to encode map e55 with expected crc 2023-12-07T16:23:49.073 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:48 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:49.073 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:48 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:49.073 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:48 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:49.073 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:48 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:49.073 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:48 smithi063 ceph-mon[192008]: osdmap e56: 6 total, 5 up, 6 in 2023-12-07T16:23:49.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.184+0000 7f5319942700 1 -- 172.21.15.63:0/649017465 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f531410f4a0 con 0x7f52fc06cfd0 2023-12-07T16:23:49.203 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.204+0000 7f52fb7fe700 1 -- 172.21.15.63:0/649017465 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f531410f4a0 con 0x7f52fc06cfd0 2023-12-07T16:23:49.203 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-07T16:23:49.203 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (2m) 1s ago 8m 28.4M - 0.25.0 c8568f914cd2 c0526812d5fe 2023-12-07T16:23:49.203 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (23s) 1s ago 8m 7474k - 19.0.0-13-ge6605fb8 104f332cd0a9 52adf44ea983 2023-12-07T16:23:49.203 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi152 smithi152 running (20s) 18s ago 7m 7461k - 19.0.0-13-ge6605fb8 104f332cd0a9 9eba5b538b96 2023-12-07T16:23:49.204 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (2m) 1s ago 8m 86.0M - 9.4.7 954c08fa6188 cc2cde9a664f 2023-12-07T16:23:49.204 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.gsjgcq smithi063 running (4m) 1s ago 4m 14.9M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 f70e4f098e4c 2023-12-07T16:23:49.204 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.yidolg smithi063 running (4m) 1s ago 4m 5931M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5b053ef5fb7f 2023-12-07T16:23:49.204 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.aovwwd smithi152 running (4m) 18s ago 4m 15.6M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 80190948a595 2023-12-07T16:23:49.204 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.mrvngf smithi152 running (4m) 18s ago 4m 5114M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5f60b893f840 2023-12-07T16:23:49.204 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.yohyyx smithi063 *:8443,9283,8765 running (2m) 1s ago 9m 507M - 19.0.0-13-ge6605fb8 104f332cd0a9 b605f882784d 2023-12-07T16:23:49.204 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi152.sxayfb smithi152 *:8443,9283,8765 running (88s) 18s ago 7m 450M - 19.0.0-13-ge6605fb8 104f332cd0a9 71716998ccc3 2023-12-07T16:23:49.204 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (77s) 1s ago 9m 59.2M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 8d7d0c6bfea3 2023-12-07T16:23:49.204 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi152 smithi152 running (53s) 18s ago 7m 39.3M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 883bb3425cf0 2023-12-07T16:23:49.205 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (2m) 1s ago 8m 18.6M - 1.5.0 0da6a335fe13 50d63981f746 2023-12-07T16:23:49.205 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi152 smithi152 *:9100 running (2m) 18s ago 7m 19.4M - 1.5.0 0da6a335fe13 627cda14f1a9 2023-12-07T16:23:49.205 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (5s) 1s ago 7m 14.2M 1568M 19.0.0-13-ge6605fb8 104f332cd0a9 5fab981f1333 2023-12-07T16:23:49.205 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (6m) 1s ago 6m 829M 1568M 17.2.7-115-g4f62d9ad fcdfd00f81c7 4372601f899e 2023-12-07T16:23:49.205 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (6m) 1s ago 6m 639M 1568M 17.2.7-115-g4f62d9ad fcdfd00f81c7 b0d432bbca05 2023-12-07T16:23:49.205 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi152 running (6m) 18s ago 6m 987M 2592M 17.2.7-115-g4f62d9ad fcdfd00f81c7 94d14402b489 2023-12-07T16:23:49.205 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi152 running (5m) 18s ago 5m 764M 2592M 17.2.7-115-g4f62d9ad fcdfd00f81c7 d3b8b2f12489 2023-12-07T16:23:49.205 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi152 running (5m) 18s ago 5m 856M 2592M 17.2.7-115-g4f62d9ad fcdfd00f81c7 e7f8d9f716bb 2023-12-07T16:23:49.205 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (96s) 1s ago 8m 50.8M - 2.43.0 a07b618ecd1d 8a323520d9fd 2023-12-07T16:23:49.206 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.207+0000 7f5319942700 1 -- 172.21.15.63:0/649017465 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f52fc06cfd0 msgr2=0x7f52fc06f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:49.206 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.207+0000 7f5319942700 1 --2- 172.21.15.63:0/649017465 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f52fc06cfd0 0x7f52fc06f480 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f530400b3b0 tx=0x7f5304009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:49.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.207+0000 7f5319942700 1 -- 172.21.15.63:0/649017465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53140ffd70 msgr2=0x7f531410da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:49.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.207+0000 7f5319942700 1 --2- 172.21.15.63:0/649017465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53140ffd70 0x7f531410da90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5308002a50 tx=0x7f5308004600 comp rx=0 tx=0).stop 2023-12-07T16:23:49.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.207+0000 7f5319942700 1 -- 172.21.15.63:0/649017465 shutdown_connections 2023-12-07T16:23:49.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.207+0000 7f5319942700 1 --2- 172.21.15.63:0/649017465 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f52fc06cfd0 0x7f52fc06f480 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:49.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.207+0000 7f5319942700 1 --2- 172.21.15.63:0/649017465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5314066920 0x7f531410d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:49.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.207+0000 7f5319942700 1 --2- 172.21.15.63:0/649017465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53140ffd70 0x7f531410da90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:49.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.207+0000 7f5319942700 1 -- 172.21.15.63:0/649017465 >> 172.21.15.63:0/649017465 conn(0x7f53140f71b0 msgr2=0x7f53140f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:49.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.207+0000 7f5319942700 1 -- 172.21.15.63:0/649017465 shutdown_connections 2023-12-07T16:23:49.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.207+0000 7f5319942700 1 -- 172.21.15.63:0/649017465 wait complete. 2023-12-07T16:23:49.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:48 smithi152 ceph-mon[175645]: failed to encode map e55 with expected crc 2023-12-07T16:23:49.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:48 smithi152 ceph-mon[175645]: failed to encode map e55 with expected crc 2023-12-07T16:23:49.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:48 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:49.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:48 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:49.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:48 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:49.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:48 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:49.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:48 smithi152 ceph-mon[175645]: osdmap e56: 6 total, 5 up, 6 in 2023-12-07T16:23:49.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.320+0000 7f9f4547d700 1 -- 172.21.15.63:0/2440551124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f400fb290 msgr2=0x7f9f400fb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:49.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.320+0000 7f9f4547d700 1 --2- 172.21.15.63:0/2440551124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f400fb290 0x7f9f400fb6a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9f30004a50 tx=0x7f9f3000af40 comp rx=0 tx=0).stop 2023-12-07T16:23:49.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.320+0000 7f9f4547d700 1 -- 172.21.15.63:0/2440551124 shutdown_connections 2023-12-07T16:23:49.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.320+0000 7f9f4547d700 1 --2- 172.21.15.63:0/2440551124 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f400fc4a0 0x7f9f400fc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:49.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.320+0000 7f9f4547d700 1 --2- 172.21.15.63:0/2440551124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f400fb290 0x7f9f400fb6a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:49.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.320+0000 7f9f4547d700 1 -- 172.21.15.63:0/2440551124 >> 172.21.15.63:0/2440551124 conn(0x7f9f400f6950 msgr2=0x7f9f400f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:49.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.320+0000 7f9f4547d700 1 -- 172.21.15.63:0/2440551124 shutdown_connections 2023-12-07T16:23:49.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.320+0000 7f9f4547d700 1 -- 172.21.15.63:0/2440551124 wait complete. 2023-12-07T16:23:49.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.321+0000 7f9f4547d700 1 Processor -- start 2023-12-07T16:23:49.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.322+0000 7f9f4547d700 1 -- start start 2023-12-07T16:23:49.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.322+0000 7f9f4547d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f400fb290 0x7f9f4010d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:49.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.322+0000 7f9f4547d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f400fc4a0 0x7f9f4010db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:49.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.322+0000 7f9f4547d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4010e150 con 0x7f9f400fb290 2023-12-07T16:23:49.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.322+0000 7f9f4547d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4010e9f0 con 0x7f9f400fc4a0 2023-12-07T16:23:49.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.322+0000 7f9f3effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f400fb290 0x7f9f4010d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:49.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.322+0000 7f9f3effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f400fb290 0x7f9f4010d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54282/0 (socket says 172.21.15.63:54282) 2023-12-07T16:23:49.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.322+0000 7f9f3effd700 1 -- 172.21.15.63:0/154214988 learned_addr learned my addr 172.21.15.63:0/154214988 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:23:49.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.322+0000 7f9f3e7fc700 1 --2- 172.21.15.63:0/154214988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f400fc4a0 0x7f9f4010db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:49.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.322+0000 7f9f3effd700 1 -- 172.21.15.63:0/154214988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f400fc4a0 msgr2=0x7f9f4010db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:49.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.322+0000 7f9f3effd700 1 --2- 172.21.15.63:0/154214988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f400fc4a0 0x7f9f4010db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:49.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.322+0000 7f9f3effd700 1 -- 172.21.15.63:0/154214988 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f30005040 con 0x7f9f400fb290 2023-12-07T16:23:49.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.323+0000 7f9f3effd700 1 --2- 172.21.15.63:0/154214988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f400fb290 0x7f9f4010d610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9f30005010 tx=0x7f9f3000af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:49.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.323+0000 7f9f277fe700 1 -- 172.21.15.63:0/154214988 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f3000f050 con 0x7f9f400fb290 2023-12-07T16:23:49.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.323+0000 7f9f277fe700 1 -- 172.21.15.63:0/154214988 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9f3000a7e0 con 0x7f9f400fb290 2023-12-07T16:23:49.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.323+0000 7f9f277fe700 1 -- 172.21.15.63:0/154214988 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f30014660 con 0x7f9f400fb290 2023-12-07T16:23:49.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.323+0000 7f9f4547d700 1 -- 172.21.15.63:0/154214988 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f4010ec10 con 0x7f9f400fb290 2023-12-07T16:23:49.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.323+0000 7f9f4547d700 1 -- 172.21.15.63:0/154214988 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4010f150 con 0x7f9f400fb290 2023-12-07T16:23:49.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.324+0000 7f9f4547d700 1 -- 172.21.15.63:0/154214988 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f401053f0 con 0x7f9f400fb290 2023-12-07T16:23:49.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.325+0000 7f9f277fe700 1 -- 172.21.15.63:0/154214988 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f9f3001da30 con 0x7f9f400fb290 2023-12-07T16:23:49.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.325+0000 7f9f277fe700 1 --2- 172.21.15.63:0/154214988 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f9f2806cf80 0x7f9f2806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:49.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.325+0000 7f9f277fe700 1 -- 172.21.15.63:0/154214988 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 7050+0+0 (secure 0 0 0) 0x7f9f3008e4d0 con 0x7f9f400fb290 2023-12-07T16:23:49.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.326+0000 7f9f3e7fc700 1 --2- 172.21.15.63:0/154214988 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f9f2806cf80 0x7f9f2806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:49.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.326+0000 7f9f3e7fc700 1 --2- 172.21.15.63:0/154214988 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f9f2806cf80 0x7f9f2806f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009b80 tx=0x7f9f3400b040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:49.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.330+0000 7f9f277fe700 1 -- 172.21.15.63:0/154214988 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9f3005bab0 con 0x7f9f400fb290 2023-12-07T16:23:49.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.635+0000 7f9f4547d700 1 -- 172.21.15.63:0/154214988 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9f4010eda0 con 0x7f9f400fb290 2023-12-07T16:23:49.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.636+0000 7f9f277fe700 1 -- 172.21.15.63:0/154214988 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+726 (secure 0 0 0) 0x7f9f4010eda0 con 0x7f9f400fb290 2023-12-07T16:23:49.635 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:23:49.636 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-07T16:23:49.636 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-07T16:23:49.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:23:49.637 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-07T16:23:49.637 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-07T16:23:49.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:23:49.637 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-07T16:23:49.638 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 5 2023-12-07T16:23:49.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:23:49.638 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-07T16:23:49.638 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 4 2023-12-07T16:23:49.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:23:49.639 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-07T16:23:49.639 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 9, 2023-12-07T16:23:49.639 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 4 2023-12-07T16:23:49.639 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-07T16:23:49.640 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:23:49.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.638+0000 7f9f4547d700 1 -- 172.21.15.63:0/154214988 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f9f2806cf80 msgr2=0x7f9f2806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:49.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.638+0000 7f9f4547d700 1 --2- 172.21.15.63:0/154214988 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f9f2806cf80 0x7f9f2806f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009b80 tx=0x7f9f3400b040 comp rx=0 tx=0).stop 2023-12-07T16:23:49.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.638+0000 7f9f4547d700 1 -- 172.21.15.63:0/154214988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f400fb290 msgr2=0x7f9f4010d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:49.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.638+0000 7f9f4547d700 1 --2- 172.21.15.63:0/154214988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f400fb290 0x7f9f4010d610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9f30005010 tx=0x7f9f3000af40 comp rx=0 tx=0).stop 2023-12-07T16:23:49.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.638+0000 7f9f4547d700 1 -- 172.21.15.63:0/154214988 shutdown_connections 2023-12-07T16:23:49.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.638+0000 7f9f4547d700 1 --2- 172.21.15.63:0/154214988 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f9f2806cf80 0x7f9f2806f430 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:49.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.638+0000 7f9f4547d700 1 --2- 172.21.15.63:0/154214988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f400fb290 0x7f9f4010d610 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:49.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.638+0000 7f9f4547d700 1 --2- 172.21.15.63:0/154214988 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f400fc4a0 0x7f9f4010db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:49.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.638+0000 7f9f4547d700 1 -- 172.21.15.63:0/154214988 >> 172.21.15.63:0/154214988 conn(0x7f9f400f6950 msgr2=0x7f9f400f8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:49.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.638+0000 7f9f4547d700 1 -- 172.21.15.63:0/154214988 shutdown_connections 2023-12-07T16:23:49.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.638+0000 7f9f4547d700 1 -- 172.21.15.63:0/154214988 wait complete. 2023-12-07T16:23:49.681 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:23:49 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-0[201963]: 2023-12-07T16:23:49.423+0000 7f0ceb584640 -1 osd.0 49 log_to_monitors true 2023-12-07T16:23:49.681 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:23:49 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-0[201963]: 2023-12-07T16:23:49.681+0000 7f0cd89ed700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T16:23:49.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.773+0000 7fdf9408d700 1 -- 172.21.15.63:0/4240828332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf8c0fde00 msgr2=0x7fdf8c0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:49.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.773+0000 7fdf9408d700 1 --2- 172.21.15.63:0/4240828332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf8c0fde00 0x7fdf8c0fe250 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c004880 tx=0x7fdf7c009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:49.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.773+0000 7fdf9408d700 1 -- 172.21.15.63:0/4240828332 shutdown_connections 2023-12-07T16:23:49.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.773+0000 7fdf9408d700 1 --2- 172.21.15.63:0/4240828332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf8c0fde00 0x7fdf8c0fe250 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:49.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.773+0000 7fdf9408d700 1 --2- 172.21.15.63:0/4240828332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf8c0fcbf0 0x7fdf8c0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:49.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.773+0000 7fdf9408d700 1 -- 172.21.15.63:0/4240828332 >> 172.21.15.63:0/4240828332 conn(0x7fdf8c0f82d0 msgr2=0x7fdf8c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:49.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.773+0000 7fdf9408d700 1 -- 172.21.15.63:0/4240828332 shutdown_connections 2023-12-07T16:23:49.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.773+0000 7fdf9408d700 1 -- 172.21.15.63:0/4240828332 wait complete. 2023-12-07T16:23:49.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.773+0000 7fdf9408d700 1 Processor -- start 2023-12-07T16:23:49.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.773+0000 7fdf9408d700 1 -- start start 2023-12-07T16:23:49.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.774+0000 7fdf9408d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf8c0fcbf0 0x7fdf8c10d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:49.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.774+0000 7fdf9408d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf8c0fde00 0x7fdf8c10da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:49.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.774+0000 7fdf9408d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c10e010 con 0x7fdf8c0fde00 2023-12-07T16:23:49.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.774+0000 7fdf9408d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c10e8b0 con 0x7fdf8c0fcbf0 2023-12-07T16:23:49.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.774+0000 7fdf91e29700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf8c0fcbf0 0x7fdf8c10d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:49.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.774+0000 7fdf91e29700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf8c0fcbf0 0x7fdf8c10d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.63:54336/0 (socket says 172.21.15.63:54336) 2023-12-07T16:23:49.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.774+0000 7fdf91e29700 1 -- 172.21.15.63:0/3257216652 learned_addr learned my addr 172.21.15.63:0/3257216652 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:23:49.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.774+0000 7fdf91e29700 1 -- 172.21.15.63:0/3257216652 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf8c0fde00 msgr2=0x7fdf8c10da10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-07T16:23:49.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.774+0000 7fdf91e29700 1 --2- 172.21.15.63:0/3257216652 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf8c0fde00 0x7fdf8c10da10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:49.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.774+0000 7fdf91e29700 1 -- 172.21.15.63:0/3257216652 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf88005040 con 0x7fdf8c0fcbf0 2023-12-07T16:23:49.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.774+0000 7fdf91e29700 1 --2- 172.21.15.63:0/3257216652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf8c0fcbf0 0x7fdf8c10d4d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdf880096b0 tx=0x7fdf88009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:49.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.774+0000 7fdf827fc700 1 -- 172.21.15.63:0/3257216652 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf8800e840 con 0x7fdf8c0fcbf0 2023-12-07T16:23:49.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.775+0000 7fdf827fc700 1 -- 172.21.15.63:0/3257216652 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdf8800f040 con 0x7fdf8c0fcbf0 2023-12-07T16:23:49.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.775+0000 7fdf9408d700 1 -- 172.21.15.63:0/3257216652 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf7c005040 con 0x7fdf8c0fcbf0 2023-12-07T16:23:49.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.775+0000 7fdf827fc700 1 -- 172.21.15.63:0/3257216652 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf88013d60 con 0x7fdf8c0fcbf0 2023-12-07T16:23:49.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.775+0000 7fdf9408d700 1 -- 172.21.15.63:0/3257216652 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8c10eee0 con 0x7fdf8c0fcbf0 2023-12-07T16:23:49.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.775+0000 7fdf9408d700 1 -- 172.21.15.63:0/3257216652 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf8c04bb80 con 0x7fdf8c0fcbf0 2023-12-07T16:23:49.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.776+0000 7fdf827fc700 1 -- 172.21.15.63:0/3257216652 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fdf8800e9a0 con 0x7fdf8c0fcbf0 2023-12-07T16:23:49.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.777+0000 7fdf827fc700 1 --2- 172.21.15.63:0/3257216652 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fdf7806cf80 0x7fdf7806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:49.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.777+0000 7fdf827fc700 1 -- 172.21.15.63:0/3257216652 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 7054+0+0 (secure 0 0 0) 0x7fdf8808c5d0 con 0x7fdf8c0fcbf0 2023-12-07T16:23:49.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.777+0000 7fdf91628700 1 --2- 172.21.15.63:0/3257216652 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fdf7806cf80 0x7fdf7806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:49.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.777+0000 7fdf91628700 1 --2- 172.21.15.63:0/3257216652 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fdf7806cf80 0x7fdf7806f430 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009fd0 tx=0x7fdf7c009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:49.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:49.781+0000 7fdf827fc700 1 -- 172.21.15.63:0/3257216652 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fdf88059b20 con 0x7fdf8c0fcbf0 2023-12-07T16:23:50.094 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.095+0000 7fdf9408d700 1 -- 172.21.15.63:0/3257216652 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdf8c10f350 con 0x7fdf8c0fcbf0 2023-12-07T16:23:50.094 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.096+0000 7fdf827fc700 1 -- 172.21.15.63:0/3257216652 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1891 (secure 0 0 0) 0x7fdf880596b0 con 0x7fdf8c0fcbf0 2023-12-07T16:23:50.094 INFO:teuthology.orchestra.run.smithi063.stdout:e17 2023-12-07T16:23:50.094 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-07T16:23:50.094 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:23:50.094 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-07T16:23:50.094 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:23:50.094 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-07T16:23:50.094 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-07T16:23:50.095 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 17 2023-12-07T16:23:50.095 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-07T16:23:50.095 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-07T16:19:08.352640+0000 2023-12-07T16:23:50.095 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-07T16:22:27.604525+0000 2023-12-07T16:23:50.095 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-07T16:23:50.095 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-07T16:23:50.095 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-07T16:23:50.095 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-07T16:23:50.095 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-07T16:23:50.095 INFO:teuthology.orchestra.run.smithi063.stdout:max_xattr_size 65536 2023-12-07T16:23:50.095 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-07T16:23:50.095 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-07T16:23:50.095 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 45 2023-12-07T16:23:50.095 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:23:50.096 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 2 2023-12-07T16:23:50.096 INFO:teuthology.orchestra.run.smithi063.stdout:in 0,1 2023-12-07T16:23:50.096 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14478,1=24269} 2023-12-07T16:23:50.096 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-07T16:23:50.096 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-07T16:23:50.096 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-07T16:23:50.096 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-07T16:23:50.096 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-07T16:23:50.096 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-07T16:23:50.096 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-07T16:23:50.096 INFO:teuthology.orchestra.run.smithi063.stdout:bal_rank_mask -1 2023-12-07T16:23:50.096 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-07T16:23:50.096 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.yidolg{0:14478} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:23:50.096 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.mrvngf{1:24269} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.152:6824/3157779064,v1:172.21.15.152:6825/3157779064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:23:50.097 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:23:50.097 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:23:50.097 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-07T16:23:50.097 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:23:50.097 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.gsjgcq{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/3063200414,v1:172.21.15.63:6827/3063200414] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:23:50.097 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.aovwwd{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/2906349729,v1:172.21.15.152:6827/2906349729] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:23:50.097 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.098+0000 7fdf9408d700 1 -- 172.21.15.63:0/3257216652 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fdf7806cf80 msgr2=0x7fdf7806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:50.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.098+0000 7fdf9408d700 1 --2- 172.21.15.63:0/3257216652 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fdf7806cf80 0x7fdf7806f430 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009fd0 tx=0x7fdf7c009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:50.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.098+0000 7fdf9408d700 1 -- 172.21.15.63:0/3257216652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf8c0fcbf0 msgr2=0x7fdf8c10d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:50.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.098+0000 7fdf9408d700 1 --2- 172.21.15.63:0/3257216652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf8c0fcbf0 0x7fdf8c10d4d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdf880096b0 tx=0x7fdf88009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:50.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.098+0000 7fdf9408d700 1 -- 172.21.15.63:0/3257216652 shutdown_connections 2023-12-07T16:23:50.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.098+0000 7fdf9408d700 1 --2- 172.21.15.63:0/3257216652 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fdf7806cf80 0x7fdf7806f430 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:50.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.098+0000 7fdf9408d700 1 --2- 172.21.15.63:0/3257216652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf8c0fcbf0 0x7fdf8c10d4d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:50.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.098+0000 7fdf9408d700 1 --2- 172.21.15.63:0/3257216652 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf8c0fde00 0x7fdf8c10da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:50.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.098+0000 7fdf9408d700 1 -- 172.21.15.63:0/3257216652 >> 172.21.15.63:0/3257216652 conn(0x7fdf8c0f82d0 msgr2=0x7fdf8c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:50.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.098+0000 7fdf9408d700 1 -- 172.21.15.63:0/3257216652 shutdown_connections 2023-12-07T16:23:50.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.098+0000 7fdf9408d700 1 -- 172.21.15.63:0/3257216652 wait complete. 2023-12-07T16:23:50.098 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2023-12-07T16:23:50.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:49 smithi063 ceph-mon[192008]: pgmap v41: 65 pgs: 6 peering, 18 active+undersized+degraded, 12 active+undersized, 29 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 67/360 objects degraded (18.611%) 2023-12-07T16:23:50.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:49 smithi063 ceph-mon[192008]: from='client.44129 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:23:50.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:49 smithi063 ceph-mon[192008]: failed to encode map e56 with expected crc 2023-12-07T16:23:50.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:49 smithi063 ceph-mon[192008]: failed to encode map e56 with expected crc 2023-12-07T16:23:50.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:49 smithi063 ceph-mon[192008]: failed to encode map e56 with expected crc 2023-12-07T16:23:50.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:49 smithi063 ceph-mon[192008]: failed to encode map e55 with expected crc 2023-12-07T16:23:50.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:49 smithi063 ceph-mon[192008]: from='osd.0 [v2:172.21.15.63:6802/1000489680,v1:172.21.15.63:6803/1000489680]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-07T16:23:50.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:49 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/154214988' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:23:50.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:49 smithi063 ceph-mon[192008]: from='osd.0 [v2:172.21.15.63:6802/1000489680,v1:172.21.15.63:6803/1000489680]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-07T16:23:50.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:49 smithi063 ceph-mon[192008]: osdmap e57: 6 total, 5 up, 6 in 2023-12-07T16:23:50.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:49 smithi063 ceph-mon[192008]: from='osd.0 [v2:172.21.15.63:6802/1000489680,v1:172.21.15.63:6803/1000489680]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-07T16:23:50.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.216+0000 7fb5dd9f1700 1 -- 172.21.15.63:0/3912188273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5d80fcbf0 msgr2=0x7fb5d80fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:50.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.216+0000 7fb5dd9f1700 1 --2- 172.21.15.63:0/3912188273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5d80fcbf0 0x7fb5d80fd000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8004940 tx=0x7fb5c8009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:50.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.216+0000 7fb5dd9f1700 1 -- 172.21.15.63:0/3912188273 shutdown_connections 2023-12-07T16:23:50.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.216+0000 7fb5dd9f1700 1 --2- 172.21.15.63:0/3912188273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5d80fde00 0x7fb5d80fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:50.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.216+0000 7fb5dd9f1700 1 --2- 172.21.15.63:0/3912188273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5d80fcbf0 0x7fb5d80fd000 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:50.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.216+0000 7fb5dd9f1700 1 -- 172.21.15.63:0/3912188273 >> 172.21.15.63:0/3912188273 conn(0x7fb5d80f82d0 msgr2=0x7fb5d80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:50.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.216+0000 7fb5dd9f1700 1 -- 172.21.15.63:0/3912188273 shutdown_connections 2023-12-07T16:23:50.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.216+0000 7fb5dd9f1700 1 -- 172.21.15.63:0/3912188273 wait complete. 2023-12-07T16:23:50.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.217+0000 7fb5dd9f1700 1 Processor -- start 2023-12-07T16:23:50.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.217+0000 7fb5dd9f1700 1 -- start start 2023-12-07T16:23:50.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.217+0000 7fb5dd9f1700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5d80fcbf0 0x7fb5d810d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.217+0000 7fb5dd9f1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5d80fde00 0x7fb5d810da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.217+0000 7fb5dd9f1700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d810e010 con 0x7fb5d80fcbf0 2023-12-07T16:23:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.217+0000 7fb5dd9f1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d810e8b0 con 0x7fb5d80fde00 2023-12-07T16:23:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.217+0000 7fb5d6ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5d80fcbf0 0x7fb5d810d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.217+0000 7fb5d6ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5d80fcbf0 0x7fb5d810d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46826/0 (socket says 172.21.15.63:46826) 2023-12-07T16:23:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.217+0000 7fb5d6ffd700 1 -- 172.21.15.63:0/1971861349 learned_addr learned my addr 172.21.15.63:0/1971861349 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:23:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.217+0000 7fb5d67fc700 1 --2- 172.21.15.63:0/1971861349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5d80fde00 0x7fb5d810da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.217+0000 7fb5d6ffd700 1 -- 172.21.15.63:0/1971861349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5d80fde00 msgr2=0x7fb5d810da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.217+0000 7fb5d6ffd700 1 --2- 172.21.15.63:0/1971861349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5d80fde00 0x7fb5d810da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.217+0000 7fb5d6ffd700 1 -- 172.21.15.63:0/1971861349 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c8005040 con 0x7fb5d80fcbf0 2023-12-07T16:23:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.218+0000 7fb5d6ffd700 1 --2- 172.21.15.63:0/1971861349 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5d80fcbf0 0x7fb5d810d4d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8000c00 tx=0x7fb5c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.218+0000 7fb5bf7fe700 1 -- 172.21.15.63:0/1971861349 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5c8021070 con 0x7fb5d80fcbf0 2023-12-07T16:23:50.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.218+0000 7fb5dd9f1700 1 -- 172.21.15.63:0/1971861349 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d810eb30 con 0x7fb5d80fcbf0 2023-12-07T16:23:50.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.218+0000 7fb5dd9f1700 1 -- 172.21.15.63:0/1971861349 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d810f010 con 0x7fb5d80fcbf0 2023-12-07T16:23:50.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.218+0000 7fb5bf7fe700 1 -- 172.21.15.63:0/1971861349 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb5c801c400 con 0x7fb5d80fcbf0 2023-12-07T16:23:50.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.218+0000 7fb5bf7fe700 1 -- 172.21.15.63:0/1971861349 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5c800e070 con 0x7fb5d80fcbf0 2023-12-07T16:23:50.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.219+0000 7fb5dd9f1700 1 -- 172.21.15.63:0/1971861349 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d804bb80 con 0x7fb5d80fcbf0 2023-12-07T16:23:50.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.220+0000 7fb5bf7fe700 1 -- 172.21.15.63:0/1971861349 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fb5c801ca00 con 0x7fb5d80fcbf0 2023-12-07T16:23:50.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.221+0000 7fb5bf7fe700 1 --2- 172.21.15.63:0/1971861349 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fb5c006cf80 0x7fb5c006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:50.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.221+0000 7fb5bf7fe700 1 -- 172.21.15.63:0/1971861349 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 7054+0+0 (secure 0 0 0) 0x7fb5c808e170 con 0x7fb5d80fcbf0 2023-12-07T16:23:50.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.221+0000 7fb5d67fc700 1 --2- 172.21.15.63:0/1971861349 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fb5c006cf80 0x7fb5c006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:50.220 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.222+0000 7fb5d67fc700 1 --2- 172.21.15.63:0/1971861349 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fb5c006cf80 0x7fb5c006f430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc009b80 tx=0x7fb5cc00b040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:50.223 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.225+0000 7fb5bf7fe700 1 -- 172.21.15.63:0/1971861349 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb5c805b6e0 con 0x7fb5d80fcbf0 2023-12-07T16:23:50.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:49 smithi152 ceph-mon[175645]: pgmap v41: 65 pgs: 6 peering, 18 active+undersized+degraded, 12 active+undersized, 29 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 67/360 objects degraded (18.611%) 2023-12-07T16:23:50.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:49 smithi152 ceph-mon[175645]: from='client.44129 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:23:50.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:49 smithi152 ceph-mon[175645]: failed to encode map e56 with expected crc 2023-12-07T16:23:50.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:49 smithi152 ceph-mon[175645]: failed to encode map e56 with expected crc 2023-12-07T16:23:50.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:49 smithi152 ceph-mon[175645]: failed to encode map e56 with expected crc 2023-12-07T16:23:50.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:49 smithi152 ceph-mon[175645]: failed to encode map e55 with expected crc 2023-12-07T16:23:50.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:49 smithi152 ceph-mon[175645]: from='osd.0 [v2:172.21.15.63:6802/1000489680,v1:172.21.15.63:6803/1000489680]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-07T16:23:50.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:49 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/154214988' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:23:50.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:49 smithi152 ceph-mon[175645]: from='osd.0 [v2:172.21.15.63:6802/1000489680,v1:172.21.15.63:6803/1000489680]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-07T16:23:50.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:49 smithi152 ceph-mon[175645]: osdmap e57: 6 total, 5 up, 6 in 2023-12-07T16:23:50.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:49 smithi152 ceph-mon[175645]: from='osd.0 [v2:172.21.15.63:6802/1000489680,v1:172.21.15.63:6803/1000489680]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-07T16:23:50.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.499+0000 7fb5dd9f1700 1 -- 172.21.15.63:0/1971861349 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5d8102750 con 0x7fb5c006cf80 2023-12-07T16:23:50.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.501+0000 7fb5bf7fe700 1 -- 172.21.15.63:0/1971861349 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb5d8102750 con 0x7fb5c006cf80 2023-12-07T16:23:50.499 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:23:50.499 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-07T16:23:50.499 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-07T16:23:50.499 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-07T16:23:50.499 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [ 2023-12-07T16:23:50.499 INFO:teuthology.orchestra.run.smithi063.stdout: "crash", 2023-12-07T16:23:50.499 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr", 2023-12-07T16:23:50.500 INFO:teuthology.orchestra.run.smithi063.stdout: "mon" 2023-12-07T16:23:50.500 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2023-12-07T16:23:50.500 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "7/21 daemons upgraded", 2023-12-07T16:23:50.500 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "Currently upgrading osd daemons", 2023-12-07T16:23:50.500 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-07T16:23:50.500 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:23:50.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.503+0000 7fb5dd9f1700 1 -- 172.21.15.63:0/1971861349 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fb5c006cf80 msgr2=0x7fb5c006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:50.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.503+0000 7fb5dd9f1700 1 --2- 172.21.15.63:0/1971861349 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fb5c006cf80 0x7fb5c006f430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc009b80 tx=0x7fb5cc00b040 comp rx=0 tx=0).stop 2023-12-07T16:23:50.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.503+0000 7fb5dd9f1700 1 -- 172.21.15.63:0/1971861349 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5d80fcbf0 msgr2=0x7fb5d810d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:50.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.503+0000 7fb5dd9f1700 1 --2- 172.21.15.63:0/1971861349 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5d80fcbf0 0x7fb5d810d4d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8000c00 tx=0x7fb5c8009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:50.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.503+0000 7fb5dd9f1700 1 -- 172.21.15.63:0/1971861349 shutdown_connections 2023-12-07T16:23:50.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.503+0000 7fb5dd9f1700 1 --2- 172.21.15.63:0/1971861349 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fb5c006cf80 0x7fb5c006f430 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:50.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.503+0000 7fb5dd9f1700 1 --2- 172.21.15.63:0/1971861349 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb5d80fcbf0 0x7fb5d810d4d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:50.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.503+0000 7fb5dd9f1700 1 --2- 172.21.15.63:0/1971861349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5d80fde00 0x7fb5d810da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:50.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.503+0000 7fb5dd9f1700 1 -- 172.21.15.63:0/1971861349 >> 172.21.15.63:0/1971861349 conn(0x7fb5d80f82d0 msgr2=0x7fb5d8101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:50.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.503+0000 7fb5dd9f1700 1 -- 172.21.15.63:0/1971861349 shutdown_connections 2023-12-07T16:23:50.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.503+0000 7fb5dd9f1700 1 -- 172.21.15.63:0/1971861349 wait complete. 2023-12-07T16:23:50.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.610+0000 7f36c027c700 1 -- 172.21.15.63:0/650941585 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36b80ffd90 msgr2=0x7f36b81021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:50.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.610+0000 7f36c027c700 1 --2- 172.21.15.63:0/650941585 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36b80ffd90 0x7f36b81021d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f36a8004940 tx=0x7f36a8009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:50.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.611+0000 7f36c027c700 1 -- 172.21.15.63:0/650941585 shutdown_connections 2023-12-07T16:23:50.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.611+0000 7f36c027c700 1 --2- 172.21.15.63:0/650941585 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36b80ffd90 0x7f36b81021d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:50.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.611+0000 7f36c027c700 1 --2- 172.21.15.63:0/650941585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36b8066070 0x7f36b80ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:50.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.611+0000 7f36c027c700 1 -- 172.21.15.63:0/650941585 >> 172.21.15.63:0/650941585 conn(0x7f36b80f7190 msgr2=0x7f36b80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:50.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.611+0000 7f36c027c700 1 -- 172.21.15.63:0/650941585 shutdown_connections 2023-12-07T16:23:50.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.611+0000 7f36c027c700 1 -- 172.21.15.63:0/650941585 wait complete. 2023-12-07T16:23:50.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.611+0000 7f36c027c700 1 Processor -- start 2023-12-07T16:23:50.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.611+0000 7f36c027c700 1 -- start start 2023-12-07T16:23:50.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.611+0000 7f36c027c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36b8066070 0x7f36b810d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:50.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.611+0000 7f36c027c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36b80ffd90 0x7f36b810dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:50.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.611+0000 7f36c027c700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b810e0b0 con 0x7f36b80ffd90 2023-12-07T16:23:50.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.611+0000 7f36c027c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b810e950 con 0x7f36b8066070 2023-12-07T16:23:50.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.611+0000 7f36bd817700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36b80ffd90 0x7f36b810dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:50.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.612+0000 7f36bd817700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36b80ffd90 0x7f36b810dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46852/0 (socket says 172.21.15.63:46852) 2023-12-07T16:23:50.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.612+0000 7f36bd817700 1 -- 172.21.15.63:0/66947049 learned_addr learned my addr 172.21.15.63:0/66947049 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:23:50.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.612+0000 7f36be018700 1 --2- 172.21.15.63:0/66947049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36b8066070 0x7f36b810d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:50.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.612+0000 7f36bd817700 1 -- 172.21.15.63:0/66947049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36b8066070 msgr2=0x7f36b810d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:50.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.612+0000 7f36bd817700 1 --2- 172.21.15.63:0/66947049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36b8066070 0x7f36b810d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:50.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.612+0000 7f36bd817700 1 -- 172.21.15.63:0/66947049 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a8005040 con 0x7f36b80ffd90 2023-12-07T16:23:50.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.612+0000 7f36bd817700 1 --2- 172.21.15.63:0/66947049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36b80ffd90 0x7f36b810dab0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f36a8004f90 tx=0x7f36a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:50.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.612+0000 7f36aeffd700 1 -- 172.21.15.63:0/66947049 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36a800e040 con 0x7f36b80ffd90 2023-12-07T16:23:50.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.612+0000 7f36c027c700 1 -- 172.21.15.63:0/66947049 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b810ebd0 con 0x7f36b80ffd90 2023-12-07T16:23:50.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.612+0000 7f36aeffd700 1 -- 172.21.15.63:0/66947049 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f36a800bcd0 con 0x7f36b80ffd90 2023-12-07T16:23:50.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.612+0000 7f36aeffd700 1 -- 172.21.15.63:0/66947049 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36a801c630 con 0x7f36b80ffd90 2023-12-07T16:23:50.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.612+0000 7f36c027c700 1 -- 172.21.15.63:0/66947049 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b810f110 con 0x7f36b80ffd90 2023-12-07T16:23:50.613 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.613+0000 7f36c027c700 1 -- 172.21.15.63:0/66947049 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b81075c0 con 0x7f36b80ffd90 2023-12-07T16:23:50.613 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.614+0000 7f36aeffd700 1 -- 172.21.15.63:0/66947049 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 37) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f36a8013960 con 0x7f36b80ffd90 2023-12-07T16:23:50.613 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.614+0000 7f36aeffd700 1 --2- 172.21.15.63:0/66947049 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f36a406cf80 0x7f36a406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:23:50.613 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.614+0000 7f36aeffd700 1 -- 172.21.15.63:0/66947049 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 7054+0+0 (secure 0 0 0) 0x7f36a808dcb0 con 0x7f36b80ffd90 2023-12-07T16:23:50.613 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.614+0000 7f36be018700 1 --2- 172.21.15.63:0/66947049 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f36a406cf80 0x7f36a406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:23:50.613 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.615+0000 7f36be018700 1 --2- 172.21.15.63:0/66947049 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f36a406cf80 0x7f36a406f430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f36b4004990 tx=0x7f36b4009ee0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:23:50.617 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.619+0000 7f36aeffd700 1 -- 172.21.15.63:0/66947049 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f36a805b200 con 0x7f36b80ffd90 2023-12-07T16:23:50.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.949+0000 7f36c027c700 1 -- 172.21.15.63:0/66947049 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f36b804bb80 con 0x7f36b80ffd90 2023-12-07T16:23:50.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.949+0000 7f36aeffd700 1 -- 172.21.15.63:0/66947049 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1374 (secure 0 0 0) 0x7f36a805ad90 con 0x7f36b80ffd90 2023-12-07T16:23:50.948 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 67/360 objects degraded (18.611%), 18 pgs degraded 2023-12-07T16:23:50.948 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-07T16:23:50.948 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-07T16:23:50.948 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 67/360 objects degraded (18.611%), 18 pgs degraded 2023-12-07T16:23:50.948 INFO:teuthology.orchestra.run.smithi063.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2023-12-07T16:23:50.948 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2023-12-07T16:23:50.948 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2023-12-07T16:23:50.948 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2023-12-07T16:23:50.948 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2023-12-07T16:23:50.948 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2023-12-07T16:23:50.948 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2023-12-07T16:23:50.948 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2023-12-07T16:23:50.949 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2023-12-07T16:23:50.949 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2023-12-07T16:23:50.949 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.12 is active+undersized+degraded, acting [3,1] 2023-12-07T16:23:50.949 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2023-12-07T16:23:50.949 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2023-12-07T16:23:50.949 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2023-12-07T16:23:50.949 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2023-12-07T16:23:50.949 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2023-12-07T16:23:50.949 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2023-12-07T16:23:50.949 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2023-12-07T16:23:50.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.951+0000 7f36c027c700 1 -- 172.21.15.63:0/66947049 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f36a406cf80 msgr2=0x7f36a406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:50.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.951+0000 7f36c027c700 1 --2- 172.21.15.63:0/66947049 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f36a406cf80 0x7f36a406f430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f36b4004990 tx=0x7f36b4009ee0 comp rx=0 tx=0).stop 2023-12-07T16:23:50.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.951+0000 7f36c027c700 1 -- 172.21.15.63:0/66947049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36b80ffd90 msgr2=0x7f36b810dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:23:50.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.951+0000 7f36c027c700 1 --2- 172.21.15.63:0/66947049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36b80ffd90 0x7f36b810dab0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f36a8004f90 tx=0x7f36a8009e30 comp rx=0 tx=0).stop 2023-12-07T16:23:50.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.952+0000 7f36c027c700 1 -- 172.21.15.63:0/66947049 shutdown_connections 2023-12-07T16:23:50.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.952+0000 7f36c027c700 1 --2- 172.21.15.63:0/66947049 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f36a406cf80 0x7f36a406f430 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:50.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.952+0000 7f36c027c700 1 --2- 172.21.15.63:0/66947049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36b8066070 0x7f36b810d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:50.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.952+0000 7f36c027c700 1 --2- 172.21.15.63:0/66947049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36b80ffd90 0x7f36b810dab0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:23:50.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.952+0000 7f36c027c700 1 -- 172.21.15.63:0/66947049 >> 172.21.15.63:0/66947049 conn(0x7f36b80f7190 msgr2=0x7f36b80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:23:50.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.952+0000 7f36c027c700 1 -- 172.21.15.63:0/66947049 shutdown_connections 2023-12-07T16:23:50.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:23:50.952+0000 7f36c027c700 1 -- 172.21.15.63:0/66947049 wait complete. 2023-12-07T16:23:51.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:50 smithi063 ceph-mon[192008]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:23:51.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:50 smithi063 ceph-mon[192008]: from='client.34170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:23:51.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:50 smithi063 ceph-mon[192008]: failed to encode map e57 with expected crc 2023-12-07T16:23:51.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:50 smithi063 ceph-mon[192008]: failed to encode map e57 with expected crc 2023-12-07T16:23:51.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:50 smithi063 ceph-mon[192008]: failed to encode map e57 with expected crc 2023-12-07T16:23:51.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:50 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/3257216652' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:23:51.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:50 smithi063 ceph-mon[192008]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-07T16:23:51.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:50 smithi063 ceph-mon[192008]: osd.0 [v2:172.21.15.63:6802/1000489680,v1:172.21.15.63:6803/1000489680] boot 2023-12-07T16:23:51.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:50 smithi063 ceph-mon[192008]: osdmap e58: 6 total, 6 up, 6 in 2023-12-07T16:23:51.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:50 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-07T16:23:51.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:50 smithi152 ceph-mon[175645]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:23:51.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:50 smithi152 ceph-mon[175645]: from='client.34170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:23:51.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:50 smithi152 ceph-mon[175645]: failed to encode map e57 with expected crc 2023-12-07T16:23:51.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:50 smithi152 ceph-mon[175645]: failed to encode map e57 with expected crc 2023-12-07T16:23:51.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:50 smithi152 ceph-mon[175645]: failed to encode map e57 with expected crc 2023-12-07T16:23:51.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:50 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/3257216652' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:23:51.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:50 smithi152 ceph-mon[175645]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-07T16:23:51.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:50 smithi152 ceph-mon[175645]: osd.0 [v2:172.21.15.63:6802/1000489680,v1:172.21.15.63:6803/1000489680] boot 2023-12-07T16:23:51.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:50 smithi152 ceph-mon[175645]: osdmap e58: 6 total, 6 up, 6 in 2023-12-07T16:23:51.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:50 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-07T16:23:51.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:51 smithi063 ceph-mon[192008]: pgmap v44: 65 pgs: 26 active+clean, 1 active+recovering+undersized+remapped, 12 active+undersized, 18 active+undersized+degraded, 7 active+clean+remapped, 1 remapped+peering; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 67/360 objects degraded (18.611%); 10/360 objects misplaced (2.778%); 1.6 MiB/s, 251 objects/s recovering 2023-12-07T16:23:51.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:51 smithi063 ceph-mon[192008]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:23:51.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:51 smithi063 ceph-mon[192008]: failed to encode map e58 with expected crc 2023-12-07T16:23:51.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:51 smithi063 ceph-mon[192008]: failed to encode map e58 with expected crc 2023-12-07T16:23:51.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:51 smithi063 ceph-mon[192008]: failed to encode map e58 with expected crc 2023-12-07T16:23:51.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:51 smithi063 ceph-mon[192008]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-07T16:23:51.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:51 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/66947049' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:23:51.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:51 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:51.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:51 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:51.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:51 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:51.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:51 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:23:51.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:51 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:51.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:51 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:23:51.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:51 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:23:51.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:51 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:23:51.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:51 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:23:51.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:51 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-07T16:23:51.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:51 smithi063 ceph-mon[192008]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-07T16:23:51.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:51 smithi063 ceph-mon[192008]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-12-07T16:23:51.907 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:51 smithi063 ceph-mon[192008]: osdmap e59: 6 total, 6 up, 6 in 2023-12-07T16:23:52.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:51 smithi152 ceph-mon[175645]: pgmap v44: 65 pgs: 26 active+clean, 1 active+recovering+undersized+remapped, 12 active+undersized, 18 active+undersized+degraded, 7 active+clean+remapped, 1 remapped+peering; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 67/360 objects degraded (18.611%); 10/360 objects misplaced (2.778%); 1.6 MiB/s, 251 objects/s recovering 2023-12-07T16:23:52.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:51 smithi152 ceph-mon[175645]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:23:52.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:51 smithi152 ceph-mon[175645]: failed to encode map e58 with expected crc 2023-12-07T16:23:52.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:51 smithi152 ceph-mon[175645]: failed to encode map e58 with expected crc 2023-12-07T16:23:52.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:51 smithi152 ceph-mon[175645]: failed to encode map e58 with expected crc 2023-12-07T16:23:52.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:51 smithi152 ceph-mon[175645]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-07T16:23:52.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:51 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/66947049' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:23:52.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:51 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:52.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:51 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:52.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:51 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:23:52.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:51 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:23:52.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:51 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:23:52.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:51 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:23:52.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:51 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:23:52.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:51 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:23:52.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:51 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:23:52.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:51 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-07T16:23:52.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:51 smithi152 ceph-mon[175645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-07T16:23:52.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:51 smithi152 ceph-mon[175645]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-12-07T16:23:52.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:51 smithi152 ceph-mon[175645]: osdmap e59: 6 total, 6 up, 6 in 2023-12-07T16:23:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:52 smithi063 ceph-mon[192008]: failed to encode map e59 with expected crc 2023-12-07T16:23:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:52 smithi063 ceph-mon[192008]: failed to encode map e59 with expected crc 2023-12-07T16:23:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:52 smithi063 ceph-mon[192008]: failed to encode map e59 with expected crc 2023-12-07T16:23:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:52 smithi063 ceph-mon[192008]: failed to encode map e59 with expected crc 2023-12-07T16:23:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:52 smithi063 ceph-mon[192008]: failed to encode map e59 with expected crc 2023-12-07T16:23:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:52 smithi063 ceph-mon[192008]: failed to encode map e59 with expected crc 2023-12-07T16:23:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:52 smithi063 ceph-mon[192008]: failed to encode map e59 with expected crc 2023-12-07T16:23:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:52 smithi063 ceph-mon[192008]: pgmap v47: 65 pgs: 26 active+clean, 1 active+recovering+undersized+remapped, 12 active+undersized, 18 active+undersized+degraded, 7 active+clean+remapped, 1 remapped+peering; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 67/360 objects degraded (18.611%); 10/360 objects misplaced (2.778%); 1.6 MiB/s, 251 objects/s recovering 2023-12-07T16:23:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:52 smithi063 ceph-mon[192008]: osdmap e60: 6 total, 6 up, 6 in 2023-12-07T16:23:53.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:52 smithi152 ceph-mon[175645]: failed to encode map e59 with expected crc 2023-12-07T16:23:53.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:52 smithi152 ceph-mon[175645]: failed to encode map e59 with expected crc 2023-12-07T16:23:53.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:52 smithi152 ceph-mon[175645]: failed to encode map e59 with expected crc 2023-12-07T16:23:53.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:52 smithi152 ceph-mon[175645]: failed to encode map e59 with expected crc 2023-12-07T16:23:53.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:52 smithi152 ceph-mon[175645]: failed to encode map e59 with expected crc 2023-12-07T16:23:53.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:52 smithi152 ceph-mon[175645]: failed to encode map e59 with expected crc 2023-12-07T16:23:53.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:52 smithi152 ceph-mon[175645]: failed to encode map e59 with expected crc 2023-12-07T16:23:53.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:52 smithi152 ceph-mon[175645]: pgmap v47: 65 pgs: 26 active+clean, 1 active+recovering+undersized+remapped, 12 active+undersized, 18 active+undersized+degraded, 7 active+clean+remapped, 1 remapped+peering; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 67/360 objects degraded (18.611%); 10/360 objects misplaced (2.778%); 1.6 MiB/s, 251 objects/s recovering 2023-12-07T16:23:53.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:52 smithi152 ceph-mon[175645]: osdmap e60: 6 total, 6 up, 6 in 2023-12-07T16:23:54.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:53 smithi063 ceph-mon[192008]: failed to encode map e60 with expected crc 2023-12-07T16:23:54.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:53 smithi063 ceph-mon[192008]: failed to encode map e60 with expected crc 2023-12-07T16:23:54.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:53 smithi063 ceph-mon[192008]: failed to encode map e60 with expected crc 2023-12-07T16:23:54.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:53 smithi063 ceph-mon[192008]: failed to encode map e60 with expected crc 2023-12-07T16:23:54.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:53 smithi063 ceph-mon[192008]: failed to encode map e60 with expected crc 2023-12-07T16:23:54.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:53 smithi063 ceph-mon[192008]: failed to encode map e60 with expected crc 2023-12-07T16:23:54.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:53 smithi152 ceph-mon[175645]: failed to encode map e60 with expected crc 2023-12-07T16:23:54.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:53 smithi152 ceph-mon[175645]: failed to encode map e60 with expected crc 2023-12-07T16:23:54.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:53 smithi152 ceph-mon[175645]: failed to encode map e60 with expected crc 2023-12-07T16:23:54.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:53 smithi152 ceph-mon[175645]: failed to encode map e60 with expected crc 2023-12-07T16:23:54.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:53 smithi152 ceph-mon[175645]: failed to encode map e60 with expected crc 2023-12-07T16:23:54.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:53 smithi152 ceph-mon[175645]: failed to encode map e60 with expected crc 2023-12-07T16:23:55.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:54 smithi063 ceph-mon[192008]: failed to encode map e61 with expected crc 2023-12-07T16:23:55.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:54 smithi063 ceph-mon[192008]: osdmap e61: 6 total, 6 up, 6 in 2023-12-07T16:23:55.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:54 smithi063 ceph-mon[192008]: failed to encode map e61 with expected crc 2023-12-07T16:23:55.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:54 smithi063 ceph-mon[192008]: failed to encode map e61 with expected crc 2023-12-07T16:23:55.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:54 smithi063 ceph-mon[192008]: pgmap v50: 65 pgs: 26 active+clean, 1 active+recovering+undersized+remapped, 12 active+undersized, 18 active+undersized+degraded, 7 active+clean+remapped, 1 remapped+peering; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 67/360 objects degraded (18.611%); 10/360 objects misplaced (2.778%) 2023-12-07T16:23:55.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:54 smithi152 ceph-mon[175645]: failed to encode map e61 with expected crc 2023-12-07T16:23:55.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:54 smithi152 ceph-mon[175645]: osdmap e61: 6 total, 6 up, 6 in 2023-12-07T16:23:55.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:54 smithi152 ceph-mon[175645]: failed to encode map e61 with expected crc 2023-12-07T16:23:55.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:54 smithi152 ceph-mon[175645]: failed to encode map e61 with expected crc 2023-12-07T16:23:55.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:54 smithi152 ceph-mon[175645]: pgmap v50: 65 pgs: 26 active+clean, 1 active+recovering+undersized+remapped, 12 active+undersized, 18 active+undersized+degraded, 7 active+clean+remapped, 1 remapped+peering; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 67/360 objects degraded (18.611%); 10/360 objects misplaced (2.778%) 2023-12-07T16:23:56.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:55 smithi063 ceph-mon[192008]: failed to encode map e61 with expected crc 2023-12-07T16:23:56.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:55 smithi063 ceph-mon[192008]: osdmap e62: 6 total, 6 up, 6 in 2023-12-07T16:23:56.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:55 smithi063 ceph-mon[192008]: failed to encode map e62 with expected crc 2023-12-07T16:23:56.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:55 smithi063 ceph-mon[192008]: failed to encode map e62 with expected crc 2023-12-07T16:23:56.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:55 smithi063 ceph-mon[192008]: failed to encode map e62 with expected crc 2023-12-07T16:23:56.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:55 smithi063 ceph-mon[192008]: failed to encode map e62 with expected crc 2023-12-07T16:23:56.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:55 smithi063 ceph-mon[192008]: failed to encode map e62 with expected crc 2023-12-07T16:23:56.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:55 smithi152 ceph-mon[175645]: failed to encode map e61 with expected crc 2023-12-07T16:23:56.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:55 smithi152 ceph-mon[175645]: osdmap e62: 6 total, 6 up, 6 in 2023-12-07T16:23:56.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:55 smithi152 ceph-mon[175645]: failed to encode map e62 with expected crc 2023-12-07T16:23:56.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:55 smithi152 ceph-mon[175645]: failed to encode map e62 with expected crc 2023-12-07T16:23:56.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:55 smithi152 ceph-mon[175645]: failed to encode map e62 with expected crc 2023-12-07T16:23:56.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:55 smithi152 ceph-mon[175645]: failed to encode map e62 with expected crc 2023-12-07T16:23:56.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:55 smithi152 ceph-mon[175645]: failed to encode map e62 with expected crc 2023-12-07T16:23:57.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:56 smithi063 ceph-mon[192008]: failed to encode map e63 with expected crc 2023-12-07T16:23:57.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:56 smithi063 ceph-mon[192008]: osdmap e63: 6 total, 6 up, 6 in 2023-12-07T16:23:57.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:56 smithi063 ceph-mon[192008]: failed to encode map e63 with expected crc 2023-12-07T16:23:57.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:56 smithi063 ceph-mon[192008]: failed to encode map e63 with expected crc 2023-12-07T16:23:57.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:56 smithi063 ceph-mon[192008]: pgmap v53: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 2 peering, 61 active+clean, 1 active+recovering+undersized+remapped; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 708/360 objects degraded (196.667%); 4.0 MiB/s, 0 keys/s, 443 objects/s recovering 2023-12-07T16:23:57.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:56 smithi152 ceph-mon[175645]: failed to encode map e63 with expected crc 2023-12-07T16:23:57.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:56 smithi152 ceph-mon[175645]: osdmap e63: 6 total, 6 up, 6 in 2023-12-07T16:23:57.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:56 smithi152 ceph-mon[175645]: failed to encode map e63 with expected crc 2023-12-07T16:23:57.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:56 smithi152 ceph-mon[175645]: failed to encode map e63 with expected crc 2023-12-07T16:23:57.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:56 smithi152 ceph-mon[175645]: pgmap v53: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 2 peering, 61 active+clean, 1 active+recovering+undersized+remapped; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 708/360 objects degraded (196.667%); 4.0 MiB/s, 0 keys/s, 443 objects/s recovering 2023-12-07T16:23:58.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:57 smithi063 ceph-mon[192008]: Health check update: Degraded data redundancy: 708/360 objects degraded (196.667%), 1 pg degraded (PG_DEGRADED) 2023-12-07T16:23:58.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:57 smithi063 ceph-mon[192008]: failed to encode map e64 with expected crc 2023-12-07T16:23:58.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:57 smithi063 ceph-mon[192008]: osdmap e64: 6 total, 6 up, 6 in 2023-12-07T16:23:58.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:57 smithi063 ceph-mon[192008]: failed to encode map e64 with expected crc 2023-12-07T16:23:58.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:57 smithi063 ceph-mon[192008]: failed to encode map e64 with expected crc 2023-12-07T16:23:58.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:57 smithi063 ceph-mon[192008]: osdmap e65: 6 total, 6 up, 6 in 2023-12-07T16:23:58.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:57 smithi152 ceph-mon[175645]: Health check update: Degraded data redundancy: 708/360 objects degraded (196.667%), 1 pg degraded (PG_DEGRADED) 2023-12-07T16:23:58.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:57 smithi152 ceph-mon[175645]: failed to encode map e64 with expected crc 2023-12-07T16:23:58.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:57 smithi152 ceph-mon[175645]: osdmap e64: 6 total, 6 up, 6 in 2023-12-07T16:23:58.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:57 smithi152 ceph-mon[175645]: failed to encode map e64 with expected crc 2023-12-07T16:23:58.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:57 smithi152 ceph-mon[175645]: failed to encode map e64 with expected crc 2023-12-07T16:23:58.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:57 smithi152 ceph-mon[175645]: osdmap e65: 6 total, 6 up, 6 in 2023-12-07T16:23:59.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:58 smithi063 ceph-mon[192008]: failed to encode map e65 with expected crc 2023-12-07T16:23:59.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:58 smithi063 ceph-mon[192008]: failed to encode map e65 with expected crc 2023-12-07T16:23:59.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:58 smithi063 ceph-mon[192008]: pgmap v56: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 2 peering, 61 active+clean, 1 active+recovering+undersized+remapped; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 708/360 objects degraded (196.667%); 4.0 MiB/s, 0 keys/s, 443 objects/s recovering 2023-12-07T16:23:59.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:23:58 smithi063 ceph-mon[192008]: osdmap e66: 6 total, 6 up, 6 in 2023-12-07T16:23:59.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:58 smithi152 ceph-mon[175645]: failed to encode map e65 with expected crc 2023-12-07T16:23:59.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:58 smithi152 ceph-mon[175645]: failed to encode map e65 with expected crc 2023-12-07T16:23:59.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:58 smithi152 ceph-mon[175645]: pgmap v56: 65 pgs: 1 active+recovery_wait+undersized+degraded+remapped, 2 peering, 61 active+clean, 1 active+recovering+undersized+remapped; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 708/360 objects degraded (196.667%); 4.0 MiB/s, 0 keys/s, 443 objects/s recovering 2023-12-07T16:23:59.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:23:58 smithi152 ceph-mon[175645]: osdmap e66: 6 total, 6 up, 6 in 2023-12-07T16:24:00.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:00 smithi063 ceph-mon[192008]: failed to encode map e66 with expected crc 2023-12-07T16:24:00.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:00 smithi063 ceph-mon[192008]: failed to encode map e66 with expected crc 2023-12-07T16:24:00.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:00 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:00.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:00 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:24:00.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:00 smithi063 ceph-mon[192008]: failed to encode map e66 with expected crc 2023-12-07T16:24:00.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:00 smithi152 ceph-mon[175645]: failed to encode map e66 with expected crc 2023-12-07T16:24:00.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:00 smithi152 ceph-mon[175645]: failed to encode map e66 with expected crc 2023-12-07T16:24:00.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:00 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:00.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:00 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:24:00.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:00 smithi152 ceph-mon[175645]: failed to encode map e66 with expected crc 2023-12-07T16:24:01.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:01 smithi063 ceph-mon[192008]: pgmap v58: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s, 10 objects/s recovering 2023-12-07T16:24:01.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:01 smithi063 ceph-mon[192008]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 708/360 objects degraded (196.667%), 1 pg degraded) 2023-12-07T16:24:01.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:01 smithi063 ceph-mon[192008]: failed to encode map e66 with expected crc 2023-12-07T16:24:01.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:01 smithi063 ceph-mon[192008]: failed to encode map e66 with expected crc 2023-12-07T16:24:01.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:01 smithi152 ceph-mon[175645]: pgmap v58: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s, 10 objects/s recovering 2023-12-07T16:24:01.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:01 smithi152 ceph-mon[175645]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 708/360 objects degraded (196.667%), 1 pg degraded) 2023-12-07T16:24:01.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:01 smithi152 ceph-mon[175645]: failed to encode map e66 with expected crc 2023-12-07T16:24:01.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:01 smithi152 ceph-mon[175645]: failed to encode map e66 with expected crc 2023-12-07T16:24:03.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:03 smithi152 ceph-mon[175645]: pgmap v59: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s, 7 objects/s recovering 2023-12-07T16:24:04.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:03 smithi063 ceph-mon[192008]: pgmap v59: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s, 7 objects/s recovering 2023-12-07T16:24:05.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:05 smithi152 ceph-mon[175645]: pgmap v60: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s, 6 objects/s recovering 2023-12-07T16:24:06.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:05 smithi063 ceph-mon[192008]: pgmap v60: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s, 6 objects/s recovering 2023-12-07T16:24:06.959 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:06 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-07T16:24:06.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:06 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-07T16:24:07.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:07 smithi063 ceph-mon[192008]: pgmap v61: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s, 5 objects/s recovering 2023-12-07T16:24:07.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:07 smithi063 ceph-mon[192008]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-07T16:24:07.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:07 smithi063 ceph-mon[192008]: Upgrade: osd.1 is safe to restart 2023-12-07T16:24:07.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:07 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:07.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:07 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-07T16:24:07.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:07 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:24:07.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:07 smithi152 ceph-mon[175645]: pgmap v61: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s, 5 objects/s recovering 2023-12-07T16:24:07.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:07 smithi152 ceph-mon[175645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-07T16:24:07.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:07 smithi152 ceph-mon[175645]: Upgrade: osd.1 is safe to restart 2023-12-07T16:24:07.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:07 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:07.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:07 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-07T16:24:07.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:07 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:24:08.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:08 smithi152 ceph-mon[175645]: Upgrade: Updating osd.1 2023-12-07T16:24:08.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:08 smithi152 ceph-mon[175645]: Deploying daemon osd.1 on smithi063 2023-12-07T16:24:09.085 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:08 smithi063 ceph-mon[192008]: Upgrade: Updating osd.1 2023-12-07T16:24:09.085 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:08 smithi063 ceph-mon[192008]: Deploying daemon osd.1 on smithi063 2023-12-07T16:24:09.942 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:09 smithi063 ceph-mon[192008]: pgmap v62: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s, 4 objects/s recovering 2023-12-07T16:24:09.943 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:09 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:09.943 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:24:09 smithi063 systemd[1]: Stopping Ceph osd.1 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:24:09.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:09 smithi152 ceph-mon[175645]: pgmap v62: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s, 4 objects/s recovering 2023-12-07T16:24:09.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:09 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:10.405 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:24:09 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-1[144680]: 2023-12-07T16:24:09.943+0000 7f15d5c51700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-07T16:24:10.405 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:24:09 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-1[144680]: 2023-12-07T16:24:09.943+0000 7f15d5c51700 -1 osd.1 66 *** Got signal Terminated *** 2023-12-07T16:24:10.405 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:24:09 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-1[144680]: 2023-12-07T16:24:09.943+0000 7f15d5c51700 -1 osd.1 66 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-07T16:24:10.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:10 smithi152 ceph-mon[175645]: osd.1 marked itself down and dead 2023-12-07T16:24:11.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:10 smithi063 ceph-mon[192008]: osd.1 marked itself down and dead 2023-12-07T16:24:11.655 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:24:11 smithi063 bash[208657]: ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-1 2023-12-07T16:24:11.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:11 smithi152 ceph-mon[175645]: pgmap v63: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s, 3 objects/s recovering 2023-12-07T16:24:11.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:11 smithi152 ceph-mon[175645]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-07T16:24:11.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:11 smithi152 ceph-mon[175645]: failed to encode map e67 with expected crc 2023-12-07T16:24:11.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:11 smithi152 ceph-mon[175645]: osdmap e67: 6 total, 5 up, 6 in 2023-12-07T16:24:11.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:11 smithi152 ceph-mon[175645]: failed to encode map e67 with expected crc 2023-12-07T16:24:11.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:11 smithi152 ceph-mon[175645]: failed to encode map e67 with expected crc 2023-12-07T16:24:11.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:11 smithi152 ceph-mon[175645]: failed to encode map e67 with expected crc 2023-12-07T16:24:12.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:11 smithi063 ceph-mon[192008]: pgmap v63: 65 pgs: 65 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s, 3 objects/s recovering 2023-12-07T16:24:12.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:11 smithi063 ceph-mon[192008]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-07T16:24:12.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:11 smithi063 ceph-mon[192008]: failed to encode map e67 with expected crc 2023-12-07T16:24:12.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:11 smithi063 ceph-mon[192008]: osdmap e67: 6 total, 5 up, 6 in 2023-12-07T16:24:12.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:11 smithi063 ceph-mon[192008]: failed to encode map e67 with expected crc 2023-12-07T16:24:12.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:11 smithi063 ceph-mon[192008]: failed to encode map e67 with expected crc 2023-12-07T16:24:12.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:11 smithi063 ceph-mon[192008]: failed to encode map e67 with expected crc 2023-12-07T16:24:12.772 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:24:12 smithi063 systemd[1]: ceph-8c493298-951b-11ee-95a2-87774f69a715@osd.1.service: Succeeded. 2023-12-07T16:24:12.772 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:24:12 smithi063 systemd[1]: Stopped Ceph osd.1 for 8c493298-951b-11ee-95a2-87774f69a715. 2023-12-07T16:24:12.772 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:24:12 smithi063 systemd[1]: Starting Ceph osd.1 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:24:12.772 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:12 smithi063 ceph-mon[192008]: failed to encode map e68 with expected crc 2023-12-07T16:24:12.772 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:12 smithi063 ceph-mon[192008]: osdmap e68: 6 total, 5 up, 6 in 2023-12-07T16:24:12.772 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:12 smithi063 ceph-mon[192008]: failed to encode map e68 with expected crc 2023-12-07T16:24:12.773 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:12 smithi063 ceph-mon[192008]: failed to encode map e68 with expected crc 2023-12-07T16:24:12.773 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:12 smithi063 ceph-mon[192008]: failed to encode map e68 with expected crc 2023-12-07T16:24:12.773 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:12 smithi063 ceph-mon[192008]: failed to encode map e68 with expected crc 2023-12-07T16:24:12.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:12 smithi152 ceph-mon[175645]: failed to encode map e68 with expected crc 2023-12-07T16:24:12.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:12 smithi152 ceph-mon[175645]: osdmap e68: 6 total, 5 up, 6 in 2023-12-07T16:24:12.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:12 smithi152 ceph-mon[175645]: failed to encode map e68 with expected crc 2023-12-07T16:24:12.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:12 smithi152 ceph-mon[175645]: failed to encode map e68 with expected crc 2023-12-07T16:24:12.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:12 smithi152 ceph-mon[175645]: failed to encode map e68 with expected crc 2023-12-07T16:24:12.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:12 smithi152 ceph-mon[175645]: failed to encode map e68 with expected crc 2023-12-07T16:24:13.684 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:24:13 smithi063 bash[208926]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-07T16:24:13.684 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:24:13 smithi063 bash[208926]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-07T16:24:13.684 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:24:13 smithi063 bash[208926]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-07T16:24:13.684 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:24:13 smithi063 bash[208926]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-07T16:24:13.684 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:24:13 smithi063 bash[208926]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2023-12-07T16:24:13.684 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:24:13 smithi063 bash[208926]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-07T16:24:13.684 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:24:13 smithi063 bash[208926]: --> ceph-volume raw activate successful for osd ID: 1 2023-12-07T16:24:13.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:13 smithi152 ceph-mon[175645]: pgmap v66: 65 pgs: 12 stale+active+clean, 53 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:24:14.023 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:13 smithi063 ceph-mon[192008]: pgmap v66: 65 pgs: 12 stale+active+clean, 53 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:24:14.405 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:24:14 smithi063 ceph-osd[209246]: -- 172.21.15.63:0/2987151566 <== mon.0 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562b3002b1e0 con 0x562b2fffac00 2023-12-07T16:24:14.405 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:24:14 smithi063 bash[209209]: b78531e6dc96c6ee9f4a6cdf4d153f5ed192afd396d796216babb717b4618538 2023-12-07T16:24:14.405 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:24:14 smithi063 systemd[1]: Started Ceph osd.1 for 8c493298-951b-11ee-95a2-87774f69a715. 2023-12-07T16:24:14.905 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:24:14 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-1[209223]: 2023-12-07T16:24:14.630+0000 7f95c18bf640 -1 Falling back to public interface 2023-12-07T16:24:15.299 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:15 smithi063 ceph-mon[192008]: pgmap v67: 65 pgs: 12 stale+active+clean, 53 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:24:15.299 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:15 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:15.299 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:15 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:24:15.299 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:15 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:15.299 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:15 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:15.299 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:15 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:24:15.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:15 smithi152 ceph-mon[175645]: pgmap v67: 65 pgs: 12 stale+active+clean, 53 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:24:15.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:15 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:15.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:15 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:24:15.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:15 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:15.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:15 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:15.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:15 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:24:16.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:16 smithi152 ceph-mon[175645]: mgrmap e38: smithi063.yohyyx(active, since 91s), standbys: smithi152.sxayfb 2023-12-07T16:24:16.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:16 smithi063 ceph-mon[192008]: mgrmap e38: smithi063.yohyyx(active, since 91s), standbys: smithi152.sxayfb 2023-12-07T16:24:17.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:17 smithi152 ceph-mon[175645]: pgmap v68: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 767 B/s wr, 0 op/s; 56/360 objects degraded (15.556%) 2023-12-07T16:24:17.733 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:17 smithi152 ceph-mon[175645]: Health check failed: Degraded data redundancy: 56/360 objects degraded (15.556%), 16 pgs degraded (PG_DEGRADED) 2023-12-07T16:24:17.733 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:17 smithi063 ceph-mon[192008]: pgmap v68: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 767 B/s wr, 0 op/s; 56/360 objects degraded (15.556%) 2023-12-07T16:24:17.734 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:17 smithi063 ceph-mon[192008]: Health check failed: Degraded data redundancy: 56/360 objects degraded (15.556%), 16 pgs degraded (PG_DEGRADED) 2023-12-07T16:24:18.772 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:18 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:18.772 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:18 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:18.772 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:18 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:18.772 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:18 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:18.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:18 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:18.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:18 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:18.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:18 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:18.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:18 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:19.405 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:24:19 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-1[209223]: 2023-12-07T16:24:19.157+0000 7f95c18bf640 -1 osd.1 0 read_superblock omap replica is missing. 2023-12-07T16:24:19.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:19 smithi063 ceph-mon[192008]: pgmap v69: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 767 B/s wr, 0 op/s; 56/360 objects degraded (15.556%) 2023-12-07T16:24:19.906 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:24:19 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-1[209223]: 2023-12-07T16:24:19.686+0000 7f95c18bf640 -1 osd.1 66 log_to_monitors true 2023-12-07T16:24:19.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:19 smithi152 ceph-mon[175645]: pgmap v69: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 767 B/s wr, 0 op/s; 56/360 objects degraded (15.556%) 2023-12-07T16:24:20.762 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:24:20 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-1[209223]: 2023-12-07T16:24:20.694+0000 7f95b2d30700 -1 osd.1 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T16:24:20.763 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:20 smithi063 ceph-mon[192008]: from='osd.1 [v2:172.21.15.63:6810/394258268,v1:172.21.15.63:6811/394258268]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-07T16:24:20.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:20 smithi152 ceph-mon[175645]: from='osd.1 [v2:172.21.15.63:6810/394258268,v1:172.21.15.63:6811/394258268]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-07T16:24:21.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.062+0000 7f2130485700 1 -- 172.21.15.63:0/2572687111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2128100050 msgr2=0x7f2128102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:21.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.062+0000 7f2130485700 1 --2- 172.21.15.63:0/2572687111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2128100050 0x7f2128102430 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2124004940 tx=0x7f2124009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:21.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.062+0000 7f2130485700 1 -- 172.21.15.63:0/2572687111 shutdown_connections 2023-12-07T16:24:21.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.062+0000 7f2130485700 1 --2- 172.21.15.63:0/2572687111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2128100050 0x7f2128102430 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:21.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.062+0000 7f2130485700 1 --2- 172.21.15.63:0/2572687111 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21280fd730 0x7f21280ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:21.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.062+0000 7f2130485700 1 -- 172.21.15.63:0/2572687111 >> 172.21.15.63:0/2572687111 conn(0x7f21280f7190 msgr2=0x7f21280f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:21.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.062+0000 7f2130485700 1 -- 172.21.15.63:0/2572687111 shutdown_connections 2023-12-07T16:24:21.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.062+0000 7f2130485700 1 -- 172.21.15.63:0/2572687111 wait complete. 2023-12-07T16:24:21.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.062+0000 7f2130485700 1 Processor -- start 2023-12-07T16:24:21.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.062+0000 7f2130485700 1 -- start start 2023-12-07T16:24:21.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.063+0000 7f2130485700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21280fd730 0x7f21280fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:21.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.063+0000 7f2130485700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2128100050 0x7f21280fb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:21.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.063+0000 7f2130485700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21280fbcd0 con 0x7f21280fd730 2023-12-07T16:24:21.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.063+0000 7f2130485700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21280fbe40 con 0x7f2128100050 2023-12-07T16:24:21.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.063+0000 7f212e221700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21280fd730 0x7f21280fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:21.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.063+0000 7f212e221700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21280fd730 0x7f21280fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52768/0 (socket says 172.21.15.63:52768) 2023-12-07T16:24:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.063+0000 7f212e221700 1 -- 172.21.15.63:0/1890928684 learned_addr learned my addr 172.21.15.63:0/1890928684 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:24:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.063+0000 7f212da20700 1 --2- 172.21.15.63:0/1890928684 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2128100050 0x7f21280fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.063+0000 7f212e221700 1 -- 172.21.15.63:0/1890928684 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2128100050 msgr2=0x7f21280fb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.063+0000 7f212e221700 1 --2- 172.21.15.63:0/1890928684 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2128100050 0x7f21280fb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.063+0000 7f212e221700 1 -- 172.21.15.63:0/1890928684 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2124005040 con 0x7f21280fd730 2023-12-07T16:24:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.063+0000 7f212e221700 1 --2- 172.21.15.63:0/1890928684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21280fd730 0x7f21280fd1c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f211c00b790 tx=0x7f211c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.063+0000 7f211affd700 1 -- 172.21.15.63:0/1890928684 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f211c00f6f0 con 0x7f21280fd730 2023-12-07T16:24:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.063+0000 7f211affd700 1 -- 172.21.15.63:0/1890928684 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f211c00fd00 con 0x7f21280fd730 2023-12-07T16:24:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.063+0000 7f2130485700 1 -- 172.21.15.63:0/1890928684 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21280fc120 con 0x7f21280fd730 2023-12-07T16:24:21.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.064+0000 7f211affd700 1 -- 172.21.15.63:0/1890928684 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f211c0103a0 con 0x7f21280fd730 2023-12-07T16:24:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.064+0000 7f2130485700 1 -- 172.21.15.63:0/1890928684 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21280fc4a0 con 0x7f21280fd730 2023-12-07T16:24:21.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.065+0000 7f2130485700 1 -- 172.21.15.63:0/1890928684 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f212804bb80 con 0x7f21280fd730 2023-12-07T16:24:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.065+0000 7f211affd700 1 -- 172.21.15.63:0/1890928684 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f211c00f850 con 0x7f21280fd730 2023-12-07T16:24:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.065+0000 7f211affd700 1 --2- 172.21.15.63:0/1890928684 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f211406ce60 0x7f211406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.066+0000 7f211affd700 1 -- 172.21.15.63:0/1890928684 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f211c08c350 con 0x7f21280fd730 2023-12-07T16:24:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.066+0000 7f212da20700 1 --2- 172.21.15.63:0/1890928684 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f211406ce60 0x7f211406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:21.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.066+0000 7f212da20700 1 --2- 172.21.15.63:0/1890928684 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f211406ce60 0x7f211406f310 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f212400b3b0 tx=0x7f2124009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:21.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.071+0000 7f211affd700 1 -- 172.21.15.63:0/1890928684 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f211c059b40 con 0x7f21280fd730 2023-12-07T16:24:21.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.289+0000 7f2130485700 1 -- 172.21.15.63:0/1890928684 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2128100cb0 con 0x7f211406ce60 2023-12-07T16:24:21.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.290+0000 7f211affd700 1 -- 172.21.15.63:0/1890928684 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2128100cb0 con 0x7f211406ce60 2023-12-07T16:24:21.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.292+0000 7f2130485700 1 -- 172.21.15.63:0/1890928684 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f211406ce60 msgr2=0x7f211406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:21.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.292+0000 7f2130485700 1 --2- 172.21.15.63:0/1890928684 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f211406ce60 0x7f211406f310 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f212400b3b0 tx=0x7f2124009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:21.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.292+0000 7f2130485700 1 -- 172.21.15.63:0/1890928684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21280fd730 msgr2=0x7f21280fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:21.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.292+0000 7f2130485700 1 --2- 172.21.15.63:0/1890928684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21280fd730 0x7f21280fd1c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f211c00b790 tx=0x7f211c009250 comp rx=0 tx=0).stop 2023-12-07T16:24:21.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.292+0000 7f2130485700 1 -- 172.21.15.63:0/1890928684 shutdown_connections 2023-12-07T16:24:21.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.292+0000 7f2130485700 1 --2- 172.21.15.63:0/1890928684 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f211406ce60 0x7f211406f310 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:21.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.292+0000 7f2130485700 1 --2- 172.21.15.63:0/1890928684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21280fd730 0x7f21280fd1c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:21.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.292+0000 7f2130485700 1 --2- 172.21.15.63:0/1890928684 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2128100050 0x7f21280fb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:21.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.292+0000 7f2130485700 1 -- 172.21.15.63:0/1890928684 >> 172.21.15.63:0/1890928684 conn(0x7f21280f7190 msgr2=0x7f21280f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:21.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.292+0000 7f2130485700 1 -- 172.21.15.63:0/1890928684 shutdown_connections 2023-12-07T16:24:21.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.292+0000 7f2130485700 1 -- 172.21.15.63:0/1890928684 wait complete. 2023-12-07T16:24:21.300 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-07T16:24:21.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.397+0000 7f2d6335e700 1 -- 172.21.15.63:0/309318777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c0fbaf0 msgr2=0x7f2d5c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:21.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.397+0000 7f2d6335e700 1 --2- 172.21.15.63:0/309318777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c0fbaf0 0x7f2d5c0fbf00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2d58004940 tx=0x7f2d58009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:21.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.397+0000 7f2d6335e700 1 -- 172.21.15.63:0/309318777 shutdown_connections 2023-12-07T16:24:21.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.397+0000 7f2d6335e700 1 --2- 172.21.15.63:0/309318777 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d5c0fcd00 0x7f2d5c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:21.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.397+0000 7f2d6335e700 1 --2- 172.21.15.63:0/309318777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c0fbaf0 0x7f2d5c0fbf00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:21.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.397+0000 7f2d6335e700 1 -- 172.21.15.63:0/309318777 >> 172.21.15.63:0/309318777 conn(0x7f2d5c0f7190 msgr2=0x7f2d5c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:21.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.397+0000 7f2d6335e700 1 -- 172.21.15.63:0/309318777 shutdown_connections 2023-12-07T16:24:21.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.397+0000 7f2d6335e700 1 -- 172.21.15.63:0/309318777 wait complete. 2023-12-07T16:24:21.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.397+0000 7f2d6335e700 1 Processor -- start 2023-12-07T16:24:21.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.398+0000 7f2d6335e700 1 -- start start 2023-12-07T16:24:21.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.398+0000 7f2d6335e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c0fbaf0 0x7f2d5c10d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:21.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.398+0000 7f2d6335e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d5c0fcd00 0x7f2d5c10da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:21.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.398+0000 7f2d6335e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c10e030 con 0x7f2d5c0fbaf0 2023-12-07T16:24:21.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.398+0000 7f2d6335e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c10e8d0 con 0x7f2d5c0fcd00 2023-12-07T16:24:21.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.398+0000 7f2d610fa700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c0fbaf0 0x7f2d5c10d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:21.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.398+0000 7f2d610fa700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c0fbaf0 0x7f2d5c10d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52790/0 (socket says 172.21.15.63:52790) 2023-12-07T16:24:21.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.398+0000 7f2d610fa700 1 -- 172.21.15.63:0/2911151886 learned_addr learned my addr 172.21.15.63:0/2911151886 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:24:21.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.398+0000 7f2d608f9700 1 --2- 172.21.15.63:0/2911151886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d5c0fcd00 0x7f2d5c10da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:21.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.398+0000 7f2d610fa700 1 -- 172.21.15.63:0/2911151886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d5c0fcd00 msgr2=0x7f2d5c10da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:21.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.398+0000 7f2d610fa700 1 --2- 172.21.15.63:0/2911151886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d5c0fcd00 0x7f2d5c10da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:21.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.398+0000 7f2d610fa700 1 -- 172.21.15.63:0/2911151886 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d58005040 con 0x7f2d5c0fbaf0 2023-12-07T16:24:21.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.398+0000 7f2d610fa700 1 --2- 172.21.15.63:0/2911151886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c0fbaf0 0x7f2d5c10d4f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2d58000c00 tx=0x7f2d58009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:21.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.399+0000 7f2d4dffb700 1 -- 172.21.15.63:0/2911151886 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d58021070 con 0x7f2d5c0fbaf0 2023-12-07T16:24:21.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.399+0000 7f2d4dffb700 1 -- 172.21.15.63:0/2911151886 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2d5801c400 con 0x7f2d5c0fbaf0 2023-12-07T16:24:21.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.399+0000 7f2d6335e700 1 -- 172.21.15.63:0/2911151886 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5c10eb50 con 0x7f2d5c0fbaf0 2023-12-07T16:24:21.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.399+0000 7f2d4dffb700 1 -- 172.21.15.63:0/2911151886 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d5800e070 con 0x7f2d5c0fbaf0 2023-12-07T16:24:21.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.399+0000 7f2d6335e700 1 -- 172.21.15.63:0/2911151886 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5c10f030 con 0x7f2d5c0fbaf0 2023-12-07T16:24:21.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.400+0000 7f2d6335e700 1 -- 172.21.15.63:0/2911151886 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d5c04bb80 con 0x7f2d5c0fbaf0 2023-12-07T16:24:21.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.400+0000 7f2d4dffb700 1 -- 172.21.15.63:0/2911151886 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f2d5801ca00 con 0x7f2d5c0fbaf0 2023-12-07T16:24:21.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.401+0000 7f2d4dffb700 1 --2- 172.21.15.63:0/2911151886 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f2d4806ce60 0x7f2d4806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:21.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.401+0000 7f2d608f9700 1 --2- 172.21.15.63:0/2911151886 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f2d4806ce60 0x7f2d4806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:21.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.401+0000 7f2d4dffb700 1 -- 172.21.15.63:0/2911151886 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f2d5808d5b0 con 0x7f2d5c0fbaf0 2023-12-07T16:24:21.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.401+0000 7f2d608f9700 1 --2- 172.21.15.63:0/2911151886 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f2d4806ce60 0x7f2d4806f310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2d50009b80 tx=0x7f2d5000b040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:21.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.406+0000 7f2d4dffb700 1 -- 172.21.15.63:0/2911151886 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2d5805ae20 con 0x7f2d5c0fbaf0 2023-12-07T16:24:21.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.624+0000 7f2d6335e700 1 -- 172.21.15.63:0/2911151886 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d5c10f490 con 0x7f2d4806ce60 2023-12-07T16:24:21.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.626+0000 7f2d4dffb700 1 -- 172.21.15.63:0/2911151886 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2d5c10f490 con 0x7f2d4806ce60 2023-12-07T16:24:21.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.628+0000 7f2d6335e700 1 -- 172.21.15.63:0/2911151886 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f2d4806ce60 msgr2=0x7f2d4806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:21.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.628+0000 7f2d6335e700 1 --2- 172.21.15.63:0/2911151886 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f2d4806ce60 0x7f2d4806f310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2d50009b80 tx=0x7f2d5000b040 comp rx=0 tx=0).stop 2023-12-07T16:24:21.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.628+0000 7f2d6335e700 1 -- 172.21.15.63:0/2911151886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c0fbaf0 msgr2=0x7f2d5c10d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:21.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.628+0000 7f2d6335e700 1 --2- 172.21.15.63:0/2911151886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c0fbaf0 0x7f2d5c10d4f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2d58000c00 tx=0x7f2d58009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:21.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.628+0000 7f2d6335e700 1 -- 172.21.15.63:0/2911151886 shutdown_connections 2023-12-07T16:24:21.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.628+0000 7f2d6335e700 1 --2- 172.21.15.63:0/2911151886 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f2d4806ce60 0x7f2d4806f310 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:21.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.628+0000 7f2d6335e700 1 --2- 172.21.15.63:0/2911151886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d5c0fbaf0 0x7f2d5c10d4f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:21.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.628+0000 7f2d6335e700 1 --2- 172.21.15.63:0/2911151886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d5c0fcd00 0x7f2d5c10da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:21.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.628+0000 7f2d6335e700 1 -- 172.21.15.63:0/2911151886 >> 172.21.15.63:0/2911151886 conn(0x7f2d5c0f7190 msgr2=0x7f2d5c065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:21.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.628+0000 7f2d6335e700 1 -- 172.21.15.63:0/2911151886 shutdown_connections 2023-12-07T16:24:21.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.628+0000 7f2d6335e700 1 -- 172.21.15.63:0/2911151886 wait complete. 2023-12-07T16:24:21.743 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.744+0000 7f6b7facc700 1 -- 172.21.15.63:0/1630543268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b780fcd00 msgr2=0x7f6b780fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:21.743 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.744+0000 7f6b7facc700 1 --2- 172.21.15.63:0/1630543268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b780fcd00 0x7f6b780fd150 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6b68004940 tx=0x7f6b68009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:21.743 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.744+0000 7f6b7facc700 1 -- 172.21.15.63:0/1630543268 shutdown_connections 2023-12-07T16:24:21.744 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.744+0000 7f6b7facc700 1 --2- 172.21.15.63:0/1630543268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b780fcd00 0x7f6b780fd150 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:21.744 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.744+0000 7f6b7facc700 1 --2- 172.21.15.63:0/1630543268 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b780fbaf0 0x7f6b780fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:21.744 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.744+0000 7f6b7facc700 1 -- 172.21.15.63:0/1630543268 >> 172.21.15.63:0/1630543268 conn(0x7f6b780f7190 msgr2=0x7f6b780f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:21.744 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.744+0000 7f6b7facc700 1 -- 172.21.15.63:0/1630543268 shutdown_connections 2023-12-07T16:24:21.744 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.744+0000 7f6b7facc700 1 -- 172.21.15.63:0/1630543268 wait complete. 2023-12-07T16:24:21.744 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.744+0000 7f6b7facc700 1 Processor -- start 2023-12-07T16:24:21.744 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.745+0000 7f6b7facc700 1 -- start start 2023-12-07T16:24:21.744 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.745+0000 7f6b7facc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b780fbaf0 0x7f6b7810c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:21.744 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.745+0000 7f6b7facc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b780fcd00 0x7f6b7810c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:21.744 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.745+0000 7f6b7facc700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7810d040 con 0x7f6b780fbaf0 2023-12-07T16:24:21.744 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.745+0000 7f6b7facc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7810d880 con 0x7f6b780fcd00 2023-12-07T16:24:21.745 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.745+0000 7f6b7d868700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b780fbaf0 0x7f6b7810c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:21.745 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.745+0000 7f6b7d868700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b780fbaf0 0x7f6b7810c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52814/0 (socket says 172.21.15.63:52814) 2023-12-07T16:24:21.745 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.745+0000 7f6b7d868700 1 -- 172.21.15.63:0/1748114386 learned_addr learned my addr 172.21.15.63:0/1748114386 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:24:21.745 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.745+0000 7f6b7d067700 1 --2- 172.21.15.63:0/1748114386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b780fcd00 0x7f6b7810c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:21.745 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.745+0000 7f6b7d868700 1 -- 172.21.15.63:0/1748114386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b780fcd00 msgr2=0x7f6b7810c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:21.745 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.745+0000 7f6b7d868700 1 --2- 172.21.15.63:0/1748114386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b780fcd00 0x7f6b7810c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:21.745 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.745+0000 7f6b7d868700 1 -- 172.21.15.63:0/1748114386 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b68005040 con 0x7f6b780fbaf0 2023-12-07T16:24:21.745 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.745+0000 7f6b7d868700 1 --2- 172.21.15.63:0/1748114386 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b780fbaf0 0x7f6b7810c470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400b790 tx=0x7f6b74009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:21.745 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.745+0000 7f6b6e7fc700 1 -- 172.21.15.63:0/1748114386 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b7400f6f0 con 0x7f6b780fbaf0 2023-12-07T16:24:21.745 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.745+0000 7f6b6e7fc700 1 -- 172.21.15.63:0/1748114386 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6b7400fd00 con 0x7f6b780fbaf0 2023-12-07T16:24:21.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.745+0000 7f6b7facc700 1 -- 172.21.15.63:0/1748114386 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7810db60 con 0x7f6b780fbaf0 2023-12-07T16:24:21.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.746+0000 7f6b6e7fc700 1 -- 172.21.15.63:0/1748114386 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b740103a0 con 0x7f6b780fbaf0 2023-12-07T16:24:21.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.746+0000 7f6b7facc700 1 -- 172.21.15.63:0/1748114386 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7810e0a0 con 0x7f6b780fbaf0 2023-12-07T16:24:21.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.746+0000 7f6b7facc700 1 -- 172.21.15.63:0/1748114386 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7804bb80 con 0x7f6b780fbaf0 2023-12-07T16:24:21.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.748+0000 7f6b6e7fc700 1 -- 172.21.15.63:0/1748114386 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f6b7400f850 con 0x7f6b780fbaf0 2023-12-07T16:24:21.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.748+0000 7f6b6e7fc700 1 --2- 172.21.15.63:0/1748114386 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f6b6406ce60 0x7f6b6406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:21.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.748+0000 7f6b6e7fc700 1 -- 172.21.15.63:0/1748114386 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f6b7408cd70 con 0x7f6b780fbaf0 2023-12-07T16:24:21.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.748+0000 7f6b7d067700 1 --2- 172.21.15.63:0/1748114386 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f6b6406ce60 0x7f6b6406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:21.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.749+0000 7f6b7d067700 1 --2- 172.21.15.63:0/1748114386 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f6b6406ce60 0x7f6b6406f310 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6b68004560 tx=0x7f6b68009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:21.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.752+0000 7f6b6e7fc700 1 -- 172.21.15.63:0/1748114386 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6b7405a6c0 con 0x7f6b780fbaf0 2023-12-07T16:24:21.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.962+0000 7f6b7facc700 1 -- 172.21.15.63:0/1748114386 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b7810e600 con 0x7f6b6406ce60 2023-12-07T16:24:21.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.972+0000 7f6b6e7fc700 1 -- 172.21.15.63:0/1748114386 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f6b7810e600 con 0x7f6b6406ce60 2023-12-07T16:24:21.970 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-07T16:24:21.970 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (3m) 4s ago 9m 28.4M - 0.25.0 c8568f914cd2 c0526812d5fe 2023-12-07T16:24:21.970 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (56s) 4s ago 9m 7474k - 19.0.0-13-ge6605fb8 104f332cd0a9 52adf44ea983 2023-12-07T16:24:21.970 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi152 smithi152 running (53s) 50s ago 8m 7461k - 19.0.0-13-ge6605fb8 104f332cd0a9 9eba5b538b96 2023-12-07T16:24:21.970 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (3m) 4s ago 8m 87.4M - 9.4.7 954c08fa6188 cc2cde9a664f 2023-12-07T16:24:21.970 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.gsjgcq smithi063 running (5m) 4s ago 5m 15.0M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 f70e4f098e4c 2023-12-07T16:24:21.970 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.yidolg smithi063 running (5m) 4s ago 5m 5932M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5b053ef5fb7f 2023-12-07T16:24:21.970 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.aovwwd smithi152 running (5m) 50s ago 5m 15.6M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 80190948a595 2023-12-07T16:24:21.970 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.mrvngf smithi152 running (5m) 50s ago 5m 5114M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5f60b893f840 2023-12-07T16:24:21.970 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.yohyyx smithi063 *:8443,9283,8765 running (2m) 4s ago 10m 509M - 19.0.0-13-ge6605fb8 104f332cd0a9 b605f882784d 2023-12-07T16:24:21.970 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi152.sxayfb smithi152 *:8443,9283,8765 running (2m) 50s ago 8m 450M - 19.0.0-13-ge6605fb8 104f332cd0a9 71716998ccc3 2023-12-07T16:24:21.971 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (110s) 4s ago 10m 64.5M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 8d7d0c6bfea3 2023-12-07T16:24:21.971 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi152 smithi152 running (85s) 50s ago 8m 39.3M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 883bb3425cf0 2023-12-07T16:24:21.971 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (3m) 4s ago 9m 18.2M - 1.5.0 0da6a335fe13 50d63981f746 2023-12-07T16:24:21.971 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi152 smithi152 *:9100 running (2m) 50s ago 8m 19.4M - 1.5.0 0da6a335fe13 627cda14f1a9 2023-12-07T16:24:21.971 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (37s) 4s ago 7m 181M 1568M 19.0.0-13-ge6605fb8 104f332cd0a9 5fab981f1333 2023-12-07T16:24:21.971 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (8s) 4s ago 7m 15.1M 1568M 19.0.0-13-ge6605fb8 104f332cd0a9 b78531e6dc96 2023-12-07T16:24:21.971 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (7m) 4s ago 7m 672M 1568M 17.2.7-115-g4f62d9ad fcdfd00f81c7 b0d432bbca05 2023-12-07T16:24:21.971 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi152 running (6m) 50s ago 6m 987M 2592M 17.2.7-115-g4f62d9ad fcdfd00f81c7 94d14402b489 2023-12-07T16:24:21.971 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi152 running (6m) 50s ago 6m 764M 2592M 17.2.7-115-g4f62d9ad fcdfd00f81c7 d3b8b2f12489 2023-12-07T16:24:21.971 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi152 running (6m) 50s ago 6m 856M 2592M 17.2.7-115-g4f62d9ad fcdfd00f81c7 e7f8d9f716bb 2023-12-07T16:24:21.971 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (2m) 4s ago 8m 51.0M - 2.43.0 a07b618ecd1d 8a323520d9fd 2023-12-07T16:24:21.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.975+0000 7f6b7facc700 1 -- 172.21.15.63:0/1748114386 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f6b6406ce60 msgr2=0x7f6b6406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:21.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.975+0000 7f6b7facc700 1 --2- 172.21.15.63:0/1748114386 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f6b6406ce60 0x7f6b6406f310 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6b68004560 tx=0x7f6b68009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:21.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.975+0000 7f6b7facc700 1 -- 172.21.15.63:0/1748114386 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b780fbaf0 msgr2=0x7f6b7810c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:21.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.975+0000 7f6b7facc700 1 --2- 172.21.15.63:0/1748114386 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b780fbaf0 0x7f6b7810c470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400b790 tx=0x7f6b74009220 comp rx=0 tx=0).stop 2023-12-07T16:24:21.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.975+0000 7f6b7facc700 1 -- 172.21.15.63:0/1748114386 shutdown_connections 2023-12-07T16:24:21.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.975+0000 7f6b7facc700 1 --2- 172.21.15.63:0/1748114386 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f6b6406ce60 0x7f6b6406f310 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:21.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.975+0000 7f6b7facc700 1 --2- 172.21.15.63:0/1748114386 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b780fbaf0 0x7f6b7810c470 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:21.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.975+0000 7f6b7facc700 1 --2- 172.21.15.63:0/1748114386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6b780fcd00 0x7f6b7810c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:21.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.975+0000 7f6b7facc700 1 -- 172.21.15.63:0/1748114386 >> 172.21.15.63:0/1748114386 conn(0x7f6b780f7190 msgr2=0x7f6b780fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:21.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.975+0000 7f6b7facc700 1 -- 172.21.15.63:0/1748114386 shutdown_connections 2023-12-07T16:24:21.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:21.975+0000 7f6b7facc700 1 -- 172.21.15.63:0/1748114386 wait complete. 2023-12-07T16:24:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:21 smithi152 ceph-mon[175645]: pgmap v70: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 662 B/s wr, 0 op/s; 56/360 objects degraded (15.556%) 2023-12-07T16:24:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:21 smithi152 ceph-mon[175645]: from='osd.1 [v2:172.21.15.63:6810/394258268,v1:172.21.15.63:6811/394258268]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-07T16:24:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:21 smithi152 ceph-mon[175645]: failed to encode map e69 with expected crc 2023-12-07T16:24:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:21 smithi152 ceph-mon[175645]: osdmap e69: 6 total, 5 up, 6 in 2023-12-07T16:24:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:21 smithi152 ceph-mon[175645]: from='osd.1 [v2:172.21.15.63:6810/394258268,v1:172.21.15.63:6811/394258268]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-07T16:24:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:21 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:21 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:21 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:24:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:21 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:24:21.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:21 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:21.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:21 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:24:21.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:21 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:24:21.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:21 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:24:21.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:21 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:24:21.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:21 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-07T16:24:22.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.077+0000 7f1a89fef700 1 -- 172.21.15.63:0/152224885 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a84100050 msgr2=0x7f1a84102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:22.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.077+0000 7f1a89fef700 1 --2- 172.21.15.63:0/152224885 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a84100050 0x7f1a84102430 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1a78004940 tx=0x7f1a78009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:22.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.077+0000 7f1a89fef700 1 -- 172.21.15.63:0/152224885 shutdown_connections 2023-12-07T16:24:22.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.077+0000 7f1a89fef700 1 --2- 172.21.15.63:0/152224885 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a84100050 0x7f1a84102430 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:22.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.077+0000 7f1a89fef700 1 --2- 172.21.15.63:0/152224885 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a840fd730 0x7f1a840ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:22.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.077+0000 7f1a89fef700 1 -- 172.21.15.63:0/152224885 >> 172.21.15.63:0/152224885 conn(0x7f1a840f7190 msgr2=0x7f1a840f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:22.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.077+0000 7f1a89fef700 1 -- 172.21.15.63:0/152224885 shutdown_connections 2023-12-07T16:24:22.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.077+0000 7f1a89fef700 1 -- 172.21.15.63:0/152224885 wait complete. 2023-12-07T16:24:22.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.078+0000 7f1a89fef700 1 Processor -- start 2023-12-07T16:24:22.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.078+0000 7f1a89fef700 1 -- start start 2023-12-07T16:24:22.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.078+0000 7f1a89fef700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a840fd730 0x7f1a840fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:22.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.078+0000 7f1a89fef700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a84100050 0x7f1a840fb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:22.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.078+0000 7f1a89fef700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840fbc40 con 0x7f1a840fd730 2023-12-07T16:24:22.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.078+0000 7f1a89fef700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840fbdb0 con 0x7f1a84100050 2023-12-07T16:24:22.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.078+0000 7f1a837fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a840fd730 0x7f1a840fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:22.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.078+0000 7f1a837fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a840fd730 0x7f1a840fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52830/0 (socket says 172.21.15.63:52830) 2023-12-07T16:24:22.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.079+0000 7f1a837fe700 1 -- 172.21.15.63:0/2684852205 learned_addr learned my addr 172.21.15.63:0/2684852205 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:24:22.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.079+0000 7f1a82ffd700 1 --2- 172.21.15.63:0/2684852205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a84100050 0x7f1a840fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:22.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.079+0000 7f1a837fe700 1 -- 172.21.15.63:0/2684852205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a84100050 msgr2=0x7f1a840fb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:22.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.079+0000 7f1a837fe700 1 --2- 172.21.15.63:0/2684852205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a84100050 0x7f1a840fb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:22.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.079+0000 7f1a837fe700 1 -- 172.21.15.63:0/2684852205 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a78005040 con 0x7f1a840fd730 2023-12-07T16:24:22.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.079+0000 7f1a82ffd700 1 --2- 172.21.15.63:0/2684852205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a84100050 0x7f1a840fb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T16:24:22.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.079+0000 7f1a837fe700 1 --2- 172.21.15.63:0/2684852205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a840fd730 0x7f1a840fd1c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1a74002a50 tx=0x7f1a740046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:22.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.079+0000 7f1a6bfff700 1 -- 172.21.15.63:0/2684852205 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a74007cc0 con 0x7f1a840fd730 2023-12-07T16:24:22.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.079+0000 7f1a6bfff700 1 -- 172.21.15.63:0/2684852205 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1a7400f040 con 0x7f1a840fd730 2023-12-07T16:24:22.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.079+0000 7f1a89fef700 1 -- 172.21.15.63:0/2684852205 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a840fc090 con 0x7f1a840fd730 2023-12-07T16:24:22.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.079+0000 7f1a6bfff700 1 -- 172.21.15.63:0/2684852205 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a74009540 con 0x7f1a840fd730 2023-12-07T16:24:22.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.079+0000 7f1a89fef700 1 -- 172.21.15.63:0/2684852205 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a84115560 con 0x7f1a840fd730 2023-12-07T16:24:22.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.080+0000 7f1a89fef700 1 -- 172.21.15.63:0/2684852205 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a841075c0 con 0x7f1a840fd730 2023-12-07T16:24:22.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.081+0000 7f1a6bfff700 1 -- 172.21.15.63:0/2684852205 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f1a740096a0 con 0x7f1a840fd730 2023-12-07T16:24:22.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.081+0000 7f1a6bfff700 1 --2- 172.21.15.63:0/2684852205 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f1a6c06ce60 0x7f1a6c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:22.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.081+0000 7f1a6bfff700 1 -- 172.21.15.63:0/2684852205 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f1a7408c250 con 0x7f1a840fd730 2023-12-07T16:24:22.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.081+0000 7f1a82ffd700 1 --2- 172.21.15.63:0/2684852205 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f1a6c06ce60 0x7f1a6c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:22.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.082+0000 7f1a82ffd700 1 --2- 172.21.15.63:0/2684852205 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f1a6c06ce60 0x7f1a6c06f310 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1a78004560 tx=0x7f1a78009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:22.083 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.086+0000 7f1a6bfff700 1 -- 172.21.15.63:0/2684852205 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1a74059a60 con 0x7f1a840fd730 2023-12-07T16:24:22.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:21 smithi063 ceph-mon[192008]: pgmap v70: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 308 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 662 B/s wr, 0 op/s; 56/360 objects degraded (15.556%) 2023-12-07T16:24:22.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:21 smithi063 ceph-mon[192008]: from='osd.1 [v2:172.21.15.63:6810/394258268,v1:172.21.15.63:6811/394258268]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-07T16:24:22.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:21 smithi063 ceph-mon[192008]: failed to encode map e69 with expected crc 2023-12-07T16:24:22.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:21 smithi063 ceph-mon[192008]: osdmap e69: 6 total, 5 up, 6 in 2023-12-07T16:24:22.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:21 smithi063 ceph-mon[192008]: from='osd.1 [v2:172.21.15.63:6810/394258268,v1:172.21.15.63:6811/394258268]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-07T16:24:22.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:21 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:22.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:21 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:22.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:21 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:24:22.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:21 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:24:22.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:21 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:22.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:21 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:24:22.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:21 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:24:22.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:21 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:24:22.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:21 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:24:22.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:21 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-07T16:24:22.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.369+0000 7f1a89fef700 1 -- 172.21.15.63:0/2684852205 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1a84105580 con 0x7f1a840fd730 2023-12-07T16:24:22.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.369+0000 7f1a6bfff700 1 -- 172.21.15.63:0/2684852205 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f1a740595f0 con 0x7f1a840fd730 2023-12-07T16:24:22.367 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:24:22.367 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-07T16:24:22.367 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-07T16:24:22.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:24:22.367 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-07T16:24:22.367 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-07T16:24:22.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:24:22.367 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-07T16:24:22.367 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 4, 2023-12-07T16:24:22.367 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-07T16:24:22.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:24:22.367 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-07T16:24:22.367 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 4 2023-12-07T16:24:22.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:24:22.368 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-07T16:24:22.368 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 8, 2023-12-07T16:24:22.368 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 6 2023-12-07T16:24:22.368 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-07T16:24:22.368 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:24:22.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.371+0000 7f1a89fef700 1 -- 172.21.15.63:0/2684852205 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f1a6c06ce60 msgr2=0x7f1a6c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:22.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.371+0000 7f1a89fef700 1 --2- 172.21.15.63:0/2684852205 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f1a6c06ce60 0x7f1a6c06f310 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1a78004560 tx=0x7f1a78009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:22.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.371+0000 7f1a89fef700 1 -- 172.21.15.63:0/2684852205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a840fd730 msgr2=0x7f1a840fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:22.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.371+0000 7f1a89fef700 1 --2- 172.21.15.63:0/2684852205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a840fd730 0x7f1a840fd1c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1a74002a50 tx=0x7f1a740046b0 comp rx=0 tx=0).stop 2023-12-07T16:24:22.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.371+0000 7f1a89fef700 1 -- 172.21.15.63:0/2684852205 shutdown_connections 2023-12-07T16:24:22.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.371+0000 7f1a89fef700 1 --2- 172.21.15.63:0/2684852205 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f1a6c06ce60 0x7f1a6c06f310 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:22.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.371+0000 7f1a89fef700 1 --2- 172.21.15.63:0/2684852205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a840fd730 0x7f1a840fd1c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:22.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.371+0000 7f1a89fef700 1 --2- 172.21.15.63:0/2684852205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a84100050 0x7f1a840fb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:22.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.371+0000 7f1a89fef700 1 -- 172.21.15.63:0/2684852205 >> 172.21.15.63:0/2684852205 conn(0x7f1a840f7190 msgr2=0x7f1a840f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:22.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.372+0000 7f1a89fef700 1 -- 172.21.15.63:0/2684852205 shutdown_connections 2023-12-07T16:24:22.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.372+0000 7f1a89fef700 1 -- 172.21.15.63:0/2684852205 wait complete. 2023-12-07T16:24:22.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.475+0000 7febce5d0700 1 -- 172.21.15.63:0/1104576424 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febc80fcd00 msgr2=0x7febc80fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:22.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.475+0000 7febce5d0700 1 --2- 172.21.15.63:0/1104576424 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febc80fcd00 0x7febc80fd150 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7febbc004940 tx=0x7febbc009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:22.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.475+0000 7febce5d0700 1 -- 172.21.15.63:0/1104576424 shutdown_connections 2023-12-07T16:24:22.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.475+0000 7febce5d0700 1 --2- 172.21.15.63:0/1104576424 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febc80fcd00 0x7febc80fd150 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:22.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.475+0000 7febce5d0700 1 --2- 172.21.15.63:0/1104576424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febc80fbaf0 0x7febc80fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:22.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.475+0000 7febce5d0700 1 -- 172.21.15.63:0/1104576424 >> 172.21.15.63:0/1104576424 conn(0x7febc80f7190 msgr2=0x7febc80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:22.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.475+0000 7febce5d0700 1 -- 172.21.15.63:0/1104576424 shutdown_connections 2023-12-07T16:24:22.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.475+0000 7febce5d0700 1 -- 172.21.15.63:0/1104576424 wait complete. 2023-12-07T16:24:22.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.476+0000 7febce5d0700 1 Processor -- start 2023-12-07T16:24:22.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.476+0000 7febce5d0700 1 -- start start 2023-12-07T16:24:22.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.476+0000 7febce5d0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febc80fbaf0 0x7febc8110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.476+0000 7febce5d0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febc80fcd00 0x7febc81127e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.476+0000 7febce5d0700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc8066110 con 0x7febc80fcd00 2023-12-07T16:24:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.476+0000 7febce5d0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc8066250 con 0x7febc80fbaf0 2023-12-07T16:24:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.477+0000 7febc77fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febc80fcd00 0x7febc81127e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.477+0000 7febc77fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febc80fcd00 0x7febc81127e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52858/0 (socket says 172.21.15.63:52858) 2023-12-07T16:24:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.477+0000 7febc77fe700 1 -- 172.21.15.63:0/503256335 learned_addr learned my addr 172.21.15.63:0/503256335 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:24:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.477+0000 7febc7fff700 1 --2- 172.21.15.63:0/503256335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febc80fbaf0 0x7febc8110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.477+0000 7febc77fe700 1 -- 172.21.15.63:0/503256335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febc80fbaf0 msgr2=0x7febc8110290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.477+0000 7febc77fe700 1 --2- 172.21.15.63:0/503256335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febc80fbaf0 0x7febc8110290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.477+0000 7febc77fe700 1 -- 172.21.15.63:0/503256335 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc005040 con 0x7febc80fcd00 2023-12-07T16:24:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.477+0000 7febc77fe700 1 --2- 172.21.15.63:0/503256335 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febc80fcd00 0x7febc81127e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7febbc00b3b0 tx=0x7febbc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.477+0000 7febc4ff9700 1 -- 172.21.15.63:0/503256335 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febbc00e040 con 0x7febc80fcd00 2023-12-07T16:24:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.477+0000 7febc4ff9700 1 -- 172.21.15.63:0/503256335 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7febbc009af0 con 0x7febc80fcd00 2023-12-07T16:24:22.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.477+0000 7febce5d0700 1 -- 172.21.15.63:0/503256335 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc8112de0 con 0x7febc80fcd00 2023-12-07T16:24:22.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.477+0000 7febc4ff9700 1 -- 172.21.15.63:0/503256335 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febbc01c630 con 0x7febc80fcd00 2023-12-07T16:24:22.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.477+0000 7febce5d0700 1 -- 172.21.15.63:0/503256335 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc81132a0 con 0x7febc80fcd00 2023-12-07T16:24:22.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.478+0000 7febce5d0700 1 -- 172.21.15.63:0/503256335 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc804bb80 con 0x7febc80fcd00 2023-12-07T16:24:22.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.479+0000 7febc4ff9700 1 -- 172.21.15.63:0/503256335 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7febbc00bc50 con 0x7febc80fcd00 2023-12-07T16:24:22.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.479+0000 7febc4ff9700 1 --2- 172.21.15.63:0/503256335 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7febb006ce60 0x7febb006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:22.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.479+0000 7febc7fff700 1 --2- 172.21.15.63:0/503256335 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7febb006ce60 0x7febb006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:22.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.479+0000 7febc4ff9700 1 -- 172.21.15.63:0/503256335 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6761+0+0 (secure 0 0 0) 0x7febbc08d780 con 0x7febc80fcd00 2023-12-07T16:24:22.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.480+0000 7febc7fff700 1 --2- 172.21.15.63:0/503256335 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7febb006ce60 0x7febb006f310 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7febc8065d90 tx=0x7febb8009040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:22.481 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.484+0000 7febc4ff9700 1 -- 172.21.15.63:0/503256335 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7febbc057620 con 0x7febc80fcd00 2023-12-07T16:24:22.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.751+0000 7febce5d0700 1 -- 172.21.15.63:0/503256335 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7febc8113710 con 0x7febc80fcd00 2023-12-07T16:24:22.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.752+0000 7febc4ff9700 1 -- 172.21.15.63:0/503256335 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1891 (secure 0 0 0) 0x7febbc061070 con 0x7febc80fcd00 2023-12-07T16:24:22.749 INFO:teuthology.orchestra.run.smithi063.stdout:e17 2023-12-07T16:24:22.749 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-07T16:24:22.749 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:24:22.750 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-07T16:24:22.750 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:24:22.750 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-07T16:24:22.750 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-07T16:24:22.750 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 17 2023-12-07T16:24:22.750 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-07T16:24:22.750 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-07T16:19:08.352640+0000 2023-12-07T16:24:22.750 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-07T16:22:27.604525+0000 2023-12-07T16:24:22.750 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-07T16:24:22.750 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-07T16:24:22.750 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-07T16:24:22.750 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-07T16:24:22.751 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-07T16:24:22.751 INFO:teuthology.orchestra.run.smithi063.stdout:max_xattr_size 65536 2023-12-07T16:24:22.751 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-07T16:24:22.751 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-07T16:24:22.751 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 45 2023-12-07T16:24:22.751 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:24:22.751 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 2 2023-12-07T16:24:22.751 INFO:teuthology.orchestra.run.smithi063.stdout:in 0,1 2023-12-07T16:24:22.751 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14478,1=24269} 2023-12-07T16:24:22.751 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-07T16:24:22.751 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-07T16:24:22.751 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-07T16:24:22.751 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-07T16:24:22.752 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-07T16:24:22.752 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-07T16:24:22.752 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-07T16:24:22.752 INFO:teuthology.orchestra.run.smithi063.stdout:bal_rank_mask -1 2023-12-07T16:24:22.752 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-07T16:24:22.752 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.yidolg{0:14478} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:24:22.752 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.mrvngf{1:24269} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.152:6824/3157779064,v1:172.21.15.152:6825/3157779064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:24:22.752 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:24:22.752 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:24:22.752 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-07T16:24:22.752 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:24:22.752 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.gsjgcq{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/3063200414,v1:172.21.15.63:6827/3063200414] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:24:22.752 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.aovwwd{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/2906349729,v1:172.21.15.152:6827/2906349729] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:24:22.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.754+0000 7febce5d0700 1 -- 172.21.15.63:0/503256335 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7febb006ce60 msgr2=0x7febb006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:22.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.754+0000 7febce5d0700 1 --2- 172.21.15.63:0/503256335 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7febb006ce60 0x7febb006f310 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7febc8065d90 tx=0x7febb8009040 comp rx=0 tx=0).stop 2023-12-07T16:24:22.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.754+0000 7febce5d0700 1 -- 172.21.15.63:0/503256335 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febc80fcd00 msgr2=0x7febc81127e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:22.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.754+0000 7febce5d0700 1 --2- 172.21.15.63:0/503256335 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febc80fcd00 0x7febc81127e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7febbc00b3b0 tx=0x7febbc009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:22.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.754+0000 7febce5d0700 1 -- 172.21.15.63:0/503256335 shutdown_connections 2023-12-07T16:24:22.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.754+0000 7febce5d0700 1 --2- 172.21.15.63:0/503256335 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7febb006ce60 0x7febb006f310 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:22.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.754+0000 7febce5d0700 1 --2- 172.21.15.63:0/503256335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febc80fbaf0 0x7febc8110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:22.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.754+0000 7febce5d0700 1 --2- 172.21.15.63:0/503256335 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febc80fcd00 0x7febc81127e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:22.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.754+0000 7febce5d0700 1 -- 172.21.15.63:0/503256335 >> 172.21.15.63:0/503256335 conn(0x7febc80f7190 msgr2=0x7febc80fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:22.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.754+0000 7febce5d0700 1 -- 172.21.15.63:0/503256335 shutdown_connections 2023-12-07T16:24:22.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.754+0000 7febce5d0700 1 -- 172.21.15.63:0/503256335 wait complete. 2023-12-07T16:24:22.754 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2023-12-07T16:24:22.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.860+0000 7effc47d3700 1 -- 172.21.15.63:0/3827965455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effbc100050 msgr2=0x7effbc102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:22.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.860+0000 7effc47d3700 1 --2- 172.21.15.63:0/3827965455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effbc100050 0x7effbc102430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7effb8004940 tx=0x7effb8009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:22.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.860+0000 7effc47d3700 1 -- 172.21.15.63:0/3827965455 shutdown_connections 2023-12-07T16:24:22.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.860+0000 7effc47d3700 1 --2- 172.21.15.63:0/3827965455 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effbc100050 0x7effbc102430 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:22.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.860+0000 7effc47d3700 1 --2- 172.21.15.63:0/3827965455 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7effbc0fd730 0x7effbc0ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:22.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.860+0000 7effc47d3700 1 -- 172.21.15.63:0/3827965455 >> 172.21.15.63:0/3827965455 conn(0x7effbc0f7190 msgr2=0x7effbc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:22.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.860+0000 7effc47d3700 1 -- 172.21.15.63:0/3827965455 shutdown_connections 2023-12-07T16:24:22.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.860+0000 7effc47d3700 1 -- 172.21.15.63:0/3827965455 wait complete. 2023-12-07T16:24:22.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.860+0000 7effc47d3700 1 Processor -- start 2023-12-07T16:24:22.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.860+0000 7effc47d3700 1 -- start start 2023-12-07T16:24:22.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.861+0000 7effc47d3700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effbc0fd730 0x7effbc10d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:22.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.861+0000 7effc47d3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7effbc100050 0x7effbc10da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:22.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.861+0000 7effc47d3700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc10e070 con 0x7effbc0fd730 2023-12-07T16:24:22.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.861+0000 7effc47d3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc10e910 con 0x7effbc100050 2023-12-07T16:24:22.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.861+0000 7effc256f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effbc0fd730 0x7effbc10d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:22.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.861+0000 7effc256f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effbc0fd730 0x7effbc10d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52888/0 (socket says 172.21.15.63:52888) 2023-12-07T16:24:22.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.861+0000 7effc256f700 1 -- 172.21.15.63:0/2049366584 learned_addr learned my addr 172.21.15.63:0/2049366584 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:24:22.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.861+0000 7effc1d6e700 1 --2- 172.21.15.63:0/2049366584 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7effbc100050 0x7effbc10da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:22.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.861+0000 7effc256f700 1 -- 172.21.15.63:0/2049366584 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7effbc100050 msgr2=0x7effbc10da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:22.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.861+0000 7effc256f700 1 --2- 172.21.15.63:0/2049366584 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7effbc100050 0x7effbc10da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:22.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.861+0000 7effc256f700 1 -- 172.21.15.63:0/2049366584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb8005040 con 0x7effbc0fd730 2023-12-07T16:24:22.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.861+0000 7effc256f700 1 --2- 172.21.15.63:0/2049366584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effbc0fd730 0x7effbc10d530 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7effb000c830 tx=0x7effb0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:22.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.861+0000 7effaeffd700 1 -- 172.21.15.63:0/2049366584 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effb00106f0 con 0x7effbc0fd730 2023-12-07T16:24:22.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.861+0000 7effaeffd700 1 -- 172.21.15.63:0/2049366584 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7effb0010d00 con 0x7effbc0fd730 2023-12-07T16:24:22.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.861+0000 7effc47d3700 1 -- 172.21.15.63:0/2049366584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effbc10ebf0 con 0x7effbc0fd730 2023-12-07T16:24:22.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.862+0000 7effaeffd700 1 -- 172.21.15.63:0/2049366584 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effb0012e90 con 0x7effbc0fd730 2023-12-07T16:24:22.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.862+0000 7effc47d3700 1 -- 172.21.15.63:0/2049366584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc10f130 con 0x7effbc0fd730 2023-12-07T16:24:22.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.863+0000 7effc47d3700 1 -- 172.21.15.63:0/2049366584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effbc1075c0 con 0x7effbc0fd730 2023-12-07T16:24:22.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.863+0000 7effaeffd700 1 -- 172.21.15.63:0/2049366584 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7effb0010850 con 0x7effbc0fd730 2023-12-07T16:24:22.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.863+0000 7effaeffd700 1 --2- 172.21.15.63:0/2049366584 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7effa806ce60 0x7effa806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:22.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.863+0000 7effaeffd700 1 -- 172.21.15.63:0/2049366584 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6761+0+0 (secure 0 0 0) 0x7effb008c420 con 0x7effbc0fd730 2023-12-07T16:24:22.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.863+0000 7effc1d6e700 1 --2- 172.21.15.63:0/2049366584 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7effa806ce60 0x7effa806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:22.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.864+0000 7effc1d6e700 1 --2- 172.21.15.63:0/2049366584 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7effa806ce60 0x7effa806f310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7effb8004890 tx=0x7effb8009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:22.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:22.868+0000 7effaeffd700 1 -- 172.21.15.63:0/2049366584 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7effb0059cb0 con 0x7effbc0fd730 2023-12-07T16:24:22.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:22 smithi152 ceph-mon[175645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-07T16:24:22.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:22 smithi152 ceph-mon[175645]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-07T16:24:22.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:22 smithi152 ceph-mon[175645]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:24:22.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:22 smithi152 ceph-mon[175645]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:24:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:22 smithi152 ceph-mon[175645]: failed to encode map e69 with expected crc 2023-12-07T16:24:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:22 smithi152 ceph-mon[175645]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-07T16:24:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:22 smithi152 ceph-mon[175645]: failed to encode map e70 with expected crc 2023-12-07T16:24:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:22 smithi152 ceph-mon[175645]: osd.1 [v2:172.21.15.63:6810/394258268,v1:172.21.15.63:6811/394258268] boot 2023-12-07T16:24:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:22 smithi152 ceph-mon[175645]: osdmap e70: 6 total, 6 up, 6 in 2023-12-07T16:24:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:22 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-07T16:24:22.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:22 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/2684852205' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:24:23.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.087+0000 7effc47d3700 1 -- 172.21.15.63:0/2049366584 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7effbc10f420 con 0x7effa806ce60 2023-12-07T16:24:23.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.088+0000 7effaeffd700 1 -- 172.21.15.63:0/2049366584 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7effbc10f420 con 0x7effa806ce60 2023-12-07T16:24:23.086 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:24:23.086 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-07T16:24:23.086 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-07T16:24:23.086 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-07T16:24:23.086 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [ 2023-12-07T16:24:23.086 INFO:teuthology.orchestra.run.smithi063.stdout: "crash", 2023-12-07T16:24:23.086 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr", 2023-12-07T16:24:23.087 INFO:teuthology.orchestra.run.smithi063.stdout: "mon" 2023-12-07T16:24:23.087 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2023-12-07T16:24:23.087 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "8/21 daemons upgraded", 2023-12-07T16:24:23.087 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "Currently upgrading osd daemons", 2023-12-07T16:24:23.087 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-07T16:24:23.087 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:24:23.088 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.090+0000 7effc47d3700 1 -- 172.21.15.63:0/2049366584 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7effa806ce60 msgr2=0x7effa806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:23.088 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.090+0000 7effc47d3700 1 --2- 172.21.15.63:0/2049366584 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7effa806ce60 0x7effa806f310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7effb8004890 tx=0x7effb8009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:23.088 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.090+0000 7effc47d3700 1 -- 172.21.15.63:0/2049366584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effbc0fd730 msgr2=0x7effbc10d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:23.088 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.090+0000 7effc47d3700 1 --2- 172.21.15.63:0/2049366584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effbc0fd730 0x7effbc10d530 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7effb000c830 tx=0x7effb0004470 comp rx=0 tx=0).stop 2023-12-07T16:24:23.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.090+0000 7effc47d3700 1 -- 172.21.15.63:0/2049366584 shutdown_connections 2023-12-07T16:24:23.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.090+0000 7effc47d3700 1 --2- 172.21.15.63:0/2049366584 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7effa806ce60 0x7effa806f310 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:23.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.090+0000 7effc47d3700 1 --2- 172.21.15.63:0/2049366584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effbc0fd730 0x7effbc10d530 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:23.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.090+0000 7effc47d3700 1 --2- 172.21.15.63:0/2049366584 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7effbc100050 0x7effbc10da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:23.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.090+0000 7effc47d3700 1 -- 172.21.15.63:0/2049366584 >> 172.21.15.63:0/2049366584 conn(0x7effbc0f7190 msgr2=0x7effbc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:23.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.090+0000 7effc47d3700 1 -- 172.21.15.63:0/2049366584 shutdown_connections 2023-12-07T16:24:23.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.090+0000 7effc47d3700 1 -- 172.21.15.63:0/2049366584 wait complete. 2023-12-07T16:24:23.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:22 smithi063 ceph-mon[192008]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-07T16:24:23.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:22 smithi063 ceph-mon[192008]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-07T16:24:23.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:22 smithi063 ceph-mon[192008]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:24:23.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:22 smithi063 ceph-mon[192008]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:24:23.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:22 smithi063 ceph-mon[192008]: failed to encode map e69 with expected crc 2023-12-07T16:24:23.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:22 smithi063 ceph-mon[192008]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-07T16:24:23.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:22 smithi063 ceph-mon[192008]: failed to encode map e70 with expected crc 2023-12-07T16:24:23.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:22 smithi063 ceph-mon[192008]: osd.1 [v2:172.21.15.63:6810/394258268,v1:172.21.15.63:6811/394258268] boot 2023-12-07T16:24:23.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:22 smithi063 ceph-mon[192008]: osdmap e70: 6 total, 6 up, 6 in 2023-12-07T16:24:23.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:22 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-07T16:24:23.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:22 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/2684852205' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:24:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.199+0000 7fea92d37700 1 -- 172.21.15.63:0/1328376591 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea8c0fcd00 msgr2=0x7fea8c0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.199+0000 7fea92d37700 1 --2- 172.21.15.63:0/1328376591 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea8c0fcd00 0x7fea8c0fd150 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fea78004940 tx=0x7fea78009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.199+0000 7fea92d37700 1 -- 172.21.15.63:0/1328376591 shutdown_connections 2023-12-07T16:24:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.199+0000 7fea92d37700 1 --2- 172.21.15.63:0/1328376591 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea8c0fcd00 0x7fea8c0fd150 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.199+0000 7fea92d37700 1 --2- 172.21.15.63:0/1328376591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea8c0fbaf0 0x7fea8c0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.199+0000 7fea92d37700 1 -- 172.21.15.63:0/1328376591 >> 172.21.15.63:0/1328376591 conn(0x7fea8c0f7190 msgr2=0x7fea8c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.199+0000 7fea92d37700 1 -- 172.21.15.63:0/1328376591 shutdown_connections 2023-12-07T16:24:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.199+0000 7fea92d37700 1 -- 172.21.15.63:0/1328376591 wait complete. 2023-12-07T16:24:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.199+0000 7fea92d37700 1 Processor -- start 2023-12-07T16:24:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.199+0000 7fea92d37700 1 -- start start 2023-12-07T16:24:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.200+0000 7fea92d37700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea8c0fbaf0 0x7fea8c10d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.200+0000 7fea92d37700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea8c0fcd00 0x7fea8c10daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.200+0000 7fea92d37700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8c10e130 con 0x7fea8c0fcd00 2023-12-07T16:24:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.200+0000 7fea92d37700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8c10e970 con 0x7fea8c0fbaf0 2023-12-07T16:24:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.200+0000 7fea8bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea8c0fcd00 0x7fea8c10daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:23.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.200+0000 7fea8bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea8c0fcd00 0x7fea8c10daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52896/0 (socket says 172.21.15.63:52896) 2023-12-07T16:24:23.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.200+0000 7fea8bfff700 1 -- 172.21.15.63:0/1513578789 learned_addr learned my addr 172.21.15.63:0/1513578789 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:24:23.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.200+0000 7fea90ad3700 1 --2- 172.21.15.63:0/1513578789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea8c0fbaf0 0x7fea8c10d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:23.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.200+0000 7fea8bfff700 1 -- 172.21.15.63:0/1513578789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea8c0fbaf0 msgr2=0x7fea8c10d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:23.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.200+0000 7fea8bfff700 1 --2- 172.21.15.63:0/1513578789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea8c0fbaf0 0x7fea8c10d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:23.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.200+0000 7fea8bfff700 1 -- 172.21.15.63:0/1513578789 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea78005040 con 0x7fea8c0fcd00 2023-12-07T16:24:23.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.200+0000 7fea8bfff700 1 --2- 172.21.15.63:0/1513578789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea8c0fcd00 0x7fea8c10daa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fea78009fd0 tx=0x7fea78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:23.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.200+0000 7fea897fa700 1 -- 172.21.15.63:0/1513578789 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea7800e040 con 0x7fea8c0fcd00 2023-12-07T16:24:23.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.200+0000 7fea92d37700 1 -- 172.21.15.63:0/1513578789 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea8c10ebf0 con 0x7fea8c0fcd00 2023-12-07T16:24:23.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.200+0000 7fea897fa700 1 -- 172.21.15.63:0/1513578789 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fea78004290 con 0x7fea8c0fcd00 2023-12-07T16:24:23.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.201+0000 7fea897fa700 1 -- 172.21.15.63:0/1513578789 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea7801c3f0 con 0x7fea8c0fcd00 2023-12-07T16:24:23.201 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.201+0000 7fea92d37700 1 -- 172.21.15.63:0/1513578789 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea8c10f130 con 0x7fea8c0fcd00 2023-12-07T16:24:23.202 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.201+0000 7fea92d37700 1 -- 172.21.15.63:0/1513578789 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea8c04bb80 con 0x7fea8c0fcd00 2023-12-07T16:24:23.202 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.202+0000 7fea897fa700 1 -- 172.21.15.63:0/1513578789 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fea78013420 con 0x7fea8c0fcd00 2023-12-07T16:24:23.202 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.202+0000 7fea897fa700 1 --2- 172.21.15.63:0/1513578789 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fea7c06ce70 0x7fea7c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:23.202 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.203+0000 7fea897fa700 1 -- 172.21.15.63:0/1513578789 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6761+0+0 (secure 0 0 0) 0x7fea7808d8c0 con 0x7fea8c0fcd00 2023-12-07T16:24:23.202 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.203+0000 7fea90ad3700 1 --2- 172.21.15.63:0/1513578789 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fea7c06ce70 0x7fea7c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:23.202 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.203+0000 7fea90ad3700 1 --2- 172.21.15.63:0/1513578789 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fea7c06ce70 0x7fea7c06f320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fea80006fd0 tx=0x7fea80008040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:23.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.207+0000 7fea897fa700 1 -- 172.21.15.63:0/1513578789 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fea7805b0d0 con 0x7fea8c0fcd00 2023-12-07T16:24:23.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.490+0000 7fea92d37700 1 -- 172.21.15.63:0/1513578789 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fea8c104530 con 0x7fea8c0fcd00 2023-12-07T16:24:23.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.490+0000 7fea897fa700 1 -- 172.21.15.63:0/1513578789 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1261 (secure 0 0 0) 0x7fea7805ac60 con 0x7fea8c0fcd00 2023-12-07T16:24:23.488 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 56/360 objects degraded (15.556%), 16 pgs degraded 2023-12-07T16:24:23.488 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-07T16:24:23.488 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-07T16:24:23.488 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 56/360 objects degraded (15.556%), 16 pgs degraded 2023-12-07T16:24:23.488 INFO:teuthology.orchestra.run.smithi063.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2023-12-07T16:24:23.488 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2023-12-07T16:24:23.488 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2023-12-07T16:24:23.488 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2023-12-07T16:24:23.489 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2023-12-07T16:24:23.489 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2023-12-07T16:24:23.489 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.6 is active+undersized+degraded, acting [0,4] 2023-12-07T16:24:23.489 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2023-12-07T16:24:23.489 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2023-12-07T16:24:23.489 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2023-12-07T16:24:23.489 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2023-12-07T16:24:23.489 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.11 is active+undersized+degraded, acting [4,3] 2023-12-07T16:24:23.489 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2023-12-07T16:24:23.489 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2023-12-07T16:24:23.489 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2023-12-07T16:24:23.490 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2023-12-07T16:24:23.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.492+0000 7fea92d37700 1 -- 172.21.15.63:0/1513578789 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fea7c06ce70 msgr2=0x7fea7c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:23.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.492+0000 7fea92d37700 1 --2- 172.21.15.63:0/1513578789 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fea7c06ce70 0x7fea7c06f320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fea80006fd0 tx=0x7fea80008040 comp rx=0 tx=0).stop 2023-12-07T16:24:23.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.492+0000 7fea92d37700 1 -- 172.21.15.63:0/1513578789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea8c0fcd00 msgr2=0x7fea8c10daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:23.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.492+0000 7fea92d37700 1 --2- 172.21.15.63:0/1513578789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea8c0fcd00 0x7fea8c10daa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fea78009fd0 tx=0x7fea78009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:23.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.492+0000 7fea92d37700 1 -- 172.21.15.63:0/1513578789 shutdown_connections 2023-12-07T16:24:23.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.492+0000 7fea92d37700 1 --2- 172.21.15.63:0/1513578789 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fea7c06ce70 0x7fea7c06f320 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:23.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.492+0000 7fea92d37700 1 --2- 172.21.15.63:0/1513578789 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea8c0fbaf0 0x7fea8c10d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:23.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.492+0000 7fea92d37700 1 --2- 172.21.15.63:0/1513578789 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea8c0fcd00 0x7fea8c10daa0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:23.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.492+0000 7fea92d37700 1 -- 172.21.15.63:0/1513578789 >> 172.21.15.63:0/1513578789 conn(0x7fea8c0f7190 msgr2=0x7fea8c065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:23.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.492+0000 7fea92d37700 1 -- 172.21.15.63:0/1513578789 shutdown_connections 2023-12-07T16:24:23.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:23.492+0000 7fea92d37700 1 -- 172.21.15.63:0/1513578789 wait complete. 2023-12-07T16:24:23.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:23 smithi152 ceph-mon[175645]: pgmap v73: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 767 B/s wr, 0 op/s; 56/360 objects degraded (15.556%) 2023-12-07T16:24:23.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:23 smithi152 ceph-mon[175645]: from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:24:23.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:23 smithi152 ceph-mon[175645]: failed to encode map e71 with expected crc 2023-12-07T16:24:23.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:23 smithi152 ceph-mon[175645]: osdmap e71: 6 total, 6 up, 6 in 2023-12-07T16:24:23.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:23 smithi152 ceph-mon[175645]: failed to encode map e71 with expected crc 2023-12-07T16:24:23.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:23 smithi152 ceph-mon[175645]: failed to encode map e71 with expected crc 2023-12-07T16:24:23.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:23 smithi152 ceph-mon[175645]: failed to encode map e71 with expected crc 2023-12-07T16:24:23.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:23 smithi152 ceph-mon[175645]: failed to encode map e71 with expected crc 2023-12-07T16:24:23.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:23 smithi152 ceph-mon[175645]: failed to encode map e71 with expected crc 2023-12-07T16:24:23.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:23 smithi152 ceph-mon[175645]: failed to encode map e71 with expected crc 2023-12-07T16:24:23.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:23 smithi152 ceph-mon[175645]: failed to encode map e71 with expected crc 2023-12-07T16:24:23.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:23 smithi152 ceph-mon[175645]: failed to encode map e71 with expected crc 2023-12-07T16:24:23.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:23 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/503256335' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:24:23.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:23 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/1513578789' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:24:24.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:23 smithi063 ceph-mon[192008]: pgmap v73: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 767 B/s wr, 0 op/s; 56/360 objects degraded (15.556%) 2023-12-07T16:24:24.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:23 smithi063 ceph-mon[192008]: from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:24:24.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:23 smithi063 ceph-mon[192008]: failed to encode map e71 with expected crc 2023-12-07T16:24:24.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:23 smithi063 ceph-mon[192008]: osdmap e71: 6 total, 6 up, 6 in 2023-12-07T16:24:24.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:23 smithi063 ceph-mon[192008]: failed to encode map e71 with expected crc 2023-12-07T16:24:24.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:23 smithi063 ceph-mon[192008]: failed to encode map e71 with expected crc 2023-12-07T16:24:24.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:23 smithi063 ceph-mon[192008]: failed to encode map e71 with expected crc 2023-12-07T16:24:24.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:23 smithi063 ceph-mon[192008]: failed to encode map e71 with expected crc 2023-12-07T16:24:24.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:23 smithi063 ceph-mon[192008]: failed to encode map e71 with expected crc 2023-12-07T16:24:24.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:23 smithi063 ceph-mon[192008]: failed to encode map e71 with expected crc 2023-12-07T16:24:24.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:23 smithi063 ceph-mon[192008]: failed to encode map e71 with expected crc 2023-12-07T16:24:24.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:23 smithi063 ceph-mon[192008]: failed to encode map e71 with expected crc 2023-12-07T16:24:24.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:23 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/503256335' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:24:24.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:23 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/1513578789' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:24:24.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:24 smithi152 ceph-mon[175645]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:24:25.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:24 smithi063 ceph-mon[192008]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:24:25.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:25 smithi152 ceph-mon[175645]: pgmap v75: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2023-12-07T16:24:26.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:25 smithi063 ceph-mon[192008]: pgmap v75: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 56/360 objects degraded (15.556%) 2023-12-07T16:24:27.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:26 smithi063 ceph-mon[192008]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 56/360 objects degraded (15.556%), 16 pgs degraded) 2023-12-07T16:24:27.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:26 smithi152 ceph-mon[175645]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 56/360 objects degraded (15.556%), 16 pgs degraded) 2023-12-07T16:24:28.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:27 smithi063 ceph-mon[192008]: pgmap v76: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 14 B/s, 0 objects/s recovering 2023-12-07T16:24:28.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:27 smithi152 ceph-mon[175645]: pgmap v76: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 14 B/s, 0 objects/s recovering 2023-12-07T16:24:30.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:29 smithi063 ceph-mon[192008]: pgmap v77: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 12 B/s, 0 objects/s recovering 2023-12-07T16:24:30.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:29 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:30.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:29 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:24:30.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:29 smithi152 ceph-mon[175645]: pgmap v77: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 12 B/s, 0 objects/s recovering 2023-12-07T16:24:30.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:29 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:30.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:29 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:24:32.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:31 smithi063 ceph-mon[192008]: pgmap v78: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 10 B/s, 0 objects/s recovering 2023-12-07T16:24:32.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:31 smithi152 ceph-mon[175645]: pgmap v78: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 10 B/s, 0 objects/s recovering 2023-12-07T16:24:34.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:33 smithi063 ceph-mon[192008]: pgmap v79: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 8 B/s, 0 objects/s recovering 2023-12-07T16:24:34.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:33 smithi152 ceph-mon[175645]: pgmap v79: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 8 B/s, 0 objects/s recovering 2023-12-07T16:24:35.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:35 smithi063 ceph-mon[192008]: pgmap v80: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7 B/s, 0 objects/s recovering 2023-12-07T16:24:35.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:35 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:35.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:35 smithi152 ceph-mon[175645]: pgmap v80: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7 B/s, 0 objects/s recovering 2023-12-07T16:24:35.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:35 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:37.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:37 smithi063 ceph-mon[192008]: pgmap v81: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7 B/s, 0 objects/s recovering 2023-12-07T16:24:37.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:37 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-07T16:24:37.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:37 smithi063 ceph-mon[192008]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-07T16:24:37.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:37 smithi063 ceph-mon[192008]: Upgrade: osd.2 is safe to restart 2023-12-07T16:24:37.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:37 smithi152 ceph-mon[175645]: pgmap v81: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7 B/s, 0 objects/s recovering 2023-12-07T16:24:37.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:37 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-07T16:24:37.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:37 smithi152 ceph-mon[175645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-07T16:24:37.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:37 smithi152 ceph-mon[175645]: Upgrade: osd.2 is safe to restart 2023-12-07T16:24:38.398 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:38 smithi063 ceph-mon[192008]: Upgrade: Updating osd.2 2023-12-07T16:24:38.399 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:38 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:38.399 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:38 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-07T16:24:38.399 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:38 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:24:38.399 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:38 smithi063 ceph-mon[192008]: Deploying daemon osd.2 on smithi063 2023-12-07T16:24:38.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:38 smithi152 ceph-mon[175645]: Upgrade: Updating osd.2 2023-12-07T16:24:38.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:38 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:38.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:38 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-07T16:24:38.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:38 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:24:38.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:38 smithi152 ceph-mon[175645]: Deploying daemon osd.2 on smithi063 2023-12-07T16:24:39.622 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:24:39 smithi063 systemd[1]: Stopping Ceph osd.2 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:24:39.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:39 smithi063 ceph-mon[192008]: pgmap v82: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:24:39.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:39 smithi063 ceph-mon[192008]: osd.2 marked itself down and dead 2023-12-07T16:24:39.905 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:24:39 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-2[154315]: 2023-12-07T16:24:39.624+0000 7fe26d301700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-07T16:24:39.905 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:24:39 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-2[154315]: 2023-12-07T16:24:39.624+0000 7fe26d301700 -1 osd.2 71 *** Got signal Terminated *** 2023-12-07T16:24:39.905 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:24:39 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-2[154315]: 2023-12-07T16:24:39.624+0000 7fe26d301700 -1 osd.2 71 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-07T16:24:39.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:39 smithi152 ceph-mon[175645]: pgmap v82: 65 pgs: 65 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:24:39.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:39 smithi152 ceph-mon[175645]: osd.2 marked itself down and dead 2023-12-07T16:24:40.655 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:24:40 smithi063 bash[215905]: ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-2 2023-12-07T16:24:40.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:40 smithi152 ceph-mon[175645]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-07T16:24:40.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:40 smithi152 ceph-mon[175645]: failed to encode map e72 with expected crc 2023-12-07T16:24:40.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:40 smithi152 ceph-mon[175645]: osdmap e72: 6 total, 5 up, 6 in 2023-12-07T16:24:41.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:40 smithi063 ceph-mon[192008]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-07T16:24:41.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:40 smithi063 ceph-mon[192008]: failed to encode map e72 with expected crc 2023-12-07T16:24:41.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:40 smithi063 ceph-mon[192008]: osdmap e72: 6 total, 5 up, 6 in 2023-12-07T16:24:41.905 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:24:41 smithi063 systemd[1]: ceph-8c493298-951b-11ee-95a2-87774f69a715@osd.2.service: Succeeded. 2023-12-07T16:24:41.905 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:24:41 smithi063 systemd[1]: Stopped Ceph osd.2 for 8c493298-951b-11ee-95a2-87774f69a715. 2023-12-07T16:24:41.905 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:24:41 smithi063 systemd[1]: Starting Ceph osd.2 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:24:41.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:41 smithi063 ceph-mon[192008]: pgmap v84: 65 pgs: 21 peering, 5 stale+active+clean, 39 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:24:41.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:41 smithi063 ceph-mon[192008]: Health check failed: Reduced data availability: 1 pg inactive, 5 pgs peering (PG_AVAILABILITY) 2023-12-07T16:24:41.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:41 smithi063 ceph-mon[192008]: failed to encode map e73 with expected crc 2023-12-07T16:24:41.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:41 smithi063 ceph-mon[192008]: osdmap e73: 6 total, 5 up, 6 in 2023-12-07T16:24:41.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:41 smithi063 ceph-mon[192008]: failed to encode map e73 with expected crc 2023-12-07T16:24:41.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:41 smithi063 ceph-mon[192008]: failed to encode map e73 with expected crc 2023-12-07T16:24:41.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:41 smithi063 ceph-mon[192008]: failed to encode map e73 with expected crc 2023-12-07T16:24:41.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:41 smithi063 ceph-mon[192008]: failed to encode map e73 with expected crc 2023-12-07T16:24:41.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:41 smithi063 ceph-mon[192008]: failed to encode map e73 with expected crc 2023-12-07T16:24:41.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:41 smithi063 ceph-mon[192008]: failed to encode map e73 with expected crc 2023-12-07T16:24:41.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:41 smithi152 ceph-mon[175645]: pgmap v84: 65 pgs: 21 peering, 5 stale+active+clean, 39 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:24:41.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:41 smithi152 ceph-mon[175645]: Health check failed: Reduced data availability: 1 pg inactive, 5 pgs peering (PG_AVAILABILITY) 2023-12-07T16:24:41.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:41 smithi152 ceph-mon[175645]: failed to encode map e73 with expected crc 2023-12-07T16:24:41.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:41 smithi152 ceph-mon[175645]: osdmap e73: 6 total, 5 up, 6 in 2023-12-07T16:24:41.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:41 smithi152 ceph-mon[175645]: failed to encode map e73 with expected crc 2023-12-07T16:24:41.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:41 smithi152 ceph-mon[175645]: failed to encode map e73 with expected crc 2023-12-07T16:24:41.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:41 smithi152 ceph-mon[175645]: failed to encode map e73 with expected crc 2023-12-07T16:24:41.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:41 smithi152 ceph-mon[175645]: failed to encode map e73 with expected crc 2023-12-07T16:24:41.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:41 smithi152 ceph-mon[175645]: failed to encode map e73 with expected crc 2023-12-07T16:24:41.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:41 smithi152 ceph-mon[175645]: failed to encode map e73 with expected crc 2023-12-07T16:24:42.772 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:24:42 smithi063 bash[216168]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-07T16:24:42.772 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:24:42 smithi063 bash[216168]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-07T16:24:42.772 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:24:42 smithi063 bash[216168]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-07T16:24:42.772 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:24:42 smithi063 bash[216168]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-07T16:24:42.772 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:24:42 smithi063 bash[216168]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2023-12-07T16:24:42.772 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:24:42 smithi063 bash[216168]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-07T16:24:42.772 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:24:42 smithi063 bash[216168]: --> ceph-volume raw activate successful for osd ID: 2 2023-12-07T16:24:43.405 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:24:43 smithi063 ceph-osd[216489]: -- 172.21.15.63:0/3682927536 <== mon.0 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56281b7251e0 con 0x56281b6f5000 2023-12-07T16:24:43.405 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:24:43 smithi063 bash[216451]: a473024763f8af611d550a5262dd48dd89bd2353f3e7d2cb98e401707557688c 2023-12-07T16:24:43.405 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:24:43 smithi063 systemd[1]: Started Ceph osd.2 for 8c493298-951b-11ee-95a2-87774f69a715. 2023-12-07T16:24:43.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:43 smithi152 ceph-mon[175645]: pgmap v86: 65 pgs: 28 peering, 1 stale+active+clean, 36 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:24:43.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:43 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:43.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:43 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:43.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:43 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:24:44.156 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:24:43 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-2[216466]: 2023-12-07T16:24:43.674+0000 7fdfa6e97640 -1 Falling back to public interface 2023-12-07T16:24:44.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:43 smithi063 ceph-mon[192008]: pgmap v86: 65 pgs: 28 peering, 1 stale+active+clean, 36 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:24:44.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:43 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:44.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:43 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:44.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:43 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:24:45.000 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:45 smithi063 ceph-mon[192008]: pgmap v87: 65 pgs: 28 peering, 1 stale+active+clean, 36 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:24:45.000 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:45 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:45.000 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:45 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:24:45.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:45 smithi152 ceph-mon[175645]: pgmap v87: 65 pgs: 28 peering, 1 stale+active+clean, 36 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2023-12-07T16:24:45.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:45 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:45.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:45 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:24:46.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:46 smithi063 ceph-mon[192008]: Health check failed: Degraded data redundancy: 47/360 objects degraded (13.056%), 13 pgs degraded (PG_DEGRADED) 2023-12-07T16:24:46.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:46 smithi063 ceph-mon[192008]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 9 pgs peering) 2023-12-07T16:24:46.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:46 smithi152 ceph-mon[175645]: Health check failed: Degraded data redundancy: 47/360 objects degraded (13.056%), 13 pgs degraded (PG_DEGRADED) 2023-12-07T16:24:46.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:46 smithi152 ceph-mon[175645]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 9 pgs peering) 2023-12-07T16:24:47.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:47 smithi152 ceph-mon[175645]: pgmap v88: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 47/360 objects degraded (13.056%) 2023-12-07T16:24:47.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:47 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:47.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:47 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:47.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:47 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:47.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:47 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:47.496 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:47 smithi063 ceph-mon[192008]: pgmap v88: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 47/360 objects degraded (13.056%) 2023-12-07T16:24:47.496 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:47 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:47.496 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:47 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:47.497 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:47 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:47.497 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:47 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:47.855 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:24:47 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-2[216466]: 2023-12-07T16:24:47.644+0000 7fdfa6e97640 -1 osd.2 0 read_superblock omap replica is missing. 2023-12-07T16:24:48.405 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:24:48 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-2[216466]: 2023-12-07T16:24:48.121+0000 7fdfa6e97640 -1 osd.2 71 log_to_monitors true 2023-12-07T16:24:48.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:48 smithi152 ceph-mon[175645]: from='osd.2 [v2:172.21.15.63:6818/2943243764,v1:172.21.15.63:6819/2943243764]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-07T16:24:49.115 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:24:48 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-2[216466]: 2023-12-07T16:24:48.701+0000 7fdf96b05700 -1 osd.2 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T16:24:49.115 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:48 smithi063 ceph-mon[192008]: from='osd.2 [v2:172.21.15.63:6818/2943243764,v1:172.21.15.63:6819/2943243764]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-07T16:24:49.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:49 smithi152 ceph-mon[175645]: pgmap v89: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 47/360 objects degraded (13.056%) 2023-12-07T16:24:49.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:49 smithi152 ceph-mon[175645]: from='osd.2 [v2:172.21.15.63:6818/2943243764,v1:172.21.15.63:6819/2943243764]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-07T16:24:49.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:49 smithi152 ceph-mon[175645]: osdmap e74: 6 total, 5 up, 6 in 2023-12-07T16:24:49.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:49 smithi152 ceph-mon[175645]: from='osd.2 [v2:172.21.15.63:6818/2943243764,v1:172.21.15.63:6819/2943243764]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-07T16:24:49.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:49 smithi152 ceph-mon[175645]: failed to encode map e74 with expected crc 2023-12-07T16:24:49.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:49 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:49.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:49 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:49.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:49 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:24:49.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:49 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:24:49.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:49 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:49.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:49 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:24:49.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:49 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:24:49.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:49 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:24:49.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:49 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:24:49.994 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:49 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-07T16:24:50.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:49 smithi063 ceph-mon[192008]: pgmap v89: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 308 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 47/360 objects degraded (13.056%) 2023-12-07T16:24:50.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:49 smithi063 ceph-mon[192008]: from='osd.2 [v2:172.21.15.63:6818/2943243764,v1:172.21.15.63:6819/2943243764]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-07T16:24:50.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:49 smithi063 ceph-mon[192008]: osdmap e74: 6 total, 5 up, 6 in 2023-12-07T16:24:50.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:49 smithi063 ceph-mon[192008]: from='osd.2 [v2:172.21.15.63:6818/2943243764,v1:172.21.15.63:6819/2943243764]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2023-12-07T16:24:50.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:49 smithi063 ceph-mon[192008]: failed to encode map e74 with expected crc 2023-12-07T16:24:50.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:49 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:50.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:49 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:50.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:49 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:24:50.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:49 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:24:50.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:49 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:50.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:49 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:24:50.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:49 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:24:50.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:49 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:24:50.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:49 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:24:50.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:49 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-07T16:24:50.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:50 smithi152 ceph-mon[175645]: failed to encode map e74 with expected crc 2023-12-07T16:24:50.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:50 smithi152 ceph-mon[175645]: failed to encode map e74 with expected crc 2023-12-07T16:24:50.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:50 smithi152 ceph-mon[175645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-07T16:24:50.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:50 smithi152 ceph-mon[175645]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-07T16:24:50.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:50 smithi152 ceph-mon[175645]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-07T16:24:50.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:50 smithi152 ceph-mon[175645]: osd.2 [v2:172.21.15.63:6818/2943243764,v1:172.21.15.63:6819/2943243764] boot 2023-12-07T16:24:50.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:50 smithi152 ceph-mon[175645]: osdmap e75: 6 total, 6 up, 6 in 2023-12-07T16:24:50.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:50 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T16:24:50.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:50 smithi152 ceph-mon[175645]: osdmap e76: 6 total, 6 up, 6 in 2023-12-07T16:24:51.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:50 smithi063 ceph-mon[192008]: failed to encode map e74 with expected crc 2023-12-07T16:24:51.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:50 smithi063 ceph-mon[192008]: failed to encode map e74 with expected crc 2023-12-07T16:24:51.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:50 smithi063 ceph-mon[192008]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-07T16:24:51.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:50 smithi063 ceph-mon[192008]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-07T16:24:51.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:50 smithi063 ceph-mon[192008]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-07T16:24:51.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:50 smithi063 ceph-mon[192008]: osd.2 [v2:172.21.15.63:6818/2943243764,v1:172.21.15.63:6819/2943243764] boot 2023-12-07T16:24:51.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:50 smithi063 ceph-mon[192008]: osdmap e75: 6 total, 6 up, 6 in 2023-12-07T16:24:51.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:50 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T16:24:51.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:50 smithi063 ceph-mon[192008]: osdmap e76: 6 total, 6 up, 6 in 2023-12-07T16:24:51.704 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:51 smithi063 ceph-mon[192008]: pgmap v92: 65 pgs: 10 peering, 12 active+undersized, 8 active+undersized+degraded, 35 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 30/360 objects degraded (8.333%) 2023-12-07T16:24:51.704 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:51 smithi063 ceph-mon[192008]: failed to encode map e76 with expected crc 2023-12-07T16:24:51.704 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:51 smithi063 ceph-mon[192008]: failed to encode map e76 with expected crc 2023-12-07T16:24:51.704 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:51 smithi063 ceph-mon[192008]: failed to encode map e76 with expected crc 2023-12-07T16:24:51.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:51 smithi152 ceph-mon[175645]: pgmap v92: 65 pgs: 10 peering, 12 active+undersized, 8 active+undersized+degraded, 35 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 30/360 objects degraded (8.333%) 2023-12-07T16:24:51.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:51 smithi152 ceph-mon[175645]: failed to encode map e76 with expected crc 2023-12-07T16:24:51.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:51 smithi152 ceph-mon[175645]: failed to encode map e76 with expected crc 2023-12-07T16:24:51.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:51 smithi152 ceph-mon[175645]: failed to encode map e76 with expected crc 2023-12-07T16:24:51.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:51 smithi152 ceph-mon[175645]: failed to encode map e76 with expected crc 2023-12-07T16:24:51.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:51 smithi152 ceph-mon[175645]: failed to encode map e76 with expected crc 2023-12-07T16:24:51.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:51 smithi152 ceph-mon[175645]: failed to encode map e76 with expected crc 2023-12-07T16:24:52.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:51 smithi063 ceph-mon[192008]: failed to encode map e76 with expected crc 2023-12-07T16:24:52.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:51 smithi063 ceph-mon[192008]: failed to encode map e76 with expected crc 2023-12-07T16:24:52.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:51 smithi063 ceph-mon[192008]: failed to encode map e76 with expected crc 2023-12-07T16:24:52.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:52 smithi152 ceph-mon[175645]: Health check update: Degraded data redundancy: 30/360 objects degraded (8.333%), 8 pgs degraded (PG_DEGRADED) 2023-12-07T16:24:53.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:52 smithi063 ceph-mon[192008]: Health check update: Degraded data redundancy: 30/360 objects degraded (8.333%), 8 pgs degraded (PG_DEGRADED) 2023-12-07T16:24:53.607 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.610+0000 7f1f237e7700 1 -- 172.21.15.63:0/3262278095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f1c066090 msgr2=0x7f1f1c0ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:53.607 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.610+0000 7f1f237e7700 1 --2- 172.21.15.63:0/3262278095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f1c066090 0x7f1f1c0ff7a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1f10004940 tx=0x7f1f10009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:53.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.610+0000 7f1f237e7700 1 -- 172.21.15.63:0/3262278095 shutdown_connections 2023-12-07T16:24:53.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.610+0000 7f1f237e7700 1 --2- 172.21.15.63:0/3262278095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f1c0ffd70 0x7f1f1c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:53.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.610+0000 7f1f237e7700 1 --2- 172.21.15.63:0/3262278095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f1c066090 0x7f1f1c0ff7a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:53.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.610+0000 7f1f237e7700 1 -- 172.21.15.63:0/3262278095 >> 172.21.15.63:0/3262278095 conn(0x7f1f1c0f7190 msgr2=0x7f1f1c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:53.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.610+0000 7f1f237e7700 1 -- 172.21.15.63:0/3262278095 shutdown_connections 2023-12-07T16:24:53.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.610+0000 7f1f237e7700 1 -- 172.21.15.63:0/3262278095 wait complete. 2023-12-07T16:24:53.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.611+0000 7f1f237e7700 1 Processor -- start 2023-12-07T16:24:53.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.611+0000 7f1f237e7700 1 -- start start 2023-12-07T16:24:53.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.611+0000 7f1f237e7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f1c066090 0x7f1f1c10d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:53.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.611+0000 7f1f237e7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f1c0ffd70 0x7f1f1c10dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:53.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.611+0000 7f1f237e7700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c10e0c0 con 0x7f1f1c0ffd70 2023-12-07T16:24:53.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.611+0000 7f1f237e7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c10e960 con 0x7f1f1c066090 2023-12-07T16:24:53.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.611+0000 7f1f20d82700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f1c0ffd70 0x7f1f1c10dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:53.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.611+0000 7f1f20d82700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f1c0ffd70 0x7f1f1c10dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58666/0 (socket says 172.21.15.63:58666) 2023-12-07T16:24:53.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.611+0000 7f1f20d82700 1 -- 172.21.15.63:0/1708233595 learned_addr learned my addr 172.21.15.63:0/1708233595 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:24:53.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.611+0000 7f1f21583700 1 --2- 172.21.15.63:0/1708233595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f1c066090 0x7f1f1c10d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:53.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.611+0000 7f1f20d82700 1 -- 172.21.15.63:0/1708233595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f1c066090 msgr2=0x7f1f1c10d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:53.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.611+0000 7f1f20d82700 1 --2- 172.21.15.63:0/1708233595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f1c066090 0x7f1f1c10d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:53.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.611+0000 7f1f20d82700 1 -- 172.21.15.63:0/1708233595 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f10005040 con 0x7f1f1c0ffd70 2023-12-07T16:24:53.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.612+0000 7f1f20d82700 1 --2- 172.21.15.63:0/1708233595 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f1c0ffd70 0x7f1f1c10dac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800c890 tx=0x7f1f180044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:53.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.612+0000 7f1f0dffb700 1 -- 172.21.15.63:0/1708233595 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f1800a700 con 0x7f1f1c0ffd70 2023-12-07T16:24:53.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.612+0000 7f1f0dffb700 1 -- 172.21.15.63:0/1708233595 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1f1800ad10 con 0x7f1f1c0ffd70 2023-12-07T16:24:53.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.612+0000 7f1f237e7700 1 -- 172.21.15.63:0/1708233595 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f1c10ec40 con 0x7f1f1c0ffd70 2023-12-07T16:24:53.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.612+0000 7f1f0dffb700 1 -- 172.21.15.63:0/1708233595 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f18012e70 con 0x7f1f1c0ffd70 2023-12-07T16:24:53.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.612+0000 7f1f237e7700 1 -- 172.21.15.63:0/1708233595 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f1c10f180 con 0x7f1f1c0ffd70 2023-12-07T16:24:53.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.613+0000 7f1f237e7700 1 -- 172.21.15.63:0/1708233595 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f1c1075e0 con 0x7f1f1c0ffd70 2023-12-07T16:24:53.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.613+0000 7f1f0dffb700 1 -- 172.21.15.63:0/1708233595 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f1f1800a860 con 0x7f1f1c0ffd70 2023-12-07T16:24:53.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.614+0000 7f1f0dffb700 1 --2- 172.21.15.63:0/1708233595 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f1f0806ce60 0x7f1f0806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:53.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.614+0000 7f1f0dffb700 1 -- 172.21.15.63:0/1708233595 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f1f1808c460 con 0x7f1f1c0ffd70 2023-12-07T16:24:53.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.614+0000 7f1f21583700 1 --2- 172.21.15.63:0/1708233595 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f1f0806ce60 0x7f1f0806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:53.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.614+0000 7f1f21583700 1 --2- 172.21.15.63:0/1708233595 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f1f0806ce60 0x7f1f0806f310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1f10004890 tx=0x7f1f10009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:53.616 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.619+0000 7f1f0dffb700 1 -- 172.21.15.63:0/1708233595 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1f18059cf0 con 0x7f1f1c0ffd70 2023-12-07T16:24:53.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.835+0000 7f1f237e7700 1 -- 172.21.15.63:0/1708233595 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f1c10f400 con 0x7f1f0806ce60 2023-12-07T16:24:53.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.836+0000 7f1f0dffb700 1 -- 172.21.15.63:0/1708233595 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1f1c10f400 con 0x7f1f0806ce60 2023-12-07T16:24:53.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.838+0000 7f1f237e7700 1 -- 172.21.15.63:0/1708233595 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f1f0806ce60 msgr2=0x7f1f0806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:53.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.838+0000 7f1f237e7700 1 --2- 172.21.15.63:0/1708233595 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f1f0806ce60 0x7f1f0806f310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1f10004890 tx=0x7f1f10009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:53.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.838+0000 7f1f237e7700 1 -- 172.21.15.63:0/1708233595 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f1c0ffd70 msgr2=0x7f1f1c10dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:53.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.838+0000 7f1f237e7700 1 --2- 172.21.15.63:0/1708233595 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f1c0ffd70 0x7f1f1c10dac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800c890 tx=0x7f1f180044c0 comp rx=0 tx=0).stop 2023-12-07T16:24:53.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.838+0000 7f1f237e7700 1 -- 172.21.15.63:0/1708233595 shutdown_connections 2023-12-07T16:24:53.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.838+0000 7f1f237e7700 1 --2- 172.21.15.63:0/1708233595 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f1f0806ce60 0x7f1f0806f310 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:53.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.838+0000 7f1f237e7700 1 --2- 172.21.15.63:0/1708233595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f1c066090 0x7f1f1c10d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:53.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.838+0000 7f1f237e7700 1 --2- 172.21.15.63:0/1708233595 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f1c0ffd70 0x7f1f1c10dac0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:53.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.838+0000 7f1f237e7700 1 -- 172.21.15.63:0/1708233595 >> 172.21.15.63:0/1708233595 conn(0x7f1f1c0f7190 msgr2=0x7f1f1c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:53.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.838+0000 7f1f237e7700 1 -- 172.21.15.63:0/1708233595 shutdown_connections 2023-12-07T16:24:53.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.838+0000 7f1f237e7700 1 -- 172.21.15.63:0/1708233595 wait complete. 2023-12-07T16:24:53.846 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-07T16:24:53.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.942+0000 7f39fd4c0700 1 -- 172.21.15.63:0/1470904667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39f80fbaf0 msgr2=0x7f39f80fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:53.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.942+0000 7f39fd4c0700 1 --2- 172.21.15.63:0/1470904667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39f80fbaf0 0x7f39f80fbf00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f39e8004940 tx=0x7f39e8009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:53.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.942+0000 7f39fd4c0700 1 -- 172.21.15.63:0/1470904667 shutdown_connections 2023-12-07T16:24:53.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.942+0000 7f39fd4c0700 1 --2- 172.21.15.63:0/1470904667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39f80fcd00 0x7f39f80fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:53.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.942+0000 7f39fd4c0700 1 --2- 172.21.15.63:0/1470904667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39f80fbaf0 0x7f39f80fbf00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:53.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.942+0000 7f39fd4c0700 1 -- 172.21.15.63:0/1470904667 >> 172.21.15.63:0/1470904667 conn(0x7f39f80f71d0 msgr2=0x7f39f80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:53.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.942+0000 7f39fd4c0700 1 -- 172.21.15.63:0/1470904667 shutdown_connections 2023-12-07T16:24:53.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.942+0000 7f39fd4c0700 1 -- 172.21.15.63:0/1470904667 wait complete. 2023-12-07T16:24:53.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.943+0000 7f39fd4c0700 1 Processor -- start 2023-12-07T16:24:53.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.943+0000 7f39fd4c0700 1 -- start start 2023-12-07T16:24:53.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.943+0000 7f39fd4c0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39f80fbaf0 0x7f39f810d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:53.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.943+0000 7f39fd4c0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39f80fcd00 0x7f39f810dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:53.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.943+0000 7f39fd4c0700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f810e140 con 0x7f39f80fcd00 2023-12-07T16:24:53.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.943+0000 7f39fd4c0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f810e980 con 0x7f39f80fbaf0 2023-12-07T16:24:53.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.943+0000 7f39f67fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39f80fcd00 0x7f39f810dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:53.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.944+0000 7f39f67fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39f80fcd00 0x7f39f810dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58680/0 (socket says 172.21.15.63:58680) 2023-12-07T16:24:53.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.944+0000 7f39f67fc700 1 -- 172.21.15.63:0/104553359 learned_addr learned my addr 172.21.15.63:0/104553359 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:24:53.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.944+0000 7f39f6ffd700 1 --2- 172.21.15.63:0/104553359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39f80fbaf0 0x7f39f810d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:53.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.944+0000 7f39f67fc700 1 -- 172.21.15.63:0/104553359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39f80fbaf0 msgr2=0x7f39f810d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:53.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.944+0000 7f39f67fc700 1 --2- 172.21.15.63:0/104553359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39f80fbaf0 0x7f39f810d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:53.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.944+0000 7f39f67fc700 1 -- 172.21.15.63:0/104553359 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e8005040 con 0x7f39f80fcd00 2023-12-07T16:24:53.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.944+0000 7f39f67fc700 1 --2- 172.21.15.63:0/104553359 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39f80fcd00 0x7f39f810dab0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f39e000b790 tx=0x7f39e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:53.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.944+0000 7f39ef7fe700 1 -- 172.21.15.63:0/104553359 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39e000f6f0 con 0x7f39f80fcd00 2023-12-07T16:24:53.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.944+0000 7f39fd4c0700 1 -- 172.21.15.63:0/104553359 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f810ec60 con 0x7f39f80fcd00 2023-12-07T16:24:53.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.944+0000 7f39ef7fe700 1 -- 172.21.15.63:0/104553359 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f39e000fd00 con 0x7f39f80fcd00 2023-12-07T16:24:53.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.944+0000 7f39ef7fe700 1 -- 172.21.15.63:0/104553359 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39e00103a0 con 0x7f39f80fcd00 2023-12-07T16:24:53.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.944+0000 7f39fd4c0700 1 -- 172.21.15.63:0/104553359 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f810f1a0 con 0x7f39f80fcd00 2023-12-07T16:24:53.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.945+0000 7f39fd4c0700 1 -- 172.21.15.63:0/104553359 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f804bb80 con 0x7f39f80fcd00 2023-12-07T16:24:53.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.946+0000 7f39ef7fe700 1 -- 172.21.15.63:0/104553359 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f39e000f850 con 0x7f39f80fcd00 2023-12-07T16:24:53.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.947+0000 7f39ef7fe700 1 --2- 172.21.15.63:0/104553359 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f39e406ce60 0x7f39e406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:53.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.947+0000 7f39ef7fe700 1 -- 172.21.15.63:0/104553359 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f39e008ce10 con 0x7f39f80fcd00 2023-12-07T16:24:53.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.947+0000 7f39f6ffd700 1 --2- 172.21.15.63:0/104553359 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f39e406ce60 0x7f39e406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:53.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.947+0000 7f39f6ffd700 1 --2- 172.21.15.63:0/104553359 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f39e406ce60 0x7f39e406f310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f39e8000c00 tx=0x7f39e8009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:53.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:53.951+0000 7f39ef7fe700 1 -- 172.21.15.63:0/104553359 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f39e005a740 con 0x7f39f80fcd00 2023-12-07T16:24:53.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:53 smithi152 ceph-mon[175645]: pgmap v94: 65 pgs: 3 activating, 10 peering, 10 active+undersized, 7 active+undersized+degraded, 35 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 27/360 objects degraded (7.500%) 2023-12-07T16:24:54.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:53 smithi063 ceph-mon[192008]: pgmap v94: 65 pgs: 3 activating, 10 peering, 10 active+undersized, 7 active+undersized+degraded, 35 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 27/360 objects degraded (7.500%) 2023-12-07T16:24:54.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.176+0000 7f39fd4c0700 1 -- 172.21.15.63:0/104553359 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f39f810f720 con 0x7f39e406ce60 2023-12-07T16:24:54.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.177+0000 7f39ef7fe700 1 -- 172.21.15.63:0/104553359 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f39f810f720 con 0x7f39e406ce60 2023-12-07T16:24:54.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.179+0000 7f39fd4c0700 1 -- 172.21.15.63:0/104553359 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f39e406ce60 msgr2=0x7f39e406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:54.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.179+0000 7f39fd4c0700 1 --2- 172.21.15.63:0/104553359 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f39e406ce60 0x7f39e406f310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f39e8000c00 tx=0x7f39e8009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:54.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.179+0000 7f39fd4c0700 1 -- 172.21.15.63:0/104553359 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39f80fcd00 msgr2=0x7f39f810dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:54.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.179+0000 7f39fd4c0700 1 --2- 172.21.15.63:0/104553359 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39f80fcd00 0x7f39f810dab0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f39e000b790 tx=0x7f39e0009250 comp rx=0 tx=0).stop 2023-12-07T16:24:54.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.179+0000 7f39fd4c0700 1 -- 172.21.15.63:0/104553359 shutdown_connections 2023-12-07T16:24:54.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.179+0000 7f39fd4c0700 1 --2- 172.21.15.63:0/104553359 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f39e406ce60 0x7f39e406f310 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:54.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.179+0000 7f39fd4c0700 1 --2- 172.21.15.63:0/104553359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39f80fbaf0 0x7f39f810d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:54.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.179+0000 7f39fd4c0700 1 --2- 172.21.15.63:0/104553359 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39f80fcd00 0x7f39f810dab0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:54.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.179+0000 7f39fd4c0700 1 -- 172.21.15.63:0/104553359 >> 172.21.15.63:0/104553359 conn(0x7f39f80f71d0 msgr2=0x7f39f8065c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:54.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.179+0000 7f39fd4c0700 1 -- 172.21.15.63:0/104553359 shutdown_connections 2023-12-07T16:24:54.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.179+0000 7f39fd4c0700 1 -- 172.21.15.63:0/104553359 wait complete. 2023-12-07T16:24:54.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.283+0000 7f9be8a23700 1 -- 172.21.15.63:0/657675438 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9be40fdf60 msgr2=0x7f9be40fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:54.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.283+0000 7f9be8a23700 1 --2- 172.21.15.63:0/657675438 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9be40fdf60 0x7f9be40fe3b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc004940 tx=0x7f9bcc009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:54.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.283+0000 7f9be8a23700 1 -- 172.21.15.63:0/657675438 shutdown_connections 2023-12-07T16:24:54.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.283+0000 7f9be8a23700 1 --2- 172.21.15.63:0/657675438 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9be40fdf60 0x7f9be40fe3b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:54.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.283+0000 7f9be8a23700 1 --2- 172.21.15.63:0/657675438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9be40faed0 0x7f9be40fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:54.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.283+0000 7f9be8a23700 1 -- 172.21.15.63:0/657675438 >> 172.21.15.63:0/657675438 conn(0x7f9be40f6950 msgr2=0x7f9be40f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:54.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.283+0000 7f9be8a23700 1 -- 172.21.15.63:0/657675438 shutdown_connections 2023-12-07T16:24:54.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.283+0000 7f9be8a23700 1 -- 172.21.15.63:0/657675438 wait complete. 2023-12-07T16:24:54.282 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.284+0000 7f9be8a23700 1 Processor -- start 2023-12-07T16:24:54.282 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.284+0000 7f9be8a23700 1 -- start start 2023-12-07T16:24:54.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.284+0000 7f9be8a23700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9be40faed0 0x7f9be410d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:54.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.284+0000 7f9be8a23700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9be40fdf60 0x7f9be410dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:54.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.284+0000 7f9be8a23700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be410e1b0 con 0x7f9be40faed0 2023-12-07T16:24:54.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.284+0000 7f9be8a23700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be410ea50 con 0x7f9be40fdf60 2023-12-07T16:24:54.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.284+0000 7f9be259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9be40faed0 0x7f9be410d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:54.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.284+0000 7f9be259c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9be40faed0 0x7f9be410d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58708/0 (socket says 172.21.15.63:58708) 2023-12-07T16:24:54.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.284+0000 7f9be259c700 1 -- 172.21.15.63:0/3165700731 learned_addr learned my addr 172.21.15.63:0/3165700731 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:24:54.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.284+0000 7f9be1d9b700 1 --2- 172.21.15.63:0/3165700731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9be40fdf60 0x7f9be410dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:54.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.284+0000 7f9be259c700 1 -- 172.21.15.63:0/3165700731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9be40fdf60 msgr2=0x7f9be410dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:54.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.284+0000 7f9be259c700 1 --2- 172.21.15.63:0/3165700731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9be40fdf60 0x7f9be410dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:54.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.285+0000 7f9be259c700 1 -- 172.21.15.63:0/3165700731 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bcc005040 con 0x7f9be40faed0 2023-12-07T16:24:54.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.285+0000 7f9be259c700 1 --2- 172.21.15.63:0/3165700731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9be40faed0 0x7f9be410d670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9bd400c8e0 tx=0x7f9bd40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:54.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.285+0000 7f9bdaffd700 1 -- 172.21.15.63:0/3165700731 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bd400a760 con 0x7f9be40faed0 2023-12-07T16:24:54.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.285+0000 7f9bdaffd700 1 -- 172.21.15.63:0/3165700731 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9bd400ad70 con 0x7f9be40faed0 2023-12-07T16:24:54.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.285+0000 7f9be8a23700 1 -- 172.21.15.63:0/3165700731 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be410ed30 con 0x7f9be40faed0 2023-12-07T16:24:54.284 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.285+0000 7f9bdaffd700 1 -- 172.21.15.63:0/3165700731 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bd40113a0 con 0x7f9be40faed0 2023-12-07T16:24:54.284 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.285+0000 7f9be8a23700 1 -- 172.21.15.63:0/3165700731 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be410f270 con 0x7f9be40faed0 2023-12-07T16:24:54.284 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.286+0000 7f9be8a23700 1 -- 172.21.15.63:0/3165700731 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be41075f0 con 0x7f9be40faed0 2023-12-07T16:24:54.284 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.286+0000 7f9bdaffd700 1 -- 172.21.15.63:0/3165700731 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f9bd4012400 con 0x7f9be40faed0 2023-12-07T16:24:54.284 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.287+0000 7f9bdaffd700 1 --2- 172.21.15.63:0/3165700731 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f9bd006ce60 0x7f9bd006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:54.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.287+0000 7f9bdaffd700 1 -- 172.21.15.63:0/3165700731 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f9bd408c2d0 con 0x7f9be40faed0 2023-12-07T16:24:54.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.287+0000 7f9be1d9b700 1 --2- 172.21.15.63:0/3165700731 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f9bd006ce60 0x7f9bd006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:54.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.287+0000 7f9be1d9b700 1 --2- 172.21.15.63:0/3165700731 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f9bd006ce60 0x7f9bd006f310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc004f90 tx=0x7f9bcc009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:54.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.291+0000 7f9bdaffd700 1 -- 172.21.15.63:0/3165700731 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9bd4059ac0 con 0x7f9be40faed0 2023-12-07T16:24:54.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.499+0000 7f9be8a23700 1 -- 172.21.15.63:0/3165700731 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9be410f4f0 con 0x7f9bd006ce60 2023-12-07T16:24:54.507 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.510+0000 7f9bdaffd700 1 -- 172.21.15.63:0/3165700731 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f9be410f4f0 con 0x7f9bd006ce60 2023-12-07T16:24:54.507 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-07T16:24:54.507 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (3m) 8s ago 9m 28.6M - 0.25.0 c8568f914cd2 c0526812d5fe 2023-12-07T16:24:54.507 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (89s) 8s ago 9m 7474k - 19.0.0-13-ge6605fb8 104f332cd0a9 52adf44ea983 2023-12-07T16:24:54.507 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi152 smithi152 running (85s) 83s ago 8m 7461k - 19.0.0-13-ge6605fb8 104f332cd0a9 9eba5b538b96 2023-12-07T16:24:54.507 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (3m) 8s ago 9m 91.4M - 9.4.7 954c08fa6188 cc2cde9a664f 2023-12-07T16:24:54.507 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.gsjgcq smithi063 running (5m) 8s ago 5m 15.2M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 f70e4f098e4c 2023-12-07T16:24:54.508 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.yidolg smithi063 running (5m) 8s ago 5m 5932M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5b053ef5fb7f 2023-12-07T16:24:54.508 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.aovwwd smithi152 running (5m) 83s ago 5m 15.6M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 80190948a595 2023-12-07T16:24:54.508 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.mrvngf smithi152 running (5m) 83s ago 5m 5114M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5f60b893f840 2023-12-07T16:24:54.508 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.yohyyx smithi063 *:8443,9283,8765 running (3m) 8s ago 10m 511M - 19.0.0-13-ge6605fb8 104f332cd0a9 b605f882784d 2023-12-07T16:24:54.508 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi152.sxayfb smithi152 *:8443,9283,8765 running (2m) 83s ago 8m 450M - 19.0.0-13-ge6605fb8 104f332cd0a9 71716998ccc3 2023-12-07T16:24:54.508 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (2m) 8s ago 10m 67.3M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 8d7d0c6bfea3 2023-12-07T16:24:54.508 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi152 smithi152 running (118s) 83s ago 8m 39.3M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 883bb3425cf0 2023-12-07T16:24:54.508 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (3m) 8s ago 9m 18.9M - 1.5.0 0da6a335fe13 50d63981f746 2023-12-07T16:24:54.508 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi152 smithi152 *:9100 running (3m) 83s ago 8m 19.4M - 1.5.0 0da6a335fe13 627cda14f1a9 2023-12-07T16:24:54.508 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (70s) 8s ago 8m 189M 1568M 19.0.0-13-ge6605fb8 104f332cd0a9 5fab981f1333 2023-12-07T16:24:54.508 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (40s) 8s ago 7m 121M 1568M 19.0.0-13-ge6605fb8 104f332cd0a9 b78531e6dc96 2023-12-07T16:24:54.508 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (11s) 8s ago 7m 11.5M 1568M 19.0.0-13-ge6605fb8 104f332cd0a9 a473024763f8 2023-12-07T16:24:54.508 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi152 running (7m) 83s ago 7m 987M 2592M 17.2.7-115-g4f62d9ad fcdfd00f81c7 94d14402b489 2023-12-07T16:24:54.508 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi152 running (6m) 83s ago 6m 764M 2592M 17.2.7-115-g4f62d9ad fcdfd00f81c7 d3b8b2f12489 2023-12-07T16:24:54.508 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi152 running (6m) 83s ago 6m 856M 2592M 17.2.7-115-g4f62d9ad fcdfd00f81c7 e7f8d9f716bb 2023-12-07T16:24:54.508 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (2m) 8s ago 9m 51.1M - 2.43.0 a07b618ecd1d 8a323520d9fd 2023-12-07T16:24:54.509 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.512+0000 7f9be8a23700 1 -- 172.21.15.63:0/3165700731 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f9bd006ce60 msgr2=0x7f9bd006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:54.509 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.512+0000 7f9be8a23700 1 --2- 172.21.15.63:0/3165700731 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f9bd006ce60 0x7f9bd006f310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc004f90 tx=0x7f9bcc009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:54.509 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.512+0000 7f9be8a23700 1 -- 172.21.15.63:0/3165700731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9be40faed0 msgr2=0x7f9be410d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:54.509 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.512+0000 7f9be8a23700 1 --2- 172.21.15.63:0/3165700731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9be40faed0 0x7f9be410d670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9bd400c8e0 tx=0x7f9bd40044c0 comp rx=0 tx=0).stop 2023-12-07T16:24:54.509 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.512+0000 7f9be8a23700 1 -- 172.21.15.63:0/3165700731 shutdown_connections 2023-12-07T16:24:54.509 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.512+0000 7f9be8a23700 1 --2- 172.21.15.63:0/3165700731 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f9bd006ce60 0x7f9bd006f310 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:54.510 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.512+0000 7f9be8a23700 1 --2- 172.21.15.63:0/3165700731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9be40faed0 0x7f9be410d670 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:54.510 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.512+0000 7f9be8a23700 1 --2- 172.21.15.63:0/3165700731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9be40fdf60 0x7f9be410dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:54.510 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.512+0000 7f9be8a23700 1 -- 172.21.15.63:0/3165700731 >> 172.21.15.63:0/3165700731 conn(0x7f9be40f6950 msgr2=0x7f9be40f8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:54.510 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.512+0000 7f9be8a23700 1 -- 172.21.15.63:0/3165700731 shutdown_connections 2023-12-07T16:24:54.510 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.512+0000 7f9be8a23700 1 -- 172.21.15.63:0/3165700731 wait complete. 2023-12-07T16:24:54.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.614+0000 7f506d3b4700 1 -- 172.21.15.63:0/176840383 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50680fe270 msgr2=0x7f50680fe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:54.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.614+0000 7f506d3b4700 1 --2- 172.21.15.63:0/176840383 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50680fe270 0x7f50680fe680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5058004940 tx=0x7f5058009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:54.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.614+0000 7f506d3b4700 1 -- 172.21.15.63:0/176840383 shutdown_connections 2023-12-07T16:24:54.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.614+0000 7f506d3b4700 1 --2- 172.21.15.63:0/176840383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50680fec50 0x7f50680fad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:54.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.614+0000 7f506d3b4700 1 --2- 172.21.15.63:0/176840383 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50680fe270 0x7f50680fe680 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:54.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.614+0000 7f506d3b4700 1 -- 172.21.15.63:0/176840383 >> 172.21.15.63:0/176840383 conn(0x7f50680f6950 msgr2=0x7f50680f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:54.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.614+0000 7f506d3b4700 1 -- 172.21.15.63:0/176840383 shutdown_connections 2023-12-07T16:24:54.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.614+0000 7f506d3b4700 1 -- 172.21.15.63:0/176840383 wait complete. 2023-12-07T16:24:54.613 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.615+0000 7f506d3b4700 1 Processor -- start 2023-12-07T16:24:54.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.615+0000 7f506d3b4700 1 -- start start 2023-12-07T16:24:54.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.615+0000 7f506d3b4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50680fe270 0x7f506810d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:54.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.615+0000 7f506d3b4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f506810db50 0x7f506810e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:54.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.615+0000 7f506d3b4700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506810e010 con 0x7f50680fe270 2023-12-07T16:24:54.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.615+0000 7f506d3b4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506810e150 con 0x7f506810db50 2023-12-07T16:24:54.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.615+0000 7f5066ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50680fe270 0x7f506810d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:54.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.615+0000 7f5066ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50680fe270 0x7f506810d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58714/0 (socket says 172.21.15.63:58714) 2023-12-07T16:24:54.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.615+0000 7f5066ffd700 1 -- 172.21.15.63:0/3808261992 learned_addr learned my addr 172.21.15.63:0/3808261992 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:24:54.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.616+0000 7f50667fc700 1 --2- 172.21.15.63:0/3808261992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f506810db50 0x7f506810e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:54.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.616+0000 7f5066ffd700 1 -- 172.21.15.63:0/3808261992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f506810db50 msgr2=0x7f506810e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:54.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.616+0000 7f5066ffd700 1 --2- 172.21.15.63:0/3808261992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f506810db50 0x7f506810e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:54.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.616+0000 7f5066ffd700 1 -- 172.21.15.63:0/3808261992 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5058005040 con 0x7f50680fe270 2023-12-07T16:24:54.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.616+0000 7f5066ffd700 1 --2- 172.21.15.63:0/3808261992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50680fe270 0x7f506810d610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5058009fd0 tx=0x7f5058009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:54.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.616+0000 7f504f7fe700 1 -- 172.21.15.63:0/3808261992 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f505800e040 con 0x7f50680fe270 2023-12-07T16:24:54.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.616+0000 7f506d3b4700 1 -- 172.21.15.63:0/3808261992 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506810eff0 con 0x7f50680fe270 2023-12-07T16:24:54.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.616+0000 7f504f7fe700 1 -- 172.21.15.63:0/3808261992 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f505800bc50 con 0x7f50680fe270 2023-12-07T16:24:54.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.616+0000 7f504f7fe700 1 -- 172.21.15.63:0/3808261992 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f505801c630 con 0x7f50680fe270 2023-12-07T16:24:54.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.616+0000 7f506d3b4700 1 -- 172.21.15.63:0/3808261992 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506810f500 con 0x7f50680fe270 2023-12-07T16:24:54.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.617+0000 7f506d3b4700 1 -- 172.21.15.63:0/3808261992 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5068107620 con 0x7f50680fe270 2023-12-07T16:24:54.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.618+0000 7f504f7fe700 1 -- 172.21.15.63:0/3808261992 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f5058013420 con 0x7f50680fe270 2023-12-07T16:24:54.616 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.618+0000 7f504f7fe700 1 --2- 172.21.15.63:0/3808261992 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f505006ce60 0x7f505006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:54.616 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.618+0000 7f50667fc700 1 --2- 172.21.15.63:0/3808261992 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f505006ce60 0x7f505006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:54.616 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.618+0000 7f504f7fe700 1 -- 172.21.15.63:0/3808261992 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f505808d7d0 con 0x7f50680fe270 2023-12-07T16:24:54.616 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.619+0000 7f50667fc700 1 --2- 172.21.15.63:0/3808261992 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f505006ce60 0x7f505006f310 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f505c007fd0 tx=0x7f505c009040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:54.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.623+0000 7f504f7fe700 1 -- 172.21.15.63:0/3808261992 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f505805b060 con 0x7f50680fe270 2023-12-07T16:24:54.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.906+0000 7f506d3b4700 1 -- 172.21.15.63:0/3808261992 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f50681056e0 con 0x7f50680fe270 2023-12-07T16:24:54.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.907+0000 7f504f7fe700 1 -- 172.21.15.63:0/3808261992 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f505805abf0 con 0x7f50680fe270 2023-12-07T16:24:54.904 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:24:54.904 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-07T16:24:54.904 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-07T16:24:54.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:24:54.904 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-07T16:24:54.904 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-07T16:24:54.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:24:54.904 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-07T16:24:54.904 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 3, 2023-12-07T16:24:54.904 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 3 2023-12-07T16:24:54.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:24:54.905 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-07T16:24:54.905 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 4 2023-12-07T16:24:54.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:24:54.905 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-07T16:24:54.905 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 7, 2023-12-07T16:24:54.905 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 7 2023-12-07T16:24:54.905 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-07T16:24:54.905 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:24:54.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.909+0000 7f506d3b4700 1 -- 172.21.15.63:0/3808261992 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f505006ce60 msgr2=0x7f505006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:54.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.909+0000 7f506d3b4700 1 --2- 172.21.15.63:0/3808261992 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f505006ce60 0x7f505006f310 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f505c007fd0 tx=0x7f505c009040 comp rx=0 tx=0).stop 2023-12-07T16:24:54.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.909+0000 7f506d3b4700 1 -- 172.21.15.63:0/3808261992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50680fe270 msgr2=0x7f506810d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:54.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.909+0000 7f506d3b4700 1 --2- 172.21.15.63:0/3808261992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50680fe270 0x7f506810d610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5058009fd0 tx=0x7f5058009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:54.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.909+0000 7f506d3b4700 1 -- 172.21.15.63:0/3808261992 shutdown_connections 2023-12-07T16:24:54.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.909+0000 7f506d3b4700 1 --2- 172.21.15.63:0/3808261992 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f505006ce60 0x7f505006f310 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:54.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.909+0000 7f506d3b4700 1 --2- 172.21.15.63:0/3808261992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50680fe270 0x7f506810d610 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:54.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.909+0000 7f506d3b4700 1 --2- 172.21.15.63:0/3808261992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f506810db50 0x7f506810e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:54.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.909+0000 7f506d3b4700 1 -- 172.21.15.63:0/3808261992 >> 172.21.15.63:0/3808261992 conn(0x7f50680f6950 msgr2=0x7f50680f8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:54.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.909+0000 7f506d3b4700 1 -- 172.21.15.63:0/3808261992 shutdown_connections 2023-12-07T16:24:54.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:54.909+0000 7f506d3b4700 1 -- 172.21.15.63:0/3808261992 wait complete. 2023-12-07T16:24:55.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.012+0000 7f4e3f72d700 1 -- 172.21.15.63:0/88902564 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e380fcd00 msgr2=0x7f4e380fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:55.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.012+0000 7f4e3f72d700 1 --2- 172.21.15.63:0/88902564 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e380fcd00 0x7f4e380fd150 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4e28004940 tx=0x7f4e28009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:55.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.012+0000 7f4e3f72d700 1 -- 172.21.15.63:0/88902564 shutdown_connections 2023-12-07T16:24:55.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.012+0000 7f4e3f72d700 1 --2- 172.21.15.63:0/88902564 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e380fcd00 0x7f4e380fd150 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:55.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.012+0000 7f4e3f72d700 1 --2- 172.21.15.63:0/88902564 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e380fbaf0 0x7f4e380fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:55.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.012+0000 7f4e3f72d700 1 -- 172.21.15.63:0/88902564 >> 172.21.15.63:0/88902564 conn(0x7f4e380f7190 msgr2=0x7f4e380f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:55.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.012+0000 7f4e3f72d700 1 -- 172.21.15.63:0/88902564 shutdown_connections 2023-12-07T16:24:55.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.012+0000 7f4e3f72d700 1 -- 172.21.15.63:0/88902564 wait complete. 2023-12-07T16:24:55.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.013+0000 7f4e3f72d700 1 Processor -- start 2023-12-07T16:24:55.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.013+0000 7f4e3f72d700 1 -- start start 2023-12-07T16:24:55.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.013+0000 7f4e3f72d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e380fbaf0 0x7f4e3810c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:55.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.013+0000 7f4e3f72d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e380fcd00 0x7f4e3810c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:55.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.013+0000 7f4e3f72d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3810cfb0 con 0x7f4e380fcd00 2023-12-07T16:24:55.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.013+0000 7f4e3f72d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3810d850 con 0x7f4e380fbaf0 2023-12-07T16:24:55.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.013+0000 7f4e3ccc8700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e380fcd00 0x7f4e3810c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:55.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.013+0000 7f4e3ccc8700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e380fcd00 0x7f4e3810c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58730/0 (socket says 172.21.15.63:58730) 2023-12-07T16:24:55.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.013+0000 7f4e3ccc8700 1 -- 172.21.15.63:0/3773778131 learned_addr learned my addr 172.21.15.63:0/3773778131 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:24:55.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.013+0000 7f4e3d4c9700 1 --2- 172.21.15.63:0/3773778131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e380fbaf0 0x7f4e3810c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:55.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.013+0000 7f4e3ccc8700 1 -- 172.21.15.63:0/3773778131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e380fbaf0 msgr2=0x7f4e3810c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:55.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.013+0000 7f4e3ccc8700 1 --2- 172.21.15.63:0/3773778131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e380fbaf0 0x7f4e3810c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:55.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.013+0000 7f4e3ccc8700 1 -- 172.21.15.63:0/3773778131 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e28005040 con 0x7f4e380fcd00 2023-12-07T16:24:55.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.013+0000 7f4e3ccc8700 1 --2- 172.21.15.63:0/3773778131 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e380fcd00 0x7f4e3810c9b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4e28009fd0 tx=0x7f4e28009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:55.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.014+0000 7f4e2dffb700 1 -- 172.21.15.63:0/3773778131 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e2800e040 con 0x7f4e380fcd00 2023-12-07T16:24:55.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.014+0000 7f4e3f72d700 1 -- 172.21.15.63:0/3773778131 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3810dad0 con 0x7f4e380fcd00 2023-12-07T16:24:55.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.014+0000 7f4e2dffb700 1 -- 172.21.15.63:0/3773778131 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4e2801e8d0 con 0x7f4e380fcd00 2023-12-07T16:24:55.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.014+0000 7f4e2dffb700 1 -- 172.21.15.63:0/3773778131 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e28013730 con 0x7f4e380fcd00 2023-12-07T16:24:55.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.014+0000 7f4e3f72d700 1 -- 172.21.15.63:0/3773778131 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3810dfb0 con 0x7f4e380fcd00 2023-12-07T16:24:55.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.015+0000 7f4e3f72d700 1 -- 172.21.15.63:0/3773778131 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3804bb80 con 0x7f4e380fcd00 2023-12-07T16:24:55.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.015+0000 7f4e2dffb700 1 -- 172.21.15.63:0/3773778131 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f4e2801ea40 con 0x7f4e380fcd00 2023-12-07T16:24:55.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.016+0000 7f4e2dffb700 1 --2- 172.21.15.63:0/3773778131 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f4e2406ce70 0x7f4e2406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:55.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.016+0000 7f4e2dffb700 1 -- 172.21.15.63:0/3773778131 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f4e28090470 con 0x7f4e380fcd00 2023-12-07T16:24:55.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.016+0000 7f4e3d4c9700 1 --2- 172.21.15.63:0/3773778131 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f4e2406ce70 0x7f4e2406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:55.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.016+0000 7f4e3d4c9700 1 --2- 172.21.15.63:0/3773778131 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f4e2406ce70 0x7f4e2406f320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4e34007fd0 tx=0x7f4e34009040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:55.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.020+0000 7f4e2dffb700 1 -- 172.21.15.63:0/3773778131 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4e2805dc80 con 0x7f4e380fcd00 2023-12-07T16:24:55.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.264+0000 7f4e3f72d700 1 -- 172.21.15.63:0/3773778131 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4e3810e350 con 0x7f4e380fcd00 2023-12-07T16:24:55.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.264+0000 7f4e2dffb700 1 -- 172.21.15.63:0/3773778131 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1891 (secure 0 0 0) 0x7f4e2805d810 con 0x7f4e380fcd00 2023-12-07T16:24:55.261 INFO:teuthology.orchestra.run.smithi063.stdout:e17 2023-12-07T16:24:55.261 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-07T16:24:55.262 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:24:55.262 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-07T16:24:55.262 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:24:55.262 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-07T16:24:55.262 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-07T16:24:55.262 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 17 2023-12-07T16:24:55.262 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-07T16:24:55.262 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-07T16:19:08.352640+0000 2023-12-07T16:24:55.262 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-07T16:22:27.604525+0000 2023-12-07T16:24:55.262 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-07T16:24:55.262 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-07T16:24:55.262 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-07T16:24:55.262 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-07T16:24:55.262 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-07T16:24:55.262 INFO:teuthology.orchestra.run.smithi063.stdout:max_xattr_size 65536 2023-12-07T16:24:55.262 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-07T16:24:55.263 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-07T16:24:55.263 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 45 2023-12-07T16:24:55.263 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:24:55.263 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 2 2023-12-07T16:24:55.263 INFO:teuthology.orchestra.run.smithi063.stdout:in 0,1 2023-12-07T16:24:55.263 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14478,1=24269} 2023-12-07T16:24:55.263 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-07T16:24:55.263 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-07T16:24:55.263 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-07T16:24:55.263 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-07T16:24:55.263 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-07T16:24:55.263 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-07T16:24:55.263 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-07T16:24:55.263 INFO:teuthology.orchestra.run.smithi063.stdout:bal_rank_mask -1 2023-12-07T16:24:55.263 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-07T16:24:55.263 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.yidolg{0:14478} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:24:55.264 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.mrvngf{1:24269} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.152:6824/3157779064,v1:172.21.15.152:6825/3157779064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:24:55.264 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:24:55.264 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:24:55.264 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-07T16:24:55.264 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:24:55.264 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.gsjgcq{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/3063200414,v1:172.21.15.63:6827/3063200414] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:24:55.264 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.aovwwd{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/2906349729,v1:172.21.15.152:6827/2906349729] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:24:55.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.266+0000 7f4e3f72d700 1 -- 172.21.15.63:0/3773778131 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f4e2406ce70 msgr2=0x7f4e2406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:55.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.266+0000 7f4e3f72d700 1 --2- 172.21.15.63:0/3773778131 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f4e2406ce70 0x7f4e2406f320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4e34007fd0 tx=0x7f4e34009040 comp rx=0 tx=0).stop 2023-12-07T16:24:55.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.266+0000 7f4e3f72d700 1 -- 172.21.15.63:0/3773778131 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e380fcd00 msgr2=0x7f4e3810c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:55.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.266+0000 7f4e3f72d700 1 --2- 172.21.15.63:0/3773778131 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e380fcd00 0x7f4e3810c9b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4e28009fd0 tx=0x7f4e28009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:55.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.266+0000 7f4e3f72d700 1 -- 172.21.15.63:0/3773778131 shutdown_connections 2023-12-07T16:24:55.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.266+0000 7f4e3f72d700 1 --2- 172.21.15.63:0/3773778131 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f4e2406ce70 0x7f4e2406f320 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:55.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.266+0000 7f4e3f72d700 1 --2- 172.21.15.63:0/3773778131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e380fbaf0 0x7f4e3810c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:55.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.266+0000 7f4e3f72d700 1 --2- 172.21.15.63:0/3773778131 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e380fcd00 0x7f4e3810c9b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:55.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.266+0000 7f4e3f72d700 1 -- 172.21.15.63:0/3773778131 >> 172.21.15.63:0/3773778131 conn(0x7f4e380f7190 msgr2=0x7f4e380fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:55.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.266+0000 7f4e3f72d700 1 -- 172.21.15.63:0/3773778131 shutdown_connections 2023-12-07T16:24:55.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.266+0000 7f4e3f72d700 1 -- 172.21.15.63:0/3773778131 wait complete. 2023-12-07T16:24:55.265 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2023-12-07T16:24:55.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.371+0000 7fe6c3890700 1 -- 172.21.15.63:0/4172066711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6bc0fd730 msgr2=0x7fe6bc0ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:55.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.371+0000 7fe6c3890700 1 --2- 172.21.15.63:0/4172066711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6bc0fd730 0x7fe6bc0ffb10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8004940 tx=0x7fe6b8009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:55.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.371+0000 7fe6c3890700 1 -- 172.21.15.63:0/4172066711 shutdown_connections 2023-12-07T16:24:55.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.371+0000 7fe6c3890700 1 --2- 172.21.15.63:0/4172066711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6bc100050 0x7fe6bc102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:55.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.371+0000 7fe6c3890700 1 --2- 172.21.15.63:0/4172066711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6bc0fd730 0x7fe6bc0ffb10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:55.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.371+0000 7fe6c3890700 1 -- 172.21.15.63:0/4172066711 >> 172.21.15.63:0/4172066711 conn(0x7fe6bc0f7190 msgr2=0x7fe6bc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:55.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.371+0000 7fe6c3890700 1 -- 172.21.15.63:0/4172066711 shutdown_connections 2023-12-07T16:24:55.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.371+0000 7fe6c3890700 1 -- 172.21.15.63:0/4172066711 wait complete. 2023-12-07T16:24:55.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.371+0000 7fe6c3890700 1 Processor -- start 2023-12-07T16:24:55.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.372+0000 7fe6c3890700 1 -- start start 2023-12-07T16:24:55.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.372+0000 7fe6c3890700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6bc0fd730 0x7fe6bc10d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:55.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.372+0000 7fe6c3890700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6bc100050 0x7fe6bc10d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:55.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.372+0000 7fe6c3890700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc10dfd0 con 0x7fe6bc100050 2023-12-07T16:24:55.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.372+0000 7fe6c3890700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc10e870 con 0x7fe6bc0fd730 2023-12-07T16:24:55.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.372+0000 7fe6c0e2b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6bc100050 0x7fe6bc10d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:55.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.372+0000 7fe6c0e2b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6bc100050 0x7fe6bc10d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58738/0 (socket says 172.21.15.63:58738) 2023-12-07T16:24:55.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.372+0000 7fe6c0e2b700 1 -- 172.21.15.63:0/680889135 learned_addr learned my addr 172.21.15.63:0/680889135 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:24:55.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.372+0000 7fe6c162c700 1 --2- 172.21.15.63:0/680889135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6bc0fd730 0x7fe6bc10d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:55.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.372+0000 7fe6c0e2b700 1 -- 172.21.15.63:0/680889135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6bc0fd730 msgr2=0x7fe6bc10d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:55.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.372+0000 7fe6c0e2b700 1 --2- 172.21.15.63:0/680889135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6bc0fd730 0x7fe6bc10d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:55.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.372+0000 7fe6c0e2b700 1 -- 172.21.15.63:0/680889135 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b8005040 con 0x7fe6bc100050 2023-12-07T16:24:55.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.372+0000 7fe6c0e2b700 1 --2- 172.21.15.63:0/680889135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6bc100050 0x7fe6bc10d9d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac002a80 tx=0x7fe6ac0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:55.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.373+0000 7fe6b1ffb700 1 -- 172.21.15.63:0/680889135 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6ac007cc0 con 0x7fe6bc100050 2023-12-07T16:24:55.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.373+0000 7fe6b1ffb700 1 -- 172.21.15.63:0/680889135 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe6ac00f040 con 0x7fe6bc100050 2023-12-07T16:24:55.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.373+0000 7fe6c3890700 1 -- 172.21.15.63:0/680889135 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6bc10eb50 con 0x7fe6bc100050 2023-12-07T16:24:55.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.373+0000 7fe6b1ffb700 1 -- 172.21.15.63:0/680889135 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6ac00da60 con 0x7fe6bc100050 2023-12-07T16:24:55.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.373+0000 7fe6c3890700 1 -- 172.21.15.63:0/680889135 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6bc10f090 con 0x7fe6bc100050 2023-12-07T16:24:55.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.374+0000 7fe6c3890700 1 -- 172.21.15.63:0/680889135 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6bc04bb80 con 0x7fe6bc100050 2023-12-07T16:24:55.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.374+0000 7fe6b1ffb700 1 -- 172.21.15.63:0/680889135 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fe6ac00dbc0 con 0x7fe6bc100050 2023-12-07T16:24:55.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.375+0000 7fe6b1ffb700 1 --2- 172.21.15.63:0/680889135 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fe6a806ce60 0x7fe6a806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:55.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.375+0000 7fe6b1ffb700 1 -- 172.21.15.63:0/680889135 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6761+0+0 (secure 0 0 0) 0x7fe6ac08c090 con 0x7fe6bc100050 2023-12-07T16:24:55.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.375+0000 7fe6c162c700 1 --2- 172.21.15.63:0/680889135 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fe6a806ce60 0x7fe6a806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:55.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.375+0000 7fe6c162c700 1 --2- 172.21.15.63:0/680889135 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fe6a806ce60 0x7fe6a806f310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8004890 tx=0x7fe6b8009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:55.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.379+0000 7fe6b1ffb700 1 -- 172.21.15.63:0/680889135 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe6ac0598a0 con 0x7fe6bc100050 2023-12-07T16:24:55.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:55 smithi063 ceph-mon[192008]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:24:55.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:55 smithi063 ceph-mon[192008]: pgmap v95: 65 pgs: 3 activating, 10 peering, 4 active+undersized, 2 active+undersized+degraded, 46 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 9/360 objects degraded (2.500%) 2023-12-07T16:24:55.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:55 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:55.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:55 smithi063 ceph-mon[192008]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:24:55.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:55 smithi063 ceph-mon[192008]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:24:55.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:55 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/3808261992' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:24:55.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:55 smithi152 ceph-mon[175645]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:24:55.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:55 smithi152 ceph-mon[175645]: pgmap v95: 65 pgs: 3 activating, 10 peering, 4 active+undersized, 2 active+undersized+degraded, 46 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 9/360 objects degraded (2.500%) 2023-12-07T16:24:55.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:55 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:55.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:55 smithi152 ceph-mon[175645]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:24:55.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:55 smithi152 ceph-mon[175645]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:24:55.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:55 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/3808261992' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:24:55.593 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.596+0000 7fe6c3890700 1 -- 172.21.15.63:0/680889135 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6bc10f4e0 con 0x7fe6a806ce60 2023-12-07T16:24:55.595 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.598+0000 7fe6b1ffb700 1 -- 172.21.15.63:0/680889135 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe6bc10f4e0 con 0x7fe6a806ce60 2023-12-07T16:24:55.595 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:24:55.595 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-07T16:24:55.595 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-07T16:24:55.595 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-07T16:24:55.595 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [ 2023-12-07T16:24:55.595 INFO:teuthology.orchestra.run.smithi063.stdout: "crash", 2023-12-07T16:24:55.595 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr", 2023-12-07T16:24:55.595 INFO:teuthology.orchestra.run.smithi063.stdout: "mon" 2023-12-07T16:24:55.595 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2023-12-07T16:24:55.595 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "9/21 daemons upgraded", 2023-12-07T16:24:55.595 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "Currently upgrading osd daemons", 2023-12-07T16:24:55.596 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-07T16:24:55.596 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:24:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.600+0000 7fe6c3890700 1 -- 172.21.15.63:0/680889135 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fe6a806ce60 msgr2=0x7fe6a806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.600+0000 7fe6c3890700 1 --2- 172.21.15.63:0/680889135 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fe6a806ce60 0x7fe6a806f310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8004890 tx=0x7fe6b8009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.600+0000 7fe6c3890700 1 -- 172.21.15.63:0/680889135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6bc100050 msgr2=0x7fe6bc10d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.600+0000 7fe6c3890700 1 --2- 172.21.15.63:0/680889135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6bc100050 0x7fe6bc10d9d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac002a80 tx=0x7fe6ac0046b0 comp rx=0 tx=0).stop 2023-12-07T16:24:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.600+0000 7fe6c3890700 1 -- 172.21.15.63:0/680889135 shutdown_connections 2023-12-07T16:24:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.600+0000 7fe6c3890700 1 --2- 172.21.15.63:0/680889135 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fe6a806ce60 0x7fe6a806f310 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.600+0000 7fe6c3890700 1 --2- 172.21.15.63:0/680889135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6bc0fd730 0x7fe6bc10d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.600+0000 7fe6c3890700 1 --2- 172.21.15.63:0/680889135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6bc100050 0x7fe6bc10d9d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.600+0000 7fe6c3890700 1 -- 172.21.15.63:0/680889135 >> 172.21.15.63:0/680889135 conn(0x7fe6bc0f7190 msgr2=0x7fe6bc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.600+0000 7fe6c3890700 1 -- 172.21.15.63:0/680889135 shutdown_connections 2023-12-07T16:24:55.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.600+0000 7fe6c3890700 1 -- 172.21.15.63:0/680889135 wait complete. 2023-12-07T16:24:55.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.703+0000 7fc3f3f83700 1 -- 172.21.15.63:0/1157616428 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ec0faed0 msgr2=0x7fc3ec0fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:55.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.703+0000 7fc3f3f83700 1 --2- 172.21.15.63:0/1157616428 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ec0faed0 0x7fc3ec0fb2e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8004940 tx=0x7fc3e8009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:55.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.703+0000 7fc3f3f83700 1 -- 172.21.15.63:0/1157616428 shutdown_connections 2023-12-07T16:24:55.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.703+0000 7fc3f3f83700 1 --2- 172.21.15.63:0/1157616428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3ec0fdf60 0x7fc3ec0fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:55.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.703+0000 7fc3f3f83700 1 --2- 172.21.15.63:0/1157616428 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ec0faed0 0x7fc3ec0fb2e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:55.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.703+0000 7fc3f3f83700 1 -- 172.21.15.63:0/1157616428 >> 172.21.15.63:0/1157616428 conn(0x7fc3ec0f6950 msgr2=0x7fc3ec0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:55.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.704+0000 7fc3f3f83700 1 -- 172.21.15.63:0/1157616428 shutdown_connections 2023-12-07T16:24:55.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.704+0000 7fc3f3f83700 1 -- 172.21.15.63:0/1157616428 wait complete. 2023-12-07T16:24:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.704+0000 7fc3f3f83700 1 Processor -- start 2023-12-07T16:24:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.704+0000 7fc3f3f83700 1 -- start start 2023-12-07T16:24:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.704+0000 7fc3f3f83700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ec0faed0 0x7fc3ec0fd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.704+0000 7fc3f3f83700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3ec0fdf60 0x7fc3ec0fbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.704+0000 7fc3f3f83700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec0fc470 con 0x7fc3ec0faed0 2023-12-07T16:24:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.704+0000 7fc3f3f83700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec0fc5e0 con 0x7fc3ec0fdf60 2023-12-07T16:24:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.704+0000 7fc3f1d1f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ec0faed0 0x7fc3ec0fd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.704+0000 7fc3f1d1f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ec0faed0 0x7fc3ec0fd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58768/0 (socket says 172.21.15.63:58768) 2023-12-07T16:24:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.704+0000 7fc3f1d1f700 1 -- 172.21.15.63:0/3175546302 learned_addr learned my addr 172.21.15.63:0/3175546302 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:24:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.705+0000 7fc3f151e700 1 --2- 172.21.15.63:0/3175546302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3ec0fdf60 0x7fc3ec0fbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.705+0000 7fc3f1d1f700 1 -- 172.21.15.63:0/3175546302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3ec0fdf60 msgr2=0x7fc3ec0fbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.705+0000 7fc3f1d1f700 1 --2- 172.21.15.63:0/3175546302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3ec0fdf60 0x7fc3ec0fbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.705+0000 7fc3f1d1f700 1 -- 172.21.15.63:0/3175546302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e8005040 con 0x7fc3ec0faed0 2023-12-07T16:24:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.705+0000 7fc3f1d1f700 1 --2- 172.21.15.63:0/3175546302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ec0faed0 0x7fc3ec0fd9f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc3e800b7d0 tx=0x7fc3e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:55.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.705+0000 7fc3e27fc700 1 -- 172.21.15.63:0/3175546302 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3e800e040 con 0x7fc3ec0faed0 2023-12-07T16:24:55.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.705+0000 7fc3e27fc700 1 -- 172.21.15.63:0/3175546302 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc3e800bc50 con 0x7fc3ec0faed0 2023-12-07T16:24:55.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.705+0000 7fc3f3f83700 1 -- 172.21.15.63:0/3175546302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3ec0fc860 con 0x7fc3ec0faed0 2023-12-07T16:24:55.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.705+0000 7fc3e27fc700 1 -- 172.21.15.63:0/3175546302 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3e801c630 con 0x7fc3ec0faed0 2023-12-07T16:24:55.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.705+0000 7fc3f3f83700 1 -- 172.21.15.63:0/3175546302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ec115570 con 0x7fc3ec0faed0 2023-12-07T16:24:55.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.706+0000 7fc3f3f83700 1 -- 172.21.15.63:0/3175546302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3ec04bb80 con 0x7fc3ec0faed0 2023-12-07T16:24:55.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.707+0000 7fc3e27fc700 1 -- 172.21.15.63:0/3175546302 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fc3e8013420 con 0x7fc3ec0faed0 2023-12-07T16:24:55.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.707+0000 7fc3e27fc700 1 --2- 172.21.15.63:0/3175546302 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fc3d806ce60 0x7fc3d806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:24:55.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.707+0000 7fc3e27fc700 1 -- 172.21.15.63:0/3175546302 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6761+0+0 (secure 0 0 0) 0x7fc3e808d770 con 0x7fc3ec0faed0 2023-12-07T16:24:55.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.707+0000 7fc3f151e700 1 --2- 172.21.15.63:0/3175546302 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fc3d806ce60 0x7fc3d806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:24:55.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.708+0000 7fc3f151e700 1 --2- 172.21.15.63:0/3175546302 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fc3d806ce60 0x7fc3d806f310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc009fd0 tx=0x7fc3dc009f60 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:24:55.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.712+0000 7fc3e27fc700 1 -- 172.21.15.63:0/3175546302 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc3e805b0a0 con 0x7fc3ec0faed0 2023-12-07T16:24:55.993 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.996+0000 7fc3f3f83700 1 -- 172.21.15.63:0/3175546302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc3ec1055b0 con 0x7fc3ec0faed0 2023-12-07T16:24:55.993 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.996+0000 7fc3e27fc700 1 -- 172.21.15.63:0/3175546302 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+481 (secure 0 0 0) 0x7fc3e805ac30 con 0x7fc3ec0faed0 2023-12-07T16:24:55.994 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 9/360 objects degraded (2.500%), 2 pgs degraded 2023-12-07T16:24:55.994 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-07T16:24:55.994 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-07T16:24:55.994 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 9/360 objects degraded (2.500%), 2 pgs degraded 2023-12-07T16:24:55.994 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2023-12-07T16:24:55.994 INFO:teuthology.orchestra.run.smithi063.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2023-12-07T16:24:55.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.998+0000 7fc3f3f83700 1 -- 172.21.15.63:0/3175546302 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fc3d806ce60 msgr2=0x7fc3d806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:55.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.998+0000 7fc3f3f83700 1 --2- 172.21.15.63:0/3175546302 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fc3d806ce60 0x7fc3d806f310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc009fd0 tx=0x7fc3dc009f60 comp rx=0 tx=0).stop 2023-12-07T16:24:55.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.998+0000 7fc3f3f83700 1 -- 172.21.15.63:0/3175546302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ec0faed0 msgr2=0x7fc3ec0fd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:24:55.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.998+0000 7fc3f3f83700 1 --2- 172.21.15.63:0/3175546302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ec0faed0 0x7fc3ec0fd9f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc3e800b7d0 tx=0x7fc3e8009e30 comp rx=0 tx=0).stop 2023-12-07T16:24:55.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.998+0000 7fc3f3f83700 1 -- 172.21.15.63:0/3175546302 shutdown_connections 2023-12-07T16:24:55.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.998+0000 7fc3f3f83700 1 --2- 172.21.15.63:0/3175546302 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fc3d806ce60 0x7fc3d806f310 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:55.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.998+0000 7fc3f3f83700 1 --2- 172.21.15.63:0/3175546302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3ec0faed0 0x7fc3ec0fd9f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:55.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.998+0000 7fc3f3f83700 1 --2- 172.21.15.63:0/3175546302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3ec0fdf60 0x7fc3ec0fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:24:55.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.998+0000 7fc3f3f83700 1 -- 172.21.15.63:0/3175546302 >> 172.21.15.63:0/3175546302 conn(0x7fc3ec0f6950 msgr2=0x7fc3ec101190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:24:55.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.999+0000 7fc3f3f83700 1 -- 172.21.15.63:0/3175546302 shutdown_connections 2023-12-07T16:24:55.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:24:55.999+0000 7fc3f3f83700 1 -- 172.21.15.63:0/3175546302 wait complete. 2023-12-07T16:24:56.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:56 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/3773778131' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:24:56.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:56 smithi063 ceph-mon[192008]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:24:56.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:56 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/3175546302' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:24:56.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:56 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/3773778131' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:24:56.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:56 smithi152 ceph-mon[175645]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:24:56.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:56 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/3175546302' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:24:57.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:57 smithi063 ceph-mon[192008]: pgmap v96: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:24:57.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:57 smithi063 ceph-mon[192008]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/360 objects degraded (2.500%), 2 pgs degraded) 2023-12-07T16:24:57.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:57 smithi152 ceph-mon[175645]: pgmap v96: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:24:57.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:57 smithi152 ceph-mon[175645]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/360 objects degraded (2.500%), 2 pgs degraded) 2023-12-07T16:24:59.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:59 smithi152 ceph-mon[175645]: pgmap v97: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:24:59.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:59 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:24:59.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:24:59 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:25:00.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:59 smithi063 ceph-mon[192008]: pgmap v97: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:00.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:59 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:00.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:24:59 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:25:01.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:01 smithi152 ceph-mon[175645]: pgmap v98: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:02.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:01 smithi063 ceph-mon[192008]: pgmap v98: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:03.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:03 smithi152 ceph-mon[175645]: pgmap v99: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:04.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:03 smithi063 ceph-mon[192008]: pgmap v99: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:05.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:05 smithi152 ceph-mon[175645]: pgmap v100: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:05.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:05 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:05.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:05 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-07T16:25:05.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:05 smithi152 ceph-mon[175645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-07T16:25:05.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:05 smithi152 ceph-mon[175645]: Upgrade: osd.3 is safe to restart 2023-12-07T16:25:05.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:05 smithi063 ceph-mon[192008]: pgmap v100: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:05.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:05 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:05.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:05 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-07T16:25:05.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:05 smithi063 ceph-mon[192008]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-07T16:25:05.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:05 smithi063 ceph-mon[192008]: Upgrade: osd.3 is safe to restart 2023-12-07T16:25:07.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:07 smithi063 ceph-mon[192008]: pgmap v101: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:07.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:07 smithi063 ceph-mon[192008]: Upgrade: Updating osd.3 2023-12-07T16:25:07.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:07 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:07.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:07 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-07T16:25:07.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:07 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:25:07.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:07 smithi063 ceph-mon[192008]: Deploying daemon osd.3 on smithi152 2023-12-07T16:25:07.436 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:07 smithi152 ceph-mon[175645]: pgmap v101: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:07.436 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:07 smithi152 ceph-mon[175645]: Upgrade: Updating osd.3 2023-12-07T16:25:07.436 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:07 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:07.436 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:07 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-07T16:25:07.437 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:07 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:25:07.437 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:07 smithi152 ceph-mon[175645]: Deploying daemon osd.3 on smithi152 2023-12-07T16:25:08.492 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:25:08 smithi152 systemd[1]: Stopping Ceph osd.3 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:25:08.492 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:25:08 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-3[127309]: 2023-12-07T16:25:08.204+0000 7f0e9ae40700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-07T16:25:08.493 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:25:08 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-3[127309]: 2023-12-07T16:25:08.204+0000 7f0e9ae40700 -1 osd.3 76 *** Got signal Terminated *** 2023-12-07T16:25:08.493 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:25:08 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-3[127309]: 2023-12-07T16:25:08.204+0000 7f0e9ae40700 -1 osd.3 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-07T16:25:08.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:08 smithi152 ceph-mon[175645]: osd.3 marked itself down and dead 2023-12-07T16:25:09.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:08 smithi063 ceph-mon[192008]: osd.3 marked itself down and dead 2023-12-07T16:25:09.682 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:25:09 smithi152 bash[187364]: ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-3 2023-12-07T16:25:09.684 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:09 smithi152 ceph-mon[175645]: pgmap v102: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:09.684 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:09 smithi152 ceph-mon[175645]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-07T16:25:09.684 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:09 smithi152 ceph-mon[175645]: osdmap e77: 6 total, 5 up, 6 in 2023-12-07T16:25:09.684 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:09 smithi152 ceph-mon[175645]: failed to encode map e77 with expected crc 2023-12-07T16:25:09.684 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:09 smithi152 ceph-mon[175645]: failed to encode map e77 with expected crc 2023-12-07T16:25:10.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:09 smithi063 ceph-mon[192008]: pgmap v102: 65 pgs: 65 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:10.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:09 smithi063 ceph-mon[192008]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-07T16:25:10.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:09 smithi063 ceph-mon[192008]: osdmap e77: 6 total, 5 up, 6 in 2023-12-07T16:25:10.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:09 smithi063 ceph-mon[192008]: failed to encode map e77 with expected crc 2023-12-07T16:25:10.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:09 smithi063 ceph-mon[192008]: failed to encode map e77 with expected crc 2023-12-07T16:25:10.911 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:25:10 smithi152 systemd[1]: ceph-8c493298-951b-11ee-95a2-87774f69a715@osd.3.service: Succeeded. 2023-12-07T16:25:10.911 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:25:10 smithi152 systemd[1]: Stopped Ceph osd.3 for 8c493298-951b-11ee-95a2-87774f69a715. 2023-12-07T16:25:10.911 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:25:10 smithi152 systemd[1]: Starting Ceph osd.3 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:25:10.912 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:10 smithi152 ceph-mon[175645]: failed to encode map e78 with expected crc 2023-12-07T16:25:10.912 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:10 smithi152 ceph-mon[175645]: osdmap e78: 6 total, 5 up, 6 in 2023-12-07T16:25:10.912 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:10 smithi152 ceph-mon[175645]: failed to encode map e78 with expected crc 2023-12-07T16:25:10.912 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:10 smithi152 ceph-mon[175645]: failed to encode map e78 with expected crc 2023-12-07T16:25:10.912 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:10 smithi152 ceph-mon[175645]: failed to encode map e78 with expected crc 2023-12-07T16:25:11.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:10 smithi063 ceph-mon[192008]: failed to encode map e78 with expected crc 2023-12-07T16:25:11.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:10 smithi063 ceph-mon[192008]: osdmap e78: 6 total, 5 up, 6 in 2023-12-07T16:25:11.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:10 smithi063 ceph-mon[192008]: failed to encode map e78 with expected crc 2023-12-07T16:25:11.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:10 smithi063 ceph-mon[192008]: failed to encode map e78 with expected crc 2023-12-07T16:25:11.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:10 smithi063 ceph-mon[192008]: failed to encode map e78 with expected crc 2023-12-07T16:25:11.689 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:25:11 smithi152 bash[187628]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-07T16:25:11.689 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:25:11 smithi152 bash[187628]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-07T16:25:11.689 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:25:11 smithi152 bash[187628]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-07T16:25:11.689 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:25:11 smithi152 bash[187628]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-07T16:25:11.689 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:25:11 smithi152 bash[187628]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2023-12-07T16:25:11.689 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:25:11 smithi152 bash[187628]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-07T16:25:11.689 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:25:11 smithi152 bash[187628]: --> ceph-volume raw activate successful for osd ID: 3 2023-12-07T16:25:11.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:11 smithi152 ceph-mon[175645]: pgmap v105: 65 pgs: 8 active+undersized, 4 activating+undersized, 8 active+undersized+degraded, 1 activating+undersized+degraded, 4 peering, 2 stale+active+clean, 38 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 43/360 objects degraded (11.944%) 2023-12-07T16:25:11.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:11 smithi152 ceph-mon[175645]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-07T16:25:11.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:11 smithi152 ceph-mon[175645]: Health check failed: Degraded data redundancy: 43/360 objects degraded (11.944%), 9 pgs degraded (PG_DEGRADED) 2023-12-07T16:25:12.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:11 smithi063 ceph-mon[192008]: pgmap v105: 65 pgs: 8 active+undersized, 4 activating+undersized, 8 active+undersized+degraded, 1 activating+undersized+degraded, 4 peering, 2 stale+active+clean, 38 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 43/360 objects degraded (11.944%) 2023-12-07T16:25:12.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:11 smithi063 ceph-mon[192008]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-07T16:25:12.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:11 smithi063 ceph-mon[192008]: Health check failed: Degraded data redundancy: 43/360 objects degraded (11.944%), 9 pgs degraded (PG_DEGRADED) 2023-12-07T16:25:12.492 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:25:12 smithi152 ceph-osd[187945]: -- 172.21.15.152:0/3993902436 <== mon.1 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55cf22c131e0 con 0x55cf22be2c00 2023-12-07T16:25:12.492 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:25:12 smithi152 bash[187908]: 7c32a746ce82dacd0caa155b89e4b9b342b9bd552bd51a606d7848e3e10736f1 2023-12-07T16:25:12.492 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:25:12 smithi152 systemd[1]: Started Ceph osd.3 for 8c493298-951b-11ee-95a2-87774f69a715. 2023-12-07T16:25:12.992 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:25:12 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-3[187922]: 2023-12-07T16:25:12.671+0000 7fa5d1425640 -1 Falling back to public interface 2023-12-07T16:25:13.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:13 smithi152 ceph-mon[175645]: pgmap v106: 65 pgs: 11 active+undersized, 4 activating+undersized, 13 active+undersized+degraded, 1 activating+undersized+degraded, 4 peering, 32 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2023-12-07T16:25:13.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:13 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:13.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:13 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:13.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:13 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:25:13.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:13 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:13.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:13 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:13.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:13 smithi063 ceph-mon[192008]: pgmap v106: 65 pgs: 11 active+undersized, 4 activating+undersized, 13 active+undersized+degraded, 1 activating+undersized+degraded, 4 peering, 32 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2023-12-07T16:25:13.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:13 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:13.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:13 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:13.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:13 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:25:13.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:13 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:13.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:13 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:15.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:15 smithi152 ceph-mon[175645]: pgmap v107: 65 pgs: 14 active+undersized, 4 activating+undersized, 14 active+undersized+degraded, 1 activating+undersized+degraded, 32 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 64/360 objects degraded (17.778%) 2023-12-07T16:25:15.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:15 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:15.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:15 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:25:15.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:15 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:15.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:15 smithi152 ceph-mon[175645]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-07T16:25:15.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:15 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:15.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:15 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:15.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:15 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:15.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:15 smithi063 ceph-mon[192008]: pgmap v107: 65 pgs: 14 active+undersized, 4 activating+undersized, 14 active+undersized+degraded, 1 activating+undersized+degraded, 32 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 64/360 objects degraded (17.778%) 2023-12-07T16:25:15.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:15 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:15.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:15 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:25:15.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:15 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:15.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:15 smithi063 ceph-mon[192008]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-07T16:25:15.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:15 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:15.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:15 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:15.406 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:15 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:16.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:16 smithi063 ceph-mon[192008]: Health check update: Degraded data redundancy: 64/360 objects degraded (17.778%), 16 pgs degraded (PG_DEGRADED) 2023-12-07T16:25:16.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:16 smithi152 ceph-mon[175645]: Health check update: Degraded data redundancy: 64/360 objects degraded (17.778%), 16 pgs degraded (PG_DEGRADED) 2023-12-07T16:25:17.374 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:17 smithi152 ceph-mon[175645]: pgmap v108: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 64/360 objects degraded (17.778%) 2023-12-07T16:25:17.375 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:25:17 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-3[187922]: 2023-12-07T16:25:17.255+0000 7fa5d1425640 -1 osd.3 0 read_superblock omap replica is missing. 2023-12-07T16:25:17.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:17 smithi063 ceph-mon[192008]: pgmap v108: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 64/360 objects degraded (17.778%) 2023-12-07T16:25:18.242 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:25:17 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-3[187922]: 2023-12-07T16:25:17.779+0000 7fa5d1425640 -1 osd.3 76 log_to_monitors true 2023-12-07T16:25:18.705 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:18 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:18.705 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:18 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:18.705 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:18 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:25:18.705 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:18 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:25:18.705 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:18 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:18.705 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:18 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:25:18.705 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:18 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:25:18.705 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:18 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:25:18.705 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:18 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:25:18.705 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:18 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-07T16:25:18.706 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:18 smithi152 ceph-mon[175645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-07T16:25:18.706 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:18 smithi152 ceph-mon[175645]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-07T16:25:18.706 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:18 smithi152 ceph-mon[175645]: from='osd.3 [v2:172.21.15.152:6800/1412291615,v1:172.21.15.152:6801/1412291615]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-07T16:25:18.706 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:18 smithi152 ceph-mon[175645]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-07T16:25:18.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:18 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:18.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:18 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:18.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:18 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:25:18.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:18 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:25:18.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:18 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:18.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:18 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:25:18.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:18 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:25:18.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:18 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:25:18.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:18 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:25:18.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:18 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-07T16:25:18.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:18 smithi063 ceph-mon[192008]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-07T16:25:18.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:18 smithi063 ceph-mon[192008]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-07T16:25:18.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:18 smithi063 ceph-mon[192008]: from='osd.3 [v2:172.21.15.152:6800/1412291615,v1:172.21.15.152:6801/1412291615]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-07T16:25:18.906 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:18 smithi063 ceph-mon[192008]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-07T16:25:18.992 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:25:18 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-3[187922]: 2023-12-07T16:25:18.707+0000 7fa5c0091700 -1 osd.3 76 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T16:25:19.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:19 smithi152 ceph-mon[175645]: pgmap v109: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 64/360 objects degraded (17.778%) 2023-12-07T16:25:19.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:19 smithi152 ceph-mon[175645]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-07T16:25:19.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:19 smithi152 ceph-mon[175645]: osdmap e79: 6 total, 5 up, 6 in 2023-12-07T16:25:19.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:19 smithi152 ceph-mon[175645]: from='osd.3 [v2:172.21.15.152:6800/1412291615,v1:172.21.15.152:6801/1412291615]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-07T16:25:19.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:19 smithi152 ceph-mon[175645]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-07T16:25:19.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:19 smithi152 ceph-mon[175645]: failed to encode map e79 with expected crc 2023-12-07T16:25:20.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:19 smithi063 ceph-mon[192008]: pgmap v109: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 308 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 64/360 objects degraded (17.778%) 2023-12-07T16:25:20.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:19 smithi063 ceph-mon[192008]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-07T16:25:20.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:19 smithi063 ceph-mon[192008]: osdmap e79: 6 total, 5 up, 6 in 2023-12-07T16:25:20.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:19 smithi063 ceph-mon[192008]: from='osd.3 [v2:172.21.15.152:6800/1412291615,v1:172.21.15.152:6801/1412291615]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-07T16:25:20.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:19 smithi063 ceph-mon[192008]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-07T16:25:20.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:19 smithi063 ceph-mon[192008]: failed to encode map e79 with expected crc 2023-12-07T16:25:20.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:20 smithi152 ceph-mon[175645]: failed to encode map e79 with expected crc 2023-12-07T16:25:20.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:20 smithi152 ceph-mon[175645]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-07T16:25:20.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:20 smithi152 ceph-mon[175645]: failed to encode map e80 with expected crc 2023-12-07T16:25:20.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:20 smithi152 ceph-mon[175645]: osd.3 [v2:172.21.15.152:6800/1412291615,v1:172.21.15.152:6801/1412291615] boot 2023-12-07T16:25:20.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:20 smithi152 ceph-mon[175645]: osdmap e80: 6 total, 6 up, 6 in 2023-12-07T16:25:20.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:20 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T16:25:20.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:20 smithi152 ceph-mon[175645]: osdmap e81: 6 total, 6 up, 6 in 2023-12-07T16:25:21.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:20 smithi063 ceph-mon[192008]: failed to encode map e79 with expected crc 2023-12-07T16:25:21.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:20 smithi063 ceph-mon[192008]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-07T16:25:21.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:20 smithi063 ceph-mon[192008]: failed to encode map e80 with expected crc 2023-12-07T16:25:21.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:20 smithi063 ceph-mon[192008]: osd.3 [v2:172.21.15.152:6800/1412291615,v1:172.21.15.152:6801/1412291615] boot 2023-12-07T16:25:21.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:20 smithi063 ceph-mon[192008]: osdmap e80: 6 total, 6 up, 6 in 2023-12-07T16:25:21.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:20 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T16:25:21.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:20 smithi063 ceph-mon[192008]: osdmap e81: 6 total, 6 up, 6 in 2023-12-07T16:25:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:21 smithi152 ceph-mon[175645]: pgmap v112: 65 pgs: 8 peering, 12 active+undersized, 13 active+undersized+degraded, 32 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 54/360 objects degraded (15.000%) 2023-12-07T16:25:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:21 smithi152 ceph-mon[175645]: failed to encode map e81 with expected crc 2023-12-07T16:25:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:21 smithi152 ceph-mon[175645]: failed to encode map e81 with expected crc 2023-12-07T16:25:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:21 smithi152 ceph-mon[175645]: failed to encode map e81 with expected crc 2023-12-07T16:25:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:21 smithi152 ceph-mon[175645]: failed to encode map e81 with expected crc 2023-12-07T16:25:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:21 smithi152 ceph-mon[175645]: failed to encode map e81 with expected crc 2023-12-07T16:25:21.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:21 smithi152 ceph-mon[175645]: failed to encode map e81 with expected crc 2023-12-07T16:25:22.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:21 smithi063 ceph-mon[192008]: pgmap v112: 65 pgs: 8 peering, 12 active+undersized, 13 active+undersized+degraded, 32 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 54/360 objects degraded (15.000%) 2023-12-07T16:25:22.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:21 smithi063 ceph-mon[192008]: failed to encode map e81 with expected crc 2023-12-07T16:25:22.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:21 smithi063 ceph-mon[192008]: failed to encode map e81 with expected crc 2023-12-07T16:25:22.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:21 smithi063 ceph-mon[192008]: failed to encode map e81 with expected crc 2023-12-07T16:25:22.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:21 smithi063 ceph-mon[192008]: failed to encode map e81 with expected crc 2023-12-07T16:25:22.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:21 smithi063 ceph-mon[192008]: failed to encode map e81 with expected crc 2023-12-07T16:25:22.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:21 smithi063 ceph-mon[192008]: failed to encode map e81 with expected crc 2023-12-07T16:25:22.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:22 smithi152 ceph-mon[175645]: Health check update: Degraded data redundancy: 54/360 objects degraded (15.000%), 13 pgs degraded (PG_DEGRADED) 2023-12-07T16:25:23.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:22 smithi063 ceph-mon[192008]: Health check update: Degraded data redundancy: 54/360 objects degraded (15.000%), 13 pgs degraded (PG_DEGRADED) 2023-12-07T16:25:23.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:23 smithi152 ceph-mon[175645]: pgmap v114: 65 pgs: 6 activating, 8 peering, 9 active+undersized, 10 active+undersized+degraded, 32 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 44/360 objects degraded (12.222%) 2023-12-07T16:25:24.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:23 smithi063 ceph-mon[192008]: pgmap v114: 65 pgs: 6 activating, 8 peering, 9 active+undersized, 10 active+undersized+degraded, 32 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 44/360 objects degraded (12.222%) 2023-12-07T16:25:25.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:25 smithi152 ceph-mon[175645]: pgmap v115: 65 pgs: 6 activating, 8 peering, 3 active+undersized, 1 active+undersized+degraded, 47 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 4/360 objects degraded (1.111%) 2023-12-07T16:25:26.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.116+0000 7f0d84158700 1 -- 172.21.15.63:0/1745001479 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d7c0fbaf0 msgr2=0x7f0d7c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:26.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.116+0000 7f0d84158700 1 --2- 172.21.15.63:0/1745001479 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d7c0fbaf0 0x7f0d7c0fbf00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0d78004940 tx=0x7f0d78009e30 comp rx=0 tx=0).stop 2023-12-07T16:25:26.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.116+0000 7f0d84158700 1 -- 172.21.15.63:0/1745001479 shutdown_connections 2023-12-07T16:25:26.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.116+0000 7f0d84158700 1 --2- 172.21.15.63:0/1745001479 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d7c0fcd00 0x7f0d7c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:26.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.116+0000 7f0d84158700 1 --2- 172.21.15.63:0/1745001479 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d7c0fbaf0 0x7f0d7c0fbf00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:26.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.116+0000 7f0d84158700 1 -- 172.21.15.63:0/1745001479 >> 172.21.15.63:0/1745001479 conn(0x7f0d7c0f7190 msgr2=0x7f0d7c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:25:26.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.116+0000 7f0d84158700 1 -- 172.21.15.63:0/1745001479 shutdown_connections 2023-12-07T16:25:26.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.116+0000 7f0d84158700 1 -- 172.21.15.63:0/1745001479 wait complete. 2023-12-07T16:25:26.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.116+0000 7f0d84158700 1 Processor -- start 2023-12-07T16:25:26.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.116+0000 7f0d84158700 1 -- start start 2023-12-07T16:25:26.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.117+0000 7f0d84158700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d7c0fbaf0 0x7f0d7c0ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:26.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.117+0000 7f0d84158700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d7c0fcd00 0x7f0d7c0fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:26.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.117+0000 7f0d84158700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c0fe640 con 0x7f0d7c0fbaf0 2023-12-07T16:25:26.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.117+0000 7f0d84158700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c0fe7b0 con 0x7f0d7c0fcd00 2023-12-07T16:25:26.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.117+0000 7f0d81ef4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d7c0fbaf0 0x7f0d7c0ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:26.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.117+0000 7f0d81ef4700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d7c0fbaf0 0x7f0d7c0ffbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37418/0 (socket says 172.21.15.63:37418) 2023-12-07T16:25:26.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.117+0000 7f0d81ef4700 1 -- 172.21.15.63:0/2656378386 learned_addr learned my addr 172.21.15.63:0/2656378386 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:25:26.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.117+0000 7f0d816f3700 1 --2- 172.21.15.63:0/2656378386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d7c0fcd00 0x7f0d7c0fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:26.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.117+0000 7f0d81ef4700 1 -- 172.21.15.63:0/2656378386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d7c0fcd00 msgr2=0x7f0d7c0fe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:26.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.117+0000 7f0d81ef4700 1 --2- 172.21.15.63:0/2656378386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d7c0fcd00 0x7f0d7c0fe040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:26.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.117+0000 7f0d81ef4700 1 -- 172.21.15.63:0/2656378386 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d78005040 con 0x7f0d7c0fbaf0 2023-12-07T16:25:26.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.117+0000 7f0d816f3700 1 --2- 172.21.15.63:0/2656378386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d7c0fcd00 0x7f0d7c0fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T16:25:26.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.117+0000 7f0d81ef4700 1 --2- 172.21.15.63:0/2656378386 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d7c0fbaf0 0x7f0d7c0ffbc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0d78000c00 tx=0x7f0d78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:25:26.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.117+0000 7f0d727fc700 1 -- 172.21.15.63:0/2656378386 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d7800e040 con 0x7f0d7c0fbaf0 2023-12-07T16:25:26.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.117+0000 7f0d727fc700 1 -- 172.21.15.63:0/2656378386 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0d78009af0 con 0x7f0d7c0fbaf0 2023-12-07T16:25:26.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.117+0000 7f0d84158700 1 -- 172.21.15.63:0/2656378386 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7c0fea30 con 0x7f0d7c0fbaf0 2023-12-07T16:25:26.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.117+0000 7f0d727fc700 1 -- 172.21.15.63:0/2656378386 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d7801c630 con 0x7f0d7c0fbaf0 2023-12-07T16:25:26.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.118+0000 7f0d84158700 1 -- 172.21.15.63:0/2656378386 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d7c1155d0 con 0x7f0d7c0fbaf0 2023-12-07T16:25:26.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.118+0000 7f0d84158700 1 -- 172.21.15.63:0/2656378386 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d7c04bb80 con 0x7f0d7c0fbaf0 2023-12-07T16:25:26.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.119+0000 7f0d727fc700 1 -- 172.21.15.63:0/2656378386 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f0d7800bcd0 con 0x7f0d7c0fbaf0 2023-12-07T16:25:26.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.120+0000 7f0d727fc700 1 --2- 172.21.15.63:0/2656378386 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f0d6806ce60 0x7f0d6806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:26.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.120+0000 7f0d816f3700 1 --2- 172.21.15.63:0/2656378386 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f0d6806ce60 0x7f0d6806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:26.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.120+0000 7f0d727fc700 1 -- 172.21.15.63:0/2656378386 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f0d7808d8b0 con 0x7f0d7c0fbaf0 2023-12-07T16:25:26.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.120+0000 7f0d816f3700 1 --2- 172.21.15.63:0/2656378386 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f0d6806ce60 0x7f0d6806f310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c009fd0 tx=0x7f0d6c009f20 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:25:26.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.124+0000 7f0d727fc700 1 -- 172.21.15.63:0/2656378386 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0d7805b1f0 con 0x7f0d7c0fbaf0 2023-12-07T16:25:26.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:25 smithi063 ceph-mon[192008]: pgmap v115: 65 pgs: 6 activating, 8 peering, 3 active+undersized, 1 active+undersized+degraded, 47 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 4/360 objects degraded (1.111%) 2023-12-07T16:25:26.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.346+0000 7f0d84158700 1 -- 172.21.15.63:0/2656378386 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d7c065a80 con 0x7f0d6806ce60 2023-12-07T16:25:26.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.347+0000 7f0d727fc700 1 -- 172.21.15.63:0/2656378386 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f0d7c065a80 con 0x7f0d6806ce60 2023-12-07T16:25:26.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.349+0000 7f0d84158700 1 -- 172.21.15.63:0/2656378386 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f0d6806ce60 msgr2=0x7f0d6806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:26.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.349+0000 7f0d84158700 1 --2- 172.21.15.63:0/2656378386 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f0d6806ce60 0x7f0d6806f310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c009fd0 tx=0x7f0d6c009f20 comp rx=0 tx=0).stop 2023-12-07T16:25:26.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.349+0000 7f0d84158700 1 -- 172.21.15.63:0/2656378386 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d7c0fbaf0 msgr2=0x7f0d7c0ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:26.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.349+0000 7f0d84158700 1 --2- 172.21.15.63:0/2656378386 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d7c0fbaf0 0x7f0d7c0ffbc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0d78000c00 tx=0x7f0d78009e30 comp rx=0 tx=0).stop 2023-12-07T16:25:26.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.349+0000 7f0d84158700 1 -- 172.21.15.63:0/2656378386 shutdown_connections 2023-12-07T16:25:26.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.349+0000 7f0d84158700 1 --2- 172.21.15.63:0/2656378386 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f0d6806ce60 0x7f0d6806f310 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:26.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.349+0000 7f0d84158700 1 --2- 172.21.15.63:0/2656378386 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d7c0fbaf0 0x7f0d7c0ffbc0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:26.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.349+0000 7f0d84158700 1 --2- 172.21.15.63:0/2656378386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d7c0fcd00 0x7f0d7c0fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:26.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.349+0000 7f0d84158700 1 -- 172.21.15.63:0/2656378386 >> 172.21.15.63:0/2656378386 conn(0x7f0d7c0f7190 msgr2=0x7f0d7c065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:25:26.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.349+0000 7f0d84158700 1 -- 172.21.15.63:0/2656378386 shutdown_connections 2023-12-07T16:25:26.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.349+0000 7f0d84158700 1 -- 172.21.15.63:0/2656378386 wait complete. 2023-12-07T16:25:26.357 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-07T16:25:26.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.453+0000 7f57ddd5f700 1 -- 172.21.15.63:0/3821842392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57d80fcbf0 msgr2=0x7f57d80fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:26.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.453+0000 7f57ddd5f700 1 --2- 172.21.15.63:0/3821842392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57d80fcbf0 0x7f57d80fd000 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f57c8004940 tx=0x7f57c8009e30 comp rx=0 tx=0).stop 2023-12-07T16:25:26.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.453+0000 7f57ddd5f700 1 -- 172.21.15.63:0/3821842392 shutdown_connections 2023-12-07T16:25:26.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.453+0000 7f57ddd5f700 1 --2- 172.21.15.63:0/3821842392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57d80fde00 0x7f57d80fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:26.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.453+0000 7f57ddd5f700 1 --2- 172.21.15.63:0/3821842392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57d80fcbf0 0x7f57d80fd000 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:26.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.453+0000 7f57ddd5f700 1 -- 172.21.15.63:0/3821842392 >> 172.21.15.63:0/3821842392 conn(0x7f57d80f82d0 msgr2=0x7f57d80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:25:26.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.454+0000 7f57ddd5f700 1 -- 172.21.15.63:0/3821842392 shutdown_connections 2023-12-07T16:25:26.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.454+0000 7f57ddd5f700 1 -- 172.21.15.63:0/3821842392 wait complete. 2023-12-07T16:25:26.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.454+0000 7f57ddd5f700 1 Processor -- start 2023-12-07T16:25:26.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.454+0000 7f57ddd5f700 1 -- start start 2023-12-07T16:25:26.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.454+0000 7f57ddd5f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57d80fcbf0 0x7f57d810d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:26.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.454+0000 7f57ddd5f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57d80fde00 0x7f57d810daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:26.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.454+0000 7f57ddd5f700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d810e0a0 con 0x7f57d80fde00 2023-12-07T16:25:26.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.454+0000 7f57ddd5f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d810e940 con 0x7f57d80fcbf0 2023-12-07T16:25:26.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.455+0000 7f57d6ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57d80fde00 0x7f57d810daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:26.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.455+0000 7f57d6ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57d80fde00 0x7f57d810daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37444/0 (socket says 172.21.15.63:37444) 2023-12-07T16:25:26.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.455+0000 7f57d6ffd700 1 -- 172.21.15.63:0/1543998897 learned_addr learned my addr 172.21.15.63:0/1543998897 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:25:26.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.455+0000 7f57d77fe700 1 --2- 172.21.15.63:0/1543998897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57d80fcbf0 0x7f57d810d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:26.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.455+0000 7f57d6ffd700 1 -- 172.21.15.63:0/1543998897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57d80fcbf0 msgr2=0x7f57d810d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:26.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.455+0000 7f57d6ffd700 1 --2- 172.21.15.63:0/1543998897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57d80fcbf0 0x7f57d810d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:26.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.455+0000 7f57d6ffd700 1 -- 172.21.15.63:0/1543998897 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c8005040 con 0x7f57d80fde00 2023-12-07T16:25:26.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.455+0000 7f57d77fe700 1 --2- 172.21.15.63:0/1543998897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57d80fcbf0 0x7f57d810d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T16:25:26.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.455+0000 7f57d6ffd700 1 --2- 172.21.15.63:0/1543998897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57d80fde00 0x7f57d810daa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f57cc00c830 tx=0x7f57cc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:25:26.455 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.455+0000 7f57bffff700 1 -- 172.21.15.63:0/1543998897 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57cc00a760 con 0x7f57d80fde00 2023-12-07T16:25:26.455 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.455+0000 7f57bffff700 1 -- 172.21.15.63:0/1543998897 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f57cc00ad70 con 0x7f57d80fde00 2023-12-07T16:25:26.455 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.455+0000 7f57ddd5f700 1 -- 172.21.15.63:0/1543998897 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d810ec20 con 0x7f57d80fde00 2023-12-07T16:25:26.455 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.455+0000 7f57bffff700 1 -- 172.21.15.63:0/1543998897 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57cc0113a0 con 0x7f57d80fde00 2023-12-07T16:25:26.455 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.455+0000 7f57ddd5f700 1 -- 172.21.15.63:0/1543998897 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d810f160 con 0x7f57d80fde00 2023-12-07T16:25:26.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.456+0000 7f57ddd5f700 1 -- 172.21.15.63:0/1543998897 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d804bb80 con 0x7f57d80fde00 2023-12-07T16:25:26.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.457+0000 7f57bffff700 1 -- 172.21.15.63:0/1543998897 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f57cc012400 con 0x7f57d80fde00 2023-12-07T16:25:26.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.457+0000 7f57bffff700 1 --2- 172.21.15.63:0/1543998897 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f57c006ce60 0x7f57c006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:26.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.457+0000 7f57bffff700 1 -- 172.21.15.63:0/1543998897 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f57cc08c470 con 0x7f57d80fde00 2023-12-07T16:25:26.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.457+0000 7f57d77fe700 1 --2- 172.21.15.63:0/1543998897 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f57c006ce60 0x7f57c006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:26.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.458+0000 7f57d77fe700 1 --2- 172.21.15.63:0/1543998897 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f57c006ce60 0x7f57c006f310 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f57c8000c00 tx=0x7f57c8009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:25:26.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.462+0000 7f57bffff700 1 -- 172.21.15.63:0/1543998897 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f57cc059d00 con 0x7f57d80fde00 2023-12-07T16:25:26.678 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.680+0000 7f57ddd5f700 1 -- 172.21.15.63:0/1543998897 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f57d810f610 con 0x7f57c006ce60 2023-12-07T16:25:26.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.681+0000 7f57bffff700 1 -- 172.21.15.63:0/1543998897 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f57d810f610 con 0x7f57c006ce60 2023-12-07T16:25:26.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.683+0000 7f57ddd5f700 1 -- 172.21.15.63:0/1543998897 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f57c006ce60 msgr2=0x7f57c006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:26.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.683+0000 7f57ddd5f700 1 --2- 172.21.15.63:0/1543998897 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f57c006ce60 0x7f57c006f310 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f57c8000c00 tx=0x7f57c8009e30 comp rx=0 tx=0).stop 2023-12-07T16:25:26.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.683+0000 7f57ddd5f700 1 -- 172.21.15.63:0/1543998897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57d80fde00 msgr2=0x7f57d810daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:26.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.683+0000 7f57ddd5f700 1 --2- 172.21.15.63:0/1543998897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57d80fde00 0x7f57d810daa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f57cc00c830 tx=0x7f57cc004470 comp rx=0 tx=0).stop 2023-12-07T16:25:26.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.683+0000 7f57ddd5f700 1 -- 172.21.15.63:0/1543998897 shutdown_connections 2023-12-07T16:25:26.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.683+0000 7f57ddd5f700 1 --2- 172.21.15.63:0/1543998897 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f57c006ce60 0x7f57c006f310 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:26.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.683+0000 7f57ddd5f700 1 --2- 172.21.15.63:0/1543998897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57d80fcbf0 0x7f57d810d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:26.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.683+0000 7f57ddd5f700 1 --2- 172.21.15.63:0/1543998897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57d80fde00 0x7f57d810daa0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:26.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.683+0000 7f57ddd5f700 1 -- 172.21.15.63:0/1543998897 >> 172.21.15.63:0/1543998897 conn(0x7f57d80f82d0 msgr2=0x7f57d8101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:25:26.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.683+0000 7f57ddd5f700 1 -- 172.21.15.63:0/1543998897 shutdown_connections 2023-12-07T16:25:26.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.683+0000 7f57ddd5f700 1 -- 172.21.15.63:0/1543998897 wait complete. 2023-12-07T16:25:26.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.788+0000 7fc1b99d1700 1 -- 172.21.15.63:0/2950236502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b4071b60 msgr2=0x7fc1b406ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:26.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.788+0000 7fc1b99d1700 1 --2- 172.21.15.63:0/2950236502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b4071b60 0x7fc1b406ffd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8004940 tx=0x7fc1a8009e30 comp rx=0 tx=0).stop 2023-12-07T16:25:26.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.788+0000 7fc1b99d1700 1 -- 172.21.15.63:0/2950236502 shutdown_connections 2023-12-07T16:25:26.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.788+0000 7fc1b99d1700 1 --2- 172.21.15.63:0/2950236502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1b4070510 0x7fc1b4070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:26.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.788+0000 7fc1b99d1700 1 --2- 172.21.15.63:0/2950236502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b4071b60 0x7fc1b406ffd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:26.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.788+0000 7fc1b99d1700 1 -- 172.21.15.63:0/2950236502 >> 172.21.15.63:0/2950236502 conn(0x7fc1b40f82d0 msgr2=0x7fc1b40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:25:26.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.788+0000 7fc1b99d1700 1 -- 172.21.15.63:0/2950236502 shutdown_connections 2023-12-07T16:25:26.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.788+0000 7fc1b99d1700 1 -- 172.21.15.63:0/2950236502 wait complete. 2023-12-07T16:25:26.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.789+0000 7fc1b99d1700 1 Processor -- start 2023-12-07T16:25:26.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.789+0000 7fc1b99d1700 1 -- start start 2023-12-07T16:25:26.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.789+0000 7fc1b99d1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1b4070510 0x7fc1b410f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:26.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.789+0000 7fc1b99d1700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b4071b60 0x7fc1b410fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:26.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.789+0000 7fc1b99d1700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b41102d0 con 0x7fc1b4071b60 2023-12-07T16:25:26.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.789+0000 7fc1b99d1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b4110b70 con 0x7fc1b4070510 2023-12-07T16:25:26.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.789+0000 7fc1b27fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b4071b60 0x7fc1b410fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:26.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.789+0000 7fc1b27fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b4071b60 0x7fc1b410fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37456/0 (socket says 172.21.15.63:37456) 2023-12-07T16:25:26.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.789+0000 7fc1b27fc700 1 -- 172.21.15.63:0/2912031925 learned_addr learned my addr 172.21.15.63:0/2912031925 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:25:26.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.789+0000 7fc1b2ffd700 1 --2- 172.21.15.63:0/2912031925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1b4070510 0x7fc1b410f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:26.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.789+0000 7fc1b27fc700 1 -- 172.21.15.63:0/2912031925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1b4070510 msgr2=0x7fc1b410f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:26.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.789+0000 7fc1b27fc700 1 --2- 172.21.15.63:0/2912031925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1b4070510 0x7fc1b410f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:26.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.789+0000 7fc1b27fc700 1 -- 172.21.15.63:0/2912031925 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a8005040 con 0x7fc1b4071b60 2023-12-07T16:25:26.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.790+0000 7fc1b27fc700 1 --2- 172.21.15.63:0/2912031925 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b4071b60 0x7fc1b410fcd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400c830 tx=0x7fc1a4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:25:26.791 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.792+0000 7fc19b7fe700 1 -- 172.21.15.63:0/2912031925 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1a40106f0 con 0x7fc1b4071b60 2023-12-07T16:25:26.791 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.792+0000 7fc19b7fe700 1 -- 172.21.15.63:0/2912031925 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc1a4010d00 con 0x7fc1b4071b60 2023-12-07T16:25:26.791 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.792+0000 7fc1b99d1700 1 -- 172.21.15.63:0/2912031925 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b4110e50 con 0x7fc1b4071b60 2023-12-07T16:25:26.791 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.792+0000 7fc19b7fe700 1 -- 172.21.15.63:0/2912031925 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1a4012e90 con 0x7fc1b4071b60 2023-12-07T16:25:26.791 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.792+0000 7fc1b99d1700 1 -- 172.21.15.63:0/2912031925 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b4111390 con 0x7fc1b4071b60 2023-12-07T16:25:26.791 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.793+0000 7fc1b99d1700 1 -- 172.21.15.63:0/2912031925 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b41096f0 con 0x7fc1b4071b60 2023-12-07T16:25:26.792 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.794+0000 7fc19b7fe700 1 -- 172.21.15.63:0/2912031925 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fc1a4010850 con 0x7fc1b4071b60 2023-12-07T16:25:26.792 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.794+0000 7fc19b7fe700 1 --2- 172.21.15.63:0/2912031925 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fc19c06ce70 0x7fc19c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:26.792 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.794+0000 7fc19b7fe700 1 -- 172.21.15.63:0/2912031925 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6761+0+0 (secure 0 0 0) 0x7fc1a408c360 con 0x7fc1b4071b60 2023-12-07T16:25:26.792 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.794+0000 7fc1b2ffd700 1 --2- 172.21.15.63:0/2912031925 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fc19c06ce70 0x7fc19c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:26.793 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.795+0000 7fc1b2ffd700 1 --2- 172.21.15.63:0/2912031925 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fc19c06ce70 0x7fc19c06f320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800b3b0 tx=0x7fc1a8009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:25:26.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:26.799+0000 7fc19b7fe700 1 -- 172.21.15.63:0/2912031925 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc1a4059c90 con 0x7fc1b4071b60 2023-12-07T16:25:27.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.007+0000 7fc1b99d1700 1 -- 172.21.15.63:0/2912031925 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1b4111610 con 0x7fc19c06ce70 2023-12-07T16:25:27.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.017+0000 7fc19b7fe700 1 -- 172.21.15.63:0/2912031925 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fc1b4111610 con 0x7fc19c06ce70 2023-12-07T16:25:27.016 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-07T16:25:27.016 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (4m) 40s ago 10m 28.6M - 0.25.0 c8568f914cd2 c0526812d5fe 2023-12-07T16:25:27.016 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (2m) 40s ago 10m 7474k - 19.0.0-13-ge6605fb8 104f332cd0a9 52adf44ea983 2023-12-07T16:25:27.016 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi152 smithi152 running (118s) 12s ago 9m 7457k - 19.0.0-13-ge6605fb8 104f332cd0a9 9eba5b538b96 2023-12-07T16:25:27.016 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (4m) 40s ago 9m 91.4M - 9.4.7 954c08fa6188 cc2cde9a664f 2023-12-07T16:25:27.016 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.gsjgcq smithi063 running (6m) 40s ago 6m 15.2M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 f70e4f098e4c 2023-12-07T16:25:27.016 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.yidolg smithi063 running (6m) 40s ago 6m 5932M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5b053ef5fb7f 2023-12-07T16:25:27.016 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.aovwwd smithi152 running (6m) 12s ago 6m 16.0M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 80190948a595 2023-12-07T16:25:27.016 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.mrvngf smithi152 running (6m) 12s ago 6m 5113M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5f60b893f840 2023-12-07T16:25:27.016 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.yohyyx smithi063 *:8443,9283,8765 running (3m) 40s ago 11m 511M - 19.0.0-13-ge6605fb8 104f332cd0a9 b605f882784d 2023-12-07T16:25:27.016 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi152.sxayfb smithi152 *:8443,9283,8765 running (3m) 12s ago 9m 451M - 19.0.0-13-ge6605fb8 104f332cd0a9 71716998ccc3 2023-12-07T16:25:27.016 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (2m) 40s ago 11m 67.3M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 8d7d0c6bfea3 2023-12-07T16:25:27.016 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi152 smithi152 running (2m) 12s ago 9m 52.0M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 883bb3425cf0 2023-12-07T16:25:27.017 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (4m) 40s ago 10m 18.9M - 1.5.0 0da6a335fe13 50d63981f746 2023-12-07T16:25:27.017 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi152 smithi152 *:9100 running (3m) 12s ago 9m 19.7M - 1.5.0 0da6a335fe13 627cda14f1a9 2023-12-07T16:25:27.017 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (103s) 40s ago 8m 189M 1568M 19.0.0-13-ge6605fb8 104f332cd0a9 5fab981f1333 2023-12-07T16:25:27.017 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (73s) 40s ago 8m 121M 1568M 19.0.0-13-ge6605fb8 104f332cd0a9 b78531e6dc96 2023-12-07T16:25:27.017 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (44s) 40s ago 8m 11.5M 1568M 19.0.0-13-ge6605fb8 104f332cd0a9 a473024763f8 2023-12-07T16:25:27.017 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi152 running (15s) 12s ago 7m 15.1M 2592M 19.0.0-13-ge6605fb8 104f332cd0a9 7c32a746ce82 2023-12-07T16:25:27.017 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi152 running (7m) 12s ago 7m 865M 2592M 17.2.7-115-g4f62d9ad fcdfd00f81c7 d3b8b2f12489 2023-12-07T16:25:27.017 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi152 running (7m) 12s ago 7m 1060M 2592M 17.2.7-115-g4f62d9ad fcdfd00f81c7 e7f8d9f716bb 2023-12-07T16:25:27.017 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (3m) 40s ago 9m 51.1M - 2.43.0 a07b618ecd1d 8a323520d9fd 2023-12-07T16:25:27.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.020+0000 7fc1b99d1700 1 -- 172.21.15.63:0/2912031925 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fc19c06ce70 msgr2=0x7fc19c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:27.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.020+0000 7fc1b99d1700 1 --2- 172.21.15.63:0/2912031925 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fc19c06ce70 0x7fc19c06f320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800b3b0 tx=0x7fc1a8009e30 comp rx=0 tx=0).stop 2023-12-07T16:25:27.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.020+0000 7fc1b99d1700 1 -- 172.21.15.63:0/2912031925 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b4071b60 msgr2=0x7fc1b410fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:27.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.020+0000 7fc1b99d1700 1 --2- 172.21.15.63:0/2912031925 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b4071b60 0x7fc1b410fcd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400c830 tx=0x7fc1a4004470 comp rx=0 tx=0).stop 2023-12-07T16:25:27.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.020+0000 7fc1b99d1700 1 -- 172.21.15.63:0/2912031925 shutdown_connections 2023-12-07T16:25:27.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.020+0000 7fc1b99d1700 1 --2- 172.21.15.63:0/2912031925 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fc19c06ce70 0x7fc19c06f320 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:27.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.020+0000 7fc1b99d1700 1 --2- 172.21.15.63:0/2912031925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1b4070510 0x7fc1b410f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:27.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.020+0000 7fc1b99d1700 1 --2- 172.21.15.63:0/2912031925 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b4071b60 0x7fc1b410fcd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:27.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.020+0000 7fc1b99d1700 1 -- 172.21.15.63:0/2912031925 >> 172.21.15.63:0/2912031925 conn(0x7fc1b40f82d0 msgr2=0x7fc1b40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:25:27.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.020+0000 7fc1b99d1700 1 -- 172.21.15.63:0/2912031925 shutdown_connections 2023-12-07T16:25:27.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.020+0000 7fc1b99d1700 1 -- 172.21.15.63:0/2912031925 wait complete. 2023-12-07T16:25:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.122+0000 7f2fe6d4f700 1 -- 172.21.15.63:0/1574077549 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fe00fde00 msgr2=0x7f2fe00fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.122+0000 7f2fe6d4f700 1 --2- 172.21.15.63:0/1574077549 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fe00fde00 0x7f2fe00fe250 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc004940 tx=0x7f2fcc009e30 comp rx=0 tx=0).stop 2023-12-07T16:25:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.122+0000 7f2fe6d4f700 1 -- 172.21.15.63:0/1574077549 shutdown_connections 2023-12-07T16:25:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.122+0000 7f2fe6d4f700 1 --2- 172.21.15.63:0/1574077549 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fe00fde00 0x7f2fe00fe250 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.123+0000 7f2fe6d4f700 1 --2- 172.21.15.63:0/1574077549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fe00fcbf0 0x7f2fe00fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.123+0000 7f2fe6d4f700 1 -- 172.21.15.63:0/1574077549 >> 172.21.15.63:0/1574077549 conn(0x7f2fe00f82d0 msgr2=0x7f2fe00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:25:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.123+0000 7f2fe6d4f700 1 -- 172.21.15.63:0/1574077549 shutdown_connections 2023-12-07T16:25:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.123+0000 7f2fe6d4f700 1 -- 172.21.15.63:0/1574077549 wait complete. 2023-12-07T16:25:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.123+0000 7f2fe6d4f700 1 Processor -- start 2023-12-07T16:25:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.123+0000 7f2fe6d4f700 1 -- start start 2023-12-07T16:25:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.123+0000 7f2fe6d4f700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fe00fcbf0 0x7f2fe010d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.123+0000 7f2fe6d4f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fe00fde00 0x7f2fe010daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.123+0000 7f2fe6d4f700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe010e0a0 con 0x7f2fe00fcbf0 2023-12-07T16:25:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.123+0000 7f2fe6d4f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe010e940 con 0x7f2fe00fde00 2023-12-07T16:25:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.124+0000 7f2fe4aeb700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fe00fcbf0 0x7f2fe010d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.124+0000 7f2fe4aeb700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fe00fcbf0 0x7f2fe010d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37472/0 (socket says 172.21.15.63:37472) 2023-12-07T16:25:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.124+0000 7f2fe4aeb700 1 -- 172.21.15.63:0/2658656425 learned_addr learned my addr 172.21.15.63:0/2658656425 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:25:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.124+0000 7f2fdffff700 1 --2- 172.21.15.63:0/2658656425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fe00fde00 0x7f2fe010daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.124+0000 7f2fe4aeb700 1 -- 172.21.15.63:0/2658656425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fe00fde00 msgr2=0x7f2fe010daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.124+0000 7f2fe4aeb700 1 --2- 172.21.15.63:0/2658656425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fe00fde00 0x7f2fe010daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.124+0000 7f2fe4aeb700 1 -- 172.21.15.63:0/2658656425 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fcc005040 con 0x7f2fe00fcbf0 2023-12-07T16:25:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.124+0000 7f2fe4aeb700 1 --2- 172.21.15.63:0/2658656425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fe00fcbf0 0x7f2fe010d560 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4002a50 tx=0x7f2fd4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:25:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.124+0000 7f2fdd7fa700 1 -- 172.21.15.63:0/2658656425 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fd4007cc0 con 0x7f2fe00fcbf0 2023-12-07T16:25:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.124+0000 7f2fe6d4f700 1 -- 172.21.15.63:0/2658656425 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe010ec20 con 0x7f2fe00fcbf0 2023-12-07T16:25:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.124+0000 7f2fdd7fa700 1 -- 172.21.15.63:0/2658656425 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2fd400f040 con 0x7f2fe00fcbf0 2023-12-07T16:25:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.124+0000 7f2fdd7fa700 1 -- 172.21.15.63:0/2658656425 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fd400d8d0 con 0x7f2fe00fcbf0 2023-12-07T16:25:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.124+0000 7f2fe6d4f700 1 -- 172.21.15.63:0/2658656425 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe010f160 con 0x7f2fe00fcbf0 2023-12-07T16:25:27.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.125+0000 7f2fe6d4f700 1 -- 172.21.15.63:0/2658656425 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe004bb80 con 0x7f2fe00fcbf0 2023-12-07T16:25:27.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.126+0000 7f2fdd7fa700 1 -- 172.21.15.63:0/2658656425 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f2fd400db40 con 0x7f2fe00fcbf0 2023-12-07T16:25:27.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.126+0000 7f2fdd7fa700 1 --2- 172.21.15.63:0/2658656425 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f2fd006ce60 0x7f2fd006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:27.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.126+0000 7f2fdd7fa700 1 -- 172.21.15.63:0/2658656425 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f2fd408c1d0 con 0x7f2fe00fcbf0 2023-12-07T16:25:27.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.126+0000 7f2fdffff700 1 --2- 172.21.15.63:0/2658656425 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f2fd006ce60 0x7f2fd006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:27.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.127+0000 7f2fdffff700 1 --2- 172.21.15.63:0/2658656425 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f2fd006ce60 0x7f2fd006f310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00b3b0 tx=0x7f2fcc009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:25:27.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.131+0000 7f2fdd7fa700 1 -- 172.21.15.63:0/2658656425 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2fd40599e0 con 0x7f2fe00fcbf0 2023-12-07T16:25:27.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:26 smithi063 ceph-mon[192008]: pgmap v116: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:27.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:26 smithi063 ceph-mon[192008]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:25:27.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:26 smithi063 ceph-mon[192008]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:25:27.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:26 smithi063 ceph-mon[192008]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/360 objects degraded (1.111%), 1 pg degraded) 2023-12-07T16:25:27.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:26 smithi152 ceph-mon[175645]: pgmap v116: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:27.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:26 smithi152 ceph-mon[175645]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:25:27.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:26 smithi152 ceph-mon[175645]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:25:27.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:26 smithi152 ceph-mon[175645]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/360 objects degraded (1.111%), 1 pg degraded) 2023-12-07T16:25:27.411 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.413+0000 7f2fe6d4f700 1 -- 172.21.15.63:0/2658656425 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2fe010f510 con 0x7f2fe00fcbf0 2023-12-07T16:25:27.411 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.413+0000 7f2fdd7fa700 1 -- 172.21.15.63:0/2658656425 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f2fd4059570 con 0x7f2fe00fcbf0 2023-12-07T16:25:27.412 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:25:27.412 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-07T16:25:27.412 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-07T16:25:27.412 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:25:27.412 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-07T16:25:27.412 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-07T16:25:27.412 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:25:27.412 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-07T16:25:27.412 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 2, 2023-12-07T16:25:27.412 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 4 2023-12-07T16:25:27.412 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:25:27.412 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-07T16:25:27.412 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 4 2023-12-07T16:25:27.412 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:25:27.412 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-07T16:25:27.413 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 6, 2023-12-07T16:25:27.413 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 8 2023-12-07T16:25:27.413 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-07T16:25:27.413 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:25:27.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.415+0000 7f2fe6d4f700 1 -- 172.21.15.63:0/2658656425 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f2fd006ce60 msgr2=0x7f2fd006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:27.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.415+0000 7f2fe6d4f700 1 --2- 172.21.15.63:0/2658656425 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f2fd006ce60 0x7f2fd006f310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00b3b0 tx=0x7f2fcc009e30 comp rx=0 tx=0).stop 2023-12-07T16:25:27.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.415+0000 7f2fe6d4f700 1 -- 172.21.15.63:0/2658656425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fe00fcbf0 msgr2=0x7f2fe010d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:27.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.415+0000 7f2fe6d4f700 1 --2- 172.21.15.63:0/2658656425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fe00fcbf0 0x7f2fe010d560 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4002a50 tx=0x7f2fd4004600 comp rx=0 tx=0).stop 2023-12-07T16:25:27.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.416+0000 7f2fe6d4f700 1 -- 172.21.15.63:0/2658656425 shutdown_connections 2023-12-07T16:25:27.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.416+0000 7f2fe6d4f700 1 --2- 172.21.15.63:0/2658656425 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f2fd006ce60 0x7f2fd006f310 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:27.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.416+0000 7f2fe6d4f700 1 --2- 172.21.15.63:0/2658656425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fe00fcbf0 0x7f2fe010d560 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:27.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.416+0000 7f2fe6d4f700 1 --2- 172.21.15.63:0/2658656425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fe00fde00 0x7f2fe010daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:27.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.416+0000 7f2fe6d4f700 1 -- 172.21.15.63:0/2658656425 >> 172.21.15.63:0/2658656425 conn(0x7f2fe00f82d0 msgr2=0x7f2fe0101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:25:27.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.416+0000 7f2fe6d4f700 1 -- 172.21.15.63:0/2658656425 shutdown_connections 2023-12-07T16:25:27.415 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.416+0000 7f2fe6d4f700 1 -- 172.21.15.63:0/2658656425 wait complete. 2023-12-07T16:25:27.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.519+0000 7f989d289700 1 -- 172.21.15.63:0/3495226200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9898100050 msgr2=0x7f9898102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:27.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.519+0000 7f989d289700 1 --2- 172.21.15.63:0/3495226200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9898100050 0x7f9898102430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f988c004940 tx=0x7f988c009e30 comp rx=0 tx=0).stop 2023-12-07T16:25:27.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.519+0000 7f989d289700 1 -- 172.21.15.63:0/3495226200 shutdown_connections 2023-12-07T16:25:27.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.519+0000 7f989d289700 1 --2- 172.21.15.63:0/3495226200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9898100050 0x7f9898102430 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:27.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.519+0000 7f989d289700 1 --2- 172.21.15.63:0/3495226200 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98980fd730 0x7f98980ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:27.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.520+0000 7f989d289700 1 -- 172.21.15.63:0/3495226200 >> 172.21.15.63:0/3495226200 conn(0x7f98980f71d0 msgr2=0x7f98980f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:25:27.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.520+0000 7f989d289700 1 -- 172.21.15.63:0/3495226200 shutdown_connections 2023-12-07T16:25:27.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.520+0000 7f989d289700 1 -- 172.21.15.63:0/3495226200 wait complete. 2023-12-07T16:25:27.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.520+0000 7f989d289700 1 Processor -- start 2023-12-07T16:25:27.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.520+0000 7f989d289700 1 -- start start 2023-12-07T16:25:27.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.520+0000 7f989d289700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98980fd730 0x7f989810d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:27.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.520+0000 7f989d289700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9898100050 0x7f989810da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:27.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.520+0000 7f989d289700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989810e060 con 0x7f98980fd730 2023-12-07T16:25:27.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.520+0000 7f989d289700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989810e900 con 0x7f9898100050 2023-12-07T16:25:27.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.521+0000 7f9896ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98980fd730 0x7f989810d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:27.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.521+0000 7f9896ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98980fd730 0x7f989810d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37486/0 (socket says 172.21.15.63:37486) 2023-12-07T16:25:27.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.521+0000 7f9896ffd700 1 -- 172.21.15.63:0/3043085555 learned_addr learned my addr 172.21.15.63:0/3043085555 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:25:27.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.521+0000 7f98967fc700 1 --2- 172.21.15.63:0/3043085555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9898100050 0x7f989810da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:27.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.521+0000 7f9896ffd700 1 -- 172.21.15.63:0/3043085555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9898100050 msgr2=0x7f989810da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:27.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.521+0000 7f9896ffd700 1 --2- 172.21.15.63:0/3043085555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9898100050 0x7f989810da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:27.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.521+0000 7f9896ffd700 1 -- 172.21.15.63:0/3043085555 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988c005040 con 0x7f98980fd730 2023-12-07T16:25:27.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.521+0000 7f9896ffd700 1 --2- 172.21.15.63:0/3043085555 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98980fd730 0x7f989810d520 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f988800c8c0 tx=0x7f98880044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:25:27.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.521+0000 7f987f7fe700 1 -- 172.21.15.63:0/3043085555 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f988800a760 con 0x7f98980fd730 2023-12-07T16:25:27.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.521+0000 7f989d289700 1 -- 172.21.15.63:0/3043085555 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989810ebe0 con 0x7f98980fd730 2023-12-07T16:25:27.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.521+0000 7f987f7fe700 1 -- 172.21.15.63:0/3043085555 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f988800ad70 con 0x7f98980fd730 2023-12-07T16:25:27.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.521+0000 7f987f7fe700 1 -- 172.21.15.63:0/3043085555 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98880113a0 con 0x7f98980fd730 2023-12-07T16:25:27.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.521+0000 7f989d289700 1 -- 172.21.15.63:0/3043085555 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989810f120 con 0x7f98980fd730 2023-12-07T16:25:27.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.522+0000 7f989d289700 1 -- 172.21.15.63:0/3043085555 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98981075c0 con 0x7f98980fd730 2023-12-07T16:25:27.522 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.523+0000 7f987f7fe700 1 -- 172.21.15.63:0/3043085555 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f9888012400 con 0x7f98980fd730 2023-12-07T16:25:27.522 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.523+0000 7f987f7fe700 1 --2- 172.21.15.63:0/3043085555 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f988006ce60 0x7f988006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:27.522 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.523+0000 7f987f7fe700 1 -- 172.21.15.63:0/3043085555 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f988808c470 con 0x7f98980fd730 2023-12-07T16:25:27.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.523+0000 7f98967fc700 1 --2- 172.21.15.63:0/3043085555 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f988006ce60 0x7f988006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:27.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.524+0000 7f98967fc700 1 --2- 172.21.15.63:0/3043085555 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f988006ce60 0x7f988006f310 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f988c004890 tx=0x7f988c009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:25:27.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.528+0000 7f987f7fe700 1 -- 172.21.15.63:0/3043085555 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9888059d00 con 0x7f98980fd730 2023-12-07T16:25:27.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.772+0000 7f989d289700 1 -- 172.21.15.63:0/3043085555 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f989804bb80 con 0x7f98980fd730 2023-12-07T16:25:27.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.773+0000 7f987f7fe700 1 -- 172.21.15.63:0/3043085555 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1891 (secure 0 0 0) 0x7f9888059890 con 0x7f98980fd730 2023-12-07T16:25:27.771 INFO:teuthology.orchestra.run.smithi063.stdout:e17 2023-12-07T16:25:27.771 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-07T16:25:27.771 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:25:27.771 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-07T16:25:27.772 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:25:27.772 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-07T16:25:27.772 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-07T16:25:27.772 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 17 2023-12-07T16:25:27.772 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-07T16:25:27.772 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-07T16:19:08.352640+0000 2023-12-07T16:25:27.772 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-07T16:22:27.604525+0000 2023-12-07T16:25:27.772 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-07T16:25:27.772 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-07T16:25:27.772 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-07T16:25:27.772 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-07T16:25:27.772 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-07T16:25:27.772 INFO:teuthology.orchestra.run.smithi063.stdout:max_xattr_size 65536 2023-12-07T16:25:27.772 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-07T16:25:27.772 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-07T16:25:27.773 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 45 2023-12-07T16:25:27.773 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:25:27.773 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 2 2023-12-07T16:25:27.773 INFO:teuthology.orchestra.run.smithi063.stdout:in 0,1 2023-12-07T16:25:27.773 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14478,1=24269} 2023-12-07T16:25:27.773 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-07T16:25:27.773 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-07T16:25:27.773 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-07T16:25:27.773 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-07T16:25:27.773 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-07T16:25:27.773 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-07T16:25:27.773 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-07T16:25:27.773 INFO:teuthology.orchestra.run.smithi063.stdout:bal_rank_mask -1 2023-12-07T16:25:27.773 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-07T16:25:27.774 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.yidolg{0:14478} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:25:27.774 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.mrvngf{1:24269} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.152:6824/3157779064,v1:172.21.15.152:6825/3157779064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:25:27.774 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:25:27.774 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:25:27.774 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-07T16:25:27.774 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:25:27.774 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.gsjgcq{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/3063200414,v1:172.21.15.63:6827/3063200414] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:25:27.774 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.aovwwd{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/2906349729,v1:172.21.15.152:6827/2906349729] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:25:27.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.775+0000 7f989d289700 1 -- 172.21.15.63:0/3043085555 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f988006ce60 msgr2=0x7f988006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:27.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.775+0000 7f989d289700 1 --2- 172.21.15.63:0/3043085555 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f988006ce60 0x7f988006f310 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f988c004890 tx=0x7f988c009e30 comp rx=0 tx=0).stop 2023-12-07T16:25:27.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.775+0000 7f989d289700 1 -- 172.21.15.63:0/3043085555 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98980fd730 msgr2=0x7f989810d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:27.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.775+0000 7f989d289700 1 --2- 172.21.15.63:0/3043085555 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98980fd730 0x7f989810d520 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f988800c8c0 tx=0x7f98880044c0 comp rx=0 tx=0).stop 2023-12-07T16:25:27.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.775+0000 7f989d289700 1 -- 172.21.15.63:0/3043085555 shutdown_connections 2023-12-07T16:25:27.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.775+0000 7f989d289700 1 --2- 172.21.15.63:0/3043085555 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f988006ce60 0x7f988006f310 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:27.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.775+0000 7f989d289700 1 --2- 172.21.15.63:0/3043085555 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98980fd730 0x7f989810d520 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:27.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.775+0000 7f989d289700 1 --2- 172.21.15.63:0/3043085555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9898100050 0x7f989810da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:27.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.775+0000 7f989d289700 1 -- 172.21.15.63:0/3043085555 >> 172.21.15.63:0/3043085555 conn(0x7f98980f71d0 msgr2=0x7f98980f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:25:27.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.775+0000 7f989d289700 1 -- 172.21.15.63:0/3043085555 shutdown_connections 2023-12-07T16:25:27.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.775+0000 7f989d289700 1 -- 172.21.15.63:0/3043085555 wait complete. 2023-12-07T16:25:27.776 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2023-12-07T16:25:27.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.879+0000 7f8c3d0c1700 1 -- 172.21.15.63:0/3484505457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c380fcbf0 msgr2=0x7f8c380fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:27.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.879+0000 7f8c3d0c1700 1 --2- 172.21.15.63:0/3484505457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c380fcbf0 0x7f8c380fd000 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8c28004940 tx=0x7f8c28009e30 comp rx=0 tx=0).stop 2023-12-07T16:25:27.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.879+0000 7f8c3d0c1700 1 -- 172.21.15.63:0/3484505457 shutdown_connections 2023-12-07T16:25:27.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.879+0000 7f8c3d0c1700 1 --2- 172.21.15.63:0/3484505457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c380fde00 0x7f8c380fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:27.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.879+0000 7f8c3d0c1700 1 --2- 172.21.15.63:0/3484505457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c380fcbf0 0x7f8c380fd000 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:27.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.879+0000 7f8c3d0c1700 1 -- 172.21.15.63:0/3484505457 >> 172.21.15.63:0/3484505457 conn(0x7f8c380f82d0 msgr2=0x7f8c380fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:25:27.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.880+0000 7f8c3d0c1700 1 -- 172.21.15.63:0/3484505457 shutdown_connections 2023-12-07T16:25:27.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.880+0000 7f8c3d0c1700 1 -- 172.21.15.63:0/3484505457 wait complete. 2023-12-07T16:25:27.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.880+0000 7f8c3d0c1700 1 Processor -- start 2023-12-07T16:25:27.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.880+0000 7f8c3d0c1700 1 -- start start 2023-12-07T16:25:27.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.880+0000 7f8c3d0c1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c380fcbf0 0x7f8c3810d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:27.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.880+0000 7f8c3d0c1700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c380fde00 0x7f8c3810dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:27.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.880+0000 7f8c3d0c1700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3810e170 con 0x7f8c380fde00 2023-12-07T16:25:27.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.880+0000 7f8c3d0c1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3810e9b0 con 0x7f8c380fcbf0 2023-12-07T16:25:27.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.880+0000 7f8c3659c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c380fde00 0x7f8c3810dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:27.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.881+0000 7f8c3659c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c380fde00 0x7f8c3810dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37510/0 (socket says 172.21.15.63:37510) 2023-12-07T16:25:27.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.881+0000 7f8c3659c700 1 -- 172.21.15.63:0/2705873502 learned_addr learned my addr 172.21.15.63:0/2705873502 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:25:27.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.881+0000 7f8c36d9d700 1 --2- 172.21.15.63:0/2705873502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c380fcbf0 0x7f8c3810d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:27.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.881+0000 7f8c3659c700 1 -- 172.21.15.63:0/2705873502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c380fcbf0 msgr2=0x7f8c3810d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:27.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.881+0000 7f8c3659c700 1 --2- 172.21.15.63:0/2705873502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c380fcbf0 0x7f8c3810d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:27.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.881+0000 7f8c3659c700 1 -- 172.21.15.63:0/2705873502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c28005040 con 0x7f8c380fde00 2023-12-07T16:25:27.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.881+0000 7f8c3659c700 1 --2- 172.21.15.63:0/2705873502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c380fde00 0x7f8c3810dae0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c00b790 tx=0x7f8c2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:25:27.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.881+0000 7f8c1f7fe700 1 -- 172.21.15.63:0/2705873502 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c2c00f770 con 0x7f8c380fde00 2023-12-07T16:25:27.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.881+0000 7f8c3d0c1700 1 -- 172.21.15.63:0/2705873502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3810ec90 con 0x7f8c380fde00 2023-12-07T16:25:27.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.881+0000 7f8c1f7fe700 1 -- 172.21.15.63:0/2705873502 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8c2c00fd80 con 0x7f8c380fde00 2023-12-07T16:25:27.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.881+0000 7f8c1f7fe700 1 -- 172.21.15.63:0/2705873502 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c2c00d310 con 0x7f8c380fde00 2023-12-07T16:25:27.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.881+0000 7f8c3d0c1700 1 -- 172.21.15.63:0/2705873502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3810f1d0 con 0x7f8c380fde00 2023-12-07T16:25:27.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.882+0000 7f8c3d0c1700 1 -- 172.21.15.63:0/2705873502 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3804bb80 con 0x7f8c380fde00 2023-12-07T16:25:27.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.884+0000 7f8c1f7fe700 1 -- 172.21.15.63:0/2705873502 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f8c2c010420 con 0x7f8c380fde00 2023-12-07T16:25:27.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.884+0000 7f8c1f7fe700 1 --2- 172.21.15.63:0/2705873502 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f8c2006ce60 0x7f8c2006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:27.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.884+0000 7f8c1f7fe700 1 -- 172.21.15.63:0/2705873502 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f8c2c08cac0 con 0x7f8c380fde00 2023-12-07T16:25:27.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.884+0000 7f8c36d9d700 1 --2- 172.21.15.63:0/2705873502 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f8c2006ce60 0x7f8c2006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:27.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.885+0000 7f8c36d9d700 1 --2- 172.21.15.63:0/2705873502 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f8c2006ce60 0x7f8c2006f310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8c28004f90 tx=0x7f8c28009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:25:27.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:27.888+0000 7f8c1f7fe700 1 -- 172.21.15.63:0/2705873502 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f8c2c05a3f0 con 0x7f8c380fde00 2023-12-07T16:25:28.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.106+0000 7f8c3d0c1700 1 -- 172.21.15.63:0/2705873502 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c3810f770 con 0x7f8c2006ce60 2023-12-07T16:25:28.105 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.107+0000 7f8c1f7fe700 1 -- 172.21.15.63:0/2705873502 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f8c3810f770 con 0x7f8c2006ce60 2023-12-07T16:25:28.105 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:25:28.105 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-07T16:25:28.105 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-07T16:25:28.105 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-07T16:25:28.105 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [ 2023-12-07T16:25:28.106 INFO:teuthology.orchestra.run.smithi063.stdout: "crash", 2023-12-07T16:25:28.106 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr", 2023-12-07T16:25:28.106 INFO:teuthology.orchestra.run.smithi063.stdout: "mon" 2023-12-07T16:25:28.106 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2023-12-07T16:25:28.106 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "10/21 daemons upgraded", 2023-12-07T16:25:28.106 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "Currently upgrading osd daemons", 2023-12-07T16:25:28.106 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-07T16:25:28.106 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:25:28.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.109+0000 7f8c3d0c1700 1 -- 172.21.15.63:0/2705873502 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f8c2006ce60 msgr2=0x7f8c2006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:28.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.109+0000 7f8c3d0c1700 1 --2- 172.21.15.63:0/2705873502 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f8c2006ce60 0x7f8c2006f310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8c28004f90 tx=0x7f8c28009e30 comp rx=0 tx=0).stop 2023-12-07T16:25:28.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.109+0000 7f8c3d0c1700 1 -- 172.21.15.63:0/2705873502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c380fde00 msgr2=0x7f8c3810dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:28.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.109+0000 7f8c3d0c1700 1 --2- 172.21.15.63:0/2705873502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c380fde00 0x7f8c3810dae0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c00b790 tx=0x7f8c2c009250 comp rx=0 tx=0).stop 2023-12-07T16:25:28.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.109+0000 7f8c3d0c1700 1 -- 172.21.15.63:0/2705873502 shutdown_connections 2023-12-07T16:25:28.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.109+0000 7f8c3d0c1700 1 --2- 172.21.15.63:0/2705873502 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f8c2006ce60 0x7f8c2006f310 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:28.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.109+0000 7f8c3d0c1700 1 --2- 172.21.15.63:0/2705873502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c380fcbf0 0x7f8c3810d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:28.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.109+0000 7f8c3d0c1700 1 --2- 172.21.15.63:0/2705873502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c380fde00 0x7f8c3810dae0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:28.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.109+0000 7f8c3d0c1700 1 -- 172.21.15.63:0/2705873502 >> 172.21.15.63:0/2705873502 conn(0x7f8c380f82d0 msgr2=0x7f8c38101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:25:28.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.109+0000 7f8c3d0c1700 1 -- 172.21.15.63:0/2705873502 shutdown_connections 2023-12-07T16:25:28.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.109+0000 7f8c3d0c1700 1 -- 172.21.15.63:0/2705873502 wait complete. 2023-12-07T16:25:28.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:27 smithi063 ceph-mon[192008]: from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:25:28.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:27 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/2658656425' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:25:28.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:27 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/3043085555' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:25:28.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.213+0000 7f62967e8700 1 -- 172.21.15.63:0/1402740970 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62900fdf60 msgr2=0x7f62900fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:28.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.213+0000 7f62967e8700 1 --2- 172.21.15.63:0/1402740970 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62900fdf60 0x7f62900fe3b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6280004940 tx=0x7f6280009e30 comp rx=0 tx=0).stop 2023-12-07T16:25:28.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.213+0000 7f62967e8700 1 -- 172.21.15.63:0/1402740970 shutdown_connections 2023-12-07T16:25:28.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.213+0000 7f62967e8700 1 --2- 172.21.15.63:0/1402740970 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62900fdf60 0x7f62900fe3b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:28.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.213+0000 7f62967e8700 1 --2- 172.21.15.63:0/1402740970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62900faed0 0x7f62900fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:28.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.213+0000 7f62967e8700 1 -- 172.21.15.63:0/1402740970 >> 172.21.15.63:0/1402740970 conn(0x7f62900f6950 msgr2=0x7f62900f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:25:28.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.213+0000 7f62967e8700 1 -- 172.21.15.63:0/1402740970 shutdown_connections 2023-12-07T16:25:28.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.213+0000 7f62967e8700 1 -- 172.21.15.63:0/1402740970 wait complete. 2023-12-07T16:25:28.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.213+0000 7f62967e8700 1 Processor -- start 2023-12-07T16:25:28.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.214+0000 7f62967e8700 1 -- start start 2023-12-07T16:25:28.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.214+0000 7f62967e8700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62900faed0 0x7f62900fd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:28.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.214+0000 7f62967e8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62900fdf60 0x7f62900fbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:28.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.214+0000 7f62967e8700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62900fc470 con 0x7f62900faed0 2023-12-07T16:25:28.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.214+0000 7f62967e8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62900fc5e0 con 0x7f62900fdf60 2023-12-07T16:25:28.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.214+0000 7f628ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62900faed0 0x7f62900fd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:28.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.214+0000 7f628ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62900faed0 0x7f62900fd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37532/0 (socket says 172.21.15.63:37532) 2023-12-07T16:25:28.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.214+0000 7f628ffff700 1 -- 172.21.15.63:0/2226876592 learned_addr learned my addr 172.21.15.63:0/2226876592 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:25:28.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.214+0000 7f628f7fe700 1 --2- 172.21.15.63:0/2226876592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62900fdf60 0x7f62900fbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:28.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.214+0000 7f628ffff700 1 -- 172.21.15.63:0/2226876592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62900fdf60 msgr2=0x7f62900fbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:28.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.214+0000 7f628ffff700 1 --2- 172.21.15.63:0/2226876592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62900fdf60 0x7f62900fbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:28.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.214+0000 7f628ffff700 1 -- 172.21.15.63:0/2226876592 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6280005040 con 0x7f62900faed0 2023-12-07T16:25:28.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.214+0000 7f628f7fe700 1 --2- 172.21.15.63:0/2226876592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62900fdf60 0x7f62900fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T16:25:28.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.214+0000 7f628ffff700 1 --2- 172.21.15.63:0/2226876592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62900faed0 0x7f62900fd9f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6278002a80 tx=0x7f6278004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:25:28.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.214+0000 7f628cff9700 1 -- 172.21.15.63:0/2226876592 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6278007cc0 con 0x7f62900faed0 2023-12-07T16:25:28.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.215+0000 7f628cff9700 1 -- 172.21.15.63:0/2226876592 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f627800f040 con 0x7f62900faed0 2023-12-07T16:25:28.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.215+0000 7f62967e8700 1 -- 172.21.15.63:0/2226876592 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62900fc8c0 con 0x7f62900faed0 2023-12-07T16:25:28.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.215+0000 7f628cff9700 1 -- 172.21.15.63:0/2226876592 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f627800da20 con 0x7f62900faed0 2023-12-07T16:25:28.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.215+0000 7f62967e8700 1 -- 172.21.15.63:0/2226876592 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62901156a0 con 0x7f62900faed0 2023-12-07T16:25:28.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.216+0000 7f62967e8700 1 -- 172.21.15.63:0/2226876592 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62901075f0 con 0x7f62900faed0 2023-12-07T16:25:28.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.216+0000 7f628cff9700 1 -- 172.21.15.63:0/2226876592 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f627800db80 con 0x7f62900faed0 2023-12-07T16:25:28.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.216+0000 7f628cff9700 1 --2- 172.21.15.63:0/2226876592 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f627c06ce70 0x7f627c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:28.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.217+0000 7f628cff9700 1 -- 172.21.15.63:0/2226876592 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f627808c140 con 0x7f62900faed0 2023-12-07T16:25:28.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.217+0000 7f628f7fe700 1 --2- 172.21.15.63:0/2226876592 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f627c06ce70 0x7f627c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:28.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.217+0000 7f628f7fe700 1 --2- 172.21.15.63:0/2226876592 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f627c06ce70 0x7f627c06f320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6280009fd0 tx=0x7f6280009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:25:28.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.221+0000 7f628cff9700 1 -- 172.21.15.63:0/2226876592 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f62780599d0 con 0x7f62900faed0 2023-12-07T16:25:28.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:27 smithi152 ceph-mon[175645]: from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:25:28.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:27 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/2658656425' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:25:28.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:27 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/3043085555' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:25:28.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.504+0000 7f62967e8700 1 -- 172.21.15.63:0/2226876592 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f629002b240 con 0x7f62900faed0 2023-12-07T16:25:28.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.504+0000 7f628cff9700 1 -- 172.21.15.63:0/2226876592 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f6278059560 con 0x7f62900faed0 2023-12-07T16:25:28.502 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-07T16:25:28.502 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-07T16:25:28.503 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-07T16:25:28.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.506+0000 7f62967e8700 1 -- 172.21.15.63:0/2226876592 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f627c06ce70 msgr2=0x7f627c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:28.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.506+0000 7f62967e8700 1 --2- 172.21.15.63:0/2226876592 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f627c06ce70 0x7f627c06f320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6280009fd0 tx=0x7f6280009e30 comp rx=0 tx=0).stop 2023-12-07T16:25:28.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.506+0000 7f62967e8700 1 -- 172.21.15.63:0/2226876592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62900faed0 msgr2=0x7f62900fd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:28.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.506+0000 7f62967e8700 1 --2- 172.21.15.63:0/2226876592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62900faed0 0x7f62900fd9f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6278002a80 tx=0x7f6278004600 comp rx=0 tx=0).stop 2023-12-07T16:25:28.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.506+0000 7f62967e8700 1 -- 172.21.15.63:0/2226876592 shutdown_connections 2023-12-07T16:25:28.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.506+0000 7f62967e8700 1 --2- 172.21.15.63:0/2226876592 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f627c06ce70 0x7f627c06f320 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:28.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.506+0000 7f62967e8700 1 --2- 172.21.15.63:0/2226876592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62900faed0 0x7f62900fd9f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:28.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.506+0000 7f62967e8700 1 --2- 172.21.15.63:0/2226876592 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62900fdf60 0x7f62900fbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:28.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.506+0000 7f62967e8700 1 -- 172.21.15.63:0/2226876592 >> 172.21.15.63:0/2226876592 conn(0x7f62900f6950 msgr2=0x7f62900f8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:25:28.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.506+0000 7f62967e8700 1 -- 172.21.15.63:0/2226876592 shutdown_connections 2023-12-07T16:25:28.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:28.506+0000 7f62967e8700 1 -- 172.21.15.63:0/2226876592 wait complete. 2023-12-07T16:25:29.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:28 smithi063 ceph-mon[192008]: pgmap v117: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:29.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:28 smithi063 ceph-mon[192008]: from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:25:29.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:28 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/2226876592' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:25:29.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:28 smithi152 ceph-mon[175645]: pgmap v117: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:29.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:28 smithi152 ceph-mon[175645]: from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:25:29.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:28 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/2226876592' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:25:30.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:30 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:30.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:30 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:25:30.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:30 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:30.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:30 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:25:31.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:31 smithi063 ceph-mon[192008]: pgmap v118: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:31.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:31 smithi152 ceph-mon[175645]: pgmap v118: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:33.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:33 smithi063 ceph-mon[192008]: pgmap v119: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:33.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:33 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-07T16:25:33.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:33 smithi063 ceph-mon[192008]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-07T16:25:33.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:33 smithi063 ceph-mon[192008]: Upgrade: osd.4 is safe to restart 2023-12-07T16:25:33.285 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:33 smithi152 ceph-mon[175645]: pgmap v119: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:33.285 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:33 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-07T16:25:33.285 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:33 smithi152 ceph-mon[175645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-07T16:25:33.285 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:33 smithi152 ceph-mon[175645]: Upgrade: osd.4 is safe to restart 2023-12-07T16:25:34.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:34 smithi152 ceph-mon[175645]: Upgrade: Updating osd.4 2023-12-07T16:25:34.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:34 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:34.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:34 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-07T16:25:34.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:34 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:25:34.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:34 smithi152 ceph-mon[175645]: Deploying daemon osd.4 on smithi152 2023-12-07T16:25:34.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:34 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:35.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:34 smithi063 ceph-mon[192008]: Upgrade: Updating osd.4 2023-12-07T16:25:35.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:34 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:35.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:34 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-07T16:25:35.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:34 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:25:35.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:34 smithi063 ceph-mon[192008]: Deploying daemon osd.4 on smithi152 2023-12-07T16:25:35.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:34 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:35.948 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:35 smithi152 ceph-mon[175645]: pgmap v120: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:35.948 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:25:35 smithi152 systemd[1]: Stopping Ceph osd.4 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:25:36.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:35 smithi063 ceph-mon[192008]: pgmap v120: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:36.242 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:25:35 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-4[135885]: 2023-12-07T16:25:35.949+0000 7ff06e7ab700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-07T16:25:36.242 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:25:35 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-4[135885]: 2023-12-07T16:25:35.949+0000 7ff06e7ab700 -1 osd.4 81 *** Got signal Terminated *** 2023-12-07T16:25:36.242 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:25:35 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-4[135885]: 2023-12-07T16:25:35.949+0000 7ff06e7ab700 -1 osd.4 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-07T16:25:36.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:36 smithi152 ceph-mon[175645]: osd.4 marked itself down and dead 2023-12-07T16:25:37.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:36 smithi063 ceph-mon[192008]: osd.4 marked itself down and dead 2023-12-07T16:25:37.690 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:25:37 smithi152 bash[194215]: ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-4 2023-12-07T16:25:37.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:37 smithi152 ceph-mon[175645]: pgmap v121: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:37.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:37 smithi152 ceph-mon[175645]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-07T16:25:37.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:37 smithi152 ceph-mon[175645]: osdmap e82: 6 total, 5 up, 6 in 2023-12-07T16:25:37.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:37 smithi152 ceph-mon[175645]: failed to encode map e82 with expected crc 2023-12-07T16:25:37.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:37 smithi152 ceph-mon[175645]: failed to encode map e82 with expected crc 2023-12-07T16:25:37.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:37 smithi152 ceph-mon[175645]: failed to encode map e82 with expected crc 2023-12-07T16:25:38.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:37 smithi063 ceph-mon[192008]: pgmap v121: 65 pgs: 65 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:38.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:37 smithi063 ceph-mon[192008]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-07T16:25:38.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:37 smithi063 ceph-mon[192008]: osdmap e82: 6 total, 5 up, 6 in 2023-12-07T16:25:38.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:37 smithi063 ceph-mon[192008]: failed to encode map e82 with expected crc 2023-12-07T16:25:38.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:37 smithi063 ceph-mon[192008]: failed to encode map e82 with expected crc 2023-12-07T16:25:38.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:37 smithi063 ceph-mon[192008]: failed to encode map e82 with expected crc 2023-12-07T16:25:38.898 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:25:38 smithi152 systemd[1]: ceph-8c493298-951b-11ee-95a2-87774f69a715@osd.4.service: Succeeded. 2023-12-07T16:25:38.898 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:25:38 smithi152 systemd[1]: Stopped Ceph osd.4 for 8c493298-951b-11ee-95a2-87774f69a715. 2023-12-07T16:25:38.898 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:25:38 smithi152 systemd[1]: Starting Ceph osd.4 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:25:38.899 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:38 smithi152 ceph-mon[175645]: failed to encode map e83 with expected crc 2023-12-07T16:25:38.899 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:38 smithi152 ceph-mon[175645]: osdmap e83: 6 total, 5 up, 6 in 2023-12-07T16:25:38.899 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:38 smithi152 ceph-mon[175645]: failed to encode map e83 with expected crc 2023-12-07T16:25:38.899 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:38 smithi152 ceph-mon[175645]: failed to encode map e83 with expected crc 2023-12-07T16:25:39.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:38 smithi063 ceph-mon[192008]: failed to encode map e83 with expected crc 2023-12-07T16:25:39.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:38 smithi063 ceph-mon[192008]: osdmap e83: 6 total, 5 up, 6 in 2023-12-07T16:25:39.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:38 smithi063 ceph-mon[192008]: failed to encode map e83 with expected crc 2023-12-07T16:25:39.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:38 smithi063 ceph-mon[192008]: failed to encode map e83 with expected crc 2023-12-07T16:25:39.702 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:25:39 smithi152 bash[194485]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-07T16:25:39.702 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:25:39 smithi152 bash[194485]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-07T16:25:39.702 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:25:39 smithi152 bash[194485]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-07T16:25:39.702 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:25:39 smithi152 bash[194485]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-07T16:25:39.702 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:25:39 smithi152 bash[194485]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2023-12-07T16:25:39.703 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:25:39 smithi152 bash[194485]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-07T16:25:39.703 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:25:39 smithi152 bash[194485]: --> ceph-volume raw activate successful for osd ID: 4 2023-12-07T16:25:39.976 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:39 smithi152 ceph-mon[175645]: pgmap v124: 65 pgs: 5 stale+active+clean, 60 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:40.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:39 smithi063 ceph-mon[192008]: pgmap v124: 65 pgs: 5 stale+active+clean, 60 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:40.242 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:25:40 smithi152 ceph-osd[194798]: -- 172.21.15.152:0/3211308547 <== mon.1 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55816cbaf1e0 con 0x55816cb7ec00 2023-12-07T16:25:40.242 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:25:40 smithi152 bash[194762]: 98e6e6e3a58ee2755da44fb5e2f67c9565e1d4ba1daf075c78442a1cbb346ad2 2023-12-07T16:25:40.242 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:25:40 smithi152 systemd[1]: Started Ceph osd.4 for 8c493298-951b-11ee-95a2-87774f69a715. 2023-12-07T16:25:40.992 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:25:40 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-4[194776]: 2023-12-07T16:25:40.595+0000 7ff4c4c1d640 -1 Falling back to public interface 2023-12-07T16:25:41.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:41 smithi063 ceph-mon[192008]: pgmap v125: 65 pgs: 12 active+undersized, 12 active+undersized+degraded, 1 stale+active+clean, 40 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 49/360 objects degraded (13.611%) 2023-12-07T16:25:41.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:41 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:41.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:41 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:41.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:41 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:25:41.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:41 smithi063 ceph-mon[192008]: Health check failed: Degraded data redundancy: 49/360 objects degraded (13.611%), 12 pgs degraded (PG_DEGRADED) 2023-12-07T16:25:41.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:41 smithi152 ceph-mon[175645]: pgmap v125: 65 pgs: 12 active+undersized, 12 active+undersized+degraded, 1 stale+active+clean, 40 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 49/360 objects degraded (13.611%) 2023-12-07T16:25:41.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:41 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:41.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:41 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:41.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:41 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:25:41.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:41 smithi152 ceph-mon[175645]: Health check failed: Degraded data redundancy: 49/360 objects degraded (13.611%), 12 pgs degraded (PG_DEGRADED) 2023-12-07T16:25:43.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:42 smithi063 ceph-mon[192008]: pgmap v126: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2023-12-07T16:25:43.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:42 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:43.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:42 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:43.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:42 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:43.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:42 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:43.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:42 smithi152 ceph-mon[175645]: pgmap v126: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2023-12-07T16:25:43.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:42 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:43.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:42 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:43.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:42 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:43.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:42 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:45.103 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:45 smithi152 ceph-mon[175645]: pgmap v127: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2023-12-07T16:25:45.104 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:45 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:45.104 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:45 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:25:45.319 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:45 smithi063 ceph-mon[192008]: pgmap v127: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2023-12-07T16:25:45.319 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:45 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:45.319 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:45 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:25:45.492 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:25:45 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-4[194776]: 2023-12-07T16:25:45.172+0000 7ff4c4c1d640 -1 osd.4 0 read_superblock omap replica is missing. 2023-12-07T16:25:45.992 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:25:45 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-4[194776]: 2023-12-07T16:25:45.722+0000 7ff4c4c1d640 -1 osd.4 81 log_to_monitors true 2023-12-07T16:25:46.492 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:25:46 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-4[194776]: 2023-12-07T16:25:46.201+0000 7ff4b2086700 -1 osd.4 81 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T16:25:46.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:46 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:46.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:46 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:46.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:46 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:25:46.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:46 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:25:46.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:46 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:46.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:46 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:25:46.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:46 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:25:46.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:46 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:25:46.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:46 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:25:46.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:46 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-07T16:25:46.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:46 smithi152 ceph-mon[175645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-07T16:25:46.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:46 smithi152 ceph-mon[175645]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2023-12-07T16:25:46.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:46 smithi152 ceph-mon[175645]: from='osd.4 [v2:172.21.15.152:6808/2649809826,v1:172.21.15.152:6809/2649809826]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-07T16:25:46.493 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:46 smithi152 ceph-mon[175645]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-07T16:25:46.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:46 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:46.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:46 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:46.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:46 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:25:46.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:46 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:25:46.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:46 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:46.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:46 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:25:46.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:46 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:25:46.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:46 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:25:46.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:46 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:25:46.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:46 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-07T16:25:46.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:46 smithi063 ceph-mon[192008]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-07T16:25:46.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:46 smithi063 ceph-mon[192008]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2023-12-07T16:25:46.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:46 smithi063 ceph-mon[192008]: from='osd.4 [v2:172.21.15.152:6808/2649809826,v1:172.21.15.152:6809/2649809826]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-07T16:25:46.656 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:46 smithi063 ceph-mon[192008]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-07T16:25:47.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:47 smithi152 ceph-mon[175645]: pgmap v128: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2023-12-07T16:25:47.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:47 smithi152 ceph-mon[175645]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-07T16:25:47.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:47 smithi152 ceph-mon[175645]: failed to encode map e84 with expected crc 2023-12-07T16:25:47.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:47 smithi152 ceph-mon[175645]: osdmap e84: 6 total, 5 up, 6 in 2023-12-07T16:25:47.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:47 smithi152 ceph-mon[175645]: from='osd.4 [v2:172.21.15.152:6808/2649809826,v1:172.21.15.152:6809/2649809826]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-07T16:25:47.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:47 smithi152 ceph-mon[175645]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-07T16:25:47.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:47 smithi063 ceph-mon[192008]: pgmap v128: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 308 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2023-12-07T16:25:47.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:47 smithi063 ceph-mon[192008]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-07T16:25:47.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:47 smithi063 ceph-mon[192008]: failed to encode map e84 with expected crc 2023-12-07T16:25:47.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:47 smithi063 ceph-mon[192008]: osdmap e84: 6 total, 5 up, 6 in 2023-12-07T16:25:47.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:47 smithi063 ceph-mon[192008]: from='osd.4 [v2:172.21.15.152:6808/2649809826,v1:172.21.15.152:6809/2649809826]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-07T16:25:47.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:47 smithi063 ceph-mon[192008]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-07T16:25:48.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:48 smithi152 ceph-mon[175645]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-07T16:25:48.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:48 smithi152 ceph-mon[175645]: failed to encode map e85 with expected crc 2023-12-07T16:25:48.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:48 smithi152 ceph-mon[175645]: osd.4 [v2:172.21.15.152:6808/2649809826,v1:172.21.15.152:6809/2649809826] boot 2023-12-07T16:25:48.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:48 smithi152 ceph-mon[175645]: osdmap e85: 6 total, 6 up, 6 in 2023-12-07T16:25:48.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:48 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-07T16:25:48.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:48 smithi152 ceph-mon[175645]: failed to encode map e85 with expected crc 2023-12-07T16:25:48.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:48 smithi152 ceph-mon[175645]: Health check update: Degraded data redundancy: 61/360 objects degraded (16.944%), 16 pgs degraded (PG_DEGRADED) 2023-12-07T16:25:48.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:48 smithi063 ceph-mon[192008]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-07T16:25:48.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:48 smithi063 ceph-mon[192008]: failed to encode map e85 with expected crc 2023-12-07T16:25:48.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:48 smithi063 ceph-mon[192008]: osd.4 [v2:172.21.15.152:6808/2649809826,v1:172.21.15.152:6809/2649809826] boot 2023-12-07T16:25:48.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:48 smithi063 ceph-mon[192008]: osdmap e85: 6 total, 6 up, 6 in 2023-12-07T16:25:48.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:48 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-07T16:25:48.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:48 smithi063 ceph-mon[192008]: failed to encode map e85 with expected crc 2023-12-07T16:25:48.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:48 smithi063 ceph-mon[192008]: Health check update: Degraded data redundancy: 61/360 objects degraded (16.944%), 16 pgs degraded (PG_DEGRADED) 2023-12-07T16:25:49.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:49 smithi152 ceph-mon[175645]: pgmap v131: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2023-12-07T16:25:49.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:49 smithi152 ceph-mon[175645]: osdmap e86: 6 total, 6 up, 6 in 2023-12-07T16:25:49.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:49 smithi152 ceph-mon[175645]: failed to encode map e86 with expected crc 2023-12-07T16:25:49.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:49 smithi152 ceph-mon[175645]: failed to encode map e86 with expected crc 2023-12-07T16:25:49.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:49 smithi063 ceph-mon[192008]: pgmap v131: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 61/360 objects degraded (16.944%) 2023-12-07T16:25:49.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:49 smithi063 ceph-mon[192008]: osdmap e86: 6 total, 6 up, 6 in 2023-12-07T16:25:49.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:49 smithi063 ceph-mon[192008]: failed to encode map e86 with expected crc 2023-12-07T16:25:49.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:49 smithi063 ceph-mon[192008]: failed to encode map e86 with expected crc 2023-12-07T16:25:51.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:51 smithi152 ceph-mon[175645]: pgmap v133: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19/360 objects degraded (5.278%) 2023-12-07T16:25:51.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:51 smithi063 ceph-mon[192008]: pgmap v133: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19/360 objects degraded (5.278%) 2023-12-07T16:25:52.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:52 smithi063 ceph-mon[192008]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 19/360 objects degraded (5.278%), 7 pgs degraded) 2023-12-07T16:25:52.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:52 smithi152 ceph-mon[175645]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 19/360 objects degraded (5.278%), 7 pgs degraded) 2023-12-07T16:25:53.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:53 smithi152 ceph-mon[175645]: pgmap v134: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:54.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:53 smithi063 ceph-mon[192008]: pgmap v134: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:55.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:55 smithi152 ceph-mon[175645]: pgmap v135: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:55.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:55 smithi152 ceph-mon[175645]: fsmap cephfs:2 {0=cephfs.smithi063.yidolg=up:active,1=cephfs.smithi152.mrvngf=up:active} 2 up:standby 2023-12-07T16:25:56.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:55 smithi063 ceph-mon[192008]: pgmap v135: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:56.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:55 smithi063 ceph-mon[192008]: fsmap cephfs:2 {0=cephfs.smithi063.yidolg=up:active,1=cephfs.smithi152.mrvngf=up:active} 2 up:standby 2023-12-07T16:25:57.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:57 smithi152 ceph-mon[175645]: pgmap v136: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:58.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:57 smithi063 ceph-mon[192008]: pgmap v136: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:58.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.626+0000 7f65d821d700 1 -- 172.21.15.63:0/3340680887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65d00fde00 msgr2=0x7f65d00fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:58.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.626+0000 7f65d821d700 1 --2- 172.21.15.63:0/3340680887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65d00fde00 0x7f65d00fe250 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f65c4004940 tx=0x7f65c4009e30 comp rx=0 tx=0).stop 2023-12-07T16:25:58.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.626+0000 7f65d821d700 1 -- 172.21.15.63:0/3340680887 shutdown_connections 2023-12-07T16:25:58.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.626+0000 7f65d821d700 1 --2- 172.21.15.63:0/3340680887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65d00fde00 0x7f65d00fe250 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:58.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.626+0000 7f65d821d700 1 --2- 172.21.15.63:0/3340680887 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65d00fcbf0 0x7f65d00fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:58.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.626+0000 7f65d821d700 1 -- 172.21.15.63:0/3340680887 >> 172.21.15.63:0/3340680887 conn(0x7f65d00f82d0 msgr2=0x7f65d00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:25:58.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.626+0000 7f65d821d700 1 -- 172.21.15.63:0/3340680887 shutdown_connections 2023-12-07T16:25:58.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.626+0000 7f65d821d700 1 -- 172.21.15.63:0/3340680887 wait complete. 2023-12-07T16:25:58.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.626+0000 7f65d821d700 1 Processor -- start 2023-12-07T16:25:58.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.626+0000 7f65d821d700 1 -- start start 2023-12-07T16:25:58.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.626+0000 7f65d821d700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65d00fcbf0 0x7f65d010d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:58.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.626+0000 7f65d821d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65d00fde00 0x7f65d010da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:58.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.626+0000 7f65d821d700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d010e010 con 0x7f65d00fcbf0 2023-12-07T16:25:58.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.626+0000 7f65d821d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d010e8b0 con 0x7f65d00fde00 2023-12-07T16:25:58.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.626+0000 7f65d5fb9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65d00fcbf0 0x7f65d010d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:58.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.626+0000 7f65d5fb9700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65d00fcbf0 0x7f65d010d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38270/0 (socket says 172.21.15.63:38270) 2023-12-07T16:25:58.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.626+0000 7f65d5fb9700 1 -- 172.21.15.63:0/3662766202 learned_addr learned my addr 172.21.15.63:0/3662766202 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:25:58.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.626+0000 7f65d57b8700 1 --2- 172.21.15.63:0/3662766202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65d00fde00 0x7f65d010da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:58.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.626+0000 7f65d5fb9700 1 -- 172.21.15.63:0/3662766202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65d00fde00 msgr2=0x7f65d010da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:58.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.626+0000 7f65d5fb9700 1 --2- 172.21.15.63:0/3662766202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65d00fde00 0x7f65d010da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:58.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.626+0000 7f65d5fb9700 1 -- 172.21.15.63:0/3662766202 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c4005040 con 0x7f65d00fcbf0 2023-12-07T16:25:58.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.626+0000 7f65d5fb9700 1 --2- 172.21.15.63:0/3662766202 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65d00fcbf0 0x7f65d010d4d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f65cc00eb70 tx=0x7f65cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:25:58.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.627+0000 7f65c27fc700 1 -- 172.21.15.63:0/3662766202 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65cc007cc0 con 0x7f65d00fcbf0 2023-12-07T16:25:58.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.627+0000 7f65d821d700 1 -- 172.21.15.63:0/3662766202 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d010eb30 con 0x7f65d00fcbf0 2023-12-07T16:25:58.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.627+0000 7f65c27fc700 1 -- 172.21.15.63:0/3662766202 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f65cc00f040 con 0x7f65d00fcbf0 2023-12-07T16:25:58.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.627+0000 7f65c27fc700 1 -- 172.21.15.63:0/3662766202 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65cc00cad0 con 0x7f65d00fcbf0 2023-12-07T16:25:58.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.627+0000 7f65d821d700 1 -- 172.21.15.63:0/3662766202 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d010f070 con 0x7f65d00fcbf0 2023-12-07T16:25:58.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.628+0000 7f65d821d700 1 -- 172.21.15.63:0/3662766202 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d004bb80 con 0x7f65d00fcbf0 2023-12-07T16:25:58.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.628+0000 7f65c27fc700 1 -- 172.21.15.63:0/3662766202 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f65cc00cc30 con 0x7f65d00fcbf0 2023-12-07T16:25:58.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.629+0000 7f65c27fc700 1 --2- 172.21.15.63:0/3662766202 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f65bc06ce60 0x7f65bc06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:58.630 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.629+0000 7f65c27fc700 1 -- 172.21.15.63:0/3662766202 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f65cc08bf40 con 0x7f65d00fcbf0 2023-12-07T16:25:58.630 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.629+0000 7f65d57b8700 1 --2- 172.21.15.63:0/3662766202 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f65bc06ce60 0x7f65bc06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:58.630 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.629+0000 7f65d57b8700 1 --2- 172.21.15.63:0/3662766202 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f65bc06ce60 0x7f65bc06f310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f65c400b0d0 tx=0x7f65c4009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:25:58.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.634+0000 7f65c27fc700 1 -- 172.21.15.63:0/3662766202 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f65cc0bf2f0 con 0x7f65d00fcbf0 2023-12-07T16:25:58.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.853+0000 7f65d821d700 1 -- 172.21.15.63:0/3662766202 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f65d010f4c0 con 0x7f65bc06ce60 2023-12-07T16:25:58.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.854+0000 7f65c27fc700 1 -- 172.21.15.63:0/3662766202 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f65d010f4c0 con 0x7f65bc06ce60 2023-12-07T16:25:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.856+0000 7f65d821d700 1 -- 172.21.15.63:0/3662766202 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f65bc06ce60 msgr2=0x7f65bc06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.856+0000 7f65d821d700 1 --2- 172.21.15.63:0/3662766202 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f65bc06ce60 0x7f65bc06f310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f65c400b0d0 tx=0x7f65c4009e30 comp rx=0 tx=0).stop 2023-12-07T16:25:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.856+0000 7f65d821d700 1 -- 172.21.15.63:0/3662766202 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65d00fcbf0 msgr2=0x7f65d010d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.856+0000 7f65d821d700 1 --2- 172.21.15.63:0/3662766202 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65d00fcbf0 0x7f65d010d4d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f65cc00eb70 tx=0x7f65cc00b040 comp rx=0 tx=0).stop 2023-12-07T16:25:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.856+0000 7f65d821d700 1 -- 172.21.15.63:0/3662766202 shutdown_connections 2023-12-07T16:25:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.856+0000 7f65d821d700 1 --2- 172.21.15.63:0/3662766202 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f65bc06ce60 0x7f65bc06f310 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.856+0000 7f65d821d700 1 --2- 172.21.15.63:0/3662766202 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65d00fcbf0 0x7f65d010d4d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.856+0000 7f65d821d700 1 --2- 172.21.15.63:0/3662766202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65d00fde00 0x7f65d010da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.856+0000 7f65d821d700 1 -- 172.21.15.63:0/3662766202 >> 172.21.15.63:0/3662766202 conn(0x7f65d00f82d0 msgr2=0x7f65d0101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:25:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.856+0000 7f65d821d700 1 -- 172.21.15.63:0/3662766202 shutdown_connections 2023-12-07T16:25:58.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.856+0000 7f65d821d700 1 -- 172.21.15.63:0/3662766202 wait complete. 2023-12-07T16:25:58.865 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-07T16:25:58.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.961+0000 7f3845f97700 1 -- 172.21.15.63:0/2809240844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38400fcd00 msgr2=0x7f38400fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:58.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.961+0000 7f3845f97700 1 --2- 172.21.15.63:0/2809240844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38400fcd00 0x7f38400fd150 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3828004940 tx=0x7f3828009e30 comp rx=0 tx=0).stop 2023-12-07T16:25:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.961+0000 7f3845f97700 1 -- 172.21.15.63:0/2809240844 shutdown_connections 2023-12-07T16:25:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.961+0000 7f3845f97700 1 --2- 172.21.15.63:0/2809240844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38400fcd00 0x7f38400fd150 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.961+0000 7f3845f97700 1 --2- 172.21.15.63:0/2809240844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38400fbaf0 0x7f38400fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.961+0000 7f3845f97700 1 -- 172.21.15.63:0/2809240844 >> 172.21.15.63:0/2809240844 conn(0x7f38400f7190 msgr2=0x7f38400f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:25:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.961+0000 7f3845f97700 1 -- 172.21.15.63:0/2809240844 shutdown_connections 2023-12-07T16:25:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.961+0000 7f3845f97700 1 -- 172.21.15.63:0/2809240844 wait complete. 2023-12-07T16:25:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.961+0000 7f3845f97700 1 Processor -- start 2023-12-07T16:25:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.962+0000 7f3845f97700 1 -- start start 2023-12-07T16:25:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.962+0000 7f3845f97700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38400fbaf0 0x7f384010d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.962+0000 7f3845f97700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38400fcd00 0x7f384010da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.962+0000 7f3845f97700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384010e010 con 0x7f38400fcd00 2023-12-07T16:25:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.962+0000 7f3845f97700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384010e8b0 con 0x7f38400fbaf0 2023-12-07T16:25:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.962+0000 7f383effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38400fcd00 0x7f384010da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.962+0000 7f383effd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38400fcd00 0x7f384010da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38300/0 (socket says 172.21.15.63:38300) 2023-12-07T16:25:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.962+0000 7f383effd700 1 -- 172.21.15.63:0/1117625960 learned_addr learned my addr 172.21.15.63:0/1117625960 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:25:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.962+0000 7f383f7fe700 1 --2- 172.21.15.63:0/1117625960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38400fbaf0 0x7f384010d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.962+0000 7f383effd700 1 -- 172.21.15.63:0/1117625960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38400fbaf0 msgr2=0x7f384010d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.962+0000 7f383effd700 1 --2- 172.21.15.63:0/1117625960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38400fbaf0 0x7f384010d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.962+0000 7f383effd700 1 -- 172.21.15.63:0/1117625960 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3828005040 con 0x7f38400fcd00 2023-12-07T16:25:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.962+0000 7f383effd700 1 --2- 172.21.15.63:0/1117625960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38400fcd00 0x7f384010da10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3828000c00 tx=0x7f3828009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:25:58.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.963+0000 7f3837fff700 1 -- 172.21.15.63:0/1117625960 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3828021070 con 0x7f38400fcd00 2023-12-07T16:25:58.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.963+0000 7f3845f97700 1 -- 172.21.15.63:0/1117625960 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384010eb30 con 0x7f38400fcd00 2023-12-07T16:25:58.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.963+0000 7f3837fff700 1 -- 172.21.15.63:0/1117625960 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f382801c400 con 0x7f38400fcd00 2023-12-07T16:25:58.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.963+0000 7f3837fff700 1 -- 172.21.15.63:0/1117625960 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f382800e070 con 0x7f38400fcd00 2023-12-07T16:25:58.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.963+0000 7f3845f97700 1 -- 172.21.15.63:0/1117625960 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384010f010 con 0x7f38400fcd00 2023-12-07T16:25:58.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.964+0000 7f3845f97700 1 -- 172.21.15.63:0/1117625960 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f384004bb80 con 0x7f38400fcd00 2023-12-07T16:25:58.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.964+0000 7f3837fff700 1 -- 172.21.15.63:0/1117625960 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f382801c9c0 con 0x7f38400fcd00 2023-12-07T16:25:58.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.965+0000 7f3837fff700 1 --2- 172.21.15.63:0/1117625960 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f382c06ce60 0x7f382c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:58.966 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.965+0000 7f3837fff700 1 -- 172.21.15.63:0/1117625960 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f382808d610 con 0x7f38400fcd00 2023-12-07T16:25:58.966 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.965+0000 7f383f7fe700 1 --2- 172.21.15.63:0/1117625960 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f382c06ce60 0x7f382c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:58.966 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.965+0000 7f383f7fe700 1 --2- 172.21.15.63:0/1117625960 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f382c06ce60 0x7f382c06f310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3830009b80 tx=0x7f383000b040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:25:58.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:58.970+0000 7f3837fff700 1 -- 172.21.15.63:0/1117625960 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f382805aea0 con 0x7f38400fcd00 2023-12-07T16:25:59.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.189+0000 7f3845f97700 1 -- 172.21.15.63:0/1117625960 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f384010f4e0 con 0x7f382c06ce60 2023-12-07T16:25:59.188 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.190+0000 7f3837fff700 1 -- 172.21.15.63:0/1117625960 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f384010f4e0 con 0x7f382c06ce60 2023-12-07T16:25:59.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.192+0000 7f3845f97700 1 -- 172.21.15.63:0/1117625960 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f382c06ce60 msgr2=0x7f382c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:59.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.192+0000 7f3845f97700 1 --2- 172.21.15.63:0/1117625960 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f382c06ce60 0x7f382c06f310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3830009b80 tx=0x7f383000b040 comp rx=0 tx=0).stop 2023-12-07T16:25:59.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.192+0000 7f3845f97700 1 -- 172.21.15.63:0/1117625960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38400fcd00 msgr2=0x7f384010da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:59.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.192+0000 7f3845f97700 1 --2- 172.21.15.63:0/1117625960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38400fcd00 0x7f384010da10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3828000c00 tx=0x7f3828009e30 comp rx=0 tx=0).stop 2023-12-07T16:25:59.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.192+0000 7f3845f97700 1 -- 172.21.15.63:0/1117625960 shutdown_connections 2023-12-07T16:25:59.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.192+0000 7f3845f97700 1 --2- 172.21.15.63:0/1117625960 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f382c06ce60 0x7f382c06f310 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:59.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.192+0000 7f3845f97700 1 --2- 172.21.15.63:0/1117625960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38400fbaf0 0x7f384010d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:59.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.192+0000 7f3845f97700 1 --2- 172.21.15.63:0/1117625960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38400fcd00 0x7f384010da10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:59.192 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.192+0000 7f3845f97700 1 -- 172.21.15.63:0/1117625960 >> 172.21.15.63:0/1117625960 conn(0x7f38400f7190 msgr2=0x7f3840065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:25:59.192 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.192+0000 7f3845f97700 1 -- 172.21.15.63:0/1117625960 shutdown_connections 2023-12-07T16:25:59.192 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.192+0000 7f3845f97700 1 -- 172.21.15.63:0/1117625960 wait complete. 2023-12-07T16:25:59.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.295+0000 7ff119b7a700 1 -- 172.21.15.63:0/1206759064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1140fbaf0 msgr2=0x7ff1140fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:59.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.295+0000 7ff119b7a700 1 --2- 172.21.15.63:0/1206759064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1140fbaf0 0x7ff1140fbf00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff104004940 tx=0x7ff104009e30 comp rx=0 tx=0).stop 2023-12-07T16:25:59.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.295+0000 7ff119b7a700 1 -- 172.21.15.63:0/1206759064 shutdown_connections 2023-12-07T16:25:59.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.295+0000 7ff119b7a700 1 --2- 172.21.15.63:0/1206759064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1140fcd00 0x7ff1140fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:59.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.295+0000 7ff119b7a700 1 --2- 172.21.15.63:0/1206759064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1140fbaf0 0x7ff1140fbf00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:59.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.295+0000 7ff119b7a700 1 -- 172.21.15.63:0/1206759064 >> 172.21.15.63:0/1206759064 conn(0x7ff1140f7190 msgr2=0x7ff1140f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:25:59.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.295+0000 7ff119b7a700 1 -- 172.21.15.63:0/1206759064 shutdown_connections 2023-12-07T16:25:59.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.295+0000 7ff119b7a700 1 -- 172.21.15.63:0/1206759064 wait complete. 2023-12-07T16:25:59.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.296+0000 7ff119b7a700 1 Processor -- start 2023-12-07T16:25:59.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.296+0000 7ff119b7a700 1 -- start start 2023-12-07T16:25:59.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.296+0000 7ff119b7a700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1140fbaf0 0x7ff11410c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:59.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.296+0000 7ff119b7a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1140fcd00 0x7ff11410c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:59.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.296+0000 7ff119b7a700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11410cfc0 con 0x7ff1140fbaf0 2023-12-07T16:25:59.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.296+0000 7ff119b7a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11410d860 con 0x7ff1140fcd00 2023-12-07T16:25:59.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.296+0000 7ff1137fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1140fbaf0 0x7ff11410c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:59.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.296+0000 7ff1137fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1140fbaf0 0x7ff11410c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38322/0 (socket says 172.21.15.63:38322) 2023-12-07T16:25:59.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.296+0000 7ff1137fe700 1 -- 172.21.15.63:0/2214950914 learned_addr learned my addr 172.21.15.63:0/2214950914 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:25:59.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.297+0000 7ff112ffd700 1 --2- 172.21.15.63:0/2214950914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1140fcd00 0x7ff11410c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:59.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.297+0000 7ff1137fe700 1 -- 172.21.15.63:0/2214950914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1140fcd00 msgr2=0x7ff11410c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:59.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.297+0000 7ff1137fe700 1 --2- 172.21.15.63:0/2214950914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1140fcd00 0x7ff11410c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:59.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.297+0000 7ff1137fe700 1 -- 172.21.15.63:0/2214950914 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff104005040 con 0x7ff1140fbaf0 2023-12-07T16:25:59.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.297+0000 7ff112ffd700 1 --2- 172.21.15.63:0/2214950914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1140fcd00 0x7ff11410c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T16:25:59.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.297+0000 7ff1137fe700 1 --2- 172.21.15.63:0/2214950914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1140fbaf0 0x7ff11410c480 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff104004f90 tx=0x7ff104009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:25:59.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.297+0000 7ff0fbfff700 1 -- 172.21.15.63:0/2214950914 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff10400e040 con 0x7ff1140fbaf0 2023-12-07T16:25:59.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.297+0000 7ff119b7a700 1 -- 172.21.15.63:0/2214950914 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff11410dae0 con 0x7ff1140fbaf0 2023-12-07T16:25:59.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.297+0000 7ff0fbfff700 1 -- 172.21.15.63:0/2214950914 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff10401e8d0 con 0x7ff1140fbaf0 2023-12-07T16:25:59.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.297+0000 7ff0fbfff700 1 -- 172.21.15.63:0/2214950914 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff104013780 con 0x7ff1140fbaf0 2023-12-07T16:25:59.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.297+0000 7ff119b7a700 1 -- 172.21.15.63:0/2214950914 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff11410dfc0 con 0x7ff1140fbaf0 2023-12-07T16:25:59.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.298+0000 7ff119b7a700 1 -- 172.21.15.63:0/2214950914 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff11404bb80 con 0x7ff1140fbaf0 2023-12-07T16:25:59.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.299+0000 7ff0fbfff700 1 -- 172.21.15.63:0/2214950914 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7ff10401e420 con 0x7ff1140fbaf0 2023-12-07T16:25:59.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.299+0000 7ff0fbfff700 1 --2- 172.21.15.63:0/2214950914 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7ff0fc06ce60 0x7ff0fc06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:59.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.299+0000 7ff0fbfff700 1 -- 172.21.15.63:0/2214950914 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6761+0+0 (secure 0 0 0) 0x7ff1040904e0 con 0x7ff1140fbaf0 2023-12-07T16:25:59.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.299+0000 7ff112ffd700 1 --2- 172.21.15.63:0/2214950914 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7ff0fc06ce60 0x7ff0fc06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:59.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.300+0000 7ff112ffd700 1 --2- 172.21.15.63:0/2214950914 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7ff0fc06ce60 0x7ff0fc06f310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff108007fd0 tx=0x7ff108009040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:25:59.302 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.304+0000 7ff0fbfff700 1 -- 172.21.15.63:0/2214950914 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff10405dcf0 con 0x7ff1140fbaf0 2023-12-07T16:25:59.508 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.510+0000 7ff119b7a700 1 -- 172.21.15.63:0/2214950914 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff11410e3e0 con 0x7ff0fc06ce60 2023-12-07T16:25:59.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.520+0000 7ff0fbfff700 1 -- 172.21.15.63:0/2214950914 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ff11410e3e0 con 0x7ff0fc06ce60 2023-12-07T16:25:59.519 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-07T16:25:59.519 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (4m) 73s ago 10m 28.6M - 0.25.0 c8568f914cd2 c0526812d5fe 2023-12-07T16:25:59.519 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (2m) 73s ago 10m 7474k - 19.0.0-13-ge6605fb8 104f332cd0a9 52adf44ea983 2023-12-07T16:25:59.519 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi152 smithi152 running (2m) 17s ago 9m 7453k - 19.0.0-13-ge6605fb8 104f332cd0a9 9eba5b538b96 2023-12-07T16:25:59.519 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (4m) 73s ago 10m 91.4M - 9.4.7 954c08fa6188 cc2cde9a664f 2023-12-07T16:25:59.519 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.gsjgcq smithi063 running (6m) 73s ago 6m 15.2M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 f70e4f098e4c 2023-12-07T16:25:59.519 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.yidolg smithi063 running (6m) 73s ago 6m 5932M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5b053ef5fb7f 2023-12-07T16:25:59.519 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.aovwwd smithi152 running (6m) 17s ago 6m 16.2M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 80190948a595 2023-12-07T16:25:59.519 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.mrvngf smithi152 running (6m) 17s ago 6m 5114M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5f60b893f840 2023-12-07T16:25:59.519 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.yohyyx smithi063 *:8443,9283,8765 running (4m) 73s ago 11m 511M - 19.0.0-13-ge6605fb8 104f332cd0a9 b605f882784d 2023-12-07T16:25:59.520 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi152.sxayfb smithi152 *:8443,9283,8765 running (3m) 17s ago 9m 451M - 19.0.0-13-ge6605fb8 104f332cd0a9 71716998ccc3 2023-12-07T16:25:59.520 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (3m) 73s ago 11m 67.3M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 8d7d0c6bfea3 2023-12-07T16:25:59.520 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi152 smithi152 running (3m) 17s ago 9m 55.1M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 883bb3425cf0 2023-12-07T16:25:59.520 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (4m) 73s ago 10m 18.9M - 1.5.0 0da6a335fe13 50d63981f746 2023-12-07T16:25:59.520 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi152 smithi152 *:9100 running (4m) 17s ago 9m 19.8M - 1.5.0 0da6a335fe13 627cda14f1a9 2023-12-07T16:25:59.520 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (2m) 73s ago 9m 189M 1568M 19.0.0-13-ge6605fb8 104f332cd0a9 5fab981f1333 2023-12-07T16:25:59.520 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (105s) 73s ago 8m 121M 1568M 19.0.0-13-ge6605fb8 104f332cd0a9 b78531e6dc96 2023-12-07T16:25:59.520 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (76s) 73s ago 8m 11.5M 1568M 19.0.0-13-ge6605fb8 104f332cd0a9 a473024763f8 2023-12-07T16:25:59.520 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi152 running (47s) 17s ago 8m 123M 2592M 19.0.0-13-ge6605fb8 104f332cd0a9 7c32a746ce82 2023-12-07T16:25:59.520 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi152 running (19s) 17s ago 8m 12.6M 2592M 19.0.0-13-ge6605fb8 104f332cd0a9 98e6e6e3a58e 2023-12-07T16:25:59.520 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi152 running (7m) 17s ago 7m 1068M 2592M 17.2.7-115-g4f62d9ad fcdfd00f81c7 e7f8d9f716bb 2023-12-07T16:25:59.521 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (3m) 73s ago 10m 51.1M - 2.43.0 a07b618ecd1d 8a323520d9fd 2023-12-07T16:25:59.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.522+0000 7ff119b7a700 1 -- 172.21.15.63:0/2214950914 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7ff0fc06ce60 msgr2=0x7ff0fc06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:59.522 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.522+0000 7ff119b7a700 1 --2- 172.21.15.63:0/2214950914 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7ff0fc06ce60 0x7ff0fc06f310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff108007fd0 tx=0x7ff108009040 comp rx=0 tx=0).stop 2023-12-07T16:25:59.522 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.522+0000 7ff119b7a700 1 -- 172.21.15.63:0/2214950914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1140fbaf0 msgr2=0x7ff11410c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:59.522 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.522+0000 7ff119b7a700 1 --2- 172.21.15.63:0/2214950914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1140fbaf0 0x7ff11410c480 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff104004f90 tx=0x7ff104009e30 comp rx=0 tx=0).stop 2023-12-07T16:25:59.522 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.522+0000 7ff119b7a700 1 -- 172.21.15.63:0/2214950914 shutdown_connections 2023-12-07T16:25:59.522 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.522+0000 7ff119b7a700 1 --2- 172.21.15.63:0/2214950914 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7ff0fc06ce60 0x7ff0fc06f310 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:59.522 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.522+0000 7ff119b7a700 1 --2- 172.21.15.63:0/2214950914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1140fbaf0 0x7ff11410c480 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:59.522 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.522+0000 7ff119b7a700 1 --2- 172.21.15.63:0/2214950914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1140fcd00 0x7ff11410c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:59.522 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.522+0000 7ff119b7a700 1 -- 172.21.15.63:0/2214950914 >> 172.21.15.63:0/2214950914 conn(0x7ff1140f7190 msgr2=0x7ff1140fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:25:59.522 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.522+0000 7ff119b7a700 1 -- 172.21.15.63:0/2214950914 shutdown_connections 2023-12-07T16:25:59.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.522+0000 7ff119b7a700 1 -- 172.21.15.63:0/2214950914 wait complete. 2023-12-07T16:25:59.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.625+0000 7f6eea92c700 1 -- 172.21.15.63:0/1738293038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee40fbaf0 msgr2=0x7f6ee40fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:59.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.625+0000 7f6eea92c700 1 --2- 172.21.15.63:0/1738293038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee40fbaf0 0x7f6ee40fbf00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4004940 tx=0x7f6ed4009e30 comp rx=0 tx=0).stop 2023-12-07T16:25:59.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.625+0000 7f6eea92c700 1 -- 172.21.15.63:0/1738293038 shutdown_connections 2023-12-07T16:25:59.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.625+0000 7f6eea92c700 1 --2- 172.21.15.63:0/1738293038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ee40fcd00 0x7f6ee40fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:59.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.625+0000 7f6eea92c700 1 --2- 172.21.15.63:0/1738293038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee40fbaf0 0x7f6ee40fbf00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:59.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.625+0000 7f6eea92c700 1 -- 172.21.15.63:0/1738293038 >> 172.21.15.63:0/1738293038 conn(0x7f6ee40f7190 msgr2=0x7f6ee40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:25:59.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.625+0000 7f6eea92c700 1 -- 172.21.15.63:0/1738293038 shutdown_connections 2023-12-07T16:25:59.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.625+0000 7f6eea92c700 1 -- 172.21.15.63:0/1738293038 wait complete. 2023-12-07T16:25:59.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.625+0000 7f6eea92c700 1 Processor -- start 2023-12-07T16:25:59.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.626+0000 7f6eea92c700 1 -- start start 2023-12-07T16:25:59.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.626+0000 7f6eea92c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ee40fbaf0 0x7f6ee41101f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:59.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.626+0000 7f6eea92c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee40fcd00 0x7f6ee4112740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:59.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.626+0000 7f6eea92c700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee4066130 con 0x7f6ee40fcd00 2023-12-07T16:25:59.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.626+0000 7f6eea92c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee4066270 con 0x7f6ee40fbaf0 2023-12-07T16:25:59.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.626+0000 7f6ee37fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee40fcd00 0x7f6ee4112740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:59.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.626+0000 7f6ee37fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee40fcd00 0x7f6ee4112740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34070/0 (socket says 172.21.15.63:34070) 2023-12-07T16:25:59.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.626+0000 7f6ee37fe700 1 -- 172.21.15.63:0/1628084415 learned_addr learned my addr 172.21.15.63:0/1628084415 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:25:59.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.626+0000 7f6ee3fff700 1 --2- 172.21.15.63:0/1628084415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ee40fbaf0 0x7f6ee41101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:59.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.626+0000 7f6ee37fe700 1 -- 172.21.15.63:0/1628084415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ee40fbaf0 msgr2=0x7f6ee41101f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:59.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.626+0000 7f6ee37fe700 1 --2- 172.21.15.63:0/1628084415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ee40fbaf0 0x7f6ee41101f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:59.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.626+0000 7f6ee37fe700 1 -- 172.21.15.63:0/1628084415 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed4005040 con 0x7f6ee40fcd00 2023-12-07T16:25:59.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.626+0000 7f6ee37fe700 1 --2- 172.21.15.63:0/1628084415 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee40fcd00 0x7f6ee4112740 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800eb40 tx=0x7f6ed800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:25:59.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.627+0000 7f6ee0ff9700 1 -- 172.21.15.63:0/1628084415 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ed8007cc0 con 0x7f6ee40fcd00 2023-12-07T16:25:59.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.627+0000 7f6ee0ff9700 1 -- 172.21.15.63:0/1628084415 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ed800f040 con 0x7f6ee40fcd00 2023-12-07T16:25:59.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.627+0000 7f6eea92c700 1 -- 172.21.15.63:0/1628084415 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee4112d40 con 0x7f6ee40fcd00 2023-12-07T16:25:59.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.627+0000 7f6ee0ff9700 1 -- 172.21.15.63:0/1628084415 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ed800c990 con 0x7f6ee40fcd00 2023-12-07T16:25:59.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.627+0000 7f6eea92c700 1 -- 172.21.15.63:0/1628084415 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee4113230 con 0x7f6ee40fcd00 2023-12-07T16:25:59.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.628+0000 7f6eea92c700 1 -- 172.21.15.63:0/1628084415 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee404bb80 con 0x7f6ee40fcd00 2023-12-07T16:25:59.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.628+0000 7f6ee0ff9700 1 -- 172.21.15.63:0/1628084415 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f6ed800cc00 con 0x7f6ee40fcd00 2023-12-07T16:25:59.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.629+0000 7f6ee0ff9700 1 --2- 172.21.15.63:0/1628084415 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f6ecc06ce60 0x7f6ecc06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:25:59.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.629+0000 7f6ee0ff9700 1 -- 172.21.15.63:0/1628084415 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f6ed808bff0 con 0x7f6ee40fcd00 2023-12-07T16:25:59.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.629+0000 7f6ee3fff700 1 --2- 172.21.15.63:0/1628084415 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f6ecc06ce60 0x7f6ecc06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:25:59.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.629+0000 7f6ee3fff700 1 --2- 172.21.15.63:0/1628084415 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f6ecc06ce60 0x7f6ecc06f310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4009fd0 tx=0x7f6ed4009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:25:59.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.634+0000 7f6ee0ff9700 1 -- 172.21.15.63:0/1628084415 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6ed8055e20 con 0x7f6ee40fcd00 2023-12-07T16:25:59.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.916+0000 7f6eea92c700 1 -- 172.21.15.63:0/1628084415 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6ee4104490 con 0x7f6ee40fcd00 2023-12-07T16:25:59.915 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.916+0000 7f6ee0ff9700 1 -- 172.21.15.63:0/1628084415 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f6ed8059440 con 0x7f6ee40fcd00 2023-12-07T16:25:59.915 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:25:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-07T16:25:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-07T16:25:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:25:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-07T16:25:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-07T16:25:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:25:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-07T16:25:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 1, 2023-12-07T16:25:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 5 2023-12-07T16:25:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:25:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-07T16:25:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 4 2023-12-07T16:25:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:25:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-07T16:25:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 5, 2023-12-07T16:25:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 9 2023-12-07T16:25:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-07T16:25:59.916 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:25:59.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.919+0000 7f6eea92c700 1 -- 172.21.15.63:0/1628084415 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f6ecc06ce60 msgr2=0x7f6ecc06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:59.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.919+0000 7f6eea92c700 1 --2- 172.21.15.63:0/1628084415 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f6ecc06ce60 0x7f6ecc06f310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4009fd0 tx=0x7f6ed4009e30 comp rx=0 tx=0).stop 2023-12-07T16:25:59.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.919+0000 7f6eea92c700 1 -- 172.21.15.63:0/1628084415 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee40fcd00 msgr2=0x7f6ee4112740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:25:59.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.919+0000 7f6eea92c700 1 --2- 172.21.15.63:0/1628084415 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee40fcd00 0x7f6ee4112740 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800eb40 tx=0x7f6ed800b040 comp rx=0 tx=0).stop 2023-12-07T16:25:59.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.919+0000 7f6eea92c700 1 -- 172.21.15.63:0/1628084415 shutdown_connections 2023-12-07T16:25:59.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.919+0000 7f6eea92c700 1 --2- 172.21.15.63:0/1628084415 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f6ecc06ce60 0x7f6ecc06f310 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:59.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.919+0000 7f6eea92c700 1 --2- 172.21.15.63:0/1628084415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6ee40fbaf0 0x7f6ee41101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:59.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.919+0000 7f6eea92c700 1 --2- 172.21.15.63:0/1628084415 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee40fcd00 0x7f6ee4112740 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:25:59.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.919+0000 7f6eea92c700 1 -- 172.21.15.63:0/1628084415 >> 172.21.15.63:0/1628084415 conn(0x7f6ee40f7190 msgr2=0x7f6ee40fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:25:59.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.919+0000 7f6eea92c700 1 -- 172.21.15.63:0/1628084415 shutdown_connections 2023-12-07T16:25:59.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:25:59.919+0000 7f6eea92c700 1 -- 172.21.15.63:0/1628084415 wait complete. 2023-12-07T16:25:59.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:59 smithi152 ceph-mon[175645]: pgmap v137: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:25:59.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:59 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:25:59.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:59 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:25:59.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:25:59 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:00.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.023+0000 7f6e9a395700 1 -- 172.21.15.63:0/1704773393 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e940fbaf0 msgr2=0x7f6e940fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:00.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.023+0000 7f6e9a395700 1 --2- 172.21.15.63:0/1704773393 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e940fbaf0 0x7f6e940fbf00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6e84004940 tx=0x7f6e84009e30 comp rx=0 tx=0).stop 2023-12-07T16:26:00.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.023+0000 7f6e9a395700 1 -- 172.21.15.63:0/1704773393 shutdown_connections 2023-12-07T16:26:00.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.023+0000 7f6e9a395700 1 --2- 172.21.15.63:0/1704773393 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e940fcd00 0x7f6e940fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:00.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.023+0000 7f6e9a395700 1 --2- 172.21.15.63:0/1704773393 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e940fbaf0 0x7f6e940fbf00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:00.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.023+0000 7f6e9a395700 1 -- 172.21.15.63:0/1704773393 >> 172.21.15.63:0/1704773393 conn(0x7f6e940f7190 msgr2=0x7f6e940f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:26:00.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.023+0000 7f6e9a395700 1 -- 172.21.15.63:0/1704773393 shutdown_connections 2023-12-07T16:26:00.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.024+0000 7f6e9a395700 1 -- 172.21.15.63:0/1704773393 wait complete. 2023-12-07T16:26:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.024+0000 7f6e9a395700 1 Processor -- start 2023-12-07T16:26:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.024+0000 7f6e9a395700 1 -- start start 2023-12-07T16:26:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.024+0000 7f6e9a395700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e940fbaf0 0x7f6e9410c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.024+0000 7f6e9a395700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e940fcd00 0x7f6e9410c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.024+0000 7f6e9a395700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9410cfc0 con 0x7f6e940fcd00 2023-12-07T16:26:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.024+0000 7f6e9a395700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9410d860 con 0x7f6e940fbaf0 2023-12-07T16:26:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.025+0000 7f6e937fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e940fcd00 0x7f6e9410c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.025+0000 7f6e937fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e940fcd00 0x7f6e9410c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34090/0 (socket says 172.21.15.63:34090) 2023-12-07T16:26:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.025+0000 7f6e937fe700 1 -- 172.21.15.63:0/1332447119 learned_addr learned my addr 172.21.15.63:0/1332447119 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:26:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.025+0000 7f6e93fff700 1 --2- 172.21.15.63:0/1332447119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e940fbaf0 0x7f6e9410c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.025+0000 7f6e937fe700 1 -- 172.21.15.63:0/1332447119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e940fbaf0 msgr2=0x7f6e9410c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.025+0000 7f6e937fe700 1 --2- 172.21.15.63:0/1332447119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e940fbaf0 0x7f6e9410c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.025+0000 7f6e937fe700 1 -- 172.21.15.63:0/1332447119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e84005040 con 0x7f6e940fcd00 2023-12-07T16:26:00.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.025+0000 7f6e937fe700 1 --2- 172.21.15.63:0/1332447119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e940fcd00 0x7f6e9410c9c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6e88002a50 tx=0x7f6e880046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:26:00.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.025+0000 7f6e90ff9700 1 -- 172.21.15.63:0/1332447119 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e88007cc0 con 0x7f6e940fcd00 2023-12-07T16:26:00.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.025+0000 7f6e9a395700 1 -- 172.21.15.63:0/1332447119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e9410db40 con 0x7f6e940fcd00 2023-12-07T16:26:00.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.025+0000 7f6e90ff9700 1 -- 172.21.15.63:0/1332447119 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6e8800f040 con 0x7f6e940fcd00 2023-12-07T16:26:00.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.025+0000 7f6e90ff9700 1 -- 172.21.15.63:0/1332447119 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e88009540 con 0x7f6e940fcd00 2023-12-07T16:26:00.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.025+0000 7f6e9a395700 1 -- 172.21.15.63:0/1332447119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9410e080 con 0x7f6e940fcd00 2023-12-07T16:26:00.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.026+0000 7f6e9a395700 1 -- 172.21.15.63:0/1332447119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e9404bb80 con 0x7f6e940fcd00 2023-12-07T16:26:00.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.027+0000 7f6e90ff9700 1 -- 172.21.15.63:0/1332447119 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f6e880096a0 con 0x7f6e940fcd00 2023-12-07T16:26:00.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.027+0000 7f6e90ff9700 1 --2- 172.21.15.63:0/1332447119 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f6e7c06ce70 0x7f6e7c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:00.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.027+0000 7f6e90ff9700 1 -- 172.21.15.63:0/1332447119 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f6e8808c250 con 0x7f6e940fcd00 2023-12-07T16:26:00.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.027+0000 7f6e93fff700 1 --2- 172.21.15.63:0/1332447119 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f6e7c06ce70 0x7f6e7c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:00.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.028+0000 7f6e93fff700 1 --2- 172.21.15.63:0/1332447119 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f6e7c06ce70 0x7f6e7c06f320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400b3b0 tx=0x7f6e84009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:26:00.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.032+0000 7f6e90ff9700 1 -- 172.21.15.63:0/1332447119 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6e88059a60 con 0x7f6e940fcd00 2023-12-07T16:26:00.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:59 smithi063 ceph-mon[192008]: pgmap v137: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:00.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:59 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:00.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:59 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:26:00.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:25:59 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:00.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.276+0000 7f6e9a395700 1 -- 172.21.15.63:0/1332447119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6e94104490 con 0x7f6e940fcd00 2023-12-07T16:26:00.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.276+0000 7f6e90ff9700 1 -- 172.21.15.63:0/1332447119 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1874 (secure 0 0 0) 0x7f6e880595f0 con 0x7f6e940fcd00 2023-12-07T16:26:00.273 INFO:teuthology.orchestra.run.smithi063.stdout:e18 2023-12-07T16:26:00.273 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-07T16:26:00.273 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:26:00.273 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2023-12-07T16:26:00.274 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:26:00.274 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2023-12-07T16:26:00.274 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2023-12-07T16:26:00.274 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 18 2023-12-07T16:26:00.274 INFO:teuthology.orchestra.run.smithi063.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-07T16:26:00.274 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-07T16:19:08.352640+0000 2023-12-07T16:26:00.274 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2023-12-07T16:25:54.188098+0000 2023-12-07T16:26:00.274 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2023-12-07T16:26:00.274 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2023-12-07T16:26:00.274 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 60 2023-12-07T16:26:00.274 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2023-12-07T16:26:00.274 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2023-12-07T16:26:00.274 INFO:teuthology.orchestra.run.smithi063.stdout:max_xattr_size 65536 2023-12-07T16:26:00.274 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2023-12-07T16:26:00.274 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2023-12-07T16:26:00.274 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 45 2023-12-07T16:26:00.275 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-07T16:26:00.275 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 2 2023-12-07T16:26:00.275 INFO:teuthology.orchestra.run.smithi063.stdout:in 0,1 2023-12-07T16:26:00.275 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=14478,1=24269} 2023-12-07T16:26:00.275 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2023-12-07T16:26:00.275 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2023-12-07T16:26:00.275 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2023-12-07T16:26:00.275 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2023-12-07T16:26:00.275 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2023-12-07T16:26:00.275 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data enabled 2023-12-07T16:26:00.275 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2023-12-07T16:26:00.275 INFO:teuthology.orchestra.run.smithi063.stdout:bal_rank_mask -1 2023-12-07T16:26:00.275 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 1 2023-12-07T16:26:00.275 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.yidolg{0:14478} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.63:6828/2335448497,v1:172.21.15.63:6829/2335448497] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:26:00.275 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.mrvngf{1:24269} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.152:6824/3157779064,v1:172.21.15.152:6825/3157779064] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:26:00.276 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:26:00.276 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:26:00.276 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2023-12-07T16:26:00.276 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:26:00.276 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi063.gsjgcq{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.63:6826/3063200414,v1:172.21.15.63:6827/3063200414] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:26:00.276 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.cephfs.smithi152.aovwwd{-1:24281} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.152:6826/2906349729,v1:172.21.15.152:6827/2906349729] compat {c=[1],r=[1],i=[7ff]}] 2023-12-07T16:26:00.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.278+0000 7f6e9a395700 1 -- 172.21.15.63:0/1332447119 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f6e7c06ce70 msgr2=0x7f6e7c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:00.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.278+0000 7f6e9a395700 1 --2- 172.21.15.63:0/1332447119 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f6e7c06ce70 0x7f6e7c06f320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400b3b0 tx=0x7f6e84009e30 comp rx=0 tx=0).stop 2023-12-07T16:26:00.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.278+0000 7f6e9a395700 1 -- 172.21.15.63:0/1332447119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e940fcd00 msgr2=0x7f6e9410c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:00.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.278+0000 7f6e9a395700 1 --2- 172.21.15.63:0/1332447119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e940fcd00 0x7f6e9410c9c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6e88002a50 tx=0x7f6e880046b0 comp rx=0 tx=0).stop 2023-12-07T16:26:00.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.278+0000 7f6e9a395700 1 -- 172.21.15.63:0/1332447119 shutdown_connections 2023-12-07T16:26:00.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.278+0000 7f6e9a395700 1 --2- 172.21.15.63:0/1332447119 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f6e7c06ce70 0x7f6e7c06f320 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:00.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.278+0000 7f6e9a395700 1 --2- 172.21.15.63:0/1332447119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e940fbaf0 0x7f6e9410c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:00.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.278+0000 7f6e9a395700 1 --2- 172.21.15.63:0/1332447119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e940fcd00 0x7f6e9410c9c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:00.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.278+0000 7f6e9a395700 1 -- 172.21.15.63:0/1332447119 >> 172.21.15.63:0/1332447119 conn(0x7f6e940f7190 msgr2=0x7f6e940fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:26:00.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.278+0000 7f6e9a395700 1 -- 172.21.15.63:0/1332447119 shutdown_connections 2023-12-07T16:26:00.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.278+0000 7f6e9a395700 1 -- 172.21.15.63:0/1332447119 wait complete. 2023-12-07T16:26:00.277 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 18 2023-12-07T16:26:00.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.383+0000 7f96d13d1700 1 -- 172.21.15.63:0/3335266986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96cc0fbaf0 msgr2=0x7f96cc0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:00.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.383+0000 7f96d13d1700 1 --2- 172.21.15.63:0/3335266986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96cc0fbaf0 0x7f96cc0fbf00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f96bc004940 tx=0x7f96bc009e30 comp rx=0 tx=0).stop 2023-12-07T16:26:00.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.383+0000 7f96d13d1700 1 -- 172.21.15.63:0/3335266986 shutdown_connections 2023-12-07T16:26:00.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.383+0000 7f96d13d1700 1 --2- 172.21.15.63:0/3335266986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96cc0fcd00 0x7f96cc0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:00.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.383+0000 7f96d13d1700 1 --2- 172.21.15.63:0/3335266986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96cc0fbaf0 0x7f96cc0fbf00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:00.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.383+0000 7f96d13d1700 1 -- 172.21.15.63:0/3335266986 >> 172.21.15.63:0/3335266986 conn(0x7f96cc0f7190 msgr2=0x7f96cc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:26:00.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.383+0000 7f96d13d1700 1 -- 172.21.15.63:0/3335266986 shutdown_connections 2023-12-07T16:26:00.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.383+0000 7f96d13d1700 1 -- 172.21.15.63:0/3335266986 wait complete. 2023-12-07T16:26:00.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.384+0000 7f96d13d1700 1 Processor -- start 2023-12-07T16:26:00.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.384+0000 7f96d13d1700 1 -- start start 2023-12-07T16:26:00.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.384+0000 7f96d13d1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96cc0fbaf0 0x7f96cc10d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:00.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.384+0000 7f96d13d1700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96cc0fcd00 0x7f96cc10da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:00.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.384+0000 7f96d13d1700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc10e030 con 0x7f96cc0fcd00 2023-12-07T16:26:00.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.384+0000 7f96d13d1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc10e8d0 con 0x7f96cc0fbaf0 2023-12-07T16:26:00.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.384+0000 7f96ca7fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96cc0fcd00 0x7f96cc10da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:00.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.384+0000 7f96ca7fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96cc0fcd00 0x7f96cc10da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34112/0 (socket says 172.21.15.63:34112) 2023-12-07T16:26:00.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.384+0000 7f96ca7fc700 1 -- 172.21.15.63:0/2735357569 learned_addr learned my addr 172.21.15.63:0/2735357569 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:26:00.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.384+0000 7f96caffd700 1 --2- 172.21.15.63:0/2735357569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96cc0fbaf0 0x7f96cc10d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:00.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.384+0000 7f96ca7fc700 1 -- 172.21.15.63:0/2735357569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96cc0fbaf0 msgr2=0x7f96cc10d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:00.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.384+0000 7f96ca7fc700 1 --2- 172.21.15.63:0/2735357569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96cc0fbaf0 0x7f96cc10d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:00.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.384+0000 7f96ca7fc700 1 -- 172.21.15.63:0/2735357569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc005040 con 0x7f96cc0fcd00 2023-12-07T16:26:00.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.384+0000 7f96ca7fc700 1 --2- 172.21.15.63:0/2735357569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96cc0fcd00 0x7f96cc10da30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f96c0002a80 tx=0x7f96c00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:26:00.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.385+0000 7f96b37fe700 1 -- 172.21.15.63:0/2735357569 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96c0007cc0 con 0x7f96cc0fcd00 2023-12-07T16:26:00.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.385+0000 7f96d13d1700 1 -- 172.21.15.63:0/2735357569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96cc10ebb0 con 0x7f96cc0fcd00 2023-12-07T16:26:00.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.385+0000 7f96b37fe700 1 -- 172.21.15.63:0/2735357569 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f96c000f040 con 0x7f96cc0fcd00 2023-12-07T16:26:00.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.385+0000 7f96b37fe700 1 -- 172.21.15.63:0/2735357569 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96c000da60 con 0x7f96cc0fcd00 2023-12-07T16:26:00.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.385+0000 7f96d13d1700 1 -- 172.21.15.63:0/2735357569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96cc10f0f0 con 0x7f96cc0fcd00 2023-12-07T16:26:00.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.386+0000 7f96d13d1700 1 -- 172.21.15.63:0/2735357569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96cc04bb80 con 0x7f96cc0fcd00 2023-12-07T16:26:00.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.386+0000 7f96b37fe700 1 -- 172.21.15.63:0/2735357569 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f96c000dbc0 con 0x7f96cc0fcd00 2023-12-07T16:26:00.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.387+0000 7f96b37fe700 1 --2- 172.21.15.63:0/2735357569 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f96b406ce70 0x7f96b406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:00.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.387+0000 7f96b37fe700 1 -- 172.21.15.63:0/2735357569 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f96c008c090 con 0x7f96cc0fcd00 2023-12-07T16:26:00.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.387+0000 7f96caffd700 1 --2- 172.21.15.63:0/2735357569 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f96b406ce70 0x7f96b406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:00.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.387+0000 7f96caffd700 1 --2- 172.21.15.63:0/2735357569 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f96b406ce70 0x7f96b406f320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f96bc00b7d0 tx=0x7f96bc009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:26:00.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.391+0000 7f96b37fe700 1 -- 172.21.15.63:0/2735357569 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f96c00598a0 con 0x7f96cc0fcd00 2023-12-07T16:26:00.607 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.610+0000 7f96d13d1700 1 -- 172.21.15.63:0/2735357569 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f96cc10f540 con 0x7f96b406ce70 2023-12-07T16:26:00.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.611+0000 7f96b37fe700 1 -- 172.21.15.63:0/2735357569 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f96cc10f540 con 0x7f96b406ce70 2023-12-07T16:26:00.608 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:26:00.608 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-07T16:26:00.608 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-07T16:26:00.608 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-07T16:26:00.608 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [ 2023-12-07T16:26:00.608 INFO:teuthology.orchestra.run.smithi063.stdout: "crash", 2023-12-07T16:26:00.608 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr", 2023-12-07T16:26:00.608 INFO:teuthology.orchestra.run.smithi063.stdout: "mon" 2023-12-07T16:26:00.608 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2023-12-07T16:26:00.608 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "11/21 daemons upgraded", 2023-12-07T16:26:00.609 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "Currently upgrading osd daemons", 2023-12-07T16:26:00.609 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": false 2023-12-07T16:26:00.609 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:26:00.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.613+0000 7f96d13d1700 1 -- 172.21.15.63:0/2735357569 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f96b406ce70 msgr2=0x7f96b406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:00.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.613+0000 7f96d13d1700 1 --2- 172.21.15.63:0/2735357569 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f96b406ce70 0x7f96b406f320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f96bc00b7d0 tx=0x7f96bc009e30 comp rx=0 tx=0).stop 2023-12-07T16:26:00.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.613+0000 7f96d13d1700 1 -- 172.21.15.63:0/2735357569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96cc0fcd00 msgr2=0x7f96cc10da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:00.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.613+0000 7f96d13d1700 1 --2- 172.21.15.63:0/2735357569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96cc0fcd00 0x7f96cc10da30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f96c0002a80 tx=0x7f96c00046b0 comp rx=0 tx=0).stop 2023-12-07T16:26:00.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.613+0000 7f96d13d1700 1 -- 172.21.15.63:0/2735357569 shutdown_connections 2023-12-07T16:26:00.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.613+0000 7f96d13d1700 1 --2- 172.21.15.63:0/2735357569 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f96b406ce70 0x7f96b406f320 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:00.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.613+0000 7f96d13d1700 1 --2- 172.21.15.63:0/2735357569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96cc0fbaf0 0x7f96cc10d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:00.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.613+0000 7f96d13d1700 1 --2- 172.21.15.63:0/2735357569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96cc0fcd00 0x7f96cc10da30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:00.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.613+0000 7f96d13d1700 1 -- 172.21.15.63:0/2735357569 >> 172.21.15.63:0/2735357569 conn(0x7f96cc0f7190 msgr2=0x7f96cc065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:26:00.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.613+0000 7f96d13d1700 1 -- 172.21.15.63:0/2735357569 shutdown_connections 2023-12-07T16:26:00.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.613+0000 7f96d13d1700 1 -- 172.21.15.63:0/2735357569 wait complete. 2023-12-07T16:26:00.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.718+0000 7f67d8ed7700 1 -- 172.21.15.63:0/1347696839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67d40fcbf0 msgr2=0x7f67d40fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:00.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.718+0000 7f67d8ed7700 1 --2- 172.21.15.63:0/1347696839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67d40fcbf0 0x7f67d40fd000 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f67c4004940 tx=0x7f67c4009e30 comp rx=0 tx=0).stop 2023-12-07T16:26:00.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.718+0000 7f67d8ed7700 1 -- 172.21.15.63:0/1347696839 shutdown_connections 2023-12-07T16:26:00.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.718+0000 7f67d8ed7700 1 --2- 172.21.15.63:0/1347696839 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67d40fde00 0x7f67d40fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:00.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.718+0000 7f67d8ed7700 1 --2- 172.21.15.63:0/1347696839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67d40fcbf0 0x7f67d40fd000 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:00.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.718+0000 7f67d8ed7700 1 -- 172.21.15.63:0/1347696839 >> 172.21.15.63:0/1347696839 conn(0x7f67d40f82d0 msgr2=0x7f67d40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:26:00.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.718+0000 7f67d8ed7700 1 -- 172.21.15.63:0/1347696839 shutdown_connections 2023-12-07T16:26:00.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.718+0000 7f67d8ed7700 1 -- 172.21.15.63:0/1347696839 wait complete. 2023-12-07T16:26:00.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.719+0000 7f67d8ed7700 1 Processor -- start 2023-12-07T16:26:00.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.719+0000 7f67d8ed7700 1 -- start start 2023-12-07T16:26:00.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.719+0000 7f67d8ed7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67d40fcbf0 0x7f67d4071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:00.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.719+0000 7f67d8ed7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67d40fde00 0x7f67d406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:00.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.719+0000 7f67d8ed7700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d41111b0 con 0x7f67d40fde00 2023-12-07T16:26:00.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.719+0000 7f67d8ed7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d4111320 con 0x7f67d40fcbf0 2023-12-07T16:26:00.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.719+0000 7f67d1d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67d40fde00 0x7f67d406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:00.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.719+0000 7f67d1d9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67d40fde00 0x7f67d406ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34134/0 (socket says 172.21.15.63:34134) 2023-12-07T16:26:00.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.719+0000 7f67d1d9b700 1 -- 172.21.15.63:0/2023282381 learned_addr learned my addr 172.21.15.63:0/2023282381 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:26:00.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.719+0000 7f67d259c700 1 --2- 172.21.15.63:0/2023282381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67d40fcbf0 0x7f67d4071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:00.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.720+0000 7f67d1d9b700 1 -- 172.21.15.63:0/2023282381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67d40fcbf0 msgr2=0x7f67d4071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:00.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.720+0000 7f67d1d9b700 1 --2- 172.21.15.63:0/2023282381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67d40fcbf0 0x7f67d4071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:00.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.720+0000 7f67d1d9b700 1 -- 172.21.15.63:0/2023282381 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c4005040 con 0x7f67d40fde00 2023-12-07T16:26:00.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.720+0000 7f67d1d9b700 1 --2- 172.21.15.63:0/2023282381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67d40fde00 0x7f67d406ff90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f67c800eb40 tx=0x7f67c800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:26:00.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.720+0000 7f67c2ffd700 1 -- 172.21.15.63:0/2023282381 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67c8007cc0 con 0x7f67d40fde00 2023-12-07T16:26:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.720+0000 7f67c2ffd700 1 -- 172.21.15.63:0/2023282381 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f67c800f040 con 0x7f67d40fde00 2023-12-07T16:26:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.720+0000 7f67d8ed7700 1 -- 172.21.15.63:0/2023282381 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d4070590 con 0x7f67d40fde00 2023-12-07T16:26:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.720+0000 7f67c2ffd700 1 -- 172.21.15.63:0/2023282381 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67c8009570 con 0x7f67d40fde00 2023-12-07T16:26:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.720+0000 7f67d8ed7700 1 -- 172.21.15.63:0/2023282381 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d4070ad0 con 0x7f67d40fde00 2023-12-07T16:26:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.721+0000 7f67d8ed7700 1 -- 172.21.15.63:0/2023282381 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d404bb80 con 0x7f67d40fde00 2023-12-07T16:26:00.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.721+0000 7f67c2ffd700 1 -- 172.21.15.63:0/2023282381 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f67c80096d0 con 0x7f67d40fde00 2023-12-07T16:26:00.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.722+0000 7f67c2ffd700 1 --2- 172.21.15.63:0/2023282381 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f67bc06ce60 0x7f67bc06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:00.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.722+0000 7f67c2ffd700 1 -- 172.21.15.63:0/2023282381 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f67c808c0f0 con 0x7f67d40fde00 2023-12-07T16:26:00.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.722+0000 7f67d259c700 1 --2- 172.21.15.63:0/2023282381 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f67bc06ce60 0x7f67bc06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:00.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.722+0000 7f67d259c700 1 --2- 172.21.15.63:0/2023282381 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f67bc06ce60 0x7f67bc06f310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f67c4013680 tx=0x7f67c4009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:26:00.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:00.726+0000 7f67c2ffd700 1 -- 172.21.15.63:0/2023282381 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f67c80599b0 con 0x7f67d40fde00 2023-12-07T16:26:00.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:00 smithi152 ceph-mon[175645]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:26:00.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:00 smithi152 ceph-mon[175645]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:26:00.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:00 smithi152 ceph-mon[175645]: from='client.34296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:26:00.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:00 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/1628084415' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:26:00.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:00 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/1332447119' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:26:00.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:00 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-07T16:26:01.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:01.007+0000 7f67d8ed7700 1 -- 172.21.15.63:0/2023282381 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f67d4119cf0 con 0x7f67d40fde00 2023-12-07T16:26:01.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:01.007+0000 7f67c2ffd700 1 -- 172.21.15.63:0/2023282381 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f67c8059540 con 0x7f67d40fde00 2023-12-07T16:26:01.005 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-07T16:26:01.005 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-07T16:26:01.005 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-07T16:26:01.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:01.009+0000 7f67d8ed7700 1 -- 172.21.15.63:0/2023282381 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f67bc06ce60 msgr2=0x7f67bc06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:01.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:01.009+0000 7f67d8ed7700 1 --2- 172.21.15.63:0/2023282381 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f67bc06ce60 0x7f67bc06f310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f67c4013680 tx=0x7f67c4009e30 comp rx=0 tx=0).stop 2023-12-07T16:26:01.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:01.009+0000 7f67d8ed7700 1 -- 172.21.15.63:0/2023282381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67d40fde00 msgr2=0x7f67d406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:01.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:01.009+0000 7f67d8ed7700 1 --2- 172.21.15.63:0/2023282381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67d40fde00 0x7f67d406ff90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f67c800eb40 tx=0x7f67c800b040 comp rx=0 tx=0).stop 2023-12-07T16:26:01.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:01.010+0000 7f67d8ed7700 1 -- 172.21.15.63:0/2023282381 shutdown_connections 2023-12-07T16:26:01.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:01.010+0000 7f67d8ed7700 1 --2- 172.21.15.63:0/2023282381 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f67bc06ce60 0x7f67bc06f310 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:01.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:01.010+0000 7f67d8ed7700 1 --2- 172.21.15.63:0/2023282381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67d40fcbf0 0x7f67d4071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:01.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:01.010+0000 7f67d8ed7700 1 --2- 172.21.15.63:0/2023282381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f67d40fde00 0x7f67d406ff90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:01.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:01.010+0000 7f67d8ed7700 1 -- 172.21.15.63:0/2023282381 >> 172.21.15.63:0/2023282381 conn(0x7f67d40f82d0 msgr2=0x7f67d4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:26:01.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:01.010+0000 7f67d8ed7700 1 -- 172.21.15.63:0/2023282381 shutdown_connections 2023-12-07T16:26:01.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:01.010+0000 7f67d8ed7700 1 -- 172.21.15.63:0/2023282381 wait complete. 2023-12-07T16:26:01.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:00 smithi063 ceph-mon[192008]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:26:01.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:00 smithi063 ceph-mon[192008]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:26:01.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:00 smithi063 ceph-mon[192008]: from='client.34296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:26:01.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:00 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/1628084415' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:26:01.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:00 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/1332447119' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-07T16:26:01.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:00 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-07T16:26:01.965 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:01 smithi152 ceph-mon[175645]: pgmap v138: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:01.965 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:01 smithi152 ceph-mon[175645]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-07T16:26:01.965 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:01 smithi152 ceph-mon[175645]: Upgrade: osd.5 is safe to restart 2023-12-07T16:26:01.965 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:01 smithi152 ceph-mon[175645]: from='client.34308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:26:01.965 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:01 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/2023282381' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:26:01.965 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:01 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:01.966 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:01 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-07T16:26:01.966 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:01 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:26:02.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:01 smithi063 ceph-mon[192008]: pgmap v138: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:02.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:01 smithi063 ceph-mon[192008]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-07T16:26:02.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:01 smithi063 ceph-mon[192008]: Upgrade: osd.5 is safe to restart 2023-12-07T16:26:02.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:01 smithi063 ceph-mon[192008]: from='client.34308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:26:02.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:01 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/2023282381' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:26:02.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:01 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:02.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:01 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-07T16:26:02.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:01 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:26:02.907 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:02 smithi152 ceph-mon[175645]: Upgrade: Updating osd.5 2023-12-07T16:26:02.907 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:02 smithi152 ceph-mon[175645]: Deploying daemon osd.5 on smithi152 2023-12-07T16:26:03.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:02 smithi063 ceph-mon[192008]: Upgrade: Updating osd.5 2023-12-07T16:26:03.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:02 smithi063 ceph-mon[192008]: Deploying daemon osd.5 on smithi152 2023-12-07T16:26:03.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:03 smithi152 ceph-mon[175645]: pgmap v139: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:03.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:03 smithi152 ceph-mon[175645]: fsmap cephfs:2 {0=cephfs.smithi063.yidolg=up:active,1=cephfs.smithi152.mrvngf=up:active} 2 up:standby 2023-12-07T16:26:03.993 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:26:03 smithi152 systemd[1]: Stopping Ceph osd.5 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:26:03.993 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:26:03 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[143897]: 2023-12-07T16:26:03.712+0000 7fc1508f5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-07T16:26:03.993 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:26:03 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[143897]: 2023-12-07T16:26:03.712+0000 7fc1508f5700 -1 osd.5 86 *** Got signal Terminated *** 2023-12-07T16:26:03.993 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:26:03 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[143897]: 2023-12-07T16:26:03.712+0000 7fc1508f5700 -1 osd.5 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-07T16:26:04.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:03 smithi063 ceph-mon[192008]: pgmap v139: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:04.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:03 smithi063 ceph-mon[192008]: fsmap cephfs:2 {0=cephfs.smithi063.yidolg=up:active,1=cephfs.smithi152.mrvngf=up:active} 2 up:standby 2023-12-07T16:26:04.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:04 smithi152 ceph-mon[175645]: osd.5 marked itself down and dead 2023-12-07T16:26:05.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:04 smithi063 ceph-mon[192008]: osd.5 marked itself down and dead 2023-12-07T16:26:05.711 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:26:05 smithi152 bash[200962]: ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5 2023-12-07T16:26:05.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:05 smithi152 ceph-mon[175645]: pgmap v140: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:05.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:05 smithi152 ceph-mon[175645]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-07T16:26:05.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:05 smithi152 ceph-mon[175645]: osdmap e87: 6 total, 5 up, 6 in 2023-12-07T16:26:06.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:05 smithi063 ceph-mon[192008]: pgmap v140: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:06.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:05 smithi063 ceph-mon[192008]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-07T16:26:06.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:05 smithi063 ceph-mon[192008]: osdmap e87: 6 total, 5 up, 6 in 2023-12-07T16:26:06.953 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:06 smithi152 ceph-mon[175645]: osdmap e88: 6 total, 5 up, 6 in 2023-12-07T16:26:06.953 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:26:06 smithi152 systemd[1]: ceph-8c493298-951b-11ee-95a2-87774f69a715@osd.5.service: Succeeded. 2023-12-07T16:26:06.953 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:26:06 smithi152 systemd[1]: Stopped Ceph osd.5 for 8c493298-951b-11ee-95a2-87774f69a715. 2023-12-07T16:26:06.953 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:26:06 smithi152 systemd[1]: Starting Ceph osd.5 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:26:07.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:06 smithi063 ceph-mon[192008]: osdmap e88: 6 total, 5 up, 6 in 2023-12-07T16:26:07.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:07 smithi152 ceph-mon[175645]: pgmap v143: 65 pgs: 3 peering, 13 stale+active+clean, 49 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:07.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:07 smithi152 ceph-mon[175645]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-07T16:26:07.993 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:26:07 smithi152 bash[201230]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-07T16:26:07.993 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:26:07 smithi152 bash[201230]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-07T16:26:07.993 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:26:07 smithi152 bash[201230]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-07T16:26:07.993 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:26:07 smithi152 bash[201230]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-07T16:26:07.993 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:26:07 smithi152 bash[201230]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2023-12-07T16:26:07.993 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:26:07 smithi152 bash[201230]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-07T16:26:07.993 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:26:07 smithi152 bash[201230]: --> ceph-volume raw activate successful for osd ID: 5 2023-12-07T16:26:08.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:07 smithi063 ceph-mon[192008]: pgmap v143: 65 pgs: 3 peering, 13 stale+active+clean, 49 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:08.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:07 smithi063 ceph-mon[192008]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-07T16:26:08.742 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:26:08 smithi152 bash[201482]: f3f47cf1e8e00c317726dc8156ee9de38337fecb27d3139e5d54eba3d7dcb296 2023-12-07T16:26:08.742 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:26:08 smithi152 systemd[1]: Started Ceph osd.5 for 8c493298-951b-11ee-95a2-87774f69a715. 2023-12-07T16:26:08.742 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:26:08 smithi152 ceph-osd[201519]: -- 172.21.15.152:0/2368722418 <== mon.1 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557354b431e0 con 0x557354b12c00 2023-12-07T16:26:09.242 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:26:08 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:26:08.919+0000 7fc6506fd640 -1 Falling back to public interface 2023-12-07T16:26:09.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:09 smithi152 ceph-mon[175645]: pgmap v144: 65 pgs: 3 active+undersized, 3 active+undersized+degraded, 3 peering, 10 stale+active+clean, 46 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 7/360 objects degraded (1.944%) 2023-12-07T16:26:09.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:09 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:09.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:09 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:09.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:09 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:26:09.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:09 smithi152 ceph-mon[175645]: Health check failed: Degraded data redundancy: 7/360 objects degraded (1.944%), 3 pgs degraded (PG_DEGRADED) 2023-12-07T16:26:09.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:09 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:09.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:09 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:09.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:09 smithi063 ceph-mon[192008]: pgmap v144: 65 pgs: 3 active+undersized, 3 active+undersized+degraded, 3 peering, 10 stale+active+clean, 46 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 7/360 objects degraded (1.944%) 2023-12-07T16:26:09.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:09 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:09.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:09 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:09.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:09 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:26:09.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:09 smithi063 ceph-mon[192008]: Health check failed: Degraded data redundancy: 7/360 objects degraded (1.944%), 3 pgs degraded (PG_DEGRADED) 2023-12-07T16:26:09.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:09 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:09.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:09 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:12.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:11 smithi152 ceph-mon[175645]: pgmap v145: 65 pgs: 14 active+undersized, 12 active+undersized+degraded, 3 peering, 36 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 48/360 objects degraded (13.333%) 2023-12-07T16:26:12.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:11 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:12.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:11 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:12.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:11 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:12.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:11 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:12.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:11 smithi063 ceph-mon[192008]: pgmap v145: 65 pgs: 14 active+undersized, 12 active+undersized+degraded, 3 peering, 36 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 48/360 objects degraded (13.333%) 2023-12-07T16:26:12.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:11 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:12.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:11 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:12.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:11 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:12.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:11 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:13.492 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:26:13 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:26:13.151+0000 7fc6506fd640 -1 osd.5 0 read_superblock omap replica is missing. 2023-12-07T16:26:13.898 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:26:13 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:26:13.673+0000 7fc6506fd640 -1 osd.5 86 log_to_monitors true 2023-12-07T16:26:13.898 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:26:13 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:26:13.767+0000 7fc63fb6a700 -1 osd.5 86 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T16:26:13.899 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:13 smithi152 ceph-mon[175645]: pgmap v146: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/360 objects degraded (15.278%) 2023-12-07T16:26:13.899 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:13 smithi152 ceph-mon[175645]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-07T16:26:13.899 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:13 smithi152 ceph-mon[175645]: from='osd.5 [v2:172.21.15.152:6816/3235100730,v1:172.21.15.152:6817/3235100730]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-07T16:26:13.899 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:13 smithi152 ceph-mon[175645]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-07T16:26:14.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:13 smithi063 ceph-mon[192008]: pgmap v146: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/360 objects degraded (15.278%) 2023-12-07T16:26:14.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:13 smithi063 ceph-mon[192008]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-07T16:26:14.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:13 smithi063 ceph-mon[192008]: from='osd.5 [v2:172.21.15.152:6816/3235100730,v1:172.21.15.152:6817/3235100730]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-07T16:26:14.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:13 smithi063 ceph-mon[192008]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-07T16:26:15.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-07T16:26:15.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='osd.5 [v2:172.21.15.152:6816/3235100730,v1:172.21.15.152:6817/3235100730]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-07T16:26:15.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: osdmap e89: 6 total, 5 up, 6 in 2023-12-07T16:26:15.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-07T16:26:15.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:15.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:15.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:26:15.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:26:15.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:15.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:15.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:26:15.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:26:15.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:26:15.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:26:15.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:26:15.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:26:15.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:15.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-07T16:26:15.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-07T16:26:15.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-07T16:26:15.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-07T16:26:15.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-07T16:26:15.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-07T16:26:15.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-07T16:26:15.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-07T16:26:15.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-07T16:26:15.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-07T16:26:15.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-07T16:26:15.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-07T16:26:15.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-07T16:26:15.158 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:15.158 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:26:15.158 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:26:15.158 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:26:15.158 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:15.158 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:14 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-mon-smithi063[191966]: 2023-12-07T16:26:14.975+0000 7f0b4635f700 -1 log_channel(cluster) log [ERR] : Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-07T16:26:15.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-07T16:26:15.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='osd.5 [v2:172.21.15.152:6816/3235100730,v1:172.21.15.152:6817/3235100730]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-07T16:26:15.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: osdmap e89: 6 total, 5 up, 6 in 2023-12-07T16:26:15.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-07T16:26:15.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:15.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:15.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:26:15.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:26:15.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:15.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:15.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:26:15.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:26:15.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:26:15.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:26:15.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:26:15.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:26:15.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:15.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-07T16:26:15.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-07T16:26:15.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-07T16:26:15.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-07T16:26:15.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-07T16:26:15.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-07T16:26:15.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-07T16:26:15.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-07T16:26:15.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-07T16:26:15.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-07T16:26:15.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-07T16:26:15.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-07T16:26:15.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-07T16:26:15.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:15.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:26:15.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:26:15.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:26:15.244 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:16.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:15 smithi063 ceph-mon[192008]: pgmap v148: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 55/360 objects degraded (15.278%) 2023-12-07T16:26:16.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:15 smithi063 ceph-mon[192008]: Upgrade: Setting container_image for all osd 2023-12-07T16:26:16.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:15 smithi063 ceph-mon[192008]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-07T16:26:16.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:15 smithi063 ceph-mon[192008]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-07T16:26:16.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:15 smithi063 ceph-mon[192008]: pgmap v149: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 55/360 objects degraded (15.278%) 2023-12-07T16:26:16.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:15 smithi063 ceph-mon[192008]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-07T16:26:16.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:15 smithi063 ceph-mon[192008]: osd.5 [v2:172.21.15.152:6816/3235100730,v1:172.21.15.152:6817/3235100730] boot 2023-12-07T16:26:16.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:15 smithi063 ceph-mon[192008]: osdmap e90: 6 total, 6 up, 6 in 2023-12-07T16:26:16.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:15 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-07T16:26:16.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:15 smithi063 ceph-mon[192008]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-07T16:26:16.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:15 smithi063 ceph-mon[192008]: osdmap e91: 6 total, 6 up, 6 in 2023-12-07T16:26:16.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:15 smithi152 ceph-mon[175645]: pgmap v148: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 55/360 objects degraded (15.278%) 2023-12-07T16:26:16.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:15 smithi152 ceph-mon[175645]: Upgrade: Setting container_image for all osd 2023-12-07T16:26:16.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:15 smithi152 ceph-mon[175645]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-07T16:26:16.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:15 smithi152 ceph-mon[175645]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-07T16:26:16.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:15 smithi152 ceph-mon[175645]: pgmap v149: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 55/360 objects degraded (15.278%) 2023-12-07T16:26:16.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:15 smithi152 ceph-mon[175645]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-07T16:26:16.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:15 smithi152 ceph-mon[175645]: osd.5 [v2:172.21.15.152:6816/3235100730,v1:172.21.15.152:6817/3235100730] boot 2023-12-07T16:26:16.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:15 smithi152 ceph-mon[175645]: osdmap e90: 6 total, 6 up, 6 in 2023-12-07T16:26:16.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:15 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-07T16:26:16.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:15 smithi152 ceph-mon[175645]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-07T16:26:16.243 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:15 smithi152 ceph-mon[175645]: osdmap e91: 6 total, 6 up, 6 in 2023-12-07T16:26:17.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:16 smithi063 ceph-mon[192008]: pgmap v152: 65 pgs: 2 peering, 14 active+undersized, 13 active+undersized+degraded, 36 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 51/360 objects degraded (14.167%) 2023-12-07T16:26:17.157 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:16 smithi063 ceph-mon[192008]: Health check update: Degraded data redundancy: 51/360 objects degraded (14.167%), 13 pgs degraded (PG_DEGRADED) 2023-12-07T16:26:17.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:16 smithi152 ceph-mon[175645]: pgmap v152: 65 pgs: 2 peering, 14 active+undersized, 13 active+undersized+degraded, 36 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 51/360 objects degraded (14.167%) 2023-12-07T16:26:17.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:16 smithi152 ceph-mon[175645]: Health check update: Degraded data redundancy: 51/360 objects degraded (14.167%), 13 pgs degraded (PG_DEGRADED) 2023-12-07T16:26:19.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:19 smithi152 ceph-mon[175645]: pgmap v153: 65 pgs: 2 peering, 13 active+undersized, 11 active+undersized+degraded, 39 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/360 objects degraded (13.056%) 2023-12-07T16:26:19.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:19 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:20.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:19 smithi063 ceph-mon[192008]: pgmap v153: 65 pgs: 2 peering, 13 active+undersized, 11 active+undersized+degraded, 39 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/360 objects degraded (13.056%) 2023-12-07T16:26:20.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:19 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:21.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:20 smithi063 ceph-mon[192008]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 47/360 objects degraded (13.056%), 11 pgs degraded) 2023-12-07T16:26:21.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:20 smithi152 ceph-mon[175645]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 47/360 objects degraded (13.056%), 11 pgs degraded) 2023-12-07T16:26:22.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:21 smithi063 ceph-mon[192008]: pgmap v154: 65 pgs: 2 peering, 63 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:22.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:21 smithi152 ceph-mon[175645]: pgmap v154: 65 pgs: 2 peering, 63 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:24.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:23 smithi063 ceph-mon[192008]: pgmap v155: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:24.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:23 smithi152 ceph-mon[175645]: pgmap v155: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:26.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:25 smithi063 ceph-mon[192008]: pgmap v156: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:26.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:25 smithi152 ceph-mon[175645]: pgmap v156: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:28.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:27 smithi063 ceph-mon[192008]: pgmap v157: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:28.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:27 smithi152 ceph-mon[175645]: pgmap v157: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:30.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:29 smithi063 ceph-mon[192008]: pgmap v158: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:30.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:29 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:30.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:29 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:26:30.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:29 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:30.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:29 smithi152 ceph-mon[175645]: pgmap v158: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:30.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:29 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:30.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:29 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:26:30.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:29 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:26:31.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.128+0000 7f1996421700 1 -- 172.21.15.63:0/790001803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19900fbaf0 msgr2=0x7f19900fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:31.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.128+0000 7f1996421700 1 --2- 172.21.15.63:0/790001803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19900fbaf0 0x7f19900fbf00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1980004940 tx=0x7f1980009e30 comp rx=0 tx=0).stop 2023-12-07T16:26:31.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.128+0000 7f1996421700 1 -- 172.21.15.63:0/790001803 shutdown_connections 2023-12-07T16:26:31.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.128+0000 7f1996421700 1 --2- 172.21.15.63:0/790001803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19900fcd00 0x7f19900fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:31.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.128+0000 7f1996421700 1 --2- 172.21.15.63:0/790001803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19900fbaf0 0x7f19900fbf00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:31.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.128+0000 7f1996421700 1 -- 172.21.15.63:0/790001803 >> 172.21.15.63:0/790001803 conn(0x7f19900f7190 msgr2=0x7f19900f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:26:31.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.128+0000 7f1996421700 1 -- 172.21.15.63:0/790001803 shutdown_connections 2023-12-07T16:26:31.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.128+0000 7f1996421700 1 -- 172.21.15.63:0/790001803 wait complete. 2023-12-07T16:26:31.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.129+0000 7f1996421700 1 Processor -- start 2023-12-07T16:26:31.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.129+0000 7f1996421700 1 -- start start 2023-12-07T16:26:31.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.129+0000 7f1996421700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19900fbaf0 0x7f19900ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:31.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.129+0000 7f1996421700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19900fcd00 0x7f19900fe040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:31.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.129+0000 7f1996421700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19900fe640 con 0x7f19900fbaf0 2023-12-07T16:26:31.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.129+0000 7f1996421700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19900fe7b0 con 0x7f19900fcd00 2023-12-07T16:26:31.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.129+0000 7f198ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19900fbaf0 0x7f19900ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:31.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.129+0000 7f198ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19900fbaf0 0x7f19900ffbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42092/0 (socket says 172.21.15.63:42092) 2023-12-07T16:26:31.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.129+0000 7f198ffff700 1 -- 172.21.15.63:0/670009866 learned_addr learned my addr 172.21.15.63:0/670009866 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:26:31.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.130+0000 7f198f7fe700 1 --2- 172.21.15.63:0/670009866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19900fcd00 0x7f19900fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:31.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.130+0000 7f198ffff700 1 -- 172.21.15.63:0/670009866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19900fcd00 msgr2=0x7f19900fe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:31.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.130+0000 7f198ffff700 1 --2- 172.21.15.63:0/670009866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19900fcd00 0x7f19900fe040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:31.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.130+0000 7f198ffff700 1 -- 172.21.15.63:0/670009866 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1980005040 con 0x7f19900fbaf0 2023-12-07T16:26:31.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.130+0000 7f198ffff700 1 --2- 172.21.15.63:0/670009866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19900fbaf0 0x7f19900ffbc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1980009380 tx=0x7f1980009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:26:31.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.130+0000 7f198cff9700 1 -- 172.21.15.63:0/670009866 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f198000e040 con 0x7f19900fbaf0 2023-12-07T16:26:31.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.130+0000 7f198cff9700 1 -- 172.21.15.63:0/670009866 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f198000bcd0 con 0x7f19900fbaf0 2023-12-07T16:26:31.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.130+0000 7f198cff9700 1 -- 172.21.15.63:0/670009866 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f198001c630 con 0x7f19900fbaf0 2023-12-07T16:26:31.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.130+0000 7f1996421700 1 -- 172.21.15.63:0/670009866 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19900fea30 con 0x7f19900fbaf0 2023-12-07T16:26:31.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.130+0000 7f1996421700 1 -- 172.21.15.63:0/670009866 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19901155b0 con 0x7f19900fbaf0 2023-12-07T16:26:31.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.131+0000 7f1996421700 1 -- 172.21.15.63:0/670009866 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199004bb80 con 0x7f19900fbaf0 2023-12-07T16:26:31.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.132+0000 7f198cff9700 1 -- 172.21.15.63:0/670009866 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f198001c8a0 con 0x7f19900fbaf0 2023-12-07T16:26:31.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.133+0000 7f198cff9700 1 --2- 172.21.15.63:0/670009866 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f197806ce60 0x7f197806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:31.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.133+0000 7f198cff9700 1 -- 172.21.15.63:0/670009866 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f198008e350 con 0x7f19900fbaf0 2023-12-07T16:26:31.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.133+0000 7f198f7fe700 1 --2- 172.21.15.63:0/670009866 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f197806ce60 0x7f197806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:31.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.133+0000 7f198f7fe700 1 --2- 172.21.15.63:0/670009866 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f197806ce60 0x7f197806f310 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1984004d60 tx=0x7f198400b040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:26:31.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.137+0000 7f198cff9700 1 -- 172.21.15.63:0/670009866 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f198005bbc0 con 0x7f19900fbaf0 2023-12-07T16:26:31.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.353+0000 7f1996421700 1 -- 172.21.15.63:0/670009866 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1990115740 con 0x7f197806ce60 2023-12-07T16:26:31.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.355+0000 7f198cff9700 1 -- 172.21.15.63:0/670009866 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7f1990115740 con 0x7f197806ce60 2023-12-07T16:26:31.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.357+0000 7f1996421700 1 -- 172.21.15.63:0/670009866 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f197806ce60 msgr2=0x7f197806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:31.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.357+0000 7f1996421700 1 --2- 172.21.15.63:0/670009866 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f197806ce60 0x7f197806f310 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1984004d60 tx=0x7f198400b040 comp rx=0 tx=0).stop 2023-12-07T16:26:31.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.357+0000 7f1996421700 1 -- 172.21.15.63:0/670009866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19900fbaf0 msgr2=0x7f19900ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:31.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.357+0000 7f1996421700 1 --2- 172.21.15.63:0/670009866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19900fbaf0 0x7f19900ffbc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1980009380 tx=0x7f1980009e30 comp rx=0 tx=0).stop 2023-12-07T16:26:31.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.357+0000 7f1996421700 1 -- 172.21.15.63:0/670009866 shutdown_connections 2023-12-07T16:26:31.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.357+0000 7f1996421700 1 --2- 172.21.15.63:0/670009866 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f197806ce60 0x7f197806f310 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:31.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.357+0000 7f1996421700 1 --2- 172.21.15.63:0/670009866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f19900fbaf0 0x7f19900ffbc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:31.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.357+0000 7f1996421700 1 --2- 172.21.15.63:0/670009866 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f19900fcd00 0x7f19900fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:31.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.357+0000 7f1996421700 1 -- 172.21.15.63:0/670009866 >> 172.21.15.63:0/670009866 conn(0x7f19900f7190 msgr2=0x7f1990065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:26:31.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.357+0000 7f1996421700 1 -- 172.21.15.63:0/670009866 shutdown_connections 2023-12-07T16:26:31.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.357+0000 7f1996421700 1 -- 172.21.15.63:0/670009866 wait complete. 2023-12-07T16:26:31.364 INFO:teuthology.orchestra.run.smithi063.stdout:true 2023-12-07T16:26:31.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.461+0000 7f98ea523700 1 -- 172.21.15.63:0/3225260931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98e40fbaf0 msgr2=0x7f98e40fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:31.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.461+0000 7f98ea523700 1 --2- 172.21.15.63:0/3225260931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98e40fbaf0 0x7f98e40fbf00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f98d4004940 tx=0x7f98d4009e30 comp rx=0 tx=0).stop 2023-12-07T16:26:31.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.461+0000 7f98ea523700 1 -- 172.21.15.63:0/3225260931 shutdown_connections 2023-12-07T16:26:31.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.461+0000 7f98ea523700 1 --2- 172.21.15.63:0/3225260931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98e40fcd00 0x7f98e40fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:31.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.461+0000 7f98ea523700 1 --2- 172.21.15.63:0/3225260931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98e40fbaf0 0x7f98e40fbf00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:31.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.461+0000 7f98ea523700 1 -- 172.21.15.63:0/3225260931 >> 172.21.15.63:0/3225260931 conn(0x7f98e40f7190 msgr2=0x7f98e40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:26:31.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.462+0000 7f98ea523700 1 -- 172.21.15.63:0/3225260931 shutdown_connections 2023-12-07T16:26:31.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.462+0000 7f98ea523700 1 -- 172.21.15.63:0/3225260931 wait complete. 2023-12-07T16:26:31.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.462+0000 7f98ea523700 1 Processor -- start 2023-12-07T16:26:31.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.462+0000 7f98ea523700 1 -- start start 2023-12-07T16:26:31.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.463+0000 7f98ea523700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98e40fbaf0 0x7f98e410c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:31.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.463+0000 7f98ea523700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98e40fcd00 0x7f98e410c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:31.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.463+0000 7f98ea523700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e410cfc0 con 0x7f98e40fcd00 2023-12-07T16:26:31.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.463+0000 7f98ea523700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e410d860 con 0x7f98e40fbaf0 2023-12-07T16:26:31.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.463+0000 7f98e37fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98e40fcd00 0x7f98e410c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:31.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.463+0000 7f98e37fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98e40fcd00 0x7f98e410c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42108/0 (socket says 172.21.15.63:42108) 2023-12-07T16:26:31.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.463+0000 7f98e37fe700 1 -- 172.21.15.63:0/1951818990 learned_addr learned my addr 172.21.15.63:0/1951818990 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:26:31.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.463+0000 7f98e3fff700 1 --2- 172.21.15.63:0/1951818990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98e40fbaf0 0x7f98e410c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:31.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.463+0000 7f98e37fe700 1 -- 172.21.15.63:0/1951818990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98e40fbaf0 msgr2=0x7f98e410c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:31.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.463+0000 7f98e37fe700 1 --2- 172.21.15.63:0/1951818990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98e40fbaf0 0x7f98e410c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:31.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.463+0000 7f98e37fe700 1 -- 172.21.15.63:0/1951818990 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d4005040 con 0x7f98e40fcd00 2023-12-07T16:26:31.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.463+0000 7f98e3fff700 1 --2- 172.21.15.63:0/1951818990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98e40fbaf0 0x7f98e410c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T16:26:31.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.463+0000 7f98e37fe700 1 --2- 172.21.15.63:0/1951818990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98e40fcd00 0x7f98e410c9c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f98d800c830 tx=0x7f98d8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:26:31.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.463+0000 7f98e0ff9700 1 -- 172.21.15.63:0/1951818990 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98d800a760 con 0x7f98e40fcd00 2023-12-07T16:26:31.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.464+0000 7f98e0ff9700 1 -- 172.21.15.63:0/1951818990 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f98d800ad70 con 0x7f98e40fcd00 2023-12-07T16:26:31.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.464+0000 7f98ea523700 1 -- 172.21.15.63:0/1951818990 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e410db40 con 0x7f98e40fcd00 2023-12-07T16:26:31.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.464+0000 7f98e0ff9700 1 -- 172.21.15.63:0/1951818990 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98d80113a0 con 0x7f98e40fcd00 2023-12-07T16:26:31.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.464+0000 7f98ea523700 1 -- 172.21.15.63:0/1951818990 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e410e080 con 0x7f98e40fcd00 2023-12-07T16:26:31.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.464+0000 7f98ea523700 1 -- 172.21.15.63:0/1951818990 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e404bb80 con 0x7f98e40fcd00 2023-12-07T16:26:31.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.465+0000 7f98e0ff9700 1 -- 172.21.15.63:0/1951818990 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f98d8012400 con 0x7f98e40fcd00 2023-12-07T16:26:31.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.466+0000 7f98e0ff9700 1 --2- 172.21.15.63:0/1951818990 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f98cc06ce60 0x7f98cc06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:31.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.466+0000 7f98e0ff9700 1 -- 172.21.15.63:0/1951818990 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f98d808c380 con 0x7f98e40fcd00 2023-12-07T16:26:31.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.466+0000 7f98e3fff700 1 --2- 172.21.15.63:0/1951818990 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f98cc06ce60 0x7f98cc06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:31.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.466+0000 7f98e3fff700 1 --2- 172.21.15.63:0/1951818990 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f98cc06ce60 0x7f98cc06f310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f98d400b3b0 tx=0x7f98d4009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:26:31.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.470+0000 7f98e0ff9700 1 -- 172.21.15.63:0/1951818990 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f98d8059cb0 con 0x7f98e40fcd00 2023-12-07T16:26:31.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.688+0000 7f98ea523700 1 -- 172.21.15.63:0/1951818990 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f98e410e580 con 0x7f98cc06ce60 2023-12-07T16:26:31.686 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.689+0000 7f98e0ff9700 1 -- 172.21.15.63:0/1951818990 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7f98e410e580 con 0x7f98cc06ce60 2023-12-07T16:26:31.688 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.691+0000 7f98ea523700 1 -- 172.21.15.63:0/1951818990 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f98cc06ce60 msgr2=0x7f98cc06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:31.688 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.691+0000 7f98ea523700 1 --2- 172.21.15.63:0/1951818990 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f98cc06ce60 0x7f98cc06f310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f98d400b3b0 tx=0x7f98d4009e30 comp rx=0 tx=0).stop 2023-12-07T16:26:31.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.691+0000 7f98ea523700 1 -- 172.21.15.63:0/1951818990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98e40fcd00 msgr2=0x7f98e410c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:31.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.691+0000 7f98ea523700 1 --2- 172.21.15.63:0/1951818990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98e40fcd00 0x7f98e410c9c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f98d800c830 tx=0x7f98d8004470 comp rx=0 tx=0).stop 2023-12-07T16:26:31.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.691+0000 7f98ea523700 1 -- 172.21.15.63:0/1951818990 shutdown_connections 2023-12-07T16:26:31.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.691+0000 7f98ea523700 1 --2- 172.21.15.63:0/1951818990 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f98cc06ce60 0x7f98cc06f310 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:31.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.691+0000 7f98ea523700 1 --2- 172.21.15.63:0/1951818990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98e40fbaf0 0x7f98e410c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:31.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.691+0000 7f98ea523700 1 --2- 172.21.15.63:0/1951818990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98e40fcd00 0x7f98e410c9c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:31.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.691+0000 7f98ea523700 1 -- 172.21.15.63:0/1951818990 >> 172.21.15.63:0/1951818990 conn(0x7f98e40f7190 msgr2=0x7f98e40fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:26:31.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.691+0000 7f98ea523700 1 -- 172.21.15.63:0/1951818990 shutdown_connections 2023-12-07T16:26:31.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:31.691+0000 7f98ea523700 1 -- 172.21.15.63:0/1951818990 wait complete. 2023-12-07T16:26:31.698 INFO:teuthology.orchestra.run.smithi063.stdout:"Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception" 2023-12-07T16:26:32.050 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:31 smithi063 ceph-mon[192008]: pgmap v159: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:32.070 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph orch ps' 2023-12-07T16:26:32.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:31 smithi152 ceph-mon[175645]: pgmap v159: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:32.395 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:26:32.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:32 smithi063 ceph-mon[192008]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:26:32.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:32 smithi063 ceph-mon[192008]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:26:33.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:32 smithi152 ceph-mon[175645]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:26:33.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:32 smithi152 ceph-mon[175645]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:26:33.598 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.600+0000 7f8cb29e7700 1 -- 172.21.15.63:0/2753481601 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cac103520 msgr2=0x7f8cac0653f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:33.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.600+0000 7f8cb29e7700 1 --2- 172.21.15.63:0/2753481601 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cac103520 0x7f8cac0653f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c004940 tx=0x7f8c9c009e30 comp rx=0 tx=0).stop 2023-12-07T16:26:33.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.600+0000 7f8cb29e7700 1 -- 172.21.15.63:0/2753481601 shutdown_connections 2023-12-07T16:26:33.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.600+0000 7f8cb29e7700 1 --2- 172.21.15.63:0/2753481601 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cac103520 0x7f8cac0653f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:33.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.600+0000 7f8cb29e7700 1 --2- 172.21.15.63:0/2753481601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cac102b80 0x7f8cac102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:33.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.600+0000 7f8cb29e7700 1 -- 172.21.15.63:0/2753481601 >> 172.21.15.63:0/2753481601 conn(0x7f8cac071970 msgr2=0x7f8cac071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:26:33.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.600+0000 7f8cb29e7700 1 -- 172.21.15.63:0/2753481601 shutdown_connections 2023-12-07T16:26:33.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.601+0000 7f8cb29e7700 1 -- 172.21.15.63:0/2753481601 wait complete. 2023-12-07T16:26:33.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.601+0000 7f8cb29e7700 1 Processor -- start 2023-12-07T16:26:33.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.601+0000 7f8cb29e7700 1 -- start start 2023-12-07T16:26:33.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.602+0000 7f8cb29e7700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cac102b80 0x7f8cac113510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:33.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.602+0000 7f8cb29e7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cac103520 0x7f8cac113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:33.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.602+0000 7f8cb29e7700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac1140a0 con 0x7f8cac102b80 2023-12-07T16:26:33.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.602+0000 7f8cb29e7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac10d3d0 con 0x7f8cac103520 2023-12-07T16:26:33.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.602+0000 7f8cabfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cac102b80 0x7f8cac113510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:33.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.602+0000 7f8cabfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cac102b80 0x7f8cac113510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42118/0 (socket says 172.21.15.63:42118) 2023-12-07T16:26:33.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.602+0000 7f8cabfff700 1 -- 172.21.15.63:0/216114471 learned_addr learned my addr 172.21.15.63:0/216114471 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:26:33.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.602+0000 7f8cab7fe700 1 --2- 172.21.15.63:0/216114471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cac103520 0x7f8cac113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:33.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.602+0000 7f8cabfff700 1 -- 172.21.15.63:0/216114471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cac103520 msgr2=0x7f8cac113a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:33.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.602+0000 7f8cabfff700 1 --2- 172.21.15.63:0/216114471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cac103520 0x7f8cac113a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:33.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.602+0000 7f8cabfff700 1 -- 172.21.15.63:0/216114471 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c005040 con 0x7f8cac102b80 2023-12-07T16:26:33.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.602+0000 7f8cab7fe700 1 --2- 172.21.15.63:0/216114471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cac103520 0x7f8cac113a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T16:26:33.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.602+0000 7f8cabfff700 1 --2- 172.21.15.63:0/216114471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cac102b80 0x7f8cac113510 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400c8c0 tx=0x7f8c940044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:26:33.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.603+0000 7f8ca8ff9700 1 -- 172.21.15.63:0/216114471 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c9400a980 con 0x7f8cac102b80 2023-12-07T16:26:33.604 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.603+0000 7f8cb29e7700 1 -- 172.21.15.63:0/216114471 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cac10d6b0 con 0x7f8cac102b80 2023-12-07T16:26:33.604 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.603+0000 7f8ca8ff9700 1 -- 172.21.15.63:0/216114471 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8c9400ce60 con 0x7f8cac102b80 2023-12-07T16:26:33.604 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.603+0000 7f8ca8ff9700 1 -- 172.21.15.63:0/216114471 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c940113a0 con 0x7f8cac102b80 2023-12-07T16:26:33.604 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.603+0000 7f8cb29e7700 1 -- 172.21.15.63:0/216114471 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cac10dc70 con 0x7f8cac102b80 2023-12-07T16:26:33.604 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.603+0000 7f8cb29e7700 1 -- 172.21.15.63:0/216114471 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cac075970 con 0x7f8cac102b80 2023-12-07T16:26:33.604 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.604+0000 7f8ca8ff9700 1 -- 172.21.15.63:0/216114471 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f8c94012400 con 0x7f8cac102b80 2023-12-07T16:26:33.604 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.605+0000 7f8ca8ff9700 1 --2- 172.21.15.63:0/216114471 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f8c9806ce60 0x7f8c9806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:33.604 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.605+0000 7f8ca8ff9700 1 -- 172.21.15.63:0/216114471 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f8c9408c540 con 0x7f8cac102b80 2023-12-07T16:26:33.604 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.605+0000 7f8cab7fe700 1 --2- 172.21.15.63:0/216114471 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f8c9806ce60 0x7f8c9806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:33.604 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.605+0000 7f8cab7fe700 1 --2- 172.21.15.63:0/216114471 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f8c9806ce60 0x7f8c9806f310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8cac10edb0 tx=0x7f8c9c009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:26:33.606 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.609+0000 7f8ca8ff9700 1 -- 172.21.15.63:0/216114471 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f8c94059dd0 con 0x7f8cac102b80 2023-12-07T16:26:33.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.818+0000 7f8cb29e7700 1 -- 172.21.15.63:0/216114471 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cac0008d0 con 0x7f8c9806ce60 2023-12-07T16:26:33.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.828+0000 7f8ca8ff9700 1 -- 172.21.15.63:0/216114471 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f8cac0008d0 con 0x7f8c9806ce60 2023-12-07T16:26:33.825 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-07T16:26:33.825 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (5m) 107s ago 11m 28.6M - 0.25.0 c8568f914cd2 c0526812d5fe 2023-12-07T16:26:33.825 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (3m) 107s ago 11m 7474k - 19.0.0-13-ge6605fb8 104f332cd0a9 52adf44ea983 2023-12-07T16:26:33.825 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi152 smithi152 running (3m) 23s ago 10m 7453k - 19.0.0-13-ge6605fb8 104f332cd0a9 9eba5b538b96 2023-12-07T16:26:33.826 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (5m) 107s ago 10m 91.4M - 9.4.7 954c08fa6188 cc2cde9a664f 2023-12-07T16:26:33.826 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.gsjgcq smithi063 running (7m) 107s ago 7m 15.2M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 f70e4f098e4c 2023-12-07T16:26:33.826 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.yidolg smithi063 running (7m) 107s ago 7m 5932M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5b053ef5fb7f 2023-12-07T16:26:33.826 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.aovwwd smithi152 running (7m) 23s ago 7m 16.3M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 80190948a595 2023-12-07T16:26:33.826 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.mrvngf smithi152 running (7m) 23s ago 7m 5114M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5f60b893f840 2023-12-07T16:26:33.826 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.yohyyx smithi063 *:8443,9283,8765 running (4m) 107s ago 12m 511M - 19.0.0-13-ge6605fb8 104f332cd0a9 b605f882784d 2023-12-07T16:26:33.826 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi152.sxayfb smithi152 *:8443,9283,8765 running (4m) 23s ago 10m 451M - 19.0.0-13-ge6605fb8 104f332cd0a9 71716998ccc3 2023-12-07T16:26:33.826 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (4m) 107s ago 12m 67.3M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 8d7d0c6bfea3 2023-12-07T16:26:33.826 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi152 smithi152 running (3m) 23s ago 10m 58.0M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 883bb3425cf0 2023-12-07T16:26:33.826 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (5m) 107s ago 11m 18.9M - 1.5.0 0da6a335fe13 50d63981f746 2023-12-07T16:26:33.826 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi152 smithi152 *:9100 running (4m) 23s ago 10m 19.6M - 1.5.0 0da6a335fe13 627cda14f1a9 2023-12-07T16:26:33.827 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (2m) 107s ago 9m 189M 1568M 19.0.0-13-ge6605fb8 104f332cd0a9 5fab981f1333 2023-12-07T16:26:33.827 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (2m) 107s ago 9m 121M 1568M 19.0.0-13-ge6605fb8 104f332cd0a9 b78531e6dc96 2023-12-07T16:26:33.827 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (110s) 107s ago 9m 11.5M 1568M 19.0.0-13-ge6605fb8 104f332cd0a9 a473024763f8 2023-12-07T16:26:33.827 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi152 running (81s) 23s ago 8m 129M 2592M 19.0.0-13-ge6605fb8 104f332cd0a9 7c32a746ce82 2023-12-07T16:26:33.827 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi152 running (53s) 23s ago 8m 119M 2592M 19.0.0-13-ge6605fb8 104f332cd0a9 98e6e6e3a58e 2023-12-07T16:26:33.827 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi152 running (25s) 23s ago 8m 13.9M 2592M 19.0.0-13-ge6605fb8 104f332cd0a9 f3f47cf1e8e0 2023-12-07T16:26:33.827 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (4m) 107s ago 10m 51.1M - 2.43.0 a07b618ecd1d 8a323520d9fd 2023-12-07T16:26:33.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.830+0000 7f8cb29e7700 1 -- 172.21.15.63:0/216114471 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f8c9806ce60 msgr2=0x7f8c9806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:33.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.830+0000 7f8cb29e7700 1 --2- 172.21.15.63:0/216114471 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f8c9806ce60 0x7f8c9806f310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8cac10edb0 tx=0x7f8c9c009e30 comp rx=0 tx=0).stop 2023-12-07T16:26:33.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.830+0000 7f8cb29e7700 1 -- 172.21.15.63:0/216114471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cac102b80 msgr2=0x7f8cac113510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:33.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.830+0000 7f8cb29e7700 1 --2- 172.21.15.63:0/216114471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cac102b80 0x7f8cac113510 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400c8c0 tx=0x7f8c940044c0 comp rx=0 tx=0).stop 2023-12-07T16:26:33.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.830+0000 7f8cb29e7700 1 -- 172.21.15.63:0/216114471 shutdown_connections 2023-12-07T16:26:33.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.830+0000 7f8cb29e7700 1 --2- 172.21.15.63:0/216114471 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f8c9806ce60 0x7f8c9806f310 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:33.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.830+0000 7f8cb29e7700 1 --2- 172.21.15.63:0/216114471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cac102b80 0x7f8cac113510 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:33.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.830+0000 7f8cb29e7700 1 --2- 172.21.15.63:0/216114471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cac103520 0x7f8cac113a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:33.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.830+0000 7f8cb29e7700 1 -- 172.21.15.63:0/216114471 >> 172.21.15.63:0/216114471 conn(0x7f8cac071970 msgr2=0x7f8cac0fa930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:26:33.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.830+0000 7f8cb29e7700 1 -- 172.21.15.63:0/216114471 shutdown_connections 2023-12-07T16:26:33.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:33.830+0000 7f8cb29e7700 1 -- 172.21.15.63:0/216114471 wait complete. 2023-12-07T16:26:34.149 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:33 smithi063 ceph-mon[192008]: pgmap v160: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:34.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:33 smithi152 ceph-mon[175645]: pgmap v160: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:34.331 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph orch upgrade status' 2023-12-07T16:26:34.608 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:26:35.667 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.667+0000 7f1a89aa6700 1 -- 172.21.15.63:0/2862282135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a8406ff80 msgr2=0x7f1a84070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:35.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.667+0000 7f1a89aa6700 1 --2- 172.21.15.63:0/2862282135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a8406ff80 0x7f1a84070350 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1a74004970 tx=0x7f1a74009e30 comp rx=0 tx=0).stop 2023-12-07T16:26:35.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.667+0000 7f1a89aa6700 1 -- 172.21.15.63:0/2862282135 shutdown_connections 2023-12-07T16:26:35.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.667+0000 7f1a89aa6700 1 --2- 172.21.15.63:0/2862282135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a84070890 0x7f1a84108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:35.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.667+0000 7f1a89aa6700 1 --2- 172.21.15.63:0/2862282135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a8406ff80 0x7f1a84070350 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:35.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.667+0000 7f1a89aa6700 1 -- 172.21.15.63:0/2862282135 >> 172.21.15.63:0/2862282135 conn(0x7f1a840f8790 msgr2=0x7f1a840faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:26:35.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.667+0000 7f1a89aa6700 1 -- 172.21.15.63:0/2862282135 shutdown_connections 2023-12-07T16:26:35.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.667+0000 7f1a89aa6700 1 -- 172.21.15.63:0/2862282135 wait complete. 2023-12-07T16:26:35.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.668+0000 7f1a89aa6700 1 Processor -- start 2023-12-07T16:26:35.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.668+0000 7f1a89aa6700 1 -- start start 2023-12-07T16:26:35.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.668+0000 7f1a89aa6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a8406ff80 0x7f1a84115840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:35.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.668+0000 7f1a89aa6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a84070890 0x7f1a84115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:35.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.668+0000 7f1a89aa6700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a84116460 con 0x7f1a8406ff80 2023-12-07T16:26:35.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.668+0000 7f1a89aa6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8410f700 con 0x7f1a84070890 2023-12-07T16:26:35.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.668+0000 7f1a837fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a8406ff80 0x7f1a84115840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:35.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.669+0000 7f1a837fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a8406ff80 0x7f1a84115840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42132/0 (socket says 172.21.15.63:42132) 2023-12-07T16:26:35.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.669+0000 7f1a837fe700 1 -- 172.21.15.63:0/539637051 learned_addr learned my addr 172.21.15.63:0/539637051 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:26:35.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.669+0000 7f1a82ffd700 1 --2- 172.21.15.63:0/539637051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a84070890 0x7f1a84115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:35.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.669+0000 7f1a837fe700 1 -- 172.21.15.63:0/539637051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a84070890 msgr2=0x7f1a84115d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:35.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.669+0000 7f1a837fe700 1 --2- 172.21.15.63:0/539637051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a84070890 0x7f1a84115d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:35.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.669+0000 7f1a837fe700 1 -- 172.21.15.63:0/539637051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a74005040 con 0x7f1a8406ff80 2023-12-07T16:26:35.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.669+0000 7f1a82ffd700 1 --2- 172.21.15.63:0/539637051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a84070890 0x7f1a84115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T16:26:35.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.669+0000 7f1a837fe700 1 --2- 172.21.15.63:0/539637051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a8406ff80 0x7f1a84115840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1a74000c00 tx=0x7f1a74009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:26:35.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.669+0000 7f1a7bfff700 1 -- 172.21.15.63:0/539637051 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a7400e040 con 0x7f1a8406ff80 2023-12-07T16:26:35.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.669+0000 7f1a89aa6700 1 -- 172.21.15.63:0/539637051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8410f980 con 0x7f1a8406ff80 2023-12-07T16:26:35.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.669+0000 7f1a7bfff700 1 -- 172.21.15.63:0/539637051 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1a7400bc10 con 0x7f1a8406ff80 2023-12-07T16:26:35.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.669+0000 7f1a7bfff700 1 -- 172.21.15.63:0/539637051 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a7401c3f0 con 0x7f1a8406ff80 2023-12-07T16:26:35.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.669+0000 7f1a89aa6700 1 -- 172.21.15.63:0/539637051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8410fec0 con 0x7f1a8406ff80 2023-12-07T16:26:35.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.670+0000 7f1a89aa6700 1 -- 172.21.15.63:0/539637051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a84106630 con 0x7f1a8406ff80 2023-12-07T16:26:35.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.671+0000 7f1a7bfff700 1 -- 172.21.15.63:0/539637051 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f1a74013420 con 0x7f1a8406ff80 2023-12-07T16:26:35.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.671+0000 7f1a7bfff700 1 --2- 172.21.15.63:0/539637051 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f1a7006ce60 0x7f1a7006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:35.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.671+0000 7f1a7bfff700 1 -- 172.21.15.63:0/539637051 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f1a7408d7c0 con 0x7f1a8406ff80 2023-12-07T16:26:35.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.671+0000 7f1a82ffd700 1 --2- 172.21.15.63:0/539637051 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f1a7006ce60 0x7f1a7006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:35.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.672+0000 7f1a82ffd700 1 --2- 172.21.15.63:0/539637051 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f1a7006ce60 0x7f1a7006f310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c006fd0 tx=0x7f1a6c008040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:26:35.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.676+0000 7f1a7bfff700 1 -- 172.21.15.63:0/539637051 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1a7405b050 con 0x7f1a8406ff80 2023-12-07T16:26:35.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.898+0000 7f1a89aa6700 1 -- 172.21.15.63:0/539637051 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a8404bbf0 con 0x7f1a7006ce60 2023-12-07T16:26:35.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.899+0000 7f1a7bfff700 1 -- 172.21.15.63:0/539637051 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7f1a8404bbf0 con 0x7f1a7006ce60 2023-12-07T16:26:35.897 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:26:35.897 INFO:teuthology.orchestra.run.smithi063.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:39a4ff3cfc7192f7589b4718fbace6b045c1d2ef8d24ece937637a3c80c27b0a", 2023-12-07T16:26:35.897 INFO:teuthology.orchestra.run.smithi063.stdout: "in_progress": true, 2023-12-07T16:26:35.897 INFO:teuthology.orchestra.run.smithi063.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-07T16:26:35.897 INFO:teuthology.orchestra.run.smithi063.stdout: "services_complete": [ 2023-12-07T16:26:35.897 INFO:teuthology.orchestra.run.smithi063.stdout: "osd", 2023-12-07T16:26:35.897 INFO:teuthology.orchestra.run.smithi063.stdout: "crash", 2023-12-07T16:26:35.897 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr", 2023-12-07T16:26:35.897 INFO:teuthology.orchestra.run.smithi063.stdout: "mon" 2023-12-07T16:26:35.898 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2023-12-07T16:26:35.898 INFO:teuthology.orchestra.run.smithi063.stdout: "progress": "12/21 daemons upgraded", 2023-12-07T16:26:35.898 INFO:teuthology.orchestra.run.smithi063.stdout: "message": "Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception", 2023-12-07T16:26:35.898 INFO:teuthology.orchestra.run.smithi063.stdout: "is_paused": true 2023-12-07T16:26:35.898 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:26:35.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.901+0000 7f1a89aa6700 1 -- 172.21.15.63:0/539637051 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f1a7006ce60 msgr2=0x7f1a7006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:35.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.901+0000 7f1a89aa6700 1 --2- 172.21.15.63:0/539637051 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f1a7006ce60 0x7f1a7006f310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c006fd0 tx=0x7f1a6c008040 comp rx=0 tx=0).stop 2023-12-07T16:26:35.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.902+0000 7f1a89aa6700 1 -- 172.21.15.63:0/539637051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a8406ff80 msgr2=0x7f1a84115840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:35.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.902+0000 7f1a89aa6700 1 --2- 172.21.15.63:0/539637051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a8406ff80 0x7f1a84115840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1a74000c00 tx=0x7f1a74009e30 comp rx=0 tx=0).stop 2023-12-07T16:26:35.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.902+0000 7f1a89aa6700 1 -- 172.21.15.63:0/539637051 shutdown_connections 2023-12-07T16:26:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.902+0000 7f1a89aa6700 1 --2- 172.21.15.63:0/539637051 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f1a7006ce60 0x7f1a7006f310 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.902+0000 7f1a89aa6700 1 --2- 172.21.15.63:0/539637051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a8406ff80 0x7f1a84115840 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.902+0000 7f1a89aa6700 1 --2- 172.21.15.63:0/539637051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1a84070890 0x7f1a84115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.902+0000 7f1a89aa6700 1 -- 172.21.15.63:0/539637051 >> 172.21.15.63:0/539637051 conn(0x7f1a840f8790 msgr2=0x7f1a841037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:26:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.902+0000 7f1a89aa6700 1 -- 172.21.15.63:0/539637051 shutdown_connections 2023-12-07T16:26:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:35.902+0000 7f1a89aa6700 1 -- 172.21.15.63:0/539637051 wait complete. 2023-12-07T16:26:36.057 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:35 smithi063 ceph-mon[192008]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:26:36.057 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:35 smithi063 ceph-mon[192008]: pgmap v161: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:36.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:35 smithi152 ceph-mon[175645]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:26:36.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:35 smithi152 ceph-mon[175645]: pgmap v161: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:36.278 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph health detail' 2023-12-07T16:26:36.553 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:26:37.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.772+0000 7fb3a9827700 1 -- 172.21.15.63:0/1895514226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a40fbb40 msgr2=0x7fb3a40fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:37.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.772+0000 7fb3a9827700 1 --2- 172.21.15.63:0/1895514226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a40fbb40 0x7fb3a40fbfb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb394004940 tx=0x7fb394009e30 comp rx=0 tx=0).stop 2023-12-07T16:26:37.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.772+0000 7fb3a9827700 1 -- 172.21.15.63:0/1895514226 shutdown_connections 2023-12-07T16:26:37.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.772+0000 7fb3a9827700 1 --2- 172.21.15.63:0/1895514226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a40fbb40 0x7fb3a40fbfb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:37.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.772+0000 7fb3a9827700 1 --2- 172.21.15.63:0/1895514226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3a4101b00 0x7fb3a4101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:37.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.772+0000 7fb3a9827700 1 -- 172.21.15.63:0/1895514226 >> 172.21.15.63:0/1895514226 conn(0x7fb3a40f76c0 msgr2=0x7fb3a40f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:26:37.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.772+0000 7fb3a9827700 1 -- 172.21.15.63:0/1895514226 shutdown_connections 2023-12-07T16:26:37.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.772+0000 7fb3a9827700 1 -- 172.21.15.63:0/1895514226 wait complete. 2023-12-07T16:26:37.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.773+0000 7fb3a9827700 1 Processor -- start 2023-12-07T16:26:37.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.773+0000 7fb3a9827700 1 -- start start 2023-12-07T16:26:37.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.773+0000 7fb3a9827700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3a40fbb40 0x7fb3a410e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:37.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.773+0000 7fb3a9827700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a4101b00 0x7fb3a410ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:37.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.773+0000 7fb3a9827700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a410f1d0 con 0x7fb3a4101b00 2023-12-07T16:26:37.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.773+0000 7fb3a9827700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a410f340 con 0x7fb3a40fbb40 2023-12-07T16:26:37.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.773+0000 7fb3a27fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a4101b00 0x7fb3a410ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:37.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.773+0000 7fb3a27fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a4101b00 0x7fb3a410ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42150/0 (socket says 172.21.15.63:42150) 2023-12-07T16:26:37.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.773+0000 7fb3a27fc700 1 -- 172.21.15.63:0/1897354465 learned_addr learned my addr 172.21.15.63:0/1897354465 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:26:37.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.773+0000 7fb3a2ffd700 1 --2- 172.21.15.63:0/1897354465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3a40fbb40 0x7fb3a410e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:37.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.774+0000 7fb3a27fc700 1 -- 172.21.15.63:0/1897354465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3a40fbb40 msgr2=0x7fb3a410e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:37.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.774+0000 7fb3a27fc700 1 --2- 172.21.15.63:0/1897354465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3a40fbb40 0x7fb3a410e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:37.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.774+0000 7fb3a27fc700 1 -- 172.21.15.63:0/1897354465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb394005040 con 0x7fb3a4101b00 2023-12-07T16:26:37.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.774+0000 7fb3a27fc700 1 --2- 172.21.15.63:0/1897354465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a4101b00 0x7fb3a410ec40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb39400b3b0 tx=0x7fb394009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:26:37.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.775+0000 7fb38b7fe700 1 -- 172.21.15.63:0/1897354465 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb39400e040 con 0x7fb3a4101b00 2023-12-07T16:26:37.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.775+0000 7fb38b7fe700 1 -- 172.21.15.63:0/1897354465 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb39401c430 con 0x7fb3a4101b00 2023-12-07T16:26:37.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.775+0000 7fb38b7fe700 1 -- 172.21.15.63:0/1897354465 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb394013640 con 0x7fb3a4101b00 2023-12-07T16:26:37.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.775+0000 7fb3a9827700 1 -- 172.21.15.63:0/1897354465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a4117670 con 0x7fb3a4101b00 2023-12-07T16:26:37.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.775+0000 7fb3a9827700 1 -- 172.21.15.63:0/1897354465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a4117b60 con 0x7fb3a4101b00 2023-12-07T16:26:37.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.776+0000 7fb3a9827700 1 -- 172.21.15.63:0/1897354465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a4103fb0 con 0x7fb3a4101b00 2023-12-07T16:26:37.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.776+0000 7fb38b7fe700 1 -- 172.21.15.63:0/1897354465 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fb39401c5a0 con 0x7fb3a4101b00 2023-12-07T16:26:37.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.777+0000 7fb38b7fe700 1 --2- 172.21.15.63:0/1897354465 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fb38c06ce60 0x7fb38c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:37.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.777+0000 7fb38b7fe700 1 -- 172.21.15.63:0/1897354465 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6761+0+0 (secure 0 0 0) 0x7fb39408ce90 con 0x7fb3a4101b00 2023-12-07T16:26:37.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.777+0000 7fb3a2ffd700 1 --2- 172.21.15.63:0/1897354465 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fb38c06ce60 0x7fb38c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:37.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.777+0000 7fb3a2ffd700 1 --2- 172.21.15.63:0/1897354465 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fb38c06ce60 0x7fb38c06f310 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb398004f40 tx=0x7fb39800b040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:26:37.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:37.782+0000 7fb38b7fe700 1 -- 172.21.15.63:0/1897354465 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb394056de0 con 0x7fb3a4101b00 2023-12-07T16:26:38.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:38.063+0000 7fb3a9827700 1 -- 172.21.15.63:0/1897354465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb3a4066460 con 0x7fb3a4101b00 2023-12-07T16:26:38.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:38.063+0000 7fb38b7fe700 1 -- 172.21.15.63:0/1897354465 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+451 (secure 0 0 0) 0x7fb39405a400 con 0x7fb3a4101b00 2023-12-07T16:26:38.061 INFO:teuthology.orchestra.run.smithi063.stdout:HEALTH_ERR 1 filesystem with deprecated feature inline_data; Upgrade: failed due to an unexpected exception 2023-12-07T16:26:38.061 INFO:teuthology.orchestra.run.smithi063.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-07T16:26:38.061 INFO:teuthology.orchestra.run.smithi063.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-07T16:26:38.061 INFO:teuthology.orchestra.run.smithi063.stdout:[ERR] UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-07T16:26:38.061 INFO:teuthology.orchestra.run.smithi063.stdout: Unexpected exception occurred during upgrade process: osd require-osd-release failed: unrecognized release unknown retval: -22 2023-12-07T16:26:38.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:38.065+0000 7fb3a9827700 1 -- 172.21.15.63:0/1897354465 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fb38c06ce60 msgr2=0x7fb38c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:38.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:38.065+0000 7fb3a9827700 1 --2- 172.21.15.63:0/1897354465 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fb38c06ce60 0x7fb38c06f310 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb398004f40 tx=0x7fb39800b040 comp rx=0 tx=0).stop 2023-12-07T16:26:38.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:38.065+0000 7fb3a9827700 1 -- 172.21.15.63:0/1897354465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a4101b00 msgr2=0x7fb3a410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:38.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:38.065+0000 7fb3a9827700 1 --2- 172.21.15.63:0/1897354465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a4101b00 0x7fb3a410ec40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb39400b3b0 tx=0x7fb394009e30 comp rx=0 tx=0).stop 2023-12-07T16:26:38.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:38.066+0000 7fb3a9827700 1 -- 172.21.15.63:0/1897354465 shutdown_connections 2023-12-07T16:26:38.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:38.066+0000 7fb3a9827700 1 --2- 172.21.15.63:0/1897354465 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fb38c06ce60 0x7fb38c06f310 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:38.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:38.066+0000 7fb3a9827700 1 --2- 172.21.15.63:0/1897354465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3a40fbb40 0x7fb3a410e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:38.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:38.066+0000 7fb3a9827700 1 --2- 172.21.15.63:0/1897354465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3a4101b00 0x7fb3a410ec40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:38.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:38.066+0000 7fb3a9827700 1 -- 172.21.15.63:0/1897354465 >> 172.21.15.63:0/1897354465 conn(0x7fb3a40f76c0 msgr2=0x7fb3a40f93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:26:38.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:38.066+0000 7fb3a9827700 1 -- 172.21.15.63:0/1897354465 shutdown_connections 2023-12-07T16:26:38.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:38.066+0000 7fb3a9827700 1 -- 172.21.15.63:0/1897354465 wait complete. 2023-12-07T16:26:38.083 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:37 smithi063 ceph-mon[192008]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:26:38.083 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:37 smithi063 ceph-mon[192008]: pgmap v162: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:38.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:37 smithi152 ceph-mon[175645]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:26:38.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:37 smithi152 ceph-mon[175645]: pgmap v162: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:38.445 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph versions' 2023-12-07T16:26:38.718 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:26:39.028 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:38 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/1897354465' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:26:39.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:38 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/1897354465' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-07T16:26:39.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.749+0000 7fe84df2e700 1 -- 172.21.15.63:0/1160617358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe848065390 msgr2=0x7fe848065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:39.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.749+0000 7fe84df2e700 1 --2- 172.21.15.63:0/1160617358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe848065390 0x7fe848065800 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe83c004940 tx=0x7fe83c009e30 comp rx=0 tx=0).stop 2023-12-07T16:26:39.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.749+0000 7fe84df2e700 1 -- 172.21.15.63:0/1160617358 shutdown_connections 2023-12-07T16:26:39.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.749+0000 7fe84df2e700 1 --2- 172.21.15.63:0/1160617358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe848065390 0x7fe848065800 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:39.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.749+0000 7fe84df2e700 1 --2- 172.21.15.63:0/1160617358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe848102c20 0x7fe848102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:39.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.749+0000 7fe84df2e700 1 -- 172.21.15.63:0/1160617358 >> 172.21.15.63:0/1160617358 conn(0x7fe8480719b0 msgr2=0x7fe848071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:26:39.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.749+0000 7fe84df2e700 1 -- 172.21.15.63:0/1160617358 shutdown_connections 2023-12-07T16:26:39.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.749+0000 7fe84df2e700 1 -- 172.21.15.63:0/1160617358 wait complete. 2023-12-07T16:26:39.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.750+0000 7fe84df2e700 1 Processor -- start 2023-12-07T16:26:39.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.750+0000 7fe84df2e700 1 -- start start 2023-12-07T16:26:39.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.750+0000 7fe84df2e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe848065390 0x7fe848113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:39.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.750+0000 7fe84df2e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe848102c20 0x7fe848113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:39.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.750+0000 7fe84df2e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8481142c0 con 0x7fe848102c20 2023-12-07T16:26:39.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.750+0000 7fe84df2e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84810d5f0 con 0x7fe848065390 2023-12-07T16:26:39.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.750+0000 7fe846ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe848102c20 0x7fe848113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:39.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.750+0000 7fe846ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe848102c20 0x7fe848113c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45998/0 (socket says 172.21.15.63:45998) 2023-12-07T16:26:39.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.750+0000 7fe846ffd700 1 -- 172.21.15.63:0/276534021 learned_addr learned my addr 172.21.15.63:0/276534021 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:26:39.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.750+0000 7fe8477fe700 1 --2- 172.21.15.63:0/276534021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe848065390 0x7fe848113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:39.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.750+0000 7fe846ffd700 1 -- 172.21.15.63:0/276534021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe848065390 msgr2=0x7fe848113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:39.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.750+0000 7fe846ffd700 1 --2- 172.21.15.63:0/276534021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe848065390 0x7fe848113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:39.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.750+0000 7fe846ffd700 1 -- 172.21.15.63:0/276534021 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c005040 con 0x7fe848102c20 2023-12-07T16:26:39.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.751+0000 7fe846ffd700 1 --2- 172.21.15.63:0/276534021 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe848102c20 0x7fe848113c70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe83c00b3b0 tx=0x7fe83c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:26:39.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.751+0000 7fe82ffff700 1 -- 172.21.15.63:0/276534021 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe83c00e040 con 0x7fe848102c20 2023-12-07T16:26:39.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.751+0000 7fe84df2e700 1 -- 172.21.15.63:0/276534021 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe84810d870 con 0x7fe848102c20 2023-12-07T16:26:39.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.751+0000 7fe82ffff700 1 -- 172.21.15.63:0/276534021 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe83c01c430 con 0x7fe848102c20 2023-12-07T16:26:39.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.751+0000 7fe82ffff700 1 -- 172.21.15.63:0/276534021 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe83c013640 con 0x7fe848102c20 2023-12-07T16:26:39.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.751+0000 7fe84df2e700 1 -- 172.21.15.63:0/276534021 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84810ddb0 con 0x7fe848102c20 2023-12-07T16:26:39.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.752+0000 7fe84df2e700 1 -- 172.21.15.63:0/276534021 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8480fff40 con 0x7fe848102c20 2023-12-07T16:26:39.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.752+0000 7fe82ffff700 1 -- 172.21.15.63:0/276534021 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fe83c01c5a0 con 0x7fe848102c20 2023-12-07T16:26:39.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.753+0000 7fe82ffff700 1 --2- 172.21.15.63:0/276534021 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fe83006ce60 0x7fe83006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:26:39.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.753+0000 7fe82ffff700 1 -- 172.21.15.63:0/276534021 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6761+0+0 (secure 0 0 0) 0x7fe83c08cfe0 con 0x7fe848102c20 2023-12-07T16:26:39.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.753+0000 7fe8477fe700 1 --2- 172.21.15.63:0/276534021 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fe83006ce60 0x7fe83006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:26:39.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.753+0000 7fe8477fe700 1 --2- 172.21.15.63:0/276534021 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fe83006ce60 0x7fe83006f310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe838004f40 tx=0x7fe83800b040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:26:39.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:39.757+0000 7fe82ffff700 1 -- 172.21.15.63:0/276534021 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe83c0c02f0 con 0x7fe848102c20 2023-12-07T16:26:39.905 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:39 smithi063 ceph-mon[192008]: pgmap v163: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:40.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:40.040+0000 7fe84df2e700 1 -- 172.21.15.63:0/276534021 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe84804bb80 con 0x7fe848102c20 2023-12-07T16:26:40.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:40.041+0000 7fe82ffff700 1 -- 172.21.15.63:0/276534021 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+721 (secure 0 0 0) 0x7fe83c05a880 con 0x7fe848102c20 2023-12-07T16:26:40.038 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:26:40.038 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-07T16:26:40.038 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-07T16:26:40.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:26:40.038 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-07T16:26:40.038 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-07T16:26:40.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:26:40.038 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-07T16:26:40.038 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 6 2023-12-07T16:26:40.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:26:40.039 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-07T16:26:40.039 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 4 2023-12-07T16:26:40.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:26:40.039 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-07T16:26:40.039 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 4, 2023-12-07T16:26:40.039 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 10 2023-12-07T16:26:40.039 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-07T16:26:40.039 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:26:40.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:40.043+0000 7fe84df2e700 1 -- 172.21.15.63:0/276534021 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fe83006ce60 msgr2=0x7fe83006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:40.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:40.043+0000 7fe84df2e700 1 --2- 172.21.15.63:0/276534021 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fe83006ce60 0x7fe83006f310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe838004f40 tx=0x7fe83800b040 comp rx=0 tx=0).stop 2023-12-07T16:26:40.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:40.043+0000 7fe84df2e700 1 -- 172.21.15.63:0/276534021 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe848102c20 msgr2=0x7fe848113c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:26:40.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:40.043+0000 7fe84df2e700 1 --2- 172.21.15.63:0/276534021 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe848102c20 0x7fe848113c70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe83c00b3b0 tx=0x7fe83c009e30 comp rx=0 tx=0).stop 2023-12-07T16:26:40.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:40.043+0000 7fe84df2e700 1 -- 172.21.15.63:0/276534021 shutdown_connections 2023-12-07T16:26:40.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:40.043+0000 7fe84df2e700 1 --2- 172.21.15.63:0/276534021 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fe83006ce60 0x7fe83006f310 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:40.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:40.043+0000 7fe84df2e700 1 --2- 172.21.15.63:0/276534021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe848065390 0x7fe848113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:40.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:40.043+0000 7fe84df2e700 1 --2- 172.21.15.63:0/276534021 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe848102c20 0x7fe848113c70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:26:40.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:40.043+0000 7fe84df2e700 1 -- 172.21.15.63:0/276534021 >> 172.21.15.63:0/276534021 conn(0x7fe8480719b0 msgr2=0x7fe8480fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:26:40.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:40.043+0000 7fe84df2e700 1 -- 172.21.15.63:0/276534021 shutdown_connections 2023-12-07T16:26:40.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:26:40.043+0000 7fe84df2e700 1 -- 172.21.15.63:0/276534021 wait complete. 2023-12-07T16:26:40.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:39 smithi152 ceph-mon[175645]: pgmap v163: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:40.421 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2023-12-07T16:26:40.693 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:26:41.035 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:40 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/276534021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:26:41.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:40 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/276534021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:26:41.722 INFO:teuthology.orchestra.run.smithi063.stdout:wait for servicemap items w/ changing names to refresh 2023-12-07T16:26:41.968 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:41 smithi063 ceph-mon[192008]: pgmap v164: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:42.062 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'sleep 60' 2023-12-07T16:26:42.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:41 smithi152 ceph-mon[175645]: pgmap v164: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:42.339 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:26:44.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:43 smithi063 ceph-mon[192008]: pgmap v165: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:44.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:43 smithi152 ceph-mon[175645]: pgmap v165: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:45.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:44 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:26:45.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:44 smithi063 ceph-mon[192008]: pgmap v166: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:45.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:44 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:26:45.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:44 smithi152 ceph-mon[175645]: pgmap v166: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:47.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:47 smithi152 ceph-mon[175645]: pgmap v167: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:47.655 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:47 smithi063 ceph-mon[192008]: pgmap v167: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:49.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:49 smithi152 ceph-mon[175645]: pgmap v168: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:50.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:49 smithi063 ceph-mon[192008]: pgmap v168: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:51.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:51 smithi152 ceph-mon[175645]: pgmap v169: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:52.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:51 smithi063 ceph-mon[192008]: pgmap v169: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:53.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:53 smithi152 ceph-mon[175645]: pgmap v170: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:54.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:53 smithi063 ceph-mon[192008]: pgmap v170: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:55.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:55 smithi152 ceph-mon[175645]: pgmap v171: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:56.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:55 smithi063 ceph-mon[192008]: pgmap v171: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:57.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:57 smithi152 ceph-mon[175645]: pgmap v172: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:58.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:57 smithi063 ceph-mon[192008]: pgmap v172: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:59.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:59 smithi152 ceph-mon[175645]: pgmap v173: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:26:59.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:26:59 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:27:00.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:59 smithi063 ceph-mon[192008]: pgmap v173: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:00.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:26:59 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:27:01.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:01 smithi152 ceph-mon[175645]: pgmap v174: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:02.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:01 smithi063 ceph-mon[192008]: pgmap v174: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:03.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:03 smithi152 ceph-mon[175645]: pgmap v175: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:04.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:03 smithi063 ceph-mon[192008]: pgmap v175: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:05.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:05 smithi152 ceph-mon[175645]: pgmap v176: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:06.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:05 smithi063 ceph-mon[192008]: pgmap v176: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:07.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:07 smithi152 ceph-mon[175645]: pgmap v177: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:08.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:07 smithi063 ceph-mon[192008]: pgmap v177: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:09.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:09 smithi152 ceph-mon[175645]: pgmap v178: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:10.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:09 smithi063 ceph-mon[192008]: pgmap v178: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:11.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:11 smithi152 ceph-mon[175645]: pgmap v179: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:12.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:11 smithi063 ceph-mon[192008]: pgmap v179: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:13.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:13 smithi152 ceph-mon[175645]: pgmap v180: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:14.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:13 smithi063 ceph-mon[192008]: pgmap v180: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:14.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:27:14.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:14 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:27:15.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:27:15.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:14 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T16:27:15.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:15 smithi152 ceph-mon[175645]: pgmap v181: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:15.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:15 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:27:15.992 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:15 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:27:15.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:15 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:27:16.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:15 smithi063 ceph-mon[192008]: pgmap v181: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:16.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:15 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T16:27:16.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:15 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T16:27:16.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:15 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' 2023-12-07T16:27:18.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:17 smithi063 ceph-mon[192008]: pgmap v182: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:18.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:17 smithi152 ceph-mon[175645]: pgmap v182: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:20.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:19 smithi063 ceph-mon[192008]: pgmap v183: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:20.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:19 smithi152 ceph-mon[175645]: pgmap v183: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:22.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:21 smithi063 ceph-mon[192008]: pgmap v184: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:22.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:21 smithi152 ceph-mon[175645]: pgmap v184: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:24.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:23 smithi063 ceph-mon[192008]: pgmap v185: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:24.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:23 smithi152 ceph-mon[175645]: pgmap v185: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:26.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:25 smithi063 ceph-mon[192008]: pgmap v186: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:26.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:25 smithi152 ceph-mon[175645]: pgmap v186: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:28.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:27 smithi063 ceph-mon[192008]: pgmap v187: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:28.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:27 smithi152 ceph-mon[175645]: pgmap v187: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:30.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:29 smithi063 ceph-mon[192008]: pgmap v188: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:30.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:29 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:27:30.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:29 smithi152 ceph-mon[175645]: pgmap v188: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:30.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:29 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:27:32.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:31 smithi063 ceph-mon[192008]: pgmap v189: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:32.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:31 smithi152 ceph-mon[175645]: pgmap v189: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:34.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:33 smithi063 ceph-mon[192008]: pgmap v190: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:34.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:33 smithi152 ceph-mon[175645]: pgmap v190: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:36.156 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:35 smithi063 ceph-mon[192008]: pgmap v191: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:36.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:35 smithi152 ceph-mon[175645]: pgmap v191: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:38.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:37 smithi063 ceph-mon[192008]: pgmap v192: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:38.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:37 smithi152 ceph-mon[175645]: pgmap v192: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:40.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:39 smithi063 ceph-mon[192008]: pgmap v193: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:40.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:39 smithi152 ceph-mon[175645]: pgmap v193: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:42.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:41 smithi063 ceph-mon[192008]: pgmap v194: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:42.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:41 smithi152 ceph-mon[175645]: pgmap v194: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:43.522 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph orch ps' 2023-12-07T16:27:43.805 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:27:44.106 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:43 smithi063 ceph-mon[192008]: pgmap v195: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:44.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:43 smithi152 ceph-mon[175645]: pgmap v195: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:44.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.843+0000 7fdc5d6d6700 1 -- 172.21.15.63:0/2944936104 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc581035a0 msgr2=0x7fdc580fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:44.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.843+0000 7fdc5d6d6700 1 --2- 172.21.15.63:0/2944936104 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc581035a0 0x7fdc580fcc10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdc40004940 tx=0x7fdc40009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:44.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.843+0000 7fdc5d6d6700 1 -- 172.21.15.63:0/2944936104 shutdown_connections 2023-12-07T16:27:44.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.843+0000 7fdc5d6d6700 1 --2- 172.21.15.63:0/2944936104 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc581035a0 0x7fdc580fcc10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:44.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.843+0000 7fdc5d6d6700 1 --2- 172.21.15.63:0/2944936104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc58102c00 0x7fdc58102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:44.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.843+0000 7fdc5d6d6700 1 -- 172.21.15.63:0/2944936104 >> 172.21.15.63:0/2944936104 conn(0x7fdc580f8790 msgr2=0x7fdc580faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:44.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.843+0000 7fdc5d6d6700 1 -- 172.21.15.63:0/2944936104 shutdown_connections 2023-12-07T16:27:44.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.843+0000 7fdc5d6d6700 1 -- 172.21.15.63:0/2944936104 wait complete. 2023-12-07T16:27:44.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.844+0000 7fdc5d6d6700 1 Processor -- start 2023-12-07T16:27:44.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.844+0000 7fdc5d6d6700 1 -- start start 2023-12-07T16:27:44.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.844+0000 7fdc5d6d6700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc58102c00 0x7fdc581135d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:44.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.844+0000 7fdc5d6d6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc581035a0 0x7fdc58113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:44.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.844+0000 7fdc5d6d6700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc58114160 con 0x7fdc58102c00 2023-12-07T16:27:44.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.844+0000 7fdc5d6d6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5810d490 con 0x7fdc581035a0 2023-12-07T16:27:44.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.844+0000 7fdc56ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc58102c00 0x7fdc581135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:44.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.844+0000 7fdc56ffd700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc58102c00 0x7fdc581135d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47932/0 (socket says 172.21.15.63:47932) 2023-12-07T16:27:44.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.844+0000 7fdc56ffd700 1 -- 172.21.15.63:0/1469489981 learned_addr learned my addr 172.21.15.63:0/1469489981 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:27:44.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.845+0000 7fdc567fc700 1 --2- 172.21.15.63:0/1469489981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc581035a0 0x7fdc58113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:44.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.845+0000 7fdc56ffd700 1 -- 172.21.15.63:0/1469489981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc581035a0 msgr2=0x7fdc58113b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:44.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.845+0000 7fdc56ffd700 1 --2- 172.21.15.63:0/1469489981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc581035a0 0x7fdc58113b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:44.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.845+0000 7fdc56ffd700 1 -- 172.21.15.63:0/1469489981 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc40005040 con 0x7fdc58102c00 2023-12-07T16:27:44.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.845+0000 7fdc567fc700 1 --2- 172.21.15.63:0/1469489981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc581035a0 0x7fdc58113b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T16:27:44.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.845+0000 7fdc56ffd700 1 --2- 172.21.15.63:0/1469489981 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc58102c00 0x7fdc581135d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800eb40 tx=0x7fdc4800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:44.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.845+0000 7fdc4f7fe700 1 -- 172.21.15.63:0/1469489981 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc48007cc0 con 0x7fdc58102c00 2023-12-07T16:27:44.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.845+0000 7fdc5d6d6700 1 -- 172.21.15.63:0/1469489981 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc5810d710 con 0x7fdc58102c00 2023-12-07T16:27:44.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.845+0000 7fdc4f7fe700 1 -- 172.21.15.63:0/1469489981 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdc4800f040 con 0x7fdc58102c00 2023-12-07T16:27:44.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.845+0000 7fdc4f7fe700 1 -- 172.21.15.63:0/1469489981 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc48009570 con 0x7fdc58102c00 2023-12-07T16:27:44.845 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.845+0000 7fdc5d6d6700 1 -- 172.21.15.63:0/1469489981 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5810dc50 con 0x7fdc58102c00 2023-12-07T16:27:44.845 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.846+0000 7fdc5d6d6700 1 -- 172.21.15.63:0/1469489981 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc580fc390 con 0x7fdc58102c00 2023-12-07T16:27:44.845 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.847+0000 7fdc4f7fe700 1 -- 172.21.15.63:0/1469489981 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fdc480096d0 con 0x7fdc58102c00 2023-12-07T16:27:44.845 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.847+0000 7fdc4f7fe700 1 --2- 172.21.15.63:0/1469489981 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fdc4406ce70 0x7fdc4406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:44.845 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.847+0000 7fdc4f7fe700 1 -- 172.21.15.63:0/1469489981 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6761+0+0 (secure 0 0 0) 0x7fdc4808c0f0 con 0x7fdc58102c00 2023-12-07T16:27:44.845 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.847+0000 7fdc567fc700 1 --2- 172.21.15.63:0/1469489981 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fdc4406ce70 0x7fdc4406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:44.845 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.848+0000 7fdc567fc700 1 --2- 172.21.15.63:0/1469489981 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fdc4406ce70 0x7fdc4406f320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdc5810ee70 tx=0x7fdc40009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:44.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:44.852+0000 7fdc4f7fe700 1 -- 172.21.15.63:0/1469489981 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fdc480599b0 con 0x7fdc58102c00 2023-12-07T16:27:44.904 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:44 smithi063 ceph-mon[192008]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:27:45.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:45.061+0000 7fdc5d6d6700 1 -- 172.21.15.63:0/1469489981 --> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc5810ec50 con 0x7fdc4406ce70 2023-12-07T16:27:45.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:45.071+0000 7fdc4f7fe700 1 -- 172.21.15.63:0/1469489981 <== mgr.24519 v2:172.21.15.63:6800/685607028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fdc5810ec50 con 0x7fdc4406ce70 2023-12-07T16:27:45.068 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-07T16:27:45.068 INFO:teuthology.orchestra.run.smithi063.stdout:alertmanager.smithi063 smithi063 *:9093,9094 running (6m) 2m ago 12m 28.6M - 0.25.0 c8568f914cd2 c0526812d5fe 2023-12-07T16:27:45.068 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi063 smithi063 running (4m) 2m ago 12m 7474k - 19.0.0-13-ge6605fb8 104f332cd0a9 52adf44ea983 2023-12-07T16:27:45.068 INFO:teuthology.orchestra.run.smithi063.stdout:crash.smithi152 smithi152 running (4m) 94s ago 11m 7453k - 19.0.0-13-ge6605fb8 104f332cd0a9 9eba5b538b96 2023-12-07T16:27:45.068 INFO:teuthology.orchestra.run.smithi063.stdout:grafana.smithi063 smithi063 *:3000 running (6m) 2m ago 12m 91.4M - 9.4.7 954c08fa6188 cc2cde9a664f 2023-12-07T16:27:45.068 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.gsjgcq smithi063 running (8m) 2m ago 8m 15.2M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 f70e4f098e4c 2023-12-07T16:27:45.068 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi063.yidolg smithi063 running (8m) 2m ago 8m 5932M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5b053ef5fb7f 2023-12-07T16:27:45.068 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.aovwwd smithi152 running (8m) 94s ago 8m 16.3M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 80190948a595 2023-12-07T16:27:45.068 INFO:teuthology.orchestra.run.smithi063.stdout:mds.cephfs.smithi152.mrvngf smithi152 running (8m) 94s ago 8m 5114M - 17.2.7-115-g4f62d9ad fcdfd00f81c7 5f60b893f840 2023-12-07T16:27:45.068 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi063.yohyyx smithi063 *:8443,9283,8765 running (5m) 2m ago 13m 511M - 19.0.0-13-ge6605fb8 104f332cd0a9 b605f882784d 2023-12-07T16:27:45.069 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.smithi152.sxayfb smithi152 *:8443,9283,8765 running (5m) 94s ago 11m 451M - 19.0.0-13-ge6605fb8 104f332cd0a9 71716998ccc3 2023-12-07T16:27:45.069 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi063 smithi063 running (5m) 2m ago 13m 67.3M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 8d7d0c6bfea3 2023-12-07T16:27:45.069 INFO:teuthology.orchestra.run.smithi063.stdout:mon.smithi152 smithi152 running (4m) 94s ago 11m 58.0M 2048M 19.0.0-13-ge6605fb8 104f332cd0a9 883bb3425cf0 2023-12-07T16:27:45.069 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi063 smithi063 *:9100 running (6m) 2m ago 12m 18.9M - 1.5.0 0da6a335fe13 50d63981f746 2023-12-07T16:27:45.069 INFO:teuthology.orchestra.run.smithi063.stdout:node-exporter.smithi152 smithi152 *:9100 running (6m) 94s ago 11m 19.6M - 1.5.0 0da6a335fe13 627cda14f1a9 2023-12-07T16:27:45.069 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (4m) 2m ago 11m 189M 1568M 19.0.0-13-ge6605fb8 104f332cd0a9 5fab981f1333 2023-12-07T16:27:45.069 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi063 running (3m) 2m ago 10m 121M 1568M 19.0.0-13-ge6605fb8 104f332cd0a9 b78531e6dc96 2023-12-07T16:27:45.069 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi063 running (3m) 2m ago 10m 11.5M 1568M 19.0.0-13-ge6605fb8 104f332cd0a9 a473024763f8 2023-12-07T16:27:45.069 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi152 running (2m) 94s ago 10m 129M 2592M 19.0.0-13-ge6605fb8 104f332cd0a9 7c32a746ce82 2023-12-07T16:27:45.069 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi152 running (2m) 94s ago 9m 119M 2592M 19.0.0-13-ge6605fb8 104f332cd0a9 98e6e6e3a58e 2023-12-07T16:27:45.069 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi152 running (96s) 94s ago 9m 13.9M 2592M 19.0.0-13-ge6605fb8 104f332cd0a9 f3f47cf1e8e0 2023-12-07T16:27:45.069 INFO:teuthology.orchestra.run.smithi063.stdout:prometheus.smithi063 smithi063 *:9095 running (5m) 2m ago 11m 51.1M - 2.43.0 a07b618ecd1d 8a323520d9fd 2023-12-07T16:27:45.070 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:45.073+0000 7fdc5d6d6700 1 -- 172.21.15.63:0/1469489981 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fdc4406ce70 msgr2=0x7fdc4406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:45.070 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:45.073+0000 7fdc5d6d6700 1 --2- 172.21.15.63:0/1469489981 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fdc4406ce70 0x7fdc4406f320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdc5810ee70 tx=0x7fdc40009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:45.070 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:45.073+0000 7fdc5d6d6700 1 -- 172.21.15.63:0/1469489981 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc58102c00 msgr2=0x7fdc581135d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:45.070 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:45.073+0000 7fdc5d6d6700 1 --2- 172.21.15.63:0/1469489981 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc58102c00 0x7fdc581135d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800eb40 tx=0x7fdc4800b040 comp rx=0 tx=0).stop 2023-12-07T16:27:45.070 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:45.073+0000 7fdc5d6d6700 1 -- 172.21.15.63:0/1469489981 shutdown_connections 2023-12-07T16:27:45.070 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:45.073+0000 7fdc5d6d6700 1 --2- 172.21.15.63:0/1469489981 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fdc4406ce70 0x7fdc4406f320 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:45.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:45.073+0000 7fdc5d6d6700 1 --2- 172.21.15.63:0/1469489981 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc58102c00 0x7fdc581135d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:45.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:45.073+0000 7fdc5d6d6700 1 --2- 172.21.15.63:0/1469489981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc581035a0 0x7fdc58113b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:45.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:45.073+0000 7fdc5d6d6700 1 -- 172.21.15.63:0/1469489981 >> 172.21.15.63:0/1469489981 conn(0x7fdc580f8790 msgr2=0x7fdc580fa240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:45.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:45.073+0000 7fdc5d6d6700 1 -- 172.21.15.63:0/1469489981 shutdown_connections 2023-12-07T16:27:45.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:45.073+0000 7fdc5d6d6700 1 -- 172.21.15.63:0/1469489981 wait complete. 2023-12-07T16:27:45.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:44 smithi152 ceph-mon[175645]: from='mgr.24519 172.21.15.63:0/2194149910' entity='mgr.smithi063.yohyyx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T16:27:45.437 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph versions' 2023-12-07T16:27:45.710 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:27:46.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:45 smithi063 ceph-mon[192008]: pgmap v196: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:46.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:45 smithi152 ceph-mon[175645]: pgmap v196: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:46.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.769+0000 7ff262d84700 1 -- 172.21.15.63:0/3387704875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff25c1035a0 msgr2=0x7ff25c0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:46.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.769+0000 7ff262d84700 1 --2- 172.21.15.63:0/3387704875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff25c1035a0 0x7ff25c0fcc10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff248004940 tx=0x7ff248009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:46.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.769+0000 7ff262d84700 1 -- 172.21.15.63:0/3387704875 shutdown_connections 2023-12-07T16:27:46.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.769+0000 7ff262d84700 1 --2- 172.21.15.63:0/3387704875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff25c1035a0 0x7ff25c0fcc10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:46.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.769+0000 7ff262d84700 1 --2- 172.21.15.63:0/3387704875 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff25c102c00 0x7ff25c102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:46.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.769+0000 7ff262d84700 1 -- 172.21.15.63:0/3387704875 >> 172.21.15.63:0/3387704875 conn(0x7ff25c0f8790 msgr2=0x7ff25c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:46.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.769+0000 7ff262d84700 1 -- 172.21.15.63:0/3387704875 shutdown_connections 2023-12-07T16:27:46.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.769+0000 7ff262d84700 1 -- 172.21.15.63:0/3387704875 wait complete. 2023-12-07T16:27:46.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.769+0000 7ff262d84700 1 Processor -- start 2023-12-07T16:27:46.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.769+0000 7ff262d84700 1 -- start start 2023-12-07T16:27:46.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.770+0000 7ff262d84700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff25c102c00 0x7ff25c113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:46.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.770+0000 7ff262d84700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff25c1035a0 0x7ff25c113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:46.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.770+0000 7ff262d84700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c114210 con 0x7ff25c1035a0 2023-12-07T16:27:46.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.770+0000 7ff262d84700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c10d500 con 0x7ff25c102c00 2023-12-07T16:27:46.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.770+0000 7ff25bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff25c1035a0 0x7ff25c113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:46.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.770+0000 7ff25bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff25c1035a0 0x7ff25c113bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47950/0 (socket says 172.21.15.63:47950) 2023-12-07T16:27:46.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.770+0000 7ff25bfff700 1 -- 172.21.15.63:0/1140780231 learned_addr learned my addr 172.21.15.63:0/1140780231 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:27:46.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.770+0000 7ff260b20700 1 --2- 172.21.15.63:0/1140780231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff25c102c00 0x7ff25c113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:46.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.770+0000 7ff25bfff700 1 -- 172.21.15.63:0/1140780231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff25c102c00 msgr2=0x7ff25c113680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:46.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.770+0000 7ff25bfff700 1 --2- 172.21.15.63:0/1140780231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff25c102c00 0x7ff25c113680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:46.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.770+0000 7ff25bfff700 1 -- 172.21.15.63:0/1140780231 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff248005040 con 0x7ff25c1035a0 2023-12-07T16:27:46.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.770+0000 7ff25bfff700 1 --2- 172.21.15.63:0/1140780231 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff25c1035a0 0x7ff25c113bc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff248009fd0 tx=0x7ff248009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:46.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.771+0000 7ff2597fa700 1 -- 172.21.15.63:0/1140780231 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff24800e040 con 0x7ff25c1035a0 2023-12-07T16:27:46.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.771+0000 7ff2597fa700 1 -- 172.21.15.63:0/1140780231 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff248013420 con 0x7ff25c1035a0 2023-12-07T16:27:46.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.771+0000 7ff262d84700 1 -- 172.21.15.63:0/1140780231 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25c10d780 con 0x7ff25c1035a0 2023-12-07T16:27:46.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.771+0000 7ff2597fa700 1 -- 172.21.15.63:0/1140780231 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff24801c630 con 0x7ff25c1035a0 2023-12-07T16:27:46.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.771+0000 7ff262d84700 1 -- 172.21.15.63:0/1140780231 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff25c10dcc0 con 0x7ff25c1035a0 2023-12-07T16:27:46.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.772+0000 7ff262d84700 1 -- 172.21.15.63:0/1140780231 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff25c113310 con 0x7ff25c1035a0 2023-12-07T16:27:46.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.772+0000 7ff2597fa700 1 -- 172.21.15.63:0/1140780231 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7ff248013a00 con 0x7ff25c1035a0 2023-12-07T16:27:46.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.772+0000 7ff2597fa700 1 --2- 172.21.15.63:0/1140780231 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7ff24c06ce60 0x7ff24c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:46.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.773+0000 7ff2597fa700 1 -- 172.21.15.63:0/1140780231 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6761+0+0 (secure 0 0 0) 0x7ff24808d570 con 0x7ff25c1035a0 2023-12-07T16:27:46.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.773+0000 7ff260b20700 1 --2- 172.21.15.63:0/1140780231 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7ff24c06ce60 0x7ff24c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:46.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.773+0000 7ff260b20700 1 --2- 172.21.15.63:0/1140780231 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7ff24c06ce60 0x7ff24c06f310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff250004f40 tx=0x7ff25000b040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:46.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:46.777+0000 7ff2597fa700 1 -- 172.21.15.63:0/1140780231 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff24805aea0 con 0x7ff25c1035a0 2023-12-07T16:27:46.904 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:46 smithi063 ceph-mon[192008]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:27:47.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:47.065+0000 7ff262d84700 1 -- 172.21.15.63:0/1140780231 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff25c04bb80 con 0x7ff25c1035a0 2023-12-07T16:27:47.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:47.066+0000 7ff2597fa700 1 -- 172.21.15.63:0/1140780231 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+721 (secure 0 0 0) 0x7ff24805aa30 con 0x7ff25c1035a0 2023-12-07T16:27:47.063 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-07T16:27:47.063 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": { 2023-12-07T16:27:47.063 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-07T16:27:47.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:27:47.063 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": { 2023-12-07T16:27:47.064 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 2 2023-12-07T16:27:47.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:27:47.064 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": { 2023-12-07T16:27:47.064 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 6 2023-12-07T16:27:47.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:27:47.064 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": { 2023-12-07T16:27:47.064 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 4 2023-12-07T16:27:47.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-07T16:27:47.064 INFO:teuthology.orchestra.run.smithi063.stdout: "overall": { 2023-12-07T16:27:47.064 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 17.2.7-115-g4f62d9ad (4f62d9ad74f167611e0396f21180a147cab03370) quincy (stable)": 4, 2023-12-07T16:27:47.064 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph version 19.0.0-13-ge6605fb8 (e6605fb8725c25c4838cef6a39f30df73f1ed149) reef (dev)": 10 2023-12-07T16:27:47.065 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-07T16:27:47.065 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-07T16:27:47.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:47.068+0000 7ff262d84700 1 -- 172.21.15.63:0/1140780231 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7ff24c06ce60 msgr2=0x7ff24c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:47.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:47.068+0000 7ff262d84700 1 --2- 172.21.15.63:0/1140780231 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7ff24c06ce60 0x7ff24c06f310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff250004f40 tx=0x7ff25000b040 comp rx=0 tx=0).stop 2023-12-07T16:27:47.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:47.068+0000 7ff262d84700 1 -- 172.21.15.63:0/1140780231 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff25c1035a0 msgr2=0x7ff25c113bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:47.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:47.068+0000 7ff262d84700 1 --2- 172.21.15.63:0/1140780231 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff25c1035a0 0x7ff25c113bc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff248009fd0 tx=0x7ff248009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:47.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:47.068+0000 7ff262d84700 1 -- 172.21.15.63:0/1140780231 shutdown_connections 2023-12-07T16:27:47.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:47.068+0000 7ff262d84700 1 --2- 172.21.15.63:0/1140780231 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7ff24c06ce60 0x7ff24c06f310 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:47.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:47.068+0000 7ff262d84700 1 --2- 172.21.15.63:0/1140780231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff25c102c00 0x7ff25c113680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:47.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:47.068+0000 7ff262d84700 1 --2- 172.21.15.63:0/1140780231 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff25c1035a0 0x7ff25c113bc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:47.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:47.068+0000 7ff262d84700 1 -- 172.21.15.63:0/1140780231 >> 172.21.15.63:0/1140780231 conn(0x7ff25c0f8790 msgr2=0x7ff25c0fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:47.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:47.068+0000 7ff262d84700 1 -- 172.21.15.63:0/1140780231 shutdown_connections 2023-12-07T16:27:47.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:47.068+0000 7ff262d84700 1 -- 172.21.15.63:0/1140780231 wait complete. 2023-12-07T16:27:47.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:46 smithi152 ceph-mon[175645]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T16:27:47.436 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2023-12-07T16:27:47.710 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/mon.smithi063/config 2023-12-07T16:27:48.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:47 smithi063 ceph-mon[192008]: pgmap v197: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:48.155 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:47 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/1140780231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:27:48.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:47 smithi152 ceph-mon[175645]: pgmap v197: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:48.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:47 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/1140780231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:27:48.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.753+0000 7fa8a4f23700 1 -- 172.21.15.63:0/1366248514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8a0103590 msgr2=0x7fa8a00fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:48.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.753+0000 7fa8a4f23700 1 --2- 172.21.15.63:0/1366248514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8a0103590 0x7fa8a00fcc00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa894004940 tx=0x7fa894009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:48.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.753+0000 7fa8a4f23700 1 -- 172.21.15.63:0/1366248514 shutdown_connections 2023-12-07T16:27:48.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.753+0000 7fa8a4f23700 1 --2- 172.21.15.63:0/1366248514 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8a0103590 0x7fa8a00fcc00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:48.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.753+0000 7fa8a4f23700 1 --2- 172.21.15.63:0/1366248514 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8a0102bf0 0x7fa8a0102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:48.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.753+0000 7fa8a4f23700 1 -- 172.21.15.63:0/1366248514 >> 172.21.15.63:0/1366248514 conn(0x7fa8a00f87a0 msgr2=0x7fa8a00fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:48.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.753+0000 7fa8a4f23700 1 -- 172.21.15.63:0/1366248514 shutdown_connections 2023-12-07T16:27:48.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.753+0000 7fa8a4f23700 1 -- 172.21.15.63:0/1366248514 wait complete. 2023-12-07T16:27:48.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.753+0000 7fa8a4f23700 1 Processor -- start 2023-12-07T16:27:48.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.753+0000 7fa8a4f23700 1 -- start start 2023-12-07T16:27:48.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.754+0000 7fa8a4f23700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8a0102bf0 0x7fa8a0113660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:48.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.754+0000 7fa8a4f23700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8a0103590 0x7fa8a0113be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:48.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.754+0000 7fa8a4f23700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a010d520 con 0x7fa8a0103590 2023-12-07T16:27:48.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.754+0000 7fa8a4f23700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a010d690 con 0x7fa8a0102bf0 2023-12-07T16:27:48.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.754+0000 7fa89dd9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8a0103590 0x7fa8a0113be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:48.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.754+0000 7fa89dd9b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8a0103590 0x7fa8a0113be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47968/0 (socket says 172.21.15.63:47968) 2023-12-07T16:27:48.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.754+0000 7fa89dd9b700 1 -- 172.21.15.63:0/2331788077 learned_addr learned my addr 172.21.15.63:0/2331788077 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:27:48.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.754+0000 7fa89e59c700 1 --2- 172.21.15.63:0/2331788077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8a0102bf0 0x7fa8a0113660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:48.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.754+0000 7fa89dd9b700 1 -- 172.21.15.63:0/2331788077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8a0102bf0 msgr2=0x7fa8a0113660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:48.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.754+0000 7fa89dd9b700 1 --2- 172.21.15.63:0/2331788077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8a0102bf0 0x7fa8a0113660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:48.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.754+0000 7fa89dd9b700 1 -- 172.21.15.63:0/2331788077 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa894005040 con 0x7fa8a0103590 2023-12-07T16:27:48.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.754+0000 7fa89dd9b700 1 --2- 172.21.15.63:0/2331788077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8a0103590 0x7fa8a0113be0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa894009380 tx=0x7fa894009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:48.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.754+0000 7fa88effd700 1 -- 172.21.15.63:0/2331788077 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa89400e040 con 0x7fa8a0103590 2023-12-07T16:27:48.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.755+0000 7fa8a4f23700 1 -- 172.21.15.63:0/2331788077 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a010d910 con 0x7fa8a0103590 2023-12-07T16:27:48.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.755+0000 7fa88effd700 1 -- 172.21.15.63:0/2331788077 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa89400bc50 con 0x7fa8a0103590 2023-12-07T16:27:48.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.755+0000 7fa88effd700 1 -- 172.21.15.63:0/2331788077 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa89401c3f0 con 0x7fa8a0103590 2023-12-07T16:27:48.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.755+0000 7fa8a4f23700 1 -- 172.21.15.63:0/2331788077 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a010de50 con 0x7fa8a0103590 2023-12-07T16:27:48.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.756+0000 7fa8a4f23700 1 -- 172.21.15.63:0/2331788077 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a00fff00 con 0x7fa8a0103590 2023-12-07T16:27:48.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.756+0000 7fa88effd700 1 -- 172.21.15.63:0/2331788077 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fa894013420 con 0x7fa8a0103590 2023-12-07T16:27:48.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.757+0000 7fa88effd700 1 --2- 172.21.15.63:0/2331788077 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fa88806ce60 0x7fa88806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:48.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.757+0000 7fa88effd700 1 -- 172.21.15.63:0/2331788077 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6761+0+0 (secure 0 0 0) 0x7fa89408d840 con 0x7fa8a0103590 2023-12-07T16:27:48.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.757+0000 7fa89e59c700 1 --2- 172.21.15.63:0/2331788077 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fa88806ce60 0x7fa88806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:48.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.757+0000 7fa89e59c700 1 --2- 172.21.15.63:0/2331788077 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fa88806ce60 0x7fa88806f310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa890006fd0 tx=0x7fa890008040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:48.758 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:48.761+0000 7fa88effd700 1 -- 172.21.15.63:0/2331788077 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa89405b0d0 con 0x7fa8a0103590 2023-12-07T16:27:49.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.048+0000 7fa8a4f23700 1 -- 172.21.15.63:0/2331788077 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa8a004bb80 con 0x7fa8a0103590 2023-12-07T16:27:49.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.048+0000 7fa88effd700 1 -- 172.21.15.63:0/2331788077 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+721 (secure 0 0 0) 0x7fa89405ac60 con 0x7fa8a0103590 2023-12-07T16:27:49.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.050+0000 7fa8a4f23700 1 -- 172.21.15.63:0/2331788077 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fa88806ce60 msgr2=0x7fa88806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:49.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.050+0000 7fa8a4f23700 1 --2- 172.21.15.63:0/2331788077 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fa88806ce60 0x7fa88806f310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa890006fd0 tx=0x7fa890008040 comp rx=0 tx=0).stop 2023-12-07T16:27:49.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.050+0000 7fa8a4f23700 1 -- 172.21.15.63:0/2331788077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8a0103590 msgr2=0x7fa8a0113be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:49.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.050+0000 7fa8a4f23700 1 --2- 172.21.15.63:0/2331788077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8a0103590 0x7fa8a0113be0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa894009380 tx=0x7fa894009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:49.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.050+0000 7fa8a4f23700 1 -- 172.21.15.63:0/2331788077 shutdown_connections 2023-12-07T16:27:49.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.050+0000 7fa8a4f23700 1 --2- 172.21.15.63:0/2331788077 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fa88806ce60 0x7fa88806f310 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:49.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.050+0000 7fa8a4f23700 1 --2- 172.21.15.63:0/2331788077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8a0102bf0 0x7fa8a0113660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:49.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.050+0000 7fa8a4f23700 1 --2- 172.21.15.63:0/2331788077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8a0103590 0x7fa8a0113be0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:49.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.050+0000 7fa8a4f23700 1 -- 172.21.15.63:0/2331788077 >> 172.21.15.63:0/2331788077 conn(0x7fa8a00f87a0 msgr2=0x7fa8a00fa200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:49.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.050+0000 7fa8a4f23700 1 -- 172.21.15.63:0/2331788077 shutdown_connections 2023-12-07T16:27:49.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.051+0000 7fa8a4f23700 1 -- 172.21.15.63:0/2331788077 wait complete. 2023-12-07T16:27:49.058 INFO:teuthology.orchestra.run.smithi063.stdout:false 2023-12-07T16:27:49.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T16:27:49.445 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_e6605fb8725c25c4838cef6a39f30df73f1ed149/qa/tasks/cephadm.py", line 1351, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/git.ceph.com_ceph-c_e6605fb8725c25c4838cef6a39f30df73f1ed149/qa/tasks/cephadm.py", line 40, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-07T16:27:49.512 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=924e4a7a8b1e40b5b68f8c06f4ee930b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_e6605fb8725c25c4838cef6a39f30df73f1ed149/qa/tasks/cephadm.py", line 1351, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/git.ceph.com_ceph-c_e6605fb8725c25c4838cef6a39f30df73f1ed149/qa/tasks/cephadm.py", line 40, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-07T16:27:49.515 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-07T16:27:49.525 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-07T16:27:49.525 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-07T16:27:49.525 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T16:27:49.550 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-07T16:27:49.550 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T16:27:49.610 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T16:27:49.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.778+0000 7f6652a0b700 1 -- 172.21.15.63:0/2422736305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f664c0fdd10 msgr2=0x7f664c0fe0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:49.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.778+0000 7f6652a0b700 1 --2- 172.21.15.63:0/2422736305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f664c0fdd10 0x7f664c0fe0e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f663c004940 tx=0x7f663c009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:49.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.778+0000 7f6652a0b700 1 -- 172.21.15.63:0/2422736305 shutdown_connections 2023-12-07T16:27:49.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.778+0000 7f6652a0b700 1 --2- 172.21.15.63:0/2422736305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f664c0fe6b0 0x7f664c106cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:49.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.778+0000 7f6652a0b700 1 --2- 172.21.15.63:0/2422736305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f664c0fdd10 0x7f664c0fe0e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:49.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.778+0000 7f6652a0b700 1 -- 172.21.15.63:0/2422736305 >> 172.21.15.63:0/2422736305 conn(0x7f664c0f7760 msgr2=0x7f664c0f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:49.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.779+0000 7f6652a0b700 1 -- 172.21.15.63:0/2422736305 shutdown_connections 2023-12-07T16:27:49.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.779+0000 7f6652a0b700 1 -- 172.21.15.63:0/2422736305 wait complete. 2023-12-07T16:27:49.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.779+0000 7f6652a0b700 1 Processor -- start 2023-12-07T16:27:49.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.779+0000 7f6652a0b700 1 -- start start 2023-12-07T16:27:49.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.779+0000 7f6652a0b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f664c0fdd10 0x7f664c113410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:49.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.779+0000 7f6652a0b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f664c0fe6b0 0x7f664c113950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:49.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.779+0000 7f6652a0b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664c113fa0 con 0x7f664c0fdd10 2023-12-07T16:27:49.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.779+0000 7f6652a0b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664c10d500 con 0x7f664c0fe6b0 2023-12-07T16:27:49.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.780+0000 7f664bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f664c0fdd10 0x7f664c113410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:49.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.780+0000 7f664bfff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f664c0fdd10 0x7f664c113410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54982/0 (socket says 172.21.15.63:54982) 2023-12-07T16:27:49.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.780+0000 7f664bfff700 1 -- 172.21.15.63:0/570941659 learned_addr learned my addr 172.21.15.63:0/570941659 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:27:49.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.780+0000 7f664b7fe700 1 --2- 172.21.15.63:0/570941659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f664c0fe6b0 0x7f664c113950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:49.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.780+0000 7f664bfff700 1 -- 172.21.15.63:0/570941659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f664c0fe6b0 msgr2=0x7f664c113950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:49.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.780+0000 7f664bfff700 1 --2- 172.21.15.63:0/570941659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f664c0fe6b0 0x7f664c113950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:49.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.780+0000 7f664bfff700 1 -- 172.21.15.63:0/570941659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c005040 con 0x7f664c0fdd10 2023-12-07T16:27:49.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.780+0000 7f664b7fe700 1 --2- 172.21.15.63:0/570941659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f664c0fe6b0 0x7f664c113950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T16:27:49.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.780+0000 7f664bfff700 1 --2- 172.21.15.63:0/570941659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f664c0fdd10 0x7f664c113410 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f663c00b3b0 tx=0x7f663c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:49.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.780+0000 7f6648ff9700 1 -- 172.21.15.63:0/570941659 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f663c00e040 con 0x7f664c0fdd10 2023-12-07T16:27:49.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.780+0000 7f6648ff9700 1 -- 172.21.15.63:0/570941659 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f663c004290 con 0x7f664c0fdd10 2023-12-07T16:27:49.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.780+0000 7f6652a0b700 1 -- 172.21.15.63:0/570941659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f664c10d7e0 con 0x7f664c0fdd10 2023-12-07T16:27:49.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.780+0000 7f6648ff9700 1 -- 172.21.15.63:0/570941659 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f663c01c3f0 con 0x7f664c0fdd10 2023-12-07T16:27:49.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.780+0000 7f6652a0b700 1 -- 172.21.15.63:0/570941659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f664c10dd20 con 0x7f664c0fdd10 2023-12-07T16:27:49.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.781+0000 7f6652a0b700 1 -- 172.21.15.63:0/570941659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f664c104300 con 0x7f664c0fdd10 2023-12-07T16:27:49.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.782+0000 7f6648ff9700 1 -- 172.21.15.63:0/570941659 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f663c00bc50 con 0x7f664c0fdd10 2023-12-07T16:27:49.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.782+0000 7f6648ff9700 1 --2- 172.21.15.63:0/570941659 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f663406ce60 0x7f663406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:49.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.782+0000 7f6648ff9700 1 -- 172.21.15.63:0/570941659 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f663c08d870 con 0x7f664c0fdd10 2023-12-07T16:27:49.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.782+0000 7f664b7fe700 1 --2- 172.21.15.63:0/570941659 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f663406ce60 0x7f663406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:49.782 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.783+0000 7f664b7fe700 1 --2- 172.21.15.63:0/570941659 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f663406ce60 0x7f663406f310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6640009fd0 tx=0x7f664000b040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:49.783 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.787+0000 7f6648ff9700 1 -- 172.21.15.63:0/570941659 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f663c057670 con 0x7f664c0fdd10 2023-12-07T16:27:49.987 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.990+0000 7f6652a0b700 1 -- 172.21.15.63:0/570941659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f664c064960 con 0x7f664c0fdd10 2023-12-07T16:27:49.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.991+0000 7f6648ff9700 1 -- 172.21.15.63:0/570941659 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+17022 (secure 0 0 0) 0x7f663c05ac90 con 0x7f664c0fdd10 2023-12-07T16:27:49.988 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:27:49.989 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":91,"fsid":"8c493298-951b-11ee-95a2-87774f69a715","created":"2023-12-07T16:14:03.401177+0000","modified":"2023-12-07T16:26:15.751658+0000","last_up_change":"2023-12-07T16:26:14.749686+0000","last_in_change":"2023-12-07T16:18:06.682768+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T16:17:29.746142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-07T16:19:07.228292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-07T16:19:07.772770+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8cce319-d8dc-49e7-8596-ba27cc0f8836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":58,"up_thru":90,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":1000489680},{"type":"v1","addr":"172.21.15.63:6803","nonce":1000489680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":1000489680},{"type":"v1","addr":"172.21.15.63:6805","nonce":1000489680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":1000489680},{"type":"v1","addr":"172.21.15.63:6809","nonce":1000489680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":1000489680},{"type":"v1","addr":"172.21.15.63:6807","nonce":1000489680}]},"public_addr":"172.21.15.63:6803/1000489680","cluster_addr":"172.21.15.63:6805/1000489680","heartbeat_back_addr":"172.21.15.63:6809/1000489680","heartbeat_front_addr":"172.21.15.63:6807/1000489680","state":["exists","up"]},{"osd":1,"uuid":"4f6f5869-8c07-49cf-8d7e-4eaab3f54f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":66,"up_from":70,"up_thru":90,"down_at":67,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":394258268},{"type":"v1","addr":"172.21.15.63:6811","nonce":394258268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":394258268},{"type":"v1","addr":"172.21.15.63:6813","nonce":394258268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":394258268},{"type":"v1","addr":"172.21.15.63:6817","nonce":394258268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":394258268},{"type":"v1","addr":"172.21.15.63:6815","nonce":394258268}]},"public_addr":"172.21.15.63:6811/394258268","cluster_addr":"172.21.15.63:6813/394258268","heartbeat_back_addr":"172.21.15.63:6817/394258268","heartbeat_front_addr":"172.21.15.63:6815/394258268","state":["exists","up"]},{"osd":2,"uuid":"42f79427-9cc3-42aa-91ab-4c28094437d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":71,"up_from":75,"up_thru":90,"down_at":72,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2943243764},{"type":"v1","addr":"172.21.15.63:6819","nonce":2943243764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":2943243764},{"type":"v1","addr":"172.21.15.63:6821","nonce":2943243764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":2943243764},{"type":"v1","addr":"172.21.15.63:6825","nonce":2943243764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2943243764},{"type":"v1","addr":"172.21.15.63:6823","nonce":2943243764}]},"public_addr":"172.21.15.63:6819/2943243764","cluster_addr":"172.21.15.63:6821/2943243764","heartbeat_back_addr":"172.21.15.63:6825/2943243764","heartbeat_front_addr":"172.21.15.63:6823/2943243764","state":["exists","up"]},{"osd":3,"uuid":"57bde3cf-c59d-4ccb-9d76-894dc48e51b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":76,"up_from":80,"up_thru":90,"down_at":77,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1412291615},{"type":"v1","addr":"172.21.15.152:6801","nonce":1412291615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1412291615},{"type":"v1","addr":"172.21.15.152:6803","nonce":1412291615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":1412291615},{"type":"v1","addr":"172.21.15.152:6807","nonce":1412291615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1412291615},{"type":"v1","addr":"172.21.15.152:6805","nonce":1412291615}]},"public_addr":"172.21.15.152:6801/1412291615","cluster_addr":"172.21.15.152:6803/1412291615","heartbeat_back_addr":"172.21.15.152:6807/1412291615","heartbeat_front_addr":"172.21.15.152:6805/1412291615","state":["exists","up"]},{"osd":4,"uuid":"1de5b172-cde3-4139-a24d-8d8c2d3f71da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":33,"last_clean_end":81,"up_from":85,"up_thru":90,"down_at":82,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":2649809826},{"type":"v1","addr":"172.21.15.152:6809","nonce":2649809826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":2649809826},{"type":"v1","addr":"172.21.15.152:6811","nonce":2649809826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":2649809826},{"type":"v1","addr":"172.21.15.152:6815","nonce":2649809826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2649809826},{"type":"v1","addr":"172.21.15.152:6813","nonce":2649809826}]},"public_addr":"172.21.15.152:6809/2649809826","cluster_addr":"172.21.15.152:6811/2649809826","heartbeat_back_addr":"172.21.15.152:6815/2649809826","heartbeat_front_addr":"172.21.15.152:6813/2649809826","state":["exists","up"]},{"osd":5,"uuid":"15256051-a7b8-4fb0-8bc5-d865cb551551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":38,"last_clean_end":86,"up_from":90,"up_thru":90,"down_at":87,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3235100730},{"type":"v1","addr":"172.21.15.152:6817","nonce":3235100730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3235100730},{"type":"v1","addr":"172.21.15.152:6819","nonce":3235100730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3235100730},{"type":"v1","addr":"172.21.15.152:6823","nonce":3235100730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3235100730},{"type":"v1","addr":"172.21.15.152:6821","nonce":3235100730}]},"public_addr":"172.21.15.152:6817/3235100730","cluster_addr":"172.21.15.152:6819/3235100730","heartbeat_back_addr":"172.21.15.152:6823/3235100730","heartbeat_front_addr":"172.21.15.152:6821/3235100730","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:16:47.295417+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:17:06.714097+0000","dead_epoch":66},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:17:26.421837+0000","dead_epoch":71},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:17:44.503538+0000","dead_epoch":76},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:18:02.822131+0000","dead_epoch":81},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:18:21.243021+0000","dead_epoch":86}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":3,"to":2}]},{"pgid":"2.6","mappings":[{"from":3,"to":0}]},{"pgid":"2.b","mappings":[{"from":3,"to":0}]},{"pgid":"3.3","mappings":[{"from":4,"to":5}]},{"pgid":"3.a","mappings":[{"from":3,"to":0}]},{"pgid":"3.e","mappings":[{"from":4,"to":0}]},{"pgid":"3.12","mappings":[{"from":1,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/575811576":"2023-12-08T16:22:43.907227+0000","172.21.15.63:6801/2671097541":"2023-12-08T16:22:43.907227+0000","172.21.15.63:0/4071489754":"2023-12-08T16:22:43.907227+0000","172.21.15.152:6829/1927275654":"2023-12-08T16:21:57.014828+0000","172.21.15.63:6800/1052036735":"2023-12-08T16:14:59.065782+0000","172.21.15.63:0/273758973":"2023-12-08T16:20:48.497388+0000","172.21.15.63:0/4058757998":"2023-12-08T16:14:27.410651+0000","172.21.15.63:6801/1052036735":"2023-12-08T16:14:59.065782+0000","172.21.15.152:0/3306394385":"2023-12-08T16:21:57.014828+0000","172.21.15.63:6800/4069965417":"2023-12-08T16:15:55.242508+0000","172.21.15.63:6801/4069965417":"2023-12-08T16:15:55.242508+0000","172.21.15.63:0/127598952":"2023-12-08T16:14:59.065782+0000","172.21.15.63:0/363151719":"2023-12-08T16:14:59.065782+0000","172.21.15.152:0/3377928690":"2023-12-08T16:21:57.014828+0000","172.21.15.152:0/1067436557":"2023-12-08T16:21:57.014828+0000","172.21.15.152:6828/1927275654":"2023-12-08T16:21:57.014828+0000","172.21.15.152:0/2032192045":"2023-12-08T16:21:57.014828+0000","172.21.15.152:0/2803495435":"2023-12-08T16:21:57.014828+0000","172.21.15.63:0/1828519471":"2023-12-08T16:14:27.410651+0000","172.21.15.63:0/335090021":"2023-12-08T16:20:48.497388+0000","172.21.15.63:0/396959949":"2023-12-08T16:15:55.242508+0000","172.21.15.63:6827/1994067670":"2023-12-08T16:19:18.402193+0000","172.21.15.63:0/1270045079":"2023-12-08T16:15:55.242508+0000","172.21.15.63:6800/2117148141":"2023-12-08T16:14:27.410651+0000","172.21.15.63:0/997543331":"2023-12-08T16:14:27.410651+0000","172.21.15.63:0/1615460383":"2023-12-08T16:22:43.907227+0000","172.21.15.63:0/2684412075":"2023-12-08T16:20:48.497388+0000","172.21.15.152:0/2939852977":"2023-12-08T16:21:57.014828+0000","172.21.15.63:0/916788374":"2023-12-08T16:20:48.497388+0000","172.21.15.63:0/3526304932":"2023-12-08T16:22:43.907227+0000","172.21.15.63:6800/184283085":"2023-12-08T16:20:48.497388+0000","172.21.15.63:6826/1994067670":"2023-12-08T16:19:18.402193+0000","172.21.15.63:6801/184283085":"2023-12-08T16:20:48.497388+0000","172.21.15.63:0/3523609322":"2023-12-08T16:14:59.065782+0000","172.21.15.63:6801/2117148141":"2023-12-08T16:14:27.410651+0000","172.21.15.63:0/847416253":"2023-12-08T16:22:43.907227+0000","172.21.15.63:0/3827601892":"2023-12-08T16:15:55.242508+0000","172.21.15.63:0/3244857768":"2023-12-08T16:22:43.907227+0000","172.21.15.63:6800/2671097541":"2023-12-08T16:22:43.907227+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T16:27:49.990 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.993+0000 7f6652a0b700 1 -- 172.21.15.63:0/570941659 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f663406ce60 msgr2=0x7f663406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:49.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.993+0000 7f6652a0b700 1 --2- 172.21.15.63:0/570941659 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f663406ce60 0x7f663406f310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6640009fd0 tx=0x7f664000b040 comp rx=0 tx=0).stop 2023-12-07T16:27:49.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.993+0000 7f6652a0b700 1 -- 172.21.15.63:0/570941659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f664c0fdd10 msgr2=0x7f664c113410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:49.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.993+0000 7f6652a0b700 1 --2- 172.21.15.63:0/570941659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f664c0fdd10 0x7f664c113410 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f663c00b3b0 tx=0x7f663c009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:49.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.993+0000 7f6652a0b700 1 -- 172.21.15.63:0/570941659 shutdown_connections 2023-12-07T16:27:49.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.993+0000 7f6652a0b700 1 --2- 172.21.15.63:0/570941659 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f663406ce60 0x7f663406f310 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:49.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.993+0000 7f6652a0b700 1 --2- 172.21.15.63:0/570941659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f664c0fdd10 0x7f664c113410 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:49.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.993+0000 7f6652a0b700 1 --2- 172.21.15.63:0/570941659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f664c0fe6b0 0x7f664c113950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:49.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.993+0000 7f6652a0b700 1 -- 172.21.15.63:0/570941659 >> 172.21.15.63:0/570941659 conn(0x7f664c0f7760 msgr2=0x7f664c101480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:49.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.994+0000 7f6652a0b700 1 -- 172.21.15.63:0/570941659 shutdown_connections 2023-12-07T16:27:49.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:49.994+0000 7f6652a0b700 1 -- 172.21.15.63:0/570941659 wait complete. 2023-12-07T16:27:50.001 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:49 smithi063 ceph-mon[192008]: pgmap v198: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:50.002 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:49 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/2331788077' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:27:50.003 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T16:17:29.746142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-07T16:19:07.228292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-07T16:19:07.772770+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T16:27:50.003 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T16:27:50.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.131+0000 7fabc9d5e700 1 -- 172.21.15.63:0/365610618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabc4101ac0 msgr2=0x7fabc4101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:50.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.131+0000 7fabc9d5e700 1 --2- 172.21.15.63:0/365610618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabc4101ac0 0x7fabc4101e90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fabb4004940 tx=0x7fabb4009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:50.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.131+0000 7fabc9d5e700 1 -- 172.21.15.63:0/365610618 shutdown_connections 2023-12-07T16:27:50.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.131+0000 7fabc9d5e700 1 --2- 172.21.15.63:0/365610618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabc41023d0 0x7fabc40fba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:50.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.131+0000 7fabc9d5e700 1 --2- 172.21.15.63:0/365610618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabc4101ac0 0x7fabc4101e90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:50.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.131+0000 7fabc9d5e700 1 -- 172.21.15.63:0/365610618 >> 172.21.15.63:0/365610618 conn(0x7fabc4071970 msgr2=0x7fabc4071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:50.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.132+0000 7fabc9d5e700 1 -- 172.21.15.63:0/365610618 shutdown_connections 2023-12-07T16:27:50.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.132+0000 7fabc9d5e700 1 -- 172.21.15.63:0/365610618 wait complete. 2023-12-07T16:27:50.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.132+0000 7fabc9d5e700 1 Processor -- start 2023-12-07T16:27:50.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.132+0000 7fabc9d5e700 1 -- start start 2023-12-07T16:27:50.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.132+0000 7fabc9d5e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabc4101ac0 0x7fabc410e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:50.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.132+0000 7fabc9d5e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabc41023d0 0x7fabc410e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:50.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.132+0000 7fabc9d5e700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc410eeb0 con 0x7fabc4101ac0 2023-12-07T16:27:50.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.132+0000 7fabc9d5e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc410eff0 con 0x7fabc41023d0 2023-12-07T16:27:50.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.133+0000 7fabc37fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabc4101ac0 0x7fabc410e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:50.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.133+0000 7fabc37fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabc4101ac0 0x7fabc410e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54998/0 (socket says 172.21.15.63:54998) 2023-12-07T16:27:50.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.133+0000 7fabc37fe700 1 -- 172.21.15.63:0/2744877705 learned_addr learned my addr 172.21.15.63:0/2744877705 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:27:50.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.133+0000 7fabc37fe700 1 -- 172.21.15.63:0/2744877705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabc41023d0 msgr2=0x7fabc410e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:50.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.133+0000 7fabc2ffd700 1 --2- 172.21.15.63:0/2744877705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabc41023d0 0x7fabc410e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:50.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.133+0000 7fabc37fe700 1 --2- 172.21.15.63:0/2744877705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabc41023d0 0x7fabc410e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:50.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.133+0000 7fabc37fe700 1 -- 172.21.15.63:0/2744877705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb4005040 con 0x7fabc4101ac0 2023-12-07T16:27:50.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.133+0000 7fabc37fe700 1 --2- 172.21.15.63:0/2744877705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabc4101ac0 0x7fabc410e430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fabb400b3b0 tx=0x7fabb4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:50.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.133+0000 7fababfff700 1 -- 172.21.15.63:0/2744877705 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabb400e040 con 0x7fabc4101ac0 2023-12-07T16:27:50.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.133+0000 7fabc9d5e700 1 -- 172.21.15.63:0/2744877705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc410f270 con 0x7fabc4101ac0 2023-12-07T16:27:50.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.133+0000 7fababfff700 1 -- 172.21.15.63:0/2744877705 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fabb400bd20 con 0x7fabc4101ac0 2023-12-07T16:27:50.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.133+0000 7fababfff700 1 -- 172.21.15.63:0/2744877705 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabb4013660 con 0x7fabc4101ac0 2023-12-07T16:27:50.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.133+0000 7fabc9d5e700 1 -- 172.21.15.63:0/2744877705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc41178a0 con 0x7fabc4101ac0 2023-12-07T16:27:50.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.134+0000 7fabc9d5e700 1 -- 172.21.15.63:0/2744877705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc40fece0 con 0x7fabc4101ac0 2023-12-07T16:27:50.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.135+0000 7fababfff700 1 -- 172.21.15.63:0/2744877705 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fabb401c430 con 0x7fabc4101ac0 2023-12-07T16:27:50.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.135+0000 7fababfff700 1 --2- 172.21.15.63:0/2744877705 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fabac06ce60 0x7fabac06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:50.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.135+0000 7fababfff700 1 -- 172.21.15.63:0/2744877705 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6761+0+0 (secure 0 0 0) 0x7fabb408d3e0 con 0x7fabc4101ac0 2023-12-07T16:27:50.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.135+0000 7fabc2ffd700 1 --2- 172.21.15.63:0/2744877705 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fabac06ce60 0x7fabac06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:50.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.136+0000 7fabc2ffd700 1 --2- 172.21.15.63:0/2744877705 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fabac06ce60 0x7fabac06f310 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fabc4065430 tx=0x7fabb800b040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:50.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.140+0000 7fababfff700 1 -- 172.21.15.63:0/2744877705 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fabb40571e0 con 0x7fabc4101ac0 2023-12-07T16:27:50.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:49 smithi152 ceph-mon[175645]: pgmap v198: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:50.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:49 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/2331788077' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-07T16:27:50.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.337+0000 7fabc9d5e700 1 -- 172.21.15.63:0/2744877705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fabc4065210 con 0x7fabc4101ac0 2023-12-07T16:27:50.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.338+0000 7fababfff700 1 -- 172.21.15.63:0/2744877705 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7fabb405a800 con 0x7fabc4101ac0 2023-12-07T16:27:50.335 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-07T16:27:50.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.340+0000 7fabc9d5e700 1 -- 172.21.15.63:0/2744877705 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fabac06ce60 msgr2=0x7fabac06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:50.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.340+0000 7fabc9d5e700 1 --2- 172.21.15.63:0/2744877705 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fabac06ce60 0x7fabac06f310 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fabc4065430 tx=0x7fabb800b040 comp rx=0 tx=0).stop 2023-12-07T16:27:50.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.340+0000 7fabc9d5e700 1 -- 172.21.15.63:0/2744877705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabc4101ac0 msgr2=0x7fabc410e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:50.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.340+0000 7fabc9d5e700 1 --2- 172.21.15.63:0/2744877705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabc4101ac0 0x7fabc410e430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fabb400b3b0 tx=0x7fabb4009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:50.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.340+0000 7fabc9d5e700 1 -- 172.21.15.63:0/2744877705 shutdown_connections 2023-12-07T16:27:50.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.340+0000 7fabc9d5e700 1 --2- 172.21.15.63:0/2744877705 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fabac06ce60 0x7fabac06f310 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:50.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.340+0000 7fabc9d5e700 1 --2- 172.21.15.63:0/2744877705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabc4101ac0 0x7fabc410e430 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:50.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.340+0000 7fabc9d5e700 1 --2- 172.21.15.63:0/2744877705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabc41023d0 0x7fabc410e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:50.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.340+0000 7fabc9d5e700 1 -- 172.21.15.63:0/2744877705 >> 172.21.15.63:0/2744877705 conn(0x7fabc4071970 msgr2=0x7fabc40faf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:50.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.340+0000 7fabc9d5e700 1 -- 172.21.15.63:0/2744877705 shutdown_connections 2023-12-07T16:27:50.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.340+0000 7fabc9d5e700 1 -- 172.21.15.63:0/2744877705 wait complete. 2023-12-07T16:27:50.349 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-07T16:27:50.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.476+0000 7f4fbfbb3700 1 -- 172.21.15.63:0/1830968847 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb8102bb0 msgr2=0x7f4fb8102f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:50.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.476+0000 7f4fbfbb3700 1 --2- 172.21.15.63:0/1830968847 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb8102bb0 0x7f4fb8102f80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4004940 tx=0x7f4fb4009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:50.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.476+0000 7f4fbfbb3700 1 -- 172.21.15.63:0/1830968847 shutdown_connections 2023-12-07T16:27:50.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.476+0000 7f4fbfbb3700 1 --2- 172.21.15.63:0/1830968847 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fb8064bb0 0x7f4fb8065000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:50.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.476+0000 7f4fbfbb3700 1 --2- 172.21.15.63:0/1830968847 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb8102bb0 0x7f4fb8102f80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:50.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.476+0000 7f4fbfbb3700 1 -- 172.21.15.63:0/1830968847 >> 172.21.15.63:0/1830968847 conn(0x7f4fb8071970 msgr2=0x7f4fb8071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:50.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.476+0000 7f4fbfbb3700 1 -- 172.21.15.63:0/1830968847 shutdown_connections 2023-12-07T16:27:50.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.477+0000 7f4fbfbb3700 1 -- 172.21.15.63:0/1830968847 wait complete. 2023-12-07T16:27:50.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.477+0000 7f4fbfbb3700 1 Processor -- start 2023-12-07T16:27:50.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.477+0000 7f4fbfbb3700 1 -- start start 2023-12-07T16:27:50.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.477+0000 7f4fbfbb3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fb8064bb0 0x7f4fb8113340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:50.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.477+0000 7f4fbfbb3700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb8102bb0 0x7f4fb8113880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:50.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.477+0000 7f4fbfbb3700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb8113ed0 con 0x7f4fb8102bb0 2023-12-07T16:27:50.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.477+0000 7f4fbfbb3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb810d3f0 con 0x7f4fb8064bb0 2023-12-07T16:27:50.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.477+0000 7f4fbd14e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb8102bb0 0x7f4fb8113880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:50.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.477+0000 7f4fbd14e700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb8102bb0 0x7f4fb8113880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55016/0 (socket says 172.21.15.63:55016) 2023-12-07T16:27:50.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.477+0000 7f4fbd14e700 1 -- 172.21.15.63:0/22441804 learned_addr learned my addr 172.21.15.63:0/22441804 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:27:50.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.478+0000 7f4fbd94f700 1 --2- 172.21.15.63:0/22441804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fb8064bb0 0x7f4fb8113340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:50.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.478+0000 7f4fbd14e700 1 -- 172.21.15.63:0/22441804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fb8064bb0 msgr2=0x7f4fb8113340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:50.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.478+0000 7f4fbd14e700 1 --2- 172.21.15.63:0/22441804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fb8064bb0 0x7f4fb8113340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:50.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.478+0000 7f4fbd14e700 1 -- 172.21.15.63:0/22441804 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb4005040 con 0x7f4fb8102bb0 2023-12-07T16:27:50.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.478+0000 7f4fbd14e700 1 --2- 172.21.15.63:0/22441804 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb8102bb0 0x7f4fb8113880 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4fac002a50 tx=0x7f4fac0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:50.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.478+0000 7f4faa7fc700 1 -- 172.21.15.63:0/22441804 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fac007cc0 con 0x7f4fb8102bb0 2023-12-07T16:27:50.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.478+0000 7f4faa7fc700 1 -- 172.21.15.63:0/22441804 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4fac00f040 con 0x7f4fb8102bb0 2023-12-07T16:27:50.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.478+0000 7f4fbfbb3700 1 -- 172.21.15.63:0/22441804 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb810d6d0 con 0x7f4fb8102bb0 2023-12-07T16:27:50.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.478+0000 7f4faa7fc700 1 -- 172.21.15.63:0/22441804 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fac009540 con 0x7f4fb8102bb0 2023-12-07T16:27:50.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.478+0000 7f4fbfbb3700 1 -- 172.21.15.63:0/22441804 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb810dc90 con 0x7f4fb8102bb0 2023-12-07T16:27:50.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.479+0000 7f4fbfbb3700 1 -- 172.21.15.63:0/22441804 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb8064730 con 0x7f4fb8102bb0 2023-12-07T16:27:50.479 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.480+0000 7f4faa7fc700 1 -- 172.21.15.63:0/22441804 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f4fac0096a0 con 0x7f4fb8102bb0 2023-12-07T16:27:50.479 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.480+0000 7f4faa7fc700 1 --2- 172.21.15.63:0/22441804 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f4fa406ce60 0x7f4fa406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:50.479 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.480+0000 7f4faa7fc700 1 -- 172.21.15.63:0/22441804 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f4fac08c140 con 0x7f4fb8102bb0 2023-12-07T16:27:50.479 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.480+0000 7f4fbd94f700 1 --2- 172.21.15.63:0/22441804 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f4fa406ce60 0x7f4fa406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:50.479 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.480+0000 7f4fbd94f700 1 --2- 172.21.15.63:0/22441804 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f4fa406ce60 0x7f4fa406f310 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4004f90 tx=0x7f4fb4009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:50.481 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.485+0000 7f4faa7fc700 1 -- 172.21.15.63:0/22441804 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4fac0599d0 con 0x7f4fb8102bb0 2023-12-07T16:27:50.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.685+0000 7f4fbfbb3700 1 -- 172.21.15.63:0/22441804 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f4fb8109ab0 con 0x7f4fb8102bb0 2023-12-07T16:27:50.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.685+0000 7f4faa7fc700 1 -- 172.21.15.63:0/22441804 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v91) v1 ==== 107+0+11 (secure 0 0 0) 0x7f4fac059560 con 0x7f4fb8102bb0 2023-12-07T16:27:50.683 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-07T16:27:50.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.688+0000 7f4fbfbb3700 1 -- 172.21.15.63:0/22441804 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f4fa406ce60 msgr2=0x7f4fa406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:50.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.688+0000 7f4fbfbb3700 1 --2- 172.21.15.63:0/22441804 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f4fa406ce60 0x7f4fa406f310 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4004f90 tx=0x7f4fb4009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:50.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.688+0000 7f4fbfbb3700 1 -- 172.21.15.63:0/22441804 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb8102bb0 msgr2=0x7f4fb8113880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:50.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.688+0000 7f4fbfbb3700 1 --2- 172.21.15.63:0/22441804 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb8102bb0 0x7f4fb8113880 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4fac002a50 tx=0x7f4fac0046b0 comp rx=0 tx=0).stop 2023-12-07T16:27:50.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.688+0000 7f4fbfbb3700 1 -- 172.21.15.63:0/22441804 shutdown_connections 2023-12-07T16:27:50.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.688+0000 7f4fbfbb3700 1 --2- 172.21.15.63:0/22441804 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f4fa406ce60 0x7f4fa406f310 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:50.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.688+0000 7f4fbfbb3700 1 --2- 172.21.15.63:0/22441804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fb8064bb0 0x7f4fb8113340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:50.686 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.688+0000 7f4fbfbb3700 1 --2- 172.21.15.63:0/22441804 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb8102bb0 0x7f4fb8113880 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:50.686 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.688+0000 7f4fbfbb3700 1 -- 172.21.15.63:0/22441804 >> 172.21.15.63:0/22441804 conn(0x7f4fb8071970 msgr2=0x7f4fb80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:50.686 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.688+0000 7f4fbfbb3700 1 -- 172.21.15.63:0/22441804 shutdown_connections 2023-12-07T16:27:50.686 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.688+0000 7f4fbfbb3700 1 -- 172.21.15.63:0/22441804 wait complete. 2023-12-07T16:27:50.697 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-07T16:27:50.824 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.825+0000 7fe507388700 1 -- 172.21.15.63:0/3824081756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe500101ac0 msgr2=0x7fe500101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:50.824 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.825+0000 7fe507388700 1 --2- 172.21.15.63:0/3824081756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe500101ac0 0x7fe500101e90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc004940 tx=0x7fe4fc009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:50.824 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.825+0000 7fe507388700 1 -- 172.21.15.63:0/3824081756 shutdown_connections 2023-12-07T16:27:50.824 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.825+0000 7fe507388700 1 --2- 172.21.15.63:0/3824081756 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5001023d0 0x7fe5000fba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:50.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.825+0000 7fe507388700 1 --2- 172.21.15.63:0/3824081756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe500101ac0 0x7fe500101e90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:50.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.825+0000 7fe507388700 1 -- 172.21.15.63:0/3824081756 >> 172.21.15.63:0/3824081756 conn(0x7fe500071970 msgr2=0x7fe500071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:50.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.826+0000 7fe507388700 1 -- 172.21.15.63:0/3824081756 shutdown_connections 2023-12-07T16:27:50.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.826+0000 7fe507388700 1 -- 172.21.15.63:0/3824081756 wait complete. 2023-12-07T16:27:50.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.826+0000 7fe507388700 1 Processor -- start 2023-12-07T16:27:50.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.826+0000 7fe507388700 1 -- start start 2023-12-07T16:27:50.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.826+0000 7fe507388700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe500101ac0 0x7fe50010e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:50.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.826+0000 7fe507388700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5001023d0 0x7fe50010e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:50.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.826+0000 7fe507388700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50010ee20 con 0x7fe500101ac0 2023-12-07T16:27:50.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.826+0000 7fe507388700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50010ef60 con 0x7fe5001023d0 2023-12-07T16:27:50.826 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.826+0000 7fe505124700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe500101ac0 0x7fe50010e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:50.826 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.826+0000 7fe505124700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe500101ac0 0x7fe50010e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55046/0 (socket says 172.21.15.63:55046) 2023-12-07T16:27:50.826 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.826+0000 7fe505124700 1 -- 172.21.15.63:0/554310994 learned_addr learned my addr 172.21.15.63:0/554310994 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:27:50.826 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.827+0000 7fe504923700 1 --2- 172.21.15.63:0/554310994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5001023d0 0x7fe50010e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:50.826 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.827+0000 7fe505124700 1 -- 172.21.15.63:0/554310994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5001023d0 msgr2=0x7fe50010e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:50.826 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.827+0000 7fe505124700 1 --2- 172.21.15.63:0/554310994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5001023d0 0x7fe50010e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:50.826 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.827+0000 7fe505124700 1 -- 172.21.15.63:0/554310994 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4fc005040 con 0x7fe500101ac0 2023-12-07T16:27:50.826 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.827+0000 7fe505124700 1 --2- 172.21.15.63:0/554310994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe500101ac0 0x7fe50010e3a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00b3b0 tx=0x7fe4fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:50.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.827+0000 7fe4f5ffb700 1 -- 172.21.15.63:0/554310994 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4fc00e040 con 0x7fe500101ac0 2023-12-07T16:27:50.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.827+0000 7fe4f5ffb700 1 -- 172.21.15.63:0/554310994 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe4fc00bd20 con 0x7fe500101ac0 2023-12-07T16:27:50.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.827+0000 7fe507388700 1 -- 172.21.15.63:0/554310994 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe50010f1e0 con 0x7fe500101ac0 2023-12-07T16:27:50.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.827+0000 7fe4f5ffb700 1 -- 172.21.15.63:0/554310994 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4fc013660 con 0x7fe500101ac0 2023-12-07T16:27:50.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.827+0000 7fe507388700 1 -- 172.21.15.63:0/554310994 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe500117810 con 0x7fe500101ac0 2023-12-07T16:27:50.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.828+0000 7fe507388700 1 -- 172.21.15.63:0/554310994 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe500064730 con 0x7fe500101ac0 2023-12-07T16:27:50.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.829+0000 7fe4f5ffb700 1 -- 172.21.15.63:0/554310994 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fe4fc01c430 con 0x7fe500101ac0 2023-12-07T16:27:50.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.829+0000 7fe4f5ffb700 1 --2- 172.21.15.63:0/554310994 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fe4ec06ce60 0x7fe4ec06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:50.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.829+0000 7fe4f5ffb700 1 -- 172.21.15.63:0/554310994 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6761+0+0 (secure 0 0 0) 0x7fe4fc08d380 con 0x7fe500101ac0 2023-12-07T16:27:50.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.829+0000 7fe504923700 1 --2- 172.21.15.63:0/554310994 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fe4ec06ce60 0x7fe4ec06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:50.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.830+0000 7fe504923700 1 --2- 172.21.15.63:0/554310994 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fe4ec06ce60 0x7fe4ec06f310 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009fd0 tx=0x7fe4f0009f60 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:50.830 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:50.834+0000 7fe4f5ffb700 1 -- 172.21.15.63:0/554310994 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe4fc057180 con 0x7fe500101ac0 2023-12-07T16:27:51.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.032+0000 7fe507388700 1 -- 172.21.15.63:0/554310994 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fe500108a10 con 0x7fe500101ac0 2023-12-07T16:27:51.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.032+0000 7fe4f5ffb700 1 -- 172.21.15.63:0/554310994 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v91) v1 ==== 107+0+11 (secure 0 0 0) 0x7fe4fc05a7a0 con 0x7fe500101ac0 2023-12-07T16:27:51.029 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-07T16:27:51.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.034+0000 7fe507388700 1 -- 172.21.15.63:0/554310994 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fe4ec06ce60 msgr2=0x7fe4ec06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:51.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.034+0000 7fe507388700 1 --2- 172.21.15.63:0/554310994 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fe4ec06ce60 0x7fe4ec06f310 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009fd0 tx=0x7fe4f0009f60 comp rx=0 tx=0).stop 2023-12-07T16:27:51.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.034+0000 7fe507388700 1 -- 172.21.15.63:0/554310994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe500101ac0 msgr2=0x7fe50010e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:51.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.034+0000 7fe507388700 1 --2- 172.21.15.63:0/554310994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe500101ac0 0x7fe50010e3a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00b3b0 tx=0x7fe4fc009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:51.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.034+0000 7fe507388700 1 -- 172.21.15.63:0/554310994 shutdown_connections 2023-12-07T16:27:51.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.034+0000 7fe507388700 1 --2- 172.21.15.63:0/554310994 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fe4ec06ce60 0x7fe4ec06f310 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:51.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.034+0000 7fe507388700 1 --2- 172.21.15.63:0/554310994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe500101ac0 0x7fe50010e3a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:51.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.034+0000 7fe507388700 1 --2- 172.21.15.63:0/554310994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5001023d0 0x7fe50010e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:51.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.034+0000 7fe507388700 1 -- 172.21.15.63:0/554310994 >> 172.21.15.63:0/554310994 conn(0x7fe500071970 msgr2=0x7fe5000fae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:51.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.034+0000 7fe507388700 1 -- 172.21.15.63:0/554310994 shutdown_connections 2023-12-07T16:27:51.033 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.034+0000 7fe507388700 1 -- 172.21.15.63:0/554310994 wait complete. 2023-12-07T16:27:51.042 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:50 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/570941659' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-07T16:27:51.042 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:50 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/2744877705' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-07T16:27:51.042 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:50 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/22441804' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-07T16:27:51.044 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-07T16:27:51.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.172+0000 7f725a3aa700 1 -- 172.21.15.63:0/2595737275 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72540fb910 msgr2=0x7f72540fbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:51.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.172+0000 7f725a3aa700 1 --2- 172.21.15.63:0/2595737275 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72540fb910 0x7f72540fbce0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7244004940 tx=0x7f7244009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:51.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.172+0000 7f725a3aa700 1 -- 172.21.15.63:0/2595737275 shutdown_connections 2023-12-07T16:27:51.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.172+0000 7f725a3aa700 1 --2- 172.21.15.63:0/2595737275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72540fc220 0x7f7254108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:51.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.172+0000 7f725a3aa700 1 --2- 172.21.15.63:0/2595737275 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72540fb910 0x7f72540fbce0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:51.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.172+0000 7f725a3aa700 1 -- 172.21.15.63:0/2595737275 >> 172.21.15.63:0/2595737275 conn(0x7f72540f7600 msgr2=0x7f72540f9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:51.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.172+0000 7f725a3aa700 1 -- 172.21.15.63:0/2595737275 shutdown_connections 2023-12-07T16:27:51.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.172+0000 7f725a3aa700 1 -- 172.21.15.63:0/2595737275 wait complete. 2023-12-07T16:27:51.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.173+0000 7f725a3aa700 1 Processor -- start 2023-12-07T16:27:51.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.173+0000 7f725a3aa700 1 -- start start 2023-12-07T16:27:51.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.173+0000 7f725a3aa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72540fb910 0x7f7254115410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:51.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.173+0000 7f725a3aa700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72540fc220 0x7f7254115950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:51.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.173+0000 7f725a3aa700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7254115fa0 con 0x7f72540fc220 2023-12-07T16:27:51.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.173+0000 7f725a3aa700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725410f500 con 0x7f72540fb910 2023-12-07T16:27:51.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.173+0000 7f72537fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72540fc220 0x7f7254115950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:51.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.173+0000 7f72537fe700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72540fc220 0x7f7254115950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55078/0 (socket says 172.21.15.63:55078) 2023-12-07T16:27:51.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.173+0000 7f72537fe700 1 -- 172.21.15.63:0/3647230453 learned_addr learned my addr 172.21.15.63:0/3647230453 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:27:51.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.173+0000 7f7253fff700 1 --2- 172.21.15.63:0/3647230453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72540fb910 0x7f7254115410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:51.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.174+0000 7f72537fe700 1 -- 172.21.15.63:0/3647230453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72540fb910 msgr2=0x7f7254115410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:51.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.174+0000 7f72537fe700 1 --2- 172.21.15.63:0/3647230453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72540fb910 0x7f7254115410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:51.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.174+0000 7f72537fe700 1 -- 172.21.15.63:0/3647230453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7244005040 con 0x7f72540fc220 2023-12-07T16:27:51.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.174+0000 7f7253fff700 1 --2- 172.21.15.63:0/3647230453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72540fb910 0x7f7254115410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T16:27:51.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.174+0000 7f72537fe700 1 --2- 172.21.15.63:0/3647230453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72540fc220 0x7f7254115950 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7248002a50 tx=0x7f72480046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:51.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.174+0000 7f7250ff9700 1 -- 172.21.15.63:0/3647230453 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7248007cc0 con 0x7f72540fc220 2023-12-07T16:27:51.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.174+0000 7f7250ff9700 1 -- 172.21.15.63:0/3647230453 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f724800f040 con 0x7f72540fc220 2023-12-07T16:27:51.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.174+0000 7f725a3aa700 1 -- 172.21.15.63:0/3647230453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f725410f7e0 con 0x7f72540fc220 2023-12-07T16:27:51.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.174+0000 7f7250ff9700 1 -- 172.21.15.63:0/3647230453 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7248009540 con 0x7f72540fc220 2023-12-07T16:27:51.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.174+0000 7f725a3aa700 1 -- 172.21.15.63:0/3647230453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f725410fda0 con 0x7f72540fc220 2023-12-07T16:27:51.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.175+0000 7f725a3aa700 1 -- 172.21.15.63:0/3647230453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72541066b0 con 0x7f72540fc220 2023-12-07T16:27:51.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.175+0000 7f7250ff9700 1 -- 172.21.15.63:0/3647230453 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f72480096a0 con 0x7f72540fc220 2023-12-07T16:27:51.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.176+0000 7f7250ff9700 1 --2- 172.21.15.63:0/3647230453 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f723c06ce60 0x7f723c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:51.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.176+0000 7f7253fff700 1 --2- 172.21.15.63:0/3647230453 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f723c06ce60 0x7f723c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:51.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.176+0000 7f7250ff9700 1 -- 172.21.15.63:0/3647230453 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f724808c250 con 0x7f72540fc220 2023-12-07T16:27:51.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.176+0000 7f7253fff700 1 --2- 172.21.15.63:0/3647230453 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f723c06ce60 0x7f723c06f310 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7244004560 tx=0x7f7244009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:51.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.181+0000 7f7250ff9700 1 -- 172.21.15.63:0/3647230453 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7248055fd0 con 0x7f72540fc220 2023-12-07T16:27:51.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:50 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/570941659' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-07T16:27:51.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:50 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/2744877705' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-07T16:27:51.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:50 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/22441804' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-07T16:27:51.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.396+0000 7f725a3aa700 1 -- 172.21.15.63:0/3647230453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7254110a30 con 0x7f72540fc220 2023-12-07T16:27:51.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.397+0000 7f7250ff9700 1 -- 172.21.15.63:0/3647230453 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v91) v1 ==== 81+0+2301 (secure 0 0 0) 0x7f72480595f0 con 0x7f72540fc220 2023-12-07T16:27:51.394 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/575811576 2023-12-08T16:22:43.907227+0000 2023-12-07T16:27:51.394 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/2671097541 2023-12-08T16:22:43.907227+0000 2023-12-07T16:27:51.394 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/4071489754 2023-12-08T16:22:43.907227+0000 2023-12-07T16:27:51.394 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.152:6829/1927275654 2023-12-08T16:21:57.014828+0000 2023-12-07T16:27:51.394 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/1052036735 2023-12-08T16:14:59.065782+0000 2023-12-07T16:27:51.394 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/273758973 2023-12-08T16:20:48.497388+0000 2023-12-07T16:27:51.394 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/4058757998 2023-12-08T16:14:27.410651+0000 2023-12-07T16:27:51.395 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/1052036735 2023-12-08T16:14:59.065782+0000 2023-12-07T16:27:51.395 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.152:0/3306394385 2023-12-08T16:21:57.014828+0000 2023-12-07T16:27:51.395 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/4069965417 2023-12-08T16:15:55.242508+0000 2023-12-07T16:27:51.395 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/4069965417 2023-12-08T16:15:55.242508+0000 2023-12-07T16:27:51.395 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/127598952 2023-12-08T16:14:59.065782+0000 2023-12-07T16:27:51.395 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/363151719 2023-12-08T16:14:59.065782+0000 2023-12-07T16:27:51.395 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.152:0/3377928690 2023-12-08T16:21:57.014828+0000 2023-12-07T16:27:51.395 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.152:0/1067436557 2023-12-08T16:21:57.014828+0000 2023-12-07T16:27:51.396 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.152:6828/1927275654 2023-12-08T16:21:57.014828+0000 2023-12-07T16:27:51.396 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.152:0/2032192045 2023-12-08T16:21:57.014828+0000 2023-12-07T16:27:51.396 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.152:0/2803495435 2023-12-08T16:21:57.014828+0000 2023-12-07T16:27:51.396 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1828519471 2023-12-08T16:14:27.410651+0000 2023-12-07T16:27:51.396 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/335090021 2023-12-08T16:20:48.497388+0000 2023-12-07T16:27:51.396 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/396959949 2023-12-08T16:15:55.242508+0000 2023-12-07T16:27:51.396 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6827/1994067670 2023-12-08T16:19:18.402193+0000 2023-12-07T16:27:51.396 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1270045079 2023-12-08T16:15:55.242508+0000 2023-12-07T16:27:51.396 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/2117148141 2023-12-08T16:14:27.410651+0000 2023-12-07T16:27:51.397 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/997543331 2023-12-08T16:14:27.410651+0000 2023-12-07T16:27:51.397 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1615460383 2023-12-08T16:22:43.907227+0000 2023-12-07T16:27:51.397 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/2684412075 2023-12-08T16:20:48.497388+0000 2023-12-07T16:27:51.397 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.152:0/2939852977 2023-12-08T16:21:57.014828+0000 2023-12-07T16:27:51.397 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/916788374 2023-12-08T16:20:48.497388+0000 2023-12-07T16:27:51.397 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/3526304932 2023-12-08T16:22:43.907227+0000 2023-12-07T16:27:51.397 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/184283085 2023-12-08T16:20:48.497388+0000 2023-12-07T16:27:51.397 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6826/1994067670 2023-12-08T16:19:18.402193+0000 2023-12-07T16:27:51.397 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/184283085 2023-12-08T16:20:48.497388+0000 2023-12-07T16:27:51.398 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/3523609322 2023-12-08T16:14:59.065782+0000 2023-12-07T16:27:51.398 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/2117148141 2023-12-08T16:14:27.410651+0000 2023-12-07T16:27:51.398 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/847416253 2023-12-08T16:22:43.907227+0000 2023-12-07T16:27:51.398 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/3827601892 2023-12-08T16:15:55.242508+0000 2023-12-07T16:27:51.398 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/3244857768 2023-12-08T16:22:43.907227+0000 2023-12-07T16:27:51.398 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/2671097541 2023-12-08T16:22:43.907227+0000 2023-12-07T16:27:51.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.399+0000 7f725a3aa700 1 -- 172.21.15.63:0/3647230453 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f723c06ce60 msgr2=0x7f723c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:51.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.399+0000 7f725a3aa700 1 --2- 172.21.15.63:0/3647230453 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f723c06ce60 0x7f723c06f310 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7244004560 tx=0x7f7244009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:51.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.399+0000 7f725a3aa700 1 -- 172.21.15.63:0/3647230453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72540fc220 msgr2=0x7f7254115950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:51.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.399+0000 7f725a3aa700 1 --2- 172.21.15.63:0/3647230453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72540fc220 0x7f7254115950 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7248002a50 tx=0x7f72480046b0 comp rx=0 tx=0).stop 2023-12-07T16:27:51.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.399+0000 7f725a3aa700 1 -- 172.21.15.63:0/3647230453 shutdown_connections 2023-12-07T16:27:51.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.399+0000 7f725a3aa700 1 --2- 172.21.15.63:0/3647230453 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f723c06ce60 0x7f723c06f310 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:51.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.399+0000 7f725a3aa700 1 --2- 172.21.15.63:0/3647230453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72540fb910 0x7f7254115410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:51.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.399+0000 7f725a3aa700 1 --2- 172.21.15.63:0/3647230453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72540fc220 0x7f7254115950 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:51.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.399+0000 7f725a3aa700 1 -- 172.21.15.63:0/3647230453 >> 172.21.15.63:0/3647230453 conn(0x7f72540f7600 msgr2=0x7f72540f8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:51.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.399+0000 7f725a3aa700 1 -- 172.21.15.63:0/3647230453 shutdown_connections 2023-12-07T16:27:51.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.399+0000 7f725a3aa700 1 -- 172.21.15.63:0/3647230453 wait complete. 2023-12-07T16:27:51.400 INFO:teuthology.orchestra.run.smithi063.stderr:listed 39 entries 2023-12-07T16:27:51.408 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-07T16:27:51.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:27:51.408 DEBUG:teuthology.orchestra.run.smithi063:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-07T16:27:51.450 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2023-12-07T16:27:51.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:27:51.450 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-07T16:27:51.558 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-07T16:27:51.559 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T16:27:51.670 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-07T16:27:51.670 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T16:27:51.737 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T16:27:51.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.863+0000 7f6885024700 1 -- 172.21.15.63:0/1267368932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68801019b0 msgr2=0x7f6880101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:51.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.863+0000 7f6885024700 1 --2- 172.21.15.63:0/1267368932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68801019b0 0x7f6880101d80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6870004940 tx=0x7f6870009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:51.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.863+0000 7f6885024700 1 -- 172.21.15.63:0/1267368932 shutdown_connections 2023-12-07T16:27:51.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.863+0000 7f6885024700 1 --2- 172.21.15.63:0/1267368932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68800fb970 0x7f68800fbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:51.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.863+0000 7f6885024700 1 --2- 172.21.15.63:0/1267368932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68801019b0 0x7f6880101d80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:51.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.863+0000 7f6885024700 1 -- 172.21.15.63:0/1267368932 >> 172.21.15.63:0/1267368932 conn(0x7f68800756d0 msgr2=0x7f68800f99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:51.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.864+0000 7f6885024700 1 -- 172.21.15.63:0/1267368932 shutdown_connections 2023-12-07T16:27:51.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.864+0000 7f6885024700 1 -- 172.21.15.63:0/1267368932 wait complete. 2023-12-07T16:27:51.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.864+0000 7f6885024700 1 Processor -- start 2023-12-07T16:27:51.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.864+0000 7f6885024700 1 -- start start 2023-12-07T16:27:51.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.864+0000 7f6885024700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68800fb970 0x7f688010e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:51.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.864+0000 7f6885024700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68801019b0 0x7f688010e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:51.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.864+0000 7f6885024700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688010ed90 con 0x7f68801019b0 2023-12-07T16:27:51.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.864+0000 7f6885024700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688010eed0 con 0x7f68800fb970 2023-12-07T16:27:51.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.865+0000 7f687e59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68801019b0 0x7f688010e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:51.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.865+0000 7f687e59c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68801019b0 0x7f688010e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55106/0 (socket says 172.21.15.63:55106) 2023-12-07T16:27:51.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.865+0000 7f687e59c700 1 -- 172.21.15.63:0/764459041 learned_addr learned my addr 172.21.15.63:0/764459041 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:27:51.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.865+0000 7f687ed9d700 1 --2- 172.21.15.63:0/764459041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68800fb970 0x7f688010e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:51.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.865+0000 7f687e59c700 1 -- 172.21.15.63:0/764459041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68800fb970 msgr2=0x7f688010e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:51.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.865+0000 7f687e59c700 1 --2- 172.21.15.63:0/764459041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68800fb970 0x7f688010e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:51.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.865+0000 7f687e59c700 1 -- 172.21.15.63:0/764459041 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6870005040 con 0x7f68801019b0 2023-12-07T16:27:51.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.865+0000 7f687e59c700 1 --2- 172.21.15.63:0/764459041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68801019b0 0x7f688010e850 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6874002a50 tx=0x7f68740046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:51.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.865+0000 7f68677fe700 1 -- 172.21.15.63:0/764459041 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6874007cc0 con 0x7f68801019b0 2023-12-07T16:27:51.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.865+0000 7f6885024700 1 -- 172.21.15.63:0/764459041 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6880117380 con 0x7f68801019b0 2023-12-07T16:27:51.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.865+0000 7f68677fe700 1 -- 172.21.15.63:0/764459041 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f687400f040 con 0x7f68801019b0 2023-12-07T16:27:51.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.865+0000 7f68677fe700 1 -- 172.21.15.63:0/764459041 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f687400d9c0 con 0x7f68801019b0 2023-12-07T16:27:51.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.865+0000 7f6885024700 1 -- 172.21.15.63:0/764459041 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6880117800 con 0x7f68801019b0 2023-12-07T16:27:51.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.866+0000 7f6885024700 1 -- 172.21.15.63:0/764459041 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6880064730 con 0x7f68801019b0 2023-12-07T16:27:51.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.867+0000 7f68677fe700 1 -- 172.21.15.63:0/764459041 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f687400db20 con 0x7f68801019b0 2023-12-07T16:27:51.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.867+0000 7f68677fe700 1 --2- 172.21.15.63:0/764459041 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f686806ce60 0x7f686806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:51.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.867+0000 7f68677fe700 1 -- 172.21.15.63:0/764459041 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f687408c160 con 0x7f68801019b0 2023-12-07T16:27:51.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.867+0000 7f687ed9d700 1 --2- 172.21.15.63:0/764459041 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f686806ce60 0x7f686806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:51.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.868+0000 7f687ed9d700 1 --2- 172.21.15.63:0/764459041 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f686806ce60 0x7f686806f310 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6870004f90 tx=0x7f6870009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:51.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:51.872+0000 7f68677fe700 1 -- 172.21.15.63:0/764459041 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6874055ee0 con 0x7f68801019b0 2023-12-07T16:27:52.070 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.074+0000 7f6885024700 1 -- 172.21.15.63:0/764459041 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6880108930 con 0x7f68801019b0 2023-12-07T16:27:52.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.075+0000 7f68677fe700 1 -- 172.21.15.63:0/764459041 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+17022 (secure 0 0 0) 0x7f6874059500 con 0x7f68801019b0 2023-12-07T16:27:52.072 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-07T16:27:52.072 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":91,"fsid":"8c493298-951b-11ee-95a2-87774f69a715","created":"2023-12-07T16:14:03.401177+0000","modified":"2023-12-07T16:26:15.751658+0000","last_up_change":"2023-12-07T16:26:14.749686+0000","last_in_change":"2023-12-07T16:18:06.682768+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T16:17:29.746142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-07T16:19:07.228292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-07T16:19:07.772770+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8cce319-d8dc-49e7-8596-ba27cc0f8836","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":58,"up_thru":90,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":1000489680},{"type":"v1","addr":"172.21.15.63:6803","nonce":1000489680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":1000489680},{"type":"v1","addr":"172.21.15.63:6805","nonce":1000489680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":1000489680},{"type":"v1","addr":"172.21.15.63:6809","nonce":1000489680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":1000489680},{"type":"v1","addr":"172.21.15.63:6807","nonce":1000489680}]},"public_addr":"172.21.15.63:6803/1000489680","cluster_addr":"172.21.15.63:6805/1000489680","heartbeat_back_addr":"172.21.15.63:6809/1000489680","heartbeat_front_addr":"172.21.15.63:6807/1000489680","state":["exists","up"]},{"osd":1,"uuid":"4f6f5869-8c07-49cf-8d7e-4eaab3f54f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":66,"up_from":70,"up_thru":90,"down_at":67,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":394258268},{"type":"v1","addr":"172.21.15.63:6811","nonce":394258268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":394258268},{"type":"v1","addr":"172.21.15.63:6813","nonce":394258268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":394258268},{"type":"v1","addr":"172.21.15.63:6817","nonce":394258268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":394258268},{"type":"v1","addr":"172.21.15.63:6815","nonce":394258268}]},"public_addr":"172.21.15.63:6811/394258268","cluster_addr":"172.21.15.63:6813/394258268","heartbeat_back_addr":"172.21.15.63:6817/394258268","heartbeat_front_addr":"172.21.15.63:6815/394258268","state":["exists","up"]},{"osd":2,"uuid":"42f79427-9cc3-42aa-91ab-4c28094437d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":71,"up_from":75,"up_thru":90,"down_at":72,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":2943243764},{"type":"v1","addr":"172.21.15.63:6819","nonce":2943243764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":2943243764},{"type":"v1","addr":"172.21.15.63:6821","nonce":2943243764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":2943243764},{"type":"v1","addr":"172.21.15.63:6825","nonce":2943243764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":2943243764},{"type":"v1","addr":"172.21.15.63:6823","nonce":2943243764}]},"public_addr":"172.21.15.63:6819/2943243764","cluster_addr":"172.21.15.63:6821/2943243764","heartbeat_back_addr":"172.21.15.63:6825/2943243764","heartbeat_front_addr":"172.21.15.63:6823/2943243764","state":["exists","up"]},{"osd":3,"uuid":"57bde3cf-c59d-4ccb-9d76-894dc48e51b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":76,"up_from":80,"up_thru":90,"down_at":77,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1412291615},{"type":"v1","addr":"172.21.15.152:6801","nonce":1412291615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1412291615},{"type":"v1","addr":"172.21.15.152:6803","nonce":1412291615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":1412291615},{"type":"v1","addr":"172.21.15.152:6807","nonce":1412291615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":1412291615},{"type":"v1","addr":"172.21.15.152:6805","nonce":1412291615}]},"public_addr":"172.21.15.152:6801/1412291615","cluster_addr":"172.21.15.152:6803/1412291615","heartbeat_back_addr":"172.21.15.152:6807/1412291615","heartbeat_front_addr":"172.21.15.152:6805/1412291615","state":["exists","up"]},{"osd":4,"uuid":"1de5b172-cde3-4139-a24d-8d8c2d3f71da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":33,"last_clean_end":81,"up_from":85,"up_thru":90,"down_at":82,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":2649809826},{"type":"v1","addr":"172.21.15.152:6809","nonce":2649809826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":2649809826},{"type":"v1","addr":"172.21.15.152:6811","nonce":2649809826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":2649809826},{"type":"v1","addr":"172.21.15.152:6815","nonce":2649809826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2649809826},{"type":"v1","addr":"172.21.15.152:6813","nonce":2649809826}]},"public_addr":"172.21.15.152:6809/2649809826","cluster_addr":"172.21.15.152:6811/2649809826","heartbeat_back_addr":"172.21.15.152:6815/2649809826","heartbeat_front_addr":"172.21.15.152:6813/2649809826","state":["exists","up"]},{"osd":5,"uuid":"15256051-a7b8-4fb0-8bc5-d865cb551551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":38,"last_clean_end":86,"up_from":90,"up_thru":90,"down_at":87,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3235100730},{"type":"v1","addr":"172.21.15.152:6817","nonce":3235100730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3235100730},{"type":"v1","addr":"172.21.15.152:6819","nonce":3235100730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3235100730},{"type":"v1","addr":"172.21.15.152:6823","nonce":3235100730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3235100730},{"type":"v1","addr":"172.21.15.152:6821","nonce":3235100730}]},"public_addr":"172.21.15.152:6817/3235100730","cluster_addr":"172.21.15.152:6819/3235100730","heartbeat_back_addr":"172.21.15.152:6823/3235100730","heartbeat_front_addr":"172.21.15.152:6821/3235100730","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:16:47.295417+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:17:06.714097+0000","dead_epoch":66},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:17:26.421837+0000","dead_epoch":71},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:17:44.503538+0000","dead_epoch":76},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:18:02.822131+0000","dead_epoch":81},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T16:18:21.243021+0000","dead_epoch":86}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":3,"to":2}]},{"pgid":"2.6","mappings":[{"from":3,"to":0}]},{"pgid":"2.b","mappings":[{"from":3,"to":0}]},{"pgid":"3.3","mappings":[{"from":4,"to":5}]},{"pgid":"3.a","mappings":[{"from":3,"to":0}]},{"pgid":"3.e","mappings":[{"from":4,"to":0}]},{"pgid":"3.12","mappings":[{"from":1,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/575811576":"2023-12-08T16:22:43.907227+0000","172.21.15.63:6801/2671097541":"2023-12-08T16:22:43.907227+0000","172.21.15.63:0/4071489754":"2023-12-08T16:22:43.907227+0000","172.21.15.152:6829/1927275654":"2023-12-08T16:21:57.014828+0000","172.21.15.63:6800/1052036735":"2023-12-08T16:14:59.065782+0000","172.21.15.63:0/273758973":"2023-12-08T16:20:48.497388+0000","172.21.15.63:0/4058757998":"2023-12-08T16:14:27.410651+0000","172.21.15.63:6801/1052036735":"2023-12-08T16:14:59.065782+0000","172.21.15.152:0/3306394385":"2023-12-08T16:21:57.014828+0000","172.21.15.63:6800/4069965417":"2023-12-08T16:15:55.242508+0000","172.21.15.63:6801/4069965417":"2023-12-08T16:15:55.242508+0000","172.21.15.63:0/127598952":"2023-12-08T16:14:59.065782+0000","172.21.15.63:0/363151719":"2023-12-08T16:14:59.065782+0000","172.21.15.152:0/3377928690":"2023-12-08T16:21:57.014828+0000","172.21.15.152:0/1067436557":"2023-12-08T16:21:57.014828+0000","172.21.15.152:6828/1927275654":"2023-12-08T16:21:57.014828+0000","172.21.15.152:0/2032192045":"2023-12-08T16:21:57.014828+0000","172.21.15.152:0/2803495435":"2023-12-08T16:21:57.014828+0000","172.21.15.63:0/1828519471":"2023-12-08T16:14:27.410651+0000","172.21.15.63:0/335090021":"2023-12-08T16:20:48.497388+0000","172.21.15.63:0/396959949":"2023-12-08T16:15:55.242508+0000","172.21.15.63:6827/1994067670":"2023-12-08T16:19:18.402193+0000","172.21.15.63:0/1270045079":"2023-12-08T16:15:55.242508+0000","172.21.15.63:6800/2117148141":"2023-12-08T16:14:27.410651+0000","172.21.15.63:0/997543331":"2023-12-08T16:14:27.410651+0000","172.21.15.63:0/1615460383":"2023-12-08T16:22:43.907227+0000","172.21.15.63:0/2684412075":"2023-12-08T16:20:48.497388+0000","172.21.15.152:0/2939852977":"2023-12-08T16:21:57.014828+0000","172.21.15.63:0/916788374":"2023-12-08T16:20:48.497388+0000","172.21.15.63:0/3526304932":"2023-12-08T16:22:43.907227+0000","172.21.15.63:6800/184283085":"2023-12-08T16:20:48.497388+0000","172.21.15.63:6826/1994067670":"2023-12-08T16:19:18.402193+0000","172.21.15.63:6801/184283085":"2023-12-08T16:20:48.497388+0000","172.21.15.63:0/3523609322":"2023-12-08T16:14:59.065782+0000","172.21.15.63:6801/2117148141":"2023-12-08T16:14:27.410651+0000","172.21.15.63:0/847416253":"2023-12-08T16:22:43.907227+0000","172.21.15.63:0/3827601892":"2023-12-08T16:15:55.242508+0000","172.21.15.63:0/3244857768":"2023-12-08T16:22:43.907227+0000","172.21.15.63:6800/2671097541":"2023-12-08T16:22:43.907227+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T16:27:52.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.077+0000 7f6885024700 1 -- 172.21.15.63:0/764459041 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f686806ce60 msgr2=0x7f686806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:52.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.077+0000 7f6885024700 1 --2- 172.21.15.63:0/764459041 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f686806ce60 0x7f686806f310 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6870004f90 tx=0x7f6870009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:52.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.077+0000 7f6885024700 1 -- 172.21.15.63:0/764459041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68801019b0 msgr2=0x7f688010e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:52.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.077+0000 7f6885024700 1 --2- 172.21.15.63:0/764459041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68801019b0 0x7f688010e850 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6874002a50 tx=0x7f68740046b0 comp rx=0 tx=0).stop 2023-12-07T16:27:52.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.077+0000 7f6885024700 1 -- 172.21.15.63:0/764459041 shutdown_connections 2023-12-07T16:27:52.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.077+0000 7f6885024700 1 --2- 172.21.15.63:0/764459041 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f686806ce60 0x7f686806f310 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:52.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.077+0000 7f6885024700 1 --2- 172.21.15.63:0/764459041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68800fb970 0x7f688010e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:52.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.077+0000 7f6885024700 1 --2- 172.21.15.63:0/764459041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68801019b0 0x7f688010e850 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:52.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.077+0000 7f6885024700 1 -- 172.21.15.63:0/764459041 >> 172.21.15.63:0/764459041 conn(0x7f68800756d0 msgr2=0x7f6880072900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:52.075 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.077+0000 7f6885024700 1 -- 172.21.15.63:0/764459041 shutdown_connections 2023-12-07T16:27:52.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.077+0000 7f6885024700 1 -- 172.21.15.63:0/764459041 wait complete. 2023-12-07T16:27:52.085 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:51 smithi063 ceph-mon[192008]: pgmap v199: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:52.085 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:51 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/554310994' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-07T16:27:52.085 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:51 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/3647230453' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-07T16:27:52.086 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T16:17:29.746142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-07T16:19:07.228292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-07T16:19:07.772770+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T16:27:52.087 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T16:27:52.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.215+0000 7f83a715b700 1 -- 172.21.15.63:0/1279866430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83a01034d0 msgr2=0x7f83a00fcb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:52.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.215+0000 7f83a715b700 1 --2- 172.21.15.63:0/1279866430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83a01034d0 0x7f83a00fcb40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f838c004940 tx=0x7f838c009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:52.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.215+0000 7f83a715b700 1 -- 172.21.15.63:0/1279866430 shutdown_connections 2023-12-07T16:27:52.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.215+0000 7f83a715b700 1 --2- 172.21.15.63:0/1279866430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83a01034d0 0x7f83a00fcb40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:52.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.215+0000 7f83a715b700 1 --2- 172.21.15.63:0/1279866430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83a0102b30 0x7f83a0102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:52.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.215+0000 7f83a715b700 1 -- 172.21.15.63:0/1279866430 >> 172.21.15.63:0/1279866430 conn(0x7f83a00f8680 msgr2=0x7f83a00faa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:52.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.215+0000 7f83a715b700 1 -- 172.21.15.63:0/1279866430 shutdown_connections 2023-12-07T16:27:52.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.215+0000 7f83a715b700 1 -- 172.21.15.63:0/1279866430 wait complete. 2023-12-07T16:27:52.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.216+0000 7f83a715b700 1 Processor -- start 2023-12-07T16:27:52.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.216+0000 7f83a715b700 1 -- start start 2023-12-07T16:27:52.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.216+0000 7f83a715b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83a0102b30 0x7f83a0113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:52.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.216+0000 7f83a715b700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83a01034d0 0x7f83a01137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:52.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.216+0000 7f83a715b700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a0113e00 con 0x7f83a01034d0 2023-12-07T16:27:52.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.216+0000 7f83a715b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a010d320 con 0x7f83a0102b30 2023-12-07T16:27:52.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.216+0000 7f839ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83a01034d0 0x7f83a01137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:52.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.216+0000 7f839ffff700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83a01034d0 0x7f83a01137b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55128/0 (socket says 172.21.15.63:55128) 2023-12-07T16:27:52.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.216+0000 7f839ffff700 1 -- 172.21.15.63:0/1349226253 learned_addr learned my addr 172.21.15.63:0/1349226253 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:27:52.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.216+0000 7f83a4ef7700 1 --2- 172.21.15.63:0/1349226253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83a0102b30 0x7f83a0113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:52.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.217+0000 7f839ffff700 1 -- 172.21.15.63:0/1349226253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83a0102b30 msgr2=0x7f83a0113270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:52.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.217+0000 7f839ffff700 1 --2- 172.21.15.63:0/1349226253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83a0102b30 0x7f83a0113270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:52.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.217+0000 7f839ffff700 1 -- 172.21.15.63:0/1349226253 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838c005040 con 0x7f83a01034d0 2023-12-07T16:27:52.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.217+0000 7f839ffff700 1 --2- 172.21.15.63:0/1349226253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83a01034d0 0x7f83a01137b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f838c008d80 tx=0x7f838c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:52.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.217+0000 7f839d7fa700 1 -- 172.21.15.63:0/1349226253 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f838c021070 con 0x7f83a01034d0 2023-12-07T16:27:52.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.217+0000 7f839d7fa700 1 -- 172.21.15.63:0/1349226253 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f838c0093b0 con 0x7f83a01034d0 2023-12-07T16:27:52.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.217+0000 7f83a715b700 1 -- 172.21.15.63:0/1349226253 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a010d5a0 con 0x7f83a01034d0 2023-12-07T16:27:52.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.217+0000 7f839d7fa700 1 -- 172.21.15.63:0/1349226253 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f838c00e070 con 0x7f83a01034d0 2023-12-07T16:27:52.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.217+0000 7f83a715b700 1 -- 172.21.15.63:0/1349226253 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a010db00 con 0x7f83a01034d0 2023-12-07T16:27:52.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.218+0000 7f83a715b700 1 -- 172.21.15.63:0/1349226253 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a0105000 con 0x7f83a01034d0 2023-12-07T16:27:52.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.218+0000 7f839d7fa700 1 -- 172.21.15.63:0/1349226253 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f838c01c5e0 con 0x7f83a01034d0 2023-12-07T16:27:52.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.219+0000 7f839d7fa700 1 --2- 172.21.15.63:0/1349226253 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f839006ce70 0x7f839006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:52.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.219+0000 7f839d7fa700 1 -- 172.21.15.63:0/1349226253 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f838c08d4f0 con 0x7f83a01034d0 2023-12-07T16:27:52.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.219+0000 7f83a4ef7700 1 --2- 172.21.15.63:0/1349226253 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f839006ce70 0x7f839006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:52.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.219+0000 7f83a4ef7700 1 --2- 172.21.15.63:0/1349226253 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f839006ce70 0x7f839006f320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8394009b80 tx=0x7f839400b040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:52.220 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.223+0000 7f839d7fa700 1 -- 172.21.15.63:0/1349226253 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f838c05ad80 con 0x7f83a01034d0 2023-12-07T16:27:52.241 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:51 smithi152 ceph-mon[175645]: pgmap v199: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:52.241 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:51 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/554310994' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-07T16:27:52.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:51 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/3647230453' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-07T16:27:52.423 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.426+0000 7f83a715b700 1 -- 172.21.15.63:0/1349226253 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f83a010e910 con 0x7f83a01034d0 2023-12-07T16:27:52.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.427+0000 7f839d7fa700 1 -- 172.21.15.63:0/1349226253 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7f838c05a910 con 0x7f83a01034d0 2023-12-07T16:27:52.424 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-07T16:27:52.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.429+0000 7f83a715b700 1 -- 172.21.15.63:0/1349226253 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f839006ce70 msgr2=0x7f839006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:52.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.429+0000 7f83a715b700 1 --2- 172.21.15.63:0/1349226253 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f839006ce70 0x7f839006f320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8394009b80 tx=0x7f839400b040 comp rx=0 tx=0).stop 2023-12-07T16:27:52.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.429+0000 7f83a715b700 1 -- 172.21.15.63:0/1349226253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83a01034d0 msgr2=0x7f83a01137b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:52.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.429+0000 7f83a715b700 1 --2- 172.21.15.63:0/1349226253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83a01034d0 0x7f83a01137b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f838c008d80 tx=0x7f838c009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:52.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.429+0000 7f83a715b700 1 -- 172.21.15.63:0/1349226253 shutdown_connections 2023-12-07T16:27:52.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.429+0000 7f83a715b700 1 --2- 172.21.15.63:0/1349226253 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f839006ce70 0x7f839006f320 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:52.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.429+0000 7f83a715b700 1 --2- 172.21.15.63:0/1349226253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83a0102b30 0x7f83a0113270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:52.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.429+0000 7f83a715b700 1 --2- 172.21.15.63:0/1349226253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83a01034d0 0x7f83a01137b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:52.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.429+0000 7f83a715b700 1 -- 172.21.15.63:0/1349226253 >> 172.21.15.63:0/1349226253 conn(0x7f83a00f8680 msgr2=0x7f83a00fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:52.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.429+0000 7f83a715b700 1 -- 172.21.15.63:0/1349226253 shutdown_connections 2023-12-07T16:27:52.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.429+0000 7f83a715b700 1 -- 172.21.15.63:0/1349226253 wait complete. 2023-12-07T16:27:52.438 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-07T16:27:52.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.567+0000 7f3517a91700 1 -- 172.21.15.63:0/2149364081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3510102bb0 msgr2=0x7f3510102f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:52.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.567+0000 7f3517a91700 1 --2- 172.21.15.63:0/2149364081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3510102bb0 0x7f3510102f80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f350c004940 tx=0x7f350c009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:52.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.567+0000 7f3517a91700 1 -- 172.21.15.63:0/2149364081 shutdown_connections 2023-12-07T16:27:52.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.567+0000 7f3517a91700 1 --2- 172.21.15.63:0/2149364081 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3510064bb0 0x7f3510065000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:52.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.567+0000 7f3517a91700 1 --2- 172.21.15.63:0/2149364081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3510102bb0 0x7f3510102f80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:52.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.567+0000 7f3517a91700 1 -- 172.21.15.63:0/2149364081 >> 172.21.15.63:0/2149364081 conn(0x7f3510071970 msgr2=0x7f3510071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:52.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.567+0000 7f3517a91700 1 -- 172.21.15.63:0/2149364081 shutdown_connections 2023-12-07T16:27:52.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.567+0000 7f3517a91700 1 -- 172.21.15.63:0/2149364081 wait complete. 2023-12-07T16:27:52.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.568+0000 7f3517a91700 1 Processor -- start 2023-12-07T16:27:52.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.568+0000 7f3517a91700 1 -- start start 2023-12-07T16:27:52.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.568+0000 7f3517a91700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3510064bb0 0x7f35101132c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:52.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.568+0000 7f3517a91700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3510102bb0 0x7f3510113800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:52.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.568+0000 7f3517a91700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3510113ee0 con 0x7f3510102bb0 2023-12-07T16:27:52.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.568+0000 7f3517a91700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351010d3b0 con 0x7f3510064bb0 2023-12-07T16:27:52.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.568+0000 7f351502c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3510102bb0 0x7f3510113800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:52.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.568+0000 7f351502c700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3510102bb0 0x7f3510113800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55142/0 (socket says 172.21.15.63:55142) 2023-12-07T16:27:52.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.568+0000 7f351502c700 1 -- 172.21.15.63:0/1394144753 learned_addr learned my addr 172.21.15.63:0/1394144753 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:27:52.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.568+0000 7f351582d700 1 --2- 172.21.15.63:0/1394144753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3510064bb0 0x7f35101132c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:52.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.568+0000 7f351502c700 1 -- 172.21.15.63:0/1394144753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3510064bb0 msgr2=0x7f35101132c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:52.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.568+0000 7f351502c700 1 --2- 172.21.15.63:0/1394144753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3510064bb0 0x7f35101132c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:52.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.568+0000 7f351502c700 1 -- 172.21.15.63:0/1394144753 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c005040 con 0x7f3510102bb0 2023-12-07T16:27:52.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.568+0000 7f351582d700 1 --2- 172.21.15.63:0/1394144753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3510064bb0 0x7f35101132c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T16:27:52.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.568+0000 7f351502c700 1 --2- 172.21.15.63:0/1394144753 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3510102bb0 0x7f3510113800 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f350000b790 tx=0x7f3500009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:52.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.569+0000 7f35067fc700 1 -- 172.21.15.63:0/1394144753 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f350000f770 con 0x7f3510102bb0 2023-12-07T16:27:52.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.569+0000 7f35067fc700 1 -- 172.21.15.63:0/1394144753 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f350000fd80 con 0x7f3510102bb0 2023-12-07T16:27:52.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.569+0000 7f3517a91700 1 -- 172.21.15.63:0/1394144753 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f351010d690 con 0x7f3510102bb0 2023-12-07T16:27:52.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.569+0000 7f35067fc700 1 -- 172.21.15.63:0/1394144753 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f350000d310 con 0x7f3510102bb0 2023-12-07T16:27:52.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.569+0000 7f3517a91700 1 -- 172.21.15.63:0/1394144753 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351010dc50 con 0x7f3510102bb0 2023-12-07T16:27:52.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.570+0000 7f3517a91700 1 -- 172.21.15.63:0/1394144753 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3510064730 con 0x7f3510102bb0 2023-12-07T16:27:52.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.570+0000 7f35067fc700 1 -- 172.21.15.63:0/1394144753 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f3500010420 con 0x7f3510102bb0 2023-12-07T16:27:52.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.570+0000 7f35067fc700 1 --2- 172.21.15.63:0/1394144753 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f34fc06ce70 0x7f34fc06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:52.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.570+0000 7f35067fc700 1 -- 172.21.15.63:0/1394144753 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f350008c2e0 con 0x7f3510102bb0 2023-12-07T16:27:52.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.570+0000 7f351582d700 1 --2- 172.21.15.63:0/1394144753 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f34fc06ce70 0x7f34fc06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:52.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.571+0000 7f351582d700 1 --2- 172.21.15.63:0/1394144753 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f34fc06ce70 0x7f34fc06f320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f350c00b3b0 tx=0x7f350c009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:52.613 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.575+0000 7f35067fc700 1 -- 172.21.15.63:0/1394144753 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3500056180 con 0x7f3510102bb0 2023-12-07T16:27:52.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.778+0000 7f3517a91700 1 -- 172.21.15.63:0/1394144753 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f3510109b30 con 0x7f3510102bb0 2023-12-07T16:27:52.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.778+0000 7f35067fc700 1 -- 172.21.15.63:0/1394144753 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v91) v1 ==== 107+0+11 (secure 0 0 0) 0x7f35000597a0 con 0x7f3510102bb0 2023-12-07T16:27:52.775 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-07T16:27:52.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.781+0000 7f3517a91700 1 -- 172.21.15.63:0/1394144753 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f34fc06ce70 msgr2=0x7f34fc06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:52.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.781+0000 7f3517a91700 1 --2- 172.21.15.63:0/1394144753 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f34fc06ce70 0x7f34fc06f320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f350c00b3b0 tx=0x7f350c009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:52.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.781+0000 7f3517a91700 1 -- 172.21.15.63:0/1394144753 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3510102bb0 msgr2=0x7f3510113800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:52.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.781+0000 7f3517a91700 1 --2- 172.21.15.63:0/1394144753 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3510102bb0 0x7f3510113800 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f350000b790 tx=0x7f3500009250 comp rx=0 tx=0).stop 2023-12-07T16:27:52.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.781+0000 7f3517a91700 1 -- 172.21.15.63:0/1394144753 shutdown_connections 2023-12-07T16:27:52.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.781+0000 7f3517a91700 1 --2- 172.21.15.63:0/1394144753 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f34fc06ce70 0x7f34fc06f320 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:52.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.781+0000 7f3517a91700 1 --2- 172.21.15.63:0/1394144753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3510064bb0 0x7f35101132c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:52.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.781+0000 7f3517a91700 1 --2- 172.21.15.63:0/1394144753 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3510102bb0 0x7f3510113800 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:52.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.781+0000 7f3517a91700 1 -- 172.21.15.63:0/1394144753 >> 172.21.15.63:0/1394144753 conn(0x7f3510071970 msgr2=0x7f35100fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:52.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.781+0000 7f3517a91700 1 -- 172.21.15.63:0/1394144753 shutdown_connections 2023-12-07T16:27:52.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.781+0000 7f3517a91700 1 -- 172.21.15.63:0/1394144753 wait complete. 2023-12-07T16:27:52.790 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-07T16:27:52.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.918+0000 7f4cf0345700 1 -- 172.21.15.63:0/2008003612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce8102b60 msgr2=0x7f4ce8102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:52.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.918+0000 7f4cf0345700 1 --2- 172.21.15.63:0/2008003612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce8102b60 0x7f4ce8102f30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8004940 tx=0x7f4cd8009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:52.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.918+0000 7f4cf0345700 1 -- 172.21.15.63:0/2008003612 shutdown_connections 2023-12-07T16:27:52.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.918+0000 7f4cf0345700 1 --2- 172.21.15.63:0/2008003612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ce8103500 0x7f4ce80fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:52.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.918+0000 7f4cf0345700 1 --2- 172.21.15.63:0/2008003612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce8102b60 0x7f4ce8102f30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:52.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.918+0000 7f4cf0345700 1 -- 172.21.15.63:0/2008003612 >> 172.21.15.63:0/2008003612 conn(0x7f4ce80f86f0 msgr2=0x7f4ce80fab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:52.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.918+0000 7f4cf0345700 1 -- 172.21.15.63:0/2008003612 shutdown_connections 2023-12-07T16:27:52.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.918+0000 7f4cf0345700 1 -- 172.21.15.63:0/2008003612 wait complete. 2023-12-07T16:27:52.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.919+0000 7f4cf0345700 1 Processor -- start 2023-12-07T16:27:52.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.919+0000 7f4cf0345700 1 -- start start 2023-12-07T16:27:52.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.919+0000 7f4cf0345700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ce8102b60 0x7f4ce806ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:52.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.919+0000 7f4cf0345700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce8103500 0x7f4ce8070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:52.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.919+0000 7f4cf0345700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce80709c0 con 0x7f4ce8103500 2023-12-07T16:27:52.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.919+0000 7f4cf0345700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce8070b00 con 0x7f4ce8102b60 2023-12-07T16:27:52.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.919+0000 7f4ced8e0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce8103500 0x7f4ce8070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:52.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.919+0000 7f4ced8e0700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce8103500 0x7f4ce8070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55164/0 (socket says 172.21.15.63:55164) 2023-12-07T16:27:52.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.919+0000 7f4ced8e0700 1 -- 172.21.15.63:0/1413038372 learned_addr learned my addr 172.21.15.63:0/1413038372 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:27:52.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.919+0000 7f4cee0e1700 1 --2- 172.21.15.63:0/1413038372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ce8102b60 0x7f4ce806ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:52.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.919+0000 7f4ced8e0700 1 -- 172.21.15.63:0/1413038372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ce8102b60 msgr2=0x7f4ce806ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:52.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.919+0000 7f4ced8e0700 1 --2- 172.21.15.63:0/1413038372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ce8102b60 0x7f4ce806ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:52.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.919+0000 7f4ced8e0700 1 -- 172.21.15.63:0/1413038372 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd8005040 con 0x7f4ce8103500 2023-12-07T16:27:52.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.919+0000 7f4ced8e0700 1 --2- 172.21.15.63:0/1413038372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce8103500 0x7f4ce8070480 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400c800 tx=0x7f4ce4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:52.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.920+0000 7f4cdeffd700 1 -- 172.21.15.63:0/1413038372 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ce40106f0 con 0x7f4ce8103500 2023-12-07T16:27:52.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.920+0000 7f4cdeffd700 1 -- 172.21.15.63:0/1413038372 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4ce4010d00 con 0x7f4ce8103500 2023-12-07T16:27:52.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.920+0000 7f4cf0345700 1 -- 172.21.15.63:0/1413038372 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce81197c0 con 0x7f4ce8103500 2023-12-07T16:27:52.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.920+0000 7f4cdeffd700 1 -- 172.21.15.63:0/1413038372 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ce40113a0 con 0x7f4ce8103500 2023-12-07T16:27:52.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.920+0000 7f4cf0345700 1 -- 172.21.15.63:0/1413038372 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce8119b10 con 0x7f4ce8103500 2023-12-07T16:27:52.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.921+0000 7f4cf0345700 1 -- 172.21.15.63:0/1413038372 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce80ffe70 con 0x7f4ce8103500 2023-12-07T16:27:52.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.921+0000 7f4cdeffd700 1 -- 172.21.15.63:0/1413038372 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f4ce4012400 con 0x7f4ce8103500 2023-12-07T16:27:52.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.922+0000 7f4cdeffd700 1 --2- 172.21.15.63:0/1413038372 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f4cd406ce70 0x7f4cd406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:52.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.922+0000 7f4cdeffd700 1 -- 172.21.15.63:0/1413038372 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f4ce408c3b0 con 0x7f4ce8103500 2023-12-07T16:27:52.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.922+0000 7f4cee0e1700 1 --2- 172.21.15.63:0/1413038372 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f4cd406ce70 0x7f4cd406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:52.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.922+0000 7f4cee0e1700 1 --2- 172.21.15.63:0/1413038372 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f4cd406ce70 0x7f4cd406f320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4cd800b3b0 tx=0x7f4cd8009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:52.923 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:52.926+0000 7f4cdeffd700 1 -- 172.21.15.63:0/1413038372 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4ce40561b0 con 0x7f4ce8103500 2023-12-07T16:27:53.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.128+0000 7f4cf0345700 1 -- 172.21.15.63:0/1413038372 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f4ce8064730 con 0x7f4ce8103500 2023-12-07T16:27:53.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.129+0000 7f4cdeffd700 1 -- 172.21.15.63:0/1413038372 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v91) v1 ==== 107+0+11 (secure 0 0 0) 0x7f4ce40597d0 con 0x7f4ce8103500 2023-12-07T16:27:53.126 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-07T16:27:53.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.131+0000 7f4cf0345700 1 -- 172.21.15.63:0/1413038372 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f4cd406ce70 msgr2=0x7f4cd406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:53.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.131+0000 7f4cf0345700 1 --2- 172.21.15.63:0/1413038372 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f4cd406ce70 0x7f4cd406f320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4cd800b3b0 tx=0x7f4cd8009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:53.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.131+0000 7f4cf0345700 1 -- 172.21.15.63:0/1413038372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce8103500 msgr2=0x7f4ce8070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:53.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.131+0000 7f4cf0345700 1 --2- 172.21.15.63:0/1413038372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce8103500 0x7f4ce8070480 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400c800 tx=0x7f4ce4004470 comp rx=0 tx=0).stop 2023-12-07T16:27:53.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.131+0000 7f4cf0345700 1 -- 172.21.15.63:0/1413038372 shutdown_connections 2023-12-07T16:27:53.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.131+0000 7f4cf0345700 1 --2- 172.21.15.63:0/1413038372 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7f4cd406ce70 0x7f4cd406f320 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:53.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.131+0000 7f4cf0345700 1 --2- 172.21.15.63:0/1413038372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ce8102b60 0x7f4ce806ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:53.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.131+0000 7f4cf0345700 1 --2- 172.21.15.63:0/1413038372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ce8103500 0x7f4ce8070480 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:53.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.131+0000 7f4cf0345700 1 -- 172.21.15.63:0/1413038372 >> 172.21.15.63:0/1413038372 conn(0x7f4ce80f86f0 msgr2=0x7f4ce80fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:53.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.131+0000 7f4cf0345700 1 -- 172.21.15.63:0/1413038372 shutdown_connections 2023-12-07T16:27:53.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.131+0000 7f4cf0345700 1 -- 172.21.15.63:0/1413038372 wait complete. 2023-12-07T16:27:53.139 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:52 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/764459041' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-07T16:27:53.139 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:52 smithi063 ceph-mon[192008]: pgmap v200: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:53.139 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:52 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/1349226253' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-07T16:27:53.139 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:52 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/1394144753' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-07T16:27:53.140 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-07T16:27:53.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:52 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/764459041' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-07T16:27:53.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:52 smithi152 ceph-mon[175645]: pgmap v200: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2023-12-07T16:27:53.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:52 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/1349226253' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-07T16:27:53.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:52 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/1394144753' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-07T16:27:53.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.268+0000 7fb4414e1700 1 -- 172.21.15.63:0/2777389189 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb43c101ac0 msgr2=0x7fb43c101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:53.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.268+0000 7fb4414e1700 1 --2- 172.21.15.63:0/2777389189 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb43c101ac0 0x7fb43c101e90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb42c004940 tx=0x7fb42c009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:53.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.268+0000 7fb4414e1700 1 -- 172.21.15.63:0/2777389189 shutdown_connections 2023-12-07T16:27:53.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.268+0000 7fb4414e1700 1 --2- 172.21.15.63:0/2777389189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb43c1023d0 0x7fb43c0fba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:53.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.268+0000 7fb4414e1700 1 --2- 172.21.15.63:0/2777389189 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb43c101ac0 0x7fb43c101e90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:53.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.268+0000 7fb4414e1700 1 -- 172.21.15.63:0/2777389189 >> 172.21.15.63:0/2777389189 conn(0x7fb43c071970 msgr2=0x7fb43c071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:53.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.268+0000 7fb4414e1700 1 -- 172.21.15.63:0/2777389189 shutdown_connections 2023-12-07T16:27:53.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.268+0000 7fb4414e1700 1 -- 172.21.15.63:0/2777389189 wait complete. 2023-12-07T16:27:53.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.269+0000 7fb4414e1700 1 Processor -- start 2023-12-07T16:27:53.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.269+0000 7fb4414e1700 1 -- start start 2023-12-07T16:27:53.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.269+0000 7fb4414e1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb43c101ac0 0x7fb43c10e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:53.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.269+0000 7fb4414e1700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb43c1023d0 0x7fb43c10e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:53.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.269+0000 7fb4414e1700 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c10eeb0 con 0x7fb43c1023d0 2023-12-07T16:27:53.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.269+0000 7fb4414e1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c10eff0 con 0x7fb43c101ac0 2023-12-07T16:27:53.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.269+0000 7fb43a7fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb43c1023d0 0x7fb43c10e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:53.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.269+0000 7fb43a7fc700 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb43c1023d0 0x7fb43c10e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55188/0 (socket says 172.21.15.63:55188) 2023-12-07T16:27:53.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.269+0000 7fb43a7fc700 1 -- 172.21.15.63:0/526888790 learned_addr learned my addr 172.21.15.63:0/526888790 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-07T16:27:53.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.270+0000 7fb43affd700 1 --2- 172.21.15.63:0/526888790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb43c101ac0 0x7fb43c10e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:53.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.270+0000 7fb43a7fc700 1 -- 172.21.15.63:0/526888790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb43c101ac0 msgr2=0x7fb43c10e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:53.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.270+0000 7fb43a7fc700 1 --2- 172.21.15.63:0/526888790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb43c101ac0 0x7fb43c10e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:53.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.270+0000 7fb43a7fc700 1 -- 172.21.15.63:0/526888790 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42c005040 con 0x7fb43c1023d0 2023-12-07T16:27:53.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.270+0000 7fb43a7fc700 1 --2- 172.21.15.63:0/526888790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb43c1023d0 0x7fb43c10e970 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb430002a50 tx=0x7fb430004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:53.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.270+0000 7fb4237fe700 1 -- 172.21.15.63:0/526888790 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb430007cc0 con 0x7fb43c1023d0 2023-12-07T16:27:53.270 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.270+0000 7fb4237fe700 1 -- 172.21.15.63:0/526888790 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb43000f040 con 0x7fb43c1023d0 2023-12-07T16:27:53.270 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.270+0000 7fb4414e1700 1 -- 172.21.15.63:0/526888790 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb43c1174a0 con 0x7fb43c1023d0 2023-12-07T16:27:53.270 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.270+0000 7fb4237fe700 1 -- 172.21.15.63:0/526888790 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb43000d920 con 0x7fb43c1023d0 2023-12-07T16:27:53.270 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.270+0000 7fb4414e1700 1 -- 172.21.15.63:0/526888790 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43c117920 con 0x7fb43c1023d0 2023-12-07T16:27:53.270 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.271+0000 7fb4414e1700 1 -- 172.21.15.63:0/526888790 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43c0fece0 con 0x7fb43c1023d0 2023-12-07T16:27:53.271 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.272+0000 7fb4237fe700 1 -- 172.21.15.63:0/526888790 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 38) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fb430009680 con 0x7fb43c1023d0 2023-12-07T16:27:53.271 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.272+0000 7fb4237fe700 1 --2- 172.21.15.63:0/526888790 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fb42406ce60 0x7fb42406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T16:27:53.271 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.272+0000 7fb4237fe700 1 -- 172.21.15.63:0/526888790 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6761+0+0 (secure 0 0 0) 0x7fb43008c1c0 con 0x7fb43c1023d0 2023-12-07T16:27:53.271 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.272+0000 7fb43affd700 1 --2- 172.21.15.63:0/526888790 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fb42406ce60 0x7fb42406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T16:27:53.271 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.273+0000 7fb43affd700 1 --2- 172.21.15.63:0/526888790 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fb42406ce60 0x7fb42406f310 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb42c004560 tx=0x7fb42c009e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T16:27:53.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.277+0000 7fb4237fe700 1 -- 172.21.15.63:0/526888790 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb430055f40 con 0x7fb43c1023d0 2023-12-07T16:27:53.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.491+0000 7fb4414e1700 1 -- 172.21.15.63:0/526888790 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb43c064730 con 0x7fb43c1023d0 2023-12-07T16:27:53.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.492+0000 7fb4237fe700 1 -- 172.21.15.63:0/526888790 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v91) v1 ==== 81+0+2301 (secure 0 0 0) 0x7fb430059560 con 0x7fb43c1023d0 2023-12-07T16:27:53.489 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/575811576 2023-12-08T16:22:43.907227+0000 2023-12-07T16:27:53.489 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/2671097541 2023-12-08T16:22:43.907227+0000 2023-12-07T16:27:53.489 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/4071489754 2023-12-08T16:22:43.907227+0000 2023-12-07T16:27:53.489 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.152:6829/1927275654 2023-12-08T16:21:57.014828+0000 2023-12-07T16:27:53.489 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/1052036735 2023-12-08T16:14:59.065782+0000 2023-12-07T16:27:53.489 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/273758973 2023-12-08T16:20:48.497388+0000 2023-12-07T16:27:53.490 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/4058757998 2023-12-08T16:14:27.410651+0000 2023-12-07T16:27:53.490 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/1052036735 2023-12-08T16:14:59.065782+0000 2023-12-07T16:27:53.490 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.152:0/3306394385 2023-12-08T16:21:57.014828+0000 2023-12-07T16:27:53.490 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/4069965417 2023-12-08T16:15:55.242508+0000 2023-12-07T16:27:53.490 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/4069965417 2023-12-08T16:15:55.242508+0000 2023-12-07T16:27:53.490 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/127598952 2023-12-08T16:14:59.065782+0000 2023-12-07T16:27:53.490 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/363151719 2023-12-08T16:14:59.065782+0000 2023-12-07T16:27:53.490 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.152:0/3377928690 2023-12-08T16:21:57.014828+0000 2023-12-07T16:27:53.491 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.152:0/1067436557 2023-12-08T16:21:57.014828+0000 2023-12-07T16:27:53.491 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.152:6828/1927275654 2023-12-08T16:21:57.014828+0000 2023-12-07T16:27:53.491 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.152:0/2032192045 2023-12-08T16:21:57.014828+0000 2023-12-07T16:27:53.491 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.152:0/2803495435 2023-12-08T16:21:57.014828+0000 2023-12-07T16:27:53.491 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1828519471 2023-12-08T16:14:27.410651+0000 2023-12-07T16:27:53.491 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/335090021 2023-12-08T16:20:48.497388+0000 2023-12-07T16:27:53.491 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/396959949 2023-12-08T16:15:55.242508+0000 2023-12-07T16:27:53.492 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6827/1994067670 2023-12-08T16:19:18.402193+0000 2023-12-07T16:27:53.492 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1270045079 2023-12-08T16:15:55.242508+0000 2023-12-07T16:27:53.492 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/2117148141 2023-12-08T16:14:27.410651+0000 2023-12-07T16:27:53.492 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/997543331 2023-12-08T16:14:27.410651+0000 2023-12-07T16:27:53.492 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1615460383 2023-12-08T16:22:43.907227+0000 2023-12-07T16:27:53.492 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/2684412075 2023-12-08T16:20:48.497388+0000 2023-12-07T16:27:53.492 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.152:0/2939852977 2023-12-08T16:21:57.014828+0000 2023-12-07T16:27:53.492 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/916788374 2023-12-08T16:20:48.497388+0000 2023-12-07T16:27:53.492 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/3526304932 2023-12-08T16:22:43.907227+0000 2023-12-07T16:27:53.492 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/184283085 2023-12-08T16:20:48.497388+0000 2023-12-07T16:27:53.493 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6826/1994067670 2023-12-08T16:19:18.402193+0000 2023-12-07T16:27:53.493 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/184283085 2023-12-08T16:20:48.497388+0000 2023-12-07T16:27:53.493 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/3523609322 2023-12-08T16:14:59.065782+0000 2023-12-07T16:27:53.493 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/2117148141 2023-12-08T16:14:27.410651+0000 2023-12-07T16:27:53.493 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/847416253 2023-12-08T16:22:43.907227+0000 2023-12-07T16:27:53.493 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/3827601892 2023-12-08T16:15:55.242508+0000 2023-12-07T16:27:53.493 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/3244857768 2023-12-08T16:22:43.907227+0000 2023-12-07T16:27:53.493 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/2671097541 2023-12-08T16:22:43.907227+0000 2023-12-07T16:27:53.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.494+0000 7fb4414e1700 1 -- 172.21.15.63:0/526888790 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fb42406ce60 msgr2=0x7fb42406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:53.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.494+0000 7fb4414e1700 1 --2- 172.21.15.63:0/526888790 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fb42406ce60 0x7fb42406f310 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb42c004560 tx=0x7fb42c009e30 comp rx=0 tx=0).stop 2023-12-07T16:27:53.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.494+0000 7fb4414e1700 1 -- 172.21.15.63:0/526888790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb43c1023d0 msgr2=0x7fb43c10e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T16:27:53.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.494+0000 7fb4414e1700 1 --2- 172.21.15.63:0/526888790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb43c1023d0 0x7fb43c10e970 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb430002a50 tx=0x7fb430004600 comp rx=0 tx=0).stop 2023-12-07T16:27:53.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.494+0000 7fb4414e1700 1 -- 172.21.15.63:0/526888790 shutdown_connections 2023-12-07T16:27:53.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.494+0000 7fb4414e1700 1 --2- 172.21.15.63:0/526888790 >> [v2:172.21.15.63:6800/685607028,v1:172.21.15.63:6801/685607028] conn(0x7fb42406ce60 0x7fb42406f310 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:53.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.494+0000 7fb4414e1700 1 --2- 172.21.15.63:0/526888790 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb43c101ac0 0x7fb43c10e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:53.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.494+0000 7fb4414e1700 1 --2- 172.21.15.63:0/526888790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb43c1023d0 0x7fb43c10e970 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T16:27:53.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.494+0000 7fb4414e1700 1 -- 172.21.15.63:0/526888790 >> 172.21.15.63:0/526888790 conn(0x7fb43c071970 msgr2=0x7fb43c0faf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T16:27:53.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.494+0000 7fb4414e1700 1 -- 172.21.15.63:0/526888790 shutdown_connections 2023-12-07T16:27:53.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-07T16:27:53.494+0000 7fb4414e1700 1 -- 172.21.15.63:0/526888790 wait complete. 2023-12-07T16:27:53.496 INFO:teuthology.orchestra.run.smithi063.stderr:listed 39 entries 2023-12-07T16:27:53.504 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-07T16:27:53.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:27:53.504 DEBUG:teuthology.orchestra.run.smithi152:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-07T16:27:53.555 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi152.front.sepia.ceph.com 2023-12-07T16:27:53.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:27:53.556 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-07T16:27:53.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:27:53.651 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2023-12-07T16:27:53.735 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-07T16:27:53.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:27:53.736 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-07T16:27:53.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:27:53.788 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2023-12-07T16:27:53.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:27:53.861 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2023-12-07T16:27:53.880 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-07T16:27:53.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:27:53.880 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-07T16:27:53.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T16:27:53.969 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2023-12-07T16:27:54.038 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-12-07T16:27:54.091 INFO:tasks.cephadm:Teardown begin 2023-12-07T16:27:54.092 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-07T16:27:54.119 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:53 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/1413038372' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-07T16:27:54.119 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:53 smithi063 ceph-mon[192008]: from='client.? 172.21.15.63:0/526888790' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-07T16:27:54.122 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-07T16:27:54.148 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:53 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/1413038372' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-07T16:27:54.148 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:53 smithi152 ceph-mon[175645]: from='client.? 172.21.15.63:0/526888790' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-07T16:27:54.151 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-12-07T16:27:54.151 DEBUG:teuthology.orchestra.run.smithi063:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-07T16:27:54.181 DEBUG:teuthology.orchestra.run.smithi152:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-07T16:27:54.210 INFO:tasks.cephadm:Stopping all daemons... 2023-12-07T16:27:54.210 INFO:tasks.cephadm.mon.smithi063:Stopping mon.smithi063... 2023-12-07T16:27:54.210 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-8c493298-951b-11ee-95a2-87774f69a715@mon.smithi063 2023-12-07T16:27:54.405 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:54 smithi063 systemd[1]: Stopping Ceph mon.smithi063 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:27:54.781 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:54 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-mon-smithi063[191966]: 2023-12-07T16:27:54.442+0000 7f0b49365700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi063 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-07T16:27:54.781 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:54 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-mon-smithi063[191966]: 2023-12-07T16:27:54.442+0000 7f0b49365700 -1 mon.smithi063@0(leader) e3 *** Got Signal Terminated *** 2023-12-07T16:27:55.093 INFO:journalctl@ceph.mon.smithi063.smithi063.stdout:Dec 07 16:27:54 smithi063 bash[225708]: ceph-8c493298-951b-11ee-95a2-87774f69a715-mon-smithi063 2023-12-07T16:27:55.101 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8c493298-951b-11ee-95a2-87774f69a715@mon.smithi063.service' 2023-12-07T16:27:55.172 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-07T16:27:55.172 INFO:tasks.cephadm.mon.smithi063:Stopped mon.smithi063 2023-12-07T16:27:55.172 INFO:tasks.cephadm.mon.smithi152:Stopping mon.smithi152... 2023-12-07T16:27:55.172 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-8c493298-951b-11ee-95a2-87774f69a715@mon.smithi152 2023-12-07T16:27:55.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:55 smithi152 systemd[1]: Stopping Ceph mon.smithi152 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:27:55.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:55 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-mon-smithi152[175622]: 2023-12-07T16:27:55.396+0000 7f6bf4f5c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi152 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-07T16:27:55.492 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:55 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-mon-smithi152[175622]: 2023-12-07T16:27:55.396+0000 7f6bf4f5c700 -1 mon.smithi152@1(peon) e3 *** Got Signal Terminated *** 2023-12-07T16:27:56.049 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 07 16:27:55 smithi152 bash[207290]: ceph-8c493298-951b-11ee-95a2-87774f69a715-mon-smithi152 2023-12-07T16:27:56.055 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8c493298-951b-11ee-95a2-87774f69a715@mon.smithi152.service' 2023-12-07T16:27:56.100 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-07T16:27:56.100 INFO:tasks.cephadm.mon.smithi152:Stopped mon.smithi152 2023-12-07T16:27:56.101 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-12-07T16:27:56.101 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-8c493298-951b-11ee-95a2-87774f69a715@osd.0 2023-12-07T16:27:56.405 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:27:56 smithi063 systemd[1]: Stopping Ceph osd.0 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:27:56.405 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:27:56 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-0[201963]: 2023-12-07T16:27:56.350+0000 7f0ce13fc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-07T16:27:56.405 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:27:56 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-0[201963]: 2023-12-07T16:27:56.350+0000 7f0ce13fc700 -1 osd.0 91 *** Got signal Terminated *** 2023-12-07T16:27:56.405 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:27:56 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-0[201963]: 2023-12-07T16:27:56.350+0000 7f0ce13fc700 -1 osd.0 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-07T16:28:02.405 INFO:journalctl@ceph.osd.0.smithi063.stdout:Dec 07 16:28:02 smithi063 bash[225863]: ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-0 2023-12-07T16:28:03.213 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8c493298-951b-11ee-95a2-87774f69a715@osd.0.service' 2023-12-07T16:28:03.256 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-07T16:28:03.256 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-12-07T16:28:03.256 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-12-07T16:28:03.257 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-8c493298-951b-11ee-95a2-87774f69a715@osd.1 2023-12-07T16:28:03.655 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:28:03 smithi063 systemd[1]: Stopping Ceph osd.1 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:28:03.656 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:28:03 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-1[209223]: 2023-12-07T16:28:03.503+0000 7f95b7737700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-07T16:28:03.656 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:28:03 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-1[209223]: 2023-12-07T16:28:03.503+0000 7f95b7737700 -1 osd.1 91 *** Got signal Terminated *** 2023-12-07T16:28:03.656 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:28:03 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-1[209223]: 2023-12-07T16:28:03.503+0000 7f95b7737700 -1 osd.1 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-07T16:28:09.404 INFO:journalctl@ceph.osd.1.smithi063.stdout:Dec 07 16:28:09 smithi063 bash[226125]: ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-1 2023-12-07T16:28:10.404 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8c493298-951b-11ee-95a2-87774f69a715@osd.1.service' 2023-12-07T16:28:10.445 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-07T16:28:10.445 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-12-07T16:28:10.445 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-12-07T16:28:10.445 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-8c493298-951b-11ee-95a2-87774f69a715@osd.2 2023-12-07T16:28:10.655 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:28:10 smithi063 systemd[1]: Stopping Ceph osd.2 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:28:11.154 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:28:10 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-2[216466]: 2023-12-07T16:28:10.710+0000 7fdf9cd0f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-07T16:28:11.155 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:28:10 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-2[216466]: 2023-12-07T16:28:10.710+0000 7fdf9cd0f700 -1 osd.2 91 *** Got signal Terminated *** 2023-12-07T16:28:11.155 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:28:10 smithi063 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-2[216466]: 2023-12-07T16:28:10.710+0000 7fdf9cd0f700 -1 osd.2 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-07T16:28:16.655 INFO:journalctl@ceph.osd.2.smithi063.stdout:Dec 07 16:28:16 smithi063 bash[226387]: ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-2 2023-12-07T16:28:17.686 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8c493298-951b-11ee-95a2-87774f69a715@osd.2.service' 2023-12-07T16:28:17.729 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-07T16:28:17.730 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-12-07T16:28:17.730 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-12-07T16:28:17.730 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-8c493298-951b-11ee-95a2-87774f69a715@osd.3 2023-12-07T16:28:18.242 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:28:17 smithi152 systemd[1]: Stopping Ceph osd.3 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:28:18.242 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:28:17 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-3[187922]: 2023-12-07T16:28:17.984+0000 7fa5c729d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-07T16:28:18.242 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:28:17 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-3[187922]: 2023-12-07T16:28:17.984+0000 7fa5c729d700 -1 osd.3 91 *** Got signal Terminated *** 2023-12-07T16:28:18.243 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:28:17 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-3[187922]: 2023-12-07T16:28:17.984+0000 7fa5c729d700 -1 osd.3 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-07T16:28:22.492 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:28:22 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-4[194776]: 2023-12-07T16:28:22.219+0000 7ff4b3889700 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-07T16:27:56.240608+0000 front 2023-12-07T16:27:56.240554+0000 (oldest deadline 2023-12-07T16:28:22.140557+0000) 2023-12-07T16:28:23.492 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:28:23 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-4[194776]: 2023-12-07T16:28:23.184+0000 7ff4b3889700 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-07T16:27:56.240608+0000 front 2023-12-07T16:27:56.240554+0000 (oldest deadline 2023-12-07T16:28:22.140557+0000) 2023-12-07T16:28:23.992 INFO:journalctl@ceph.osd.3.smithi152.stdout:Dec 07 16:28:23 smithi152 bash[207437]: ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-3 2023-12-07T16:28:24.492 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:28:24 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-4[194776]: 2023-12-07T16:28:24.187+0000 7ff4b3889700 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-07T16:27:56.240608+0000 front 2023-12-07T16:27:56.240554+0000 (oldest deadline 2023-12-07T16:28:22.140557+0000) 2023-12-07T16:28:24.850 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8c493298-951b-11ee-95a2-87774f69a715@osd.3.service' 2023-12-07T16:28:24.891 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-07T16:28:24.891 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-12-07T16:28:24.891 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-12-07T16:28:24.891 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-8c493298-951b-11ee-95a2-87774f69a715@osd.4 2023-12-07T16:28:25.128 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:28:24 smithi152 systemd[1]: Stopping Ceph osd.4 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:28:25.492 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:25 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:25.172+0000 7fc64136d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-07T16:27:59.088125+0000 front 2023-12-07T16:27:59.088108+0000 (oldest deadline 2023-12-07T16:28:24.987964+0000) 2023-12-07T16:28:25.492 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:28:25 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-4[194776]: 2023-12-07T16:28:25.130+0000 7ff4baa95700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-07T16:28:25.492 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:28:25 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-4[194776]: 2023-12-07T16:28:25.130+0000 7ff4baa95700 -1 osd.4 91 *** Got signal Terminated *** 2023-12-07T16:28:25.493 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:28:25 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-4[194776]: 2023-12-07T16:28:25.130+0000 7ff4baa95700 -1 osd.4 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-07T16:28:25.493 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:28:25 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-4[194776]: 2023-12-07T16:28:25.182+0000 7ff4b3889700 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-07T16:27:56.240608+0000 front 2023-12-07T16:27:56.240554+0000 (oldest deadline 2023-12-07T16:28:22.140557+0000) 2023-12-07T16:28:26.492 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:26 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:26.160+0000 7fc64136d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-07T16:27:59.088125+0000 front 2023-12-07T16:27:59.088108+0000 (oldest deadline 2023-12-07T16:28:24.987964+0000) 2023-12-07T16:28:26.493 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:28:26 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-4[194776]: 2023-12-07T16:28:26.159+0000 7ff4b3889700 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-07T16:27:56.240608+0000 front 2023-12-07T16:27:56.240554+0000 (oldest deadline 2023-12-07T16:28:22.140557+0000) 2023-12-07T16:28:27.493 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:28:27 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-4[194776]: 2023-12-07T16:28:27.111+0000 7ff4b3889700 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-07T16:27:56.240608+0000 front 2023-12-07T16:27:56.240554+0000 (oldest deadline 2023-12-07T16:28:22.140557+0000) 2023-12-07T16:28:27.493 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:27 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:27.203+0000 7fc64136d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-07T16:27:59.088125+0000 front 2023-12-07T16:27:59.088108+0000 (oldest deadline 2023-12-07T16:28:24.987964+0000) 2023-12-07T16:28:28.492 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:28:28 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-4[194776]: 2023-12-07T16:28:28.121+0000 7ff4b3889700 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-07T16:27:56.240608+0000 front 2023-12-07T16:27:56.240554+0000 (oldest deadline 2023-12-07T16:28:22.140557+0000) 2023-12-07T16:28:28.492 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:28 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:28.198+0000 7fc64136d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-07T16:27:59.088125+0000 front 2023-12-07T16:27:59.088108+0000 (oldest deadline 2023-12-07T16:28:24.987964+0000) 2023-12-07T16:28:29.492 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:28:29 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-4[194776]: 2023-12-07T16:28:29.087+0000 7ff4b3889700 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-07T16:27:56.240608+0000 front 2023-12-07T16:27:56.240554+0000 (oldest deadline 2023-12-07T16:28:22.140557+0000) 2023-12-07T16:28:29.492 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:29 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:29.215+0000 7fc64136d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-07T16:27:59.088125+0000 front 2023-12-07T16:27:59.088108+0000 (oldest deadline 2023-12-07T16:28:24.987964+0000) 2023-12-07T16:28:30.492 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:30 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:30.219+0000 7fc64136d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-07T16:27:59.088125+0000 front 2023-12-07T16:27:59.088108+0000 (oldest deadline 2023-12-07T16:28:24.987964+0000) 2023-12-07T16:28:30.492 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:30 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:30.219+0000 7fc64136d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.1 since back 2023-12-07T16:28:07.888918+0000 front 2023-12-07T16:28:07.888932+0000 (oldest deadline 2023-12-07T16:28:30.188850+0000) 2023-12-07T16:28:30.992 INFO:journalctl@ceph.osd.4.smithi152.stdout:Dec 07 16:28:30 smithi152 bash[207701]: ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-4 2023-12-07T16:28:31.492 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:31 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:31.229+0000 7fc64136d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-07T16:27:59.088125+0000 front 2023-12-07T16:27:59.088108+0000 (oldest deadline 2023-12-07T16:28:24.987964+0000) 2023-12-07T16:28:31.492 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:31 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:31.229+0000 7fc64136d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.1 since back 2023-12-07T16:28:07.888918+0000 front 2023-12-07T16:28:07.888932+0000 (oldest deadline 2023-12-07T16:28:30.188850+0000) 2023-12-07T16:28:31.923 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8c493298-951b-11ee-95a2-87774f69a715@osd.4.service' 2023-12-07T16:28:31.964 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-07T16:28:31.964 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-12-07T16:28:31.964 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-12-07T16:28:31.965 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-8c493298-951b-11ee-95a2-87774f69a715@osd.5 2023-12-07T16:28:32.194 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:32 smithi152 systemd[1]: Stopping Ceph osd.5 for 8c493298-951b-11ee-95a2-87774f69a715... 2023-12-07T16:28:32.194 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:32 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:32.196+0000 7fc64136d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-07T16:27:59.088125+0000 front 2023-12-07T16:27:59.088108+0000 (oldest deadline 2023-12-07T16:28:24.987964+0000) 2023-12-07T16:28:32.492 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:32 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:32.196+0000 7fc64136d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.1 since back 2023-12-07T16:28:07.888918+0000 front 2023-12-07T16:28:07.888932+0000 (oldest deadline 2023-12-07T16:28:30.188850+0000) 2023-12-07T16:28:32.492 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:32 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:32.208+0000 7fc646575700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-07T16:28:32.492 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:32 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:32.208+0000 7fc646575700 -1 osd.5 91 *** Got signal Terminated *** 2023-12-07T16:28:32.492 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:32 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:32.208+0000 7fc646575700 -1 osd.5 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-07T16:28:33.492 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:33 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:33.158+0000 7fc64136d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-07T16:27:59.088125+0000 front 2023-12-07T16:27:59.088108+0000 (oldest deadline 2023-12-07T16:28:24.987964+0000) 2023-12-07T16:28:33.492 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:33 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:33.158+0000 7fc64136d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.1 since back 2023-12-07T16:28:07.888918+0000 front 2023-12-07T16:28:07.888932+0000 (oldest deadline 2023-12-07T16:28:30.188850+0000) 2023-12-07T16:28:34.492 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:34 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:34.155+0000 7fc64136d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-07T16:27:59.088125+0000 front 2023-12-07T16:27:59.088108+0000 (oldest deadline 2023-12-07T16:28:24.987964+0000) 2023-12-07T16:28:34.492 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:34 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:34.155+0000 7fc64136d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.1 since back 2023-12-07T16:28:07.888918+0000 front 2023-12-07T16:28:07.888932+0000 (oldest deadline 2023-12-07T16:28:30.188850+0000) 2023-12-07T16:28:35.492 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:35 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:35.119+0000 7fc64136d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-07T16:27:59.088125+0000 front 2023-12-07T16:27:59.088108+0000 (oldest deadline 2023-12-07T16:28:24.987964+0000) 2023-12-07T16:28:35.492 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:35 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:35.119+0000 7fc64136d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.1 since back 2023-12-07T16:28:07.888918+0000 front 2023-12-07T16:28:07.888932+0000 (oldest deadline 2023-12-07T16:28:30.188850+0000) 2023-12-07T16:28:36.492 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:36 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:36.082+0000 7fc64136d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-07T16:27:59.088125+0000 front 2023-12-07T16:27:59.088108+0000 (oldest deadline 2023-12-07T16:28:24.987964+0000) 2023-12-07T16:28:36.492 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:36 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:36.082+0000 7fc64136d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.1 since back 2023-12-07T16:28:07.888918+0000 front 2023-12-07T16:28:07.888932+0000 (oldest deadline 2023-12-07T16:28:30.188850+0000) 2023-12-07T16:28:37.492 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:37 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:37.045+0000 7fc64136d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2023-12-07T16:27:59.088125+0000 front 2023-12-07T16:27:59.088108+0000 (oldest deadline 2023-12-07T16:28:24.987964+0000) 2023-12-07T16:28:37.492 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:37 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:37.045+0000 7fc64136d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6814 osd.1 since back 2023-12-07T16:28:07.888918+0000 front 2023-12-07T16:28:07.888932+0000 (oldest deadline 2023-12-07T16:28:30.188850+0000) 2023-12-07T16:28:37.492 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:37 smithi152 ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5[201496]: 2023-12-07T16:28:37.045+0000 7fc64136d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.63:6822 osd.2 since back 2023-12-07T16:28:10.189526+0000 front 2023-12-07T16:28:10.189468+0000 (oldest deadline 2023-12-07T16:28:36.589652+0000) 2023-12-07T16:28:37.992 INFO:journalctl@ceph.osd.5.smithi152.stdout:Dec 07 16:28:37 smithi152 bash[207958]: ceph-8c493298-951b-11ee-95a2-87774f69a715-osd-5 2023-12-07T16:28:38.846 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-8c493298-951b-11ee-95a2-87774f69a715@osd.5.service' 2023-12-07T16:28:38.886 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-07T16:28:38.886 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-12-07T16:28:38.887 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8c493298-951b-11ee-95a2-87774f69a715 --force --keep-logs 2023-12-07T16:28:53.494 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8c493298-951b-11ee-95a2-87774f69a715 --force --keep-logs 2023-12-07T16:29:07.957 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-07T16:29:07.996 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-07T16:29:08.027 INFO:tasks.cephadm:Archiving crash dumps... 2023-12-07T16:29:08.029 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/crash to /home/teuthworker/archive/gabrioux-2023-12-07_15:07:54-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7482152/remote/smithi063/crash 2023-12-07T16:29:08.030 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/crash -- . 2023-12-07T16:29:08.068 INFO:teuthology.orchestra.run.smithi063.stderr:tar: /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/crash: Cannot open: No such file or directory 2023-12-07T16:29:08.068 INFO:teuthology.orchestra.run.smithi063.stderr:tar: Error is not recoverable: exiting now 2023-12-07T16:29:08.070 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/crash to /home/teuthworker/archive/gabrioux-2023-12-07_15:07:54-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7482152/remote/smithi152/crash 2023-12-07T16:29:08.071 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/crash -- . 2023-12-07T16:29:08.097 INFO:teuthology.orchestra.run.smithi152.stderr:tar: /var/lib/ceph/8c493298-951b-11ee-95a2-87774f69a715/crash: Cannot open: No such file or directory 2023-12-07T16:29:08.097 INFO:teuthology.orchestra.run.smithi152.stderr:tar: Error is not recoverable: exiting now 2023-12-07T16:29:08.098 INFO:tasks.cephadm:Checking cluster log for badness... 2023-12-07T16:29:08.098 DEBUG:teuthology.orchestra.run.smithi063:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-07T16:29:08.144 INFO:teuthology.orchestra.run.smithi063.stderr:grep: /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph.log: No such file or directory 2023-12-07T16:29:08.146 INFO:tasks.cephadm:Compressing logs... 2023-12-07T16:29:08.146 DEBUG:teuthology.orchestra.run.smithi063:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-07T16:29:08.189 DEBUG:teuthology.orchestra.run.smithi152:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-07T16:29:08.218 INFO:teuthology.orchestra.run.smithi152.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-12-07T16:29:08.218 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-07T16:29:08.218 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-volume.log 2023-12-07T16:29:08.218 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-mgr.smithi152.sxayfb.log 2023-12-07T16:29:08.219 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi152.aovwwd.log 2023-12-07T16:29:08.219 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-volume.log: /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-mgr.smithi152.sxayfb.log: gzip -5 --verbose -- /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-osd.3.log 2023-12-07T16:29:08.219 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi152.aovwwd.log: gzip -5 --verbose -- /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi152.mrvngf.log 2023-12-07T16:29:08.221 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-osd.3.log: /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi152.mrvngf.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-07T16:29:08.221 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-osd.4.log 2023-12-07T16:29:08.221 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-mon.smithi152.log 2023-12-07T16:29:08.222 INFO:teuthology.orchestra.run.smithi063.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-07T16:29:08.222 INFO:teuthology.orchestra.run.smithi063.stderr:: No such file or directory 2023-12-07T16:29:08.222 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-mon.smithi063.log 2023-12-07T16:29:08.223 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-volume.log 2023-12-07T16:29:08.223 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-mon.smithi063.log: gzip -5 --verbose -- /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-osd.2.log 2023-12-07T16:29:08.223 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-osd.0.log 2023-12-07T16:29:08.223 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi063.yidolg.log 2023-12-07T16:29:08.224 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-osd.2.log: /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-osd.0.log: /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi063.yidolg.log: gzip -5 --verbose -- /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi063.gsjgcq.log 2023-12-07T16:29:08.224 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-osd.1.log 2023-12-07T16:29:08.225 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-osd.4.log: /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-mon.smithi152.log: 94.2% -- replaced with /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi152.aovwwd.log.gz 2023-12-07T16:29:08.225 INFO:teuthology.orchestra.run.smithi152.stderr: 90.9% -- replaced with /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-volume.log.gz 2023-12-07T16:29:08.229 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-osd.5.log 2023-12-07T16:29:08.229 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi063.gsjgcq.log: /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-osd.1.log: 90.6% -- replaced with /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-volume.log.gz 2023-12-07T16:29:08.230 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-mgr.smithi063.yohyyx.log 2023-12-07T16:29:08.230 INFO:teuthology.orchestra.run.smithi063.stderr: 91.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-07T16:29:08.232 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-mgr.smithi063.yohyyx.log: 91.2% -- replaced with /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi063.gsjgcq.log.gz 2023-12-07T16:29:08.265 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-osd.5.log: 88.5% -- replaced with /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-mgr.smithi152.sxayfb.log.gz 2023-12-07T16:29:08.416 INFO:teuthology.orchestra.run.smithi063.stderr: 88.2% -- replaced with /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-mgr.smithi063.yohyyx.log.gz 2023-12-07T16:29:08.493 INFO:teuthology.orchestra.run.smithi152.stderr: 92.5% -- replaced with /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-mon.smithi152.log.gz 2023-12-07T16:29:08.806 INFO:teuthology.orchestra.run.smithi063.stderr: 90.7% -- replaced with /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-mon.smithi063.log.gz 2023-12-07T16:29:12.144 INFO:teuthology.orchestra.run.smithi063.stderr: 93.4% -- replaced with /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-osd.2.log.gz 2023-12-07T16:29:12.611 INFO:teuthology.orchestra.run.smithi152.stderr: 93.1% -- replaced with /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-osd.4.log.gz 2023-12-07T16:29:13.099 INFO:teuthology.orchestra.run.smithi063.stderr: 93.5% -- replaced with /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-osd.0.log.gz 2023-12-07T16:29:13.121 INFO:teuthology.orchestra.run.smithi063.stderr: 93.4% -- replaced with /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-osd.1.log.gz 2023-12-07T16:29:14.105 INFO:teuthology.orchestra.run.smithi152.stderr: 93.0% -- replaced with /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-osd.5.log.gz 2023-12-07T16:29:14.967 INFO:teuthology.orchestra.run.smithi152.stderr: 92.8% -- replaced with /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-osd.3.log.gz 2023-12-07T16:29:46.734 INFO:teuthology.orchestra.run.smithi152.stderr: 93.2% -- replaced with /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi152.mrvngf.log.gz 2023-12-07T16:29:46.736 INFO:teuthology.orchestra.run.smithi152.stderr: 2023-12-07T16:29:46.736 INFO:teuthology.orchestra.run.smithi152.stderr:real 0m38.530s 2023-12-07T16:29:46.737 INFO:teuthology.orchestra.run.smithi152.stderr:user 0m53.893s 2023-12-07T16:29:46.737 INFO:teuthology.orchestra.run.smithi152.stderr:sys 0m1.913s 2023-12-07T16:29:58.023 INFO:teuthology.orchestra.run.smithi063.stderr: 92.8% -- replaced with /var/log/ceph/8c493298-951b-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi063.yidolg.log.gz 2023-12-07T16:29:58.025 INFO:teuthology.orchestra.run.smithi063.stderr: 2023-12-07T16:29:58.025 INFO:teuthology.orchestra.run.smithi063.stderr:real 0m49.819s 2023-12-07T16:29:58.025 INFO:teuthology.orchestra.run.smithi063.stderr:user 1m2.283s 2023-12-07T16:29:58.025 INFO:teuthology.orchestra.run.smithi063.stderr:sys 0m1.947s 2023-12-07T16:29:58.026 INFO:tasks.cephadm:Archiving logs... 2023-12-07T16:29:58.026 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/log/ceph to /home/teuthworker/archive/gabrioux-2023-12-07_15:07:54-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7482152/remote/smithi063/log 2023-12-07T16:29:58.027 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-07T16:30:06.481 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/log/ceph to /home/teuthworker/archive/gabrioux-2023-12-07_15:07:54-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7482152/remote/smithi152/log 2023-12-07T16:30:06.482 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-07T16:30:14.370 INFO:tasks.cephadm:Removing cluster... 2023-12-07T16:30:14.371 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8c493298-951b-11ee-95a2-87774f69a715 --force 2023-12-07T16:30:14.936 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 8c493298-951b-11ee-95a2-87774f69a715 --force 2023-12-07T16:30:15.476 INFO:tasks.cephadm:Removing cephadm ... 2023-12-07T16:30:15.476 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-07T16:30:15.496 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-07T16:30:15.514 INFO:tasks.cephadm:Teardown complete 2023-12-07T16:30:15.514 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-07T16:30:15.527 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-07T16:30:15.527 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-07T16:30:15.538 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-07T16:30:15.637 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-07T16:30:15.648 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-07T16:30:15.648 DEBUG:teuthology.orchestra.run.smithi063:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-07T16:30:15.650 DEBUG:teuthology.orchestra.run.smithi152:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-07T16:30:15.666 INFO:teuthology.orchestra.run.smithi063.stderr:bash: ntpq: command not found 2023-12-07T16:30:15.667 INFO:teuthology.orchestra.run.smithi152.stderr:bash: ntpq: command not found 2023-12-07T16:30:15.671 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-07T16:30:15.671 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2023-12-07T16:30:15.671 INFO:teuthology.orchestra.run.smithi063.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 56 +992us[ +991us] +/- 86ms 2023-12-07T16:30:15.671 INFO:teuthology.orchestra.run.smithi063.stdout:^* hv02.front.sepia.ceph.com 3 6 377 55 -836us[ -837us] +/- 70ms 2023-12-07T16:30:15.672 INFO:teuthology.orchestra.run.smithi063.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 +110us[ +110us] +/- 62ms 2023-12-07T16:30:15.672 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T16:30:15.672 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-07T16:30:15.673 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2023-12-07T16:30:15.673 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 56 +981us[ +995us] +/- 86ms 2023-12-07T16:30:15.673 INFO:teuthology.orchestra.run.smithi152.stdout:^* hv02.front.sepia.ceph.com 3 6 377 54 -843us[ -828us] +/- 70ms 2023-12-07T16:30:15.673 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 +99us[ +99us] +/- 62ms 2023-12-07T16:30:15.673 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T16:30:15.673 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-07T16:30:15.683 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-07T16:30:15.684 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-07T16:30:15.693 DEBUG:teuthology.orchestra.run.smithi063:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-07T16:30:15.814 DEBUG:teuthology.orchestra.run.smithi152:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-07T16:30:15.909 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-07T16:30:15.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T16:30:15.943 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-07T16:30:15.975 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T16:30:15.976 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-07T16:30:15.987 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-07T16:30:15.998 INFO:teuthology.task.internal:Duration was 2761.567962 seconds 2023-12-07T16:30:15.998 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-07T16:30:16.009 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-07T16:30:16.009 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-07T16:30:16.012 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-07T16:30:16.057 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-07T16:30:16.062 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-07T16:30:16.417 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-07T16:30:16.417 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi063.front.sepia.ceph.com 2023-12-07T16:30:16.417 DEBUG:teuthology.orchestra.run.smithi063:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-07T16:30:16.441 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi152.front.sepia.ceph.com 2023-12-07T16:30:16.441 DEBUG:teuthology.orchestra.run.smithi152:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-07T16:30:16.465 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-07T16:30:16.465 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-07T16:30:16.484 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-07T16:30:16.555 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-07T16:30:16.555 DEBUG:teuthology.orchestra.run.smithi063:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-07T16:30:16.558 DEBUG:teuthology.orchestra.run.smithi152:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-07T16:30:16.671 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-07T16:30:16.684 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-07T16:30:16.684 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-07T16:30:16.712 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-07T16:30:16.740 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-07T16:30:16.751 DEBUG:teuthology.orchestra.run.smithi063:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-07T16:30:16.755 DEBUG:teuthology.orchestra.run.smithi152:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-07T16:30:16.780 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = core 2023-12-07T16:30:16.807 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = core 2023-12-07T16:30:16.821 DEBUG:teuthology.orchestra.run.smithi063:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-07T16:30:16.851 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T16:30:16.851 DEBUG:teuthology.orchestra.run.smithi152:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-07T16:30:16.878 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T16:30:16.879 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-07T16:30:16.891 INFO:teuthology.task.internal:Transferring archived files... 2023-12-07T16:30:16.892 DEBUG:teuthology.misc:Transferring archived files from smithi063:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2023-12-07_15:07:54-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7482152/remote/smithi063 2023-12-07T16:30:16.892 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-07T16:30:16.939 DEBUG:teuthology.misc:Transferring archived files from smithi152:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2023-12-07_15:07:54-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7482152/remote/smithi152 2023-12-07T16:30:16.939 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-07T16:30:16.981 INFO:teuthology.task.internal:Removing archive directory... 2023-12-07T16:30:16.981 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-07T16:30:16.984 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-07T16:30:17.033 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-07T16:30:17.045 INFO:teuthology.task.internal:Not uploading archives. 2023-12-07T16:30:17.045 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-07T16:30:17.056 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-07T16:30:17.057 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-07T16:30:17.059 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-07T16:30:17.074 INFO:teuthology.orchestra.run.smithi063.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 7 16:30 /home/ubuntu/cephtest 2023-12-07T16:30:17.090 INFO:teuthology.orchestra.run.smithi152.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 7 16:30 /home/ubuntu/cephtest 2023-12-07T16:30:17.091 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-07T16:30:17.102 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-07T16:30:17.126 INFO:teuthology.nuke:Checking targets against current locks 2023-12-07T16:30:17.151 DEBUG:teuthology.nuke:shortname: smithi063 2023-12-07T16:30:17.152 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-07T16:30:17.174 DEBUG:teuthology.nuke:shortname: smithi152 2023-12-07T16:30:17.174 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-07T16:30:17.178 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-12-07_15:07:54-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7482152', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 15:34:58.274293', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMdkX0ifMc5MQBPHmmPkTr/2PPmk54gQ93LPTI2VSnNEEqw52sTbA95fqtHxqxTXjj0yHWt3dI3DP4guGqHJb28='} 2023-12-07T16:30:17.199 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-12-07_15:07:54-orch:cephadm-wip-guits-testing-2023-12-05-0857-distro-default-smithi/7482152', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 15:34:58.276243', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEKgUZN/csJi3+K7rT8Y1M6Cn9VpHCOy/ZwbazjO1Ae+Okm2FeIKHCkw+75HBd5DT2vY5V2QZRguAupLm4yD1ac='} 2023-12-07T16:30:17.230 INFO:teuthology.orchestra.console.smithi063:Power off 2023-12-07T16:30:17.230 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-07T16:30:17.256 DEBUG:teuthology.orchestra.console.smithi063:power off output: Chassis Power Control: Down/Off 2023-12-07T16:30:17.256 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T16:30:17.271 INFO:teuthology.orchestra.console.smithi152:Power off 2023-12-07T16:30:17.272 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-07T16:30:17.280 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on 2023-12-07T16:30:17.293 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2023-12-07T16:30:17.293 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T16:30:17.316 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-12-07T16:30:21.282 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T16:30:21.317 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T16:30:21.391 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on 2023-12-07T16:30:21.425 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-12-07T16:30:25.396 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T16:30:25.426 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T16:30:25.509 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on 2023-12-07T16:30:25.536 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-12-07T16:30:25.636 INFO:teuthology.orchestra.console.smithi152:Power off completed 2023-12-07T16:30:29.514 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T16:30:29.627 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off 2023-12-07T16:30:29.728 INFO:teuthology.orchestra.console.smithi063:Power off completed 2023-12-07T16:30:29.834 INFO:teuthology.run:Summary data: description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2761.567962408066 failure_reason: 'Command failed on smithi063 with status 1: ''sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c493298-951b-11ee-95a2-87774f69a715 -e sha1=e6605fb8725c25c4838cef6a39f30df73f1ed149 -- bash -c \''ceph versions | jq -e \''"\''"\''.overall | length == 1\''"\''"\''\''''' flavor: default owner: scheduled_gabrioux@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=924e4a7a8b1e40b5b68f8c06f4ee930b status: fail success: false 2023-12-07T16:30:29.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T16:30:29.923 INFO:teuthology.run:FAIL